This presentation was recorded at GOTO Copenhagen 2024. #GOTOcon #GOTOcph
https://gotocph.com
Thomas Vitale - Software Architect at Systematic & Author of "Cloud Native Spring in Action" & CNCF Ambassador @ThomasVitale
RESOURCES
https://www.thomasvitale.com
https://twitter.com/vitalethomas
https://linkedin.com/in/vitalethomas
https://github.com/ThomasVitale
ABSTRACT
Imagine you're a music composer struggling to find inspiration for a pivotal movie scene. Then, you remember you’re also a software engineer, and the solution becomes suddenly obvious. Join me in this session, where I'll demonstrate how I enhanced my music composition process by harnessing the power of Java and AI.
This presentation will discuss the core architectural patterns for introducing AI capabilities into an existing software system, exploring concepts like templated prompts, agent tools, and integration of external knowledge. The Java ecosystem is getting more and more capabilities for building AI applications. But are they ready for production? Are there any gaps?
Throughout the session, I’ll build a "composer assistant" application using Java and an AI Orchestrator (LangChain4J, Spring AI) to showcase how to make an LLM application production-ready. Is the developer experience affected when working locally with language models? How is observability different when it comes to tokens? Can we ensure resilience across the many integrations orchestrated by the AI? What strategies are available for deploying LLM applications?
In a final twist, you’ll choose which movie scene to score, and I’ll compose and perform the music live for it, supported by AI. Will it meet the mark? There’s only one way to find out: join me in exploring the practical side of AI applications, where Java and Generative AI offer tangible solutions to real-world use cases. Aaaaand action! [...]
TIMECODES
00:00 Intro
01:28 GenAI
02:22 The WHY factor
07:25 Demo
10:21 Text classification
10:43 Demo
15:58 Semantic search
17:10 Demo
18:58 Question answering with docs
19:50 Demo
24:08 Structured data extraction
24:33 Speech transcription
24:52 Demo
33:20 Final product
34:00 Outro
Download slides and read the full abstract here:
https://gotocph.com/2024/sessions/3138
RECOMMENDED BOOKS
Thomas Vitale • Cloud Native Spring in Action • https://amzn.to/3kLu1ns
Mauricio Salatino • Platform Engineering on Kubernetes • https://amzn.to/3X14qZK
Mark Heckler • Spring Boot: Up & Running • https://amzn.to/3c0NK19
Phil Winder • Reinforcement Learning • https://amzn.to/3t1S1VZ
Kelleher & Tierney • Data Science (The MIT Press Essential Knowledge series) • https://amzn.to/3AQmIRg
https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.instagram.com/goto_con
https://www.facebook.com/GOTOConferences
#Java #AI #ArtificialIntelligence #AIAssistant #LLM #ComposerAssistant #AIComposer #ThomasVitale
CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1