
Zero-Dependencies Java 25+ Business Agents: Running locally
About this event
In-person only. Register here ๐ https://www.meetup.com/java-vienna/events/314639734/
Modern Java provides all the functionality required for local LLM inference and agent orchestration, eliminating the need for external dependencies.
LightMetal directly binds Llama.cpp from Java using the Foreign Function and Memory API (FFM), eliminating the need for JNI or native wrappers. It runs open models such as Mistral, Gemma, and Llama on your machine.
Zsmith is built on LightMetal and uses the Boundary-Control-Entity (BCE) model to structure agents. It loads tools and skills as ServiceLoader plugins and runs tool calls and streaming on Virtual Threads. Local inference and remote models work with the same agent code over the JDK's HttpClient.
Topics:
- One-line installation, no build tools, no package managers
- FFM in practice: calling native libraries without JNI
- Running Mistral, Gemma and Llama locally in pure Java
- ServiceLoader as a plugin mechanism for tools and skills
- BCE applied to AI agents
- Virtual Threads for streaming, tool calls and parallel inference
- Switching between local and remote models without changing the agent
- Plain JDK: HttpClient, records, sealed types and pattern matching
- Packaging agents as single-file Java applications
Everything is demonstrated live with code. Your questions are highly welcome โ the more, the better!
See you at: https://airhacks.live and https://airhacks.university!
Source: meetup