jitLLM

TornadoVM 8.0.0 is out! After 10 years: thank you, Graal. Java kernels are now compiled by TC, our own pure-Java compiler to CUDA, OpenCL and Metal. • AOT ready • No JVMCI • Now Apache 2.0 • Your code doesn't change 👉 www.tornadovm.org/blogs/tornad... #OpenSource #Java #AI #GPU

Great to see @tornadovm.org and @jitllm.io hit #1 on Hacker News!” Check out the latest article on @infoq.com by @ogkittylyst.bsky.social : www.infoq.com/news/2026/10...

Had so much fun at #JDD 2026 in Kraków yesterday. I presented “Java Goes CUDA-Native”: new @tornadovm.org features that let @jitllm.io run LLM inference at GPU-native speed, from Java. tornadovm.org jitllm.io #opensource #Java #TornadoVM #GPU #AI

Yesterday my colleagues @maryxek.bsky.social and @mikepapadim.bsky.social showed live demos about using NVIDIA cuFFT and cuBLAS with @tornadovm.org for signal filtering and @jitllm.io! NVIDIA performance is a jar away from Java. #Java #CUDA #TornadoVM

Optimized GPU libraries (e.g. cuBLAS, cuDNN, etc.) by NVIDIA, now one jar away for your Java - without caring about JNI. We also show demos with Apache Flink and @jitllm.io. Watch our talk in @devoxx.com 👇 youtu.be/6SPnBmQrYEk?... #opensource #AI #TornadoVM #Java #GPU

We are at @devoxx.com, getting ready for our first hands-on #GPU lab for #Java! We will be in BOF2 room at 16:50, with live demos! @tornadovm.org @jitllm.io

jitLLM is part of the @langchain4j.dev 1.21.0 release! 🚀 Read more here: docs.langchain4j.dev/integrations... #opensource #LLM #GPU #Java #LangChain4j #Inference

Our latest addition to the TornadoVM family. Blazing fast AI inference at native speed!

Can Java compete with llama.cpp/ollama? YES! With @jitllm.io! jitLLM uses NVIDIA CUDA features and libraries (cuBLAS, cuDNN) and reaches 0.90× to 1.12× of llama.cpp's throughput! jitLLM is empowered by @tornadovm.org and will be soon in @langchain4j.dev and @quarkus.io. github.com/beehive-lab/...

Next week we will be in @devoxx.com and speak about @tornadovm.org, @jitllm.io and how we accelerate Java on GPUs, using #NVIDIA native libraries! Come and talk to us, to learn more! #opensource #Java #AI #TornadoVM #jitLLM #GPU