Tool
TornadoVM is an add-on to the Java Virtual Machine that compiles Java code at runtime into GPU kernels, including NVIDIA PTX and SPIR-V targets. It lets developers write GPU programs in Java; the discussed example implements a GPU version of Llama 3 entirely in Java.
1 use taken from transcripts — each links to the moment in the video.
An add-on to the JVM that compiles Java code on the fly into GPU kernels (PTX for Nvidia, SPIR-V, etc.), letting developers write GPU programs in Java. The blog post discussed walks through writing a simple kernel and running a GPU implementation of llama 3 entirely in Java on it.
1 in the library.