AI product
Fireworks AI's inference engine for serving AI models. It uses custom-built CUDA kernels that can be optimized for a customer's workload to target latency and performance requirements. The video credits FireAttention and related Fireworks serving work with enabling 13× faster inference for Cursor's Composer 2.
1 use taken from transcripts — each links to the moment in the video.
Fireworks' own inference engine, including custom-built CUDA kernels, that can be optimized for a customer's specific workload to hit latency and performance targets — credited with 13x faster inference for Cursor's Composer 2.
1 in the library.