AI product

FireAttention

Fireworks AI's inference engine for serving AI models. It uses custom-built CUDA kernels that can be optimized for a customer's workload to target latency and performance requirements. The video credits FireAttention and related Fireworks serving work with enabling 13× faster inference for Cursor's Composer 2.

Mentioned in 1 video ↓

What FireAttention is used for

1 use taken from transcripts — each links to the moment in the video.

  • Fireworks' own inference engine, including custom-built CUDA kernels, that can be optimized for a customer's specific workload to hit latency and performance targets — credited with 13x faster inference for Cursor's Composer 2.

Videos mentioning FireAttention

1 in the library.