Tokens / second
STAR is the first model with a 32M token context window, able to generate thousands of tokens per second on a single GPU.
Decoding throughput, tokens per second.
STAR outputs measured on a single NVIDIA 6000 Pro.
How far does $100 go?
Why STAR is different
Not another wrapper.
A new architecture, built for long context.
Actually parse video, audio, text, data all in parallel.
Programs
MIT TNT Research
Together.ai Accelerator