| Model Key | Provider | Model | NS avg (s) | NS TPS | TTFB (s) | Stream (s) | ST TPS |
|---|
Definitions
- NS avg (s): Average end-to-end time for a non-streaming request.
- NS TPS: Non-streaming throughput in tokens/sec (completion tokens divided by non-streaming duration, aggregated over runs).
- TTFB (s): Time-to-first-token during streaming; measured from stream start until first chunk arrives.
- Stream (s): Total streaming time from start to last chunk.
- ST TPS: Streaming throughput in tokens/sec (completion tokens divided by total streaming time; estimated from characters if usage is unavailable).