Inference Benchmarks

Performance metrics across hardware, software, and model configurations

Early Preview

We are working to certify more internal benchmarks to be published. If you're interested in providing hardware or have questions, email benchmarks@haimaker.ai.

Filters

Active Filters:Tag: Llama-3.3-70B-Instruct

Found 1 benchmark suite

Date	Suite Name	GPU	Model	Output TPS	Input TPS	Energy Cost (kWh/MT)
2/19/2026	Tenstorrent Wormhole (32x) - Llama-3.3-70B-Instruct	Wormhole 32x 384GB	Llama-3.3-70B-Instruct meta-llama	1,091.26	4,654.03	0.13