Inference Benchmarks

Performance metrics across hardware, software, and model configurations

Early Preview

We are working to certify more internal benchmarks to be published. If you're interested in providing hardware or have questions, email benchmarks@haimaker.ai.

Filters

Active Filters:Tag: openai

Found 4 benchmark suites

Date	Suite Name	GPU	Model	Output TPS	Input TPS	Energy Cost (kWh/MT)
12/19/2025	NVIDIA A100-SXM4-80GB (2x) - gpt-oss-120b Reasoning	NVIDIA A100-SXM4-80GB 2x 160GB	gpt-oss-120b openai	3,860.39	15,892.90	0.01
11/13/2025	NVIDIA H100 80GB HBM3 (8x) - gpt-oss-120b	NVIDIA H100 80GB HBM3 8x 632GB	gpt-oss-120b openai	18,672.47	50,200.55	0.02
11/5/2025	NVIDIA H200 NVL (2x) - gpt-oss-120b	NVIDIA H200 NVL 2x 280GB	gpt-oss-120b openai	3,166.06	11,929.37	0.01
11/2/2025	NVIDIA A100 80GB PCIe (2x) - gpt-oss-120b	NVIDIA A100 80GB PCIe 2x 160GB	gpt-oss-120b openai	1,673.99	5,556.37	0.02