Dataset updates

A snapshot should explain exactly how it changed.

V1 is fixed to one reviewed source commit. Promotion is atomic: importer, schemas, provenance, coverage and deterministic hashes must all pass first.

Releasev6.0
DivisionClosed
Results145
Systems50
Accelerators13
Quarantined0
Manifest

Immutable source boundary

PINNED
Repository
mlcommons/inference_results_v6.0 ↗
Commit
4d3916ac9cf474b679cdfcf492d43a0559418ad1
Snapshot SHA-256
sha256:d953bc0bac8cd2a80fd2118a23628cf3e9bfa2148de1e79cb9fe973e28e671af
Last reviewed
2026-09-02T07:45:00.000Z
Freshness
pinned; no live scraping
Coverage matrix

What the source can actually support

WorkloadScenarioAcceptedVendorsFamilies
llama3.1-8bOffline19NVIDIAB200, B300, H200, RTX PRO 4500 Blackwell, RTX PRO 6000 Blackwell
llama3.1-8bServer19NVIDIAB200, B300, H200, RTX PRO 4500 Blackwell, RTX PRO 6000 Blackwell
llama3.1-8bInteractive10NVIDIAB200, B300, RTX PRO 6000 Blackwell
gpt-oss-120bOffline27AMD, Intel, NVIDIAArc Pro B60, Arc Pro B70, B200, B300, GB200 NVL72, GB300 NVL72, H200, Instinct MI355X, RTX PRO 6000 Blackwell
gpt-oss-120bServer27AMD, Intel, NVIDIAArc Pro B60, Arc Pro B70, B200, B300, GB200 NVL72, GB300 NVL72, H200, Instinct MI355X, RTX PRO 6000 Blackwell
gpt-oss-120bInteractive4NVIDIAB200, B300, GB200 NVL72, GB300 NVL72
deepseek-r1Offline18NVIDIAB200, B300, GB200 NVL72, GB300 NVL72
deepseek-r1Server18NVIDIAB200, B300, GB200 NVL72, GB300 NVL72
deepseek-r1Interactive3NVIDIAB300, GB200 NVL72, GB300 NVL72
Quarantine

No records excluded

All 145 allowlisted base performance summaries passed the current reviewed registry and validity rules. The negative fixture still proves ambiguous identities and counts are rejected.

Changelog

Snapshot history

2026-09-02T07:45:00.000ZInitial import · +145

Initial pinned MLPerf Inference v6.0 Closed snapshot.

sha256:d953bc0bac8cd2a80fd2118a23628cf3e9bfa2148de1e79cb9fe973e28e671af
Manual update and rollback

Review is a deliberate operation.

# Update candidate
git -C ../mlperf-inference-v6 fetch origin
# edit the pinned commit only after review
npm run data:fixture
npm run data:full
npm run data:verify
npm test && npm run build

# Rollback
git revert <dataset-promotion-commit>
npm run data:verify
npm run build