Measured
The result must come from an executable artifact and a recorded run.
A benchmark without model, hardware, mode and date is marketing, not evidence. This ledger separates operational facts from lab results and future work.
The result must come from an executable artifact and a recorded run.
Model, hardware, precision, workload and operating mode remain attached to the number.
A lab result is never presented as a customer or production outcome.
New measurements can supersede old ones, without rewriting history.
Bonsai-8B Q2_0, H100 SXM5, deterministic single-stream greedy. Internal measurement from July 2026.
Lab benchmark; it does not represent a multi-user production workload.
Inference is delivered by a Go binary with CPU, Metal and CUDA backends. PyTorch remains limited to training and export.
Support varies by architecture and modality.
The ledger is intentionally small. DGL Tech would rather publish three defensible facts than thirty numbers that cannot survive technical review.