QEncode Benchmark

Blog

Technical articles on quantum algorithm benchmarking, VQE methodology, and reproducible quantum chemistry evaluation.

·11 min read

We Said Every Result Was Reproducible. Then We Tried to Check.

Our verifier could not re-run 29 of our 54 published entries, and nobody had noticed — a verifier that errors out looks like a broken command, not a broken guarantee. Three bugs later, all 54 reproduce. Then CI failed, because we had asked for bit-identical energies across machines and the numerics do not support that. The finding that outlasts the bugs: an entry certified close to the threshold is not robustly certified.

reproducibilityverificationcertification marginCICOBYLAbenchmark integrity
Read →
·9 min read

The Optimal Shot Allocation Rule Made Our Energies 50× Worse

Neyman allocation is the provably variance-minimising way to split a VQE shot budget across Pauli terms. Estimated from a pilot sample it deletes the largest-coefficient terms outright — median error 604 mHa against 11 for the simple scheme it was meant to beat. Judged on standard deviation it looked like the winner. Two cheap fixes recover a validated 2.3× shot saving across 10 molecules.

shot allocationNeyman allocationmeasurementestimator biasRosalinvariance reduction
Read →
·6 min read

The Four Things That Make a VQE Result Reproducible

Reproducibility is not one property but four: deterministic arithmetic, recorded package versions, a recorded seed, and a recorded code version. Setting a random seed — the thing most people reach for first — fixes none of the hard one. We wrote all four down and built a free checker (NumPy and SciPy only) that runs on your own code and prints the one-line fix.

reproducibilityOMP_NUM_THREADSscorecardtoolingprovenance
Read →
·11 min read

We Audited Our Own VQE Benchmark and Found the Numbers Were Partly Luck

Threaded BLAS sums floating point in nondeterministic order. Gradient-free COBYLA turns that 1e-16 noise into a different local minimum — the same LiH command returned 8.99 mHa or 0.53 mHa on identical hardware. We traced it, fixed it in one line, and re-ran all 46 entries. ADAPT-VQE with analytic gradients was never affected. Also: H₁₀ certified at 9.977 mHa, 300 operators, 20 qubits.

reproducibilityOMP_NUM_THREADSCOBYLAADAPT-VQEH₁₀v4.4
Read →
·9 min read

ADAPT-VQE Certifies Benzene — How We Broke the Medium Molecule Barrier

COBYLA + UCCSD hits a wall at ~400 parameters. ADAPT-VQE breaks it by building the ansatz one operator at a time, selecting only what matters. We used it to certify H₆ (28 operators) and benzene (10 operators) — the first aromatic molecule certified on QEncode.

ADAPT-VQEbenzeneH₆medium moleculesv4.3
Read →
·8 min read

Certifying N₂: QEncode Benchmarks the Triple Bond

N₂ is one of the hardest molecules in quantum chemistry — a triple bond, strong multireference character, and an orbital manifold that defeats standard HF partitioning. Here's how we certified it at cc-pVDZ with CASSCF orbitals, 12 qubits, and a 2 mHa gap.

N₂CASSCF12-qubitUCCSDbenchmarkDARPA QB-GSEE
Read →
·6 min read

Chemical Accuracy vs. Certification: What the Gap Bars Mean

The leaderboard shows two thresholds: a 1.6 mHa chemical accuracy line and a 10 mHa certification threshold. Here's why they're different, what the colored bars measure, and how to read H₂O's red bars alongside H₂'s green ones.

chemical accuracycertificationmethodologyleaderboard
Read →