Glossary
Every technical term this platform uses, with what it means and — the part that is harder to find elsewhere — the mistake it prevents. On this subject the intuitive reading is often the wrong one, so each entry says what a reader would otherwise get wrong.
Evidence
- Benchmark suite
A versioned definition of an experiment, so two people can run the same thing.
Easy to get wrong: Runs from different suite versions are not comparable, and a leaderboard that mixes them is a ranking of different experiments.
Seen in use on /benchmarks