The whole of this group is a release asset
This site holds 8 of the 262 question directories these 11 runs wrote; the archive holds every one:
- archive
- minidev-sqlite-gpt-4-32k.tar.gz
- size
- 2,338,557 bytes
- sha256
- 39bd31d2b9ec4c2b2c7092ddd578f395bb304a14a9cc5e4f7f50f01eb47932c4
The sums of the 11 runs
One prediction file, audited once per database it names, because a connection here is one file. Each run below states its own counts; these are those counts added up, which they can be because no question is in two of the runs.
| what | how many |
|---|---|
| audited | 498 |
| compared | 460 |
| EQUAL | 205 |
| NOT_EQUAL | 255 |
| ERROR | 38 |
| probes fired | 25 |
| credited by BIRD and NOT_EQUAL | 32 |
The runs
Every group of minidev-sqlite is indexed a level up.
| database | date | engine | question set | question set digest |
|---|---|---|---|---|
| california_schools | 2026-09-08T05:01:18.658638+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| card_games | 2026-09-08T05:19:52.881154+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| codebase_community | 2026-09-08T05:20:40.760586+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| debit_card_specializing | 2026-09-08T05:01:34.398754+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| european_football_2 | 2026-09-08T05:01:40.266048+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| financial | 2026-09-08T05:01:46.354941+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| formula_1 | 2026-09-08T05:01:50.212472+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| student_club | 2026-09-08T05:01:56.151062+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| superhero | 2026-09-08T05:01:56.358817+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| thrombosis_prediction | 2026-09-08T05:01:56.738269+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| toxicology | 2026-09-08T05:01:57.445716+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |