The whole of this group is a release asset
This site holds 8 of the 232 question directories these 11 runs wrote; the archive holds every one:
- archive
- minidev-sqlite-gpt-35-turbo-instruct.tar.gz
- size
- 12,866,649 bytes
- sha256
- 8b8a96d259e6eef7d6afe164ced25e6bff5200abe354c2e08dd23f28f39a0e7e
The sums of the 11 runs
One prediction file, audited once per database it names, because a connection here is one file. Each run below states its own counts; these are those counts added up, which they can be because no question is in two of the runs.
| what | how many |
|---|---|
| audited | 498 |
| compared | 372 |
| EQUAL | 144 |
| NOT_EQUAL | 228 |
| ERROR | 126 |
| probes fired | 23 |
| credited by BIRD and NOT_EQUAL | 26 |
The runs
Every group of minidev-sqlite is indexed a level up.
| database | date | engine | question set | question set digest |
|---|---|---|---|---|
| california_schools | 2026-09-08T05:00:01.033370+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| card_games | 2026-09-08T05:15:46.379264+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| codebase_community | 2026-09-08T05:00:01.024913+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| debit_card_specializing | 2026-09-08T05:00:01.020642+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| european_football_2 | 2026-09-08T05:16:35.006619+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| financial | 2026-09-08T05:00:04.966698+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| formula_1 | 2026-09-08T05:00:08.607089+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| student_club | 2026-09-08T05:00:14.792252+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| superhero | 2026-09-08T05:00:15.392424+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| thrombosis_prediction | 2026-09-08T05:00:16.380927+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |
| toxicology | 2026-09-08T05:00:17.113453+00:00 | sqlite | https://bird-bench.oss-cn-beijing.aliyuncs.com/minidev.zip (sha256 cc48ba16838204e4e214512030cb572eeb5f7bcdd999bae4b9b6ff12ec13b92f, downloaded 2026-09-07), member minidev/MINIDEV/mini_dev_sqlite.json | sha256:4ba5fa8de55856222f484d380d2ba872b380bf79d825de70478e2120cb0fc43b |