q1034 GOLD-ONLY

The question

List the players' api id who had the highest above average overall ratings in 2010.

the hint the set supplies: highest above average overall ratings refers to MAX(overall_rating); in 2010 refers to substr(date,1,4) = '2010';

This question was audited without a prediction beside it, so there is nothing to compare the gold with. The probes below read the gold alone.

read by hand, 2026-09-07: wrong the gold does not answer its question on this data

three rows tie on the largest overall rating in that year and name two different players

a maintainer's reading of this question, out of classification.json, copied from plans/reports/bird-dev-sqlite-260907/classification.json. It is not a verdict and nothing above it was computed from it.

The statements

gold

SELECT player_api_id FROM Player_Attributes WHERE SUBSTR(`date`, 1, 4) = '2010' ORDER BY overall_rating DESC LIMIT 1

overall_rating: descending

sha256:fb5160f7bd70559923b0ed5dadfd92b8092f067f362d05a27ae15681bfdf5b57

The results

gold, 1 row

from evidence-gold.json, 1 row

player_api_idINTEGER
30657

The probes

A smell is a mechanical reason to read this gold statement again. It is a heuristic: it does not state that the statement is wrong, and a maintainer decides.

ordering-over-numeric-text not applicable

this statement orders by a text column holding only numbers, and ordering it as a number gives a different answer, so the gold may be sorting 9.5 above 10

no ORDER BY key resolves to a text column

what it measured

{
  "heuristic": true,
  "reason": "no ORDER BY key resolves to a text column",
  "keys": [
    {
      "key": "overall_rating",
      "column": "Player_Attributes.overall_rating",
      "declared_type": "INTEGER",
      "not_applicable": "the column is not declared as text"
    }
  ]
}

arbitrary-cut fired

this statement cuts its result at a LIMIT that does not decide which rows come back, so a different but equally correct statement can return other rows and score zero

from smells.json, 3 rows

30657	90
30981	90
30981	90

what it measured

{
  "heuristic": true,
  "cut": 1,
  "offset": 0,
  "distinct_kept": false,
  "unbounded_sql": "SELECT player_api_id, overall_rating AS attestql_ordering_key_0 FROM Player_Attributes WHERE SUBSTRING(\"date\", 1, 4) = '2010' ORDER BY overall_rating DESC",
  "unbounded_rows": 10829,
  "projected_columns": [
    "player_api_id"
  ],
  "ordering_key_columns": [
    "attestql_ordering_key_0"
  ],
  "ordering_keys": [
    {
      "key": "overall_rating",
      "direction": "desc",
      "nulls": "last",
      "nulls_first_in_effect": false,
      "returned_rows_null_in_this_key": 0,
      "fires": false
    }
  ],
  "tied_at_the_cut": {
    "positions": [
      0,
      1,
      2
    ],
    "tied_rows": 3,
    "distinct_projected_answers": 2,
    "rows": [
      [
        {
          "type": "int",
          "value": 30657
        }
      ],
      [
        {
          "type": "int",
          "value": 30981
        }
      ],
      [
        {
          "type": "int",
          "value": 30981
        }
      ]
    ]
  },
  "case": "tie-at-the-cut"
}

not-a-function-of-the-data fired

rerun over the same rows in another physical order this statement gives another answer, so its result depends on how the rows are stored and not only on the data

from smells.json, 1 row

30981

what it measured

{
  "heuristic": true,
  "rule": "R-ORD",
  "baseline_result_hash": "sha256:fb5160f7bd70559923b0ed5dadfd92b8092f067f362d05a27ae15681bfdf5b57",
  "baseline_result": {
    "columns": [
      {
        "name": "player_api_id",
        "declared_type": "INTEGER"
      }
    ],
    "row_count": 1,
    "truncated": false,
    "rows_shown": 1,
    "rows": [
      [
        {
          "type": "int",
          "value": 30657
        }
      ]
    ],
    "result_hash": "sha256:fb5160f7bd70559923b0ed5dadfd92b8092f067f362d05a27ae15681bfdf5b57"
  },
  "planner_statistics": {},
  "shuffle": {
    "seed": "1",
    "row_limit": 300000,
    "tables": [
      "Player_Attributes"
    ],
    "tables_not_shuffled": [],
    "tables_skipped_for_size": {},
    "tables_not_reached_by_a_copy": {}
  },
  "shuffled_copies": {
    "run": true,
    "verdict": "not_equal",
    "differs": true,
    "result_hash": "sha256:8cb38ee13c01690a9d24d0e9e20275a25cf67f08935a96acabcf3a57c7dabc93",
    "result": {
      "columns": [
        {
          "name": "player_api_id",
          "declared_type": "INTEGER"
        }
      ],
      "row_count": 1,
      "truncated": false,
      "rows_shown": 1,
      "rows": [
        [
          {
            "type": "int",
            "value": 30981
          }
        ]
      ],
      "result_hash": "sha256:8cb38ee13c01690a9d24d0e9e20275a25cf67f08935a96acabcf3a57c7dabc93"
    }
  },
  "plan_variant": {
    "run": false,
    "reason": "the plan variant was not asked for"
  }
}

The evidence records

gold: evidence-gold.json

SELECT player_api_id FROM Player_Attributes WHERE SUBSTR(`date`, 1, 4) = '2010' ORDER BY overall_rating DESC LIMIT 1

statement read from: data/questions/dev_20251106-00000-of-00001.json
digest: sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb
origin: https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07), 2026-01-18T08:51:02Z

result_hash sha256:fb5160f7bd70559923b0ed5dadfd92b8092f067f362d05a27ae15681bfdf5b57 recomputed from this JSON: match

record_hash sha256:c07ab0e32f1de641705ea859b82bc0b2bb4713041414324fa9d620fb8249ffed recomputed from this JSON: match

the result this record holds, 1 row

from evidence-gold.json, 1 row

player_api_idINTEGER
30657

what ran, and where

run: audit-9d69a29b-e497-49b3-976c-18ac8e4f0c76
executed at: 2026-09-08T05:13:59.180098+00:00
data as of: 2026-09-08T05:13:55.178504+00:00
backend at checkout: SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/european_football_2/european_football_2.sqlite | size=597754880
backend that answered: SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/european_football_2/european_football_2.sqlite | size=597754880
database role: file
replay rule: R-ORD
question set version: sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb
validator: audit:sqlglot-sqlite-parse
checks run: parses_as_exactly_one_statement, the_one_statement_is_a_select, no_placeholder_without_a_bound_parameter
statement timeout: 30000 ms
rows: 1 row

the session it ran under

engine: sqlite
time_zone: not stated by this engine
date_style: not stated by this engine
interval_style: not stated by this engine
extra_float_digits: not stated by this engine
database_collation: not stated by this engine
work_mem: not stated by this engine
hash_mem_multiplier: not stated by this engine

recorded beside them

sqlite_version: 3.53.4
encoding: UTF-8
reverse_unordered_selects: 0
query_only: 1
journal_mode: delete
data_version: 2
compile_options: ATOMIC_INTRINSICS=1,COMPILER=clang-21.0.0,DEFAULT_AUTOVACUUM,DEFAULT_CACHE_SIZE=-2000,DEFAULT_FILE_FORMAT=4,DEFAULT_JOURNAL_SIZE_LIMIT=-1,DEFAULT_MMAP_SIZE=0,DEFAULT_PAGE_SIZE=4096,DEFAULT_PCACHE_INITSZ=20,DEFAULT_RECURSIVE_TRIGGERS,DEFAULT_SECTOR_SIZE=4096,DEFAULT_SYNCHRONOUS=2,DEFAULT_WAL_AUTOCHECKPOINT=1000,DEFAULT_WAL_SYNCHRONOUS=2,DEFAULT_WORKER_THREADS=0,DIRECT_OVERFLOW_READ,ENABLE_API_ARMOR,ENABLE_COLUMN_METADATA,ENABLE_DBSTAT_VTAB,ENABLE_FTS3,ENABLE_FTS3_PARENTHESIS,ENABLE_FTS5,ENABLE_GEOPOLY,ENABLE_MATH_FUNCTIONS,ENABLE_MEMORY_MANAGEMENT,ENABLE_PERCENTILE,ENABLE_PREUPDATE_HOOK,ENABLE_RTREE,ENABLE_SESSION,ENABLE_STAT4,ENABLE_UNLOCK_NOTIFY,MALLOC_SOFT_LIMIT=1024,MAX_ATTACHED=10,MAX_COLUMN=2000,MAX_COMPOUND_SELECT=500,MAX_DEFAULT_PAGE_SIZE=8192,MAX_EXPR_DEPTH=1000,MAX_FUNCTION_ARG=1000,MAX_LENGTH=1000000000,MAX_LIKE_PATTERN_LENGTH=50000,MAX_MMAP_SIZE=0x7fff0000,MAX_PAGE_COUNT=0xfffffffe,MAX_PAGE_SIZE=65536,MAX_SQL_LENGTH=1000000000,MAX_TRIGGER_DEPTH=1000,MAX_VARIABLE_NUMBER=250000,MAX_VDBE_OP=250000000,MAX_WORKER_THREADS=8,MUTEX_PTHREADS,SYSTEM_MALLOC,TEMP_STORE=1,THREADSAFE=1,USE_URI
collation_list: RTRIM,NOCASE,BINARY
case_sensitive_like: 0

the rendering and the data

version: attestql/audit/2
numeric_scale: 6
timestamp_format: %Y-%m-%dT%H:%M:%S.%fZ
timezone: UTC
null_rendering: NULL
encoding: utf-8
schema digest: sha256:fc0e260cdb06570fe5435b209285246871c03abe20b9805bc26d3269499e7478
source file sha256: sha256:e4d361dbeec6591a4b315877c0c481da05c8ff5a3d389b34d6e17b6f15bee4e0
rows in main.Player_Attributes: 183978

Running these again

gold

re-run this statement read-only against SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/european_football_2/european_football_2.sqlite | size=597754880 under the session settings and over the data this record's fixture digest names, and compare the two results under R-ORD

This question's run

run: audit-9d69a29b-e497-49b3-976c-18ac8e4f0c76
server: SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/european_football_2/european_football_2.sqlite | size=597754880
question set: dev_20251106-00000-of-00001 from https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07)
replay rule: R-ORD

the run this question belongs to

The JSON this page was rendered from

evidence-gold.json the gold's evidence record
smells.json attestql/audit/smells/2

The question

The statements

◀ gold

The results

The probes

ordering-over-numeric-text not applicable

arbitrary-cut fired

not-a-function-of-the-data fired

The evidence records

gold: evidence-gold.json

recorded beside them

Running these again

gold

This question's run

The JSON this page was rendered from

gold