q802 GOLD-ONLY

The question

Who is the tallest superhero?

the hint the set supplies: who refers to superhero_name; tallest superhero refers to MAX(height_cm);

This question was audited without a prediction beside it, so there is nothing to compare the gold with. The probes below read the gold alone.

read by hand, 2026-09-07: wrong the gold does not answer its question on this data

two superheroes share the largest height

a maintainer's reading of this question, out of classification.json, copied from plans/reports/bird-dev-sqlite-260907/classification.json. It is not a verdict and nothing above it was computed from it.

The statements

gold

SELECT superhero_name FROM superhero ORDER BY height_cm DESC LIMIT 1

height_cm: descending

sha256:4c95751e6bdd85ef3d9cebd94fdd271a38255d880df029f5b82f362c024dd652

The results

gold, 1 row

from evidence-gold.json, 1 row

superhero_nameTEXT
Surtur

The probes

A smell is a mechanical reason to read this gold statement again. It is a heuristic: it does not state that the statement is wrong, and a maintainer decides.

ordering-over-numeric-text not applicable

this statement orders by a text column holding only numbers, and ordering it as a number gives a different answer, so the gold may be sorting 9.5 above 10

no ORDER BY key resolves to a text column

what it measured

{
  "heuristic": true,
  "reason": "no ORDER BY key resolves to a text column",
  "keys": [
    {
      "key": "height_cm",
      "column": "superhero.height_cm",
      "declared_type": "INTEGER",
      "not_applicable": "the column is not declared as text"
    }
  ]
}

arbitrary-cut fired

this statement cuts its result at a LIMIT that does not decide which rows come back, so a different but equally correct statement can return other rows and score zero

from smells.json, 2 rows

Surtur	30480
Ymir	30480

what it measured

{
  "heuristic": true,
  "cut": 1,
  "offset": 0,
  "distinct_kept": false,
  "unbounded_sql": "SELECT superhero_name, height_cm AS attestql_ordering_key_0 FROM superhero ORDER BY height_cm DESC",
  "unbounded_rows": 750,
  "projected_columns": [
    "superhero_name"
  ],
  "ordering_key_columns": [
    "attestql_ordering_key_0"
  ],
  "ordering_keys": [
    {
      "key": "height_cm",
      "direction": "desc",
      "nulls": "last",
      "nulls_first_in_effect": false,
      "returned_rows_null_in_this_key": 0,
      "fires": false
    }
  ],
  "tied_at_the_cut": {
    "positions": [
      0,
      1
    ],
    "tied_rows": 2,
    "distinct_projected_answers": 2,
    "rows": [
      [
        {
          "type": "str",
          "value": "Surtur"
        }
      ],
      [
        {
          "type": "str",
          "value": "Ymir"
        }
      ]
    ]
  },
  "case": "tie-at-the-cut"
}

not-a-function-of-the-data quiet

rerun over the same rows in another physical order this statement gives another answer, so its result depends on how the rows are stored and not only on the data

what it measured

{
  "heuristic": true,
  "rule": "R-ORD",
  "baseline_result_hash": "sha256:4c95751e6bdd85ef3d9cebd94fdd271a38255d880df029f5b82f362c024dd652",
  "baseline_result": {
    "columns": [
      {
        "name": "superhero_name",
        "declared_type": "TEXT"
      }
    ],
    "row_count": 1,
    "truncated": false,
    "rows_shown": 1,
    "rows": [
      [
        {
          "type": "str",
          "value": "Surtur"
        }
      ]
    ],
    "result_hash": "sha256:4c95751e6bdd85ef3d9cebd94fdd271a38255d880df029f5b82f362c024dd652"
  },
  "planner_statistics": {},
  "shuffle": {
    "seed": "1",
    "row_limit": 300000,
    "tables": [
      "superhero"
    ],
    "tables_not_shuffled": [],
    "tables_skipped_for_size": {},
    "tables_not_reached_by_a_copy": {}
  },
  "shuffled_copies": {
    "run": true,
    "verdict": "equal",
    "differs": false,
    "result_hash": "sha256:4c95751e6bdd85ef3d9cebd94fdd271a38255d880df029f5b82f362c024dd652",
    "result": {
      "columns": [
        {
          "name": "superhero_name",
          "declared_type": "TEXT"
        }
      ],
      "row_count": 1,
      "truncated": false,
      "rows_shown": 1,
      "rows": [
        [
          {
            "type": "str",
            "value": "Surtur"
          }
        ]
      ],
      "result_hash": "sha256:4c95751e6bdd85ef3d9cebd94fdd271a38255d880df029f5b82f362c024dd652"
    }
  },
  "plan_variant": {
    "run": false,
    "reason": "the plan variant was not asked for"
  }
}

The evidence records

gold: evidence-gold.json

SELECT superhero_name FROM superhero ORDER BY height_cm DESC LIMIT 1

statement read from: data/questions/dev_20251106-00000-of-00001.json
digest: sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb
origin: https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07), 2026-01-18T08:51:02Z

result_hash sha256:4c95751e6bdd85ef3d9cebd94fdd271a38255d880df029f5b82f362c024dd652 recomputed from this JSON: match

record_hash sha256:630d0525805c5f3730e9b656dca8c637fa646eea21a5d6dc5d2742a7a3f27c81 recomputed from this JSON: match

the result this record holds, 1 row

from evidence-gold.json, 1 row

superhero_nameTEXT
Surtur

what ran, and where

run: audit-d3f8ac37-674e-4d02-9bef-e01383ae49a0
executed at: 2026-09-08T04:59:10.629326+00:00
data as of: 2026-09-08T04:59:10.039543+00:00
backend at checkout: SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/superhero/superhero.sqlite | size=237568
backend that answered: SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/superhero/superhero.sqlite | size=237568
database role: file
replay rule: R-ORD
question set version: sha256:ffd8018378ddb1a8794753e0a31cfc81862ff7318a5184c22f3dc4ce03a03feb
validator: audit:sqlglot-sqlite-parse
checks run: parses_as_exactly_one_statement, the_one_statement_is_a_select, no_placeholder_without_a_bound_parameter
statement timeout: 30000 ms
rows: 1 row

the session it ran under

engine: sqlite
time_zone: not stated by this engine
date_style: not stated by this engine
interval_style: not stated by this engine
extra_float_digits: not stated by this engine
database_collation: not stated by this engine
work_mem: not stated by this engine
hash_mem_multiplier: not stated by this engine

recorded beside them

sqlite_version: 3.53.4
encoding: UTF-8
reverse_unordered_selects: 0
query_only: 1
journal_mode: delete
data_version: 1
compile_options: ATOMIC_INTRINSICS=1,COMPILER=clang-21.0.0,DEFAULT_AUTOVACUUM,DEFAULT_CACHE_SIZE=-2000,DEFAULT_FILE_FORMAT=4,DEFAULT_JOURNAL_SIZE_LIMIT=-1,DEFAULT_MMAP_SIZE=0,DEFAULT_PAGE_SIZE=4096,DEFAULT_PCACHE_INITSZ=20,DEFAULT_RECURSIVE_TRIGGERS,DEFAULT_SECTOR_SIZE=4096,DEFAULT_SYNCHRONOUS=2,DEFAULT_WAL_AUTOCHECKPOINT=1000,DEFAULT_WAL_SYNCHRONOUS=2,DEFAULT_WORKER_THREADS=0,DIRECT_OVERFLOW_READ,ENABLE_API_ARMOR,ENABLE_COLUMN_METADATA,ENABLE_DBSTAT_VTAB,ENABLE_FTS3,ENABLE_FTS3_PARENTHESIS,ENABLE_FTS5,ENABLE_GEOPOLY,ENABLE_MATH_FUNCTIONS,ENABLE_MEMORY_MANAGEMENT,ENABLE_PERCENTILE,ENABLE_PREUPDATE_HOOK,ENABLE_RTREE,ENABLE_SESSION,ENABLE_STAT4,ENABLE_UNLOCK_NOTIFY,MALLOC_SOFT_LIMIT=1024,MAX_ATTACHED=10,MAX_COLUMN=2000,MAX_COMPOUND_SELECT=500,MAX_DEFAULT_PAGE_SIZE=8192,MAX_EXPR_DEPTH=1000,MAX_FUNCTION_ARG=1000,MAX_LENGTH=1000000000,MAX_LIKE_PATTERN_LENGTH=50000,MAX_MMAP_SIZE=0x7fff0000,MAX_PAGE_COUNT=0xfffffffe,MAX_PAGE_SIZE=65536,MAX_SQL_LENGTH=1000000000,MAX_TRIGGER_DEPTH=1000,MAX_VARIABLE_NUMBER=250000,MAX_VDBE_OP=250000000,MAX_WORKER_THREADS=8,MUTEX_PTHREADS,SYSTEM_MALLOC,TEMP_STORE=1,THREADSAFE=1,USE_URI
collation_list: RTRIM,NOCASE,BINARY
case_sensitive_like: 0

the rendering and the data

version: attestql/audit/2
numeric_scale: 6
timestamp_format: %Y-%m-%dT%H:%M:%S.%fZ
timezone: UTC
null_rendering: NULL
encoding: utf-8
schema digest: sha256:f7bfa4cee3b2a4a0bcd09eb72f3b425e6209a762fefaea50749c072ab4abd34e
source file sha256: sha256:75e94a2c3236ee3bb2c01fb97a1c4b4c1c269bcefd4eab1d04be323d2d0825b1
rows in main.superhero: 750

Running these again

gold

re-run this statement read-only against SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/superhero/superhero.sqlite | size=237568 under the session settings and over the data this record's fixture digest names, and compare the two results under R-ORD

This question's run

run: audit-d3f8ac37-674e-4d02-9bef-e01383ae49a0
server: SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/superhero/superhero.sqlite | size=237568
question set: dev_20251106-00000-of-00001 from https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07)
replay rule: R-ORD

the run this question belongs to

The JSON this page was rendered from

evidence-gold.json the gold's evidence record
smells.json attestql/audit/smells/2

The question

The statements

◀ gold

The results

The probes

ordering-over-numeric-text not applicable

arbitrary-cut fired

not-a-function-of-the-data quiet

The evidence records

gold: evidence-gold.json

recorded beside them

Running these again

gold

This question's run

The JSON this page was rendered from

gold