Certificate - Product (shared drive)
100.0% CERTIFIED
70/70 benchmark cases passed (threshold 90%)
· pinned to epoch 1 · 2026-09-14T21:44:12.320925Z
· run run-9f9f50da0c
This page is public and reproducible: every case below links to a URL-addressable query that re-executes against the certified instance. Same query + same epoch = same answer.
Provenance posture
- every_response_carries: source, transforms, freshness, epoch
- determinism: same query + same epoch = same answer
- errors: structured; never silent filter drops
Cases
| Axis | Tier | Intent | DSL | Result |
|---|---|---|---|---|
| 1 | aggregation | FILES per is_folder | COUNT FILES BY IS_FOLDER reproduce | pass |
| 1 | aggregation | Total depth | SUM FILES DEPTH BY IS_FOLDER reproduce | pass |
| 1 | aggregation | PERMISSIONS per principal | COUNT PERMISSIONS BY PRINCIPAL reproduce | pass |
| 1 | aggregation | PRINCIPALS per domain | COUNT PRINCIPALS BY DOMAIN reproduce | pass |
| 1 | aggregation | REVISIONS per modified_by | COUNT REVISIONS BY MODIFIED_BY reproduce | pass |
| 1 | aggregation | Total size_bytes | SUM REVISIONS SIZE_BYTES BY MODIFIED_BY reproduce | pass |
| 1 | aggregation | Total section_index | SUM SECTIONS SECTION_INDEX reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST COMMENTS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST DRIVES WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Invalid enum value must coach, not silently drop | LIST FILES WHERE IS_FOLDER IS "NOT_A_REAL_VALUE" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST FILES WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST LABELS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST LINKS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Invalid enum value must coach, not silently drop | LIST PERMISSIONS WHERE PRINCIPAL IS "NOT_A_REAL_VALUE" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST PERMISSIONS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Invalid enum value must coach, not silently drop | LIST PRINCIPALS WHERE DOMAIN IS "NOT_A_REAL_VALUE" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST PRINCIPALS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Invalid enum value must coach, not silently drop | LIST REVISIONS WHERE MODIFIED_BY IS "NOT_A_REAL_VALUE" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST REVISIONS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | error | Unknown field must coach, not silently drop | LIST SECTIONS WHERE MADE_UP_FIELD IS "x" reproduce | pass |
| 1 | filters | Show me cmt_3 | GET COMMENTS "cmt_3" reproduce | pass |
| 1 | filters | Show me Product | GET DRIVES "Product" reproduce | pass |
| 1 | filters | Show me Product | GET FILES "Product" reproduce | pass |
| 1 | filters | FILES where is_folder is no | LIST FILES WHERE IS_FOLDER IS "no" LIMIT 10 reproduce | pass |
| 1 | filters | Show me doc_roadmap26 | GET LABELS "doc_roadmap26" reproduce | pass |
| 1 | filters | Show me doc_roadmap26 | GET LINKS "doc_roadmap26" reproduce | pass |
| 1 | filters | Show me fld_product | GET PERMISSIONS "fld_product" reproduce | pass |
| 1 | filters | PERMISSIONS where principal is acme.com | LIST PERMISSIONS WHERE PRINCIPAL IS "acme.com" LIMIT 10 reproduce | pass |
| 1 | filters | Show me acme.com | GET PRINCIPALS "acme.com" reproduce | pass |
| 1 | filters | PRINCIPALS where domain is * | LIST PRINCIPALS WHERE DOMAIN IS "*" LIMIT 10 reproduce | pass |
| 1 | filters | Show me doc_roadmap26@r1 | GET REVISIONS "doc_roadmap26@r1" reproduce | pass |
| 1 | filters | REVISIONS where modified_by is alice@acme.com | LIST REVISIONS WHERE MODIFIED_BY IS "alice@acme.com" LIMIT 10 reproduce | pass |
| 1 | filters | Show me doc_roadmap26#s0 | GET SECTIONS "doc_roadmap26#s0" reproduce | pass |
| 1 | help | Read the COMMENTS lesson | HELP COMMENTS reproduce | pass |
| 1 | help | Read the DRIVES lesson | HELP DRIVES reproduce | pass |
| 1 | help | Read the FILES lesson | HELP FILES reproduce | pass |
| 1 | help | Read the LABELS lesson | HELP LABELS reproduce | pass |
| 1 | help | Read the LINKS lesson | HELP LINKS reproduce | pass |
| 1 | help | Read the PERMISSIONS lesson | HELP PERMISSIONS reproduce | pass |
| 1 | help | Read the PRINCIPALS lesson | HELP PRINCIPALS reproduce | pass |
| 1 | help | Read the REVISIONS lesson | HELP REVISIONS reproduce | pass |
| 1 | help | Read the SECTIONS lesson | HELP SECTIONS reproduce | pass |
| 1 | structure | List a few comments | LIST COMMENTS LIMIT 5 reproduce | pass |
| 1 | structure | How many comments are there? | COUNT COMMENTS reproduce | pass |
| 1 | structure | List a few drives | LIST DRIVES LIMIT 5 reproduce | pass |
| 1 | structure | How many drives are there? | COUNT DRIVES reproduce | pass |
| 1 | structure | List a few files | LIST FILES LIMIT 5 reproduce | pass |
| 1 | structure | How many files are there? | COUNT FILES reproduce | pass |
| 1 | structure | List a few labels | LIST LABELS LIMIT 5 reproduce | pass |
| 1 | structure | How many labels are there? | COUNT LABELS reproduce | pass |
| 1 | structure | List a few links | LIST LINKS LIMIT 5 reproduce | pass |
| 1 | structure | How many links are there? | COUNT LINKS reproduce | pass |
| 1 | structure | List a few permissions | LIST PERMISSIONS LIMIT 5 reproduce | pass |
| 1 | structure | How many permissions are there? | COUNT PERMISSIONS reproduce | pass |
| 1 | structure | List a few principals | LIST PRINCIPALS LIMIT 5 reproduce | pass |
| 1 | structure | How many principals are there? | COUNT PRINCIPALS reproduce | pass |
| 1 | structure | List a few revisions | LIST REVISIONS LIMIT 5 reproduce | pass |
| 1 | structure | How many revisions are there? | COUNT REVISIONS reproduce | pass |
| 1 | structure | List a few sections | LIST SECTIONS LIMIT 5 reproduce | pass |
| 1 | structure | How many sections are there? | COUNT SECTIONS reproduce | pass |
| 2 | intent | How many files by kind? | COUNT FILES BY IS_FOLDER reproduce | pass |
| 2 | robustness | Fuzzy lookup: "cmt_3" | RESOLVE COMMENTS "cmt_3" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "produ" | RESOLVE DRIVES "produ" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "produ" | RESOLVE FILES "produ" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "doc_roadmap" | RESOLVE LABELS "doc_roadmap" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "doc_roadmap" | RESOLVE LINKS "doc_roadmap" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "fld_produ" | RESOLVE PERMISSIONS "fld_produ" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "acme.c" | RESOLVE PRINCIPALS "acme.c" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "doc_roadmap26@" | RESOLVE REVISIONS "doc_roadmap26@" reproduce | pass |
| 2 | robustness | Fuzzy lookup: "doc_roadmap26#" | RESOLVE SECTIONS "doc_roadmap26#" reproduce | pass |