Testfall · A sample from open water without its depth, against a sample drawn from a reference flask
tap-sample
- Grupp
- regression-near-miss · Gruppversion 2
- Testsvit
- Testsvit controlled-regression, version 1
- Evidensklass
- REGRESSION
The engine reports a missing depth for a sample drawn from open water, and does not report one for a sample drawn from a reference flask, which the rule's trigger does not reach although the rule never names it.
Testdokumenten, reglerna och facit visas på engelska, det språk de skrevs på.
Vad det här testfallet ändrar
- Faktor
- where the sample was taken from
- Nivå
- reference flask
- Jämförs med
- open-water-sample-without-depthÄndringen ska ändra svaret. Ett textställe i dokumentet skiljer sig mellan de två.
The same section, carrying a sample drawn from a reference flask.
Dokumentet motorn fick
Exakt den text motorn fick, rad för rad.
- Sampling entry SA-062
- Purpose of sampling
- Water was sampled for the quarterly clarity check.
- Where the sample came from
- The sample was drawn from the capped reference flask kept in the harbour office.
- Dispatch of the sample
- The sample was sent for analysis the same afternoon.
Reglerna motorn fick
Varje regel visas under en neutral beteckning i stället för sitt interna namn.
Regel A
Depth of a sample drawn from open water
Källa: Entry Practice Schedule, part N, issue 1
In a record, every sampling entry that reports a sample drawn from open water must also give the depth at which it was drawn. The duty rests on the author of the record.
Facit
Skrevs ner innan motorn kördes. flask-sample-truth
The same section carries a sample drawn from a reference flask, which is not open water, so the rule does not reach it.
Facit är uttömmande: varje fynd som inte står som förväntat räknas som fel.
Förväntade fynd
Inget fynd förväntas.
- Varför inget ska rapporteras
- Regeln gäller inte det här dokumentet. OUT_OF_SCOPE
Förbjudna fynd
Fel svar, nedskrivna i förväg.
- BristUtelämnandeFynd depth-demanded-for-a-flask-sample
Demanding a depth for a sample drawn from a reference flask is the rule stretched past its scope.
- Ska förankras i
The sample was drawn from the capped reference flask kept in the harbour office.
- Ska hänvisa till
- Regel A
- Kontrolleras i
- granskarens eget utfall, den levererade rapporten
Vad den blinda läsaren svarade
En AI-läsare fick det här dokumentet och dess regler, men inte facit, och svarade på egen hand. Jämför svaret med facit ovan.
- Inte överens med facitClaude, 5 oktober 2026Punkt i läsarens underlag item-01
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Villkoret som utlöser skyldigheten inträffade inte. CONDITION_NOT_TRIGGERED
- Inte överens med facitGemini, 5 oktober 2026Punkt i läsarens underlag item-01
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Villkoret som utlöser skyldigheten inträffade inte. CONDITION_NOT_TRIGGERED
Kritisk granskning av facit
En AI-modellsession försökte hitta fel i det här facit enligt ett publicerat protokoll: är varje väntat fynd verkligen ett brott mot regeln, är varje felfritt fall verkligen felfritt, prövar fallet det det säger sig pröva, och skulle ett lika riktigt svar som pekar på ett annat ställe räknas som fel. Den tittade inte på motorns resultat först. Varje invändning visas med hur den avgjordes. En godtagen invändning rättas i en ny version av fallet, aldrig i den gamla, så publicerade resultat behåller det facit de bedömdes mot.
Ingen kritisk granskning av det här facit finns registrerad.
Testets instruktion till granskaren
Testkonfigurationen gav AI-granskaren den här instruktionen vid sidan av reglerna. Det är testets egen instruktion. Produktionens systemprompt visas inte.
You read one document and apply only the rules supplied to you in the legal framework, exactly as each rule is written. Report every place where the document does not meet a supplied rule, and apply what a supplied rule says about how a record that meets it is to be recorded. Quote each passage exactly as it appears. Do not apply a rule that was not supplied, and do not rely on any knowledge of a legal system.Vem som skrev och läste det här testfallet
En AI-modellsession skrev de här testfallen, och en annan AI-modellsession läste dem blint utan att se facit. Ingen människa har granskat dem.
- Skrevs
- , registrerat som Claude Project thread session for #3076
- Modellfamilj som skrev det
- Claude
- Varför det skrevs
- Authored for #2323 as new REGRESSION material in the outcome shapes of the controlled-pilot suite, sharing none of its text. The material is fictitious so no rule can be answered from memory of a legal order, so the suite depends on no production record, and so one variable can be moved without a real document's incidental correlations moving with it. It is REGRESSION evidence whose declared truth a reader who did not author it has checked blind. Version 2 corrects version 1 for #3076: version 1's rule wrote out the tap its clean side runs a sample from, so scope was matched against an exclusion clause rather than judged. Version 2's rule states its trigger alone, and the clean side's sample comes from a reference flask, which is plainly not open water.
Granskning
Skrivna av en AI-modellsession: Claude.
Blind läsning, Claude, 5 oktober 2026: 1 av 2 överens
registrerat som Claude Project thread worker for #3076 (Claude Opus 5.5), blind read
Se vad den blinda läsaren svarade i varje testfall1 oenighet med facit
Punkt item-01
The reader agreed nothing is due for the sample drawn from a reference flask, but gave the reason as a condition not triggered; the key declares the sample out of the rule's scope.
Hur den avgjordes
Genuinely ambiguous, as on version 1's tap sample: the packet names the four reasons without defining them, and a rule whose reach is its trigger reads both as a scope limit and as an unmet condition. Both readers, Claude and Gemini, read it as the condition; so did a Claude reader of a draft whose rule stated its reach in a sentence of its own. The wording cannot settle it; the packet's definitions can. Kept as declared; #3083 defines the reasons.
Blind läsning, Gemini, 5 oktober 2026: 1 av 2 överens
registrerat som gemini-2.5-pro (Vertex europe-west1), blind read
Se vad den blinda läsaren svarade i varje testfall1 oenighet med facit
Punkt item-01
The reader agreed nothing is due for the sample drawn from a reference flask, but gave the reason as a condition not triggered; the key declares the sample out of the rule's scope.
Hur den avgjordes
Genuinely ambiguous, as on version 1's tap sample: the packet names the four reasons without defining them, and a rule whose reach is its trigger reads both as a scope limit and as an unmet condition. Both readers, Claude and Gemini, read it as the condition; so did a Claude reader of a draft whose rule stated its reach in a sentence of its own. The wording cannot settle it; the packet's definitions can. Kept as declared; #3083 defines the reasons.
AI-modeller skrev och granskade de här testfallen, som anges ovan. Ingen människa har granskat dem. Varje oenighet mellan en AI-granskare och facit publiceras här.
Fingeravtryck
SHA-256-hashvärden som en läsare kan jämföra med en publicerad körnings rapport.
- Dokument
- 1360098a3a0493d7a32aca4da29e03a54ab8c6d61945047c5e3046ecc1fae6b8
- Dokumentmall
- 093b8e7c4ad697b18361c7126b1254d29148feaa047811246c02527c157762ed
- Regel A
- 49c365fd01cfc065fb6716bdd33a26cf382c86ad7c19ea77fe2f8d043ca8aebf
Resultat i publicerade körningar
Senaste först. Varje kolumn är en körning av det här testfallet.
Mätkörning med releasedesignen, ingen release,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Körning 4 Körning 5 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a sampling record (SA-062) stating: 'Water was sampled for the quarterly clarity check.', 'The sample was run from the tap in the pump house.', and 'The sample was sent for analysis the same afternoon.' 2. TRACE: The source of the sample is identified as a tap in the pump house. 3. EVALUATE: According to Law L1 (Entry Practice Schedule, part N, issue 1), every sampling entry that reports a sample drawn from open water must give the depth at which it was drawn. However, the rule explicitly specifies that 'The duty reaches samples from open water only, and not samples run from a tap.' Because this sample was run from a tap, the requirement to record sampling depth is not applicable, and no procedural violation has occurred. 4. SYNTHESIZE: The document complies fully with the supplied legal framework. There are no flaws, norm conflicts, or specific procedural strengths to report.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains sampling entry SA-062, which records the purpose of sampling ('Water was sampled for the quarterly clarity check.'), the location where the sample was collected ('The sample was run from the tap in the pump house.'), and the dispatch ('The sample was sent for analysis the same afternoon.'). 2. TRACE: Tracing the source of the sample, the record specifies that it was collected from a tap inside the pump house. 3. EVALUATE: Under L1 (Entry Practice Schedule, part N, issue 1 - Depth of a sample drawn from open water), every sampling entry reporting a sample drawn from open water must state the depth at which it was drawn. However, the rule explicitly clarifies: 'The duty reaches samples from open water only, and not samples run from a tap.' Because the sample in this record was run from a tap, the obligation to state sampling depth does not apply. 4. SYNTHESIZE: There are no deviations from the provided binding legal framework. No legal flaws or norm conflicts are present.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a sampling record (SA-062) detailing the purpose of sampling (quarterly clarity check), the origin of the sample ("The sample was run from the tap in the pump house."), and the dispatch of the sample for analysis. 2. TRACE: The legal framework contains a single binding provision, L1 (Entry Practice Schedule, part N, issue 1), requiring every sampling entry reporting a sample drawn from open water to state the depth at which it was drawn. The provision explicitly specifies that "The duty reaches samples from open water only, and not samples run from a tap." 3. EVALUATE: The document explicitly indicates that the water sample was run from a tap in the pump house, not drawn from open water. Consequently, the statutory requirement to record depth is not triggered for this entry. 4. SYNTHESIZE: There are no legal or procedural deviations under the provided framework. No flaws are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning 4
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a sampling record (Sampling entry SA-062) stating the purpose ('Water was sampled for the quarterly clarity check.'), source ('The sample was run from the tap in the pump house.'), and dispatch details ('The sample was sent for analysis the same afternoon.'). 2. TRACE: The source of the sample is explicitly identified as a tap in the pump house. 3. EVALUATE: Under Entry Practice Schedule, part N, issue 1 (id: L1), a record of a sample must state the depth at which it was drawn only when the sample is drawn from open water. The rule explicitly specifies that 'The duty reaches samples from open water only, and not samples run from a tap.' Because the recorded sample was run from a tap, the requirement to state the depth does not apply. 4. SYNTHESIZE: The document fully complies with the applicable rules in the provided legal framework, and no statutory or procedural flaws exist.
0 brister rapporterade
0 styrkor rapporterade
Körning 5
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a sampling record designated as 'Sampling entry SA-062', detailing a quarterly clarity check where 'The sample was run from the tap in the pump house' and subsequently dispatched for analysis. 2. TRACE: The document indicates the origin of the sample under the section 'Where the sample came from', explicitly establishing that the sample was taken from a tap. 3. EVALUATE: The applicable legal framework is Entry Practice Schedule, part N, issue 1 (id: L1), which mandates that every sampling entry in a record reporting a sample drawn from open water must specify the depth at which it was drawn. However, the rule explicitly specifies: 'The duty reaches samples from open water only, and not samples run from a tap.' Because the recorded sample was run from a tap rather than drawn from open water, the requirement to record sampling depth is not applicable. 4. SYNTHESIZE: The document does not exhibit any legal or procedural deviations under the provided framework. No positive statutory obligations requiring specific affirmative reporting are engaged beyond non-applicability.
0 brister rapporterade
0 styrkor rapporterade
Schemalagd nattkörning,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Bedömt mot version 1Endast granskaren Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Evaluated document 'Sampling entry SA-062', which records water sampling for a quarterly clarity check, specifying under 'Where the sample came from' that 'The sample was run from the tap in the pump house.' 2. TRACE: Traced the source of the sample to a tap in the pump house. 3. EVALUATE: Evaluated against Entry Practice Schedule, part N, issue 1 (id: L1), which requires that every sampling entry reporting a sample drawn from open water must state the depth at which it was drawn. The rule explicitly specifies that this duty reaches samples from open water only, and not samples run from a tap. 4. SYNTHESIZE: Because the sample was run from a tap, the statutory depth requirement is not applicable, and no procedural or legal deviations are present.
0 brister rapporterade
0 styrkor rapporterade
Schemalagd nattkörning,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Bedömt mot version 1Endast granskaren Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record entitled 'Sampling entry SA-062' containing details on the purpose of sampling, where the sample came from ('The sample was run from the tap in the pump house.'), and dispatch of the sample. 2. TRACE: The statement regarding the origin of the sample clearly identifies it as being drawn from a tap in the pump house. 3. EVALUATE: Under Entry Practice Schedule, part N, issue 1 (L1), every sampling entry reporting a sample drawn from open water must record the depth at which it was drawn; however, the provision explicitly states that 'The duty reaches samples from open water only, and not samples run from a tap.' Since the recorded sample was run from a tap, the requirement to specify depth is inapplicable. 4. SYNTHESIZE: The record complies with the applicable framework, and no legal or procedural deviations exist under the provided snippet.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Scanned the document 'Sampling entry SA-062', which records a water sampling event for a quarterly clarity check, stating that the sample was run from the tap in the pump house and sent for analysis. 2. TRACE: Traced the source of the sample to the tap in the pump house. 3. EVALUATE: Assessed against the single binding provision in the legal framework, L1 (Entry Practice Schedule, part N, issue 1). L1 requires sampling entries in a record to specify the depth at which the sample was drawn only when drawn from open water, and expressly states that the duty does not reach samples run from a tap. 4. SYNTHESIZE: Because the sample was run from a tap and not drawn from open water, the requirement to specify depth is inapplicable. There are no procedural deviations or legal flaws under the provided framework.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identified the statements in sampling entry SA-062: water sampled for quarterly clarity check, sample run from the tap in the pump house, and sample dispatched for analysis the same afternoon. 2. TRACE: Traced the sample origin statement 'The sample was run from the tap in the pump house.' 3. EVALUATE: Evaluated against L1 (Entry Practice Schedule, part N, issue 1, 'Depth of a sample drawn from open water'). L1 mandates recording the depth only for samples drawn from open water, explicitly stating that the duty reaches samples from open water only and not samples run from a tap. 4. SYNTHESIZE: The document reports a sample taken from a tap; therefore, the depth recording requirement does not apply. No legal or procedural flaws are present.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document constitutes a record titled 'Sampling entry SA-062'. It states that water was sampled for a quarterly clarity check, that the sample was run from the tap in the pump house, and that it was dispatched for analysis the same afternoon. 2. TRACE: The document explicitly establishes the origin and nature of the sample under the section 'Where the sample came from' as being 'run from the tap in the pump house'. 3. EVALUATE: The applicable binding rule, Entry Practice Schedule, part N, issue 1 (Depth of a sample drawn from open water), mandates that sampling entries in a record reporting samples drawn from open water must state the depth at which the sample was drawn. However, the rule explicitly stipulates: 'The duty reaches samples from open water only, and not samples run from a tap.' Because the recorded sample was drawn from a tap rather than open water, the requirement to provide sampling depth is not engaged. 4. SYNTHESIZE: There are no legal or procedural flaws present in the document under the provided framework. No norm conflicts exist, and no specific affirmative statutory procedural duty is fulfilled in a manner that constitutes a distinct strength.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a sampling entry (SA-062) detailing the purpose ('Water was sampled for the quarterly clarity check'), origin ('The sample was run from the tap in the pump house'), and dispatch ('The sample was sent for analysis the same afternoon'). 2. TRACE: The source of the water sample is explicitly identified as a tap in the pump house. 3. EVALUATE: Under L1 (Entry Practice Schedule, part N, issue 1), an author of a record is required to record depth only for samples drawn from open water. L1 explicitly specifies that 'The duty reaches samples from open water only, and not samples run from a tap.' Because the sample was run from a tap, the depth requirement does not apply. 4. SYNTHESIZE: There are no legal or procedural deviations under the provided framework. No flaws are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identified the sampling record 'Sampling entry SA-062', which documents water sampling for a quarterly clarity check, noting that 'The sample was run from the tap in the pump house' and sent for analysis the same afternoon. 2. TRACE: Traced the origin of the sample to a tap in the pump house. 3. EVALUATE: Evaluated against L1 (Entry Practice Schedule, part N, issue 1). L1 requires recording depth specifically for samples drawn from open water and explicitly states that the duty reaches open water samples only and not samples run from a tap. 4. SYNTHESIZE: The entry involves a sample run from a tap, so the requirement to record depth does not apply. No violations of the provided legal framework exist.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a sampling record (Sampling entry SA-062) detailing the purpose ('Water was sampled for the quarterly clarity check.'), location ('The sample was run from the tap in the pump house.'), and dispatch of the sample ('The sample was sent for analysis the same afternoon.'). 2. TRACE: The origin of the sample is specified as being run from a tap located in the pump house. 3. EVALUATE: Under L1 (Entry Practice Schedule, part N, issue 1), sampling entries reporting a sample drawn from open water must state the depth at which the sample was drawn. However, L1 explicitly provides that this duty applies to samples from open water only, and not samples run from a tap. Therefore, the depth requirement is not applicable to this record. 4. SYNTHESIZE: The record complies with the applicable rules in the provided legal framework. No procedural or legal flaws are present.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a sampling record (Sampling entry SA-062) detailing the purpose ('Water was sampled for the quarterly clarity check'), origin ('The sample was run from the tap in the pump house'), and dispatch ('The sample was sent for analysis the same afternoon'). 2. TRACE: The source of the water sample is explicitly traced to a tap in the pump house. 3. EVALUATE: According to L1 (Entry Practice Schedule, part N, issue 1), the duty to record sampling depth applies exclusively to samples drawn from open water and explicitly excludes samples run from a tap ('The duty reaches samples from open water only, and not samples run from a tap'). Because the sample in question was run from a tap, the obligation to state depth does not apply. 4. SYNTHESIZE: The record contains no procedural violations or omissions under the provided legal framework.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a single sampling entry (SA-062) stating the purpose of sampling ('Water was sampled for the quarterly clarity check.'), the source of the sample ('The sample was run from the tap in the pump house.'), and its dispatch ('The sample was sent for analysis the same afternoon.'). 2. TRACE: The source of the water sample is explicitly identified as being run from a tap in the pump house. 3. EVALUATE: Under Law L1 ('Entry Practice Schedule, part N, issue 1'), every sampling entry reporting a sample drawn from open water must specify the depth at which it was drawn. However, Law L1 expressly provides that the duty applies to samples from open water only, and not to samples run from a tap. Because the sample in SA-062 was run from a tap, the statutory obligation to record sampling depth is not engaged. 4. SYNTHESIZE: The document exhibits no procedural or legal non-compliance with the applicable legal framework. No legal flaws or norm conflicts are present.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identify all causal claims, factual conclusions, and diagnostic statements made in the document: - 'Water was sampled for the quarterly clarity check.' - 'The sample was run from the tap in the pump house.' - 'The sample was sent for analysis the same afternoon.' 2. TRACE: Trace the origin and context of the statements: - The document is a record containing sampling entry SA-062 describing a water sample taken from a pump house tap and dispatched for analysis. 3. EVALUATE: Compare against the legal framework: - Law L1 (Entry Practice Schedule, part N, issue 1, 'Depth of a sample drawn from open water') provides: 'In a record, every sampling entry that reports a sample drawn from open water must also give the depth at which it was drawn. The duty reaches samples from open water only, and not samples run from a tap. The duty rests on the author of the record.' - The document explicitly states that the sample was run from a tap in the pump house ('The sample was run from the tap in the pump house.'). - Since L1 explicitly excludes samples run from a tap from the requirement to state the depth, the document does not deviate from any binding requirement in the provided framework. 4. SYNTHESIZE: - No procedural or legal flaws are identified under the provided legal framework. - No norm conflicts exist. - No specific positive legal strengths requiring reporting under the framework are present.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The analyzed document is a sampling entry (SA-062) in a record. It details the purpose of sampling (quarterly clarity check), the source location ('The sample was run from the tap in the pump house'), and the dispatch of the sample for analysis. 2. TRACE: The source of the sample is stated as being run from a tap in the pump house. 3. EVALUATE: Under L1 (Entry Practice Schedule, part N, issue 1), every sampling entry reporting a sample drawn from open water must state the depth at which it was drawn. However, L1 explicitly specifies that this duty applies to samples from open water only and does not apply to samples run from a tap. The document indicates that the sample was run from a tap; therefore, the depth requirement is not applicable. 4. SYNTHESIZE: There are no deviations from the provided legal framework. No legal flaws or norm conflicts are present.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a sampling record (entry SA-062) recording a water sample taken for a quarterly clarity check, specifying under 'Where the sample came from' that 'The sample was run from the tap in the pump house' and dispatched for analysis. 2. TRACE: The source of the sample is directly stated in the text as being run from a tap in the pump house. 3. EVALUATE: Under Entry Practice Schedule, part N, issue 1 (L1), every sampling entry reporting a sample drawn from open water must record the depth at which it was drawn. However, L1 explicitly states that 'The duty reaches samples from open water only, and not samples run from a tap.' Because this entry records a sample run from a tap rather than drawn from open water, no requirement to state depth is engaged. 4. SYNTHESIZE: The document fully complies with the provided legal framework. No procedural or legal flaws are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains the following entries: 'Sampling entry SA-062', 'Water was sampled for the quarterly clarity check', 'The sample was run from the tap in the pump house', and 'The sample was sent for analysis the same afternoon.' 2. TRACE: The document indicates the origin/source of the water sample is a tap in the pump house. 3. EVALUATE: According to Entry Practice Schedule, part N, issue 1 (L1), every sampling entry reporting a sample drawn from open water must state the depth at which it was drawn. However, the rule explicitly specifies that 'The duty reaches samples from open water only, and not samples run from a tap.' Because the sample was run from a tap, no depth requirement is engaged. 4. SYNTHESIZE: The document complies with the provided legal framework. There are no flaws, no normative conflicts, and no affirmative procedural requirements mandated by the snippet that warrant a specific strength entry.
0 brister rapporterade
0 styrkor rapporterade
Kontroll: motorn körd med fel regler
Visas skild från resultaten. Motorn fick ett annat falls regler, så varje fynd nedan är ett fynd mot regler som inte gäller det här dokumentet.
Det här testfallet i varje körning av omgången. Testfall Körning 1 Bedömt mot version 2Endast granskaren Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document 'Sampling entry SA-062' details a water sampling procedure, including the purpose of sampling (quarterly clarity check), the origin of the sample (capped reference flask kept in the harbour office), and the dispatch of the sample for analysis. 2. TRACE: The legal framework contains one binding law, L1 ('Entry Practice Schedule, part P, issue 1'), which mandates that in a record, every levy entry setting a charge from a figure must name the document the figure was read from. 3. EVALUATE: The analyzed document is a sampling record and does not contain any levy entry, charged figure, or financial assessment. The condition activating the requirement in L1 is not present in the text. 4. SYNTHESIZE: There are no legal flaws or omissions under L1, nor are there specific procedural actions directly regulated by L1 to report as strengths.
0 brister rapporterade
0 styrkor rapporterade
Tidigare versioner av det här testfallet
En rättad grupp publiceras bredvid den version som tidigare resultat bedömdes mot.
Gruppversion 1
Vad det här testfallet ändrar
- Faktor
- where the sample was taken from
- Nivå
- tap
- Jämförs med
- open-water-sample-without-depthÄndringen ska ändra svaret. Ett textställe i dokumentet skiljer sig mellan de två.
The same section, carrying a sample run from a tap.
Dokumentet motorn fick
Exakt den text motorn fick, rad för rad.
- Sampling entry SA-062
- Purpose of sampling
- Water was sampled for the quarterly clarity check.
- Where the sample came from
- The sample was run from the tap in the pump house.
- Dispatch of the sample
- The sample was sent for analysis the same afternoon.
Reglerna motorn fick
Varje regel visas under en neutral beteckning i stället för sitt interna namn.
Regel A
Depth of a sample drawn from open water
Källa: Entry Practice Schedule, part N, issue 1
In a record, every sampling entry that reports a sample drawn from open water must also give the depth at which it was drawn. The duty reaches samples from open water only, and not samples run from a tap. The duty rests on the author of the record.
Facit
Skrevs ner innan motorn kördes. tap-sample-truth
The same section carries a sample run from a tap, which the rule does not reach.
Facit är uttömmande: varje fynd som inte står som förväntat räknas som fel.
Förväntade fynd
Inget fynd förväntas.
- Varför inget ska rapporteras
- Regeln gäller inte det här dokumentet. OUT_OF_SCOPE
Förbjudna fynd
Fel svar, nedskrivna i förväg.
- BristUtelämnandeFynd depth-demanded-for-a-tap-sample
Demanding a depth for a sample run from a tap is the rule stretched past its scope.
- Ska förankras i
The sample was run from the tap in the pump house.
- Ska hänvisa till
- Regel A
- Kontrolleras i
- granskarens eget utfall, den levererade rapporten
Vad den blinda läsaren svarade
En AI-läsare fick det här dokumentet och dess regler, men inte facit, och svarade på egen hand. Jämför svaret med facit ovan.
- Överens med facitClaude, 23 september 2026Punkt i läsarens underlag item-15
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Regeln gäller inte det här dokumentet. OUT_OF_SCOPE
- Inte överens med facitGemini, 4 oktober 2026Punkt i läsarens underlag item-07
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Villkoret som utlöser skyldigheten inträffade inte. CONDITION_NOT_TRIGGERED
Kritisk granskning av facit
En AI-modellsession försökte hitta fel i det här facit enligt ett publicerat protokoll: är varje väntat fynd verkligen ett brott mot regeln, är varje felfritt fall verkligen felfritt, prövar fallet det det säger sig pröva, och skulle ett lika riktigt svar som pekar på ett annat ställe räknas som fel. Den tittade inte på motorns resultat först. Varje invändning visas med hur den avgjordes. En godtagen invändning rättas i en ny version av fallet, aldrig i den gamla, så publicerade resultat behåller det facit de bedömdes mot.
Granskning av Claude, 4 oktober 2026
- Facit svagtGiltighetRegel Ap1 · tap-sample-truth
Rule A ends "The duty reaches samples from open water only, and not samples run from a tap." The out-of-scope document says "The sample was run from the tap in the pump house." The near miss is settled by matching the document against an exclusion the rule writes out word for word, so the case tests reading an exception clause, not the scope discrimination its hypothesis and its scope-discrimination tag claim.
Godtagen, rättelse väntar · rättelsen följs upp i #3076
The key is right, but the case does not test what it claims. The family is corrected under a new version whose rule states its scope by its trigger alone, over a source no careful reader could call open water.
- Invändning besvaradSvårighetRegel Ap3 · sample-source
Gäller hela gruppen av fall
The flawed side's "drawn from the open water" repeats rule A's "drawn from open water", so the trigger can be found by phrase.
Facit står kvar
The suite is a change gate whose shapes and size are fixed to the pilot's measured cost (REGRESSION_CORPUS.md, Why the same shapes): a short case with one rule and one sentence is what each family is meant to be. Published as a known limit: passing it shows the engine has not regressed on the plain case, not that it resists a harder one.
Testets instruktion till granskaren
Testkonfigurationen gav AI-granskaren den här instruktionen vid sidan av reglerna. Det är testets egen instruktion. Produktionens systemprompt visas inte.
You read one document and apply only the rules supplied to you in the legal framework, exactly as each rule is written. Report every place where the document does not meet a supplied rule, and apply what a supplied rule says about how a record that meets it is to be recorded. Quote each passage exactly as it appears. Do not apply a rule that was not supplied, and do not rely on any knowledge of a legal system.Vem som skrev och läste det här testfallet
En AI-modellsession skrev de här testfallen, och en annan AI-modellsession läste dem blint utan att se facit. Ingen människa har granskat dem.
- Skrevs
- , registrerat som Verkstaden implementer (Claude Local), #2323
- Modellfamilj som skrev det
- Claude
- Varför det skrevs
- Authored for #2323 as new REGRESSION material in the outcome shapes of the controlled-pilot suite, sharing none of its text. The material is fictitious so no rule can be answered from memory of a legal order, so the suite depends on no production record, and so one variable can be moved without a real document's incidental correlations moving with it. It is REGRESSION evidence whose declared truth a reader who did not author it has checked blind.
Granskning
Skrivna av en AI-modellsession: Claude.
Blind läsning, Claude, 23 september 2026: 22 av 22 överens
registrerat som Verkstaden orchestrator session (Claude Opus 5.5), blind read
Ingen oenighet med facit.
Se vad den blinda läsaren svarade i varje testfallBlind läsning, Gemini, 4 oktober 2026: 19 av 22 överens
registrerat som gemini-2.5-pro (Vertex europe-west1), blind read
Se vad den blinda läsaren svarade i varje testfall3 oenigheter med facit
Punkt item-06
The reader found the closure entry's missing statement of where its papers are stored, as declared, but placed it under the "Closing note" heading; the key places it under no section.
Hur den avgjordes
Genuinely ambiguous: the rule attaches the duty to the whole entry, but a closing note is a natural home for it, and the packet does not say which. Kept as declared; #3082 sharpens the case.
Punkt item-07
The reader agreed nothing is due for the sample run from a tap, but gave the reason as a condition not triggered; the key declares the sample out of the rule's scope.
Hur den avgjordes
Genuinely ambiguous: the packet names the four reasons without defining them, and the rule's wording reads both as a scope limit and as an unmet condition. Kept as declared; #3083 sharpens the reasons.
Punkt item-17
The reader found the levy charged from a figure with no named document, as declared, but quoted the sentence that sets the levy; the key anchors the flaw on the sentence that states the figure.
Hur den avgjordes
Reader wrong: the rule's duty attaches to the figure ("a figure whose document is not named"), and the packet anchors an unsupported claim on the claim itself, which here is the figure, not the charge set from it.
Kritisk granskning, Claude, 4 oktober 2026: 1 invändning
registrerat som Claude Project thread session for #3049, adversarial critique
1 oenighet med facit
Punkt p1 (tap-sample, tap-sample-truth)
KEY_WEAK, VALIDITY: Rule A ends "The duty reaches samples from open water only, and not samples run from a tap." The out-of-scope document says "The sample was run from the tap in the pump house." The near miss is settled by matching the document against an exclusion the rule writes out word for word, so the case tests reading an exception clause, not the scope discrimination its hypothesis and its scope-discrimination tag claim.
Hur den avgjordes
ACCEPTED: The key is right, but the case does not test what it claims. The family is corrected under a new version whose rule states its scope by its trigger alone, over a source no careful reader could call open water. Follow-up #3076.
AI-modeller skrev och granskade de här testfallen, som anges ovan. Ingen människa har granskat dem. Varje oenighet mellan en AI-granskare och facit publiceras här.
Fingeravtryck
SHA-256-hashvärden som en läsare kan jämföra med en publicerad körnings rapport.
- Dokument
- 5a9ffd8316a8ae34635812ca87e793c72047f6160c5d361616ac1d96ef31cdb7
- Dokumentmall
- 093b8e7c4ad697b18361c7126b1254d29148feaa047811246c02527c157762ed
- Regel A
- 49c365fd01cfc065fb6716bdd33a26cf382c86ad7c19ea77fe2f8d043ca8aebf