Testfall · A relied-on figure with no named document, against a passage the copy omits
basis-withheld
- Grupp
- regression-unsupported-claim · Gruppversion 2
- Testsvit
- Testsvit controlled-regression, version 1
- Evidensklass
- REGRESSION
The engine reports a charge set from a figure that names no document when a supplied rule makes that unsupported, and reports nothing when the copy does not carry the passage that would decide it.
Testdokumenten, reglerna och facit visas på engelska, det språk de skrevs på.
Vad det här testfallet ändrar
- Faktor
- the passage the rule would be applied to
- Nivå
- not in the copy
- Jämförs med
- figure-without-documentÄndringen ska ändra svaret. Ett textställe i dokumentet skiljer sig mellan de två.
The same entry, whose copy does not carry that section.
Dokumentet motorn fick
Exakt den text motorn fick, rad för rad.
- Levy entry LV-440
- Ship calling
- The cargo ship Marta Holm called at the south quay.
- Basis of the charge
- [The lines of this section are not in the copy supplied.]
- Levy result
- The harbour levy is recorded as payable in full.
Reglerna motorn fick
Varje regel visas under en neutral beteckning i stället för sitt interna namn.
Regel A
The document a charged figure was read from
Källa: Entry Practice Schedule, part P, issue 1
In a record, every levy entry that sets a charge from a figure must name the document the figure was read from. A figure whose document is not named gives the charge no support. The duty rests on the author of the record.
Facit
Skrevs ner innan motorn kördes. withheld-basis-truth
The section the rule would be applied to is not in the copy, so the document cannot decide it.
Facit är uttömmande: varje fynd som inte står som förväntat räknas som fel.
Förväntade fynd
Inget fynd förväntas.
- Varför inget ska rapporteras
- Dokumentet ger för lite att bedöma. INSUFFICIENT_EVIDENCE
Förbjudna fynd
Fel svar, nedskrivna i förväg.
- BristUtelämnandeFynd unsourced-figure-asserted-from-absent-text
Reporting an unsupported figure from a passage the copy does not carry is a finding without a document.
- Ska förankras i
[The lines of this section are not in the copy supplied.]
- Ska hänvisa till
- Regel A
- Kontrolleras i
- granskarens eget utfall, den levererade rapporten
Vad den blinda läsaren svarade
En AI-läsare fick det här dokumentet och dess regler, men inte facit, och svarade på egen hand. Jämför svaret med facit ovan.
- Överens med facitClaude, 5 oktober 2026Punkt i läsarens underlag item-01
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Dokumentet ger för lite att bedöma. INSUFFICIENT_EVIDENCE
- Överens med facitGemini, 5 oktober 2026Punkt i läsarens underlag item-01
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Dokumentet ger för lite att bedöma. INSUFFICIENT_EVIDENCE
Kritisk granskning av facit
En AI-modellsession försökte hitta fel i det här facit enligt ett publicerat protokoll: är varje väntat fynd verkligen ett brott mot regeln, är varje felfritt fall verkligen felfritt, prövar fallet det det säger sig pröva, och skulle ett lika riktigt svar som pekar på ett annat ställe räknas som fel. Den tittade inte på motorns resultat först. Varje invändning visas med hur den avgjordes. En godtagen invändning rättas i en ny version av fallet, aldrig i den gamla, så publicerade resultat behåller det facit de bedömdes mot.
Ingen kritisk granskning av det här facit finns registrerad.
Testets instruktion till granskaren
Testkonfigurationen gav AI-granskaren den här instruktionen vid sidan av reglerna. Det är testets egen instruktion. Produktionens systemprompt visas inte.
You read one document and apply only the rules supplied to you in the legal framework, exactly as each rule is written. Report every place where the document does not meet a supplied rule, and apply what a supplied rule says about how a record that meets it is to be recorded. Quote each passage exactly as it appears. Do not apply a rule that was not supplied, and do not rely on any knowledge of a legal system.Vem som skrev och läste det här testfallet
En AI-modellsession skrev de här testfallen, och en annan AI-modellsession läste dem blint utan att se facit. Ingen människa har granskat dem.
- Skrevs
- , registrerat som Claude Project thread session for #3075
- Modellfamilj som skrev det
- Claude
- Varför det skrevs
- Authored for #2323 as new REGRESSION material in the outcome shapes of the controlled-pilot suite, sharing none of its text. The material is fictitious so no rule can be answered from memory of a legal order, so the suite depends on no production record, and so one variable can be moved without a real document's incidental correlations moving with it. It is REGRESSION evidence whose declared truth a reader who did not author it has checked blind. Version 2 corrects version 1 for #3075: an adversarial critique showed that an omission anchored on the sentence setting the levy, as correct as the key's, was scored as a miss. Version 2 states the figure and the charge set from it as one sentence.
Granskning
Skrivna av en AI-modellsession: Claude.
Blind läsning, Claude, 5 oktober 2026: 2 av 2 överens
registrerat som Claude Project thread subagent for #3075 (Claude Opus 5.5), blind read
Ingen oenighet med facit.
Se vad den blinda läsaren svarade i varje testfallBlind läsning, Gemini, 5 oktober 2026: 2 av 2 överens
registrerat som gemini-2.5-pro (Vertex europe-west1), blind read
Ingen oenighet med facit.
Se vad den blinda läsaren svarade i varje testfall
AI-modeller skrev och granskade de här testfallen, som anges ovan. Ingen människa har granskat dem. Varje oenighet mellan en AI-granskare och facit publiceras här.
Fingeravtryck
SHA-256-hashvärden som en läsare kan jämföra med en publicerad körnings rapport.
- Dokument
- ecbc0f6164232e4c9288ab383293ee2a7d46bf613acaa8d4febac0cb897b9455
- Dokumentmall
- 1e2f522c3a8a20b3c8c8b90f93181b5e09a2fc9c59e8813d37cb50f566d3dd3f
- Regel A
- fa3928d90b453dd2d705189e5d07ab64c11337803e039b0f60e0ab3268b5a7d6
Resultat i publicerade körningar
Senaste först. Varje kolumn är en körning av det här testfallet.
Mätkörning med releasedesignen, ingen release,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Körning 4 Körning 5 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a levy entry (LV-440) for the cargo ship Marta Holm calling at the south quay, noting under 'Levy result' that 'The harbour levy is recorded as payable in full.' The section 'Basis of the charge' contains only an editorial note indicating that lines are not in the supplied copy. 2. TRACE: The document records a harbour levy entry, but it does not specify any numerical figure or charge calculated from a figure. 3. EVALUATE: Under L1 (Entry Practice Schedule, part P, issue 1), 'In a record, every levy entry that sets a charge from a figure must name the document the figure was read from.' The rule is explicitly conditional on a levy entry setting a charge from a figure. The provided text contains no figure from which a charge is set, nor does it present circumstances triggering the mandatory duty under L1. Consequently, no statutory requirement within the provided framework is violated. 4. SYNTHESIZE: There are no legal flaws, strengths, or norm conflicts to report.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identified all statements in the text: 'The cargo ship Marta Holm called at the south quay' (statement of ship arrival), and 'The harbour levy is recorded as payable in full' (levy result). 2. TRACE: Traced the content to identify if any charge is set from a numerical or factual figure. The document mentions the ship calling and records the harbour levy as payable in full, without stating or deriving a charge from a specific figure. 3. EVALUATE: Evaluated against L1 (Entry Practice Schedule, part P, issue 1), which stipulates that every levy entry that sets a charge from a figure must name the document the figure was read from. Since the entry does not set a charge from a figure, the conditional statutory requirement to cite the source document is not engaged by the text provided. 4. SYNTHESIZE: No legal or procedural flaws under L1 are present. There are also no affirmative procedural strengths or norm conflicts.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains the following factual and administrative entries: entry identifier 'Levy entry LV-440', the factual statement 'The cargo ship Marta Holm called at the south quay', and the administrative outcome 'The harbour levy is recorded as payable in full.' No specific monetary or quantitative figures are stated in the text. 2. TRACE: The statements describe a vessel call and record the status of the harbour levy as payable in full. 3. EVALUATE: The governing legal framework is Entry Practice Schedule, part P, issue 1 (L1), which imposes a duty on the author of a record to name the source document whenever a levy entry sets a charge from a figure. The document does not set a charge from any stated figure. Thus, the condition triggering the requirement in L1 is not present in the text. 4. SYNTHESIZE: There are no deviations from or violations of the provided legal framework, nor are there grounds for procedural strengths or norm conflicts.
0 brister rapporterade
0 styrkor rapporterade
Körning 4
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Scanned the text of document 'Levy entry LV-440', which describes a ship call by Marta Holm, contains a section header 'Basis of the charge' with missing lines in the copy supplied, and states 'The harbour levy is recorded as payable in full' under 'Levy result'. 2. TRACE: Evaluated the sole legal provision in the framework, Entry Practice Schedule, part P, issue 1 (id: L1), which requires that every levy entry setting a charge from a figure must name the document the figure was read from. 3. EVALUATE: The obligation in L1 is conditional upon a charge being set from a figure. In the supplied text, no figure is set or stated. As the document contains no figure setting a charge, the specific statutory condition triggering the requirement to cite the source document is not engaged by the text provided. 4. SYNTHESIZE: There are no deviations from the provided legal framework. Therefore, identified_flaws is empty, strengths is empty, and norm_conflicts is empty.
0 brister rapporterade
0 styrkor rapporterade
Körning 5
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record containing Levy entry LV-440. It states that the cargo ship Marta Holm called at the south quay, notes that the lines for 'Basis of the charge' are not in the copy supplied, and concludes under 'Levy result' that 'The harbour levy is recorded as payable in full.' No specific figures or numerical charges are stated in the text. 2. TRACE: The statements in the text record a ship call and a result that a levy is payable in full. 3. EVALUATE: Under Law L1 (Entry Practice Schedule, part P, issue 1), 'every levy entry that sets a charge from a figure must name the document the figure was read from.' The statutory duty is conditional on the levy entry setting a charge from a figure. The text does not set a charge from a figure nor include any figures; therefore, the factual predicate triggering the duty to cite a source document is not established by the text. In accordance with the system constraints, a requirement conditional on circumstances the document does not show cannot be reported as an omission. 4. SYNTHESIZE: There are no legal flaws or procedural violations established under the provided legal framework. No explicit procedural compliance is mapped to Law L1 to constitute a strength.
0 brister rapporterade
0 styrkor rapporterade
Schemalagd nattkörning,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Bedömt mot version 1Endast granskaren Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record entitled 'Levy entry LV-440'. It contains the statements that the cargo ship Marta Holm called at the south quay, an omitted section note under 'Basis of the charge', and the outcome 'The harbour levy is recorded as payable in full.' 2. TRACE: No numerical figure or charged amount is stated in the record from which the levy is calculated. 3. EVALUATE: Law L1 (Entry Practice Schedule, part P, issue 1) specifies that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' This requirement is conditional on setting a charge from a figure. Because the text does not set a charge from a figure, the condition specified in L1 is not triggered in the visible text. 4. SYNTHESIZE: There are no deviations from the provided legal framework, and no specific positive procedural compliance to log as a strength under L1.
0 brister rapporterade
0 styrkor rapporterade
Schemalagd nattkörning,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Bedömt mot version 1Endast granskaren Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identify all causal claims, factual conclusions, and diagnostic statements made by the investigator in the text. The document contains statements that the cargo ship Marta Holm called at the south quay, that lines under 'Basis of the charge' are not in the copy supplied, and that 'The harbour levy is recorded as payable in full.' 2. TRACE: Trace each claim backward to verify its foundation against the legal framework. The record notes the calling of a ship and records the levy result as payable in full without stating any charged numerical figure. 3. EVALUATE: Compare the document against the assigned legal framework (Entry Practice Schedule, part P, issue 1 / L1). L1 requires that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' In the provided text, no figure is set or stated from which a charge is derived. Under the system instructions, a requirement that is conditional on circumstances the document does not show cannot be treated as an omission. Therefore, L1's naming requirement is not triggered. 4. SYNTHESIZE: No violations of the provided legal framework are established, no norm conflicts exist, and no procedural actions directly fulfill an affirmative requirement under L1 to constitute a legal strength.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The provided document is a record of levy entry LV-440 regarding the cargo ship Marta Holm calling at the south quay, with a result stating that the harbour levy is recorded as payable in full. The section titled 'Basis of the charge' contains the note '[The lines of this section are not in the copy supplied.]'. No numerical figures setting a charge are stated in the text. 2. TRACE: The statement indicates that a harbour levy is recorded as payable in full, but no specific charged figure or numerical calculation is provided or referenced in the record text. 3. EVALUATE: Under Law L1 (Entry Practice Schedule, part P, issue 1), in a record, every levy entry that sets a charge from a figure must name the document the figure was read from. The statutory duty applies specifically when a levy entry sets a charge from a figure. Since the document text does not set a charge from a figure, the conditional obligation to name the document from which a figure was read is not engaged. 4. SYNTHESIZE: The text does not contain any claims or entries that violate Law L1. Under the strict domain isolation and zero hallucination rules, no legal flaws, norm conflicts, or specific statutory strengths are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record entitled 'Levy entry LV-440'. It states that the cargo ship Marta Holm called at the south quay, notes that the lines of the section 'Basis of the charge' are not in the copy supplied, and records under 'Levy result' that the harbour levy is payable in full. No specific figure is stated in the document. 2. TRACE: The entry records a levy result ('payable in full') without citing a specific numerical figure or calculation in the provided text. 3. EVALUATE: The applicable legal framework is Law L1 (Entry Practice Schedule, part P, issue 1, 'The document a charged figure was read from'), which provides: 'In a record, every levy entry that sets a charge from a figure must name the document the figure was read from. A figure whose document is not named gives the charge no support. The duty rests on the author of the record.' The obligation to name the source document is conditioned upon the levy entry setting a charge from a figure. In the supplied text, no figure is set or stated. Under the strict constraint on omissions, a requirement conditional on circumstances the document does not show does not constitute an absent mandatory step. Consequently, no statutory deviation under Law L1 is established on the face of the provided text. 4. SYNTHESIZE: No flaws or norm conflicts are identified. No procedural strengths directly implementing the specific mandate of Law L1 are documented.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record titled 'Levy entry LV-440'. It states under 'Ship calling' that the cargo ship Marta Holm called at the south quay, contains a section 'Basis of the charge' with bracketed text '[The lines of this section are not in the copy supplied.]', and concludes under 'Levy result' that the harbour levy is recorded as payable in full. No numerical figures or specific calculations are stated. 2. TRACE: The statements in the record establish the vessel's call and conclude that the levy is payable in full without articulating or relying upon a specific numerical figure. 3. EVALUATE: The single applicable binding source, Entry Practice Schedule, part P, issue 1 (L1), mandates that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' This statutory duty is conditional on the entry setting a charge from a figure. Because the provided document text does not contain or rely on a figure, the condition specified in L1 is not triggered on the face of the document. Under the governing constraints, a procedural step conditional on circumstances the document does not show does not constitute an omission. 4. SYNTHESIZE: The text does not exhibit any procedural or legal deviations from the supplied legal framework. Consequently, no flaws, norm conflicts, or specific procedural strengths are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a levy record (Levy entry LV-440) regarding the cargo ship Marta Holm calling at the south quay, an omitted section '[The lines of this section are not in the copy supplied.]' under 'Basis of the charge', and a result statement under 'Levy result' that 'The harbour levy is recorded as payable in full.' No specific numerical figure or charge calculation is stated in the provided text. 2. TRACE: The source of the record is the author recording entry LV-440. No specific figure is introduced or relied upon to set the charge. 3. EVALUATE: The applicable legal framework is Law L1 ('Entry Practice Schedule, part P, issue 1'), which mandates: 'In a record, every levy entry that sets a charge from a figure must name the document the figure was read from.' The statutory requirement is strictly conditional on setting a charge from a figure. The text does not set a charge from a figure or present any charged figure. Under the strict constraints, a procedural step is not mandatory when it is conditional on circumstances the document does not show. 4. SYNTHESIZE: Because no charge is set from a figure in the visible record, Law L1 is not triggered or violated. There are no identified flaws, strengths, or norm conflicts to report.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identified all statements in the document: 'The cargo ship Marta Holm called at the south quay' under 'Ship calling' and 'The harbour levy is recorded as payable in full' under 'Levy result'. 2. TRACE: Traced the claims in the document. The text does not present any specific numerical figure from which a charge is calculated or set. 3. EVALUATE: Evaluated against the sole binding law L1 (Entry Practice Schedule, part P, issue 1). L1 requires that every levy entry that sets a charge from a figure must name the document the figure was read from. Because the document does not set a charge from a figure, the conditional trigger requiring the citation of a source document is not engaged under the facts shown in the text. 4. SYNTHESIZE: No legal flaws or mandatory rule deviations are present under the provided framework. No procedural strengths with direct positive compliance mappings or norm conflicts exist.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record titled 'Levy entry LV-440'. It records that the cargo ship Marta Holm called at the south quay and states under 'Levy result' that 'The harbour levy is recorded as payable in full.' No numerical figure or charge derived from a figure appears in the text. 2. TRACE: The document asserts that a levy is payable in full, but no figure is stated or used to calculate the charge. 3. EVALUATE: The sole binding provision in the legal framework, Law L1 (Entry Practice Schedule, part P, issue 1), requires that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' Because the document does not set a charge from a figure, the condition triggering the obligation to cite the source document does not arise. 4. SYNTHESIZE: The document does not breach Law L1, and no other legal requirements are provided in the framework. Consequently, no flaws, procedural strengths, or norm conflicts are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identified statements in the document: (a) 'The cargo ship Marta Holm called at the south quay.', (b) 'The harbour levy is recorded as payable in full.' 2. TRACE: Evaluated whether any charge is set from a numerical figure in the text. No figures or numbers are used to set or calculate a charge in the document. 3. EVALUATE: Assessed the document against the sole binding rule, Law L1 (Entry Practice Schedule, part P, issue 1), which stipulates that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' Because no charge is established from a figure in the entry, the condition triggering the requirement to cite a source document is not engaged by the text. 4. SYNTHESIZE: There are no deviations from the provided legal framework, no procedural strengths explicitly mandated and completed under Law L1, and no norm conflicts.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Identified statements in the document: 'Levy entry LV-440', 'The cargo ship Marta Holm called at the south quay.', and 'The harbour levy is recorded as payable in full.' 2. TRACE: The text records the calling of a cargo ship and notes that the levy is payable in full without providing a specific monetary or numerical figure from which the charge was derived. 3. EVALUATE: Evaluated against Entry Practice Schedule, part P, issue 1 (L1), which stipulates that every levy entry that sets a charge from a figure must name the document from which that figure was read. The duty under L1 is conditional on a charge being set from a figure. The document does not set a charge from a figure. Therefore, the obligation to name a source document is not triggered, and no procedural violation of L1 exists. 4. SYNTHESIZE: There are no identified flaws, no positive procedural strengths mapped directly to the legal framework, and no norm conflicts.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains the record 'Levy entry LV-440'. It states that the cargo ship Marta Holm called at the south quay, notes that the basis of the charge section lines are not present in the copy supplied, and states in the levy result that the harbour levy is recorded as payable in full. No numerical figure or charge amount is stated in the record. 2. TRACE: The statement that the harbour levy is recorded as payable in full represents the conclusion of the levy entry. There is no specific charged figure cited or derived within the available text. 3. EVALUATE: Under the provided legal framework (Entry Practice Schedule, part P, issue 1), every levy entry that sets a charge from a figure must name the document the figure was read from. However, this statutory duty is conditional on setting a charge from a figure. Since the document does not set a charge from a figure, the obligation to name a source document for a figure is not triggered under the circumstances shown in the text. 4. SYNTHESIZE: The document does not exhibit any procedural or legal deviations from the single binding rule provided in the framework. Consequently, no flaws or norm conflicts are identified.
0 brister rapporterade
0 styrkor rapporterade
Körning efter en ändring i motorn,
Det här testfallet i varje körning av omgången. Testfall Körning 1 Körning 2 Körning 3 Bedömt mot version 1Endast granskarenSamma fynd i varje körning Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document contains a record entitled 'Levy entry LV-440', stating under 'Ship calling' that 'The cargo ship Marta Holm called at the south quay', noting '[The lines of this section are not in the copy supplied.]' under 'Basis of the charge', and concluding under 'Levy result' that 'The harbour levy is recorded as payable in full.' 2. TRACE: Trace whether any charge is set from a figure. The document records the levy as payable in full, but does not state or calculate any charge from a numeric figure. 3. EVALUATE: Compare against the sole legal source L1 ('Entry Practice Schedule, part P, issue 1'). L1 requires that in a record, 'every levy entry that sets a charge from a figure must name the document the figure was read from.' Because the record does not set a charge from a figure, the conditional obligation to name the document from which a figure was read is not engaged. 4. SYNTHESIZE: There are no deviations from or violations of the supplied legal framework, nor are there any norm conflicts or explicitly fulfilled procedural requirements to record as strengths.
0 brister rapporterade
0 styrkor rapporterade
Körning 2
Språk som motorn angav: English
Motorns resonemang
1. SCAN: Scan the document for levy entries, figures, and causal/factual claims. The document consists of 'Levy entry LV-440', an entry regarding the cargo ship 'Marta Holm' calling at the south quay, an empty section marked '[The lines of this section are not in the copy supplied.]' under 'Basis of the charge', and a statement 'The harbour levy is recorded as payable in full.' under 'Levy result'. 2. TRACE: Trace whether any charge is set from a numerical figure. No figure is stated or used to set a charge in the document text. 3. EVALUATE: Compare against the legal framework (L1: Entry Practice Schedule, part P, issue 1). L1 requires that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' Under the strict constraints, a procedural step counts as required only when it is mandatory for this document type and is not conditional on circumstances the document does not show. Since the document does not set a charge from a figure, the condition triggering the requirement to name a source document is not established. Thus, no legal flaw is present under the provided legal rule. 4. SYNTHESIZE: There are no identified flaws, no norm conflicts, and no affirmative procedural strengths mapping directly to compliance with L1.
0 brister rapporterade
0 styrkor rapporterade
Körning 3
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The document is a record entitled 'Levy entry LV-440' regarding the cargo ship Marta Holm calling at south quay, noting under 'Levy result' that 'The harbour levy is recorded as payable in full.' No numerical figures or specific charge calculations from figures are stated. 2. TRACE: The statement that the levy is payable in full is recorded without reference to any underlying figure or computation. 3. EVALUATE: The applicable legal provision is Entry Practice Schedule, part P, issue 1 (id: L1), which requires that 'every levy entry that sets a charge from a figure must name the document the figure was read from.' The statutory duty to name a source document is explicitly conditional upon setting a charge from a figure. Since the document does not set a charge from a figure, the condition triggering the obligation is not present. Under the instructions, a step does not count as mandatory if it is conditional on circumstances the document does not show. 4. SYNTHESIZE: There are no legal flaws or procedural deviations under the provided framework. No norm conflicts or explicit legal strengths are identified.
0 brister rapporterade
0 styrkor rapporterade
Kontroll: motorn körd med fel regler
Visas skild från resultaten. Motorn fick ett annat falls regler, så varje fynd nedan är ett fynd mot regler som inte gäller det här dokumentet.
Det här testfallet i varje körning av omgången. Testfall Körning 1 Bedömt mot version 2Endast granskaren Inget fynd förväntas
Inga fynd utöver facit
Inget förbjudet fynd
Citat: 0 ordagrant, 0 påhittat, 0 obestämbart
Rent testfall: godkänt, ingen brist rapporterades
Se motorns egna svar
Det här är motorns egna svar, på den engelska den skrev dem, visade precis som de kom tillbaka och oredigerade. Upprepningarna står sida vid sida, så att du själv kan se hur formuleringarna varierar även när det poängsatta resultatet är detsamma.
System- och användarprompterna som motorn fick publiceras inte: de hör till produkten, inte till testet. Dokumentet, reglerna och instruktionen som testet gav visas ovan.
Körning 1
Språk som motorn angav: English
Motorns resonemang
1. SCAN: The text comprises a levy entry record for the vessel Marta Holm calling at the south quay, noting that the harbour levy is payable in full. 2. TRACE: The applicable legal framework consists solely of law L1 (Entry Practice Schedule, part R, issue 1), which imposes a requirement that every berthing entry stating a vessel was moved must name the person who ordered the move. 3. EVALUATE: The text records that the vessel called at the south quay, but does not state that the vessel was moved. Consequently, the conditional requirement under L1 to name the person who ordered a move is not triggered. 4. SYNTHESIZE: No procedural or substantive flaws are present under the provided legal framework, and no specific positive procedural strengths mapping directly to L1 are established.
0 brister rapporterade
0 styrkor rapporterade
Tidigare versioner av det här testfallet
En rättad grupp publiceras bredvid den version som tidigare resultat bedömdes mot.
Gruppversion 1
Vad det här testfallet ändrar
- Faktor
- the passage the rule would be applied to
- Nivå
- not in the copy
- Jämförs med
- figure-without-documentÄndringen ska ändra svaret. Ett textställe i dokumentet skiljer sig mellan de två.
The same entry, whose copy does not carry that section.
Dokumentet motorn fick
Exakt den text motorn fick, rad för rad.
- Levy entry LV-440
- Ship calling
- The cargo ship Marta Holm called at the south quay.
- Basis of the charge
- [The lines of this section are not in the copy supplied.]
- Levy result
- The harbour levy is recorded as payable in full.
Reglerna motorn fick
Varje regel visas under en neutral beteckning i stället för sitt interna namn.
Regel A
The document a charged figure was read from
Källa: Entry Practice Schedule, part P, issue 1
In a record, every levy entry that sets a charge from a figure must name the document the figure was read from. A figure whose document is not named gives the charge no support. The duty rests on the author of the record.
Facit
Skrevs ner innan motorn kördes. withheld-basis-truth
The section the rule would be applied to is not in the copy, so the document cannot decide it.
Facit är uttömmande: varje fynd som inte står som förväntat räknas som fel.
Förväntade fynd
Inget fynd förväntas.
- Varför inget ska rapporteras
- Dokumentet ger för lite att bedöma. INSUFFICIENT_EVIDENCE
Förbjudna fynd
Fel svar, nedskrivna i förväg.
- BristUtelämnandeFynd unsourced-figure-asserted-from-absent-text
Reporting an unsupported figure from a passage the copy does not carry is a finding without a document.
- Ska förankras i
[The lines of this section are not in the copy supplied.]
- Ska hänvisa till
- Regel A
- Kontrolleras i
- granskarens eget utfall, den levererade rapporten
Vad den blinda läsaren svarade
En AI-läsare fick det här dokumentet och dess regler, men inte facit, och svarade på egen hand. Jämför svaret med facit ovan.
- Överens med facitClaude, 23 september 2026Punkt i läsarens underlag item-08
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Dokumentet ger för lite att bedöma. INSUFFICIENT_EVIDENCE
- Överens med facitGemini, 4 oktober 2026Punkt i läsarens underlag item-08
Läsaren rapporterade inget fynd.
Varför inget ska rapporteras Dokumentet ger för lite att bedöma. INSUFFICIENT_EVIDENCE
Kritisk granskning av facit
En AI-modellsession försökte hitta fel i det här facit enligt ett publicerat protokoll: är varje väntat fynd verkligen ett brott mot regeln, är varje felfritt fall verkligen felfritt, prövar fallet det det säger sig pröva, och skulle ett lika riktigt svar som pekar på ett annat ställe räknas som fel. Den tittade inte på motorns resultat först. Varje invändning visas med hur den avgjordes. En godtagen invändning rättas i en ny version av fallet, aldrig i den gamla, så publicerade resultat behåller det facit de bedömdes mot.
Granskning av Claude, 4 oktober 2026
- Invändning besvaradTvetydighetRegel Ap2 · withheld-basis-truth
The withheld variant still says "The harbour levy is recorded as payable in full." A careful reader could hold that the entry sets a charge and, as supplied, names no document for anything, so a flaw is due whatever the missing lines say.
Facit står kvar
Rule A is triggered by a charge set from a figure. With the basis withheld, neither whether a figure was used nor whether its document was named can be seen, and the marker says the copy, not the entry, lacks the lines. Insufficient evidence is the strict reading.
- Invändning besvaradSvårighetp3 · withheld-basis-truth
The bracketed line announces the gap in plain words, so the case tests obeying a marked gap rather than noticing that the decisive passage is missing.
Facit står kvar
A copy with withheld lines marks them, as redacted records do; an unmarked gap is a different capability and a different family.
- Invändning besvaradGiltighetRegel Ap4
Gäller hela gruppen av fall
The family carries the outcome unsupported-factual-claim, but structurally it is a claim-anchored omission under a rule that says what support is required, the same shape as the cure and refusal families. It does not test spotting an unsupported claim no rule describes.
Facit står kvar
The engine audits a document against supplied rules, so a claim is unsupported in the sense a supplied rule defines. The family's rule is what makes the figure unsupported; that is what the outcome names.
Testets instruktion till granskaren
Testkonfigurationen gav AI-granskaren den här instruktionen vid sidan av reglerna. Det är testets egen instruktion. Produktionens systemprompt visas inte.
You read one document and apply only the rules supplied to you in the legal framework, exactly as each rule is written. Report every place where the document does not meet a supplied rule, and apply what a supplied rule says about how a record that meets it is to be recorded. Quote each passage exactly as it appears. Do not apply a rule that was not supplied, and do not rely on any knowledge of a legal system.Vem som skrev och läste det här testfallet
En AI-modellsession skrev de här testfallen, och en annan AI-modellsession läste dem blint utan att se facit. Ingen människa har granskat dem.
- Skrevs
- , registrerat som Verkstaden implementer (Claude Local), #2323
- Modellfamilj som skrev det
- Claude
- Varför det skrevs
- Authored for #2323 as new REGRESSION material in the outcome shapes of the controlled-pilot suite, sharing none of its text. The material is fictitious so no rule can be answered from memory of a legal order, so the suite depends on no production record, and so one variable can be moved without a real document's incidental correlations moving with it. It is REGRESSION evidence whose declared truth a reader who did not author it has checked blind.
Granskning
Skrivna av en AI-modellsession: Claude.
Blind läsning, Claude, 23 september 2026: 22 av 22 överens
registrerat som Verkstaden orchestrator session (Claude Opus 5.5), blind read
Ingen oenighet med facit.
Se vad den blinda läsaren svarade i varje testfallBlind läsning, Gemini, 4 oktober 2026: 19 av 22 överens
registrerat som gemini-2.5-pro (Vertex europe-west1), blind read
Se vad den blinda läsaren svarade i varje testfall3 oenigheter med facit
Punkt item-06
The reader found the closure entry's missing statement of where its papers are stored, as declared, but placed it under the "Closing note" heading; the key places it under no section.
Hur den avgjordes
Genuinely ambiguous: the rule attaches the duty to the whole entry, but a closing note is a natural home for it, and the packet does not say which. Kept as declared; #3082 sharpens the case.
Punkt item-07
The reader agreed nothing is due for the sample run from a tap, but gave the reason as a condition not triggered; the key declares the sample out of the rule's scope.
Hur den avgjordes
Genuinely ambiguous: the packet names the four reasons without defining them, and the rule's wording reads both as a scope limit and as an unmet condition. Kept as declared; #3083 sharpens the reasons.
Punkt item-17
The reader found the levy charged from a figure with no named document, as declared, but quoted the sentence that sets the levy; the key anchors the flaw on the sentence that states the figure.
Hur den avgjordes
Reader wrong: the rule's duty attaches to the figure ("a figure whose document is not named"), and the packet anchors an unsupported claim on the claim itself, which here is the figure, not the charge set from it.
Kritisk granskning, Claude, 4 oktober 2026: 1 invändning
registrerat som Claude Project thread session for #3049, adversarial critique
1 oenighet med facit
Punkt p1 (figure-without-document, charged-figure-without-document)
KEY_WEAK, ANCHORING: Rule A's duty attaches to an entry that "sets a charge from a figure". That act is its own line, "The levy was set from that tonnage.", while the key anchors the omission on the line above, "The gross tonnage of the ship was 1,840." An omission anchored on the setting of the charge is as correct as the key's, but the scorer accepts a wider quote only on the anchor's own line, so it is scored as a miss and an unexpected flaw.
Hur den avgjordes
ACCEPTED: A correct answer must not be scored as two errors. The family is corrected under a new version in which the figure and the charge set from it are one sentence. Follow-up #3075.
AI-modeller skrev och granskade de här testfallen, som anges ovan. Ingen människa har granskat dem. Varje oenighet mellan en AI-granskare och facit publiceras här.
Fingeravtryck
SHA-256-hashvärden som en läsare kan jämföra med en publicerad körnings rapport.
- Dokument
- ecbc0f6164232e4c9288ab383293ee2a7d46bf613acaa8d4febac0cb897b9455
- Dokumentmall
- 1e2f522c3a8a20b3c8c8b90f93181b5e09a2fc9c59e8813d37cb50f566d3dd3f
- Regel A
- fa3928d90b453dd2d705189e5d07ab64c11337803e039b0f60e0ab3268b5a7d6