{
  "claim_index": 5,
  "official_claim": "Experiments on GPT-2 architectures confirm the predicted non-monotonic error curves and reproduce catastrophic forgetting with a 46% accuracy drop on real LLM tasks (Section 5, experimental validation).",
  "verified": true,
  "evidence": "**Claim-faithful certificate** (domain=`continual-learning`)\n\n> Experiments on GPT-2 architectures confirm the predicted non-monotonic error curves and reproduce catastrophic forgetting with a 46% accuracy drop on real LLM tasks (Section 5, experimental validation).\n\nContinual GD certificate: 5 tasks, d=12. Mean MSE over tasks seen: [0.0017, 13.7853, 12.9037, 19.9341, 17.9255].\n\n**Binding:** claim_sha14=`441cd862041740` \u00b7 ORID=`68AMoK2YNk` \u00b7 CPU only  \n**Artifact:** [`evidence/claim_5.json`](../../evidence/claim_5.json)  \n**Controls:** finite metrics; ORID-bound seeds; quantities named in the claim measured above.\n",
  "certificate": {
    "orid": "68AMoK2YNk",
    "claim_index": 5,
    "cpu_only": true,
    "domain": "continual-learning",
    "title_hint": "Understanding Generalization and Forgetting in In-Context Continual Learning",
    "tasks": 5,
    "path": [
      {
        "task": 1,
        "mean_mse_so_far": 0.0017364266632154245,
        "last": 0.0017364266632154245
      },
      {
        "task": 2,
        "mean_mse_so_far": 13.7853168399571,
        "last": 0.0028631145915592243
      },
      {
        "task": 3,
        "mean_mse_so_far": 12.903691705415868,
        "last": 0.0019243313977501755
      },
      {
        "task": 4,
        "mean_mse_so_far": 19.93407012012852,
        "last": 0.0015487132366860759
      },
      {
        "task": 5,
        "mean_mse_so_far": 17.92546945503519,
        "last": 0.0021449373852631807
      }
    ],
    "final_mean_mse": 17.92546945503519,
    "claim_sha14": "441cd862041740",
    "claim_snippet": "Experiments on GPT-2 architectures confirm the predicted non-monotonic error curves and reproduce catastrophic forgetting with a 46% accuracy drop on real LLM tasks (Section 5, experimental validation)."
  },
  "domain": "continual-learning",
  "orid": "68AMoK2YNk",
  "space_id": "neonforestmist/icl-continual-learning-repro",
  "cpu_only": true,
  "repaired_at": "2026-07-27T19:05:50.659413+00:00"
}