<?xml version="1.0" encoding="utf-8"?>
<feed xmlns="http://www.w3.org/2005/Atom">
  <title>Reinforced Labs Research</title>
  <subtitle>Research notes and explainers on AI evaluation, guardrails and agent security.</subtitle>
  <link href="https://reinforcedlabs.ai/research/feed.xml" rel="self"/>
  <link href="https://reinforcedlabs.ai/research"/>
  <id>https://reinforcedlabs.ai/research</id>
  <updated>2026-10-27T12:00:00Z</updated>
  <author><name>Reinforced Labs Research</name></author>
  <entry>
    <title>AI compliance testing: EU AI Act, NIST AI RMF and ISO/IEC 42001</title>
    <link href="https://reinforcedlabs.ai/learn/ai-compliance-testing"/>
    <id>https://reinforcedlabs.ai/learn/ai-compliance-testing</id>
    <published>2026-10-27T12:00:00Z</published>
    <updated>2026-10-27T12:00:00Z</updated>
    <summary>What each framework actually asks you to test, mapped to concrete evaluations and evidence.</summary>
  </entry>
  <entry>
    <title>LLM-as-a-judge: how it works, where it fails, how to validate it</title>
    <link href="https://reinforcedlabs.ai/learn/llm-as-a-judge"/>
    <id>https://reinforcedlabs.ai/learn/llm-as-a-judge</id>
    <published>2026-10-24T12:00:00Z</published>
    <updated>2026-10-24T12:00:00Z</updated>
    <summary>Judge designs, documented biases, and a validation protocol with agreement metrics.</summary>
  </entry>
  <entry>
    <title>How many test cases does an LLM eval need?</title>
    <link href="https://reinforcedlabs.ai/research/eval-sample-size"/>
    <id>https://reinforcedlabs.ai/research/eval-sample-size</id>
    <published>2026-10-21T12:00:00Z</published>
    <updated>2026-10-21T12:00:00Z</updated>
    <summary>Wilson intervals, power analysis and a Monte Carlo study of paired vs. unpaired tests. Detecting a 2-point regression takes thousands of cases, not hundreds.</summary>
  </entry>
  <entry>
    <title>EU AI Act testing requirements and the 2026–2028 timeline</title>
    <link href="https://reinforcedlabs.ai/learn/eu-ai-act-testing-requirements"/>
    <id>https://reinforcedlabs.ai/learn/eu-ai-act-testing-requirements</id>
    <published>2026-10-20T12:00:00Z</published>
    <updated>2026-10-20T12:00:00Z</updated>
    <summary>Articles 9, 15 and 55, the Digital Omnibus delay, and what evidence a test programme should produce.</summary>
  </entry>
  <entry>
    <title>LLM-as-a-judge vs. human evaluation</title>
    <link href="https://reinforcedlabs.ai/compare/llm-as-a-judge-vs-human-evaluation"/>
    <id>https://reinforcedlabs.ai/compare/llm-as-a-judge-vs-human-evaluation</id>
    <published>2026-10-17T12:00:00Z</published>
    <updated>2026-10-17T12:00:00Z</updated>
    <summary>Cost, agreement, latency and failure modes compared, and a hybrid design that uses each where it is strongest.</summary>
  </entry>
  <entry>
    <title>AI safety and evaluation for financial services</title>
    <link href="https://reinforcedlabs.ai/industries/financial-services"/>
    <id>https://reinforcedlabs.ai/industries/financial-services</id>
    <published>2026-10-16T12:00:00Z</published>
    <updated>2026-10-16T12:00:00Z</updated>
    <summary>Model risk management (SR 11-7), credit and fraud use cases, and agent controls for payments.</summary>
  </entry>
  <entry>
    <title>Your LLM judge is a diagnostic test: correcting measured failure rates</title>
    <link href="https://reinforcedlabs.ai/research/llm-judge-error"/>
    <id>https://reinforcedlabs.ai/research/llm-judge-error</id>
    <published>2026-10-14T12:00:00Z</published>
    <updated>2026-10-14T12:00:00Z</updated>
    <summary>Sensitivity, specificity and the Rogan–Gladen correction. At a 0.5% true failure rate, a 97%-accurate judge reports 3.4%.</summary>
  </entry>
  <entry>
    <title>NIST AI RMF Measure for generative AI: an evaluation checklist</title>
    <link href="https://reinforcedlabs.ai/learn/nist-ai-rmf-measure"/>
    <id>https://reinforcedlabs.ai/learn/nist-ai-rmf-measure</id>
    <published>2026-10-13T12:00:00Z</published>
    <updated>2026-10-13T12:00:00Z</updated>
    <summary>Turning the Measure function and the NIST AI 600-1 profile into tests you can run.</summary>
  </entry>
  <entry>
    <title>Indirect prompt injection, explained</title>
    <link href="https://reinforcedlabs.ai/learn/indirect-prompt-injection"/>
    <id>https://reinforcedlabs.ai/learn/indirect-prompt-injection</id>
    <published>2026-10-10T12:00:00Z</published>
    <updated>2026-10-10T12:00:00Z</updated>
    <summary>How instructions hidden in documents, web pages and tool output hijack agents, with real research and the controls that hold.</summary>
  </entry>
  <entry>
    <title>LLM evaluation plan template</title>
    <link href="https://reinforcedlabs.ai/templates/llm-eval-plan"/>
    <id>https://reinforcedlabs.ai/templates/llm-eval-plan</id>
    <published>2026-10-09T12:00:00Z</published>
    <updated>2026-10-09T12:00:00Z</updated>
    <summary>A copy-ready plan: scope, threat model, categories, sample sizes, graders, gates and owners.</summary>
  </entry>
  <entry>
    <title>pass@k vs. pass^k: measuring agent reliability</title>
    <link href="https://reinforcedlabs.ai/research/pass-at-k-vs-pass-hat-k"/>
    <id>https://reinforcedlabs.ai/research/pass-at-k-vs-pass-hat-k</id>
    <published>2026-10-07T12:00:00Z</published>
    <updated>2026-10-07T12:00:00Z</updated>
    <summary>Three task populations with identical pass@1 = 0.60 have pass^8 between 1.7% and 28.8%. How to estimate pass^k and how many trials you need.</summary>
  </entry>
  <entry>
    <title>Evaluating clinical and healthcare LLM applications</title>
    <link href="https://reinforcedlabs.ai/industries/healthcare"/>
    <id>https://reinforcedlabs.ai/industries/healthcare</id>
    <published>2026-10-06T12:00:00Z</published>
    <updated>2026-10-06T12:00:00Z</updated>
    <summary>Clinical harm taxonomies, expert graders, over-refusal and documentation for regulated deployments.</summary>
  </entry>
  <entry>
    <title>Prompt injection vs. jailbreak: what's the difference?</title>
    <link href="https://reinforcedlabs.ai/compare/prompt-injection-vs-jailbreak"/>
    <id>https://reinforcedlabs.ai/compare/prompt-injection-vs-jailbreak</id>
    <published>2026-10-03T12:00:00Z</published>
    <updated>2026-10-03T12:00:00Z</updated>
    <summary>Different attacker, different target, different defences. A precise comparison with examples.</summary>
  </entry>
  <entry>
    <title>AI red-team report template</title>
    <link href="https://reinforcedlabs.ai/templates/ai-red-team-report"/>
    <id>https://reinforcedlabs.ai/templates/ai-red-team-report</id>
    <published>2026-10-02T12:00:00Z</published>
    <updated>2026-10-02T12:00:00Z</updated>
    <summary>Finding format, severity model, reproduction rate and retest log, ready to copy.</summary>
  </entry>
  <entry>
    <title>A 2% attack success rate is not low: retry economics of prompt injection</title>
    <link href="https://reinforcedlabs.ai/research/prompt-injection-retry-risk"/>
    <id>https://reinforcedlabs.ai/research/prompt-injection-retry-risk</id>
    <published>2026-09-30T12:00:00Z</published>
    <updated>2026-09-30T12:00:00Z</updated>
    <summary>Cumulative compromise probability, and why correlated defence layers deliver 3–30× less protection than the independence assumption predicts.</summary>
  </entry>
  <entry>
    <title>OWASP Top 10 for LLM Applications (2025), explained for engineers</title>
    <link href="https://reinforcedlabs.ai/learn/owasp-top-10-llm"/>
    <id>https://reinforcedlabs.ai/learn/owasp-top-10-llm</id>
    <published>2026-09-26T12:00:00Z</published>
    <updated>2026-09-26T12:00:00Z</updated>
    <summary>All ten risks, what each looks like in an agent, and the test and control that addresses it.</summary>
  </entry>
  <entry>
    <title>Guardrail thresholds under low base rates</title>
    <link href="https://reinforcedlabs.ai/research/guardrail-thresholds"/>
    <id>https://reinforcedlabs.ai/research/guardrail-thresholds</id>
    <published>2026-09-23T12:00:00Z</published>
    <updated>2026-09-23T12:00:00Z</updated>
    <summary>With a 0.1% attack rate, a classifier with AUC 0.96 tuned to 95% recall has 0.5% precision. Cost-optimal thresholds, worked through.</summary>
  </entry>
  <entry>
    <title>MCP security: tool poisoning, rug pulls and how to defend</title>
    <link href="https://reinforcedlabs.ai/learn/mcp-security"/>
    <id>https://reinforcedlabs.ai/learn/mcp-security</id>
    <published>2026-09-19T12:00:00Z</published>
    <updated>2026-09-19T12:00:00Z</updated>
    <summary>The Model Context Protocol attack surface and a hardening checklist for teams connecting agents to MCP servers.</summary>
  </entry>
  <entry>
    <title>The latency budget of AI guardrails: sequential, parallel and hedged</title>
    <link href="https://reinforcedlabs.ai/research/guardrail-latency"/>
    <id>https://reinforcedlabs.ai/research/guardrail-latency</id>
    <published>2026-09-16T12:00:00Z</published>
    <updated>2026-09-16T12:00:00Z</updated>
    <summary>Order statistics of parallel checks. Hedging at the single-check p95 cuts eight-check p99 from 49 ms to 35 ms for 5% extra load.</summary>
  </entry>
  <entry>
    <title>Evals vs. guardrails vs. red teaming</title>
    <link href="https://reinforcedlabs.ai/compare/evals-vs-guardrails"/>
    <id>https://reinforcedlabs.ai/compare/evals-vs-guardrails</id>
    <published>2026-09-15T12:00:00Z</published>
    <updated>2026-09-15T12:00:00Z</updated>
    <summary>Comparison.</summary>
  </entry>
</feed>
