How we measure Bearnier AI's answers
What the question set covers
| Category | Questions |
|---|---|
| Predicates | 50 |
| Testing | 40 |
| Standards | 30 |
| Software and cybersecurity | 30 |
| Post-market | 25 |
| Pathways | 25 |
| Total | 200 |
Planned split. Final counts are published with the first scores in January 2027.
How grading works
- 1
Experts write the questions
Regulatory professionals write 200 device questions and the answers they would accept.
- 2
Bearnier AI answers each one
Every release answers the full set without seeing the expected answers.
- 3
Graders score three things
Answer accuracy, citation validity, and whether Bearnier AI correctly refused when the record does not support an answer.
- 4
We publish the scores
Scores for every release go on this page, starting January 2027.