Claude Certified Architect — Foundations · Free practice question 2 of 10
Severity and confidence metadata for review findings
A code-review automation surfaces findings to engineers; the team complains that noisy findings drown out the genuine bugs. The team is unwilling to lose any genuine bug, so they want to keep recall high but reduce the noise downstream. Which output design best supports this tradeoff while keeping all of Claude's findings available for later analysis?
- A.Ask Claude to emit each finding with `severity` (low/med/high) and `confidence` (0–1) fields, and threshold programmatically downstream.
- B.Lower Claude's temperature and tell it "only report bugs you are highly confident about."
- C.Have Claude self-filter and emit only findings it would tag as high severity.
- D.Wrap Claude's review in a second pass that re-reads each finding and keeps only the ones flagged "true positive."
Show answer and explanation
Correct answer: A. Ask Claude to emit each finding with `severity` (low/med/high) and `confidence` (0–1) fields, and threshold programmatically downstream.
Why: Structured metadata on every finding preserves recall at the model layer (nothing is dropped) while letting downstream code threshold cheaply and adjust over time. Self-filtering and re-pass approaches throw away information you can never recover later for analysis.
More free Claude Certified Architect — Foundations questions
- Narrowing label definitions to stop over-triggering
- Tool-based verification to prevent hallucinated APIs
- Precision vs recall trade-offs in extraction
- Evidence fields for auditable structured output
- Tool schemas for strict JSON conformance
- Routing scarce human review capacity
- Execution-based evals for SQL generation
- Prompt caching for repeated context
- Shadow-mode rollout for prompt changes