Claude Certified Architect — Foundations · Free practice question 1 of 10
Narrowing label definitions to stop over-triggering
You run a Claude-powered ticket-classification pipeline that tags incoming customer requests with one of seven labels. Production logs show the model consistently picks the "billing" label for messages that mention any dollar amount, even when the message is clearly about feature requests that happen to reference pricing. The prompt currently says "Tag the ticket with the most relevant label." Which prompt change is most likely to fix the over-triggering without breaking other labels?
- A.Add an explicit "Only use the billing label when the user is asking about an existing charge, refund, or payment failure" instruction.
- B.Append a final instruction "Be careful and think before answering."
- C.Switch to a tool call where the model selects from an enum of labels.
- D.Lower the model's temperature to 0.
Show answer and explanation
Correct answer: A. Add an explicit "Only use the billing label when the user is asking about an existing charge, refund, or payment failure" instruction.
Why: Over-triggering on a lexical pattern (any dollar amount → billing) is a definition gap in the prompt. Narrowing when billing applies fixes the root cause. A tool-call with an enum still lets the model pick the wrong enum value; temperature changes don't address the model's mistaken concept of what 'billing' covers.
More free Claude Certified Architect — Foundations questions
- Severity and confidence metadata for review findings
- Tool-based verification to prevent hallucinated APIs
- Precision vs recall trade-offs in extraction
- Evidence fields for auditable structured output
- Tool schemas for strict JSON conformance
- Routing scarce human review capacity
- Execution-based evals for SQL generation
- Prompt caching for repeated context
- Shadow-mode rollout for prompt changes