Write a short rating rationale that identifies the decisive error without restating both responses.

Instruction: Submit an actual rationale of no more than two sentences for each fictional round. In the advanced round, apply the purchase-date policy assignment and cite the decisive version error; do not add external return rules or restate both responses.

Context:

Write concise rating reasons, then distinguish a current policy from the version that governs an earlier purchase.

Fictional practice task

Approved policy: Requests received within 14 days of purchase are eligible for a return. Requests received after 14 days are not eligible under this policy. There are no additional exceptions in the supplied policy.

User: "I purchased this item 18 days ago. Am I eligible for a return?"

Response A: "The policy permits returns within 14 days, so an 18-day-old purchase is not eligible under the supplied policy."

Response B: "You are eligible because the return window is 30 days."

Task: Prefer the response supported by the policy. Write a rationale of no more than two sentences identifying the decisive factual error; do not restate both full responses.

Advanced second round: current document, earlier purchase

This is a separate fictional policy case. There are no additional eligibility conditions or exceptions.

Policy assignment rule: Use the policy version effective on the purchase date, not the return-request date. Later revisions do not retroactively change the window for earlier purchases. The request is eligible when the elapsed calendar days are no greater than that version's limit.

  • Policy v1: Applies to purchases dated 2026-09-01 through 2026-09-30, inclusive. Return window: 14 calendar days.
  • Policy v2: Applies to purchases dated 2026-10-01 onward. Return window: 30 calendar days. It is the current document for new purchases and supersedes v1 for those purchases only.

Purchase: 2026-09-28. Return request: 2026-10-16, 18 calendar days after purchase.

Response A: "The purchase falls under v1, so its 18-day request is outside the 14-day window and is not eligible."

Response B: "v2 is current on the request date, so its 30-day window makes this request eligible."

Task: Prefer the response supported by the version-assignment rule. Submit a rationale of no more than two sentences naming the decisive policy error and its eligibility consequence. Do not rewrite the full responses.

Updated

Prepare a stronger answer

I'd prefer A...

This member answer includes:

  • • A complete, copyable sample answer
  • • Guidance for adapting the answer to your experience
  • • A practical walkthrough
  • • Common mistakes and how to avoid them
  • • Answered interviewer follow-ups
  • • Strong, adequate and weak assessment criteria
Unlock the full answer and preparation guide

One payment for one year of full access. No automatic renewal.

See pricing and everything included

Your preparation path

Choose the track that matches the role. Work through its questions in order, then explain each answer in your own words.

1. Entry level annotation

Apply guidelines, label text and spans, and explain a small practice project.

  1. How would you explain the data annotator role and the kind of work you would expect to do? Free sample
  2. How would you learn a new annotation guideline before starting your first batch? Member answer
  3. Apply a sentiment guideline to four short comments. Which labels would you choose, and why? Free sample
  4. Mark two location mentions using the exact character-offset contract. How would you check your result? Free sample
  5. Walk me through an annotation or quality-checking project you can discuss, including your own contribution and limits. Member answer

2. AI response evaluation

Compare responses using separate criteria for correctness, instruction following, and writing quality.

  1. Compare two AI responses against a supplied fact sheet. Which response is better under the rubric? Free sample
  2. One response is accurate but breaks the required format; another follows the format but contains a false claim. How would you rate them? Member answer
  3. Write a short rating rationale that identifies the decisive error without restating both responses. Member answer
  4. An AI response includes a factual claim you cannot verify from the supplied sources. What would you do? Member answer
  5. Two responses have different strengths and neither clearly wins. How would you apply the ranking rules? Member answer

3. Senior review and quality

Work through disagreement, missed critical cases, changing guidelines, review capacity, and reviewer calibration.

  1. Two experienced reviewers disagree repeatedly, and the deadline leaves little time for adjudication. What would you recommend? Free sample
  2. A batch has 98% accuracy against reviewed references but misses every critical item. Would you accept it? Member answer
  3. A labeling rule changes halfway through a delivery. Would you relabel old work, split the dataset or delay the release? Member answer
  4. The delivery requires review of every item, but the available reviewers cannot finish by the deadline. What would you change? Member answer
  5. A reference answer appears to contradict the written rule, and workers are being penalized for disagreeing with it. What would you do? Member answer

Try the 20 minute mock assessment. Use the fictional cases to practice; the self-check is not an employer's hiring benchmark.

Related Questions