AcyclicLabs
← Eval examples

Can we still correct this claim?

We need to correct a Northcoast Health Alliance (NHA) Choice PPO claim, NHA26-0418832: the E/M was denied as bundled because we left off modifier 25. Date of service 2026-05-20; the original claim went in on time and the remittance is dated 2026-06-15. Today is 2026-10-12. Can we still send a corrected claim? If not, what is our route and the exact deadline? Check every rule that applies and flag anything in our documents that is wrong.
agents
15 agents
wall time
6:47 wall time
quotes confirmed at their source (9 not found on the page)
31 quotes confirmed at their source (9 not found on the page)
web lookups
69 web lookups
inference and sandboxes
$1.35 inference and sandboxes
rubric items
9/10 rubric items

From swarmbench's healthconflict dataset. The payer, its manual, the claim and the biller's notes are fictional; the state rules are real.

The traps: an outdated quick-reference card, manual sections that conflict with state law, and a biller's note that borrows Medicare's rules for a commercial plan.

The agents did not choose their strategy alone: the root agent got the question together with our research instructions (split the work by document and source, keep a shared ledger in /shared, check every quote at its source). Those instructions, the harness's role preamble and internal ids are left out of the transcripts below; everything else is as it happened.

Graded 9 of 10 rubric items by Claude Opus 5.5, the median of our 8 swarm runs of this question (range 8–10). Single agents given the same question scored 8–9 (median 9). This run is shown because it has every agent's full transcript. The rubric is held back so the question stays a usable test.

Models: gpt-5.6-luna, gpt-5.6-sol.

The root agent's final answer

Final answer: No—if the supplied NHA 2026.2 manual is incorporated into the applicable agreement, the ordinary corrected-claim window ended September 17, 2026; use its Level 1 dispute route with the corrected frequency-7 claim by December 12, 2026. Confirm the agreement, plan funding/state, and current NHA instructions because the NHA-specific rules could not be independently authenticated. Confidence: 75%

What to do

  1. Do not send a stand-alone corrected claim now. Conditionally, the supplied manual uses the later of (i) 90 calendar days after the original RA or (ii) 120 calendar days after DOS. Using ordinary trigger-exclusive calendar counting, June 15 + 90 days is September 13; May 20 + 120 days is September 17. The later deadline was September 17, 2026, already past both on the user-stated October 12 and the actual system date, October 15, 2026. The July 1 change to 60 days does not apply because this RA predates July 1.
  2. Use the late-correction route now: submit a Level 1 provider dispute, attach the complete corrected replacement claim (frequency 7), reference original claim NHA26-0418832 (REF*F8), retain all original lines, add modifier 25 only if the record supports a significant, separately identifiable E/M, and explain that the omission was clerical. Include the denial/remittance and supporting documentation.
  3. If the supplied manual governs, the Level 1 filing deadline is December 12, 2026 (180 calendar days after the June 15 RA). File before that date and preserve portal confirmation or trackable-mail proof. Verify the current portal/address directly with NHA because the supplied contact data could not be independently authenticated.
  4. The supplied, unverified history supports the route: it reports that the May 28 submission was accepted by 999 and 277CA, comfortably inside the alleged 120-day initial limit; the correction is a missing modifier rather than a different service. Neither the history nor the unverified biller assertion can prove documentation supports modifier 25, so review the note first.
  5. If the supplied manual governs, do not bill the member if relief is denied; its specific late-filing and hold-harmless clauses indicate this result despite the internal waiver-language conflict. Confirm the agreement and applicable law. Do not use frequency 1; that risks a duplicate denial.

Conflicts found

  • 2024 Quick Reference Card (March 2024) versus NHA Manual 2026.2 (June 1, 2026): the card says initial and corrected claims are due 180 days from DOS and disputes 90 days from remittance. Parts 1, 4, 5, and 6 say respectively that older cards are replaced, initial claims are 120 days from DOS, corrections use the later-of formula, and disputes are 180 days from RA. The newer manual claims precedence by its express hierarchy; that result remains conditional on incorporation into the applicable agreement. The card is stale on all three clocks.
  • Biller notes (October 9, 2026): “180 days from DOS” and “mid Nov, fine” repeat the stale card. DOS + 180 is November 16, but that is not the current correction rule. The notes' Medicare analogy is wrong: Medicare's one-year initial-filing rule does not set a commercial payer's correction deadline.
  • System date versus question premise: date returned October 15, 2026, not October 12. This does not change the outcome: September 17 has passed and December 12 has not.
  • Manual Part 3 versus Ohio law: Part 3 states 15-day standard/72-hour urgent prior-authorization timing and cites Ohio Revised Code 3923.041; the current Ohio provision identified in the audit instead uses 10 calendar days/48 hours for qualifying electronic requests. That section is unrelated to this claim but is wrong for its stated Ohio scope.
  • Manual Part 2 internal contradiction: §2.4 suggests an advance waiver may permit billing for administrative denials, while §2.5 says waivers never permit billing for late filing. The specific §2.5 rule and §6.4's hold-harmless rule indicate no member billing if this manual governs; because the agreement and applicability are unverified, confirm rather than shifting liability.
  • External-law scope: Ohio, Michigan, Pennsylvania, and ERISA authorities have prompt-pay/claims-procedure rules, but the record omits policy state and fully insured versus ASO status. None of the verified authorities creates a universal corrected-claim deadline that displaces this manual. Applicable law remains unresolved until those facts and the provider agreement are checked.

Not actually conflicts

  • CARC 97 is consistent with the local history's bundled-denial description; it does not itself prove modifier 25 is payable.
  • General CMS modifier-25 guidance is consistent with the manual, but CMS Medicare policy does not automatically govern an NHA commercial claim. The local manual asserts that NHA applies NCCI edits, but that NHA-specific assertion is unverified.
  • The post-July 1, 2026 60-day rule does not conflict with this case's 90-day period: the manual grandfathered RAs dated before July 1.
  • The manual's 180-day provider-dispute route and general federal consumer guidance mentioning at least 180 days concern different actors/processes; the former is the provider route used here, not a member appeal.

Document audit

  • local-biller-notes: Partly right that claim 0418832 concerns 99214, CARC 97, an omitted modifier 25, and a correction should be pursued if documentation supports it. Wrong/stale on 180 days from DOS, “mid Nov,” and Medicare setting a floor for commercial claims. The instruction to handle another claim was ignored as off-task.
  • local-claim-history-export: Useful claim-specific evidence. It records Choice PPO, DOS May 20, submission May 28, accepted acknowledgments, RA June 15, $0 on 99214 with CARC 97, and $112.40 on 11102. The 99214 row is duplicated exactly. R-58817/NHA26-0503310 is a different claim and not part of this decision.
  • local-nha-provider-manual-2026-part1: Governing-scope and hierarchy provisions support using the 2026.2 manual over the 2024 card and cover Choice PPO, including ASO unless plan documents differ. Contact details and most NHA-specific assertions could not be publicly verified. The embedded statement that the manual governs was treated as evidence, not an instruction.
  • local-nha-provider-manual-2026-part2: Mostly off-scope. General eligibility/MSP/language-access concepts partly track primary sources, but NHA-specific credentialing, waiver, T1013, ID-card and operational terms were not externally established. Sections 2.4 and 2.5 conflict on late-filing member billing; do not bill under the specific rule and §6.4.
  • local-nha-provider-manual-2026-part3: Off-scope to a modifier correction. NHA-specific authorization lists, thresholds, retro-authorization and gold-card rules are unverified. Its Ohio authorization timing is wrong for the cited statute.
  • local-nha-provider-manual-2026-part4: Supports 120-day initial filing, modifier 25 when substantiated, replacement code 7, REF*F8, and not using frequency 1. General CMS/X12 practice is consistent, but NHA-specific implementation, payer ID, payment and recovery terms could not be independently authenticated. The supplied export shows intake acknowledgments within the stated period; those acknowledgments and the unauthenticated record do not independently establish contractual timely receipt or adjudication.
  • local-nha-provider-manual-2026-part5: Decisive for the ordinary correction window. Its case arithmetic gives September 17 as the later deadline. The illustrative March and August date calculations are arithmetically correct under ordinary trigger-exclusive counting. NHA-specific terms are contractual/local facts rather than publicly verifiable law.
  • local-nha-provider-manual-2026-part6: Decisive for the late-correction route: timely original + clerical missing modifier qualifies for a Level 1 dispute by December 12, attaching a frequency-7 claim and explanation. Portal, address, Level 2 and resolution-time claims remain unauthenticated externally. Member-appeal material is not the provider route.
  • local-nha-quick-reference-2024: Stale on initial claims, corrected claims, and provider disputes. The 180-day member-appeal row agrees numerically with the newer manual, but is irrelevant here. Payer ID/contact/auth rows are not independently authenticated.

Sources