Questions to ask before renewing an AI agent contract

  • Guide
  • Published
  • Reviewed
  • By

Before you renew, answer these questions from your own records rather than the vendor's report: what share of the agent's claimed outcomes held up, what each audited outcome cost, why the rest failed, whether that is getting better, and what the contract says about outcomes that fail. If you cannot answer the first two, the renewal is the moment to require the data that would.

The questions#

QuestionEvidenceWhere it comes from
1. What share of its claimed outcomes held up?Audited share per month, with its interval, under a stated ruleYour help desk, CRM or booking system (support, meetings, bookings)
2. What did each audited outcome cost?Spend ÷ audited outcomes, next to the price per claimed outcomeInvoices and the count above (calculator)
3. Why did the rest fail?Share of claims failing at each check: repeat contact, handoff, not resolved; or rep booked, cancelled, no-show; or staff fixed, wrong bookingThe same records
4. Is it changing?Month-on-month audited share, with intervals, under the same ruleAt least three settled months
5. How does it compare with your own team?The same checks on your team's work in the same periodThe same systems
6. What did you pay for outcomes that failed?Price × failed claims, under per-outcome pricingInvoices
7. Has the vendor's definition changed during the term?The vendor's definition page then and nowThe vendor's documentation, dated

What to negotiate#

  • The outcome definition, in the contract, word for word.
  • Credit for claims that fail under that definition (a customer who comes back within 7 days, a meeting that was never held).
  • Audit rights: per-outcome data with ids that match your systems.
  • A price that fits the audited number: at your audited share, what per-outcome price makes the cost per audited outcome acceptable (break-even).
  • Exit terms if the audited share drops below an agreed level for two months in a row.

Read the trend carefully#

  • An audited share that moves inside overlapping 95% intervals has not clearly changed.
  • A change in your contact mix (more billing questions, more new patients) can move the share without the agent changing.
  • A new vendor definition can move the claimed rate without any customer being helped more.

Do it with Attify#

The buyer dashboard keeps every month's audited share, cost per audited outcome and failure reasons, and the Team plan produces a signed renewal pack for each agent and month that anyone can check at /verify.

Questions

We renew in 60 days. What data do I need?

Two or three settled months of claimed and audited outcomes from your own systems, the spend for the same months, the reasons claims failed, and the same numbers for your own team where you can measure them.

Can I put an audited rate into the contract?

You can ask for it: define the outcome as a published standard does, name the data source (your systems), and agree what happens below the threshold. Whether a vendor accepts is a negotiation.

What if the audited share is low but improving?

Check that the improvement is outside the intervals of the earlier months, and that the definition did not change. A month-on-month move inside overlapping intervals is not a clear change.

Sources

  1. Attify. Attify standards. Read 8 Nov 2026.