Evaluating a plumbing pilot beyond answered calls

The decision to make first

A high number of answered calls can hide incomplete records, unsupported promises or requests that never receive a staff response. Evaluate the pilot using accurate capture, correct routing, staff acknowledgment and confirmed business outcomes alongside usage and cost.

What the handoff should contain

Track complete requests, failed transfers, corrected details, acknowledged handoffs, staff review effort and completed jobs where the business can verify them.

Suggested wording to approve

Example wording: “A successful pilot should make the next action clearer for customers and staff. Answering the phone is the beginning of that workflow, not the final outcome.”

Test the difficult case

Review a mixed set of successful and unsuccessful requests and trace each one from capture to the final staff-recorded outcome. Do not attribute every later job to the assistant or report simulated demonstration results as real customer conversions.

Worked example

Fictional example: A sample pilot answers many calls, but several complete requests remain unacknowledged by the office. The review should identify the ownership problem instead of declaring success from the answer count. A later improvement can be measured by whether those requests receive a usable next action, without claiming every captured inquiry became paid work.

Review it in operation

Choose improvements based on the largest recurring handoff problem, then measure whether that specific change helped during the next review period.

Check before you launch

• Evaluate the pilot using accurate capture, correct routing, staff acknowledgment and confirmed business outcomes alongside usage and cost.
• Track complete requests, failed transfers, corrected details, acknowledged handoffs, staff review effort and completed jobs where the business can verify them.
• Review a mixed set of successful and unsuccessful requests and trace each one from capture to the final staff-recorded outcome.
• Choose improvements based on the largest recurring handoff problem, then measure whether that specific change helped during the next review period.

Related guides