Skip to main content
Back to lab

2026-02-09 · Demo

What a 2-week voice agent pilot actually sounds like

An inbound voice agent built in two weeks. What works, what fails, and where humans take over.

We shipped an inbound voice agent on the Founder MVP tier over two weeks. Calls come in, the agent qualifies, books a slot, and transfers to a human when anything is unclear.

Voice AI investment grew fast in 2024. Twilio reported strong adoption of programmable voice with AI layers for customer service. The gap between demo and production is still handoff, latency, and accent coverage.

Sub-second response time is the bar for voice that feels natural. Above that, callers talk over the agent.

Jeff Lawson · Twilio, voice and AI keynote themes 2024

Always design the failure path first. Voice agents will misunderstand. Your product is only as good as the escalation.

Retell AI team · Voice agent production checklist 2025

Stack for a one-week pilot

Telephony on Twilio or Vapi, streaming STT, a small dialog policy in your backend, TTS for responses, and calendar or CRM integration for booking. LLM handles intent, not every word.

Keep the happy path narrow: greet, ask two qualifying questions, offer two time slots, confirm, send SMS backup.

What we skip in week one

Custom voice cloning, multilingual support, and post-call analytics dashboards. Add those on System tier when the pilot proves call volume.

What worked in 2026

STT latency is good enough for short turns on major providers. Calendar integration is straightforward with Google or Outlook APIs. The model handles small talk if you cap it with a system prompt.

Callers accept a slightly synthetic voice when the agent resolves the task in under two minutes.

What still breaks

Long pauses feel robotic. Accents the model rarely sees still confuse slot parsing. Background noise on mobile calls drops word error rate.

Fix: tight prompts, confirm details by repeating them, and a published human number for instant transfer.

Human handoff is not optional

Press zero or say agent anytime. Log the transcript and reason for transfer so you can add eval cases weekly.

When to upgrade from MVP to System

You need eval replay on recorded calls, CRM write-back, WhatsApp fallback, and monitoring on cost per minute. That is System tier work at $2,999 over 6 weeks.

See our voice and chat agents service line and the Fuel Depot case study for ops-heavy products that started with manual workflows.

FAQ

Can you really ship voice in 2 weeks?

Yes for a narrow inbound qualify-and-book flow on Founder MVP. Production voice with CRM sync, eval replay, and WhatsApp fallback needs the 6-week System tier.

Which languages do you support?

English-first pilots in week one. Hindi and Tamil requests need scoped STT models and extra eval work. Tell us on the intake form.

How much do calls cost to run?

Telephony plus STT plus TTS plus LLM minutes typically run a few cents per minute on top of your Twilio bill. We pass infra through at cost.

What if the agent gets stuck?

Callers transfer to a human number. We log the transcript and add it to the eval set. You review weekly, not never.

WhatsApp vs phone voice?

WhatsApp suits async orders and FAQs. Phone suits urgent booking. Many operators want both on System tier.

Do I need fine-tuning for voice?

Rarely in 2025. Prompt policy plus eval replay gets you further than custom models for scheduling and qualification.

Want this kind of work for your product? Start a project or see our services.

Start a project