Technical AIadvancedVideo + quiz

Build Voice AI Agents That Answer the Phone

For developers who have built a text agent with tools and now need one that answers the phone.

15 lessons · 51 min
Watch the first lesson freeWelcome · 3 min

Sign in to watch one lesson from this course free.

What you will be able to do

Choose between a speech pipeline and a speech to speech model and budget each turn's delayHandle recognition errors, voices and pronunciationManage turn-taking, barge-in and back-channel soundsLet an agent look up and book on a live call with read-back and confirmation enforced in codeConnect a phone line and test with scripted hard callers and p95 delayKeep payments, identity and cloned voices safe on calls

Skills you will gain

  • Voice agent architecture
  • Speech recognition errors
  • Turn-taking
  • Telephony
  • Voice agent testing
  • Voice safety

About this course

For developers who have built a text agent with tools and now need one that answers the phone. Learn to choose between a speech pipeline and a speech to speech model, budget the delay of every turn, and handle recognition errors, voices and pronunciation. Manage turn-taking, barge-in and back-channel sounds, and let the agent look up and book on a live call with hold, read-back and confirm enforced in code. Connect a phone line with the notices callers are owed, test with scripted hard callers and p95 delay, and keep payments, identity and cloned voices safe. Follow a made-up dental group as it builds a booking line, then build and test it yourself in a free lab with Python, Groq’s free plan or a no-key mock mode, and an optional browser voice call with Pipecat.

Technical AI

Curriculum

5 modules · 15 lessons · 51m

Requirements

An agent that calls tools in a loop
Python 3.11 or later and a terminal
A microphone, for the optional voice step

What you walk away with

A Yallo AI academy certificate of completion, issued when every lesson is complete and the final assessment is passed at 70% or aboveA public verification page, so a stranger can check the certificate without asking you for a filePDF download, and a one-click share to your LinkedIn profile

Yallo AI academy certifies completion of

Build Voice AI Agents That Answer the Phone