Realtime Voice Not Quite Working

[sibblegp]

Describe the bug

I have incorporated the new realtime capabilities into Twilio. They work well. While it does seem to be calling tools, the response it gives does not use the data from the tools. The tracing also shows no tool calls.

Is this feature complete or still being worked on?

Debug information

• Agents SDK version:v0.2
• Python version: Python3.13

Repro steps

Set up a RealtimeAgent and runner with a tool to check stock prices. In the logs, you can see it calls the tool, but the answer for the stock price is a random number, not from the tool response. The trace also shows no tools were used.

Expected behavior

It should take the data retrieved from the tool and use it to figure out its answer. Furthermore, the tool use should show up in tracing.

EDIT
I can definitely confirm it routes to the right tools (I added a hangup tool and it works) but it doesn't appear to integrate the results of the tool into responses.

[sibblegp]

It also sometimes fails to call the tool. Seems odd.

Also, how do you interrupt it? There's an ability to send a Truncate command in the API but I'm not sure it's set up yet.

[sibblegp]

It definitely looks like this is still under development considering there was a commit with more capabilities an hour ago. Please keep up the great work! The hard part is already done. Now just integrating tools, handoffs, and truncating and I'll have everything I need!

[sibblegp]

It also keeps switching to Spanish. This is hilarious.

edit: I realized this is because on speakerphone there seems to be no cancellation out of it listening to itself. I think there is a setting for this in the API but I couldn't find it?

I notice you added handoffs! This is all very exciting.

I can confirm though:

• The appropriate tool is called
• The tool response is not processed (i.e. it answers randomly not based upon the tool's output.....at least if it is a dict
• Tracing does not show the tool as called and shows no output from the tool