fix(audiocontext): works on both Safari and Chrome

[dselman]

Fix for issue: #21

I'm not sure why the original code was so complex, but this simplified version seems to work on both Safari and Chrome on Mac OS.

Possibly related to: https://developer.chrome.com/blog/autoplay/#webaudio

const map: Map<string, AudioContext> = new Map();

export async function audioContext(options?: GetAudioContextOptions,) : Promise<AudioContext>  {
    if (options?.id && map.has(options.id)) {
      const ctx = map.get(options.id);
      if (ctx) {
        return ctx;
      }
    }

    const ctx = new AudioContext(options);
    if (options?.id) {
      map.set(options.id, ctx);
    }
    return ctx;
}

[google-cla]

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

[dselman]

Yes, this is now broken on Chrome... More investigation needed.

[dselman]

Interesting thread: https://stackoverflow.com/a/74495761

[hchen2020]

I tested in Chrome and Safari, it works as expected.

[sreeshas]

I tested in Chrome and Safari, it works as expected.

did you test it on ios?

[sreeshas]

existing audiocontext does not work on safari on ios. it also does not work on chrome on ios sometimes. audiocontext is getting suspended.

[Log] Creating new AudioStreamer...
[Log] Creating new AudioStreamer...
[Log] Disconnect called but no AudioStreamer exists
[Log] New AudioContext created with state: suspended
[Log] AudioStreamer instantiated
[Log] New AudioContext created with state: suspended
[Log] AudioStreamer instantiated
[Log] Volume meter worklet added successfully (x2)
[Log] Pre-initialized back camera
[Log] Joined meeting successfully
[Log] Connecting with config: – Object
Object
[Log] Before connect - AudioStreamer exists, AudioContext state: suspended
[Log] Camera list: – Array (7)
Array (7)
[Log] Found back camera: – "Back Camera"
[Log] After connect - AudioStreamer exists, AudioContext state: suspended
[Log] Camera list: – Array (0)
Array (0)
[Log] No back camera found in devices list
[Log] Camera list: – Array (0)
Array (0)
[Log] No back camera found in devices list
[Log] Received audio data: 9600 bytes, AudioContext state: suspended
[Log] Received audio data: 11520 bytes, AudioContext state: suspended
[Log] Received audio data: 11520 bytes, AudioContext state: running (x4)
[Log] Received audio data: 7680 bytes, AudioContext state: running
[Log] Received audio data: 9600 bytes, AudioContext state: running (x2)
[Log] Received audio data: 11520 bytes, AudioContext state: running (x10)
[Log] Received audio data: 5760 bytes, AudioContext state: running
[Log] Received audio data: 9600 bytes, AudioContext state: running

another instance
[Warning] Received audio data but AudioStreamer is not initialized (x21)

another instance
[Log] Creating new AudioStreamer...
[Log] Creating new AudioStreamer...
[Log] Disconnect called but no AudioStreamer exists
[Log] New AudioContext created with state: suspended
[Log] AudioStreamer instantiated
[Log] New AudioContext created with state: suspended
[Log] AudioStreamer instantiated
[Log] Volume meter worklet added successfully (x2)
[Log] Pre-initialized back camera
[Log] Joined meeting successfully
[Log] Connecting with config: – {model: "models/gemini-2.0-flash-exp", systemInstruction: Object, tools: Array, …}
{model: "models/gemini-2.0-flash-exp", systemInstruction: Object, tools: Array, generationConfig: Object}Object
[Log] Before connect - AudioStreamer exists, AudioContext state: suspended
[Log] Camera list: – [{label: "Back Camera", id: "EA0A4AF8B4997F9EF352DD8F5821EA0215A35E55", facingMode: undefined}, {label: "Back Dual Camera", id: "A291BFDDFED980CB607BAE8AAAE7593C17B1ED96", facingMode: undefined}, {label: "Back Dual Wide Camera", id: "71F94A26BAA1F4B0E597AF7F4F37E7A55BDFA16B", facingMode: undefined}, …] (7)

[Log] Found back camera: – "Back Camera"
[Log] After connect - AudioStreamer exists, AudioContext state: suspended
[Log] Camera list: – [] (0)
[Log] No back camera found in devices list
[Log] Camera list: – [] (0)
[Log] No back camera found in devices list
[Log] Received audio data: 9600 bytes, AudioContext state: suspended
[Log] Received audio data: 11520 bytes, AudioContext state: suspended (x2)
[Log] Received audio data: 11520 bytes, AudioContext state: running (x2)
[Log] Received audio data: 1920 bytes, AudioContext state: running
[Log] Received audio data: 9600 bytes, AudioContext state: running (x2)
[Log] Received audio data: 11520 bytes, AudioContext state: running (x9)
[Log] Received audio data: 9600 bytes, AudioContext state: running

[hchen2020]

I tested in Chrome and Safari, it works as expected.

did you test it on ios?

Yes, it works on Iphone iOS safari.

[thijssmudde]

I tested in Chrome and Safari, it works as expected.

did you test it on ios?

Yes, it works on Iphone iOS safari.

I tested on Safari and Chrome from an iPhone as well and I have the following findings:

• It always asks for permission to use the mic (after every reload).
• The first time after everything is cleared and permission is granted for the mic it works.
• Every time after that that mic input is not working.

[thijssmudde]

Interesting thread: https://stackoverflow.com/a/74495761

Thanks this helped me fix 2 of the 3 the audio issues! Only remaining issue is that the user always has to give permission even after they already gave permission. But I think this is an iOS thing.