Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update audio explainer with intro + WebIDL #75

Merged
merged 3 commits into from
Dec 7, 2023
Merged

Update audio explainer with intro + WebIDL #75

Changes from 2 commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
cc253f6
Update audio explainer with intro + WebIDL
alvestrand Jan 27, 2022
3ed5199
Merge branch 'main' into more-audio-text
alvestrand Jan 27, 2022
6729ccf
Update audio-explainer.md
alvestrand Dec 7, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
33 changes: 33 additions & 0 deletions audio-explainer.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,26 @@ This document contains arguments for including audio processing in the Breakout
Box mechanism, and preserves pieces of text that have been removed from the spec
because there is no WG consensus on including audio.

This is a supporting document for [issue #29](https://github.com/w3c/mediacapture-transform/issues/29).

# Examples of processing where audio support would be helpful

TBD


# Spec changes needed
alvestrand marked this conversation as resolved.
Show resolved Hide resolved

These spec changes are included here because the text contains information
that was present in earlier versions of the specification, but were deleted
when the decision was made to not document stuff that did not have WG consensus.

In addition, the text below contains changes that are required to align the
audio processing API with the presently proposed video processing API.

Markup included is intended to be consumed by Bikeshed.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need this?


## Detailed changes

Include <audio> tags as a possible destination

Under "Use cases supported", include:
Expand Down Expand Up @@ -39,3 +57,18 @@ If the track is an audio track, the chunks will be {{AudioData}} objects.
Under "Security and Privacy considerations", include AudioData as an alternative
to VideoFrame.

TODO: Include consideration of constraints for audio tracks.

## Additional IDL for AudioTrackGenerator
This IDL is intended to parallel that for VideoTrackGenerator. In previous
proposals, both versions were included in MediaStreamTrackGenerator.

<pre class="idl">
[Exposed=DedicatedWorker]
interface AudioTrackGenerator {
constructor();
readonly attribute WritableStream writable;
attribute boolean muted;
readonly attribute MediaStreamTrack track;
};
</pre>