Video Public Roadmap & Changelog

[tbarbugli]

Video Roadmap

We're constantly rearranging this based on customer feedback. Be sure to let us know what's important to you.

1.3 Roadmap - AI & SIP - Dec

The focus is on improved performance on older devices and poor network conditions. In addition to that we're shipping everything you need to build AI use cases with Stream. (SIP, Python SDK etc.)

• ✅ VP9 as a default over VP8 in more calls
• ✅ Dynascale to improve simulcast/SVC overhead on 1-1 calls
• Codec negotiation - dynamically change encoders and decoders during calls
• OpenAI realtime integration with Node and Python SDK support
• Python WebRTC SDK for custom AI/Transcription integrations
• AI / LLM integration system for live audio/video AI
• Manual quality selection (currently it's always automatic)
• More server-side SDKs for easier integrations (Golang, Java, PHP)
• SIP
• Improved Closed Captions
• Integrate with Moderation
• Aggregated call stats
• Improvements to bandwidth estimation
• Translations for Closed Caption

1.2 Roadmap - Sept

• ✅ PIP support for React Native
• ✅ PIP support for Flutter
• ✅ Audio only/ Ringing calls document edge cases
• ✅ RTMP out
• ✅ Stability & performance improvements

1.1 Roadmap - June

• ✅ Improved support for teams & multi-tenant
• ✅ Improve noise reduction/cancelation
• ✅ Multi language support for transcriptions
• ✅ Complete moderation endpoints integration (blocking users, banning users, ...)
• ✅ Session timers
• ✅ Blur & AI video filter on React Native

1.0 Roadmap - April

• ✅ Analytics for calls (this is the most important missing feature during this BETA. When quality drops we need to understand if it's caused by network, CPU, device heat etc.)
• ✅ Blur & AI video filter docs on Android, iOS and React
• ✅ Transcriptions
• ✅ Support external storage for recorded calls (S3, Google Cloud, Azure)
• ✅ Audio & video filter support (supported on native iOS and Android)
• ✅ Screensharing from all mobile SDKs
• ✅ Standardization across SDKs
• ✅ Composite layout for streaming and recording
• ✅ Recording 2.0
• ✅ Unity SDK
• ✅ Livestream, default video player UI for all SDKs
• ✅ Benchmarks for audio rooms and livestreams
• ✅ Improvements to starts_at (allow people to join x minutes earlier)

1.4 Roadmap Preview - Livestreaming Improvements

Stream scales well to large calls and livestreaming use cases. We can improve which ingress formats we support

• Ingress for SRT, RTSP, SDI, NDI, MTS/ MPEG-2 TS, RIST and Zixi
• AV1
• WHIP

After/Later

• Waiting rooms
• Query call session endpoint + better missed calls support
• RTMP & WebRTC domain proxy for branding
• Blur & AI video filter on Flutter
• Breakout rooms
• Transcription Summaries
• Tap to focus (supported by iOS atm)
• Whiteboards
• Camera controls
• WHEP
• Client-side recording
• RTMP broadcast - API integration with Youtube, Twitch and other providers
• WHIP

Video SDK roadmaps

• React
• iOS
• Android
• Flutter
• React Native

Changelog

• 16th of October - VP9 and AV1 support is available with React (1.7.0), React Native (1.2.0), and Plain-JS (1.9.0)
• 16th of October - Dynascale to remove simulcast/SVC on 1-1 calls is available with React (1.7.0), React Native (1.2.0), and Plain-JS (1.9.0)
• 4th of October - Golang SDK is publicly available
• 2nd of October - Manual Quality Selection is available with React (1.5.0), React Native (1.1.0), and Plain-JS (1.8.0)
• 3rd of September - React Native v1.0.0 is now released
• 3rd of September - Reconnects v2 for React (v1.3.0+), React Native (v1.0.0) and Plain-JS (v1.6.0)
• 28th of August - Picture in Picture (PiP) support for React Native iOS (v0.10.5)
• 16th of August - RTMP out is now supported
• 19th of July - Picture in Picture (PiP) support on Flutter SDK
• 12th of June - Blur and AI Video filters for React Native (Android, iOS)
• 10th June 2024 - Moderation endpoints (blocking users, banning, muting, ...)
• 31st May 2024 - Session timers API are available
• 14th of May 2024 - User bans work across video and chat products
• 10th of May 2024 - Released Python SDK v1.0.0
• 7th of May 2024 - React 1.0.0 released, Plain-JS 1.0.0 released
• 1st of May 2024 - iOS 1.0 release, https://github.com/GetStream/stream-video-swift/releases/tag/1.0.0
• 26th of April 2024 - Improved support for teams & multi-tenant and Analytics for calls is GA on Stream Dashboard
• 25th of April 2024 React Video SDK 0.6.12, Plain-JS SDK 0.7.8 - Noise Cancellation
• 9th of April 2024: React Video SDK 0.6.0, React Native Video SDK 0.6.0, Plain-JS Video SDK 0.7.0 - Removes the already deprecated server-side support in favor of our NodeJS Server-Side SDK
• 5th of April 2024: React Video SDK 0.5.10, Plain-JS Video SDK 0.6.8 - Background blurring and background filters
• 2nd of April 2024: Flutter Video SDK v0.3.5: Picture in Picture for Android
• 25th of March 2024: React Video SDK 0.5.5, React Native Video SDK 0.5.10, Plain-JS Video SDK 0.6.3 - Call statistics reporting
• 26th of February 2024: React Video SDK 0.5.0 release
• 26th of February 2024: React Native Video SDK 0.5.0 release
• 22nd of February 2024: Transcriptions went live
• 16th of February 2024: iOS 0.5 release, https://github.com/GetStream/stream-video-swift/releases/tag/0.5.0
• 9th of February 2024: Support external storage for recorded calls (S3, Google Cloud, Azure) is available
• 9th of February 2024: Flutter Video SDK v0.3.2: fast reconnect, background voip callback for iOS terminated state, push notifications enhancements
• 3rd of January 2024: Audio & video filter support on iOS and Android, Screensharing is supported for all mobile SDKs
• 12th of December 2023: Flutter Video SDK v0.3.0
• 13th of November 2023: Python and Node.JS server-side SDK are live and documented
• 10th of November 2023: Unity SDK is GA, recording 2.0 is live, support for composite layout on streaming and recording is also live
• 27th of October 2023: React Video SDK v0.4.0 and Plain-JS SDK v0.4.0 released
• 24th of October 2023, Android SDK 0.4.0 released, https://github.com/GetStream/stream-video-android/releases/tag/0.4.0
• 11th of October 2023: iOS 0.4 release, https://github.com/GetStream/stream-video-swift/releases/tag/0.4.0
• 06th of October 2023: React SDK v0.3.38: Added support for Screen Share Audio
• 06th of October 2023: Plain-JS SDK v0.3.30: Added support for Screen Share Audio
• 28th of September 2023: Flutter SDK v0.1.0: Improved VoIP and CallKit support, SDK alignment, Docs: https://github.com/GetStream/stream-video-flutter/releases/tag/v0.1.0
• 27th of September 2023: React SDK v0.3.31: LivestreamLayout and support for thumbnails
• 22nd of September 2023: Thumbnails for livestreaming previews
• 21nd of September 2023: Android 0.3.4, fast reconnect: https://github.com/GetStream/stream-video-android/releases/tag/0.3.4
• 15th of September 2023: Video call benchmark up to 10k participants (goal is 100k by end of Q4)
• 8th of September 2023: Expo support
• 3rd of September 2023: React native release
• 25th of August 2023: iOS 0.3 release, https://github.com/GetStream/stream-video-swift/releases/tag/0.3.0
• 16th of August 2023: React v0.3, JS-SDK 0.3: Improved Call State handling and new Device Management API
• 7th of August 2023: RTMP supports multiple resolutions and audioLevels
• 7th of August 2023: Android 0.3 release (ringing, livestreaming and chat improvements): https://github.com/GetStream/stream-video-android/releases/tag/0.3.0
• 4th of August 2023: Improvements to RTMP support, audio levels, simulcast and others
• 4th of August 2023: Benchmark up to 400 video call participants in a single call. Blogpost coming later
• 4th of August 2023: Livestream tutorials
• 20th of July 2023: Android 0.2 release, https://github.com/GetStream/stream-video-android/releases
• 18th of July 2023: iOS 0.2 release, https://github.com/GetStream/stream-video-swift/releases/tag/0.2.0
• 10th of July 2023: Kotlin, Swift, React and Flutter 0.1 release

[caaazinha]

hi! our company is using GetStream chat and video solution but we do have an use case for video where the "Waiting rooms" feature would be extremely important and totally nail... any chance of being released in this years' roadmap?