Unable to create multiple streams

[aaron-sieraai]

I am having an issue that I cannot have multiple video streams running at the same time. I got this working with 1 stream however when I try to use 2 or 3 then the system encounters the following error at the framerate of the camera. Everything works normally until this point when the errors start showing up after everything is done initializing.

[ERROR] [1601414471.746840163]: [KinesisVideoStreamSetup] Skipping stream id 0 due to failure initializing stream. Error code: 4109
[ERROR] [1601414471.748540212]: [ProcessCodecPrivateDataForStream] KinesisVideoStreamSetup failed, uninstalling subscriptions to /video/encoded_0 Error code: 4109
[ WARN] [1601414471.748683914]: [KinesisVideoFrameTransportCallback] testStream1 failed updating codec data, error code: 4109. Continuing streaming as a best effort, but you might not be able to decode and render the stream.
[ WARN] [1601414471.748781209]: [KinesisVideoFrameTransportCallback] testStream1 PutFrame failed. Error code: 4101

My parameters are as follows:

SUMMARY

PARAMETERS

• /cam_0/gscam_driver_v4l_0/camera_info_url: package://gscam/e...
• /cam_0/gscam_driver_v4l_0/camera_name: default
• /cam_0/gscam_driver_v4l_0/frame_id: /v4l_frame_0
• /cam_0/gscam_driver_v4l_0/gscam_config: nvarguscamerasrc ...
• /cam_0/gscam_driver_v4l_0/sync_sink: True
• /cam_1/gscam_driver_v4l_1/camera_info_url: package://gscam/e...
• /cam_1/gscam_driver_v4l_1/camera_name: default
• /cam_1/gscam_driver_v4l_1/frame_id: /v4l_frame_1
• /cam_1/gscam_driver_v4l_1/gscam_config: nvarguscamerasrc ...
• /cam_1/gscam_driver_v4l_1/sync_sink: True
• /h264_video_encoder_0/bitrate: 200000
• /h264_video_encoder_0/fps_denominator: 1
• /h264_video_encoder_0/fps_numerator: 5
• /h264_video_encoder_0/image_transport: compressed
• /h264_video_encoder_0/publication_topic: /video/encoded_0
• /h264_video_encoder_0/subscription_topic: /cam_0/camera/ima...
• /h264_video_encoder_1/bitrate: 200000
• /h264_video_encoder_1/fps_denominator: 1
• /h264_video_encoder_1/fps_numerator: 5
• /h264_video_encoder_1/image_transport: compressed
• /h264_video_encoder_1/publication_topic: /video/encoded_1
• /h264_video_encoder_1/subscription_topic: /cam_1/camera/ima...
• /kinesis_video_streamer/aws_client_configuration/connect_timeout_ms: 9000
• /kinesis_video_streamer/aws_client_configuration/max_retries: 10
• /kinesis_video_streamer/aws_client_configuration/region: us-east-2
• /kinesis_video_streamer/aws_client_configuration/request_timeout_ms: 9000
• /kinesis_video_streamer/kinesis_video/stream0/frame_rate: 5
• /kinesis_video_streamer/kinesis_video/stream0/frame_timecodes: False
• /kinesis_video_streamer/kinesis_video/stream0/stream_name: testStream0
• /kinesis_video_streamer/kinesis_video/stream0/subscription_topic: /video/encoded_0
• /kinesis_video_streamer/kinesis_video/stream0/topic_type: 1
• /kinesis_video_streamer/kinesis_video/stream1/frame_rate: 5
• /kinesis_video_streamer/kinesis_video/stream1/frame_timecodes: False
• /kinesis_video_streamer/kinesis_video/stream1/stream_name: testStream1
• /kinesis_video_streamer/kinesis_video/stream1/subscription_topic: /video/encoded_1
• /kinesis_video_streamer/kinesis_video/stream1/topic_type: 1
• /kinesis_video_streamer/kinesis_video/stream_count: 2
• /rosdistro: melodic
• /rosversion: 1.14.9

NODES
/
h264_video_encoder_0 (h264_video_encoder/h264_video_encoder)
h264_video_encoder_1 (h264_video_encoder/h264_video_encoder)
kinesis_video_streamer (kinesis_video_streamer/kinesis_video_streamer)
/cam_0/
gscam_driver_v4l_0 (gscam/gscam)
/cam_1/
gscam_driver_v4l_1 (gscam/gscam)

Attached are my launch and configuration files.
h264_0.txt
h264_1.txt
kinesis_node.txt
kinesis_stream_0.txt
kinesis_stream_1.txt
visionstreamer.txt

To be clear this works perfectly fine with one stream
Thanks for any help you can provide.
-- Aaron

[issue-label-bot]

Issue-Label Bot is automatically applying the label bug to this issue, with a confidence of 0.57. Please mark this comment with 👍 or 👎 to give our bot feedback!

Links: app homepage, dashboard and code for this bot.

[dabonnie]

Hi @aaron-sieraai, thanks for filing this issue and your patience. I'm currently trying to reproduce your issue and will update when I have some more information.

[dabonnie]

Hi @aaron-sieraai one potential workaround (verified locally) is to launch two Kinesis nodes where each has a single stream.

[dabonnie]

@aaron-sieraai I'm seeing similar behavior on my end when specifying multiple streams. While we investigate please feel free to use the suggested workaround above.

[aaron-sieraai]

Thank you for looking into the issue, I will look at using multiple node instances.