[BUG] Error: Broken AVC stream on Twitch.tv stream file

[superbonaci]

Compiled version form latest commit 79aaf86:

ccextractor --version
CCExtractor 0.94, Carlos Fernandez Sanz, Volker Quetschke.
Teletext portions taken from Petr Kutalek's telxcc
--------------------------------------------------------------------------
CCExtractor detailed version info
	Version: 0.94
	Git commit: 79aaf8659390850d570a96a764d8b7f29557ce6a
	Compilation date: 2023-12-10
	CEA-708 decoder: C
	File SHA256: Could not open file
Libraries used by CCExtractor
	libGPAC Version: 2.2.1
	zlib: 1.2.11
	utf8proc Version: 2.4.0
	protobuf-c Version: 1.3.1
	libpng Version: 1.6.37
	FreeType
	libhash
	nuklear
	libzvbi

Trying to extract subtitles from Twitch.tv stream generates a 0 byte file and errors:

$ ccextractor file.ts
CCExtractor 0.94, Carlos Fernandez Sanz, Volker Quetschke.
Teletext portions taken from Petr Kutalek's telxcc
--------------------------------------------------------------------------
Input: file.ts
[Extract: 1] [Stream mode: Autodetect]
[Program : Auto ] [Hauppage mode: No] [Use MythTV code: Auto]
[CEA-708: 63 decoders active]
[CEA-708: using charset "none" for all services]
[Timing mode: Auto] [Debug: No] [Buffer input: No]
[Use pic_order_cnt_lsb for H.264: No] [Print CC decoder traces: No]
[Target format: .srt] [Encoding: UTF-8] [Delay: 0] [Trim lines: No]
[Add font color data: Yes] [Add font typesetting: Yes]
[Convert case: No][Filter profanity: No] [Video-edit join: No]
[Extraction start time: not set (from start)]
[Extraction end time: not set (to end)]
[Live stream: No] [Clock frequency: 90000]
[Teletext page: Autodetect]
[Start credits text: None]
[Quantisation-mode: CCExtractor's internal function]

-----------------------------------------------------------------
Opening file: file.ts
File seems to be a transport stream, enabling TS mode
Analyzing data in general mode
Changed fps using NAL to: 120.000000

Found large gap(14566) in PTS! Trying to recover ...
Error: Broken AVC stream - Leading bytes are non-zero...
Issues? Open a ticket here
https://github.com/CCExtractor/ccextractor/issues

The error will happen with any ts from any Twitch.tv stream, sample:

file.ts.zip

[superbonaci]

Error with another Twitch file:

$ ccextractor output.ts
CCExtractor 0.94, Carlos Fernandez Sanz, Volker Quetschke.
Teletext portions taken from Petr Kutalek's telxcc
--------------------------------------------------------------------------
Input: output.ts
[Extract: 1] [Stream mode: Autodetect]
[Program : Auto ] [Hauppage mode: No] [Use MythTV code: Auto]
[CEA-708: 63 decoders active]
[CEA-708: using charset "none" for all services]
[Timing mode: Auto] [Debug: No] [Buffer input: No]
[Use pic_order_cnt_lsb for H.264: No] [Print CC decoder traces: No]
[Target format: .srt] [Encoding: UTF-8] [Delay: 0] [Trim lines: No]
[Add font color data: Yes] [Add font typesetting: Yes]
[Convert case: No][Filter profanity: No] [Video-edit join: No]
[Extraction start time: not set (from start)]
[Extraction end time: not set (to end)]
[Live stream: No] [Clock frequency: 90000]
[Teletext page: Autodetect]
[Start credits text: None]
[Quantisation-mode: CCExtractor's internal function]

-----------------------------------------------------------------
Opening file: output.ts
File seems to be a transport stream, enabling TS mode
Analyzing data in general mode

Found large gap(48073) in PTS! Trying to recover ...
Error: Broken AVC stream - Leading bytes are non-zero...
Issues? Open a ticket here
https://github.com/CCExtractor/ccextractor/issues

[superbonaci]

Another sample for testing purposes:

1462570126.zip

[SP-XD]

@superbonaci Hey the sample ts files you have given have no embeded subtitles, I converted manually the ts to mp4 using ffmpeg and then tried to convert this was the result:

CCExtractor 0.94, Carlos Fernandez Sanz, Volker Quetschke.
Teletext portions taken from Petr Kutalek's telxcc
--------------------------------------------------------------------------
Input: ../../ccextractor_debug_files/output2.mp4
[Extract: 1] [Stream mode: Autodetect]
[Program : Auto ] [Hauppage mode: No] [Use MythTV code: Auto]
[CEA-708: 63 decoders active]
[CEA-708: using charset "none" for all services]
[Timing mode: Auto] [Debug: No] [Buffer input: No]
[Use pic_order_cnt_lsb for H.264: No] [Print CC decoder traces: No]
[Target format: .srt] [Encoding: UTF-8] [Delay: 0] [Trim lines: No]
[Add font color data: Yes] [Add font typesetting: Yes]
[Convert case: No][Filter profanity: No] [Video-edit join: No]
[Extraction start time: not set (from start)]
[Extraction end time: not set (to end)]
[Live stream: No] [Clock frequency: 90000]
[Teletext page: Autodetect]
[Start credits text: None]
[Quantisation-mode: CCExtractor's internal function]

-----------------------------------------------------------------
Opening file: ../../ccextractor_debug_files/output2.mp4
Detected MP4 box with name: ftyp
Detected MP4 box with name: free
Detected MP4 box with name: mdat
File seems to be a MP4
Analyzing data with GPAC (MP4 library)
Opening '../../ccextractor_debug_files/output2.mp4': ok
Track 1, type=vide subtype=avc1
Track 2, type=soun subtype=MPEG
MP4: found 2 tracks: 1 avc and 0 cc
Processing track 1, type=vide subtype=avc1
Processing track 2, type=soun subtype=MPEG

Closing media: ok
Found 1 AVC track(s). Found no dedicated CC track(s).


Total frames time:        00:00:18:451  (553 frames at 29.97fps)

Min PTS:                                00:00:00:066
Max PTS:                                00:00:18:566
Length:                          00:00:18:500
Done, processing time = 0 seconds

No captions were found in input.
Issues? Open a ticket here
https://github.com/CCExtractor/ccextractor/issues

[SP-XD]

also tried ts sample with subttitles and its working https://tsduck.io/streams/usa-atsc/503.ts

CCExtractor 0.94, Carlos Fernandez Sanz, Volker Quetschke.
Teletext portions taken from Petr Kutalek's telxcc
--------------------------------------------------------------------------
Input: ../../ccextractor_debug_files/503.ts
[Extract: 1] [Stream mode: Autodetect]
[Program : Auto ] [Hauppage mode: No] [Use MythTV code: Auto]
[CEA-708: 63 decoders active]
[CEA-708: using charset "none" for all services]
[Timing mode: Auto] [Debug: No] [Buffer input: No]
[Use pic_order_cnt_lsb for H.264: No] [Print CC decoder traces: No]
[Target format: .srt] [Encoding: UTF-8] [Delay: 0] [Trim lines: No]
[Add font color data: Yes] [Add font typesetting: Yes]
[Convert case: No][Filter profanity: No] [Video-edit join: No]
[Extraction start time: not set (from start)]
[Extraction end time: not set (to end)]
[Live stream: No] [Clock frequency: 90000]
[Teletext page: Autodetect]
[Start credits text: None]
[Quantisation-mode: CCExtractor's internal function]

-----------------------------------------------------------------
Opening file: ../../ccextractor_debug_files/503.ts
File seems to be a transport stream, enabling TS mode
Analyzing data in general mode

This TS file has more than one program. These are the program numbers found: 
1
2
3
4
  1%  |  00:00

New video information found
[1920 * 1080] [AR: 03 - 16:9] [FR: 04 - 29.97] [progressive: no]

XDS: ContentAdvisory: US TV Parental Guidelines. Age Rating: TV-14 (Parents Strongly Cautioned)
XDS: [Violence] 
XDS Notice: Program is now Chicago PD
100%  |  01:03
Number of NAL_type_7: 0
Number of VCL_HRD: 0
Number of NAL HRD: 0
Number of jump-in-frames: 0
Number of num_unexpected_sei_length: 0

Total frames time:        00:01:02:195  (1864 frames at 29.97fps)
CC type 0: 332 (NTSC line 21 field 1 closed captions)
CC type 1: 1864 (NTSC line 21 field 2 closed captions)
CC type 2: 2134 (DTVCC Channel Packet Data)
CC type 3: 690 (DTVCC Channel Packet Start)

Min PTS:                                02:07:41:087
Max PTS:                                02:08:44:183
Length:                          00:01:03:096

Initial GOP time:          00:00:00:000
Final GOP time:          00:00:00:000+19F
Diff. GOP length:          00:00:00:000+19F     (00:00:00:633)

Number of key frames: 42
Total user data fields: 1864
HDTV type user data fields: 1864
Done, processing time = 2 seconds
Issues? Open a ticket here
https://github.com/CCExtractor/ccextractor/issues