Error trying to decode fragmented (FU-A) RTP H.264 Encoded Video Stream

[Harold-M-Suquillo]

I'm trying to decode a H.264 RTP video stream, I'm removing the 12 bytes from the RTP header and calling imx_vpu_api_dec_push_encoded_frame with the encoded frame data being the Fragmented Frame (FU indicator + FU header + FU payload). I'm getting an error from the VPU, as it never has a frame to decode and continuously outputs codec state CODEC_NEED_MORE even after pushing frames in successfully. I'm also uncertain how the VPU is acquiring the data from SPS and PPS NALUs, I see a reference in the decode-example but not any mention to how the VPU lib is supposed to get that info. I've also tried to depacketize the frames into whole frames but then I get an error nal_ref_idc cannot be null.

Libimxvpuapi Version: 2.2.1
Platform: IMX8MP
vpu_output.txt