Resets problems with streams #16

jiperez11 · 2024-03-30T02:31:09Z

jiperez11
Mar 30, 2024

im using in my setup:
ssl_client.setBufferSizes(4048, 1024);
Database.get(asClStream, PathRoot::path_idDispo.c_str(), streamResult, true);

And i have this error:

User exception (panic/abort/assert)
--------------- CUT HERE FOR EXCEPTION DECODER ---------------

Unhandled C++ exception: OOM

stack>>>

ctx: cont
sp: 3ffffa00 end: 3fffffd0 offset: 0010
3ffffa10: c02ac026 c00ec004 000005d8 40210dcc
3ffffa20: c09dc09c 00000001 3fff571c 4020d95b
3ffffa30: 00000000 c00dc003 3fff000a 4020db64
3ffffa40: 00000000 00000000 00000d60 3fffae4c
3ffffa50: 00000000 3fffaf4c 3fff571c 4020de09
3ffffa60: 00000000 00023fe7 68f5c28f 0299e391
3ffffa70: 00000000 00000000 00000034 00023fe7
3ffffa80: 00003a98 3fff679c 3fff571c 4020d052
3ffffa90: 3fff7764 000006e9 3ffe86fc 4010089e
3ffffaa0: 3ffe8e48 00000017 3fffbed8 000001bb
3ffffab0: 000001bb 3fffae4c 3fff571c 4020df95
3ffffac0: 40215438 7127be23 40215438 7127be23
3ffffad0: 3fffae4c 3fff0b08 3fffbcb4 40203c2a
3ffffae0: 00000000 0017001f 00000000 40203c65
3ffffaf0: 00000000 3fff0b08 3fff571c 3fffbe04
3ffffb00: 3fffbdb4 3fff0b08 3fffbcb4 40207780
3ffffb10: 3fffae4c 002a002f 80000000 40202466
3ffffb20: 3fffbcb4 3fffbdb4 3fffbdec 3fffbe04
3ffffb30: 3fffbcb4 3fffbdb4 3fff0b08 40207d9c
3ffffb40: 00000000 00000000 00000000 00000000
3ffffb50: 3ffe8ab6 3fffbcbc 3fffbce0 00000000
3ffffb60: 3fffbdb4 3ffffdd0 3fffbcb4 4020847a
3ffffb70: 3ffffdf0 3ffffde0 3fffbcbc 3fffbdb4
3ffffb80: 00000000 0000746e 00000000 40100bec
3ffffb90: 00000000 3fff0b08 3fffbcb4 40207a6c
3ffffba0: 00000001 3fffbdb4 3fffbe6c 402025c8
3ffffbb0: 000038a0 00000714 3ffe86fc 4010089e
3ffffbc0: 3fffbcb4 3fffbdb4 3fff0b08 3ffffca0
3ffffbd0: 3fff68fc 00000060 00000020 40100c20
3ffffbe0: 3fff68fc 00000060 3ffffdb4 3ffffcc0
3ffffbf0: 3fff76fc 00000060 00000020 40100c20
3ffffc00: 3fff76fc 00000060 3ffffdd4 4020ffa2
3ffffc10: 00000000 00000030 00000020 40100c20
3ffffc20: 3fff709c 00000030 3ffffe74 3ffffcc0
3ffffc30: 3fff76fc 0000005e 3ffffdd4 40210037
3ffffc40: 00000000 00000074 00000000 40210079
3ffffc50: 00000000 3fff76fc 3fff709c 0024002f
3ffffc60: 80000000 3ffffe01 3ffffdd0 40204a4d
3ffffc70: 00000004 3fff8684 00000000 40210079
3ffffc80: 3fff0cec 3ffffe80 3ffffde0 3ffffec0
3ffffc90: 3fff0cec 3ffffdd0 3ffffcc0 40208616
3ffffca0: 00000000 40000000 00000000 3ffffe0c
3ffffcb0: 00000000 3ffffcc0 00000000 3ffffe80
3ffffcc0: 3ffffcc0 00000000 00000000 00000000
3ffffcd0: 00000000 00000000 00000000 00000000
3ffffce0: 00003301 00000000 00000000 3fffc278
3ffffcf0: 00000000 00000000 00000022 00000000
3ffffd00: 40210900 00000000 00000000 ffff0000
3ffffd10: ffffffff 00000000 00000000 00000000
3ffffd20: ffffffff 00000000 3fff6673 00000000
3ffffd30: 3fff8600 3ffffce8 00000000 3ffffe54
3ffffd40: 00000000 00000000 00000000 00000000
--------------- CUT HERE FOR EXCEPTION DECODER ---------------

Unhandled C++ exception: OOM

stack>>>

ctx: cont
sp: 3ffff720 end: 3fffffd0 offset: 0010
3ffff730: 00000000 00000000 00000000 401031b6
3ffff740: 4010322d 00000031 40302063 00000000
3ffff750: 00000000 00000000 00000000 00000004
3ffff760: 40003b50 2c9f0300 4000050c 3fffc278
3ffff770: 401031d0 3fffc200 00000022 08ccbde8
3ffff780: 40003b53 00000030 00000010 ffffffff
3ffff790: 40001dea 0000000d 00018000 00000000
3ffff7a0: 00ff0000 5ffffe00 5ffffe00 00000000
3ffff7b0: 00018000 00000000 3ffff773 3ffff8c1
3ffff7c0: 00000020 0000003c 3fffffd0 00000030
3ffff7d0: 0000003c 3ffe8368 000000a0 4021fcc9
3ffff7e0: 3ffff8c1 3fffc6fc 0000006e ffff0208
3ffff7f0: 3ffff890 0000009f 3ffff9b0 3ffff9b0
3ffff800: 3fffffd0 3ffe8368 000000a0 4021fcc9
3ffff810: 3ffff8e8 0000009f 00000077 ffff0208
3ffff820: 3ffff8c0 0000009f 00018000 00000000
3ffff830: 00ff0000 5ffffe00 5ffffe00 00000000
3ffff840: 00018000 3fffc6fc 0000005c 3ffff931
3ffff850: 4020d95b 00000020 3ffff890 4021fd05
3ffff860: 3ffff950 3ffff940 00000004 4021fcc9
3ffff870: 3ffff944 000000fe 3ffff8b0 4021fd05
3ffff880: 40211501 00000010 3ffff8c0 402114f4
3ffff890: 66666633 30346466 3020203a 30303030
3ffff8a0: 20303030 30303030 30303030 30303020
3ffff8b0: 30303030 30302030 30303030 20203030
3ffff8c0: 203a000a 66666633 30306166 646e6520
3ffff8d0: 6633203a 66666666 6f203064 65736666
3ffff8e0: 30203a74 0a303130 3ffff900 4021fd05
3ffff8f0: 3ffff9e0 3ffff9d0 00000004 40244f16
3ffff900: 4010461f 00000019 00000002 00040000
3ffff910: 40211501 3ffeb1f4 00000001 402114f4
3ffff920: 6573550a 78652072 74706563 206e6f69
3ffff930: 3ffff950 3ffff940 00000004 7373612f
3ffff940: 29747265 3ffffd40 00000000 00000000
3ffff950: 00000000 00000000 00000004 3fff6f3c
3ffff960: 3ffff980 3ffff970 3ffffd50 4021154e
3ffff970: 00000020 3ffffa00 3fffffd0 00000010
3ffff980: 5ffffe00 5ffffe00 0000000f 3ffff9b0
3ffff990: 3fffffd0 00000010 3ffffa10 402117f2
3ffff9a0: 3fffae4c 000001bb 3fffae4c 00000030
3ffff9b0: 000000fe 00000000 00000000 00000000
3ffff9c0: 00000000 00000000 00000000 3ffffa40
3ffff9d0: 3fffefd0 000000fe 3fff3480 00000001
3ffff9e0: 00000000 00000000 c030c02c 00000000
3ffff9f0: 00000000 4020d95b 000005d8 40211866
3ffffa00: 00000000 4020d95b 00000020 40211885
3ffffa10: c02ac026 c00ec004 000005d8 40210dcc
3ffffa20: c09dc09c 00000001 3fff571c 4020d95b
3ffffa30: 00000000 c00dc003 3fff000a 4020db64
3ffffa40: 00000000 00000000 00000d60 3fffae4c
3ffffa50: 00000000 3fffaf4c 3fff571c 4020de09
3ffffa60: 00000000 00023fe7 68f5c28f 0299e391
3ffffa70: 00000000 00000000 00000034 00023fe7
3ffffa80: 00003a98 3fff679c 3fff571c 4020d052
3ffffa90: 3fff7764 000006e9 3ffe86fc 4010089e
3ffffaa0: 3ffe8e48 00000017 3fffbed8 000001bb
3ffffab0: 000001bb 3fffae4c 3fff571c 4020df95
3ffffac0: 40215438 7127be23 40215438 7127be23
3ffffad0: 3fffae4c 3fff0b08 3fffbcb4 40203c2a
3ffffae0: 00000000 0017001f 00000000 40203c65
3ffffaf0: 00000000 3fff0b08 3fff571c 3fffbe04
3ffffb00: 3fffbdb4 3fff0b08 3fffbcb4 40207780
3ffffb10: 3fffae4c 002a002f 80000000 40202466
3ffffb20: 3fffbcb4 3fffbdb4 3fffbdec 3fffbe04
3ffffb30: 3fffbcb4 3fffbdb4 3fff0b08 40207d9c
3ffffb40: 00000000 00000000 00000000 00000000
3ffffb50: 3ffe8ab6 3fffbcbc 3fffbce0 00000000
3ffffb60: 3fffbdb4 3ffffdd0 3fffbcb4 4020847a
3ffffb70: 3ffffdf0 3ffffde0 3fffbcbc 3fffbdb4
3ffffb80: 00000000 0000746e 00000000 40100bec
3ffffb90: 00000000 3fff0b08 3fffbcb4 40207a6c
3ffffba0: 00000001 3fffbdb4 3fffbe6c 402025c8
3ffffbb0: 000038a0 00000714 3ffe86fc 4010089e
3ffffbc0: 3fffbcb4 3fffbdb4 3fff0b08 3ffffca0
3ffffbd0: 3fff68fc 00000060 00000020 40100c20
3ffffbe0: 3fff68fc 00000060 3ffffdb4 3ffffcc0
3ffffbf0: 3fff76fc 00000060 00000020 40100c20
3ffffc00: 3fff76fc 00000060 3ffffdd4 4020ffa2
3ffffc10: 00000000 00000030 00000020 40100c20
3ffffc20: 3fff709c 00000030 3ffffe74 3ffffcc0
3ffffc30: 3fff76fc 0000005e 3ffffdd4 40210037
3ffffc40: 00000000 00000074 00000000 40210079
3ffffc50: 00000000 3fff76fc 3fff709c 0024002f
3ffffc60: 80000000 3ffffe01 3ffffdd0 40204a4d
3ffffc70: 00000004 3fff8684 00000000 40210079
3ffffc80: 3fff0cec 3ffffe80 3ffffde0 3ffffec0
3ffffc90: 3fff0cec 3ffffdd0 3ffffcc0 40208616
3ffffca0: 00000000 40000000 00000000 3ffffe0c
3ffffcb0: 00000000 3ffffcc0 00000000 3ffffe80
3ffffcc0: 3ffffcc0 00000000 00000000 00000000
3ffffcd0: 00000000 00000000 00000000 00000000
3ffffce0: 00003301 00000000 00000000 3fffc278
3ffffcf0: 00000000 00000000 00000022 00000000
3ffffd00: 40210900 00000000 00000000 ffff0000
3ffffd10: ffffffff 00000000 00000000 00000000
3ffffd20: ffffffff 00000000 3fff6673 00000000

mobizt · 2024-03-30T03:05:47Z

mobizt
Mar 30, 2024
Maintainer

You have memory leaks in your code or out of memory due to memory is not properly set.

You should read this to configure your device memory.
https://github.com/mobizt/FirebaseClient?tab=readme-ov-file#memory-options-for-esp8266

For async result, please read.
https://github.com/mobizt/FirebaseClient?tab=readme-ov-file#the-static-async-result-instances-required-for-async-operation

4 replies

jiperez11 Mar 30, 2024
Author

My problem is when streaming and in the loop updating every second

mobizt Mar 30, 2024
Maintainer

You have to reduce the data at the path to be stream.

It should keep small as possible. Streaming large data is not recommended.

And you have to limit the BearSSL engine buffer otherwise it set to 16k+ by default.

FirebaseClient/examples/RealtimeDatabase/Async/Stream/Stream.ino

Lines 299 to 300 in cd2ac8d

    
           ssl_client.setBufferSizes(4096, 1024); 
        
           ssl_client2.setBufferSizes(4096, 1024);

jiperez11 Mar 30, 2024
Author

It works correctly without updates in the loop:

Grabacion.de.pantalla.2024-03-30.a.la.s.9.23.15.a.m.mov

jiperez11 Mar 30, 2024
Author

But when adding update in the loop it takes a lot of time for the stream and the update to react.
https://github.com/mobizt/FirebaseClient/assets/63749581/e8ca07c8-f674-4495-87b0-7c73615f09c0

mobizt · 2024-03-30T15:07:42Z

mobizt
Mar 30, 2024
Maintainer

It is your code problem.

You can prove this by run this example without changing anything unless the WiFi and user_auth credentials.
https://github.com/mobizt/FirebaseClient/blob/main/examples/RealtimeDatabase/Async/Stream/Stream.ino

Now go to the Firebase console and edit the data at node /test/stream/number manually and see your device Serial monitor.

If you can see the change in your device Serial monitor corresponds to the change you made on Firebase console instantly, your device and network are ok.

In your code, you have to debug what part of your code blocks the async task handler to run.

You can check how fast or how often the app.loop() and Database.loop() can run in each iteration and where is the blocking process.

You should keep in mind that this library is true async operation by design (only small chunk of payload while sending and receiving or even file reading and writing processes with data incompletion checking timeout) and no blocking in any part of library unless SSL/TLS handshake in SSL client you used during first server connection.

0 replies

mobizt · 2024-03-30T15:22:00Z

mobizt
Mar 30, 2024
Maintainer

I see something really bad practice in your code that you are trying to send data every 1 second in loop.

You should read the comment in all examples (at the top) that describe about queue.

The queue size is 10 maximum, and any additional request will be ignored because of it consumed memory for each data in queue.

You should update the data based on hardware event or reasonable timing (1 second does not make any sense). You should use sync for 1 second repetition data sending instead if you don't care about resource usage.

1 reply

jiperez11 Mar 31, 2024
Author

Thanks I'm controlling if queue > 5 👍🏼

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Resets problems with streams #16

{{title}}

Replies: 3 comments 5 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

Select a reply

Resets problems with streams #16

jiperez11 Mar 30, 2024

Replies: 3 comments · 5 replies

mobizt Mar 30, 2024 Maintainer

jiperez11 Mar 30, 2024 Author

mobizt Mar 30, 2024 Maintainer

jiperez11 Mar 30, 2024 Author

It works correctly without updates in the loop:

jiperez11 Mar 30, 2024 Author

mobizt Mar 30, 2024 Maintainer

mobizt Mar 30, 2024 Maintainer

jiperez11 Mar 31, 2024 Author

jiperez11
Mar 30, 2024

Replies: 3 comments 5 replies

mobizt
Mar 30, 2024
Maintainer

jiperez11 Mar 30, 2024
Author

mobizt Mar 30, 2024
Maintainer

jiperez11 Mar 30, 2024
Author

jiperez11 Mar 30, 2024
Author

mobizt
Mar 30, 2024
Maintainer

mobizt
Mar 30, 2024
Maintainer

jiperez11 Mar 31, 2024
Author