Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Long lived Sinks seem to time out, pool doesn't seem to fix this automatically #161

Open
visch opened this issue Jul 12, 2023 · 2 comments
Labels
bug Something isn't working

Comments

@visch
Copy link
Member

visch commented Jul 12, 2023

          > @BuzzCutNorman tried this PR here https://meltano.slack.com/archives/C01RKUVUG4S/p1688075229854589?thread_ts=1688060563.197079&cid=C01RKUVUG4S , I thought this would address an issue like
cur.execute(b''.join(parts)) cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres
2023-06-29T20:23:10.757683Z [info     ] sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) server closed the connection unexpectedly cmd_type=elb consumer=True name=target-postgres producer=False stdio=stderr string_id=target-postgres

By using Pooling properly but we're still hitting it. Going to take a look a bit deeper but wanted to capture this somewhere

@BuzzCutNorman can you try this again?

Originally posted by @visch in #153 (comment)

@BuzzCutNorman
Copy link
Contributor

I did a meltano install --clean, target-postgres was pulled from the pipurl of git+https://github.com/MeltanoLabs/target-postgres.git@uppercase_alter_failure. It stopped with the following error when the second insert started.

psycopg2.OperationalError: server closed the connection unexpectedly 
     This probably means the server terminated abnormally 
     before or while processing the request.

@visch
Copy link
Member Author

visch commented Jul 12, 2023

Sorry @BuzzCutNorman I didn't mean to ask you to do it yet again! I was just trying to capture this issue separately as obviously the fix I thought would make this work didn't work!

@visch visch added the bug Something isn't working label Jul 12, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: No status
Development

No branches or pull requests

2 participants