Replies: 3 comments 6 replies
-
|
The binary files put into the nats object Store are chunked by me. I do this so that it’s resilient when putting large ikes in and out. I have had success with 50 gb video files . By chunking the server memory does not increase. The destination of the files can be local or s3. Just thought this is useful to know in terms of use cases and technical resiliency |
Beta Was this translation helpful? Give feedback.
-
Hey @gedw99! We have two connectors because the Publish-Subscribe and JetStream implementations differ a lot and the configuration is quite different as well, so it didn't make that much sense to have a single connector. I see that you already opened a feature request for objects and key-values, thanks for that! |
Beta Was this translation helpful? Give feedback.
-
|
Hey here it is: conduitio-labs/conduit-connector-nats-jetstream#54 Now using the correct repo :) If you want some help with this let me know... |
Beta Was this translation helpful? Give feedback.
-
|
If you want to take a stab at it, definitely feel free to do so! We're happy to accept contributions and we'll be glad to provide guidelines and help. Otherwise, we'll prioritize it and see what's the earliest time someone from the Conduit team can work on it. |
Beta Was this translation helpful? Give feedback.
-
|
I will try. Still getting my head around conduit... |
Beta Was this translation helpful? Give feedback.
-
|
👍 Is there anything you'd like to know to understand Conduit better? If you'd like, you can also join our Discord channel: https://discord.meroxa.com/ |
Beta Was this translation helpful? Give feedback.
-
|
def - going there now if your there !!! |
Beta Was this translation helpful? Give feedback.
-
|
For reference the ticket which is about implementing this feature: conduitio-labs/conduit-connector-nats-pubsub#45. |
Beta Was this translation helpful? Give feedback.
-
|
I deleted it because i only found the Jetstream one later :) |
Beta Was this translation helpful? Give feedback.
-
Nats also supports objects ( files ) and kv ( key values ).
Not sure why there are 2 ?
https://github.com/conduitio-labs/conduit-connector-nats-pubsub
https://github.com/conduitio-labs/conduit-connector-nats-jetstream
It would be nice if this was supported too. From what I can it’s not ?
it should be possible because both support cdc semantics of created, updated and deleted.
I use nats for syncing files and kv values across systens. It’s a great way to manage server resources like binary’s that need to be in many places. Kv is a create way of updating configs across many servers.
Beta Was this translation helpful? Give feedback.
All reactions