Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for msgpack-based serialization of GufeTokenizables #372

Open
dotsdl opened this issue Oct 25, 2024 · 0 comments
Open

Add support for msgpack-based serialization of GufeTokenizables #372

dotsdl opened this issue Oct 25, 2024 · 0 comments
Assignees
Milestone

Comments

@dotsdl
Copy link
Member

dotsdl commented Oct 25, 2024

Currently, we use JSON-based encoding as our general approach for serializing representations of GufeTokenizables, either in their dict, keyed_dict, or keyed_chain forms. However, JSON has several known disadvantages, including being relatively slow to parse for large objects and being space-inefficient for numeric datatypes. These limitations have bitten us in particular for ProtocolDAGResult objects, which often feature numerical data as key results.

To address this, we should pursue msgpack as an alternative serialization mechanism in addition to JSON. This could over time overtake JSON as our default approach for serialization in automated systems, while still retaining JSON as an option for cases in which human-readability is more valuable, or where a string representation of a full GufeTokenizable is required.

@dotsdl dotsdl added this to the Release 1.3 milestone Oct 25, 2024
@dotsdl dotsdl moved this to Upcoming Sprint - Queued in gufe : advancement sprints Jan 7, 2025
@dotsdl dotsdl assigned dotsdl and ianmkenney and unassigned dotsdl Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Upcoming Sprint - Queued
Development

No branches or pull requests

2 participants