Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🔖 Migrations for LaminDB 0.78 #368

Open
falexwolf opened this issue Apr 15, 2024 · 0 comments
Open

🔖 Migrations for LaminDB 0.78 #368

falexwolf opened this issue Apr 15, 2024 · 0 comments

Comments

@falexwolf
Copy link
Member

falexwolf commented Apr 15, 2024

  • add a boolean field .many to Feature that default to True and indicates whether feature values for this feature are expected to occur once or multiple times for an artifact -- something similar for Param

  • remove the .transform foreign key from artifact and collection for consistency with all other records; introduce a property and a simple filter statement instead (alternatively, add the .transform foreign key to all other records)

  • store provenance metadata for TransformULabel, ArtifactFeatureValue, RunParamValue, ArtifactParamValue

  • a boolean on ULabel called is_metalabel to distinguish mere ontological parents from labels that are meant to be used for labeling

  • add TracksRun.transform for consistency with Artifact & Collection

  • rename run.parent to run.initiator

  • given that feature_sets is a public attribute and given that some people might want to query for feature_values or param_values outside the .features and .params managers; we should consider making _feature_values and _param_values public. This will likely also help people better understand the underlying mechanics if they're ever interested. The downside is that then there are two ways to query by a feature or param. If one wants to do nested JSON queries, this could be desired however. We'll need to look into how .params behaves in that regard. 🤔

  • introduce a boolean flag on artifact without an index that's either called _store_revisions, which indicates whether revisions are stored; it defaults to True for file-like artifact and to False for folder/array-like artifacts (alternative names: _keep_only_latest or _overwrite_revisions) - see Slack thread

  • ? rename Feature to Dimension and FeatureSet to DimGroup


Prospective:

@falexwolf falexwolf changed the title Increase uid for storage to 12 characters Next migrations Apr 16, 2024
@falexwolf falexwolf changed the title Next migrations Migrations for 0.65 Apr 16, 2024
@falexwolf falexwolf pinned this issue Apr 16, 2024
@falexwolf falexwolf changed the title Migrations for 0.65 🔖 Migrations for 0.65 Apr 16, 2024
@falexwolf falexwolf changed the title 🔖 Migrations for 0.65 🔖 Migrations for 0.66 Apr 16, 2024
@falexwolf falexwolf changed the title 🔖 Migrations for 0.66 🔖 Migrations for 0.67 May 29, 2024
@falexwolf falexwolf changed the title 🔖 Migrations for 0.67 🔖 Migrations for next release May 29, 2024
@falexwolf falexwolf changed the title 🔖 Migrations for next release 🔖 Migrations for LaminDB 0.77 Oct 14, 2024
@falexwolf falexwolf changed the title 🔖 Migrations for LaminDB 0.77 🔖 Migrations for LaminDB 0.78 Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant