Roadmap, Scope and API design

[AyushExel]

Scope

Roadmap to V1:

• Dataset management - Simple ways to double down on specific parts of the dataset

Searching

• Using SQL

• Using Semantic search

• Support multiple datasets, i.e, allow semantic search across datasets (Via staging area)

• Using natural Language / AI search - Example- "Show me all images where a person is standing next to a car and the sample should be recorded before 2015"

• Allow enriching datasets by adding/removing samples from various sources, including other datasets ( secondary datasets of data lakes)

• Allow Various dataset formats (Users can load datasets from any format including 3rd party sources like RF, DagsHub, etc.)

• Allow loading tables directly - local, or cloud based ( s3 etc.)

• Allow various tasks:

• Detection
• Segmentation
• Classification
• ImgFolder structure used for generative AI or diffusion model samples

API Design:

• GUI/ Dashboard - TODO
• Pythonic/ Notebook - TODO