Leveraging LLMs with vision capabilities to automatically generate profile pictures in a notion-like "sketch" style using vector graphics from open-peeps. Rendered with opeeps.fun's React wrapper.
Planned User Flow
- user uploads image
- ViT/foundation model is used to describe properties (hair style, gender, accessories, etc.)
- LLM/foundation model picks the best react-peeps assets
- user manually fine-tunes their avatar
- user downloads svg avatar
- make frontend
- prompting w/ sanity testing
- wrap microservice in flask
- make backend (maybe next.js or part of flask)