Library

Installation Environment

• Python 3.10.12

Key libraries

• selenium: 4.21.0 - Web page automation tool, dynamic web page crawling
• beautifulsoup 4: 4.12.3 - Web Scraping
• Google-cloud-storage: 2.16.0 - allows data storage and management in conjunction with Google Cloud Storage
• pg8000 | psycopg - Library for PostgreSQL database connection
• faiss-cpu: 1.8.0 - Vector Search and DB Library
• torch: 2.3.0
• torchvision: 0.18.0
• timm: 1.0.3 - Library for using pre-trained models
• fastapi: 0.111.0 - framework for API construction
• uvicorn: 0.30.1 - used to run fastapi

How to install

pip install -r requirements.txt