Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Openalex Data Importer #439

Open
wants to merge 23 commits into
base: develop
Choose a base branch
from
Open

Openalex Data Importer #439

wants to merge 23 commits into from

Conversation

shadrach-tayo
Copy link
Contributor

@shadrach-tayo shadrach-tayo commented Jul 30, 2024 •
edited
Loading

Description of the Problem / Feature

  • Create script to update self hosted Open alex database everyday

Explanation of the solution

  • Instrospect remote Db to pull schema
  • Setup local db with pgvector and local setup script using docker
  • Integrate drizzle for database client
  • Run script with node-cron
  • Manage process using pm2
  • Integrate pino for logging

@shadrach-tayo shadrach-tayo self-assigned this Aug 2, 2024
@shadrach-tayo shadrach-tayo requested a review from hubsmoke August 2, 2024 04:31
@shadrach-tayo shadrach-tayo marked this pull request as ready for review August 2, 2024 04:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@hubsmoke hubsmoke Awaiting requested review from hubsmoke

At least 1 approving review is required to merge this pull request.

Assignees

@shadrach-tayo shadrach-tayo

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@shadrach-tayo