Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inquiry and question about data usage in pretraining the foundation model #56

Closed
wuwusky opened this issue Sep 18, 2024 · 1 comment
Closed

Comments

@wuwusky
Copy link

wuwusky commented Sep 18, 2024

Thank you for the excellent work!
I am interested in learning more about the pretraining process. Based on the paper, it appears that the scFoundation model was trained exclusively on single-cell gene expression matrices, including the count values calculated internally and the RDA training strategy. Could you clarify if any metadata or additional prior knowledge was incorporated during the pretraining process?

@WhirlFirst
Copy link
Collaborator

Hi, thank you for your interest! We didn't use any metadata or prior knowledge for pre-training.

@wuwusky wuwusky closed this as completed Dec 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants