Replies: 1 comment
-
I added:
to short circut |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I attempted to pull a very small file
dvc pull -r aws train_labels.csv.dvc -vvv
, and I it took nearly a minute to finish. I added the-vvv
to give me a sense as to what was going on, and I noticed a ton of "collecting stages" messages:You can see the command starts at
21:35:53
and starts "collecting stages" 7 seconds later at21:36:00,221
, it then continues to collect stages for until21:36:39
, nearly 40 seconds later, and then it finally after 4 more seconds.I don't use DVC for pipelines, I've never used a stage. All I use it for is git-for-data, which it's great for... until I start adding lots of files to a single repo, and then I run into issues like this. Is there anyway to disable these stage checks? I see in #7093 there is an item
stop collecting whole DAG all the time in the whole repo
, is that related to this?Beta Was this translation helpful? Give feedback.
All reactions