Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No more local output #161

Merged
merged 2 commits into from
Jun 14, 2024
Merged

No more local output #161

merged 2 commits into from
Jun 14, 2024

Conversation

FaroutYLq
Copy link
Collaborator

When running in debug mode (we have to because of the rucio direct upload issue unresolved ), it is a pain that we keep saturating our scratch folder locally. Since there is no more than two people running outsource, we can just make sure users delete stuff on davs constantly on their own, and it shall be safe.

@FaroutYLq FaroutYLq added the enhancement New feature or request label Jun 13, 2024
@FaroutYLq FaroutYLq requested a review from rynge June 13, 2024 20:20
@FaroutYLq FaroutYLq self-assigned this Jun 13, 2024
@FaroutYLq
Copy link
Collaborator Author

The implementation above is wrong:

Pegasus.client._client.PegasusClientError: Pegasus command: ['/usr/bin/pegasus-plan', '--conf', '/home/yuanlq/software/outsource/outsource/workflow/pegasus.conf', '--sites', 'condorpool', '--output-sites', 'staging-davs', '--staging-site', 'condorpool=staging-davs', '--dir', '/scratch/yuanlq/workflows/runs/straxen_v2.2.3/xenonnt_sr1_cevns', '--relative-dir', 'florian63_20240613_1', '--cleanup', 'inplace', 'workflow.yml', '--json'] FAILED

It triggers a bug when submitting

@FaroutYLq
Copy link
Collaborator Author

The previous one failed because of Directory(Directory.LOCAL_STORAGE, vs Directory(Directory.SHARED_SCRATCH

@FaroutYLq FaroutYLq merged commit 4c6f75e into master Jun 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant