StashCalculation: a new CalcJob plugin

[khsrali]

Historically, stashing was only possible, if it was instructed before running a generic calcjob. The instruction had to be "attached" to the original calcjob, like this for example:

inputs = {
    'MyInputs': <MyInputs>,
    'metadata': {
        'computer': Computer.collection.get(label="localhost"),
        'options': {
            'resources': {'num_machines': 1}, 
            'stash': {
                'stash_mode': StashMode.COPY.value,
                'target_base': '/scratch/',
                 'source_list': ['heavy_data.xyz'],
            },
        },
    },
}
run(MyCalculation, **inputs)

However, if a user would realize they need to stash something only after running th calcjob, this would not be possible.

This PR, defines a new calcjob, that is able to perform a stashing operation even after a calculation is finished.
The usage is very similar, and for consistency and user-friendliness, we keep the instruction as part of the metadata. The only main input is obviously a source node, for example:

StashCalculation_ = CalculationFactory('core.stash')


MyCalculation = orm.load_node(pk=<PK>)
inputs = {
    'metadata': {
        'computer': Computer.collection.get(label="localhost"),
        'options': {
            'resources': {'num_machines': 1}, 
            'stash': {
                'stash_mode': StashMode.COPY.value,
                'target_base': '/scratch/',
                 'source_list': ['heavy_data.xyz'],
            },
        },
    },
    'source_node': MyCalculation,
}

result = run(StashCalculation_, **inputs)

P.S. This PR is part of the upcoming changes, reference in #6764

[codecov]

Codecov Report

Attention: Patch coverage is 91.42857% with 3 lines in your changes missing coverage. Please review.

Project coverage is 78.32%. Comparing base (ae49af6) to head (4c1504b).

Files with missing lines	Patch %	Lines
src/aiida/engine/daemon/execmanager.py	72.73%	3 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #6772      +/-   ##
==========================================
+ Coverage   78.30%   78.32%   +0.02%     
==========================================
  Files         566      567       +1     
  Lines       42751    42777      +26     
==========================================
+ Hits        33474    33499      +25     
- Misses       9277     9278       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[agoscinski]

First quick review.

[agoscinski]

I am not sure how would I pass another computer here? Maybe you could also explain more scenario more detailed.

Suggested change

	# However, if another computer has access to the directory, we don't want to restrict.`
	# However if you cannot access the stash storage from the same computer anymore but you have access to it from another computer, you can can specify the computer with this commented block below

[khsrali]

Thanks I updated the comment, and moved it to docstring.
Passing computer appears to be a very routing procedure it's done via metadata.computer.
It should be very clear, now, even for the users.

[agoscinski]

I think the CUSTOM_SCRIPT is part of a different PR

[khsrali]

yes! my bad :) fixed now.

[agoscinski]

might increase readability

Suggested change

	uuid = calculation.inputs.source_node.uuid
	uuid = remote_node.uuid

[khsrali]

First quick review.

applied!