When I running the following code with dflow
from dflow.plugins.dispatcher import DispatcherExecutor
kwargs = {'host': 'xxx', 'username': 'xxx', 'port': 6666, 'machine_dict': {'batch_type': 'Slurm', 'context_type': 'SSHContext', 'remote_profile': {
'key_filename': '/home/xxx/.ssh/id_ed25519'}}, 'resources_dict': {'number_node': 1, 'cpu_per_node': 1}, 'queue_name': 'c52-small', 'remote_root': '/data/home/xxx/tmp/dflow-galaxy/square-sum'}
exeuctor = DispatcherExecutor(**kwargs)If the remote_root path doesn't existed, it will raise error instead of create it automatically. I think this could be easily fixed by using mkdir -p or os.makedirs(path, exist_ok=True) somewhere in dpdispatcher.
When I running the following code with dflow
If the
remote_rootpath doesn't existed, it will raise error instead of create it automatically. I think this could be easily fixed by usingmkdir -poros.makedirs(path, exist_ok=True)somewhere in dpdispatcher.