开发者

script unable to find directories/files when running from qsub cluster script

开发者 https://www.devze.com 2022-12-22 08:36 出处:网络
I\'m calling several unix commands and python on a python script from a qsub shell script, meant to run on a cluster.The trouble is that when the script executes, something seems to go awry in the she

I'm calling several unix commands and python on a python script from a qsub shell script, meant to run on a cluster. The trouble is that when the script executes, something seems to go awry in the shell, so that directories and files that exist are not found. For example, in the .out output files of qsub I see the following errors:

cd: /valid/dir/name: No such file or directory
python valid/script/name.py 
python: can't open file 'valid/script/name.py': [Errno 2] No such file or directory

so the script cannot cd i开发者_如何学编程nto a dir that definitely exist. Similarly, calling python on a python script that definitely exists yields an error.

any idea what might be going wrong here, or how I could try to debug this?

thanks very much.


the errors are pretty self explanatory. make sure /valid/dir/name is actually a directory. You can put this in your shell script to create this directory if not found.

if [ ! -d "/valid/dir/name" ];then
   mkdir -p /valid/dir/name
fi

As for Python error, because there's no "valid" directory, it gives you error.


Does this directory exist on every possible compute node? Remember that the script won't necessarily execute on the host you submit it from. Try adding the python equivalent of echo hostname to your script and then verifying that the directory exists on that host.

0

精彩评论

暂无评论...
验证码 换一张
取 消

关注公众号