Back to BDM Home
Sample commands
- Support email : srmlbl.gov
1. Retrieve a source directory from remote GridFTP transfer servers with concurrency 2
- bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////tgt_directory_path -concurrency
- e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2
- e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -overwrite
- e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -recursive
- e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -recursive -overwrite
2. Retrieve a source directory from remote GridFTP transfer servers with concurrency 2 (for strict firewall proctected sites)
- Uses passive connection for data browsing and data transfers
- limitation: parallelism cannot be more than 1
- bdmclient -sd gsiftp://remote_hostname//src_directory_path -td file:////tgt_directory_path -concurrency 2 -usepassive
- e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -usepassive
3. Retrieve a source directory from two remote GridFTP transfer servers with concurrency 2 for each server
- bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////tgt_directory_path -transferserver remote_hostname_1,remote_hostname_2 -concurrency 2
- e.g. bdmclient -sd gsiftp://gs1.intrepid.alcf.anl.gov//intrepid-fs0/projects/sc09bwc/data/koa/nersc/tRun1/sc09/ipcc2/sresb1/ocn/ -td file:////project/projectdirs/sc09/sctest -transferserver gs2.intrepid.alcf.anl.gov,gs1.intrepid.alcf.anl.gov -concurrency 2
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////project/projectdirs/sc09/sctest -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 2
4. Retrieve a single source file from a remote GridFTP transfer server
- bdmclient -s gsiftp://remote_hostname//src_directory_path -t file:////tgt_directory_path
- e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/test.data -t file:////tmp/test.data.2
- e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/test.data -td file:////tmp/
5. Retrieve a single source file where file contains spaces init, from a remote GridFTP transfer server
- bdmclient -s gsiftp://remote_hostname//src_directory_path/"file name with space" -td file:////tgt_directory_path/
- e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/"file name with space" -td file:////tmp/
6. Retrieve a single source file from root dir
- bdmclient -s gsiftp://remote_hostname//file -td file:////tgt_directory_path/
- e.g. bdmclient -s gsiftp://srm.lbl.gov//vmlinuz -td file:////tmp/
7. Retrieve from root dir
- bdmclient -s gsiftp://remote_hostname// -td file:////tgt_directory_path/ -recursive
- e.g. bdmclient -s gsiftp://srm.lbl.gov// -td file:////tmp/ -recursive
- e.g. bdmclient -s gsiftp://srm.lbl.gov// -td file:////tmp/
8. Retrieve using an input xml file
- please see the sample xml files for formats and uses cases
- bdmclient -f inputfile.xml
9. Browse root dir
- bdmclient -s gsiftp://remote_hostname// -browse
- e.g. bdmclient -s gsiftp://srm.lbl.gov// -browse -recursive
- e.g. bdmclient -s gsiftp://srm.lbl.gov// -browse
10. Browse remote source directory only.
- Stores the file information in the database
- Returns the request token to the user for later use
- bdmclient -sd gsiftp://remote_hostname//src_directory_path -browse
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse -recursive
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse -overwrite
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse -usepassive (for strict firewall protected sites)
11. Browse remote source directory recursively with concurrency and transferserver option
- bdmclient -sd gsiftp://remote_hostname//src_directory_path -browse -concurrency 15 -transferserver -recursive
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////tmp -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 15 -recursive
12. measure performance
- bdmclient -perftest -sd gsiftp://remote_hostname//dev/ZERO -f file:////dev/null
- e.g. bdmclient -perftest -sd gsiftp://dm.lbl.gov//dev/ZERO -t file:////dev/null
13. Browse remote source file
- bdmclient -sd gsiftp://remote_hostname//src_directory_path/src_file -browse
- e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/test.data -browse
14. Resume the previous request with the request token with two remote GridFTP transfer servers and concurrency 2
- bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////tgt_directory_path -resume my_request_token -transferserver remote_hostname_1,remote_hostname_2 -concurrency 2
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////tmp -resume viji_12345 -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 2
15. Resume the previous request with the request token to different target dir with two remote GridFTP transfer servers and concurrency 2
- bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////another_tgt_directory_path -resume my_request_token -transferserver remote_hostname_1,remote_hostname_2 -concurrency 2
- e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////tmp/differenttargetdir -resume viji_12345 -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 2
16. Show request status
- when -requesttoken is not provided, it shows the status of the latest request
- bdmstatus -requesttoken my_request_token
- e.g. bdmstatus -requesttoken viji_12345
17. List request status
18. Output the request status in detail
- Generates the XML output file, which contains source, target, checksum information for the files in the given request.
- bdmstatus -publish output.xml -requesttoken my_request_token
- e.g. bdmstatus -publish test_output.xml -requesttoken viji_12345
- To compare the calculated checksum of the file with the input
- When the checksum information for the files is given in the input file, BDM compares the calculated checksum with the given checksum and retry file transfer if they do not match. If the checksum information is not provided, then it computes the checksum and stores in a database.
- bdmclient -f input.xml -checksum
19. To compare the calculated checksum of the file with the input
- When the checksum information for the files is given in the input file, BDM compares the calculated checksum with the given checksum and retry file transfer if they do not match. If the checksum information is not provided, then it computes the checksum and stores in a database.
- bdmclient -f input.xml -checksum