Sample commands

Support email : srmlbl.gov

1. Retrieve a source directory from remote GridFTP transfer servers with concurrency 2

bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////tgt_directory_path -concurrency

e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2
e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -overwrite
e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -recursive
e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -recursive -overwrite

2. Retrieve a source directory from remote GridFTP transfer servers with concurrency 2 (for strict firewall proctected sites)

Uses passive connection for data browsing and data transfers
limitation: parallelism cannot be more than 1
bdmclient -sd gsiftp://remote_hostname//src_directory_path -td file:////tgt_directory_path -concurrency 2 -usepassive

e.g. bdmclient -sd gsiftp://gdo2.ucllnl.org//export/ftp/pub/sc09/ipcc2/2xco2 -td file:////project/projectdirs/sc09/sctest -concurrency 2 -usepassive

3. Retrieve a source directory from two remote GridFTP transfer servers with concurrency 2 for each server

bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////tgt_directory_path -transferserver remote_hostname_1,remote_hostname_2 -concurrency 2

e.g. bdmclient -sd gsiftp://gs1.intrepid.alcf.anl.gov//intrepid-fs0/projects/sc09bwc/data/koa/nersc/tRun1/sc09/ipcc2/sresb1/ocn/ -td file:////project/projectdirs/sc09/sctest -transferserver gs2.intrepid.alcf.anl.gov,gs1.intrepid.alcf.anl.gov -concurrency 2
e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////project/projectdirs/sc09/sctest -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 2

4. Retrieve a single source file from a remote GridFTP transfer server

bdmclient -s gsiftp://remote_hostname//src_directory_path -t file:////tgt_directory_path

e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/test.data -t file:////tmp/test.data.2
e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/test.data -td file:////tmp/

5. Retrieve a single source file where file contains spaces init, from a remote GridFTP transfer server

bdmclient -s gsiftp://remote_hostname//src_directory_path/"file name with space" -td file:////tgt_directory_path/

e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/"file name with space" -td file:////tmp/

6. Retrieve a single source file from root dir

bdmclient -s gsiftp://remote_hostname//file -td file:////tgt_directory_path/

e.g. bdmclient -s gsiftp://srm.lbl.gov//vmlinuz -td file:////tmp/

7. Retrieve from root dir

bdmclient -s gsiftp://remote_hostname// -td file:////tgt_directory_path/ -recursive

e.g. bdmclient -s gsiftp://srm.lbl.gov// -td file:////tmp/ -recursive
e.g. bdmclient -s gsiftp://srm.lbl.gov// -td file:////tmp/

8. Retrieve using an input xml file

please see the sample xml files for formats and uses cases
bdmclient -f inputfile.xml

9. Browse root dir

bdmclient -s gsiftp://remote_hostname// -browse

e.g. bdmclient -s gsiftp://srm.lbl.gov// -browse -recursive
e.g. bdmclient -s gsiftp://srm.lbl.gov// -browse

10. Browse remote source directory only.

Stores the file information in the database
Returns the request token to the user for later use
bdmclient -sd gsiftp://remote_hostname//src_directory_path -browse

e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse
e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse -recursive
e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse -overwrite
e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -browse -usepassive (for strict firewall protected sites)

11. Browse remote source directory recursively with concurrency and transferserver option

bdmclient -sd gsiftp://remote_hostname//src_directory_path -browse -concurrency 15 -transferserver -recursive

e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////tmp -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 15 -recursive

12. measure performance

bdmclient -perftest -sd gsiftp://remote_hostname//dev/ZERO -f file:////dev/null

e.g. bdmclient -perftest -sd gsiftp://dm.lbl.gov//dev/ZERO -t file:////dev/null

13. Browse remote source file

bdmclient -sd gsiftp://remote_hostname//src_directory_path/src_file -browse

e.g. bdmclient -s gsiftp://srm.lbl.gov//tmp/test.data -browse

14. Resume the previous request with the request token with two remote GridFTP transfer servers and concurrency 2

bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////tgt_directory_path -resume my_request_token -transferserver remote_hostname_1,remote_hostname_2 -concurrency 2

e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////tmp -resume viji_12345 -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 2

15. Resume the previous request with the request token to different target dir with two remote GridFTP transfer servers and concurrency 2

bdmclient -sd gsiftp://remote_hostname_1//src_directory_path -td file:////another_tgt_directory_path -resume my_request_token -transferserver remote_hostname_1,remote_hostname_2 -concurrency 2

e.g. bdmclient -sd gsiftp://dtn01.nersc.gov//project/projectdirs/sc09/MSU -td file:////tmp/differenttargetdir -resume viji_12345 -transferserver dtn02.nersc.gov,dtn01.nersc.gov -concurrency 2

16. Show request status

when -requesttoken is not provided, it shows the status of the latest request
bdmstatus -requesttoken my_request_token

e.g. bdmstatus -requesttoken viji_12345

17. List request status

bdmstatus -list

18. Output the request status in detail

Generates the XML output file, which contains source, target, checksum information for the files in the given request.
bdmstatus -publish output.xml -requesttoken my_request_token

e.g. bdmstatus -publish test_output.xml -requesttoken viji_12345

To compare the calculated checksum of the file with the input

When the checksum information for the files is given in the input file, BDM compares the calculated checksum with the given checksum and retry file transfer if they do not match. If the checksum information is not provided, then it computes the checksum and stores in a database.
bdmclient -f input.xml -checksum

19. To compare the calculated checksum of the file with the input

When the checksum information for the files is given in the input file, BDM compares the calculated checksum with the given checksum and retry file transfer if they do not match. If the checksum information is not provided, then it computes the checksum and stores in a database.

bdmclient -f input.xml -checksum