SDM
People Publications Projects

SRM-COPY: BeStMan SRM-Client Tools User's Guide

srm-copy requests to copy files to and from SRM, between SRMs, between SRM and other storage repository. Operations include GET, PUT, BringOnline, and COPY.

Usage

Options

-3partycopy
  • Issues 3rd party copy between source SRM and target SRM.
  • Client will request “get” to the source SRM, and retrieve the TURL from the source SRM. Client then requests “put” to the target SRM, and retrieves the TURL for the target SRM. Then client makes the 3rd party gsiftp file transfer from source TURL to target TURL.
  • Default=false
-accesslatency <online¶nearline>
  • Specifies access latency
  • <liDefault=online
-adjustturl
  • Sometimes SRM-returned TURLs need few or more slashes to be a valid URL. When this option is on, it tries to adjust the number of slashes to be a valid URL.
  • Default=false
-authid <string>
  • Authorization ID to be used in SRM for the request
-bringonline
  • Sets the request operation for srmBringOnline
-buffersize <int>
  • Specifies gridftp buffer size in bytes
  • Default=1MB
-checkdiskspace
  • Checks the availability of the local disk space when retrieving files.
  • Default=false
-concurrency <int>
  • Specifies concurrent file transfers.
  • Default=1
-conf <path>
  • Path to the configuration file.
  • Command line options will override the options from conf file
-connectiontimeout <int>
  • enforces http connection timeout in the given seconds.
  • Default=1800
-copy
  • SMakes srmCopy requests explicitly with provided source url and target url
-dcau <true¶false>
  • Specifies DCAU for gsiftp file transfers
  • Default=true
-debug
  • Specifies debugging output
  • Default=false
-delegation <true¶false>
  • Force proxy delegation.
  • When not provided, srm-copy makes no delegation by default, and automatically handles proxy delegation based on the source and target URLs.
  • When –delegation is provided, it forces the user choice.
-direct
  • This option enables direct gsiftp file transfer from the gsiftp source or to the gsiftp target
  • This srm-copy does not go through SRM server.
  • Default=false
-f <path>
  • Path to the xml input file containing the source url, target url information for requests with more than one file
  • Refer to the format and examples below
-filelifetime <int>
  • File (SURL) lifetime in seconds
-filestoragetype <p ¶ d ¶ v>
  • Indicates filestorage type
  • p - Permanent, d - Durable, v - Volatile
-gucpath <path>
-gurlcopy <path>
  • Specifies path to the globus-url-copy (or its script)
-help
  • Show the help message
-log <path>
  • Specifies path to log file
  • Refer to the format and an example below
-maxfilesperrequest <int>
  • maximum file requests per request.
  • It divides the files in multiple requests.
  • Default is to include all files in one request
-nodownload
  • Not to download the requested files.
  • iles have to be retrieved with a direct file transfers. (e.g. globus-url-copy)
  • Default=false
-nooverwrite
  • Enables no overwriting to the target.
  • Default=false and overwrite always
-noreleasefile
  • Disable releasing file after the get request and file transfer.
  • Default=release file
-numlevels <int>
  • Specifies number of directory levels in recursive request.
  • Default=0 requesting all levels
-numretry <int>
  • Specifies number of file transfer retries before giving up.
  • Default=3
-parallelism <int>
  • Specifies gridftp parallel streams.
  • When parallelism is 1, passive file transfer is on by default.
  • Default=1
-pinlifetime <int>
  • Pin lifetime in seconds
-protocolslist <string>
  • List of preferred file transfer protocol list separated by comma.
  • Default=gsiftp
  • e.g. gsiftp,ftp,http,dcap
-proxyfile <path>
  • Path to user grid proxy
-pushmode
  • Issues push mode when srmCopy is done
  • Default=pull mode
-quiet
  • Suppress output in the console.
  • This option writes the output to the log file.
  • Default=false
-recursive
  • Allows recursive GET from source url and/or PUT to target url
-releasespace
  • Releases the space upon completion of the request
  • f -releasespace used in pair with -reservespace, then it releases the newly created space.
  • If used in pair with -spacetoken, then it releases the space associated with the space token
-remotetransferinfo <string>
  • Specifies extra file transfer parameters in srmCopy.
  • Formatted input separated by comma with the following keywords: buffersize:<int>,dcau:<true ¶ false>,parallelism:<int>,guc:<true ¶ false>,protection<true ¶ falase>
-renewproxy
  • Enables automatic proxy renewal upon expiration
  • Works only when -usercert and -userkey are provided
  • Prompts for the pass phrase
  • Default=false
-report <path>
  • Specifies path to full report output.
-reservespace
  • Reserves a new space before the request, and use the space token with the request
-retentionpolicy <replica ¶ output ¶ custodial>
  • Specifies retention quality
  • Default=replica
-retrydelay <int>
  • Specifies number of seconds to sleep between file transfer retries.
  • Default=60
-s <source_url>
  • Source URL
-serviceurl <endpoint>
  • Full web service endpoint
  • Required when source url or target url does not contain web service endpoint information
-sethttptimeout <int>
  • set client-side http connection timeout in the given seconds.
  • Default=600
-spacelifetime <int>
  • Specifies desired space lifetime in seconds for -reservespace
-spacegsize <int>
  • Specifies desired guaranteed space size in bytes for -reservespace
-spacesize <int>
  • Specifies desired total space size in bytes for -reservespace
-spacetoken <string>
  • Space token to be used with the request
-statusmaxtime <int>
  • Max time before status checks get timed out, in seconds
  • Default=600
-statuswaittime <int>
  • Wait time delay between status check, in seconds
  • Default=30
-storageinfo <string>
  • extra storage access information
  • For BeStMan supporting MSS, a formatted input separated by comma is used with following keywords when necessary: for:<source ¶ target ¶ sourcetarget>,login:<string>,passwd:<string>,projectid:<string>,readpasswd:<string>,writepasswd<string>
-submitonly
  • Exits after the request submission
  • Status must be checked separately. (e.g. srm-copy-status)
  • Default=false
-t <target_url>
  • Target URL
-td <target_url>
  • Target URL as directory path
  • Required for multiple “get” file requests if input file does not contain the target information.
  • When both target information in the input file and –td option are provided, command line option –td will take priority and information in the input file will be ignored.
-totalrequesttime <int>
  • Total request time
  • TotalRequestTime means: All file transfers for the request must be completed within the totalRequestTime. Otherwise, SRM will return SRM_REQUEST_TIMED_OUT as the request status code with individual file status of SRM_FAILURE with an appropriate explanation.
-usercert <path>
  • Path to user grid certificate
-userdesc <string>
  • Specifies user request description
-userkey <path>
  • Path to user grid certificate key
-xmlreport <path>
  • Specifies path to short output report in XML format.

Notes

Input file format



  
    Source_URL
    Target_URL
  



  
    file:////tmp/my.source.data
    srm://bestman.lbl.gov:8443/srm/v2/server?SFN=/mydir/mypath/myfile
  



  
    gsiftp://gridftphost.lbl.gov//tmp/my.source.data
    srm://bestman.lbl.gov:8443/srm/v2/server?SFN=/mydir/mypath/myfile
  



  
    srm://bestman.lbl.gov:8443/srm/v2/server?SFN=/mydir/my.source.file
    srm://bestman2.lbl.gov:8443/srm/v2/server?SFN=/mydir/my.target.file
  



  
    srm://bestman.lbl.gov:8443/srm/v2/server?SFN=/mydir/my.source.file
  

Examples

Put a file from local disk to remote SRM cache

Get a file from remote site to local disk

BringOnline a file on an SRM

Copy a file from one SRM to another SRM

Troubleshooting

See Also