Blob Blame History Raw
'\" t
.\"     Title: globus-url-copy
.\"    Author: 
.\" Generator: DocBook XSL Stylesheets v1.75.2 <http://docbook.sf.net/>
.\"      Date: 08/11/2011
.\"    Manual: Globus Tookit
.\"    Source: The Globus Alliance
.\"  Language: English
.\"
.TH "GLOBUS\-URL\-COPY" "1" "08/11/2011" "The Globus Alliance" "Globus Tookit"
.\" -----------------------------------------------------------------
.\" * Define some portability stuff
.\" -----------------------------------------------------------------
.\" ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
.\" http://bugs.debian.org/507673
.\" http://lists.gnu.org/archive/html/groff/2009-02/msg00013.html
.\" ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
.ie \n(.g .ds Aq \(aq
.el       .ds Aq '
.\" -----------------------------------------------------------------
.\" * set default formatting
.\" -----------------------------------------------------------------
.\" disable hyphenation
.nh
.\" disable justification (adjust text to left margin only)
.ad l
.\" -----------------------------------------------------------------
.\" * MAIN CONTENT STARTS HERE *
.\" -----------------------------------------------------------------
.SH "NAME"
globus-url-copy \- globus\-url\-copy
.SH "SYNOPSIS"
.HP \w'\fB/usr/bin/globus\-url\-copy\fR\ 'u
\fB/usr/bin/globus\-url\-copy\fR [\fBoptions\fR]
.SH "DESCRIPTION"
.PP
globus\-url\-copy is a scriptable command line tool that can do multi\-protocol data movement\&. It supports gsiftp:// (GridFTP), ftp://, http://, https://, and file:/// protocol specifiers in the URL\&. For GridFTP, globus\-url\-copy supports all implemented functionality\&. Versions from GT 3\&.2 and later support file globbing and directory moves\&.
.SH "OPTIONS"
.PP
\fB\-help | \-usage\fR
.RS 4
Print help\&.
.RE
.PP
\fB\-versions\fR
.RS 4
Print the versions of all modules that this program uses
.RE
.PP
\fB\-c | \-continue\-on\-error\fR
.RS 4
Do not die after any errors\&. By default, program will exit after most errors\&.
.RE
.PP
\fB\-a | \-ascii\fR
.RS 4
Convert the file to/from ASCII format to/from local file format
.RE
.PP
\fB\-b | \-binary\fR
.RS 4
Do not apply any conversion to the files\&. *default*
.RE
.PP
\fB\-f filename\fR
.RS 4
Read a list of url pairs from filename\&. Each line should contain sourceURL destURL\&. Enclose URLs with spaces in double qoutes (")\&. Blank lines and lines beginning with # will be ignored\&.
.RE
.PP
\fB\-cd | \-create\-dest\fR
.RS 4
Create destination directory if needed\&.
.RE
.PP
\fB\-r\fR
.RS 4
Copy files in subdirectories
.RE
.PP
\fB\-fast\fR
.RS 4
Recommended when using GridFTP servers\&. Use MODE E for all data transfers, including reusing data channels between list and transfer operations\&.
.RE
.PP
\fB\-t transfer time in seconds\fR
.RS 4
Run the transfer for this number of seconds and then end\&. Useful for performance testing or forced restart loops\&.
.RE
.PP
\fB\-q | \-quiet\fR
.RS 4
Suppress all output for successful operation
.RE
.PP
\fB\-v | \-verbose\fR
.RS 4
Display urls being transferred
.RE
.PP
\fB\-vb | \-verbose\-perf\fR
.RS 4
During the transfer, display the number of bytes transferred and the transfer rate per second\&. Show urls being transferred
.RE
.PP
\fB\-dbg | \-debugftp\fR
.RS 4
Debug ftp connections\&. Prints control channel communication to stderr
.RE
.PP
\fB\-rst | \-restart\fR
.RS 4
Restart failed ftp operations\&.
.RE
.PP
\fB\-rst\-retries retries\fR
.RS 4
The maximum number of times to retry the operation before giving up on the transfer\&. Use 0 for infinite\&. Default is 5\&.
.RE
.PP
\fB\-rst\-interval seconds\fR
.RS 4
The interval in seconds to wait after a failure before retrying the transfer\&. Use 0 for an exponential backoff\&. Default is 0\&.
.RE
.PP
\fB\-rst\-timeout seconds\fR
.RS 4
Maximum time after a failure to keep retrying\&. Use 0 for no timeout\&. Default is 0\&.
.RE
.PP
\fB\-stall\-timeout | \-st seconds\fR
.RS 4
How long before cancelling/restarting a transfer with no data movement\&. Set to 0 to disable\&. Default is 600 seconds\&.
.RE
.PP
\fB\-df filename | \-dumpfile filename\fR
.RS 4
Path to file where untransferred urls will be saved for later restarting\&. Resulting file is the same format as the \-f input file\&. If file exists, it will be read and all other url input will be ignored\&.
.RE
.PP
\fB\-do filename | \-dump\-only filename\fR
.RS 4
Perform no write operations on the destination\&. Instead, all files that would be transferred are enumerated and dumped to the specified file\&. Resulting file is the same format as the \-f input file\&. Note: if you intend to use this file as input for a future transfer, the \-create\-dest option will be required if any destination directories do not already exist\&.
.RE
.PP
\fB\-rp | \-relative\-paths\fR
.RS 4
The path portion of ftp urls will be interpereted as relative to the user\*(Aqs starting directory on the server\&. By default, all paths are root\-relative\&. When this flag is set, the path portion of the ftp url must start with %2F if it designates a root\-relative path\&.
.RE
.PP
\fB\-s subject | \-subject subject\fR
.RS 4
Use this subject to match with both the source and dest servers
.RE
.PP
\fB\-ss subject | \-source\-subject subject\fR
.RS 4
Use this subject to match with the source server
.RE
.PP
\fB\-ds subject | \-dest\-subject subject\fR
.RS 4
Use this subject to match with the destionation server
.RE
.PP
\fB\-tcp\-bs size | \-tcp\-buffer\-size size\fR
.RS 4
Specify the size (in bytes) of the buffer to be used by the underlying ftp data channels\&.
.RE
.PP
\fB\-bs block size | \-block\-size block size\fR
.RS 4
Specify the size (in bytes) of the buffer to be used by the underlying transfer methods
.RE
.PP
\fB\-p parallelism | \-parallel parallelism\fR
.RS 4
Specify the number of parallel data connections should be used\&.
.RE
.PP
\fB\-notpt | \-no\-third\-party\-transfers\fR
.RS 4
Turn third\-party transfers off (on by default)\&.
.RE
.PP
\fB\-nodcau | \-no\-data\-channel\-authentication\fR
.RS 4
Turn off data channel authentication for ftp transfers\&.
.RE
.PP
\fB\-dcsafe | \-data\-channel\-safe\fR
.RS 4
Set data channel protection mode to SAFE
.RE
.PP
\fB\-dcpriv | \-data\-channel\-private\fR
.RS 4
Set data channel protection mode to PRIVATE
.RE
.PP
\fB\-off | \-partial\-offset\fR
.RS 4
Offset for partial ftp file transfers, defaults to 0
.RE
.PP
\fB\-len | \-partial\-length\fR
.RS 4
Length for partial ftp file transfers, used only for the source url, defaults the full file\&.
.RE
.PP
\fB\-\-list url to list\fR
.RS 4
.RE
.PP
\fB\-stripe\fR
.RS 4
Enable striped transfers on supported servers
.RE
.PP
\fB\-striped\-block\-size | \-sbs\fR
.RS 4
Set layout mode and blocksize for striped transfers\&. If not set, server defaults will be used\&. If set to 0, Partitioned mode will be used\&. If set to >0, Blocked mode will be used, with this as the blocksize\&.
.RE
.PP
\fB\-ipv6\fR
.RS 4
Use ipv6 when available (EXPERIMENTAL)
.RE
.PP
\fB\-udt\fR
.RS 4
Use UDT, a reliable udp based transport protocol, for data transfers
.RE
.PP
\fB\-g2 | \-gridftp2\fR
.RS 4
Use GridFTP v2 protocol enhancements when possible
.RE
.PP
\fB\-dp | \-delayed\-pasv\fR
.RS 4
Enable delayed passive
.RE
.PP
\fB\-mn | \-module\-name gridftp storage module name\fR
.RS 4
Set the backend storage module to use for both the source and destination in a GridFTP transfer
.RE
.PP
\fB\-mp | \-module\-parameters gridftp storage module parameters\fR
.RS 4
Set the backend storage module arguments to use for both the source and destination in a GridFTP transfer
.RE
.PP
\fB\-smn | \-src\-module\-name gridftp storage module name\fR
.RS 4
Set the backend storage module to use for the source in a GridFTP transfer
.RE
.PP
\fB\-smp | \-src\-module\-parameters gridftp storage module parameters\fR
.RS 4
Set the backend storage module arguments to use for the source in a GridFTP transfer
.RE
.PP
\fB\-dmn | \-dst\-module\-name gridftp storage module name\fR
.RS 4
Set the backend storage module to use for the destination in a GridFTP transfer
.RE
.PP
\fB\-dmp | \-dst\-module\-parameters gridftp storage module parameters\fR
.RS 4
Set the backend storage module arguments to use for the destination in a GridFTP transfer
.RE
.PP
\fB\-aa | \-authz\-assert authorization assertion file\fR
.RS 4
Use the assertions in this file to authorize the access with both source and dest servers
.RE
.PP
\fB\-saa | \-src\-authz\-assert authorization assertion file\fR
.RS 4
Use the assertions in this file to authorize the access with source server
.RE
.PP
\fB\-daa | \-dst\-authz\-assert authorization assertion file\fR
.RS 4
Use the assertions in this file to authorize the access with dest server
.RE
.PP
\fB\-cache\-aa | \-cache\-authz\-assert\fR
.RS 4
Cache the authz assertion for subsequent transfers
.RE
.PP
\fB\-cache\-saa | \-cache\-src\-authz\-assert\fR
.RS 4
Cache the src authz assertion for subsequent transfers
.RE
.PP
\fB\-cache\-daa | \-cache\-dst\-authz\-assert\fR
.RS 4
Cache the dst authz assertion for subsequent transfers
.RE
.PP
\fB\-pipeline | \-pp\fR
.RS 4
Enable pipelining support for multi\-file ftp transfers\&. Currently third\-party transfers benefit from this\&. *EXPERIMENTAL*
.RE
.PP
\fB\-concurrency | \-cc\fR
.RS 4
Number of concurrent ftp connections to use for multiple transfers\&.
.RE
.PP
\fB\-nl\-bottleneck | \-nlb\fR
.RS 4
Use NetLogger to estimate speeds of disk and network read/write system calls, and attempt to determine the bottleneck component
.RE
.PP
\fB\-src\-pipe | \-SP command line\fR
.RS 4
Set the source end of a remote transfer to use piped in input with the given command line\&. Do not use with \-fsstack
.RE
.PP
\fB\-dst\-pipe | \-DP command line\fR
.RS 4
Set the destination end of a remote transfer to write data to then standard input of the program run via the given command line\&. Do not use with \-fsstack
.RE
.PP
\fB\-pipe command line\fR
.RS 4
Sets both \-src\-pipe and \-dst\-pipe to the same thing\&.
.RE
.PP
\fB\-dcstack | \-data\-channel\-stack\fR
.RS 4
Set the XIO driver stack for the network on both the source and the destination\&. Both must be GridFTP servers\&.
.RE
.PP
\fB\-fsstack | \-file\-system\-stack\fR
.RS 4
Set the XIO driver stack for the disk on both the source and the destination\&. Both must be GridFTP servers\&.
.RE
.PP
\fB\-src\-dcstack | \-source\-data\-channel\-stack\fR
.RS 4
Set the XIO driver stack for the network on the source GridFTP server\&.
.RE
.PP
\fB\-src\-fsstack | \-source\-file\-system\-stack\&.\fR
.RS 4
Set the XIO driver stack for the disk on the source GridFTP server\&.
.RE
.PP
\fB\-dst\-dcstack | \-dest\-data\-channel\-stack\fR
.RS 4
Set the XIO driver stack for the network on the destination GridFTP server\&.
.RE
.PP
\fB\-dst\-fsstack | \-dest\-file\-system\-stack\fR
.RS 4
Set the XIO driver stack for the disk on the destination GridFTP server\&.
.RE
.PP
\fB\-cred path to credentials or proxy file\fR
.RS 4
Set the credentials to use for both ftp connections\&.
.RE
.PP
\fB\-src\-cred | \-sc path to credentials or proxy file\fR
.RS 4
Set the credentials to use for source ftp connections\&.
.RE
.PP
\fB\-dst\-cred | \-dc path to credentials or proxy file\fR
.RS 4
Set the credentials to use for destination ftp connections\&.
.RE
.PP
\fB\-af filename | \-alias\-file filename\fR
.RS 4
File with mapping of logical host aliases to lists of physical hosts\&. When used with multiple conncurrent connections, each connection uses the next host in the list\&. Each line should either be an alias, noted with the @ symbol, or a hostname[:port]\&. Currently, only the aliases @source and @destination are valid, and they are used for every source or destination url\&.
.RE
.PP
\fB\-sync\fR
.RS 4
Only transfer files where the destination does not exist or differs from the source\&. \-sync\-level controls how to determine if files differ\&.
.RE
.PP
\fB\-sync\-level number\fR
.RS 4
Choose critera for determining if files differ when performing a sync transfer\&. Level 0 will only transfer if the destination does not exist\&. Level 1 will transfer if the size of the destination does not match the size of the source\&. Level 2 will transfer if the timestamp of the destination is older than the timestamp of the source\&. Level 3 will perform a checksum of the source and destination and transfer if the checksums do not match\&. The default sync level is 2\&.
.RE
.SH "AUTHOR"
.br
.br
The Globus Alliance, http://www\&.globus\&.org/
.RS 4
Author.
.RE
.SH "COPYRIGHT"
.br
Copyright \(co 1999-2010 University of Chicago
.br