Sbload - imports in bulk one or more local files and/or directories into SRB space.
Sbload [-k] [-c container] [-S resourceName] [-s maxContSzInMbytes] localFile|localDirectory ... targetCollection
Sbload is similar to Sput, which reads one or more local files and|or directories and writes them as object(s) in SRB space. It is designed to greatly improve the efficiency of ingesting a large number of small files by 1) registering up to several hundreds files with MCAT with a single call instead of the normal mode of registering one file at a time. 2) use of separate threads for registration and data transfer.
If the -c option is specified, the Sbload command will put all data into the specified container which must be created beforehand. If the -c option is not used, all data will be ingested as normal files.
When the container is full, Sbload automatically renames the full con- tainer "myContainer" to "myContainer.NNNN" where NNNN is a random inte- ger number. It then creates an empty container with the original con- tainer name "myContainer" to receive more data. The optional -S option is used to specify the resource for the new container. If this option is not used, the resource associated with the original container will be used. Similarly, the optional -s option is used to specify the con- tainer size limit in MBytes. If this option is not used, the limit associated with the original container will be used.
The localFile and|or localDirectory can be a path name in the local file hierarchy. The user should have at least 'read' access permission for them. These inputs can have wildcards.
The targetCollection is the target collection path under which the new objects will be created. The path can be relative or absolute. Also, special path name such as "." and ".." are valid.
- container is the container where the target object will be stored.
- resourceName is the resource for the new container.
- maxContSzInMbytes is the container size limit in MBytes.
- Client computes simple checksum (sum -s, --sysv) of the local file and registers with MCAT. No verification is done on the server side.