Sbload

From SRB

(Difference between revisions)
Revision as of 01:12, 11 March 2006
Lucas (Talk | contribs)

← Previous diff		 Current revision
Wayne (Talk | contribs)

Line 1: Line 1:
== NAME == == NAME ==
- +Sbload - imports in bulk one or more local files and/or directories into SRB space.
-Sbload - imports in bulk one or more local files and/or directories into SRB space.+
== SYNOPSIS == == SYNOPSIS ==
- +Sbload [-k] [-c container] [-S resourceName] [-s maxContSzInMbytes] localFile|localDirectory ... targetCollection
-'''Sbload [-k] [-c''' ''container]'' ['''-S''' ''resourceName''] ['''-s''' ''maxContSzInMbytes''] ''localFile''<nowiki>|</nowiki>''localDirectory'' ... targetCollection <br />+
== DESCRIPTION == == DESCRIPTION ==
 +Sbload is similar to Sput, which reads one or more local files and|or directories and writes them as object(s) in SRB space. It is designed to greatly improve the efficiency of ingesting a large number of small files by
 +1) registering up to several hundreds files with MCAT with a single call instead of the normal mode of registering one file at a time.
 +2) use of separate threads for registration and data transfer.
-'''Sbload ''' is similar to Sput, which reads one or more local files and|or directories and writes them as object(s) in SRB space. It is designed to greatly improve the efficiency of ingesting a large number of small files by <br /> 1) registering up to several hundreds files with MCAT with a single call instead of the normal mode of registering one file at a time. <br /> 2) use of separate threads for registration and data transfer.+If the -c option is specified, the Sbload command will put all data into the specified container which must be created beforehand. If the
 +-c option is not used, all data will be ingested as normal files.
-If the -c option is specified, the Sbload command will put all data into the specified container which must be created beforehand. If the -c option is not used, all data will be ingested as normal files.+When the container is full, Sbload automatically renames the full con- tainer "myContainer" to "myContainer.NNNN" where NNNN is a random inte- ger number. It then creates an empty container with the original con- tainer name "myContainer" to receive more data. The optional -S option is used to specify the resource for the new container. If this option is not used, the resource associated with the original container will be used. Similarly, the optional -s option is used to specify the con- tainer size limit in MBytes. If this option is not used, the limit associated with the original container will be used.
-When the container is full, Sbload automatically renames the full container "myContainer" to "myContainer.NNNN" where NNNN is a random integer number. It then creates an empty container with the original container name "myContainer" to receive more data. The optional -S option is used to specify the resource for the new container. If this option is not used, the resource associated with the original container will be used. Similarly, the optional -s option is used to specify the container size limit in MBytes. If this option is not used, the limit associated with the original container will be used.+The localFile and|or localDirectory can be a path name in the local file hierarchy. The user should have at least 'read' access permission for them. These inputs can have wildcards.
-The ''localFile'' and|or ''localDirectory'' can be a path name in the local file hierarchy. The user should have at least 'read' access permission for them. These inputs can have wildcards.+The targetCollection is the target collection path under which the new objects will be created. The path can be relative or absolute. Also, special path name such as "." and ".." are valid.
-The ''targetCollection'' is the target collection path under which the new objects will be created. The path can be relative or absolute. Also, special path name such as "." and ".." are valid. 
== OPTIONS == == OPTIONS ==
 +;-c
 +: container is the container where the target object will be stored.
-; '''-c '''+;-S
-: ''container '' is the container where the target object will be stored.+: resourceName is the resource for the new container.
-; '''-S '''+
-: ''resourceName '' is the resource for the new container.+
-; '''-s '''+
-: ''maxContSzInMbytes '' is the container size limit in MBytes.+
-; '''-k '''+
-: Client computes simple checksum (sum -s, --sysv) of the local file and registers with MCAT. No verification is done on the server side.+
-== SEE ALSO ==+;-s
 +: maxContSzInMbytes is the container size limit in MBytes.
-'''[http://www.sdsc.edu/srb/srbcommands/Sbunload.1.html Sbunload]'''(1), '''[http://www.sdsc.edu/srb/srbcommands/Sput.1.html Sput]'''(1), '''[http://www.sdsc.edu/srb/srbcommands/Sget.1.html Sget]'''(1), '''[http://www.sdsc.edu/srb/srbcommands/Smkdir.1.html Smkdir]'''(1)+;-k
 +: Client computes simple checksum (sum -s, --sysv) of the local file and registers with MCAT. No verification is done on the server side.
-----+== SEE ALSO ==
- +[[Sbunload]], [[Sput]], [[Sget]], [[Smkdir]]
-== Index ==+
- +
-; [http://www.sdsc.edu/srb/srbcommands/Sbload.1.html#lbAB NAME]+
-:+
-; [http://www.sdsc.edu/srb/srbcommands/Sbload.1.html#lbAC SYNOPSIS]+
-:+
-; [http://www.sdsc.edu/srb/srbcommands/Sbload.1.html#lbAD DESCRIPTION]+
-:+
-; [http://www.sdsc.edu/srb/srbcommands/Sbload.1.html#lbAE OPTIONS]+
-:+
-; [http://www.sdsc.edu/srb/srbcommands/Sbload.1.html#lbAF SEE ALSO]+
-:+
- +
-----+
- +
-This document was created by [http://www.sdsc.edu/srb/srbcommands.html man2html], using the manual pages.<br /> Time: 16:14:51 GMT, October 31, 2005+

Current revision

Contents

[edit]

NAME

Sbload - imports in bulk one or more local files and/or directories into SRB space.

[edit]

SYNOPSIS

Sbload [-k] [-c container] [-S resourceName] [-s maxContSzInMbytes] localFile|localDirectory ... targetCollection

[edit]

DESCRIPTION

Sbload is similar to Sput, which reads one or more local files and|or directories and writes them as object(s) in SRB space. It is designed to greatly improve the efficiency of ingesting a large number of small files by 1) registering up to several hundreds files with MCAT with a single call instead of the normal mode of registering one file at a time. 2) use of separate threads for registration and data transfer.

If the -c option is specified, the Sbload command will put all data into the specified container which must be created beforehand. If the -c option is not used, all data will be ingested as normal files.

When the container is full, Sbload automatically renames the full con- tainer "myContainer" to "myContainer.NNNN" where NNNN is a random inte- ger number. It then creates an empty container with the original con- tainer name "myContainer" to receive more data. The optional -S option is used to specify the resource for the new container. If this option is not used, the resource associated with the original container will be used. Similarly, the optional -s option is used to specify the con- tainer size limit in MBytes. If this option is not used, the limit associated with the original container will be used.

The localFile and|or localDirectory can be a path name in the local file hierarchy. The user should have at least 'read' access permission for them. These inputs can have wildcards.

The targetCollection is the target collection path under which the new objects will be created. The path can be relative or absolute. Also, special path name such as "." and ".." are valid.


[edit]

OPTIONS

-c
container is the container where the target object will be stored.
-S
resourceName is the resource for the new container.
-s
maxContSzInMbytes is the container size limit in MBytes.
-k
Client computes simple checksum (sum -s, --sysv) of the local file and registers with MCAT. No verification is done on the server side.
[edit]

SEE ALSO

Sbunload, Sput, Sget, Smkdir

Retrieved from "http://www.sdsc.edu/srb/index.php/Sbload"