File Set Operations
These are the operations that you can perform on a file set.
ADD
The ADD command creates a new file set. It uploads files from sourceDirectory, which become the DSC files of the new file set, and names the file set targetFileSetName. If you use the name of a file set that already exists, an error message is displayed.
Syntax
DSC FILESET ADD sourceDirectorytargetFileSetName [/service: headnode] [/public] /compression:compressionScheme
Remarks
The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.
The /public option sets the NTFS permissions on the file set. All users in the Authenticated Users group have Read permissions, and the creator/owner has Full Control permissions. By default, new file sets are created with Full Control permissions for the owner/creator and administrators of the file set, but no Read permission for other users.
The /compression option sets compression scheme that was used to compress the files prior to adding them into the fileset. Valid values for the compression flag are Gzip and None. Setting compression to Gzip does not compress the files being added to DSC, it simply flags these files as already compressed.
Examples
DSC FILESET ADD mySourceDirectory myTargetFileSet /compression:None
This command uploads files from mySourceDirectory, uses those files as the components of a file set, and creates a file set named myTargetFileSet in the DSC.
READ
The READ command downloads files from the file set that is specified as targetFileSetName, to the directory specified as targetDirectory. Use this command to extract information from the cluster, and to write it to a network file share.
Syntax
DSC FILESET READ targetFileSetNametargetDirectory [/service: headnode]
Remarks
The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.
Examples
DSC FILESET READ MyFileSet MyNetworkDirectory
This command downloads MyFileSet from the DSC to the file share named MyNetworkDirectory.
LIST
The LIST command lists the file sets that are in the DSC.
Syntax
DSC FILESET LIST [/prefix: fileSetNamePrefix] [/service: headnode]
Remarks
Use the /prefix option to list only those file sets whose names are prefixed with fileSetNamePrefix.
The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.
Examples
DSC FILESET LIST
This command lists all the file sets that are in the DSC.
REMOVE
The REMOVE command deletes the file set specified by fileSetName from the DSC. All of the DSC files in the named file set will also be deleted.
Syntax
DSC FILESET REMOVE fileSetName [/service: headnode]
Remarks
The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.
When a file set is removed, it is marked as "expired" and does not appear in the file sets that are listed by the DSC FILESET LIST command. The DSC removes expired file sets every ten minutes. After the files are removed, the DSC considers the space to be available for new data although the files still exist on the HpcData shares. The next time the disk cleanup task runs, it removes any unused files from those shares. The frequency of disk cleanup is specified by setting the DiskCleanupInterval parameter, which has a default value of 3600 seconds.
In other words, a REMOVE operation does not free disk storage immediately. You can perform garbage collection manually in order to release space immediately by calling the HpcDscNodeAdmin command with the /g option. Otherwise, you must wait approximately 10 minutes, until the file is automatically deleted at the end of the next garbage collection interval.
Examples
DSC FILESET REMOVE MyFileSet
This command removes the file set named MyFileSet from the DSC.
VIEW
The VIEW command displays detailed information about the file set that is specified by fileSetName.
Syntax
DSC FILESET VIEW fileSetName [/files] [/service: headnode]
Remarks
Use the /files option to list the files that are in the file set. Replicated files are only listed once.
DSC FILESET VIEW products-partitioned /files /service:MyUser-hn
Here is an example of the output.
FileSet products-partitioned:
Sealed = True
File Count = 3
Total File Size = 2978
Compression Scheme = None
Creation Time = 4/13/2011 10:00:02 PM
Lease Time = None
Replication Factor = 3
Permissions:
BUILTIN\Administrators ReadOrModify
REDMOND\myuse ReadOrModify Owner
Files:
000000000000008C.data
000000000000008D.data
000000000000008B.data
The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.
Examples
DSC FILESET VIEW MyFileSet
This command lists information about the file set named MyFileSet.
SETPERMISSIONS
The SETPERMISSIONS command sets the permissions for the user identified by domain\username for the file set that is specified by fileSetName. The user can be assigned one of three access levels, where none denies all access to the specified user, read provides read-only access, and readormodify provides full access, which includes the ability to write and delete data.
Syntax
DSC FILESET SETPERMISSIONS fileSetNamedomain\username none|read|readormodify [/service: headnode]
Remarks
File set or domain\username parameters that contain white space should be within quotation marks.
The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.
Examples
DSC FILESET MyFileSet MyDomain\MyName read
This command gives the user read permissions on the file set.