File Set Operations

These are the operations that you can perform on a file set.

ADD

The ADD command creates a new file set. It uploads files from sourceDirectory, which become the DSC files of the new file set, and names the file set targetFileSetName. If you use the name of a file set that already exists, an error message is displayed.

Syntax

   DSC FILESET ADD sourceDirectorytargetFileSetName [/service: headnode] [/public] /compression:compressionScheme

Remarks

The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.

The /public option sets the NTFS permissions on the file set. All users in the Authenticated Users group have Read permissions, and the creator/owner has Full Control permissions. By default, new file sets are created with Full Control permissions for the owner/creator and administrators of the file set, but no Read permission for other users.

The /compression option sets compression scheme that was used to compress the files prior to adding them into the fileset. Valid values for the compression flag are Gzip and None. Setting compression to Gzip does not compress the files being added to DSC, it simply flags these files as already compressed.

Examples

DSC FILESET ADD mySourceDirectory myTargetFileSet /compression:None

This command uploads files from mySourceDirectory, uses those files as the components of a file set, and creates a file set named myTargetFileSet in the DSC.

READ

The READ command downloads files from the file set that is specified as targetFileSetName, to the directory specified as targetDirectory. Use this command to extract information from the cluster, and to write it to a network file share.

Syntax

DSC FILESET READ targetFileSetNametargetDirectory [/service: headnode]

Remarks

The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.

Examples

DSC FILESET READ MyFileSet MyNetworkDirectory

This command downloads MyFileSet from the DSC to the file share named MyNetworkDirectory.

LIST

The LIST command lists the file sets that are in the DSC.

Syntax

DSC FILESET LIST [/prefix: fileSetNamePrefix] [/service: headnode]

Remarks

Use the /prefix option to list only those file sets whose names are prefixed with fileSetNamePrefix.

The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.

Examples

DSC FILESET LIST

This command lists all the file sets that are in the DSC.

REMOVE

The REMOVE command deletes the file set specified by fileSetName from the DSC. All of the DSC files in the named file set will also be deleted.

Syntax

DSC FILESET REMOVE fileSetName [/service: headnode]

Remarks

The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.

When a file set is removed, it is marked as "expired" and does not appear in the file sets that are listed by the DSC FILESET LIST command. The DSC removes expired file sets every ten minutes. After the files are removed, the DSC considers the space to be available for new data although the files still exist on the HpcData shares. The next time the disk cleanup task runs, it removes any unused files from those shares. The frequency of disk cleanup is specified by setting the DiskCleanupInterval parameter, which has a default value of 3600 seconds.

In other words, a REMOVE operation does not free disk storage immediately. You can perform garbage collection manually in order to release space immediately by calling the HpcDscNodeAdmin command with the /g option. Otherwise, you must wait approximately 10 minutes, until the file is automatically deleted at the end of the next garbage collection interval.

Examples

DSC FILESET REMOVE MyFileSet

This command removes the file set named MyFileSet from the DSC.

VIEW

The VIEW command displays detailed information about the file set that is specified by fileSetName.

Syntax

DSC FILESET VIEW fileSetName [/files] [/service: headnode]

Remarks

Use the /files option to list the files that are in the file set. Replicated files are only listed once.

DSC FILESET VIEW products-partitioned /files /service:MyUser-hn

Here is an example of the output.

FileSet products-partitioned:
    Sealed = True
    File Count = 3
    Total File Size = 2978
    Compression Scheme = None
    Creation Time = 4/13/2011 10:00:02 PM
    Lease Time = None
    Replication Factor = 3
    Permissions:
        BUILTIN\Administrators          ReadOrModify
        REDMOND\myuse                    ReadOrModify    Owner
    Files:
        000000000000008C.data
        000000000000008D.data
        000000000000008B.data

The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.

Examples

DSC FILESET VIEW MyFileSet

This command lists information about the file set named MyFileSet.

SETPERMISSIONS

The SETPERMISSIONS command sets the permissions for the user identified by domain\username for the file set that is specified by fileSetName. The user can be assigned one of three access levels, where none denies all access to the specified user, read provides read-only access, and readormodify provides full access, which includes the ability to write and delete data.

Syntax

DSC FILESET SETPERMISSIONS fileSetNamedomain\username none|read|readormodify [/service: headnode]

Remarks

File set or domain\username parameters that contain white space should be within quotation marks.

The /service option specifies the name of the cluster’s head node. Use the /service option if the environment variable %CCP_SCHEDULER% is not set. This environment variable identifies the location of the head node and is read by the Dsc.exe program. Although the environment variable is set by default on the head node itself, it is not set by default on the client.

Examples

DSC FILESET MyFileSet MyDomain\MyName read

This command gives the user read permissions on the file set.



Show: