Add-AzureRmHDInsightConfigValues

Add-AzureRmHDInsightConfigValues

Updated: November 4, 2015

Applies To: Azure PowerShell 1.0

Add-AzureRmHDInsightConfigValues

Adds a Hadoop configuration value customization and/or a Hive shared library customization to a cluster configuration object.

Syntax

Parameter Set: Default
Add-AzureRmHDInsightConfigValues [-Config] <AzureHDInsightConfig> [-Core <Hashtable> ] [-HBaseEnv <Hashtable> ] [-HBaseSite <Hashtable> ] [-Hdfs <Hashtable> ] [-HiveEnv <Hashtable> ] [-HiveSite <Hashtable> ] [-MapRed <Hashtable> ] [-OozieEnv <Hashtable> ] [-OozieSite <Hashtable> ] [-Storm <Hashtable> ] [-Tez <Hashtable> ] [-WebHCat <Hashtable> ] [-Yarn <Hashtable> ] [ <CommonParameters>]




Detailed Description

The Add-AzureRmHDInsightConfigValues cmdlet adds a Hadoop configuration value customization, such as core-site.xml or hive-site.xml, and/or a Hive shared library customization to the HDInsight configuration object created by the New-AzureRmHDInsightClusterConfig cmdlet.

Parameters

-Config<AzureHDInsightConfig>

Specifies the HDInsight cluster configuration object that this cmdlet modifies. This object is created by the New-AzureRmHDInsightClusterConfig cmdlet.


Aliases

none

Required?

true

Position?

1

Default Value

none

Accept Pipeline Input?

true(ByValue)

Accept Wildcard Characters?

false

-Core<Hashtable>

Specifies the Core Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-HBaseEnv<Hashtable>

Specifies the HBase Env configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-HBaseSite<Hashtable>

Specifies the HBase Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Hdfs<Hashtable>

Specifies the HDFS configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-HiveEnv<Hashtable>

Specifies the Hive Env configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-HiveSite<Hashtable>

Specifies the Hive Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-MapRed<Hashtable>

Specifies the MapRed Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-OozieEnv<Hashtable>

Specifies the Oozie Env configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-OozieSite<Hashtable>

Specifies the Oozie Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Storm<Hashtable>

Specifies the Storm Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Tez<Hashtable>

Specifies the Tez Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-WebHCat<Hashtable>

Specifies the WebHCat Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Yarn<Hashtable>

Specifies the YARN Site configurations of this HDInsight cluster.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

<CommonParameters>

This cmdlet supports the common parameters: -Debug, -ErrorAction, -ErrorVariable, -InformationAction, -InformationVariable, -OutVariable, -OutBuffer, -PipelineVariable, -Verbose, -WarningAction, and -WarningVariable. For more information, see    about_CommonParameters.

Inputs

The input type is the type of the objects that you can pipe to the cmdlet.

Outputs

The output type is the type of the objects that the cmdlet emits.

Examples

Example 1: Add a custom configuration value to the cluster configuration object

This command adds a Hadoop configuration value to the cluster named your-hadoop-001.


PS C:\> # Primary storage account info
PS C:\> $storageAccountResourceGroupName = "Group"
PS C:\> $storageAccountName = "yourstorageacct001"
PS C:\> $storageAccountKey = (Get-AzureRmStorageAccountKey -ResourceGroupName $storageAccountResourceGroupName -Name $storageAccountName)[0].value

PS C:\> $storageContainer = "container001"

# Cluster configuration info
PS C:\> $location = "East US 2"
PS C:\> $clusterResourceGroupName = "Group"
PS C:\> $clusterName = "your-hadoop-001"
PS C:\> $clusterCreds = Get-Credential

# If the cluster's resource group doesn't exist yet, run:
#   New-AzureRmResourceGroup -Name $clusterResourceGroupName -Location $location

# Config values
PS C:\> $coreConfigs = @{"io.file.buffer.size"="300000"}
PS C:\> $mapRedConfigs = @{"mapred.map.max.attempts"="2"}

# Create the cluster
PS C:\> New-AzureRmHDInsightClusterConfig `
            | Add-AzureRmHDInsightConfigValues `
                -Core $coreConfigs `
                -MapRed $mapRedConfigs `
            | New-AzureRmHDInsightCluster `
                -ClusterType Hadoop `
                -OSType Windows `
                -ClusterSizeInNodes 4 `
                -ResourceGroupName $clusterResourceGroupName `
                -ClusterName $clusterName `
                -HttpCredential $clusterCreds `
                -Location $location `
                -DefaultStorageAccountName "$storageAccountName.blob.core.windows.net" `
                -DefaultStorageAccountKey $storageAccountKey `
                -DefaultStorageContainer $storageAccountContainer

Related topics

Show:
© 2016 Microsoft