Start-AzureHDInsightJob

Article
05/15/2014

[This topic is pre-release documentation and is subject to change in future releases. Blank topics are included as placeholders.]

Start-AzureHDInsightJob

Starts an Azure HDInsight job on a specified cluster.

Syntax

Parameter Set: Start jobDetails on an HDInsight Cluster
Start-AzureHDInsightJob [-Cluster] <String> [[-Credential] <PSCredential> ] [-JobDefinition] <AzureHDInsightJobDefinition> [ <CommonParameters>]

Parameter Set: Start jobDetails on an HDInsight Cluster (with Specific Subscription Credential)
Start-AzureHDInsightJob [-Cluster] <String> [[-Subscription] <String> ] [-JobDefinition] <AzureHDInsightJobDefinition> [-Certificate <X509Certificate2> ] [-Endpoint <Uri> ] [-HostedService <String> ] [ <CommonParameters>]

Detailed Description

Starts a defined Azure HDInsight job on a specified cluster. This can be a MapReduce job, a streaming job, a Hive job, or a Pig job.

This topic describes the cmdlet in the 0.8.1 version of the Microsoft Azure PowerShell module. To find out the version of the module you're using, from the Azure PowerShell console, type (get-module azure).version.

Parameters

-Certificate<X509Certificate2>

Management certificate of the Azure subscription.

Aliases	Cert
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-Cluster<String>

The name of the Azure HDInsight cluster.

Aliases	ClusterName
Required?	true
Position?	1
Default Value	none
Accept Pipeline Input?	True (ByValue)
Accept Wildcard Characters?	false

-Credential<PSCredential>

Cluster credentials used for direct HTTP access to the cluster. Can be used instead of Subscription parameter to authenticate access to the cluster.

Aliases	Cred
Required?	false
Position?	2
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-Endpoint<Uri>

Specifies the endpoint to use when connecting to Windows Azure if the endpoint is different from the default.

Aliases	none
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-HostedService<String>

The namespace of the Azure HDInsight Service if it is different from the default.

Aliases	CloudServiceName
Required?	false
Position?	named
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

-JobDefinition<AzureHDInsightJobDefinition>

Specifies the endpoint to use when connecting to Windows Azure if the endpoint is different from the default.

Aliases	jobDetails
Required?	true
Position?	3
Default Value	none
Accept Pipeline Input?	True (ByValue)
Accept Wildcard Characters?	false

-Subscription<String>

The subscription that contains the HDInsight cluster.

Aliases	Sub
Required?	false
Position?	2
Default Value	none
Accept Pipeline Input?	false
Accept Wildcard Characters?	false

<CommonParameters>

This cmdlet supports the common parameters: -Verbose, -Debug, -ErrorAction, -ErrorVariable, -OutBuffer, and -OutVariable. For more information, see about_CommonParameters (https://go.microsoft.com/fwlink/p/?LinkID=113216).

Inputs

The input type is the type of the objects that you can pipe to the cmdlet.

Outputs

The output type is the type of the objects that the cmdlet emits.

Examples

Start an Azure HDInsight job

Start an Azure HDInsight job on a specified cluster.

PS C:\> $subid = (Get-AzureSubscription –Current).SubscriptionId$clustername = “yourcluster”$wordCountJob = New-AzureHDInsightMapReduceJobDefinition -JarFile "/example/apps/hadoop-examples.jar" -ClassName "wordcount" `   -Defines @{ "mapred.map.tasks"="3" } -Arguments "/example/data/gutenberg/davinci.txt", "/example/output/WordCount"$wordCountJob `    | Start-AzureHDInsightJob -Cluster $clustername `    | Wait-AzureHDInsightJob -Subscription $subid -WaitTimeoutInSeconds 3600 `    | Get-AzureHDInsightJobOutput -Cluster $clustername -Subscription $subid -StandardError

Start-AzureHDInsightJob