Export (0) Print
Expand All
Expand Minimize

Get-AzureHDInsightJobOutput

[This topic is pre-release documentation and is subject to change in future releases. Blank topics are included as placeholders.]

Get-AzureHDInsightJobOutput

Retrieves the log output for a job from the storage account associated with a specified cluster.

Syntax

Parameter Set: Default
Get-AzureHDInsightJobOutput [-Cluster] <String> [[-Subscription] <String> ] -JobId <String> [-Certificate <X509Certificate2> ] [-DownloadTaskLogs] [-Endpoint <Uri> ] [-HostedService <String> ] [-StandardError] [-StandardOutput] [-TaskLogsDirectory <String> ] [-TaskSummary] [ <CommonParameters>]




Detailed Description

Retrieves various types of job logs including Standard Output, Standard Error, Task logs, and a summary of the task logs.

This topic describes the cmdlet in the 0.8.1 version of the Microsoft Azure PowerShell module. To find out the version of the module you're using, from the Azure PowerShell console, type (get-module azure).version.

Parameters

-Certificate<X509Certificate2>

Management certificate of the Azure subscription.


Aliases

Cert

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Cluster<String>

Name of the cluster that ran the jobs that are being retrieved.


Aliases

ClusterName

Required?

true

Position?

1

Default Value

none

Accept Pipeline Input?

True (ByValue, ByPropertyName)

Accept Wildcard Characters?

false

-DownloadTaskLogs

Switch used to retrieve the task logs for the job.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Endpoint<Uri>

Specifies the endpoint to use when connecting to Azure if the endpoint is different from the default.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-HostedService<String>

The namespace of the Azure HDInsight Service if it is different from the default.


Aliases

CloudServiceName

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-JobId<String>

The Id of a specific job to be retrieved.


Aliases

Id

Required?

true

Position?

named

Default Value

none

Accept Pipeline Input?

True (ByValue, ByPropertyName)

Accept Wildcard Characters?

false

-StandardError

Switch used to retrieve the StdErr output of the job.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-StandardOutput

Switch used to retrieve the SdtOut output of the job.


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-Subscription<String>

The subscription containing the HDInsight clusters to retrieve.


Aliases

Sub

Required?

false

Position?

2

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-TaskLogsDirectory<String>

When DownloadTaksLogs switch is used this parameter specifies destination local folder where tasks logs will be downloaded.


Aliases

LogsDir

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

-TaskSummary

Switch used to retrieve task log summary


Aliases

none

Required?

false

Position?

named

Default Value

none

Accept Pipeline Input?

false

Accept Wildcard Characters?

false

<CommonParameters>

This cmdlet supports the common parameters: -Verbose, -Debug, -ErrorAction, -ErrorVariable, -OutBuffer, and -OutVariable. For more information, see  about_CommonParameters (http://go.microsoft.com/fwlink/p/?LinkID=113216).

Inputs

The input type is the type of the objects that you can pipe to the cmdlet.

Outputs

The output type is the type of the objects that the cmdlet emits.

Examples

Get Job Output

Retrieve the output from an HDInsight job.


PS C:\> $subid = (Get-AzureSubscription –Current).SubscriptionId$clustername = “yourcluster”$wordCountJob = New-AzureHDInsightMapReduceJobDefinition -JarFile "/example/apps/hadoop-examples.jar" -ClassName "wordcount" `   -Defines @{ "mapred.map.tasks"="3" } -Arguments "/example/data/gutenberg/davinci.txt", "/example/output/WordCount"$wordCountJob `    | Start-AzureHDInsightJob -Subscription $subid -Cluster $clustername `    | Wait-AzureHDInsightJob -Subscription $subid -WaitTimeoutInSeconds 3600 `    | Get-AzureHDInsightJobOutput -Cluster $clustername -StandardError

Show:
© 2014 Microsoft