[hadoop]MAPREDUCE-5240 Report

1. Symptom

Early termination

FileOutputCommitter the initialized Credentials cache appears to be empty

1.1 Severity

Blocker

1.2 Was there exception thrown?

Yes

13/05/12 03:05:35 INFO mapreduce.Job: Job job_1368318686284_0013 failed with state FAILED due to: Job commit failed: java.io.IOException:

numberOfSecretKeys: 0

numberOfTokens: 0

at org.myorg.LostCreds$DestroyerFileOutputCommitter.commitJob(LostCreds.java:43)

1.2.1 Were there multiple exceptions?

No

2. How to reproduce this failure

2.0 Version

2.0.4-alpha

2.1 Configuration

1 AM

2.2 Reproduction procedure

1. Set user credentials for the job (config change)

2. Submit a MapReduce job (feature start)

2.2.1 Timing order

Yes

2.2.2 Events order externally controllable?

Yes

2.3 Can the logs tell how to reproduce the failure?

Yes

2.4 How many machines needed?

1 AM

3. Diagnosis procedure

3.1 Detailed Symptom (where you start)

When calling the FileOutputCommitter, it cannot initialize the user credentials.

3.2 Backward inference

As AM did not get user credentials from UGI during initialization, the credentials cannot be reached in job submission.

4. Root cause

During the initialization of AM, it does not get user credentials from UGI.

4.1 Category:

Semantic --- this is a case where the catastrophic failure is not caused by incorrect handling. The user got an exception, which resulted in termination. The root cause is that this exception should not be thrown in the first place. The handling was correct.