[hadoop]MAPREDUCE-5023 Report

1. Symptom

The History Server’s Job Counters API is not consistent to the Job’s Counters webpage.

1.1 Severity


1.2 Was there exception thrown?


1.2.1 Were there multiple exceptions?


1.3 Scope of the failure

single client request

2. How to reproduce this failure

2.0 Version


2.1 Configuration

History Server and Web APP

2.2 Reproduction procedure

1. start HS & web APP and start intercommunication

2.2.1 Timing order

No, timing order is not important as long as HS and web APP starts intercommunication

2.2.2 Events order externally controllable?

yes, but not applicable here

2.3 Can the logs tell how to reproduce the failure?

No log

2.4 How many machines needed?


3. Diagnosis procedure

3.1 Detailed Symptom (where you start)

The History Server's Job Counters API is not returning all the counters seen on the Job's Counters webpage

3.2 Backward inference

found History server web services missing job counters in API

4. Root cause

Missing job counters field in API

4.1 Category:

semantic (wrong understanding)

5. Fix

5.1 How?

Add job counters to the Web Services.