Hadoopのヒストリログとか

JobTrackerのWebUIを見るとTaskAttemptの情報なんかが出てきますが、Asakusa Frameworkなんかをつかっていると、複数のMapReduce Jobのsubmissionになるので、1アプリケーションでのjob submission横断的に見たいなあということで、自前で実行結果の情報をとる方法がないかHadoopAPIとかログとかを調べました。

欲しい情報は、カウンタとかもあるのですが、WebUIだと、TaskAttemptがどのノードでどのくらいの時間動いたかまでわかるので、その辺まではとりたいです。

結局採用したのは、TaskAttemptレベルの情報を持っていて一番扱いが楽そうなのはHistory Logで、他はいろいろ欲しい情報が足りなかったりで使えなさそうだったのですが、せっかく調べたのでいろいろ書き残しておこうと思います。調べた路線は下記の様な感じです。

・JobSubmissionProtocolの実装を使う系
・WebUIのhtmlを気合いでパースする系
Hadoopのログを気合いでパースする系

以下詳細です。
・JobSubmissionProtocolの実装を使う系
JobSubmissionProtocolはインターフェイスで、名前と違ってジョブの実行情報がとれる口があったりします。インスタンスをとるのはorg.apache.hadoop.mapred.JobClientあたりを見ておけばいいとして(それも結構めんどくさそうでしたが)、情報がとれそうな候補は、

  /**
   * Grab a handle to a job that is already known to the JobTracker.
   * @return Profile of the job, or null if not found. 
   */
  public JobProfile getJobProfile(JobID jobid) throws IOException;

  /**
   * Grab a handle to a job that is already known to the JobTracker.
   * @return Status of the job, or null if not found.
   */
  public JobStatus getJobStatus(JobID jobid) throws IOException;

  /**
   * Grab the current job counters
   */
  public Counters getJobCounters(JobID jobid) throws IOException;
    
  /**
   * Grab a bunch of info on the map tasks that make up the job
   */
  public TaskReport[] getMapTaskReports(JobID jobid) throws IOException;

  /**
   * Grab a bunch of info on the reduce tasks that make up the job
   */
  public TaskReport[] getReduceTaskReports(JobID jobid) throws IOException;

  /**
   * Grab a bunch of info on the cleanup tasks that make up the job
   */
  public TaskReport[] getCleanupTaskReports(JobID jobid) throws IOException;

  /**
   * Grab a bunch of info on the setup tasks that make up the job
   */
  public TaskReport[] getSetupTaskReports(JobID jobid) throws IOException;

このへんかなと。もらえる情報はそれぞれ、

public class JobProfile implements Writable {
~
  String user;
  final JobID jobid;
  String jobFile;
  String url;
  String name;
  String queueName;

JobStatus

public class JobStatus implements Writable, Cloneable {
~
  private JobID jobid;
  private float mapProgress;
  private float reduceProgress;
  private float cleanupProgress;
  private float setupProgress;
  private int runState;
  private long startTime;
  private String user;
  private JobPriority priority;
  private String schedulingInfo="NA";
  private String failureInfo = "NA";

Counters

~
  // Map from group name (enum class name) to map of int (enum ordinal) to
  // counter record (name-value pair).
  private Map<String,Group> counters = new HashMap<String, Group>();

  /**
   * A cache from enum values to the associated counter. Dramatically speeds up
   * typical usage.
   */
  private Map<Enum, Counter> cache = new IdentityHashMap<Enum, Counter>();

TaskReport

public class TaskReport implements Writable {
  private TaskID taskid;
  private float progress;
  private String state;
  private String[] diagnostics;
  private long startTime; 
  private long finishTime; 
  private Counters counters;
  private TIPStatus currentStatus;

という感じです。JobProfileはJob単位なので情報少なすぎ、JobStatusも同様、Countersは欲しいけどそれだけだとあれだなあという感じで、TaskReportはすごい期待したのですがこれもTask単位で、どのノードで動いたかわからないのが微妙、という感じでした。


・WebUIのhtmlを気合いでパースする系
いやでもWebUIにでてるんだからどこかに情報はあるはず、ということでWebUIのコードを見ました。詳細がでているURLをみると、taskdetailshistory.jspなどの文字があるので、その辺を調べました。

~
  String logFile = request.getParameter("logFile");
  String tipid = request.getParameter("tipid");
  if (logFile == null || tipid == null) {
    out.println("Missing job!!");
    return;
  }
  String encodedLogFileName = JobHistory.JobInfo.encodeJobHistoryFilePath(logFile);

なんかファイルのパスを渡しています。なんやねん。JobClientみても意味ないじゃん。いろいろ辿るとjobtracker.jspからパラメーターで引き回していることがわかり、結局のところログを直接見れば欲しい情報があるということがわかりました。


Hadoopのログを気合いでパースする系
ということで、ログを調べます。上のコードに"JobHistory.JobInfo.encodeJobHistoryFilePath"とあり、この辺なんかをみると、

http://www.cloudera.com/blog/2009/09/apache-hadoop-log-files-where-to-find-them-in-cdh-and-what-info-they-contain/
http://www.cloudera.com/blog/2010/11/hadoop-log-location-and-retention/

欲しいログはヒストリログと呼ばれているものだということがわかりました。

Job Statistics
These logs are created by the jobtracker. The jobtracker runtime statistics from jobs to these files. Those statistics include task attempts, time spent shuffling, input splits given to task attempts, start times of tasks attempts and other information.
The statistics files are named:
___

2) In the Job History
Key: hadoop.job.history.location
Key (H21): mapreduce.jobtracker.jobhistory.location
Default: file:///${hadoop.log.dir}/history
Retention: up to a max. of 30 days (see General Job File Notes below)
Note: The value for this key is treated as a URI, in other words you can store the job files in HDFS or on the local file system (which is the default).
3) Per Job
Key: hadoop.job.history.user.location
Key (H21): mapreduce.job.userhistorylocation
Default: /_logs/history (can be "none" to disable)
Retention: forever
You can print the info contained in those files using the hadoop command line script like so:
hadoop job -history
This implies that the above command expects the path to be on HDFS. In other words you cannot use it to display the other job files stored on the local disk for example.

この辺を参考にしました。場所はローカルファイルシステムまたはHDFSに配置させされるし、名前のJobIDが入っているので、その辺はうまいことやれば情報がとれると。中身はわさわさしてます。

Meta VERSION="1" .
Job JOBID="job_201210031529_0001" JOBNAME="PiEstimator" USER="root" SUBMIT_TIME="1349245808278" JOBCONF="hdfs://mapr01:8020/tmp/hadoop-mapred/mapred/staging/root/\.staging/job_201210031529_0001/job\.xml" VIEW_JOB="*" MODIFY_JOB="*" JOB_QUEUE="default" .
Job JOBID="job_201210031529_0001" JOB_PRIORITY="NORMAL" .
Job JOBID="job_201210031529_0001" LAUNCH_TIME="1349245808751" TOTAL_MAPS="10" TOTAL_REDUCES="1" JOB_STATUS="PREP" .
Task TASKID="task_201210031529_0001_m_000011" TASK_TYPE="SETUP" START_TIME="1349245808752" SPLITS="" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201210031529_0001_m_000011" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000011_0" START_TIME="1349245809202" TRACKER_NAME="tracker_hdslv01:localhost\.localdomain/127\.0\.0\.1:54068" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="SETUP" TASKID="task_201210031529_0001_m_000011" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000011_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245810021" HOSTNAME="/default-rack/hdslv01" STATE_STRING="setup" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52195)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(123105280)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(200)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1448828928)]}" .
Task TASKID="task_201210031529_0001_m_000011" TASK_TYPE="SETUP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245810028" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52195)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(123105280)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(200)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1448828928)]}" .
Job JOBID="job_201210031529_0001" JOB_STATUS="RUNNING" .
Task TASKID="task_201210031529_0001_r_000000" TASK_TYPE="REDUCE" START_TIME="1349245811187" SPLITS="" .
Task TASKID="task_201210031529_0001_m_000002" TASK_TYPE="MAP" START_TIME="1349245811251" SPLITS="/default-rack/hdslv01" .
Task TASKID="task_201210031529_0001_m_000000" TASK_TYPE="MAP" START_TIME="1349245812139" SPLITS="/default-rack/hdslv04" .
Task TASKID="task_201210031529_0001_m_000001" TASK_TYPE="MAP" START_TIME="1349245813030" SPLITS="/default-rack/hdslv04" .
Task TASKID="task_201210031529_0001_m_000003" TASK_TYPE="MAP" START_TIME="1349245813031" SPLITS="/default-rack/hdslv06" .
Task TASKID="task_201210031529_0001_m_000004" TASK_TYPE="MAP" START_TIME="1349245813032" SPLITS="/default-rack/hdslv04" .
Task TASKID="task_201210031529_0001_m_000005" TASK_TYPE="MAP" START_TIME="1349245813048" SPLITS="/default-rack/hdslv03" .
Task TASKID="task_201210031529_0001_m_000006" TASK_TYPE="MAP" START_TIME="1349245813050" SPLITS="/default-rack/hdslv08" .
Task TASKID="task_201210031529_0001_m_000007" TASK_TYPE="MAP" START_TIME="1349245813050" SPLITS="/default-rack/hdslv05" .
Task TASKID="task_201210031529_0001_m_000008" TASK_TYPE="MAP" START_TIME="1349245813051" SPLITS="/default-rack/hdslv04" .
Task TASKID="task_201210031529_0001_m_000009" TASK_TYPE="MAP" START_TIME="1349245813052" SPLITS="/default-rack/hdslv08" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000002" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000002_0" START_TIME="1349245811254" TRACKER_NAME="tracker_hdslv01:localhost\.localdomain/127\.0\.0\.1:54068" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000002" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000002_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245812923" HOSTNAME="/default-rack/hdslv01" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part2:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(667701248)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(500)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1469227008)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000002" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245813062" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(667701248)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(500)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1469227008)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000008" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000008_0" START_TIME="1349245813062" TRACKER_NAME="tracker_hdslv01:localhost\.localdomain/127\.0\.0\.1:54068" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000008" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000008_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245814917" HOSTNAME="/default-rack/hdslv01" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part8:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639553536)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1430839296)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000008" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245814920" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639553536)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1430839296)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000009" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000009_0" START_TIME="1349245813063" TRACKER_NAME="tracker_hdslv01:localhost\.localdomain/127\.0\.0\.1:54068" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000009" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000009_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245814931" HOSTNAME="/default-rack/hdslv01" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part9:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(663744512)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(550)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1431617536)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000009" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245814935" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(663744512)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(550)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1431617536)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000006" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000006_0" START_TIME="1349245813059" TRACKER_NAME="tracker_hdslv01:localhost\.localdomain/127\.0\.0\.1:54068" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000006" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000006_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245814994" HOSTNAME="/default-rack/hdslv01" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part6:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639393792)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1386078208)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000006" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245814998" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639393792)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1386078208)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000007" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000007_0" START_TIME="1349245813061" TRACKER_NAME="tracker_hdslv01:localhost\.localdomain/127\.0\.0\.1:54068" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000007" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000007_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245815217" HOSTNAME="/default-rack/hdslv01" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part7:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639725568)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1426575360)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000007" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245815220" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639725568)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1426575360)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000001" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000001_0" START_TIME="1349245813516" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000001" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000001_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245815853" HOSTNAME="/default-rack/hdslv02" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part1:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639279104)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1430925312)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000001" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245815857" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52259)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(639279104)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(290)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1430925312)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000003" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000003_0" START_TIME="1349245813518" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000003" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000003_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816049" HOSTNAME="/default-rack/hdslv02" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part3:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(638373888)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(280)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1452851200)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000003" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816053" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(638373888)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(280)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1452851200)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000000" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000000_0" START_TIME="1349245813515" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000000" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000000_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816059" HOSTNAME="/default-rack/hdslv02" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part0:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(667324416)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(280)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1470246912)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000000" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816063" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(667324416)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(280)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1470246912)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000004" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000004_0" START_TIME="1349245813520" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000004" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000004_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816253" HOSTNAME="/default-rack/hdslv02" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part4:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(664510464)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(310)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1457082368)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000004" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816257" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(664510464)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(310)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1457082368)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000005" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000005_0" START_TIME="1349245813523" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="MAP" TASKID="task_201210031529_0001_m_000005" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000005_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816372" HOSTNAME="/default-rack/hdslv02" STATE_STRING="hdfs://mapr01:8020/user/root/PiEstimator_TMP_3_141592654/in/part5:0+118" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(640319488)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(270)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1453215744)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
Task TASKID="task_201210031529_0001_m_000005" TASK_TYPE="MAP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245816375" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(236)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52260)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(1)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(640319488)][(SPILLED_RECORDS)(Spilled Records)(2)][(MAP_OUTPUT_BYTES)(Map output bytes)(18)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(270)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1453215744)][(MAP_INPUT_BYTES)(Map input bytes)(24)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(MAP_OUTPUT_RECORDS)(Map output records)(2)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(118)]}" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201210031529_0001_r_000000" TASK_ATTEMPT_ID="attempt_201210031529_0001_r_000000_0" START_TIME="1349245811636" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
ReduceAttempt TASK_TYPE="REDUCE" TASKID="task_201210031529_0001_r_000000" TASK_ATTEMPT_ID="attempt_201210031529_0001_r_000000_0" TASK_STATUS="SUCCESS" SHUFFLE_FINISHED="1349245819126" SORT_FINISHED="1349245819133" FINISH_TIME="1349245821267" HOSTNAME="/default-rack/hdslv02" STATE_STRING="reduce > reduce" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52122)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(257)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(2)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(339)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(199237632)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(1170)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(2612346880)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(20)]}" .
Task TASKID="task_201210031529_0001_r_000000" TASK_TYPE="REDUCE" TASK_STATUS="SUCCESS" FINISH_TIME="1349245821270" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52122)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(257)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(2)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(339)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(199237632)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(1170)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(2612346880)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(20)]}" .
Task TASKID="task_201210031529_0001_m_000010" TASK_TYPE="CLEANUP" START_TIME="1349245821276" SPLITS="" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201210031529_0001_m_000010" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000010_0" START_TIME="1349245821279" TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247" HTTP_PORT="50060" .
MapAttempt TASK_TYPE="CLEANUP" TASKID="task_201210031529_0001_m_000010" TASK_ATTEMPT_ID="attempt_201210031529_0001_m_000010_0" TASK_STATUS="SUCCESS" FINISH_TIME="1349245822252" HOSTNAME="/default-rack/hdslv02" STATE_STRING="cleanup" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52195)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(125140992)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(300)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1514856448)]}" .
Task TASKID="task_201210031529_0001_m_000010" TASK_TYPE="CLEANUP" TASK_STATUS="SUCCESS" FINISH_TIME="1349245822255" COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52195)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(125140992)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(300)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1514856448)]}" .
Job JOBID="job_201210031529_0001" FINISH_TIME="1349245822256" JOB_STATUS="SUCCESS" FINISHED_MAPS="10" FINISHED_REDUCES="1" FAILED_MAPS="0" FAILED_REDUCES="0" MAP_COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(2360)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(522599)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(MAP_INPUT_RECORDS)(Map input records)(10)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(6499926016)][(SPILLED_RECORDS)(Spilled Records)(20)][(MAP_OUTPUT_BYTES)(Map output bytes)(180)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(10290462720)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(3350)][(MAP_INPUT_BYTES)(Map input bytes)(240)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(14408658944)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(1180)][(MAP_OUTPUT_RECORDS)(Map output records)(20)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)]}" REDUCE_COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(52122)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(257)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(2)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(339)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(199237632)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(0)][(SPILLED_RECORDS)(Spilled Records)(0)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(1170)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(2612346880)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(REDUCE_INPUT_RECORDS)(Reduce input records)(20)]}" COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters )[(SLOTS_MILLIS_MAPS)(SLOTS_MILLIS_MAPS)(24269)][(TOTAL_LAUNCHED_REDUCES)(Launched reduce tasks)(1)][(FALLOW_SLOTS_MILLIS_REDUCES)(Total time spent by all reduces waiting after reserving slots \\(ms\\))(0)][(RACK_LOCAL_MAPS)(Rack-local map tasks)(9)][(FALLOW_SLOTS_MILLIS_MAPS)(Total time spent by all maps waiting after reserving slots \\(ms\\))(0)][(TOTAL_LAUNCHED_MAPS)(Launched map tasks)(10)][(DATA_LOCAL_MAPS)(Data-local map tasks)(1)][(SLOTS_MILLIS_REDUCES)(SLOTS_MILLIS_REDUCES)(9631)]}{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(2360)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(574721)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(257)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(10)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(339)][(SPILLED_RECORDS)(Spilled Records)(20)][(MAP_OUTPUT_BYTES)(Map output bytes)(180)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(4520)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(11319508992)][(MAP_INPUT_BYTES)(Map input bytes)(240)][(COMBINE_INPUT_RECORDS)(Combine input records)(0)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(1180)][(REDUCE_INPUT_RECORDS)(Reduce input records)(20)][(REDUCE_INPUT_GROUPS)(Reduce input groups)(2)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(0)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(6699163648)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(0)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(17021005824)][(MAP_OUTPUT_RECORDS)(Map output records)(20)]}" .

わっさーっと。パースは空気を読みつつ気合いですね。

このログは、hadoop job -history で食わせて情報を出したりとか(気合い系)、http://hadoop.apache.org/docs/mapreduce/current/vaidya.html この辺のcontribで分析できたりとか(新しめのバージョンだとJTのWebUIと統合されてる)、というようなものなので、まあ知っていると便利かもです。

内容を見ると、行頭にログの種類っぽいものがあって、Meta、Job、Task、MapAttempt、ReduceAttemptとあります。だいたいジョブの実行のところでみるような内容なので、書いてあるところは想像すればわかるかなと思います。それぞれ、新しい状態になるとログが一行増える的なないようっぽいです。持っている情報がわかりやすいように整形すると、それぞれ下記の様な感じになります。

Meta VERSION="1" .

Job
JOBID="job_201210031529_0007"
JOBNAME="DirectIOCompositeDistributedExperimentExecutionBatch\.DirectIOExperimentExecutionMainJobFlow\.stage0001"
USER="marblejenka"
SUBMIT_TIME="1349325836881"
JOBCONF="hdfs://mapr01:8020/tmp/hadoop-mapred/mapred/staging/marblejenka/\.staging/job_201210031529_0007/job\.xml"
VIEW_JOB="*"
MODIFY_JOB="*"
JOB_QUEUE="default" .

Job
JOBID="job_201210031529_0007"
JOB_PRIORITY="NORMAL" .

Job
JOBID="job_201210031529_0007"
LAUNCH_TIME="1349325837195"
TOTAL_MAPS="144"
TOTAL_REDUCES="42"
JOB_STATUS="PREP" .

Job
JOBID="job_201210031529_0007"
JOB_STATUS="RUNNING" .

Job
JOBID="job_201210031529_0007"
FINISH_TIME="1349328457835"
JOB_STATUS="SUCCESS"
FINISHED_MAPS="144"
FINISHED_REDUCES="42"
FAILED_MAPS="0"
FAILED_REDUCES="0"
MAP_COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(8907724532)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(246435226164)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(16865832635)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(39801890)][(MAP_INPUT_RECORDS)(Map input records)(30000000)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(143548780544)][(SPILLED_RECORDS)(Spilled Records)(39801890)][(MAP_OUTPUT_BYTES)(Map output bytes)(165299860437)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(154378829824)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(4796440)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(212579356672)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(1395406)][(MAP_OUTPUT_RECORDS)(Map output records)(69899745)][(COMBINE_INPUT_RECORDS)(Combine input records)(89799490)]}"
REDUCE_COUNTERS="{(com\.asakusafw\.stage\.output\.RecordCounters)(com\.asakusafw\.stage\.output\.RecordCounters)[(result50)(result50)(9899745)][(result40)(result40)(10)][(result20)(result20)(10)][(result0)(result0)(10)][(result30)(result30)(10)][(result10)(result10)(10)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(7075962610)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(7079015055)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(8263652418)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(10000050)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(16625806)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(8427558064)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(80554999808)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(9899795)][(SPILLED_RECORDS)(Spilled Records)(16625806)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(78389313536)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(784840)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(109396811776)][(COMBINE_INPUT_RECORDS)(Combine input records)(16627481)][(REDUCE_INPUT_RECORDS)(Reduce input records)(19900470)]}"
COUNTERS="{(org\.apache\.hadoop\.mapred\.JobInProgress$Counter)(Job Counters )[(SLOTS_MILLIS_MAPS)(SLOTS_MILLIS_MAPS)(24286252)][(TOTAL_LAUNCHED_REDUCES)(Launched reduce tasks)(42)][(FALLOW_SLOTS_MILLIS_REDUCES)(Total time spent by all reduces waiting after reserving slots \\(ms\\))(0)][(RACK_LOCAL_MAPS)(Rack-local map tasks)(95)][(FALLOW_SLOTS_MILLIS_MAPS)(Total time spent by all maps waiting after reserving slots \\(ms\\))(0)][(TOTAL_LAUNCHED_MAPS)(Launched map tasks)(144)][(DATA_LOCAL_MAPS)(Data-local map tasks)(49)][(SLOTS_MILLIS_REDUCES)(SLOTS_MILLIS_REDUCES)(29201550)]}{(com\.asakusafw\.stage\.output\.RecordCounters)(com\.asakusafw\.stage\.output\.RecordCounters)[(result50)(result50)(9899745)][(result40)(result40)(10)][(result20)(result20)(10)][(result0)(result0)(10)][(result30)(result30)(10)][(result10)(result10)(10)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(15983687142)][(HDFS_BYTES_READ)(HDFS_BYTES_READ)(246435226164)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(23944847690)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(8263652418)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(MAP_INPUT_RECORDS)(Map input records)(30000000)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(8427558064)][(SPILLED_RECORDS)(Spilled Records)(56427696)][(MAP_OUTPUT_BYTES)(Map output bytes)(165299860437)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(5581280)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(232768143360)][(COMBINE_INPUT_RECORDS)(Combine input records)(106426971)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(1395406)][(REDUCE_INPUT_RECORDS)(Reduce input records)(19900470)][(REDUCE_INPUT_GROUPS)(Reduce input groups)(10000050)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(56427696)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(224103780352)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(9899795)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(321976168448)][(MAP_OUTPUT_RECORDS)(Map output records)(69899745)]}" .

Task
TASKID="task_201210031529_0007_m_000145"
TASK_TYPE="SETUP"
START_TIME="1349325837198"
SPLITS="" .

Task
TASKID="task_201210031529_0007_m_000145"
TASK_TYPE="SETUP"
TASK_STATUS="SUCCESS"
FINISH_TIME="1349325838368"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(72803)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(114061312)][(SPILLED_RECORDS)(Spilled Records)(0)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(130)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1029046272)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1436717056)]}" .

Task
TASKID="task_201210031529_0007_m_000001"
TASK_TYPE="MAP"
START_TIME="1349325840236"
SPLITS="/default-rack/hdslv01" .

Task TASKID="task_201210031529_0007_m_000010" TASK_TYPE="MAP" START_TIME="1349325840236" SPLITS="/default-rack/hdslv01" .
Task TASKID="task_201210031529_0007_m_000012" TASK_TYPE="MAP" START_TIME="1349325840237" SPLITS="/default-rack/hdslv01" .
Task TASKID="task_201210031529_0007_m_000013" TASK_TYPE="MAP" START_TIME="1349325840237" SPLITS="/default-rack/hdslv01" .
Task TASKID="task_201210031529_0007_m_000021" TASK_TYPE="MAP" START_TIME="1349325840238" SPLITS="/default-rack/hdslv01" .
Task TASKID="task_201210031529_0007_m_000007" TASK_TYPE="MAP" START_TIME="1349325840517" SPLITS="/default-rack/hdslv02" .
Task TASKID="task_201210031529_0007_m_000015" TASK_TYPE="MAP" START_TIME="1349325840518" SPLITS="/default-rack/hdslv02" .
Task TASKID="task_201210031529_0007_m_000016" TASK_TYPE="MAP" START_TIME="1349325840518" SPLITS="/default-rack/hdslv02" .
Task TASKID="task_201210031529_0007_m_000036" TASK_TYPE="MAP" START_TIME="1349325840519" SPLITS="/default-rack/hdslv02" .
Task TASKID="task_201210031529_0007_m_000039" TASK_TYPE="MAP" START_TIME="1349325840519" SPLITS="/default-rack/hdslv02" .
Task TASKID="task_201210031529_0007_m_000047" TASK_TYPE="MAP" START_TIME="1349325840520" SPLITS="/default-rack/hdslv02" .
Task TASKID="task_201210031529_0007_m_000022" TASK_TYPE="MAP" START_TIME="1349325842818" SPLITS="/default-rack/hdslv01" .
Task TASKID="task_201210031529_0007_r_000000" TASK_TYPE="REDUCE" START_TIME="1349325846873" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000001" TASK_TYPE="REDUCE" START_TIME="1349325846926" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000002" TASK_TYPE="REDUCE" START_TIME="1349325846973" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000003" TASK_TYPE="REDUCE" START_TIME="1349325847277" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000004" TASK_TYPE="REDUCE" START_TIME="1349325847298" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000005" TASK_TYPE="REDUCE" START_TIME="1349325847310" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000006" TASK_TYPE="REDUCE" START_TIME="1349325847314" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000007" TASK_TYPE="REDUCE" START_TIME="1349325847678" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000008" TASK_TYPE="REDUCE" START_TIME="1349325847702" SPLITS="" .
Task TASKID="task_201210031529_0007_r_000009" TASK_TYPE="REDUCE" START_TIME="1349325847800" SPLITS="" .

Task
TASKID="task_201210031529_0007_m_000007"
TASK_TYPE="MAP"
TASK_STATUS="SUCCESS"
FINISH_TIME="1349325955624"
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(2030398046)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(75542)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(50)][(MAP_INPUT_RECORDS)(Map input records)(247192)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(968900608)][(SPILLED_RECORDS)(Spilled Records)(50)][(MAP_OUTPUT_BYTES)(Map output bytes)(28427080)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(37650)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1070858240)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1434906624)][(COMBINE_INPUT_RECORDS)(Combine input records)(1235960)][(MAP_OUTPUT_RECORDS)(Map output records)(1235960)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(11276)]}" .

Task
TASKID="task_201210031529_0007_r_000007"
TASK_TYPE="REDUCE"
TASK_STATUS="SUCCESS"
FINISH_TIME="1349327950186"
COUNTERS="{(com\.asakusafw\.stage\.output\.RecordCounters)(com\.asakusafw\.stage\.output\.RecordCounters)[(result50)(result50)(235652)][(result40)(result40)(0)][(result0)(result0)(0)][(result20)(result20)(0)][(result30)(result30)(0)][(result10)(result10)(0)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(168429113)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(168501835)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(196706757)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(238095)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(396067)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(200631847)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(1191866368)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(235652)][(SPILLED_RECORDS)(Spilled Records)(396067)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(20700)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1565917184)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(2646269952)][(COMBINE_INPUT_RECORDS)(Combine input records)(396067)][(REDUCE_INPUT_RECORDS)(Reduce input records)(473747)]}" .

MapAttempt
TASK_TYPE="MAP"
TASKID="task_201210031529_0007_m_000007"
TASK_ATTEMPT_ID="attempt_201210031529_0007_m_000007_0"
START_TIME="1349325840522"
TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247"
HTTP_PORT="50060" .

MapAttempt
TASK_TYPE="MAP"
TASKID="task_201210031529_0007_m_000007"
TASK_ATTEMPT_ID="attempt_201210031529_0007_m_000007_0"
TASK_STATUS="SUCCESS"
FINISH_TIME="1349325955622"
HOSTNAME="/default-rack/hdslv02"
STATE_STRING=""
COUNTERS="{(FileSystemCounters)(FileSystemCounters)[(HDFS_BYTES_READ)(HDFS_BYTES_READ)(2030398046)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(75542)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(COMBINE_OUTPUT_RECORDS)(Combine output records)(50)][(MAP_INPUT_RECORDS)(Map input records)(247192)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(968900608)][(SPILLED_RECORDS)(Spilled Records)(50)][(MAP_OUTPUT_BYTES)(Map output bytes)(28427080)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(37650)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1070858240)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(1434906624)][(COMBINE_INPUT_RECORDS)(Combine input records)(1235960)][(MAP_OUTPUT_RECORDS)(Map output records)(1235960)][(SPLIT_RAW_BYTES)(SPLIT_RAW_BYTES)(11276)]}" .

ReduceAttempt
TASK_TYPE="REDUCE"
TASKID="task_201210031529_0007_r_000007"
TASK_ATTEMPT_ID="attempt_201210031529_0007_r_000007_0"
START_TIME="1349325848847"
TRACKER_NAME="tracker_hdslv02:localhost\.localdomain/127\.0\.0\.1:56247"
HTTP_PORT="50060" .

ReduceAttempt
TASK_TYPE="REDUCE"
TASKID="task_201210031529_0007_r_000007"
TASK_ATTEMPT_ID="attempt_201210031529_0007_r_000007_0"
TASK_STATUS="SUCCESS"
SHUFFLE_FINISHED="1349327889352"
SORT_FINISHED="1349327889361"
FINISH_TIME="1349327950181"
HOSTNAME="/default-rack/hdslv02"
STATE_STRING="reduce > reduce"
COUNTERS="{(com\.asakusafw\.stage\.output\.RecordCounters)(com\.asakusafw\.stage\.output\.RecordCounters)[(result50)(result50)(235652)][(result40)(result40)(0)][(result0)(result0)(0)][(result20)(result20)(0)][(result30)(result30)(0)][(result10)(result10)(0)]}{(FileSystemCounters)(FileSystemCounters)[(FILE_BYTES_READ)(FILE_BYTES_READ)(168429113)][(FILE_BYTES_WRITTEN)(FILE_BYTES_WRITTEN)(168501835)][(HDFS_BYTES_WRITTEN)(HDFS_BYTES_WRITTEN)(196706757)]}{(org\.apache\.hadoop\.mapred\.Task$Counter)(Map-Reduce Framework)[(REDUCE_INPUT_GROUPS)(Reduce input groups)(238095)][(COMBINE_OUTPUT_RECORDS)(Combine output records)(396067)][(REDUCE_SHUFFLE_BYTES)(Reduce shuffle bytes)(200631847)][(PHYSICAL_MEMORY_BYTES)(Physical memory \\(bytes\\) snapshot)(1191866368)][(REDUCE_OUTPUT_RECORDS)(Reduce output records)(235652)][(SPILLED_RECORDS)(Spilled Records)(396067)][(CPU_MILLISECONDS)(CPU time spent \\(ms\\))(20700)][(COMMITTED_HEAP_BYTES)(Total committed heap usage \\(bytes\\))(1565917184)][(VIRTUAL_MEMORY_BYTES)(Virtual memory \\(bytes\\) snapshot)(2646269952)][(COMBINE_INPUT_RECORDS)(Combine input records)(396067)][(REDUCE_INPUT_RECORDS)(Reduce input records)(473747)]}" .

Attemptとかは、FAILで終わるとエラーログを持っていたりもしますが、上に出しているのは正常系のものだけです。


という感じで、とりあえず欲しいものは見つかりました。