Hadoop Internals


Fork me on GitHub

Job


Table of contents:

Finite State Machine

Hadoop (MapReduce): Job - Finite State Machine

NEW => INITED [JOB_INIT]

Hadoop (MapReduce): Job - NEW => INITED - JOB_INIT

INITTED => SETUP [JOB_START]

Hadoop (MapReduce): Job - INITTED => SETUP - JOB_START

SETUP => RUNNING [JOB_SETUP_COMPLETED]

Hadoop (MapReduce): Job - SETUP => RUNNING - JOB_SETUP_COMPLETED

RUNNING => {RUNNING, COMMITTING, FAIL ABORT} [JOB_TASK_COMPLETED]

Hadoop (MapReduce): Job - RUNNING => RUNNING, COMMITTING, FAIL ABORT - JOB_TASK_COMPLETED

RUNNING => RUNNING [JOB_TASK_ATTEMPT_COMPLETED]

Hadoop (MapReduce): Job - RUNNING => RUNNING - JOB_TASK_ATTEMPT_COMPLETED

COMMITTING => SUCCEEDED [JOB_COMMIT_COMPLETED]

Hadoop (MapReduce): Job - COMMITTED => SUCCEEDED - JOB_COMMIT_COMPLETED