|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.mapreduce.OutputCommitter
org.apache.hadoop.mapred.OutputCommitter
org.apache.hadoop.mapred.FileOutputCommitter
public class FileOutputCommitter
An OutputCommitter that commits files specified
in job output directory i.e. ${mapred.output.dir}.
| Field Summary | |
|---|---|
static org.apache.commons.logging.Log |
LOG
|
static String |
TEMP_DIR_NAME
Temporary directory name |
| Constructor Summary | |
|---|---|
FileOutputCommitter()
|
|
| Method Summary | |
|---|---|
void |
abortTask(TaskAttemptContext context)
Discard the task output |
void |
cleanupJob(JobContext context)
For cleaning up the job's output after job completion |
void |
commitTask(TaskAttemptContext context)
To promote the task's temporary output to final output location The task's output is moved to the job's output directory. |
boolean |
needsTaskCommit(TaskAttemptContext context)
Check whether task needs a commit |
void |
setupJob(JobContext context)
For the framework to setup the job output during initialization |
void |
setupTask(TaskAttemptContext context)
Sets up output for the task. |
| Methods inherited from class org.apache.hadoop.mapred.OutputCommitter |
|---|
abortTask, cleanupJob, commitTask, needsTaskCommit, setupJob, setupTask |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Field Detail |
|---|
public static final org.apache.commons.logging.Log LOG
public static final String TEMP_DIR_NAME
| Constructor Detail |
|---|
public FileOutputCommitter()
| Method Detail |
|---|
public void setupJob(JobContext context)
throws IOException
OutputCommitter
setupJob in class OutputCommittercontext - Context of the job whose output is being written.
IOException - if temporary output could not be created
public void cleanupJob(JobContext context)
throws IOException
OutputCommitter
cleanupJob in class OutputCommittercontext - Context of the job whose output is being written.
IOException
public void setupTask(TaskAttemptContext context)
throws IOException
OutputCommitter
setupTask in class OutputCommittercontext - Context of the task whose output is being written.
IOException
public void commitTask(TaskAttemptContext context)
throws IOException
OutputCommitter
commitTask in class OutputCommittercontext - Context of the task whose output is being written.
IOException - if commit is not
public void abortTask(TaskAttemptContext context)
throws IOException
OutputCommitter
abortTask in class OutputCommitterIOException
public boolean needsTaskCommit(TaskAttemptContext context)
throws IOException
OutputCommitter
needsTaskCommit in class OutputCommitterIOException
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||