|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||
java.lang.Objectorg.apache.hadoop.conf.Configured
org.apache.hadoop.fs.FileSystem
org.apache.hadoop.fs.kfs.KosmosFileSystem
@InterfaceAudience.Public @InterfaceStability.Stable public class KosmosFileSystem
A FileSystem backed by KFS.
| Field Summary |
|---|
| Fields inherited from class org.apache.hadoop.fs.FileSystem |
|---|
DEFAULT_FS, FS_DEFAULT_NAME_KEY, LOG, SHUTDOWN_HOOK_PRIORITY, statistics |
| Constructor Summary | |
|---|---|
KosmosFileSystem()
|
|
| Method Summary | |
|---|---|
FSDataOutputStream |
append(Path f,
int bufferSize,
Progressable progress)
Append to an existing file (optional operation). |
void |
completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Called when we're all done writing to the target. |
void |
copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is on the local disk. |
void |
copyToLocalFile(boolean delSrc,
Path src,
Path dst)
The src file is under FS, and the dst is on the local disk. |
FSDataOutputStream |
create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
Create an FSDataOutputStream at the indicated Path with write-progress reporting. |
boolean |
delete(Path path,
boolean recursive)
Delete a file. |
long |
getDefaultBlockSize()
Return the number of bytes that large input files should be optimally be split into to minimize i/o time. |
short |
getDefaultReplication()
Get the default replication. |
BlockLocation[] |
getFileBlockLocations(FileStatus file,
long start,
long len)
Return null if the file doesn't exist; otherwise, get the locations of the various chunks of the file file from KFS. |
FileStatus |
getFileStatus(Path path)
Return a file status object that represents the path. |
String |
getScheme()
Return the protocol scheme for the FileSystem. |
URI |
getUri()
Returns a URI whose scheme and authority identify this FileSystem. |
Path |
getWorkingDirectory()
Get the current working directory for the given file system |
void |
initialize(URI uri,
Configuration conf)
Called after a new FileSystem instance is constructed. |
boolean |
isDirectory(Path path)
True iff the named path is a directory. |
boolean |
isFile(Path path)
True iff the named path is a regular file. |
FileStatus[] |
listStatus(Path path)
List the statuses of the files/directories in the given path if the path is a directory. |
void |
lock(Path path,
boolean shared)
Deprecated. |
boolean |
mkdirs(Path path,
FsPermission permission)
Make the given file and all non-existent parents into directories. |
FSDataInputStream |
open(Path path,
int bufferSize)
Opens an FSDataInputStream at the indicated Path. |
void |
release(Path path)
Deprecated. |
boolean |
rename(Path src,
Path dst)
Renames Path src to Path dst. |
boolean |
setReplication(Path path,
short replication)
Set replication for an existing file. |
void |
setWorkingDirectory(Path dir)
Set the current working directory for the given file system. |
Path |
startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
Returns a local File that the user can write output to. |
| Methods inherited from class org.apache.hadoop.conf.Configured |
|---|
getConf, setConf |
| Methods inherited from class java.lang.Object |
|---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
| Constructor Detail |
|---|
public KosmosFileSystem()
| Method Detail |
|---|
public String getScheme()
getScheme in class FileSystemkfspublic URI getUri()
FileSystem
getUri in class FileSystem
public void initialize(URI uri,
Configuration conf)
throws IOException
FileSystem
initialize in class FileSystemuri - a uri whose authority section names the host, port, etc.
for this FileSystemconf - the configuration
IOExceptionpublic Path getWorkingDirectory()
FileSystem
getWorkingDirectory in class FileSystempublic void setWorkingDirectory(Path dir)
FileSystem
setWorkingDirectory in class FileSystem
public boolean mkdirs(Path path,
FsPermission permission)
throws IOException
FileSystem
mkdirs in class FileSystempath - path to createpermission - to apply to f
IOException
public boolean isDirectory(Path path)
throws IOException
FileSystem
isDirectory in class FileSystempath - path to check
IOException
public boolean isFile(Path path)
throws IOException
FileSystem
isFile in class FileSystempath - path to check
IOException
public FileStatus[] listStatus(Path path)
throws IOException
FileSystem
listStatus in class FileSystempath - given path
FileNotFoundException - when the path does not exist;
IOException see specific implementation
IOException
public FileStatus getFileStatus(Path path)
throws IOException
FileSystem
getFileStatus in class FileSystempath - The path we want information from
FileNotFoundException - when the path does not exist;
IOException see specific implementation
IOException
public FSDataOutputStream append(Path f,
int bufferSize,
Progressable progress)
throws IOException
FileSystem
append in class FileSystemf - the existing file to be appended.bufferSize - the size of the buffer to be used.progress - for reporting progress if it is not null.
IOException
public FSDataOutputStream create(Path file,
FsPermission permission,
boolean overwrite,
int bufferSize,
short replication,
long blockSize,
Progressable progress)
throws IOException
FileSystem
create in class FileSystemfile - the file name to openoverwrite - if a file with this name already exists, then if true,
the file will be overwritten, and if false an error will be thrown.bufferSize - the size of the buffer to be used.replication - required block replication for the file.
IOExceptionFileSystem.setPermission(Path, FsPermission)
public FSDataInputStream open(Path path,
int bufferSize)
throws IOException
FileSystem
open in class FileSystempath - the file name to openbufferSize - the size of the buffer to be used.
IOException
public boolean rename(Path src,
Path dst)
throws IOException
FileSystem
rename in class FileSystemsrc - path to be renameddst - new path after rename
IOException - on failure
public boolean delete(Path path,
boolean recursive)
throws IOException
FileSystem
delete in class FileSystempath - the path to delete.recursive - if path is a directory and set to
true, the directory is deleted else throws an exception. In
case of a file the recursive can be set to either true or false.
IOExceptionpublic short getDefaultReplication()
FileSystem
getDefaultReplication in class FileSystem
public boolean setReplication(Path path,
short replication)
throws IOException
FileSystem
setReplication in class FileSystempath - file namereplication - new replication
IOExceptionpublic long getDefaultBlockSize()
FileSystem
getDefaultBlockSize in class FileSystem
@Deprecated
public void lock(Path path,
boolean shared)
throws IOException
IOException
@Deprecated
public void release(Path path)
throws IOException
IOException
public BlockLocation[] getFileBlockLocations(FileStatus file,
long start,
long len)
throws IOException
getFileBlockLocations in class FileSystemfile - FilesStatus to get data fromstart - offset into the given filelen - length for which to get locations for
IOException
public void copyFromLocalFile(boolean delSrc,
Path src,
Path dst)
throws IOException
FileSystem
copyFromLocalFile in class FileSystemdelSrc - whether to delete the srcsrc - pathdst - path
IOException
public void copyToLocalFile(boolean delSrc,
Path src,
Path dst)
throws IOException
FileSystem
copyToLocalFile in class FileSystemdelSrc - whether to delete the srcsrc - pathdst - path
IOException
public Path startLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
throws IOException
FileSystem
startLocalOutput in class FileSystemfsOutputFile - path of output filetmpLocalFile - path of local tmp file
IOException
public void completeLocalOutput(Path fsOutputFile,
Path tmpLocalFile)
throws IOException
FileSystem
completeLocalOutput in class FileSystemfsOutputFile - path of output filetmpLocalFile - path to local tmp file
IOException
|
||||||||||
| PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
| SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD | |||||||||