object Hdfs
- Source
- Hdfs.scala
- Alphabetic
- By Inheritance
- Hdfs
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- def append(fs: FileSystem, path: Path)(implicit scheduler: Scheduler): Consumer[Array[Byte], Long]
The subscriber implementation of an HDFS append writer.
The subscriber implementation of an HDFS append writer.
- fs
An abstract base class for a fairly generic filesystem.
- path
Names a file or directory in a FileSystem. Path strings use slash as the directory separator.
- scheduler
An implicit Scheduler instance to be in the scope of the call.
- returns
A Long that represents the number of bytes that has been written.
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def read(fs: FileSystem, path: Path, chunkSize: Int = 8192)(implicit scheduler: Scheduler): Observable[Array[Byte]]
- fs
An abstract base class for a fairly generic filesystem. Any potentially usage of the Hadoop Distributed File System should be written to use a FileSystem object.
- path
Names a file or directory in a FileSystem. Path strings use slash as the directory separator.
- chunkSize
The maximum length of the emitted arrays of bytes.
- scheduler
An implicit Scheduler instance to be in the scope of the call.
- returns
An Observable of chunks of bytes with the size specified by chunkSize.
- final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()
- def write(fs: FileSystem, path: Path, overwrite: Boolean = true, replication: Short = 3, bufferSize: Int = 4096, blockSize: Int = 134217728)(implicit scheduler: Scheduler): Consumer[Array[Byte], Long]
The subscriber implementation of an HDFS writer.
The subscriber implementation of an HDFS writer. I expects chunks of bytes to be passed and it synchronously writes them to the specified path. If the chunk is an empty byte array, then no bytes are written, so nothing happens.
- fs
An abstract base class for a fairly generic filesystem. The FileSystem allows to implement the IO operations in the Hadoop DFS (being a multi-machine system) as a single one.
- path
Names a file or directory in a FileSystem. Path strings use slash as the directory separator.
- overwrite
When a file with this name already exists, then if true, the file will be overwritten. And if false an java.io.IOException will be thrown. Files are overwritten by default.
- replication
The replication factor.
- bufferSize
The size of the buffer to be used.
- blockSize
The default block size for new files, in bytes. Being 128 MB the default value.
- scheduler
An implicit Scheduler instance to be in the scope of the call.
- returns
A Long that represents the number of bytes that has been written.