Packages

object Hdfs

Source
Hdfs.scala
Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. Hdfs
  2. AnyRef
  3. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. Protected

Value Members

  1. final def !=(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  2. final def ##: Int
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean
    Definition Classes
    AnyRef → Any
  4. def append(fs: FileSystem, path: Path)(implicit scheduler: Scheduler): Consumer[Array[Byte], Long]

    The subscriber implementation of an HDFS append writer.

    The subscriber implementation of an HDFS append writer.

    fs

    An abstract base class for a fairly generic filesystem.

    path

    Names a file or directory in a FileSystem. Path strings use slash as the directory separator.

    scheduler

    An implicit Scheduler instance to be in the scope of the call.

    returns

    A Long that represents the number of bytes that has been written.

  5. final def asInstanceOf[T0]: T0
    Definition Classes
    Any
  6. def clone(): AnyRef
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.CloneNotSupportedException]) @native()
  7. final def eq(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  8. def equals(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef → Any
  9. def finalize(): Unit
    Attributes
    protected[lang]
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.Throwable])
  10. final def getClass(): Class[_ <: AnyRef]
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  11. def hashCode(): Int
    Definition Classes
    AnyRef → Any
    Annotations
    @native()
  12. final def isInstanceOf[T0]: Boolean
    Definition Classes
    Any
  13. final def ne(arg0: AnyRef): Boolean
    Definition Classes
    AnyRef
  14. final def notify(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  15. final def notifyAll(): Unit
    Definition Classes
    AnyRef
    Annotations
    @native()
  16. def read(fs: FileSystem, path: Path, chunkSize: Int = 8192)(implicit scheduler: Scheduler): Observable[Array[Byte]]

    fs

    An abstract base class for a fairly generic filesystem. Any potentially usage of the Hadoop Distributed File System should be written to use a FileSystem object.

    path

    Names a file or directory in a FileSystem. Path strings use slash as the directory separator.

    chunkSize

    The maximum length of the emitted arrays of bytes.

    scheduler

    An implicit Scheduler instance to be in the scope of the call.

    returns

    An Observable of chunks of bytes with the size specified by chunkSize.

  17. final def synchronized[T0](arg0: => T0): T0
    Definition Classes
    AnyRef
  18. def toString(): String
    Definition Classes
    AnyRef → Any
  19. final def wait(): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  20. final def wait(arg0: Long, arg1: Int): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException])
  21. final def wait(arg0: Long): Unit
    Definition Classes
    AnyRef
    Annotations
    @throws(classOf[java.lang.InterruptedException]) @native()
  22. def write(fs: FileSystem, path: Path, overwrite: Boolean = true, replication: Short = 3, bufferSize: Int = 4096, blockSize: Int = 134217728)(implicit scheduler: Scheduler): Consumer[Array[Byte], Long]

    The subscriber implementation of an HDFS writer.

    The subscriber implementation of an HDFS writer. I expects chunks of bytes to be passed and it synchronously writes them to the specified path. If the chunk is an empty byte array, then no bytes are written, so nothing happens.

    fs

    An abstract base class for a fairly generic filesystem. The FileSystem allows to implement the IO operations in the Hadoop DFS (being a multi-machine system) as a single one.

    path

    Names a file or directory in a FileSystem. Path strings use slash as the directory separator.

    overwrite

    When a file with this name already exists, then if true, the file will be overwritten. And if false an java.io.IOException will be thrown. Files are overwritten by default.

    replication

    The replication factor.

    bufferSize

    The size of the buffer to be used.

    blockSize

    The default block size for new files, in bytes. Being 128 MB the default value.

    scheduler

    An implicit Scheduler instance to be in the scope of the call.

    returns

    A Long that represents the number of bytes that has been written.

Inherited from AnyRef

Inherited from Any

Ungrouped