Uses of Interface
org.apache.hadoop.fs.RemoteIterator
Packages that use RemoteIterator
Package
Description
An abstract file system API.
Support for the execution of a file system command.
ViewFileSystem and ViewFileSystemOverloadScheme classes.
Support for functional programming within the Hadoop APIs.
-
Uses of RemoteIterator in org.apache.hadoop.fs
Classes in org.apache.hadoop.fs that implement RemoteIteratorModifier and TypeClassDescriptionclassA RemoteIterator that fetches elements in batches.protected classFileSystem.DirListingIterator<T extends FileStatus>Generic iterator for implementingFileSystem.listStatusIterator(Path).Methods in org.apache.hadoop.fs that return RemoteIteratorModifier and TypeMethodDescriptionBatchListingOperations.batchedListLocatedStatusIterator(List<Path> paths) Batched listing API that returnsPartialListings for the passed Paths.BatchListingOperations.batchedListStatusIterator(List<Path> paths) Batched listing API that returnsPartialListings for the passed Paths.AbstractFileSystem.listCorruptFileBlocks(Path path) FileContext.listCorruptFileBlocks(Path path) List CorruptFile Blocks.FileSystem.listCorruptFileBlocks(Path path) List corrupted file blocks.FilterFileSystem.listCorruptFileBlocks(Path path) FilterFs.listCorruptFileBlocks(Path path) List the statuses and block locations of the files in the given path.List the statuses and block locations of the files in the given path.AbstractFileSystem.listLocatedStatus(Path f) The specification of this method matches that ofFileContext.listLocatedStatus(Path)except that Path f must be for this file system.ChecksumFileSystem.listLocatedStatus(Path f) List the statuses of the files/directories in the given path if the path is a directory.ChecksumFs.listLocatedStatus(Path f) FileContext.listLocatedStatus(Path f) List the statuses of the files/directories in the given path if the path is a directory.FileSystem.listLocatedStatus(Path f) List the statuses of the files/directories in the given path if the path is a directory.protected RemoteIterator<LocatedFileStatus>FileSystem.listLocatedStatus(Path f, PathFilter filter) List a directory.FilterFileSystem.listLocatedStatus(Path f) List files and its block locations in a directory.protected RemoteIterator<LocatedFileStatus>FilterFileSystem.listLocatedStatus(Path f, PathFilter filter) FilterFs.listLocatedStatus(Path f) FileContext.listStatus(Path f) List the statuses of the files/directories in the given path if the path is a directory.AbstractFileSystem.listStatusIterator(Path f) The specification of this method matches that ofFileContext.listStatus(Path)except that Path f must be for this file system.ChecksumFileSystem.listStatusIterator(Path p) FileSystem.listStatusIterator(Path p) Returns a remote iterator so that followup calls are made on demand while consuming the entries.FilterFileSystem.listStatusIterator(Path f) Return a remote iterator for listing in a directory -
Uses of RemoteIterator in org.apache.hadoop.fs.shell
Methods in org.apache.hadoop.fs.shell that return RemoteIteratorModifier and TypeMethodDescriptionPathData.getDirectoryContentsIterator()Returns a RemoteIterator for PathData objects of the items contained in the given directory.Methods in org.apache.hadoop.fs.shell with parameters of type RemoteIteratorModifier and TypeMethodDescriptionprotected voidCommand.processPaths(PathData parent, RemoteIterator<PathData> itemsIterator) Iterates over the given expanded paths and invokesCommand.processPath(PathData)on each element. -
Uses of RemoteIterator in org.apache.hadoop.fs.viewfs
Methods in org.apache.hadoop.fs.viewfs that return RemoteIteratorModifier and TypeMethodDescriptionViewFileSystem.listLocatedStatus(Path f, PathFilter filter) ViewFs.listLocatedStatus(Path f) ViewFs.listStatusIterator(Path f) -
Uses of RemoteIterator in org.apache.hadoop.util.functional
Classes in org.apache.hadoop.util.functional that implement RemoteIteratorModifier and TypeClassDescriptionstatic classWrapper of another remote iterator; IOStatistics and Closeable methods are passed down if implemented.Methods in org.apache.hadoop.util.functional that return RemoteIteratorModifier and TypeMethodDescriptionstatic <S> RemoteIterator<S>RemoteIterators.closingRemoteIterator(RemoteIterator<S> iterator, Closeable toClose) This adds an extra close operation alongside the passthrough to any Closeable.close() method supported by the source iterator.static <S> RemoteIterator<S>RemoteIterators.filteringRemoteIterator(RemoteIterator<S> iterator, FunctionRaisingIOE<? super S, Boolean> filter) Create a RemoteIterator from a RemoteIterator and a filter function which returns true for every element to be passed through.protected RemoteIterator<S>RemoteIterators.WrappingRemoteIterator.getSource()static <S> RemoteIterator<S>RemoteIterators.haltableRemoteIterator(RemoteIterator<S> iterator, CallableRaisingIOE<Boolean> continueWork) Wrap an iterator with one which adds a continuation probe.static <S,T> RemoteIterator<T> RemoteIterators.mappingRemoteIterator(RemoteIterator<S> iterator, FunctionRaisingIOE<? super S, T> mapper) Create an iterator from an iterator and a transformation function.static RemoteIterator<Long>RemoteIterators.rangeExcludingIterator(long start, long excludedFinish) A remote iterator which simply counts up, stopping once the value is greater than the value ofexcludedFinish.static <T> RemoteIterator<T>RemoteIterators.remoteIteratorFromArray(T[] array) Create a remote iterator from an array.static <T> RemoteIterator<T>RemoteIterators.remoteIteratorFromIterable(Iterable<T> iterable) Create a remote iterator from a java.util.Iterable -e.g. a list or other collection.static <T> RemoteIterator<T>RemoteIterators.remoteIteratorFromIterator(Iterator<T> iterator) Create a remote iterator from a java.util.Iterator.static <T> RemoteIterator<T>RemoteIterators.remoteIteratorFromSingleton(T singleton) Create an iterator from a singleton.static <S,T> RemoteIterator<T> RemoteIterators.typeCastingRemoteIterator(RemoteIterator<S> iterator) Create a RemoteIterator from a RemoteIterator, casting the type in the process.Methods in org.apache.hadoop.util.functional with parameters of type RemoteIteratorModifier and TypeMethodDescriptionstatic <T> voidRemoteIterators.cleanupRemoteIterator(RemoteIterator<T> source) Clean up after an iteration.static <S> RemoteIterator<S>RemoteIterators.closingRemoteIterator(RemoteIterator<S> iterator, Closeable toClose) This adds an extra close operation alongside the passthrough to any Closeable.close() method supported by the source iterator.static <S> RemoteIterator<S>RemoteIterators.filteringRemoteIterator(RemoteIterator<S> iterator, FunctionRaisingIOE<? super S, Boolean> filter) Create a RemoteIterator from a RemoteIterator and a filter function which returns true for every element to be passed through.static <T> longRemoteIterators.foreach(RemoteIterator<T> source, ConsumerRaisingIOE<? super T> consumer) Apply an operation to all values of a RemoteIterator.static <I> TaskPool.Builder<I>TaskPool.foreach(RemoteIterator<I> items) Create a task builder for the remote iterator.static <S> RemoteIterator<S>RemoteIterators.haltableRemoteIterator(RemoteIterator<S> iterator, CallableRaisingIOE<Boolean> continueWork) Wrap an iterator with one which adds a continuation probe.static <S,T> RemoteIterator<T> RemoteIterators.mappingRemoteIterator(RemoteIterator<S> iterator, FunctionRaisingIOE<? super S, T> mapper) Create an iterator from an iterator and a transformation function.static <T> T[]RemoteIterators.toArray(RemoteIterator<T> source, T[] a) Build an array from a RemoteIterator.static <T> List<T>RemoteIterators.toList(RemoteIterator<T> source) Build a list from a RemoteIterator.static <S,T> RemoteIterator<T> RemoteIterators.typeCastingRemoteIterator(RemoteIterator<S> iterator) Create a RemoteIterator from a RemoteIterator, casting the type in the process.Constructors in org.apache.hadoop.util.functional with parameters of type RemoteIterator