Index

A C D E F G I L M O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values

A

activeConnections - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

allChannels - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

allChannels - Variable in class org.apache.hadoop.mapred.ShuffleHandler

AUDITLOG - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

C

channelActive(ChannelHandlerContext) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

channelInactive(ChannelHandlerContext) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

channelRead0(ChannelHandlerContext, FullHttpRequest) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

close() - Method in class org.apache.hadoop.mapred.FadvisedChunkedFile

CONCURRENCY_LEVEL - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

conf - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

CONNECTION_CLOSE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

connectionKeepAliveEnabled - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

connectionKeepAliveTimeOut - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

createHandlerContext() - Method in class org.apache.hadoop.mapred.ShuffleHandler

CURRENT_VERSION_INFO - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

D

deallocate() - Method in class org.apache.hadoop.mapred.FadvisedFileRegion

DEFAULT_CONCURRENCY_LEVEL - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_EXPIRE_AFTER_ACCESS_MINUTES - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_MAX_SHUFFLE_CONNECTIONS - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_MAX_SHUFFLE_THREADS - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_MAX_WEIGHT - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_BUFFER_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_CONNECTION_KEEP_ALIVE_ENABLED - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_CONNECTION_KEEP_ALIVE_TIME_OUT - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_LISTEN_QUEUE_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_MANAGE_OS_CACHE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_MAPOUTPUT_META_INFO_CACHE_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_MAX_SESSION_OPEN_FILES - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_PORT - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_READAHEAD_BYTES - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SHUFFLE_TRANSFERTO_ALLOWED - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

DEFAULT_SUFFLE_SSL_FILE_BUFFER_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

deserializeMetaData(ByteBuffer) - Static method in class org.apache.hadoop.mapred.ShuffleHandler

A helper function to deserialize the metadata returned by ShuffleHandler.

deserializeServiceData(ByteBuffer) - Static method in class org.apache.hadoop.mapred.ShuffleHandler

E

exceptionCaught(ChannelHandlerContext, Throwable) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

EXPIRE_AFTER_ACCESS_MINUTES - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

F

FadvisedChunkedFile - Class in org.apache.hadoop.mapred

FadvisedChunkedFile(RandomAccessFile, long, long, int, boolean, int, ReadaheadPool, String) - Constructor for class org.apache.hadoop.mapred.FadvisedChunkedFile

FadvisedFileRegion - Class in org.apache.hadoop.mapred

FadvisedFileRegion(RandomAccessFile, long, long, boolean, int, ReadaheadPool, String, int, boolean) - Constructor for class org.apache.hadoop.mapred.FadvisedFileRegion

FETCH_RETRY_DELAY - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

G

getCtx() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getCurrentVersion() - Method in class org.apache.hadoop.mapred.ShuffleHandler

getInfoMap() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getJobId() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getKeepAlive() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getMapIds() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getMapOutputInfo(String, int, String, String) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

getMapsToSend() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getMapsToWait() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getMetaData() - Method in class org.apache.hadoop.mapred.ShuffleHandler

getReduceId() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

getUser() - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler.ReduceContext

I

IGNORABLE_ERROR_MESSAGE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

indexCache - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

initChannel(SocketChannel) - Method in class org.apache.hadoop.mapred.ShuffleChannelInitializer

initializeApplication(ApplicationInitializationContext) - Method in class org.apache.hadoop.mapred.ShuffleHandler

L

LOG - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

M

manageOsCache - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

Should the shuffle use posix_fadvise calls to manage the OS cache during sendfile.

mapOutputMetaInfoCacheSize - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

MAPREDUCE_SHUFFLE_SERVICEID - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

MAX_CONTENT_LENGTH - Static variable in class org.apache.hadoop.mapred.ShuffleChannelInitializer

MAX_SHUFFLE_CONNECTIONS - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

MAX_SHUFFLE_THREADS - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

MAX_WEIGHT - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

maxSessionOpenFiles - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

maxShuffleConnections - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

metrics - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

ms - Variable in class org.apache.hadoop.mapred.ShuffleHandler

O

org.apache.hadoop.mapred - package org.apache.hadoop.mapred

P

pathCache - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

populateHeaders(List<String>, String, String, int, HttpResponse, boolean, Map<String, ShuffleChannelHandler.MapOutputInfo>) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

port - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

R

readaheadLength - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

readaheadPool - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

readChunk(ByteBufAllocator) - Method in class org.apache.hadoop.mapred.FadvisedChunkedFile

RETRY_AFTER_HEADER - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

S

secretManager - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

secretManager - Variable in class org.apache.hadoop.mapred.ShuffleHandler

sendError(ChannelHandlerContext, HttpResponseStatus) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

sendError(ChannelHandlerContext, String, HttpResponseStatus) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

sendError(ChannelHandlerContext, String, HttpResponseStatus, Map<String, String>) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

sendMap(ShuffleChannelHandler.ReduceContext) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

Calls sendMapOutput for the mapId pointed by ReduceContext.mapsToSend and increments it.

sendMapOutput(Channel, String, String, int, ShuffleChannelHandler.MapOutputInfo) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

serializeMetaData(int) - Static method in class org.apache.hadoop.mapred.ShuffleHandler

Serialize the shuffle port into a ByteBuffer for use later on.

serializeServiceData(Token<JobTokenIdentifier>) - Static method in class org.apache.hadoop.mapred.ShuffleHandler

A helper function to serialize the JobTokenIdentifier to be sent to the ShuffleHandler as ServiceData.

serviceInit(Configuration) - Method in class org.apache.hadoop.mapred.ShuffleHandler

serviceStart() - Method in class org.apache.hadoop.mapred.ShuffleHandler

serviceStop() - Method in class org.apache.hadoop.mapred.ShuffleHandler

setResponseHeaders(HttpResponse, boolean, long) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

SHUFFLE_BUFFER_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_CONNECTION_KEEP_ALIVE_ENABLED - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_CONNECTION_KEEP_ALIVE_TIME_OUT - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_LISTEN_QUEUE_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_MANAGE_OS_CACHE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_MAPOUTPUT_META_INFO_CACHE_SIZE - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_MAX_SESSION_OPEN_FILES - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_PORT_CONFIG_KEY - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_READAHEAD_BYTES - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

SHUFFLE_TRANSFERTO_ALLOWED - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

shuffleBufferSize - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

ShuffleChannelHandler - Class in org.apache.hadoop.mapred

ShuffleChannelHandler verifies the map request then servers the attempts in a http stream.

ShuffleChannelHandler.ReduceContext - Class in org.apache.hadoop.mapred

Maintain parameters per messageReceived() Netty context.

ShuffleChannelHandlerContext - Class in org.apache.hadoop.mapred

ShuffleChannelHandlerContext(Configuration, Map<String, String>, JobTokenSecretManager, LoadingCache<ShuffleHandler.AttemptPathIdentifier, ShuffleHandler.AttemptPathInfo>, IndexCache, ShuffleHandler.ShuffleMetrics, ChannelGroup) - Constructor for class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

ShuffleChannelInitializer - Class in org.apache.hadoop.mapred

ShuffleChannelInitializer(ShuffleChannelHandlerContext, SSLFactory) - Constructor for class org.apache.hadoop.mapred.ShuffleChannelInitializer

ShuffleHandler - Class in org.apache.hadoop.mapred

ShuffleHandler() - Constructor for class org.apache.hadoop.mapred.ShuffleHandler

shuffleHeaderToBytes(ShuffleHeader) - Static method in class org.apache.hadoop.mapred.ShuffleChannelHandler

shuffleTransferToAllowed - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

sslFileBufferSize - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

stopApplication(ApplicationTerminationContext) - Method in class org.apache.hadoop.mapred.ShuffleHandler

SUFFLE_SSL_FILE_BUFFER_SIZE_KEY - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

T

TOO_MANY_REQ_STATUS - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

transferSuccessful() - Method in class org.apache.hadoop.mapred.FadvisedFileRegion

Call when the transfer completes successfully so we can advise the OS that we don't need the region to be cached anymore.

transferTo(WritableByteChannel, long) - Method in class org.apache.hadoop.mapred.FadvisedFileRegion

U

userRsrc - Variable in class org.apache.hadoop.mapred.ShuffleChannelHandlerContext

userRsrc - Variable in class org.apache.hadoop.mapred.ShuffleHandler

V

verifyRequest(String, ChannelHandlerContext, HttpRequest, HttpResponse, URL) - Method in class org.apache.hadoop.mapred.ShuffleChannelHandler

W

WINDOWS_DEFAULT_SHUFFLE_TRANSFERTO_ALLOWED - Static variable in class org.apache.hadoop.mapred.ShuffleHandler

A C D E F G I L M O P R S T U V W
All Classes and Interfaces|All Packages|Constant Field Values