Package org.apache.hadoop.hdfs

Class DeadNodeDetector

java.lang.Object

java.lang.Thread

org.apache.hadoop.util.Daemon

org.apache.hadoop.hdfs.DeadNodeDetector

All Implemented Interfaces:

Runnable

public class DeadNodeDetector
extends org.apache.hadoop.util.Daemon

Detect the dead nodes in advance, and share this information among all the DFSInputStreams in the same client.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.util.Daemon

org.apache.hadoop.util.Daemon.DaemonFactory

Nested classes/interfaces inherited from class java.lang.Thread

Thread.UncaughtExceptionHandler

Field Summary

Fields

Modifier and Type	Field	Description
static final org.slf4j.Logger	LOG

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor	Description
DeadNodeDetector(String name, org.apache.hadoop.conf.Configuration conf)

Method Summary

Modifier and Type	Method	Description
void	addNodeToDetect(DFSInputStream dfsInputStream, DatanodeInfo datanodeInfo)	Add datanode to suspectNodes and suspectAndDeadNodes.
Set<DatanodeInfo>	clearAndGetDetectedDeadNodes()	Remove dead node which is not used by any DFSInputStream from deadNodes.
org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo>	getDeadNodesProbeQueue()
org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo>	getSuspectNodesProbeQueue()
boolean	isDeadNode(DatanodeInfo datanodeInfo)
void	removeNodeFromDeadNodeDetector(DFSInputStream dfsInputStream, DatanodeInfo datanodeInfo)	Remove suspect and dead node from suspectAndDeadNodes#dfsInputStream and local deadNodes.
void	shutdown()	Shutdown all the threads.
void	work()

Methods inherited from class org.apache.hadoop.util.Daemon

getRunnable, run, start

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupt, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, onSpinWait, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Details

LOG

public static final org.slf4j.Logger LOG

Constructor Details

DeadNodeDetector

public DeadNodeDetector(String name,
 org.apache.hadoop.conf.Configuration conf)

Method Details

work

public void work()

Overrides:

work in class org.apache.hadoop.util.Daemon

shutdown

public void shutdown()

Shutdown all the threads.

isDeadNode

public boolean isDeadNode(DatanodeInfo datanodeInfo)

getDeadNodesProbeQueue

public org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo> getDeadNodesProbeQueue()

getSuspectNodesProbeQueue

public org.apache.hadoop.hdfs.DeadNodeDetector.UniqueQueue<DatanodeInfo> getSuspectNodesProbeQueue()

addNodeToDetect

public void addNodeToDetect(DFSInputStream dfsInputStream,
 DatanodeInfo datanodeInfo)

Add datanode to suspectNodes and suspectAndDeadNodes.

clearAndGetDetectedDeadNodes

public Set<DatanodeInfo> clearAndGetDetectedDeadNodes()

Remove dead node which is not used by any DFSInputStream from deadNodes.

Returns:

new dead node shared by all DFSInputStreams.

removeNodeFromDeadNodeDetector

public void removeNodeFromDeadNodeDetector(DFSInputStream dfsInputStream,
 DatanodeInfo datanodeInfo)

Remove suspect and dead node from suspectAndDeadNodes#dfsInputStream and local deadNodes.