Package org.apache.hadoop.yarn.server.resourcemanager.blacklist

Class SimpleBlacklistManager

java.lang.Object
org.apache.hadoop.yarn.server.resourcemanager.blacklist.SimpleBlacklistManager
All Implemented Interfaces:
BlacklistManager
public class SimpleBlacklistManager extends Object implements BlacklistManager
Maintains a list of failed nodes and returns that as long as number of blacklisted nodes is below a threshold percentage of total nodes. If more than threshold number of nodes are marked as failure they all are returned as removal from blacklist so previous additions are reversed.

  • Constructor Summary

    Constructors
    Constructor
    Description
    SimpleBlacklistManager(int numberOfNodeManagerHosts, double blacklistDisableFailureThreshold)
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    addNode(String node)
    Report failure of a container on node.
    org.apache.hadoop.yarn.api.records.ResourceBlacklistRequest
    getBlacklistUpdates()
    Get ResourceBlacklistRequest that indicate which nodes should be added or to removed from the blacklist.
    void
    refreshNodeHostCount(int nodeHostCount)
    Refresh the number of NodeManagers available for scheduling.

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Constructor Details

    • SimpleBlacklistManager

      public SimpleBlacklistManager(int numberOfNodeManagerHosts, double blacklistDisableFailureThreshold)

  • Method Details

    • addNode

      public void addNode(String node)
      Description copied from interface: BlacklistManager
      Report failure of a container on node.
      Specified by:
      addNode in interface BlacklistManager
      Parameters:
      node - that has a container failure

    • refreshNodeHostCount

      public void refreshNodeHostCount(int nodeHostCount)
      Description copied from interface: BlacklistManager
      Refresh the number of NodeManagers available for scheduling.
      Specified by:
      refreshNodeHostCount in interface BlacklistManager
      Parameters:
      nodeHostCount - is the number of node hosts.

    • getBlacklistUpdates

      public org.apache.hadoop.yarn.api.records.ResourceBlacklistRequest getBlacklistUpdates()
      Description copied from interface: BlacklistManager
      Get ResourceBlacklistRequest that indicate which nodes should be added or to removed from the blacklist.
      Specified by:
      getBlacklistUpdates in interface BlacklistManager
      Returns:
      ResourceBlacklistRequest