Uses of Class
org.apache.hadoop.yarn.server.resourcemanager.scheduler.SchedulerNode
Packages that use SchedulerNode
Package
Description
Package org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement
contains classes related to scheduling containers using placement
constraints.
This Package contains classes related to constrained placement of
Requests.
Package o.a.h.yarn.server.resourcemanager.scheduler.constraint.processor
contains classes related to scheduling containers using placement
processor.
Package org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement
contains classes related to application monitor.
-
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager
Methods in org.apache.hadoop.yarn.server.resourcemanager that return types with arguments of type SchedulerNodeModifier and TypeMethodDescriptionprotected MultiNodeSortingManager<SchedulerNode>ResourceManager.createMultiNodeSortingManager()RMActiveServiceContext.getMultiNodeSortingManager()RMContext.getMultiNodeSortingManager()RMContextImpl.getMultiNodeSortingManager()Method parameters in org.apache.hadoop.yarn.server.resourcemanager with type arguments of type SchedulerNodeModifier and TypeMethodDescriptionvoidRMActiveServiceContext.setMultiNodeSortingManager(MultiNodeSortingManager<SchedulerNode> multiNodeSortingManager) voidRMContext.setMultiNodeSortingManager(MultiNodeSortingManager<SchedulerNode> multiNodeSortingManager) voidRMContextImpl.setMultiNodeSortingManager(MultiNodeSortingManager<SchedulerNode> multiNodeSortingManager) -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler
Classes in org.apache.hadoop.yarn.server.resourcemanager.scheduler with type parameters of type SchedulerNodeModifier and TypeClassDescriptionclassAbstractYarnScheduler<T extends SchedulerApplicationAttempt,N extends SchedulerNode> classClusterNodeTracker<N extends SchedulerNode>Helper library that: - tracks the state of all clusterSchedulerNodes - provides convenience methods to filter and sort nodesMethods in org.apache.hadoop.yarn.server.resourcemanager.scheduler with type parameters of type SchedulerNodeModifier and TypeMethodDescription<N extends SchedulerNode>
AppPlacementAllocator<N>AppSchedulingInfo.getAppPlacementAllocator(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerkey) <N extends SchedulerNode>
AppPlacementAllocator<N>SchedulerApplicationAttempt.getAppPlacementAllocator(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerRequestKey) Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler that return SchedulerNodeModifier and TypeMethodDescriptionAbstractYarnScheduler.getNode(org.apache.hadoop.yarn.api.records.NodeId nodeId) SchedContainerChangeRequest.getSchedulerNode()YarnScheduler.getSchedulerNode(org.apache.hadoop.yarn.api.records.NodeId nodeId) Get SchedulerNode corresponds to nodeId.Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler that return types with arguments of type SchedulerNodeModifier and TypeMethodDescriptionstatic AppPlacementAllocator<SchedulerNode>ApplicationPlacementAllocatorFactory.getAppPlacementAllocator(String appPlacementAllocatorName, AppSchedulingInfo appSchedulingInfo, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerRequestKey, RMContext rmContext) Get AppPlacementAllocator related to the placement type requested.Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler with parameters of type SchedulerNodeModifier and TypeMethodDescriptionbooleanNodeFilter.accept(SchedulerNode node) Criteria to accept node in the filtered list.voidSchedulerApplicationAttempt.addToNewlyAllocatedContainers(SchedulerNode node, RMContainer rmContainer) AppSchedulingInfo.allocate(NodeType type, SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, RMContainer containerAllocated) booleanAbstractYarnScheduler.attemptAllocationOnNode(SchedulerApplicationAttempt appAttempt, org.apache.hadoop.yarn.api.records.SchedulingRequest schedulingRequest, SchedulerNode schedulerNode) Default implementation.booleanResourceScheduler.attemptAllocationOnNode(SchedulerApplicationAttempt appAttempt, org.apache.hadoop.yarn.api.records.SchedulingRequest schedulingRequest, SchedulerNode schedulerNode) Attempts to allocate a SchedulerRequest on a Node.booleanAppSchedulingInfo.checkAllocation(NodeType type, SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey) booleanContainerUpdateContext.checkAndAddToOutstandingDecreases(org.apache.hadoop.yarn.api.records.UpdateContainerRequest updateReq, SchedulerNode schedulerNode, org.apache.hadoop.yarn.api.records.Container container) Add the container to outstanding decreases.booleanContainerUpdateContext.checkAndAddToOutstandingIncreases(RMContainer rmContainer, SchedulerNode schedulerNode, org.apache.hadoop.yarn.api.records.UpdateContainerRequest updateRequest) Add the container to outstanding increases.protected voidAbstractYarnScheduler.containerIncreasedOnNode(org.apache.hadoop.yarn.api.records.ContainerId containerId, SchedulerNode node, org.apache.hadoop.yarn.api.records.Container increasedContainerReportedByNM) protected voidAbstractYarnScheduler.containerLaunchedOnNode(org.apache.hadoop.yarn.api.records.ContainerId containerId, SchedulerNode node) static booleanSchedulerUtils.isNodeHeartbeated(SchedulerNode node, long skipNodeInterval) static booleanSchedulerAppUtils.isPlaceBlacklisted(SchedulerApplicationAttempt application, SchedulerNode node, org.slf4j.Logger log) org.apache.hadoop.yarn.api.records.ContainerIdContainerUpdateContext.matchContainerToOutstandingIncreaseReq(SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, RMContainer rmContainer) Check if a new container is to be matched up against an outstanding Container increase request.booleanAppSchedulingInfo.precheckNode(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, SchedulerNode schedulerNode, SchedulingMode schedulingMode, Optional<DiagnosticsCollector> dcOpt) Pre-check node to see if it satisfy the given schedulerKey and scheduler mode.booleanSchedulerApplicationAttempt.recoverContainer(SchedulerNode node, RMContainer rmContainer) SchedulerApplicationAttempt.reserve(SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, RMContainer rmContainer, org.apache.hadoop.yarn.api.records.Container container) booleanSchedulerApplicationAttempt.reserveIncreasedContainer(SchedulerNode node, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, RMContainer rmContainer, org.apache.hadoop.yarn.api.records.Resource reservedResource) static voidAppSchedulingInfo.updateMetrics(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, NodeType type, SchedulerNode node, RMContainer containerAllocated, String user, Queue queue) protected voidAbstractYarnScheduler.updateNodeResourceUtilization(RMNode nm, SchedulerNode schedulerNode) Update container and utilization information on the NodeManager.Constructors in org.apache.hadoop.yarn.server.resourcemanager.scheduler with parameters of type SchedulerNodeModifierConstructorDescriptionSchedContainerChangeRequest(RMContext rmContext, SchedulerNode schedulerNode, RMContainer rmContainer, org.apache.hadoop.yarn.api.records.Resource targetCapacity) -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities
Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.activities with parameters of type SchedulerNodeModifier and TypeMethodDescriptionstatic voidActivitiesLogger.NODE.finishAllocatedNodeAllocation(ActivitiesManager activitiesManager, SchedulerNode node, org.apache.hadoop.yarn.api.records.ContainerId containerId, AllocationState containerState) static voidActivitiesLogger.NODE.finishSkippedNodeAllocation(ActivitiesManager activitiesManager, SchedulerNode node) org.apache.hadoop.yarn.api.records.NodeIdActivitiesManager.getRecordingNodeId(SchedulerNode node) Get recording node id: 1. node id of the input node if it is not null. 2.static voidActivitiesLogger.APP.recordAppActivityWithAllocation(ActivitiesManager activitiesManager, SchedulerNode node, SchedulerApplicationAttempt application, RMContainer updatedContainer, ActivityState activityState) static voidActivitiesLogger.APP.recordAppActivityWithoutAllocation(ActivitiesManager activitiesManager, SchedulerNode node, SchedulerApplicationAttempt application, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, String diagnostic, ActivityState appState, ActivityLevel level) static voidActivitiesLogger.QUEUE.recordQueueActivity(ActivitiesManager activitiesManager, SchedulerNode node, String parentQueueName, String queueName, ActivityState state, String diagnostic) static voidActivitiesLogger.QUEUE.recordQueueActivity(ActivitiesManager activitiesManager, SchedulerNode node, String parentQueueName, String queueName, ActivityState state, Supplier<String> diagnosticSupplier) static voidActivitiesLogger.APP.recordRejectedAppActivityFromLeafQueue(ActivitiesManager activitiesManager, SchedulerNode node, SchedulerApplicationAttempt application, org.apache.hadoop.yarn.api.records.Priority priority, String diagnostic) static voidActivitiesLogger.APP.recordSkippedAppActivityWithoutAllocation(ActivitiesManager activitiesManager, SchedulerNode node, SchedulerApplicationAttempt application, org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey requestKey, String diagnostic, ActivityLevel level) -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity
Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity with parameters of type SchedulerNodeModifier and TypeMethodDescriptionbooleanCapacityScheduler.attemptAllocationOnNode(SchedulerApplicationAttempt appAttempt, org.apache.hadoop.yarn.api.records.SchedulingRequest schedulingRequest, SchedulerNode schedulerNode) -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.common
Classes in org.apache.hadoop.yarn.server.resourcemanager.scheduler.common with type parameters of type SchedulerNodeModifier and TypeClassDescriptionclassContainerAllocationProposal<A extends SchedulerApplicationAttempt,N extends SchedulerNode> Proposal to allocate/reserve a new containerclassResourceCommitRequest<A extends SchedulerApplicationAttempt,N extends SchedulerNode> classSchedulerContainer<A extends SchedulerApplicationAttempt,N extends SchedulerNode> Contexts for a container inside scheduler -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.common.fica
-
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint
Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint with parameters of type SchedulerNodeModifier and TypeMethodDescriptionstatic booleanPlacementConstraintsUtil.canSatisfyConstraints(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, org.apache.hadoop.yarn.api.records.SchedulingRequest request, SchedulerNode schedulerNode, PlacementConstraintManager pcm, AllocationTagsManager atm) static booleanPlacementConstraintsUtil.canSatisfyConstraints(org.apache.hadoop.yarn.api.records.ApplicationId applicationId, org.apache.hadoop.yarn.api.records.SchedulingRequest request, SchedulerNode schedulerNode, PlacementConstraintManager pcm, AllocationTagsManager atm, Optional<DiagnosticsCollector> dcOpt) Returns true if the placement constraint for a given scheduling request is currently satisfied by the specific scheduler node. -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.api
Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.api that return types with arguments of type SchedulerNodeModifier and TypeMethodDescriptionPlacedSchedulingRequest.getNodes()List of Node locations on which this Scheduling Request can be placed. -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor
Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor that return types with arguments of type SchedulerNodeModifier and TypeMethodDescriptionNodeCandidateSelector.selectNodes(NodeFilter filter) Select a list of nodes given a filter.Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.constraint.processor with parameters of type SchedulerNodeModifier and TypeMethodDescriptionvoidBatchedRequests.addToBlacklist(Set<String> tags, SchedulerNode node) -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair
Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair with parameters of type SchedulerNodeModifier and TypeMethodDescriptionbooleanFSAppAttempt.recoverContainer(SchedulerNode node, RMContainer rmContainer) -
Uses of SchedulerNode in org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement
Classes in org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement with type parameters of type SchedulerNodeModifier and TypeClassDescriptionclassAppPlacementAllocator<N extends SchedulerNode>This class has the following functionality: 1) Keeps track of pending resource requests when following events happen: - New ResourceRequests are added to schedulerinterfaceCandidateNodeSet<N extends SchedulerNode>A group of nodes which can be allocated by scheduler.classLocalityAppPlacementAllocator<N extends SchedulerNode>This is an implementation of theAppPlacementAllocatorthat takes into account locality preferences (node, rack, any) when allocating containers.interfaceMultiNodeLookupPolicy<N extends SchedulerNode>This class has the following functionality.classMultiNodeSorter<N extends SchedulerNode>Common node sorting class which will do sorting based on policy spec.classMultiNodeSortingManager<N extends SchedulerNode>Node Sorting Manager which runs all sorter threads and policies.classResourceUsageMultiNodeLookupPolicy<N extends SchedulerNode>This class has the following functionality:classSimpleCandidateNodeSet<N extends SchedulerNode>A simple CandidateNodeSet which keeps an unordered mapclassThis is a simple implementation to do affinity or anti-affinity for inter/intra apps.Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement with type parameters of type SchedulerNodeModifier and TypeMethodDescriptionstatic <N extends SchedulerNode>
NCandidateNodeSetUtils.getSingleNode(CandidateNodeSet<N> candidates) Methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.placement with parameters of type SchedulerNodeModifier and TypeMethodDescriptionabstract ContainerRequestAppPlacementAllocator.allocate(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, NodeType type, SchedulerNode node) Notify container allocated.LocalityAppPlacementAllocator.allocate(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, NodeType type, SchedulerNode node) SingleConstraintAppPlacementAllocator.allocate(org.apache.hadoop.yarn.server.scheduler.SchedulerRequestKey schedulerKey, NodeType type, SchedulerNode node) abstract booleanAppPlacementAllocator.canAllocate(NodeType type, SchedulerNode node) We can still have pending requirement for a given NodeType and nodebooleanLocalityAppPlacementAllocator.canAllocate(NodeType type, SchedulerNode node) booleanSingleConstraintAppPlacementAllocator.canAllocate(NodeType type, SchedulerNode node) abstract booleanAppPlacementAllocator.precheckNode(SchedulerNode schedulerNode, SchedulingMode schedulingMode) abstract booleanAppPlacementAllocator.precheckNode(SchedulerNode schedulerNode, SchedulingMode schedulingMode, Optional<DiagnosticsCollector> dcOpt) Does thisAppPlacementAllocatoraccept resources on given node?booleanLocalityAppPlacementAllocator.precheckNode(SchedulerNode schedulerNode, SchedulingMode schedulingMode) booleanLocalityAppPlacementAllocator.precheckNode(SchedulerNode schedulerNode, SchedulingMode schedulingMode, Optional<DiagnosticsCollector> dcOpt) booleanSingleConstraintAppPlacementAllocator.precheckNode(SchedulerNode schedulerNode, SchedulingMode schedulingMode) booleanSingleConstraintAppPlacementAllocator.precheckNode(SchedulerNode schedulerNode, SchedulingMode schedulingMode, Optional<DiagnosticsCollector> dcOpt)