Package org.apache.hadoop.yarn.server.timelineservice.storage

Class HBaseTimelineWriterImpl

java.lang.Object
org.apache.hadoop.service.AbstractService
org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineWriterImpl
All Implemented Interfaces:
Closeable, AutoCloseable, org.apache.hadoop.service.Service, org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter
@Private @Unstable public class HBaseTimelineWriterImpl extends org.apache.hadoop.service.AbstractService implements org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter
This implements a hbase based backend for storing the timeline entity information. It writes to multiple tables at the backend

  • Nested Class Summary

    Nested classes/interfaces inherited from interface org.apache.hadoop.service.Service

    org.apache.hadoop.service.Service.STATE

  • Constructor Summary

    Constructors
    Constructor
    Description
    HBaseTimelineWriterImpl()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse
    aggregate(org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity data, org.apache.hadoop.yarn.server.timelineservice.storage.TimelineAggregationTrack track)
     
    void
    flush()
     
    org.apache.hadoop.yarn.api.records.timeline.TimelineHealth
    getHealthStatus()
     
    protected org.apache.hadoop.yarn.server.timelineservice.storage.TimelineStorageMonitor
    getTimelineStorageMonitor()
     
    protected void
    serviceInit(org.apache.hadoop.conf.Configuration conf)
    initializes the hbase connection to write to the entity table.
    protected void
    serviceStart()
     
    protected void
    serviceStop()
    close the hbase connections The close APIs perform flushing and release any resources held.
    org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse
    write(org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorContext context, org.apache.hadoop.yarn.api.records.timelineservice.TimelineDomain domain)
     
    org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse
    write(org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorContext context, org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntities data, org.apache.hadoop.security.UserGroupInformation callerUgi)
    Stores the entire information in TimelineEntities to the timeline store.

    Methods inherited from class org.apache.hadoop.service.AbstractService

    close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, noteFailure, putBlocker, registerGlobalListener, registerServiceListener, removeBlocker, setConfig, start, stop, toString, unregisterGlobalListener, unregisterServiceListener, waitForServiceToStop

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

    Methods inherited from interface org.apache.hadoop.service.Service

    close, getBlockers, getConfig, getFailureCause, getFailureState, getLifecycleHistory, getName, getServiceState, getStartTime, init, isInState, registerServiceListener, start, stop, unregisterServiceListener, waitForServiceToStop

  • Constructor Details

    • HBaseTimelineWriterImpl

      public HBaseTimelineWriterImpl()

  • Method Details

    • serviceInit

      protected void serviceInit(org.apache.hadoop.conf.Configuration conf) throws Exception
      initializes the hbase connection to write to the entity table.
      Overrides:
      serviceInit in class org.apache.hadoop.service.AbstractService
      Throws:
      Exception

    • serviceStart

      protected void serviceStart() throws Exception
      Overrides:
      serviceStart in class org.apache.hadoop.service.AbstractService
      Throws:
      Exception

    • write

      public org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse write(org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorContext context, org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntities data, org.apache.hadoop.security.UserGroupInformation callerUgi) throws IOException
      Stores the entire information in TimelineEntities to the timeline store.
      Specified by:
      write in interface org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter
      Throws:
      IOException

    • write

      public org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse write(org.apache.hadoop.yarn.server.timelineservice.collector.TimelineCollectorContext context, org.apache.hadoop.yarn.api.records.timelineservice.TimelineDomain domain) throws IOException
      Specified by:
      write in interface org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter
      Throws:
      IOException

    • aggregate

      public org.apache.hadoop.yarn.api.records.timelineservice.TimelineWriteResponse aggregate(org.apache.hadoop.yarn.api.records.timelineservice.TimelineEntity data, org.apache.hadoop.yarn.server.timelineservice.storage.TimelineAggregationTrack track) throws IOException
      Specified by:
      aggregate in interface org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter
      Throws:
      IOException

    • getHealthStatus

      public org.apache.hadoop.yarn.api.records.timeline.TimelineHealth getHealthStatus()
      Specified by:
      getHealthStatus in interface org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter

    • flush

      public void flush() throws IOException
      Specified by:
      flush in interface org.apache.hadoop.yarn.server.timelineservice.storage.TimelineWriter
      Throws:
      IOException

    • serviceStop

      protected void serviceStop() throws Exception
      close the hbase connections The close APIs perform flushing and release any resources held.
      Overrides:
      serviceStop in class org.apache.hadoop.service.AbstractService
      Throws:
      Exception

    • getTimelineStorageMonitor

      protected org.apache.hadoop.yarn.server.timelineservice.storage.TimelineStorageMonitor getTimelineStorageMonitor()