Package org.apache.spark.sql.pipelines.graph

Class FlowSystemMetadata

Object

org.apache.spark.sql.pipelines.graph.FlowSystemMetadata

All Implemented Interfaces:

Serializable, org.apache.spark.internal.Logging, SystemMetadata, scala.Equals, scala.Product

public class FlowSystemMetadata
extends Object
implements SystemMetadata, org.apache.spark.internal.Logging, scala.Product, Serializable

Represents the system metadata associated with a Flow.

See Also:

• Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.spark.internal.Logging

org.apache.spark.internal.Logging.LogStringContext, org.apache.spark.internal.Logging.SparkShellLoggingFilter

Constructor Summary

Constructors

Constructor	Description
FlowSystemMetadata(PipelineUpdateContext context, Flow flow, DataflowGraph graph)

Method Summary

Modifier and Type	Method	Description
abstract static R	apply(T1 v1, T2 v2, T3 v3)
PipelineUpdateContext	context()
Flow	flow()
DataflowGraph	graph()
String	latestCheckpointLocation()	Returns the location for the most recent checkpoint of a given flow.
scala.Option<String>	latestCheckpointLocationOpt()	Same as latestCheckpointLocation() but returns None if the flow checkpoints directory does not exist.
static String	toString()

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Equals

canEqual, equals

Methods inherited from interface org.apache.spark.internal.Logging

initializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logBasedOnLevel, logDebug, logDebug, logDebug, logDebug, logError, logError, logError, logError, logInfo, logInfo, logInfo, logInfo, logName, LogStringContext, logTrace, logTrace, logTrace, logTrace, logWarning, logWarning, logWarning, logWarning, MDC, org$apache$spark$internal$Logging$$log_, org$apache$spark$internal$Logging$$log__$eq, withLogContext

Methods inherited from interface scala.Product

productArity, productElement, productElementName, productElementNames, productIterator, productPrefix

Constructor Details

FlowSystemMetadata

public FlowSystemMetadata(PipelineUpdateContext context,
 Flow flow,
 DataflowGraph graph)

Method Details

apply

public abstract static R apply(T1 v1,
 T2 v2,
 T3 v3)

toString

public static String toString()

context

public PipelineUpdateContext context()

flow

public Flow flow()

graph

public DataflowGraph graph()

latestCheckpointLocation

public String latestCheckpointLocation()

Returns the location for the most recent checkpoint of a given flow.

latestCheckpointLocationOpt

public scala.Option<String> latestCheckpointLocationOpt()

Same as latestCheckpointLocation() but returns None if the flow checkpoints directory does not exist.

Returns:

(undocumented)