Value Members

1.  final def !=(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

2.  final def ##(): Int

   Definition Classes

   AnyRef → Any

3.  final def ==(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

4.  final def asInstanceOf[T0]: T0

   Definition Classes

   Any

5.  def clone(): AnyRef

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... ) @native()

6.  def create(numTasks: Int, spark: SparkSession, driverListenPort: Int, timeout: Double, useBarrierExecutionMode: Boolean): NetworkManager

   Create a NetworkManager, which will encapsulate all network operations.

   Create a NetworkManager, which will encapsulate all network operations. This method will opens a socket communications channel on the driver, and then initialize the network manager itself. The NetworkManager object will start a thread that waits for the host:port from the executors, and then sends back the information to the executors.

   numTasks

   The total number of training tasks to wait for.

   returns

   The NetworkTopology.

7.  final def eq(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

8.  def equals(arg0: Any): Boolean

   Definition Classes

   AnyRef → Any

9.  def finalize(): Unit

   Attributes

   protected[lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( classOf[java.lang.Throwable] )

10.  def findOpenPort(ctx: TrainingContext, log: Logger): Option[Socket]
11.  final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

12.  def getGlobalNetworkInfo(ctx: TrainingContext, log: Logger, taskId: Long, partitionId: Int, shouldExecuteTraining: Boolean, measures: TaskInstrumentationMeasures): NetworkTopologyInfo

    Retrieve the network nodes and current port information from the driver.

    Retrieve the network nodes and current port information from the driver.

    Establish local socket connection.

    Note: Ideally we would start the socket connections in the C layer, this opens us up for race conditions in case other applications open sockets on cluster, but usually this should not be a problem

    ctx

    Information about the current training session.

    log

    The Logger.

    taskId

    The task id.

    partitionId

    The partition id.

    shouldExecuteTraining

    Whether this task should be a part of the training network.

    measures

    Instrumentation for perf measurements.

13.  def getMainWorkerPort(nodes: String, log: Logger): Int

    Gets the main node's port that will return the LightGBM Booster.

    Gets the main node's port that will return the LightGBM Booster. Used to minimize network communication overhead in reduce step.

    returns

    The main node's port number.

14.  def getNetworkTopologyInfoFromDriver(networkParams: NetworkParams, taskId: Long, partitionId: Int, localListenPort: Int, log: Logger, shouldExecuteTraining: Boolean): NetworkTopologyInfo
15.  def hashCode(): Int

    Definition Classes

    AnyRef → Any

    Annotations

    @native()

16.  def initLightGBMNetwork(ctx: PartitionTaskContext, log: Logger, retry: Int = LightGBMConstants.NetworkRetries, delay: Long = LightGBMConstants.InitialDelay): Unit
17.  final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

18.  final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

19.  final def notify(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

20.  final def notifyAll(): Unit

    Definition Classes

    AnyRef

    Annotations

    @native()

21.  def parseExecutorPartitionList(partitionsByExecutorStr: String, executorId: String): Array[Int]
22.  def parseWorkerMessage(message: String): TaskMessageInfo
23.  def setFinishedStatus(networkParams: NetworkParams, log: Logger): Unit
24.  final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

25.  def toString(): String

    Definition Classes

    AnyRef → Any

26.  final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

27.  final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

28.  final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... ) @native()