PACCExternal

Instance Constructors

new PACCExternal()

Type Members

case class Config(localThreshold: Int = 100000, numPartitions: Int = 80, inputPath: String = "", outputPath: String = "") extends Product with Serializable

command line interface with default parameters
command line interface with default parameters
localThreshold
if the number of remaining edges are lower than this value, pacc run a single machine algorithm (LocalCC)
numPartitions
the number of partitions
inputPath
input file path
outputPath
output file path

Definition Classes
PACC

Value Members

final def !=(arg0: Any): Boolean

Definition Classes
AnyRef → Any
final def ##(): Int

Definition Classes
AnyRef → Any
final def ==(arg0: Any): Boolean

Definition Classes
AnyRef → Any
val APP_NAME: String

Definition Classes
PACCExternal → PACC
val EXEC_NAME: String

Definition Classes
PACCExternal → PACC
val VERSION: String

Definition Classes
PACC
final def asInstanceOf[T0]: T0

Definition Classes
Any
def ccComputation(remains: RDD[(Long, Long)], numPartitions: Int): RDD[(Long, Long)]

CC-Computation operation.
CC-Computation operation. This operation conducts LocalCC in each partition.
remains
input RDD
numPartitions
the number of partitions
returns
final output RDD containing connected components

Definition Classes
PACC
def clone(): AnyRef

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( ... )
final def eq(arg0: AnyRef): Boolean

Definition Classes
AnyRef
def equals(arg0: Any): Boolean

Definition Classes
AnyRef → Any
def finalize(): Unit

Attributes
protected[java.lang]
Definition Classes
AnyRef
Annotations
@throws( classOf[java.lang.Throwable] )
final def getClass(): Class[_]

Definition Classes
AnyRef → Any
def hashCode(): Int

Definition Classes
AnyRef → Any
final def isInstanceOf[T0]: Boolean

Definition Classes
Any
def largeStar(inputRDD: RDD[(Long, Long)], numPartitions: Int, round: Int, tmpPath: String): (RDD[(Long, Long)], Long, Long, Long, Long)

PA-Large-Star Operation.
PA-Large-Star Operation. For each node n, this operation links each large neighbor v to the minimum node mcu(p(v)) in the same partition p(v) that contains the neighbor v.
inputRDD
the input rdd
numPartitions
the number of partitions
round
current round number
tmpPath
the temporary path to save the intermediate results
returns
(RDD for next round input, # changed edges, # of 'out' edges, # filtered 'cc' edges, # filtered 'in' edges)

Definition Classes
PACCExternal → PACC
final def ne(arg0: AnyRef): Boolean

Definition Classes
AnyRef
final def notify(): Unit

Definition Classes
AnyRef
final def notifyAll(): Unit

Definition Classes
AnyRef
def run(inputPath: String, localThreshold: Int, numPartitions: Int, sc: SparkContext): RDD[(Long, Long)]

submit the spark job.
submit the spark job.
inputPath
input file path.
localThreshold
if the number of remaining edges are lower than this value, pacc run a single machine algorithm (LocalCC).
numPartitions
the number of partitions
sc
spark context.
returns
an RDD containing connected components

Definition Classes
PACC
def runByCLI(args: Array[String]): Unit

run by command line interface
run by command line interface

Definition Classes
PACC
def smallStar(inputRDD: RDD[(Long, Long)], numPartitions: Int, round: Int, tmpPath: String): (RDD[(Long, Long)], Long, Long, Long)

PA-Small-Star Operation.
PA-Small-Star Operation. For each node n, this operation links each small neighbor v to the minimum node mcu(p(v)) in the same partition p(v) that contains the neighbor v.
inputRDD
the input rdd
numPartitions
the number of partitions
round
current round number
tmpPath
the temporary path to save the intermediate results
returns
(RDD for next round input, # changed edges, # of 'out' edges, # filtered 'in' edges)

Definition Classes
PACCExternal → PACC
final def synchronized[T0](arg0: ⇒ T0): T0

Definition Classes
AnyRef
def toString(): String

Definition Classes
AnyRef → Any
final def wait(): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long, arg1: Int): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )
final def wait(arg0: Long): Unit

Definition Classes
AnyRef
Annotations
@throws( ... )

Related Docs: object PACCExternal | package cc

class PACCExternal extends PACC

Instance Constructors

new PACCExternal()

Type Members

case class Config(localThreshold: Int = 100000, numPartitions: Int = 80, inputPath: String = "", outputPath: String = "") extends Product with Serializable

Value Members

final def !=(arg0: Any): Boolean

final def ##(): Int

final def ==(arg0: Any): Boolean

val APP_NAME: String

val EXEC_NAME: String

val VERSION: String

final def asInstanceOf[T0]: T0

def ccComputation(remains: RDD[(Long, Long)], numPartitions: Int): RDD[(Long, Long)]

def clone(): AnyRef

final def eq(arg0: AnyRef): Boolean

def equals(arg0: Any): Boolean

def finalize(): Unit

final def getClass(): Class[_]

def hashCode(): Int

final def isInstanceOf[T0]: Boolean

def largeStar(inputRDD: RDD[(Long, Long)], numPartitions: Int, round: Int, tmpPath: String): (RDD[(Long, Long)], Long, Long, Long, Long)

final def ne(arg0: AnyRef): Boolean

final def notify(): Unit

final def notifyAll(): Unit

def run(inputPath: String, localThreshold: Int, numPartitions: Int, sc: SparkContext): RDD[(Long, Long)]

def runByCLI(args: Array[String]): Unit

def smallStar(inputRDD: RDD[(Long, Long)], numPartitions: Int, round: Int, tmpPath: String): (RDD[(Long, Long)], Long, Long, Long)

final def synchronized[T0](arg0: ⇒ T0): T0

def toString(): String

final def wait(): Unit

final def wait(arg0: Long, arg1: Int): Unit

final def wait(arg0: Long): Unit

Inherited from PACC

Inherited from Serializable

Inherited from Serializable

Inherited from AnyRef

Inherited from Any

Ungrouped