Skip to content

Processing Stages

Jump to bottom
kamir edited this page Jul 4, 2012 · 12 revisions

Creation and Storage of Nodes Data

  1. Nodes are entities, stored in a database, described by properties in records, eventually spread over different tables or databases.
  2. Time dependent properties are stored in a time series store (TSS).
  3. Node data can contain raw data, which is processed by a pre processing stage (PPS), utilizing the cluster
  4. for a node we store raw data or preprocessed data, together with its pre processing stage parameters (PPSP)

Creation and Storage of Link Data

  1. Links are identified by a link creation mode (LCM), which for itself is parametrized by a set of LCM parameters (LCMP).
  2. LCM : are program modules, which are deployed to the system as modules or connected as whole subsystems.
  3. LCMP : is a set of METADATA which also includes one copy of the executable to reproduce the calculation.
  4. LCM working on just one property per node, a set of properties per node or whole time series of data per node
  5. the kind of calculation decides what subsystem has to be used (MATLAB, R, CUDA, Hadoop M/R)

Definition of Complex Systems Views

  1. Complex system representation (CSR) are defined by an initial node selection, called NodeGroup (NG)
  2. a Complex systems view (CSV) is defined by a combination of a CSR and LCM including its special LCMP
  3. CSV : are described by a set of METADATA, calculated by LCM, and represented by a link set (LS)
  4. CSV : can be prepared to track a complex systems properties in time
  5. CSV : are created by implementations of LCM, either by MATLAB programs, CUDA programs or Map Reduce programs on a Hadoop systems using Mahout or Giraph
  6. CSV : are processed in the same fashion like they are created but with different algorithms

Processing of Complex Systems Views

  1. Complex systems view (CSV) is defined by a combination of a CSR and LCM including its special LCMP
  2. CSV : are described by a set of METADATA, calculated by LCM, and represented by a link set (LS)
  3. CSV : can be prepared to track a complex systems properties in time
  4. CSV : are created either by MATLAB programs, CUDA programs or Map Reduce programs on a Hadoop systems using Mahout or Giraph
Clone this wiki locally