Apache SAMOA is a platform for mining on big data streams. It is a distributed streaming machine learning (ML) framework that contains a programing abstraction for distributed streaming ML algorithms.
Apache SAMOA enables development of new ML algorithms without dealing with the complexity of underlying streaming processing engines (SPE, such as Apache Storm and Apache S4). Apache SAMOA also provides extensibility in integrating new SPEs into the framework. These features allow Apache SAMOA users to develop distributed streaming ML algorithms once and to execute the algorithms in multiple SPEs, i.e., code the algorithms once and execute them in multiple SPEs.
###Storm mode
Simply clone the repository and install SAMOA.
git clone http://git.apache.org/incubator-samoa.git
cd incubator-samoa
mvn -Pstorm package
The deployable jar for SAMOA will be in target/SAMOA-Storm-0.3.0-SNAPSHOT.jar
.
###S4 mode
If you want to compile SAMOA for S4, you will need to install the S4 dependencies manually as explained in Executing SAMOA with Apache S4.
Once the dependencies if needed are installed, you can simply clone the repository and install SAMOA.
git clone http://git.apache.org/incubator-samoa.git
cd incubator-samoa
mvn -Ps4 package
###Local mode
If you want to test SAMOA in a local environment, simply clone the repository and install SAMOA.
git clone http://git.apache.org/incubator-samoa.git
cd incubator-samoa
mvn package
The deployable jar for SAMOA will be in target/SAMOA-Local-0.3.0-SNAPSHOT.jar
.
The documentation is intended to give an introduction on how to use Apache SAMOA in the various possible ways. As a user you can use it to develop new algorithms and test different Distributed Stream Processing Engines.
G. De Francisci Morales, A. Bifet SAMOA: Scalable Advanced Massive Online Analysis Journal of Machine Learning Research, 16(Jan):149−153, 2015.
List of contributors to the Apache SAMOA project
The use and distribution terms for this software are covered by the Apache License, Version 2.0 (http://www.apache.org/licenses/LICENSE-2.0.html).