Skip to content

jpatanooga/Canova

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

75 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Canova

Description

A tool focused simply on vectorizing raw data into usable vector formats across machine learning tools.

Example

  • Convert the MNIST dataset from raw binary files to the svmLight text format.
  • Convert raw text into the Metronome vector format
  • Convert raw text into TF-IDF based vectors in a text vector format {svmLight, metronome, arff}
  • Convert raw text into the word2vec in a text vector format {svmLight, metronome, arff}

Targeted Vectorization Engines

  • MNIST to vectors
  • Text to vectors
    • TF-IDF
    • Bag of Words
    • word2vec

Execution

Runs as both a local serial process and a MapReduce scale out process with no code changes.

Targetted Vector Formats

  • svmLight
  • libsvm
  • Metronome
  • ARFF

Built-In General Functionality

  • Understands how to take general text and convert it into vectors with stock techniques such as kernel hashing and TF-IDF [TODO]

About

General Vectorization Lib for Machine Learning Tools

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published