To compile cython files:
python code/setup.py build_ext --inplace
To preprocess embeddings for faster loading, do
python code/topicModelP/preprocess_en_embed.py
Basic 20 newsgroup vanilla (discrete LDA)
bash ./bin/runGaussian_py.sh $DATA $SHARED_PARAMS $INTERPOLATE $STAGGER $TRAIN_MODE $NTOPICS $TRAIN_SIZE $SPLIT
Batch run for sungrid engine
bash ./bin/runNews.shbash ./bin/runWiki.sh
See ./bin/runGaussian_py.sh which contains full list of configs and descriptions
For the multi-lingual case, a config file with data_paths should be provided in configs/data_paths.yaml. See example in configs/data_path.yaml
External evaluations (cv, npmi) relies on the Palmetto library. We only conduct external scoring against the monolingual dataset. This code relies on en_words.txt being present in the DIR.
bash ./bin/external_score.sh