Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add processing for ICLR-GREAT Paper and Fix bugs #8

Merged
merged 14 commits into from
Aug 25, 2020
Merged

Add processing for ICLR-GREAT Paper and Fix bugs #8

merged 14 commits into from
Aug 25, 2020

Commits on Aug 4, 2020

  1. Add data generation for ICLR-GREAT model 

    Add JsonVisitor to preprocess dataset
for the ICLR-GREAT model. Also hack-fix
some of the NullPointer / Peek errors.
    @hsellik
    hsellik committed Aug 4, 2020
    Configuration menu
    Copy the full SHA
    8eb4d8a View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2020

  1. Add extra flushing to data generator

    @hsellik
    hsellik committed Aug 5, 2020
    Configuration menu
    Copy the full SHA
    81134ea View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2020

  1. Refactor DataGenerator to use less memory 

    Refactored DataGenerator in general and
added BufferedOutputStream to flush
and avoid running out of memory with
bigger datasets.
    @hsellik
    hsellik committed Aug 6, 2020
    Configuration menu
    Copy the full SHA
    81120b0 View commit details
    Browse the repository at this point in the history

  2. Catch exception when code can't be parsed 

    If processing huge datasets there are bound
to be code that on purpose doesn't compile.
This commit will catch those examples and
ignores them.
    @hsellik
    hsellik committed Aug 6, 2020
    Configuration menu
    Copy the full SHA
    052abd1 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2020

  1. Refactor and add javadoc

    @hsellik
    hsellik committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    d4f4837 View commit details
    Browse the repository at this point in the history

  2. Add tests for Enums and unparsable code

    @hsellik
    hsellik committed Aug 10, 2020
    Configuration menu
    Copy the full SHA
    015c8ed View commit details
    Browse the repository at this point in the history

Commits on Aug 11, 2020

  1. Fix enum test

    @hsellik
    hsellik committed Aug 11, 2020
    Configuration menu
    Copy the full SHA
    df56817 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2020

  1. Update JsonVisitor to produce imbalanced data

    @hsellik
    hsellik committed Aug 12, 2020
    Configuration menu
    Copy the full SHA
    5c7df43 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2020

  1. Catch InvalidPathException when reading files

    @hsellik
    hsellik committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    13a2b67 View commit details
    Browse the repository at this point in the history

  2. Continue DataGenerator when error during reading

    @hsellik
    hsellik committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    76b9abb View commit details
    Browse the repository at this point in the history

  3. Refactor naming for ICLR20-Great related code

    @hsellik
    hsellik committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    e9e98c9 View commit details
    Browse the repository at this point in the history

  4. Disable Enum test

    @hsellik
    hsellik committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    b229d9e View commit details
    Browse the repository at this point in the history

  5. Fix test description for unparsable code

    @hsellik
    hsellik committed Aug 13, 2020
    Configuration menu
    Copy the full SHA
    210c79b View commit details
    Browse the repository at this point in the history

Commits on Aug 17, 2020

  1. Fix bug in imbalanced data generation

    @hsellik
    hsellik committed Aug 17, 2020
    Configuration menu
    Copy the full SHA
    dc6bd7f View commit details
    Browse the repository at this point in the history