Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix gpt-tfjs bugs, add tests and refactor code #658

Merged
merged 30 commits into from
Apr 16, 2024
Merged

Fix gpt-tfjs bugs, add tests and refactor code #658

merged 30 commits into from
Apr 16, 2024

Commits on Apr 8, 2024

  1. Fix repeated token due to wrong text preprocessing

    @JulienVig
    JulienVig committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    9c72f72 View commit details
    Browse the repository at this point in the history

  2. Clean wikitext example

    @JulienVig
    JulienVig committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    133ce56 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Refactor and comment gpt-tfjs implementation

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    94d664a View commit details
    Browse the repository at this point in the history

  2. Refactor gpt-tfjs to support config as intit argument

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    b9e1edc View commit details
    Browse the repository at this point in the history

  3. Fix linting errors

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    6265316 View commit details
    Browse the repository at this point in the history

  4. Use tf.CustomCallbacks rather than redefining it

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    c3134be View commit details
    Browse the repository at this point in the history

  5. Fix tensor allocation leak in training loop

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    20700f3 View commit details
    Browse the repository at this point in the history

  6. Create a compile method to init the gpt-tfjs optimizer

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0b27fe7 View commit details
    Browse the repository at this point in the history

  7. Add tfjs-node as dev dependencies to discojs-core to run gpt-tfjs uni… 

    …t tests
    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    7fa3c12 View commit details
    Browse the repository at this point in the history

  8. Add support and test for gpt config serilization

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    37fbbed View commit details
    Browse the repository at this point in the history

  9. Create node.js model save and load functions

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    f9f932d View commit details
    Browse the repository at this point in the history

  10. Make tokenize preprocessing return a number[] rather than tensor

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    1f9271a View commit details
    Browse the repository at this point in the history

  11. Fix linting errors

    @JulienVig
    JulienVig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    0ed7a1f View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Fix linting error and increase gpt test timeout

    @JulienVig
    JulienVig committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    433959b View commit details
    Browse the repository at this point in the history

  2. Create text preprocessing test cases

    @JulienVig
    JulienVig committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    2e6e834 View commit details
    Browse the repository at this point in the history

  3. discojs-core/package.json: fix tfjs-node major version

    @JulienVig
    JulienVig authored Apr 10, 2024
    Configuration menu
    Copy the full SHA
    2faae1c View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Change variable function to actual function 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    d808d8e View commit details
    Browse the repository at this point in the history

  2. Use dot notion 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    5eba6b2 View commit details
    Browse the repository at this point in the history

  3. Use dot notion 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    cb40e6b View commit details
    Browse the repository at this point in the history

  4. Use dot notion 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    73300b6 View commit details
    Browse the repository at this point in the history

  5. Remove test error log when expected 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    d287fd3 View commit details
    Browse the repository at this point in the history

  6. Remove test error log when expected 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    1650349 View commit details
    Browse the repository at this point in the history

  7. Remove try catch around file read 

    Co-authored-by: Valérian Rousset <[email protected]>
    @JulienVig @tharvik
    JulienVig and tharvik authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    1677af8 View commit details
    Browse the repository at this point in the history

  8. Use async functions to save and load models from disk

    @JulienVig
    JulienVig committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    a7655e6 View commit details
    Browse the repository at this point in the history

  9. Fix linting error

    @JulienVig
    JulienVig committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    21f371c View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. improve wikitext example

    @JulienVig
    JulienVig committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    6721717 View commit details
    Browse the repository at this point in the history

  2. Merge with develop

    @JulienVig
    JulienVig committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    1f0c526 View commit details
    Browse the repository at this point in the history

  3. Fixup merge with develop

    @JulienVig
    JulienVig committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    a19fd2b View commit details
    Browse the repository at this point in the history

  4. Rework training logs

    @JulienVig
    JulienVig committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    5c5ecde View commit details
    Browse the repository at this point in the history

  5. Fix training logs web-client

    @JulienVig
    JulienVig committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    a80c403 View commit details
    Browse the repository at this point in the history