Skip to content

Commit

Permalink
Update README.md: Refactor Fluent UI v9 display and add browser demo …
Browse files Browse the repository at this point in the history
…section
  • Loading branch information
aeltorio committed Oct 7, 2024
1 parent 0151fd8 commit e72b526
Showing 1 changed file with 7 additions and 2 deletions.
9 changes: 7 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
# Javascript wrapper for the sentencepiece library

## Browser demo
![Build React App](https://github.com/sctg-development/sentencepiece-js/actions/workflows/build_react.yaml/badge.svg)
![Publish to npmjs registry](https://github.com/sctg-development/sentencepiece-js/actions/workflows/build.yaml/badge.svg)

On Github Pages you can see Sentencepiece used for counting the token using [Meta Llama 3.1 tokenizer model](https://huggingface.co/spaces/Xanthius/llama-token-counter/blob/main/tokenizer.model) https://sctg-development.github.io/sentencepiece-js/ no data is sent to the server.
## Browser Demo

You can see Sentencepiece-js in action for counting and displaying tokens using the [Meta Llama 3.1 tokenizer model](https://huggingface.co/spaces/Xanthius/llama-token-counter/blob/main/tokenizer.model) on GitHub Pages: https://sctg-development.github.io/sentencepiece-js/. All computations are performed in your browser, and no data is sent to the server. To display the tokens, click on the `tokens` link.

This simple React app is located in the `tokenCount` directory of this repository. It is built with React 18, Vite, and the Fluent UI v9 framework.

## Build

Expand Down

0 comments on commit e72b526

Please sign in to comment.