Calculate perplexity of ISQ models

[EricLBuehler]

Currently planning to add support for calibrated ISQ.

[github-actions]

Code Metrics Report

  ===============================================================================
 Language            Files        Lines         Code     Comments       Blanks
===============================================================================
 C Header                2           35           28            0            7
 Dockerfile              1           41           22           10            9
 Happy                   1          442          369            0           73
 JSON                   12          105          104            0            1
 Python                 53         2274         1949           63          262
 Shell                   1           57           22           18           17
 TOML                   18          583          520            2           61
 YAML                    2           21           19            2            0
-------------------------------------------------------------------------------
 Jupyter Notebooks       4            0            0            0            0
 |- Markdown             2           77           32           31           14
 |- Python               2          196          169            1           26
 (Total)                            273          201           32           40
-------------------------------------------------------------------------------
 Markdown               40         3009            0         2286          723
 |- BASH                 6          101           98            0            3
 |- JSON                 1           12           12            0            0
 |- Python               6          114          102            0           12
 |- Rust                10          361          306            0           55
 |- TOML                 2           75           63            0           12
 (Total)                           3672          581         2286          805
-------------------------------------------------------------------------------
 Rust                  280        85018        76288         1765         6965
 |- Markdown           136         1436           25         1307          104
 (Total)                          86454        76313         3072         7069
===============================================================================
 Total                 415        91585        79321         4146         8118
===============================================================================
  

[EricLBuehler]

wget https://huggingface.co/datasets/EricB/wikitext2/resolve/main/wiki.test_small.raw
cargo run --features cuda --release --example perplexity '--' -f wiki.test_small.raw --isq q8_0