Add the F8E4M3 dtype for CUDA and CPU#2546

Closed

EricLBuehler wants to merge 94 commits intohuggingface:mainfrom EricLBuehler:f8_dtype

+6,219-1,095

Commits on May 15, 2024

Commits on May 16, 2024

Commits on May 18, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on May 19, 2024

Remove candle-layer-norm (#6 )

EricLBuehler
and
LaurentMazare
authored
Merge
EricLBuehler
committed

Commits on May 27, 2024

Merge
EricLBuehler
committed

Commits on May 28, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on May 29, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on May 30, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Jun 1, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Jun 3, 2024

Commits on Jun 4, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Jun 9, 2024

Commits on Jun 11, 2024

Commits on Jun 29, 2024

Add QTensor::quantize_onto (#12 )
EricLBuehler
authored
implement Slice op (huggingface#2260 )

shua
authored and
EricLBuehler
committed
Fix the fast bf16 gemm cublas kernels. (huggingface#2274 )

LaurentMazare
authored and
EricLBuehler
committed
Fix a bug in the metal implemtation of col2im1d. (huggingface#2284 )

LaurentMazare
authored and
EricLBuehler
committed
Depth Anything v2 (huggingface#2279 )

authored and
EricLBuehler
committed
Adding Gemm and ArgMax operators to candle-onnx (huggingface#2231 )

authored and
EricLBuehler
committed
Add DINOv2Reg4 + PlantCLEF2024 (huggingface#2293 )

authored and
EricLBuehler
committed
make up for the missing last token output of phi2 example (huggingface#2299 )

Czxck001
authored and
EricLBuehler
committed

Commits on Jun 30, 2024

Patch metal function
EricLBuehler
committed

Commits on Jul 15, 2024

Complete merge
EricLBuehler
committed

Commits on Jul 26, 2024

Commits on Jul 31, 2024

Merge remote-tracking branch 'upstream/main'
EricLBuehler
committed

Commits on Aug 7, 2024

Simplify things a bit
EricLBuehler
committed

Commits on Aug 9, 2024

Mistral.rs GPTQ dev PR (#14 )
EricLBuehler
authored

Commits on Aug 14, 2024

Fix on metal
EricLBuehler
committed
Add the flux model for image generation. (huggingface#2390 )

LaurentMazare
authored and
EricLBuehler
committed
Simplify handling of flux modulations. (huggingface#2394 )

LaurentMazare
authored and
EricLBuehler
committed
optimize gradient for silu a bit (huggingface#2393 )

MilkFather
authored and
EricLBuehler
committed
Support the flux-dev model too. (huggingface#2395 )

LaurentMazare
authored and
EricLBuehler
committed
Support for mistral-nemo. (huggingface#2396 )

LaurentMazare
authored and
EricLBuehler
committed
add models support and example for THUDM/glm-4 (huggingface#2362 )

authored and
EricLBuehler
committed
Add the MMDiT model of Stable Diffusion 3 (huggingface#2397 )

Czxck001
authored and
EricLBuehler
committed
Add the import script for the T5 tokenizer. (huggingface#2399 )

LaurentMazare
authored and
EricLBuehler
committed
fix: usage of actions/checkout@v2 (huggingface#2403 )

hamirmahal
authored and
EricLBuehler
committed
Fix issues in the encodec example README.md (huggingface#2407 )

jnises
authored and
EricLBuehler
committed
Soft Non-Maximum Suppression (huggingface#2400 )

onichmath
authored and
EricLBuehler
committed
Add documentation examples for Tensor::i and Tensor::narrow methods (huggingface#2308 )

authored and
EricLBuehler
committed
Add Based LLM from Hazy Research. (huggingface#2411 )

janimo
authored and
EricLBuehler
committed
Fix the device for the bert attention mask. (huggingface#2414 )

LaurentMazare
authored and
EricLBuehler
committed
Clippy fixes. (huggingface#2415 )

LaurentMazare
authored and
EricLBuehler
committed
Update flash_fwd_launch_template.h with fix for kernels (#16 )
joshpopelka20
authored
Build fixes
EricLBuehler
committed
Merge branch 'sdpa'
EricLBuehler
committed

Commits on Aug 21, 2024

Add GGUF BF16 support (#17 )
EricLBuehler
authored

Commits on Aug 22, 2024

Commits on Sep 2, 2024

Update kernels for metal bf16 (#19 )
EricLBuehler
authored

Commits on Sep 5, 2024

fix(metal/accelerate): f64-f32 type mismatch (#20 )
sammcj
authored

Commits on Sep 6, 2024

Bump the version to 0.6.1. (huggingface#2438 )

LaurentMazare
authored and
EricLBuehler
committed
onnx: workaround pow with negative base (huggingface#2439 )

shua
authored and
EricLBuehler
committed
onnx: support negative index in Gather (huggingface#2440 )

shua
authored and
EricLBuehler
committed
silero-vad v5 example (huggingface#2321 )

authored and
EricLBuehler
committed
Fix for parler-tts, do not add the last slice of padding tokens. (huggingface#2442 )

LaurentMazare
authored and
EricLBuehler
committed
Add FastViT model. (huggingface#2444 )

janimo
authored and
EricLBuehler
committed
fix: qwen2 lm_head loading huggingface#2443 (huggingface#2445 )

authored and
EricLBuehler
committed
Update cudarc to 0.12. (huggingface#2451 )

LaurentMazare
authored and
EricLBuehler
committed
FastViT fixes. (huggingface#2452 )

janimo
authored and
EricLBuehler
committed
MobileCLIP models S1 and S2 (huggingface#2454 )

authored and
EricLBuehler
committed
Fix FLUX.1 weights (huggingface#2457 )

eugenehp
authored and
EricLBuehler
committed
Clippy fixes for 1.81.0. (huggingface#2461 )

LaurentMazare
authored and
EricLBuehler
committed

Commits on Sep 11, 2024

Commits on Sep 13, 2024

Commits on Sep 15, 2024

Add the i16 dtype (2) (#26 )
ro99
authored

Commits on Oct 2, 2024

Commits on Oct 3, 2024

Fix set_dtype
EricLBuehler
committed

Commits on Oct 6, 2024

Add initial f8 e4m3 type
EricLBuehler
committed