Skip to content
This repository has been archived by the owner on Oct 11, 2024. It is now read-only.

Commit

Permalink
format fix
Browse files Browse the repository at this point in the history
  • Loading branch information
LucasWilkinson committed Feb 14, 2024
1 parent 7f67d62 commit 131a0a5
Show file tree
Hide file tree
Showing 2 changed files with 1 addition and 2 deletions.
2 changes: 1 addition & 1 deletion vllm/model_executor/layers/parameters/lazy_compressed.py
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ def compress(self) -> None:
density = torch.count_nonzero(
self.uncompressed_data).item() / numpy.prod(self.shape)

# only compress if we have sufficient sparsity (>=45%), currently
# only compress if we have sufficient sparsity (>=45%), currently
# this applies globally across all formats including 2:4
if (1 - density) < 0.45:
return
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -71,4 +71,3 @@ def apply_weights(
assert not w.compress_transposed
output = F.linear(x, w.compressed_data.decompress(), bias)
return output

0 comments on commit 131a0a5

Please sign in to comment.