Skip to content

Commit

Permalink
refactor: bump & adjust estimation
Browse files Browse the repository at this point in the history
Signed-off-by: thxCode <[email protected]>
  • Loading branch information
thxCode committed Sep 2, 2024
1 parent 581a061 commit 8d86931
Show file tree
Hide file tree
Showing 5 changed files with 7 additions and 7 deletions.
2 changes: 1 addition & 1 deletion cmd/gguf-packer/estimate.go
Original file line number Diff line number Diff line change
Expand Up @@ -457,7 +457,7 @@ func estimate(app string) *cobra.Command {
c.Flags().Uint64Var(&offloadLayersStep, "gpu-layers-step", offloadLayersStep, "Specify the offload layers step.")
c.Flags().StringSliceVar(&deviceMetrics, "device-metric", deviceMetrics, "Specify the device metric, in form of \"FLOPS;Up Bandwidth[;Down Bandwidth]\". "+
"The FLOPS unit, select from [PFLOPS, TFLOPS, GFLOPS, MFLOPS, KFLOPS]. "+
"The Up/Down Bandwidth unit, select from [PiBps, PBps, TiBps, TBps, GiBps, GBps, MiBps, MBps, KiBps, KBps].")
"The Up/Down Bandwidth unit, select from [PiBps, TiBps, GiBps, MiBps, KiBps, PBps, TBps, GBps, MBps, KBps, Pbps, Tbps, Gbps, Mbps, Kbps].")
c.Flags().BoolVar(&inShort, "in-short", inShort, "Output as short format.")
c.Flags().BoolVar(&inJson, "json", inJson, "Output as JSON.")
return c
Expand Down
2 changes: 1 addition & 1 deletion cmd/gguf-packer/go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ require (
github.com/dustin/go-humanize v1.0.1
github.com/google/go-containerregistry v0.20.2
github.com/gpustack/gguf-packer-go v0.0.0-00010101000000-000000000000
github.com/gpustack/gguf-parser-go v0.10.0
github.com/gpustack/gguf-parser-go v0.10.1
github.com/jedib0t/go-pretty/v6 v6.5.9
github.com/moby/buildkit v0.15.2
github.com/opencontainers/go-digest v1.0.0
Expand Down
4 changes: 2 additions & 2 deletions cmd/gguf-packer/go.sum

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ require (
github.com/containerd/platforms v0.2.1
github.com/distribution/reference v0.6.0
github.com/docker/go-units v0.5.0
github.com/gpustack/gguf-parser-go v0.10.0
github.com/gpustack/gguf-parser-go v0.10.1
github.com/mitchellh/hashstructure/v2 v2.0.2
github.com/moby/buildkit v0.15.2
github.com/moby/patternmatcher v0.6.0
Expand Down
4 changes: 2 additions & 2 deletions go.sum

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

0 comments on commit 8d86931

Please sign in to comment.