Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

binary [2ʳ - 1, 2ʳ - 1 - r, 3] Hamming code #275

Draft
wants to merge 8 commits into
base: master
Choose a base branch
from
Draft

binary [2ʳ - 1, 2ʳ - 1 - r, 3] Hamming code #275

wants to merge 8 commits into from

Conversation

Fe-r-oz
Copy link
Contributor

@Fe-r-oz Fe-r-oz commented May 16, 2024

Adding family of classical binary [[2ʳ - 1, 2ʳ - 1 - r, 3]] Hamming codes along with Hamming/Sphere-packing, Gilbert-Varshamov, Griesmer and other bounds. I believe it would be nice to have these bounds defined.

Please do let me know that I have defined the bounds at the correct places, meaning in ECC.jl whenever you review this PR. Thanks!

Fe-r-oz added 2 commits May 16, 2024 19:33
Adding family of classical binary [[2ʳ - 1, 2ʳ - 1 - r, 3]] Hamming c…
7fe95f9 
…odes along with Hamming, Gilbert-Varshamov, Griesmer and other bounds
minor fix
ba0c056
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented May 16, 2024 •
edited
Loading

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 16 May 2024 - 14:52
  • Baseline: 16 May 2024 - 15:00
  • Package commits:
  • Target: 275b34
  • Baseline: 44f618
  • Julia commits:
  • Target: e7a1de
  • Baseline: e7a1de
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 0.66 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.87 (5%) ✅ 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 0.67 (5%) ✅ 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_stab"] 0.95 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.94 (5%) ✅ 0.99 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.02 (5%) 1.02 (1%) ❌
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 0.99 (5%) 0.98 (1%) ✅
["pauli", "mul", "20000000"] 0.90 (5%) ✅ 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 1.06 (5%) ❌ 1.00 (1%)
["stabilizer", "tensor", "pow5_20"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2294 s 0 s 160 s 6379 s 0 s
 #2 0 MHz 2164 s 0 s 197 s 6457 s 0 s
 #3 0 MHz 2676 s 0 s 170 s 5988 s 0 s
 #4 0 MHz 2072 s 0 s 162 s 6598 s 0 s
 Memory: 15.606498718261719 GB (13322.94921875 MB free)
 Uptime: 887.03 sec
 Load Avg: 1.05 1.05 0.75
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2984 s 0 s 211 s 10027 s 0 s
 #2 0 MHz 2825 s 0 s 252 s 10131 s 0 s
 #3 0 MHz 3930 s 0 s 218 s 9077 s 0 s
 #4 0 MHz 3882 s 0 s 212 s 9131 s 0 s
 Memory: 15.606498718261719 GB (13326.51953125 MB free)
 Uptime: 1326.84 sec
 Load Avg: 1.0 1.02 0.87
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 16 May 2024 - 14:52
  • Package commit: 275b34
  • Julia commit: e7a1de
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 7.015 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.178 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.002 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 174.275 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.254 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 120.795 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.019 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 118.962 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.611 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 170.017 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.097 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.001 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.559 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.901 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.080 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.856 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.308 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.912 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 133.680 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.059 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.364 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.426 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 6.022 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.117 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 559.033 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 48.381 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.662 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 26.119 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.704 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.420 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 6.020 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 968.547 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 559.062 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.479 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 701.969 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.197 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 584.450 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.858 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.364 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.799 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.374 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.851 ms (5%) 1.77 MiB (1%) 42555
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.377 ms (5%) 3.63 MiB (1%) 82069
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.796 ms (5%) 3.72 MiB (1%) 82955
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.454 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.494 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.997 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 256.589 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.106 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.533 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 687.227 ms (5%) 12.729 ms 173.46 MiB (1%) 1039918
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.421 s (5%) 26.414 ms 355.71 MiB (1%) 2164596
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.410 s (5%) 25.578 ms 352.29 MiB (1%) 2163869
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 387.469 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 820.680 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 815.388 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.195 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 17.297 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 26.457 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.635 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.122 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 24.402 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.204 ns (5%)
["pauli", "mul", "1000"] 17.899 ns (5%)
["pauli", "mul", "100000"] 718.159 ns (5%)
["pauli", "mul", "20000000"] 171.730 μs (5%)
["stabilizer", "canon", "cano500"] 3.059 ms (5%)
["stabilizer", "canon", "diag_cano500"] 603.376 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.123 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 732.517 μs (5%)
["stabilizer", "canon", "gott500"] 6.582 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.564 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.632 ms (5%)
["stabilizer", "canon", "rref500"] 3.153 ms (5%)
["stabilizer", "project", "destabilizer"] 18.394 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.857 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.266 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.648 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.418 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.265 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2294 s 0 s 160 s 6379 s 0 s
 #2 0 MHz 2164 s 0 s 197 s 6457 s 0 s
 #3 0 MHz 2676 s 0 s 170 s 5988 s 0 s
 #4 0 MHz 2072 s 0 s 162 s 6598 s 0 s
 Memory: 15.606498718261719 GB (13322.94921875 MB free)
 Uptime: 887.03 sec
 Load Avg: 1.05 1.05 0.75
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 16 May 2024 - 15:0
  • Package commit: 44f618
  • Julia commit: e7a1de
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 6.971 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.196 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.424 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 174.235 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.705 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.005 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.414 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 119.592 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.510 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 171.911 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.100 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.001 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 64.189 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 173.373 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.103 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.838 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 6.432 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.301 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 135.212 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.055 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.304 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.477 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.802 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.120 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 559.824 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 49.292 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 23.935 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.407 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.304 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.469 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.801 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 968.595 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 559.854 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.485 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 701.097 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.207 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 584.760 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.869 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.789 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.374 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.800 ms (5%) 1.77 MiB (1%) 42541
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.268 ms (5%) 3.63 MiB (1%) 81999
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 5.095 ms (5%) 3.75 MiB (1%) 83795
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.837 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.708 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 51.668 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 255.967 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.084 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.510 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 686.834 ms (5%) 11.748 ms 173.47 MiB (1%) 1040002
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.389 s (5%) 22.652 ms 349.98 MiB (1%) 2130905
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.428 s (5%) 26.311 ms 359.99 MiB (1%) 2209138
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 391.695 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 815.167 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 830.920 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.203 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.764 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.878 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.634 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.576 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.781 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.486 ns (5%)
["pauli", "mul", "1000"] 18.251 ns (5%)
["pauli", "mul", "100000"] 713.295 ns (5%)
["pauli", "mul", "20000000"] 190.986 μs (5%)
["stabilizer", "canon", "cano500"] 3.020 ms (5%)
["stabilizer", "canon", "diag_cano500"] 618.653 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.174 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 731.835 μs (5%)
["stabilizer", "canon", "gott500"] 6.576 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.542 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.556 ms (5%)
["stabilizer", "canon", "rref500"] 3.143 ms (5%)
["stabilizer", "project", "destabilizer"] 17.693 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.696 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.190 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.500 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.108 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.245 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2984 s 0 s 211 s 10027 s 0 s
 #2 0 MHz 2825 s 0 s 252 s 10131 s 0 s
 #3 0 MHz 3930 s 0 s 218 s 9077 s 0 s
 #4 0 MHz 3882 s 0 s 212 s 9131 s 0 s
 Memory: 15.606498718261719 GB (13326.51953125 MB free)
 Uptime: 1326.84 sec
 Load Avg: 1.0 1.02 0.87
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.86
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 16 May 2024 - 15:03
  • Baseline: 16 May 2024 - 15:11
  • Package commits:
  • Target: 758176
  • Baseline: 44f618
  • Julia commits:
  • Target: e7a1de
  • Baseline: e7a1de
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "mctrajectories_union", "q1001_r1"] 1.12 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_destab"] 1.15 (5%) ❌ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.92 (5%) ✅ 0.99 (1%) ✅
["ecc", "evaluate_decoder", "shor_pybp_comm"] 0.95 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 0.95 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.00 (5%) 1.01 (1%) ❌
["pauli", "mul", "20000000"] 1.06 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3057 s 0 s 180 s 5624 s 0 s
 #2 0 MHz 2971 s 0 s 170 s 5720 s 0 s
 #3 0 MHz 1762 s 0 s 168 s 6926 s 0 s
 #4 0 MHz 1498 s 0 s 181 s 7164 s 0 s
 Memory: 15.606498718261719 GB (13273.7578125 MB free)
 Uptime: 890.09 sec
 Load Avg: 1.04 1.03 0.73
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 4375 s 0 s 236 s 8680 s 0 s
 #2 0 MHz 4688 s 0 s 217 s 8384 s 0 s
 #3 0 MHz 2565 s 0 s 217 s 10500 s 0 s
 #4 0 MHz 2112 s 0 s 236 s 10922 s 0 s
 Memory: 15.606498718261719 GB (13299.37109375 MB free)
 Uptime: 1333.7 sec
 Load Avg: 1.0 1.02 0.86
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 16 May 2024 - 15:3
  • Package commit: 758176
  • Julia commit: e7a1de
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 7.211 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.367 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.205 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 172.643 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.442 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.276 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.634 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 119.834 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.662 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 169.256 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.095 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.001 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 43.551 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.451 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.081 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.858 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.378 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.612 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 132.197 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.053 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.334 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.609 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.867 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.120 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 559.555 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 48.520 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.602 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.658 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.834 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.606 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.878 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 966.544 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 559.525 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.473 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 696.150 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.204 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 580.083 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.849 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.354 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.809 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.354 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.802 ms (5%) 1.77 MiB (1%) 42583
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.281 ms (5%) 3.63 MiB (1%) 82083
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.715 ms (5%) 3.72 MiB (1%) 83011
["ecc", "evaluate_decoder", "shor_pybp_comm"] 24.488 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 49.409 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 50.393 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 256.049 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.082 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.512 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 704.103 ms (5%) 12.677 ms 172.10 MiB (1%) 1031924
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.420 s (5%) 32.822 ms 356.14 MiB (1%) 2167158
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.401 s (5%) 29.093 ms 352.45 MiB (1%) 2164800
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 393.235 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 813.742 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 826.420 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.171 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.737 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.950 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.651 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.656 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.935 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.506 ns (5%)
["pauli", "mul", "1000"] 18.218 ns (5%)
["pauli", "mul", "100000"] 730.131 ns (5%)
["pauli", "mul", "20000000"] 197.399 μs (5%)
["stabilizer", "canon", "cano500"] 3.019 ms (5%)
["stabilizer", "canon", "diag_cano500"] 615.219 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.102 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 655.294 μs (5%)
["stabilizer", "canon", "gott500"] 6.551 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.544 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.579 ms (5%)
["stabilizer", "canon", "rref500"] 3.145 ms (5%)
["stabilizer", "project", "destabilizer"] 18.104 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.836 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.172 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.476 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.469 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.435 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3057 s 0 s 180 s 5624 s 0 s
 #2 0 MHz 2971 s 0 s 170 s 5720 s 0 s
 #3 0 MHz 1762 s 0 s 168 s 6926 s 0 s
 #4 0 MHz 1498 s 0 s 181 s 7164 s 0 s
 Memory: 15.606498718261719 GB (13273.7578125 MB free)
 Uptime: 890.09 sec
 Load Avg: 1.04 1.03 0.73
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 16 May 2024 - 15:11
  • Package commit: 44f618
  • Julia commit: e7a1de
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 6.889 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.073 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.289 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 172.723 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.412 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.437 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.112 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 119.744 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 61.716 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 174.015 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.102 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.212 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.690 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 150.692 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.080 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.828 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.308 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.291 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 132.838 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.054 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.314 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.522 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.810 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 975.364 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 559.055 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 48.600 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.733 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.798 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.964 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.533 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.797 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 966.988 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 559.045 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.478 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 700.298 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.197 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 584.473 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.839 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.364 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.799 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.364 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.871 ms (5%) 1.77 MiB (1%) 42695
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.354 ms (5%) 3.62 MiB (1%) 81803
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 5.125 ms (5%) 3.77 MiB (1%) 84285
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.899 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 52.214 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.874 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 257.050 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.085 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.509 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 705.423 ms (5%) 17.249 ms 173.46 MiB (1%) 1039904
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.415 s (5%) 24.702 ms 352.54 MiB (1%) 2145948
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.423 s (5%) 35.703 ms 355.01 MiB (1%) 2179822
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 408.103 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 824.811 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 839.452 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.205 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.910 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.967 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.658 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.717 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.815 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.265 ns (5%)
["pauli", "mul", "1000"] 18.219 ns (5%)
["pauli", "mul", "100000"] 727.098 ns (5%)
["pauli", "mul", "20000000"] 186.298 μs (5%)
["stabilizer", "canon", "cano500"] 3.033 ms (5%)
["stabilizer", "canon", "diag_cano500"] 637.092 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.204 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 655.526 μs (5%)
["stabilizer", "canon", "gott500"] 6.686 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.558 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.590 ms (5%)
["stabilizer", "canon", "rref500"] 3.137 ms (5%)
["stabilizer", "project", "destabilizer"] 17.943 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.567 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.143 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.517 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.188 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.315 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 4375 s 0 s 236 s 8680 s 0 s
 #2 0 MHz 4688 s 0 s 217 s 8384 s 0 s
 #3 0 MHz 2565 s 0 s 217 s 10500 s 0 s
 #4 0 MHz 2112 s 0 s 236 s 10922 s 0 s
 Memory: 15.606498718261719 GB (13299.37109375 MB free)
 Uptime: 1333.7 sec
 Load Avg: 1.0 1.02 0.86
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 48 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 4
On-line CPU(s) list: 0-3
Vendor ID: AuthenticAMD
Model name: AMD EPYC 7763 64-Core Processor
CPU family: 25
Model: 1
Thread(s) per core: 2
Core(s) per socket: 2
Socket(s): 1
Stepping: 1
BogoMIPS: 4890.87
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm
Virtualization: AMD-V
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 64 KiB (2 instances)
L1i cache: 64 KiB (2 instances)
L2 cache: 1 MiB (2 instances)
L3 cache: 32 MiB (1 instance)
NUMA node(s): 1
NUMA node0 CPU(s): 0-3
Vulnerability Gather data sampling: Not affected
Vulnerability Itlb multihit: Not affected
Vulnerability L1tf: Not affected
Vulnerability Mds: Not affected
Vulnerability Meltdown: Not affected
Vulnerability Mmio stale data: Not affected
Vulnerability Retbleed: Not affected
Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode
Vulnerability Spec store bypass: Vulnerable
Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Vulnerability Spectre v2: Mitigation; Retpolines; STIBP disabled; RSB filling; PBRSB-eIBRS Not affected; BHI Not affected
Vulnerability Srbds: Not affected
Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 16 May 2024 - 15:39
  • Baseline: 16 May 2024 - 15:46
  • Package commits:
  • Target: b6c830
  • Baseline: 44f618
  • Julia commits:
  • Target: e7a1de
  • Baseline: e7a1de
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with ❌), while a ratio less
than 1.0 denotes a possible improvement (marked with ✅). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.05 (5%) ❌ 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 0.86 (5%) ✅ 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 0.86 (5%) ✅ 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.93 (5%) ✅ 0.98 (1%) ✅
["ecc", "evaluate_decoder", "toric8_bp_comm"] 1.02 (5%) 0.99 (1%) ✅
["stabilizer", "canon", "diag_rref500"] 1.12 (5%) ❌ 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 1641 s 0 s 157 s 7020 s 0 s
 #2 0 MHz 2274 s 0 s 171 s 6363 s 0 s
 #3 0 MHz 2791 s 0 s 149 s 5882 s 0 s
 #4 0 MHz 2516 s 0 s 189 s 6121 s 0 s
 Memory: 15.606502532958984 GB (13310.5546875 MB free)
 Uptime: 886.27 sec
 Load Avg: 1.0 1.02 0.74
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2519 s 0 s 210 s 10480 s 0 s
 #2 0 MHz 2602 s 0 s 223 s 10375 s 0 s
 #3 0 MHz 4450 s 0 s 196 s 8571 s 0 s
 #4 0 MHz 4065 s 0 s 245 s 8911 s 0 s
 Memory: 15.606502532958984 GB (13313.25390625 MB free)
 Uptime: 1326.35 sec
 Load Avg: 1.03 1.05 0.89
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 16 May 2024 - 15:39
  • Package commit: b6c830
  • Julia commit: e7a1de
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "compactification", "compact"] 6.933 ms (5%)
["circuitsim", "compactification", "no_compact"] 7.119 ms (5%) 281.25 KiB (1%) 6000
["circuitsim", "mctrajectories", "q1001_r1"] 15.428 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 174.656 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.465 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 121.618 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.170 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 119.554 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.120 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 175.839 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.142 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.971 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.750 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 154.058 μs (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.132 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.855 ms (5%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.297 μs (5%)
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.322 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 136.235 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.100 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.314 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.423 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.744 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.119 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 483.214 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 49.682 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 23.735 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 25.447 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.105 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.423 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.747 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 966.765 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 483.214 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.474 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 701.993 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.197 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 584.022 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.849 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.364 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.799 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.364 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.803 ms (5%) 1.77 MiB (1%) 42597
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.318 ms (5%) 3.63 MiB (1%) 82013
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.730 ms (5%) 3.72 MiB (1%) 83053
["ecc", "evaluate_decoder", "shor_pybp_comm"] 25.469 ms (5%) 3.97 MiB (1%) 116084
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 51.740 ms (5%) 7.99 MiB (1%) 228133
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 52.190 ms (5%) 8.07 MiB (1%) 229131
["ecc", "evaluate_decoder", "shor_table_comm"] 256.530 μs (5%) 241.48 KiB (1%) 4595
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.090 ms (5%) 350.88 KiB (1%) 5155
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.514 ms (5%) 440.22 KiB (1%) 6153
["ecc", "evaluate_decoder", "toric8_bp_comm"] 709.353 ms (5%) 14.299 ms 170.29 MiB (1%) 1021312
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.405 s (5%) 28.922 ms 353.60 MiB (1%) 2152206
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.419 s (5%) 25.781 ms 351.99 MiB (1%) 2162098
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 397.493 ms (5%) 7.31 MiB (1%) 135575
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 809.862 ms (5%) 16.90 MiB (1%) 317606
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 819.363 ms (5%) 19.38 MiB (1%) 351522
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.225 ms (5%) 1.95 MiB (1%) 23180
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 17.035 ms (5%) 6.03 MiB (1%) 92823
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 26.123 ms (5%) 8.50 MiB (1%) 126739
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.669 ms (5%) 1.64 MiB (1%) 23086
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.711 ms (5%) 5.38 MiB (1%) 92628
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.807 ms (5%) 7.86 MiB (1%) 126544
["pauli", "mul", "100"] 14.506 ns (5%)
["pauli", "mul", "1000"] 18.820 ns (5%)
["pauli", "mul", "100000"] 727.542 ns (5%)
["pauli", "mul", "20000000"] 188.211 μs (5%)
["stabilizer", "canon", "cano500"] 3.074 ms (5%)
["stabilizer", "canon", "diag_cano500"] 636.992 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.059 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 731.921 μs (5%)
["stabilizer", "canon", "gott500"] 6.496 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.558 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.589 ms (5%)
["stabilizer", "canon", "rref500"] 3.143 ms (5%)
["stabilizer", "project", "destabilizer"] 18.003 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 8.636 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.184 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.449 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.038 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.276 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "compactification"]
  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.541
Commit e7a1def390f (2024-05-16 11:50 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1021-azure #22~22.04.1-Ubuntu SMP Tue Apr 30 16:08:18 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 1641 s 0 s 157 s 7020 s 0 s
 #2 0 MHz 2274 s 0 s 171 s 6363 s 0 s
 #3 0 MHz 2791 s 0 s 149 s 5882 s 0 s
 #4 0 MHz 2516 s 0 s 189 s 6121 s 0 s
 Memory: 15.606502532958984 GB (13310.5546875 MB free)
 Uptime: 886.27 sec
 Load Avg: 1.0 1.02 0.74
 WORD_SIZE: 64
 LLVM: libLLVM-17.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 16 May 2024 - 15:46
  • Package commit: 44f618
  • Julia commit: e7a1de
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks.
The value...[Comment body truncated]

@codecov Codecov
Copy link

codecov bot commented May 16, 2024 •
edited
Loading

Codecov Report

Attention: Patch coverage is 78.04878% with 9 lines in your changes missing coverage. Please review.

Project coverage is 82.35%. Comparing base (44f618a) to head (a756520).
Report is 38 commits behind head on master.

Files with missing lines Patch % Lines
src/ecc/ECC.jl 62.50% 9 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##           master     #275      +/-   ##
==========================================
+ Coverage   82.20%   82.35%   +0.14%     
==========================================
  Files          59       60       +1     
  Lines        3940     3972      +32     
==========================================
+ Hits         3239     3271      +32     
  Misses        701      701

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@Krastanov Krastanov added the ECC Having to do with the ECC submodule label May 19, 2024
@Fe-r-oz Fe-r-oz changed the title Adding family of classical binary [[2ʳ - 1, 2ʳ - 1 - r, 3]] Hamming c… binary [2ʳ - 1, 2ʳ - 1 - r, 3] Hamming code Jul 22, 2024
@Fe-r-oz Fe-r-oz marked this pull request as draft August 4, 2024 15:16
@Krastanov Krastanov added the needs rebase A PR that is nearly done, but a merge conflict needs to be fixed. label Sep 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
ECC Having to do with the ECC submodule needs rebase A PR that is nearly done, but a merge conflict needs to be fixed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Fe-r-oz @Krastanov