Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chore: use stable firefox release in browser tests #7318

Merged
merged 2 commits into from
Jan 2, 2025
Merged

chore: use stable firefox release in browser tests #7318

merged 2 commits into from
Jan 2, 2025

Conversation

nflaig
Copy link
Member

@nflaig nflaig commented Dec 19, 2024

Motivation

Closes #7307

Description

Use stable firefox release in browser tests

Their latest tag seems to refer to nightly builds (works on mac as confirmed by @nazarhussain)

❯ npx @puppeteer/browsers install firefox@latest --path /tmp
Need to install the following packages:
@puppeteer/[email protected]
Ok to proceed? (y) y

Downloading firefox nightly_135.0a1 - 148.3 MB [====================] 100% 0.0s

but the specific version is missing for Linux which causes the CI to fail

@codecov Codecov
Copy link

codecov bot commented Dec 19, 2024 •
edited
Loading

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 48.75%. Comparing base (8c7eaf8) to head (28f07e1).
Report is 7 commits behind head on unstable.

Additional details and impacted files 
@@            Coverage Diff            @@
##           unstable    #7318   +/-   ##
=========================================
  Coverage     48.75%   48.75%           
=========================================
  Files           601      601           
  Lines         40222    40222           
  Branches       2061     2061           
=========================================
  Hits          19609    19609           
  Misses        20575    20575           
  Partials         38       38

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Dec 19, 2024 •
edited
Loading

Performance Report

✔️ no performance regression detected

🚀🚀 Significant benchmark improvement detected

Benchmark suite Current: b267a34 Previous: 5916e00 Ratio
Buffer.compare 32 - random bytes 17.164 ns/op 58.046 ns/op 0.30
Buffer.compare 1024 - random bytes 16.955 ns/op 55.056 ns/op 0.31
Buffer.compare 123687377 - random bytes 18.490 ns/op 63.100 ns/op 0.29
wrappedArray get 100000 times 32.544 us/op 103.01 us/op 0.32
arrayWithProxy get 100000 times 12.185 ms/op 41.353 ms/op 0.29
findModifiedValidators - 10 modified validators 143.08 ms/op 437.77 ms/op 0.33
Full benchmark results
Benchmark suite Current: b267a34 Previous: 5916e00 Ratio
getPubkeys - index2pubkey - req 1000 vs - 250000 vc 1.7089 ms/op 1.6587 ms/op 1.03
getPubkeys - validatorsArr - req 1000 vs - 250000 vc 46.142 us/op 63.983 us/op 0.72
BLS verify - blst 790.11 us/op 952.01 us/op 0.83
BLS verifyMultipleSignatures 3 - blst 1.1743 ms/op 1.4927 ms/op 0.79
BLS verifyMultipleSignatures 8 - blst 1.6167 ms/op 2.3230 ms/op 0.70
BLS verifyMultipleSignatures 32 - blst 4.7338 ms/op 6.2043 ms/op 0.76
BLS verifyMultipleSignatures 64 - blst 8.8002 ms/op 12.807 ms/op 0.69
BLS verifyMultipleSignatures 128 - blst 16.855 ms/op 21.879 ms/op 0.77
BLS deserializing 10000 signatures 676.01 ms/op 850.82 ms/op 0.79
BLS deserializing 100000 signatures 6.7449 s/op 9.0762 s/op 0.74
BLS verifyMultipleSignatures - same message - 3 - blst 850.41 us/op 1.0196 ms/op 0.83
BLS verifyMultipleSignatures - same message - 8 - blst 1.0464 ms/op 1.1904 ms/op 0.88
BLS verifyMultipleSignatures - same message - 32 - blst 1.6841 ms/op 1.9472 ms/op 0.86
BLS verifyMultipleSignatures - same message - 64 - blst 2.6105 ms/op 3.5328 ms/op 0.74
BLS verifyMultipleSignatures - same message - 128 - blst 4.2799 ms/op 5.3480 ms/op 0.80
BLS aggregatePubkeys 32 - blst 19.807 us/op 27.354 us/op 0.72
BLS aggregatePubkeys 128 - blst 69.716 us/op 91.662 us/op 0.76
notSeenSlots=1 numMissedVotes=1 numBadVotes=10 52.416 ms/op 129.04 ms/op 0.41
notSeenSlots=1 numMissedVotes=0 numBadVotes=4 45.903 ms/op 95.092 ms/op 0.48
notSeenSlots=2 numMissedVotes=1 numBadVotes=10 42.650 ms/op 86.655 ms/op 0.49
getSlashingsAndExits - default max 155.78 us/op 267.31 us/op 0.58
getSlashingsAndExits - 2k 479.68 us/op 512.62 us/op 0.94
proposeBlockBody type=full, size=empty 6.4985 ms/op 5.9825 ms/op 1.09
isKnown best case - 1 super set check 305.00 ns/op 310.00 ns/op 0.98
isKnown normal case - 2 super set checks 277.00 ns/op 270.00 ns/op 1.03
isKnown worse case - 16 super set checks 277.00 ns/op 272.00 ns/op 1.02
InMemoryCheckpointStateCache - add get delete 3.0840 us/op 2.8270 us/op 1.09
validate api signedAggregateAndProof - struct 1.3546 ms/op 1.5722 ms/op 0.86
validate gossip signedAggregateAndProof - struct 1.4122 ms/op 1.4742 ms/op 0.96
batch validate gossip attestation - vc 640000 - chunk 32 129.43 us/op 130.46 us/op 0.99
batch validate gossip attestation - vc 640000 - chunk 64 111.55 us/op 115.23 us/op 0.97
batch validate gossip attestation - vc 640000 - chunk 128 105.05 us/op 113.82 us/op 0.92
batch validate gossip attestation - vc 640000 - chunk 256 105.98 us/op 109.28 us/op 0.97
pickEth1Vote - no votes 1.0167 ms/op 1.0445 ms/op 0.97
pickEth1Vote - max votes 5.6916 ms/op 6.6588 ms/op 0.85
pickEth1Vote - Eth1Data hashTreeRoot value x2048 11.482 ms/op 12.215 ms/op 0.94
pickEth1Vote - Eth1Data hashTreeRoot tree x2048 15.964 ms/op 18.576 ms/op 0.86
pickEth1Vote - Eth1Data fastSerialize value x2048 455.63 us/op 526.66 us/op 0.87
pickEth1Vote - Eth1Data fastSerialize tree x2048 3.3702 ms/op 3.5203 ms/op 0.96
bytes32 toHexString 496.00 ns/op 444.00 ns/op 1.12
bytes32 Buffer.toString(hex) 247.00 ns/op 261.00 ns/op 0.95
bytes32 Buffer.toString(hex) from Uint8Array 392.00 ns/op 396.00 ns/op 0.99
bytes32 Buffer.toString(hex) + 0x 245.00 ns/op 272.00 ns/op 0.90
Object access 1 prop 0.14600 ns/op 0.15300 ns/op 0.95
Map access 1 prop 0.13200 ns/op 0.14200 ns/op 0.93
Object get x1000 6.2090 ns/op 7.0470 ns/op 0.88
Map get x1000 6.7660 ns/op 7.4310 ns/op 0.91
Object set x1000 37.474 ns/op 34.536 ns/op 1.09
Map set x1000 24.086 ns/op 24.053 ns/op 1.00
Return object 10000 times 0.29460 ns/op 0.31190 ns/op 0.94
Throw Error 10000 times 3.4227 us/op 3.6728 us/op 0.93
toHex 146.12 ns/op 153.82 ns/op 0.95
Buffer.from 128.87 ns/op 140.08 ns/op 0.92
shared Buffer 90.243 ns/op 94.588 ns/op 0.95
fastMsgIdFn sha256 / 200 bytes 2.3680 us/op 2.4560 us/op 0.96
fastMsgIdFn h32 xxhash / 200 bytes 261.00 ns/op 259.00 ns/op 1.01
fastMsgIdFn h64 xxhash / 200 bytes 279.00 ns/op 294.00 ns/op 0.95
fastMsgIdFn sha256 / 1000 bytes 7.5430 us/op 8.3930 us/op 0.90
fastMsgIdFn h32 xxhash / 1000 bytes 389.00 ns/op 388.00 ns/op 1.00
fastMsgIdFn h64 xxhash / 1000 bytes 355.00 ns/op 371.00 ns/op 0.96
fastMsgIdFn sha256 / 10000 bytes 65.922 us/op 72.123 us/op 0.91
fastMsgIdFn h32 xxhash / 10000 bytes 1.8880 us/op 1.9580 us/op 0.96
fastMsgIdFn h64 xxhash / 10000 bytes 1.2330 us/op 1.3150 us/op 0.94
send data - 1000 256B messages 12.854 ms/op 12.637 ms/op 1.02
send data - 1000 512B messages 17.854 ms/op 16.551 ms/op 1.08
send data - 1000 1024B messages 26.560 ms/op 26.995 ms/op 0.98
send data - 1000 1200B messages 26.258 ms/op 26.981 ms/op 0.97
send data - 1000 2048B messages 35.896 ms/op 32.986 ms/op 1.09
send data - 1000 4096B messages 33.639 ms/op 33.098 ms/op 1.02
send data - 1000 16384B messages 70.227 ms/op 71.112 ms/op 0.99
send data - 1000 65536B messages 221.73 ms/op 208.15 ms/op 1.07
enrSubnets - fastDeserialize 64 bits 1.4750 us/op 1.0960 us/op 1.35
enrSubnets - ssz BitVector 64 bits 463.00 ns/op 376.00 ns/op 1.23
enrSubnets - fastDeserialize 4 bits 217.00 ns/op 160.00 ns/op 1.36
enrSubnets - ssz BitVector 4 bits 476.00 ns/op 403.00 ns/op 1.18
prioritizePeers score -10:0 att 32-0.1 sync 2-0 219.49 us/op 146.38 us/op 1.50
prioritizePeers score 0:0 att 32-0.25 sync 2-0.25 228.23 us/op 164.43 us/op 1.39
prioritizePeers score 0:0 att 32-0.5 sync 2-0.5 335.07 us/op 224.07 us/op 1.50
prioritizePeers score 0:0 att 64-0.75 sync 4-0.75 528.25 us/op 406.04 us/op 1.30
prioritizePeers score 0:0 att 64-1 sync 4-1 681.56 us/op 527.78 us/op 1.29
array of 16000 items push then shift 1.6956 us/op 1.6853 us/op 1.01
LinkedList of 16000 items push then shift 9.5030 ns/op 7.8970 ns/op 1.20
array of 16000 items push then pop 139.58 ns/op 108.64 ns/op 1.28
LinkedList of 16000 items push then pop 8.2410 ns/op 7.1530 ns/op 1.15
array of 24000 items push then shift 2.5774 us/op 2.5236 us/op 1.02
LinkedList of 24000 items push then shift 7.7430 ns/op 7.3080 ns/op 1.06
array of 24000 items push then pop 187.15 ns/op 136.64 ns/op 1.37
LinkedList of 24000 items push then pop 7.7360 ns/op 7.1270 ns/op 1.09
intersect bitArray bitLen 8 6.7280 ns/op 6.6360 ns/op 1.01
intersect array and set length 8 46.964 ns/op 45.551 ns/op 1.03
intersect bitArray bitLen 128 31.471 ns/op 30.969 ns/op 1.02
intersect array and set length 128 697.45 ns/op 676.45 ns/op 1.03
bitArray.getTrueBitIndexes() bitLen 128 1.3990 us/op 1.3470 us/op 1.04
bitArray.getTrueBitIndexes() bitLen 248 2.5860 us/op 2.0410 us/op 1.27
bitArray.getTrueBitIndexes() bitLen 512 5.3310 us/op 4.1810 us/op 1.28
Buffer.concat 32 items 844.00 ns/op 710.00 ns/op 1.19
Uint8Array.set 32 items 1.5790 us/op 1.4210 us/op 1.11
Buffer.copy 2.5350 us/op 2.5470 us/op 1.00
Uint8Array.set - with subarray 2.4320 us/op 2.1690 us/op 1.12
Uint8Array.set - without subarray 1.5040 us/op 1.5250 us/op 0.99
getUint32 - dataview 257.00 ns/op 217.00 ns/op 1.18
getUint32 - manual 179.00 ns/op 146.00 ns/op 1.23
Set add up to 64 items then delete first 2.3614 us/op 2.2240 us/op 1.06
OrderedSet add up to 64 items then delete first 4.1802 us/op 3.3225 us/op 1.26
Set add up to 64 items then delete last 2.9007 us/op 2.5365 us/op 1.14
OrderedSet add up to 64 items then delete last 4.6471 us/op 3.9354 us/op 1.18
Set add up to 64 items then delete middle 3.2078 us/op 2.5732 us/op 1.25
OrderedSet add up to 64 items then delete middle 6.4889 us/op 5.4916 us/op 1.18
Set add up to 128 items then delete first 6.3361 us/op 5.1950 us/op 1.22
OrderedSet add up to 128 items then delete first 9.1436 us/op 7.3136 us/op 1.25
Set add up to 128 items then delete last 6.8805 us/op 5.0521 us/op 1.36
OrderedSet add up to 128 items then delete last 11.120 us/op 7.6249 us/op 1.46
Set add up to 128 items then delete middle 7.5783 us/op 5.6778 us/op 1.33
OrderedSet add up to 128 items then delete middle 17.187 us/op 15.288 us/op 1.12
Set add up to 256 items then delete first 13.907 us/op 10.944 us/op 1.27
OrderedSet add up to 256 items then delete first 24.454 us/op 16.828 us/op 1.45
Set add up to 256 items then delete last 13.157 us/op 10.901 us/op 1.21
OrderedSet add up to 256 items then delete last 19.495 us/op 16.945 us/op 1.15
Set add up to 256 items then delete middle 11.287 us/op 10.754 us/op 1.05
OrderedSet add up to 256 items then delete middle 49.870 us/op 45.155 us/op 1.10
transfer serialized Status (84 B) 3.2390 us/op 2.8240 us/op 1.15
copy serialized Status (84 B) 1.6670 us/op 1.4470 us/op 1.15
transfer serialized SignedVoluntaryExit (112 B) 3.1810 us/op 2.9710 us/op 1.07
copy serialized SignedVoluntaryExit (112 B) 1.5650 us/op 1.5630 us/op 1.00
transfer serialized ProposerSlashing (416 B) 4.1290 us/op 3.2860 us/op 1.26
copy serialized ProposerSlashing (416 B) 2.9730 us/op 1.8890 us/op 1.57
transfer serialized Attestation (485 B) 4.4080 us/op 3.3470 us/op 1.32
copy serialized Attestation (485 B) 2.4910 us/op 1.7970 us/op 1.39
transfer serialized AttesterSlashing (33232 B) 2.8580 us/op 3.0500 us/op 0.94
copy serialized AttesterSlashing (33232 B) 7.5770 us/op 5.0860 us/op 1.49
transfer serialized Small SignedBeaconBlock (128000 B) 3.6120 us/op 3.8310 us/op 0.94
copy serialized Small SignedBeaconBlock (128000 B) 23.514 us/op 14.822 us/op 1.59
transfer serialized Avg SignedBeaconBlock (200000 B) 4.5600 us/op 4.2830 us/op 1.06
copy serialized Avg SignedBeaconBlock (200000 B) 28.784 us/op 19.611 us/op 1.47
transfer serialized BlobsSidecar (524380 B) 6.3300 us/op 4.9510 us/op 1.28
copy serialized BlobsSidecar (524380 B) 97.264 us/op 101.70 us/op 0.96
transfer serialized Big SignedBeaconBlock (1000000 B) 9.0300 us/op 4.5930 us/op 1.97
copy serialized Big SignedBeaconBlock (1000000 B) 270.56 us/op 223.08 us/op 1.21
pass gossip attestations to forkchoice per slot 3.7281 ms/op 3.1543 ms/op 1.18
forkChoice updateHead vc 100000 bc 64 eq 0 504.88 us/op 471.00 us/op 1.07
forkChoice updateHead vc 600000 bc 64 eq 0 4.2810 ms/op 2.9430 ms/op 1.45
forkChoice updateHead vc 1000000 bc 64 eq 0 6.1065 ms/op 5.1158 ms/op 1.19
forkChoice updateHead vc 600000 bc 320 eq 0 3.5843 ms/op 2.9641 ms/op 1.21
forkChoice updateHead vc 600000 bc 1200 eq 0 3.4105 ms/op 3.0779 ms/op 1.11
forkChoice updateHead vc 600000 bc 7200 eq 0 4.2976 ms/op 3.6841 ms/op 1.17
forkChoice updateHead vc 600000 bc 64 eq 1000 11.317 ms/op 10.732 ms/op 1.05
forkChoice updateHead vc 600000 bc 64 eq 10000 11.001 ms/op 10.671 ms/op 1.03
forkChoice updateHead vc 600000 bc 64 eq 300000 16.512 ms/op 15.418 ms/op 1.07
computeDeltas 500000 validators 300 proto nodes 5.1511 ms/op 4.5845 ms/op 1.12
computeDeltas 500000 validators 1200 proto nodes 6.2738 ms/op 4.5696 ms/op 1.37
computeDeltas 500000 validators 7200 proto nodes 6.3267 ms/op 4.4713 ms/op 1.41
computeDeltas 750000 validators 300 proto nodes 7.8407 ms/op 7.2621 ms/op 1.08
computeDeltas 750000 validators 1200 proto nodes 7.5240 ms/op 6.7016 ms/op 1.12
computeDeltas 750000 validators 7200 proto nodes 7.0597 ms/op 6.6358 ms/op 1.06
computeDeltas 1400000 validators 300 proto nodes 11.898 ms/op 13.955 ms/op 0.85
computeDeltas 1400000 validators 1200 proto nodes 12.103 ms/op 13.498 ms/op 0.90
computeDeltas 1400000 validators 7200 proto nodes 12.696 ms/op 12.706 ms/op 1.00
computeDeltas 2100000 validators 300 proto nodes 18.118 ms/op 18.844 ms/op 0.96
computeDeltas 2100000 validators 1200 proto nodes 17.959 ms/op 18.896 ms/op 0.95
computeDeltas 2100000 validators 7200 proto nodes 20.651 ms/op 18.801 ms/op 1.10
altair processAttestation - 250000 vs - 7PWei normalcase 2.4899 ms/op 2.1225 ms/op 1.17
altair processAttestation - 250000 vs - 7PWei worstcase 3.0506 ms/op 3.0683 ms/op 0.99
altair processAttestation - setStatus - 1/6 committees join 97.706 us/op 132.73 us/op 0.74
altair processAttestation - setStatus - 1/3 committees join 183.81 us/op 242.43 us/op 0.76
altair processAttestation - setStatus - 1/2 committees join 273.92 us/op 374.44 us/op 0.73
altair processAttestation - setStatus - 2/3 committees join 373.10 us/op 441.66 us/op 0.84
altair processAttestation - setStatus - 4/5 committees join 553.38 us/op 660.61 us/op 0.84
altair processAttestation - setStatus - 100% committees join 592.08 us/op 715.07 us/op 0.83
altair processBlock - 250000 vs - 7PWei normalcase 3.9764 ms/op 6.4199 ms/op 0.62
altair processBlock - 250000 vs - 7PWei normalcase hashState 30.891 ms/op 31.168 ms/op 0.99
altair processBlock - 250000 vs - 7PWei worstcase 35.827 ms/op 40.477 ms/op 0.89
altair processBlock - 250000 vs - 7PWei worstcase hashState 71.530 ms/op 71.887 ms/op 1.00
phase0 processBlock - 250000 vs - 7PWei normalcase 2.0343 ms/op 2.2545 ms/op 0.90
phase0 processBlock - 250000 vs - 7PWei worstcase 23.962 ms/op 22.374 ms/op 1.07
altair processEth1Data - 250000 vs - 7PWei normalcase 360.11 us/op 360.64 us/op 1.00
getExpectedWithdrawals 250000 eb:1,eth1:1,we:0,wn:0,smpl:15 6.2650 us/op 6.2880 us/op 1.00
getExpectedWithdrawals 250000 eb:0.95,eth1:0.1,we:0.05,wn:0,smpl:219 46.958 us/op 47.269 us/op 0.99
getExpectedWithdrawals 250000 eb:0.95,eth1:0.3,we:0.05,wn:0,smpl:42 11.080 us/op 8.6210 us/op 1.29
getExpectedWithdrawals 250000 eb:0.95,eth1:0.7,we:0.05,wn:0,smpl:18 5.3750 us/op 6.3910 us/op 0.84
getExpectedWithdrawals 250000 eb:0.1,eth1:0.1,we:0,wn:0,smpl:1020 113.08 us/op 129.77 us/op 0.87
getExpectedWithdrawals 250000 eb:0.03,eth1:0.03,we:0,wn:0,smpl:11777 1.2952 ms/op 1.2842 ms/op 1.01
getExpectedWithdrawals 250000 eb:0.01,eth1:0.01,we:0,wn:0,smpl:16384 1.5309 ms/op 1.8115 ms/op 0.85
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,smpl:16384 1.7784 ms/op 1.8443 ms/op 0.96
getExpectedWithdrawals 250000 eb:0,eth1:0,we:0,wn:0,nocache,smpl:16384 3.8806 ms/op 3.9495 ms/op 0.98
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,smpl:16384 1.6415 ms/op 1.6012 ms/op 1.03
getExpectedWithdrawals 250000 eb:0,eth1:1,we:0,wn:0,nocache,smpl:16384 4.0319 ms/op 4.3281 ms/op 0.93
Tree 40 250000 create 214.76 ms/op 231.81 ms/op 0.93
Tree 40 250000 get(125000) 141.84 ns/op 160.53 ns/op 0.88
Tree 40 250000 set(125000) 626.41 ns/op 661.13 ns/op 0.95
Tree 40 250000 toArray() 15.266 ms/op 15.244 ms/op 1.00
Tree 40 250000 iterate all - toArray() + loop 15.132 ms/op 15.209 ms/op 0.99
Tree 40 250000 iterate all - get(i) 50.001 ms/op 50.352 ms/op 0.99
Array 250000 create 2.8157 ms/op 2.8493 ms/op 0.99
Array 250000 clone - spread 1.4057 ms/op 1.3506 ms/op 1.04
Array 250000 get(125000) 0.41600 ns/op 0.46100 ns/op 0.90
Array 250000 set(125000) 0.44000 ns/op 0.48700 ns/op 0.90
Array 250000 iterate all - loop 107.64 us/op 113.84 us/op 0.95
phase0 afterProcessEpoch - 250000 vs - 7PWei 49.617 ms/op 50.203 ms/op 0.99
Array.fill - length 1000000 3.5564 ms/op 3.5194 ms/op 1.01
Array push - length 1000000 17.020 ms/op 22.726 ms/op 0.75
Array.get 0.27124 ns/op 0.30510 ns/op 0.89
Uint8Array.get 0.44059 ns/op 0.53839 ns/op 0.82
phase0 beforeProcessEpoch - 250000 vs - 7PWei 15.797 ms/op 21.599 ms/op 0.73
altair processEpoch - mainnet_e81889 279.89 ms/op 287.66 ms/op 0.97
mainnet_e81889 - altair beforeProcessEpoch 21.278 ms/op 20.222 ms/op 1.05
mainnet_e81889 - altair processJustificationAndFinalization 14.693 us/op 14.491 us/op 1.01
mainnet_e81889 - altair processInactivityUpdates 4.8795 ms/op 5.8139 ms/op 0.84
mainnet_e81889 - altair processRewardsAndPenalties 36.677 ms/op 58.125 ms/op 0.63
mainnet_e81889 - altair processRegistryUpdates 2.2830 us/op 2.5580 us/op 0.89
mainnet_e81889 - altair processSlashings 396.00 ns/op 458.00 ns/op 0.86
mainnet_e81889 - altair processEth1DataReset 463.00 ns/op 448.00 ns/op 1.03
mainnet_e81889 - altair processEffectiveBalanceUpdates 1.4195 ms/op 1.5769 ms/op 0.90
mainnet_e81889 - altair processSlashingsReset 3.1910 us/op 4.0920 us/op 0.78
mainnet_e81889 - altair processRandaoMixesReset 4.3000 us/op 5.1280 us/op 0.84
mainnet_e81889 - altair processHistoricalRootsUpdate 967.00 ns/op 713.00 ns/op 1.36
mainnet_e81889 - altair processParticipationFlagUpdates 2.0170 us/op 1.7850 us/op 1.13
mainnet_e81889 - altair processSyncCommitteeUpdates 572.00 ns/op 533.00 ns/op 1.07
mainnet_e81889 - altair afterProcessEpoch 49.471 ms/op 68.689 ms/op 0.72
capella processEpoch - mainnet_e217614 955.92 ms/op 1.0386 s/op 0.92
mainnet_e217614 - capella beforeProcessEpoch 64.410 ms/op 85.278 ms/op 0.76
mainnet_e217614 - capella processJustificationAndFinalization 10.769 us/op 12.832 us/op 0.84
mainnet_e217614 - capella processInactivityUpdates 15.780 ms/op 16.903 ms/op 0.93
mainnet_e217614 - capella processRewardsAndPenalties 218.87 ms/op 238.61 ms/op 0.92
mainnet_e217614 - capella processRegistryUpdates 15.009 us/op 18.354 us/op 0.82
mainnet_e217614 - capella processSlashings 526.00 ns/op 556.00 ns/op 0.95
mainnet_e217614 - capella processEth1DataReset 392.00 ns/op 388.00 ns/op 1.01
mainnet_e217614 - capella processEffectiveBalanceUpdates 10.658 ms/op 11.458 ms/op 0.93
mainnet_e217614 - capella processSlashingsReset 2.7950 us/op 3.2550 us/op 0.86
mainnet_e217614 - capella processRandaoMixesReset 4.1660 us/op 4.2530 us/op 0.98
mainnet_e217614 - capella processHistoricalRootsUpdate 588.00 ns/op 939.00 ns/op 0.63
mainnet_e217614 - capella processParticipationFlagUpdates 1.3140 us/op 2.1220 us/op 0.62
mainnet_e217614 - capella afterProcessEpoch 122.03 ms/op 153.89 ms/op 0.79
phase0 processEpoch - mainnet_e58758 293.09 ms/op 370.43 ms/op 0.79
mainnet_e58758 - phase0 beforeProcessEpoch 64.366 ms/op 73.588 ms/op 0.87
mainnet_e58758 - phase0 processJustificationAndFinalization 11.609 us/op 13.852 us/op 0.84
mainnet_e58758 - phase0 processRewardsAndPenalties 22.502 ms/op 23.037 ms/op 0.98
mainnet_e58758 - phase0 processRegistryUpdates 10.932 us/op 9.1250 us/op 1.20
mainnet_e58758 - phase0 processSlashings 545.00 ns/op 1.3250 us/op 0.41
mainnet_e58758 - phase0 processEth1DataReset 411.00 ns/op 747.00 ns/op 0.55
mainnet_e58758 - phase0 processEffectiveBalanceUpdates 1.1290 ms/op 1.2495 ms/op 0.90
mainnet_e58758 - phase0 processSlashingsReset 2.2840 us/op 2.6940 us/op 0.85
mainnet_e58758 - phase0 processRandaoMixesReset 4.4660 us/op 4.3410 us/op 1.03
mainnet_e58758 - phase0 processHistoricalRootsUpdate 430.00 ns/op 420.00 ns/op 1.02
mainnet_e58758 - phase0 processParticipationRecordUpdates 3.7200 us/op 3.7130 us/op 1.00
mainnet_e58758 - phase0 afterProcessEpoch 41.837 ms/op 47.411 ms/op 0.88
phase0 processEffectiveBalanceUpdates - 250000 normalcase 1.3285 ms/op 1.4507 ms/op 0.92
phase0 processEffectiveBalanceUpdates - 250000 worstcase 0.5 1.9382 ms/op 1.8737 ms/op 1.03
altair processInactivityUpdates - 250000 normalcase 13.602 ms/op 16.422 ms/op 0.83
altair processInactivityUpdates - 250000 worstcase 13.895 ms/op 17.003 ms/op 0.82
phase0 processRegistryUpdates - 250000 normalcase 8.9760 us/op 9.5920 us/op 0.94
phase0 processRegistryUpdates - 250000 badcase_full_deposits 265.85 us/op 316.03 us/op 0.84
phase0 processRegistryUpdates - 250000 worstcase 0.5 107.78 ms/op 118.45 ms/op 0.91
altair processRewardsAndPenalties - 250000 normalcase 39.217 ms/op 39.187 ms/op 1.00
altair processRewardsAndPenalties - 250000 worstcase 38.289 ms/op 40.431 ms/op 0.95
phase0 getAttestationDeltas - 250000 normalcase 7.4017 ms/op 8.8191 ms/op 0.84
phase0 getAttestationDeltas - 250000 worstcase 7.0388 ms/op 7.4149 ms/op 0.95
phase0 processSlashings - 250000 worstcase 77.376 us/op 88.306 us/op 0.88
altair processSyncCommitteeUpdates - 250000 126.41 ms/op 153.87 ms/op 0.82
BeaconState.hashTreeRoot - No change 244.00 ns/op 267.00 ns/op 0.91
BeaconState.hashTreeRoot - 1 full validator 109.37 us/op 130.61 us/op 0.84
BeaconState.hashTreeRoot - 32 full validator 1.1667 ms/op 1.5319 ms/op 0.76
BeaconState.hashTreeRoot - 512 full validator 9.7872 ms/op 10.729 ms/op 0.91
BeaconState.hashTreeRoot - 1 validator.effectiveBalance 126.70 us/op 123.60 us/op 1.03
BeaconState.hashTreeRoot - 32 validator.effectiveBalance 1.6218 ms/op 1.8122 ms/op 0.89
BeaconState.hashTreeRoot - 512 validator.effectiveBalance 22.113 ms/op 22.297 ms/op 0.99
BeaconState.hashTreeRoot - 1 balances 105.02 us/op 103.26 us/op 1.02
BeaconState.hashTreeRoot - 32 balances 1.1429 ms/op 921.10 us/op 1.24
BeaconState.hashTreeRoot - 512 balances 7.9513 ms/op 8.3968 ms/op 0.95
BeaconState.hashTreeRoot - 250000 balances 179.58 ms/op 226.97 ms/op 0.79
aggregationBits - 2048 els - zipIndexesInBitList 22.489 us/op 43.837 us/op 0.51
byteArrayEquals 32 52.910 ns/op 84.601 ns/op 0.63
Buffer.compare 32 17.083 ns/op 27.307 ns/op 0.63
byteArrayEquals 1024 1.5796 us/op 2.0045 us/op 0.79
Buffer.compare 1024 25.433 ns/op 36.355 ns/op 0.70
byteArrayEquals 16384 25.621 us/op 31.404 us/op 0.82
Buffer.compare 16384 204.66 ns/op 378.77 ns/op 0.54
byteArrayEquals 123687377 190.78 ms/op 316.47 ms/op 0.60
Buffer.compare 123687377 6.8179 ms/op 9.9673 ms/op 0.68
byteArrayEquals 32 - diff last byte 52.422 ns/op 101.39 ns/op 0.52
Buffer.compare 32 - diff last byte 17.244 ns/op 34.232 ns/op 0.50
byteArrayEquals 1024 - diff last byte 1.5813 us/op 3.5108 us/op 0.45
Buffer.compare 1024 - diff last byte 25.061 ns/op 61.164 ns/op 0.41
byteArrayEquals 16384 - diff last byte 25.249 us/op 53.889 us/op 0.47
Buffer.compare 16384 - diff last byte 202.02 ns/op 493.80 ns/op 0.41
byteArrayEquals 123687377 - diff last byte 191.57 ms/op 448.34 ms/op 0.43
Buffer.compare 123687377 - diff last byte 6.4778 ms/op 10.108 ms/op 0.64
byteArrayEquals 32 - random bytes 5.1190 ns/op 12.083 ns/op 0.42
Buffer.compare 32 - random bytes 17.164 ns/op 58.046 ns/op 0.30
byteArrayEquals 1024 - random bytes 5.1590 ns/op 13.274 ns/op 0.39
Buffer.compare 1024 - random bytes 16.955 ns/op 55.056 ns/op 0.31
byteArrayEquals 16384 - random bytes 5.4610 ns/op 13.152 ns/op 0.42
Buffer.compare 16384 - random bytes 17.492 ns/op 51.959 ns/op 0.34
byteArrayEquals 123687377 - random bytes 6.5300 ns/op 15.800 ns/op 0.41
Buffer.compare 123687377 - random bytes 18.490 ns/op 63.100 ns/op 0.29
regular array get 100000 times 39.084 us/op 86.584 us/op 0.45
wrappedArray get 100000 times 32.544 us/op 103.01 us/op 0.32
arrayWithProxy get 100000 times 12.185 ms/op 41.353 ms/op 0.29
ssz.Root.equals 46.053 ns/op 142.66 ns/op 0.32
byteArrayEquals 45.124 ns/op 149.48 ns/op 0.30
Buffer.compare 10.303 ns/op 22.348 ns/op 0.46
processSlot - 1 slots 12.796 us/op 26.673 us/op 0.48
processSlot - 32 slots 2.8666 ms/op 4.4082 ms/op 0.65
getEffectiveBalanceIncrementsZeroInactive - 250000 vs - 7PWei 37.227 ms/op 63.640 ms/op 0.58
getCommitteeAssignments - req 1 vs - 250000 vc 2.1721 ms/op 3.8918 ms/op 0.56
getCommitteeAssignments - req 100 vs - 250000 vc 4.1841 ms/op 6.8414 ms/op 0.61
getCommitteeAssignments - req 1000 vs - 250000 vc 4.4940 ms/op 9.5279 ms/op 0.47
findModifiedValidators - 10000 modified validators 249.92 ms/op 533.05 ms/op 0.47
findModifiedValidators - 1000 modified validators 157.53 ms/op 457.07 ms/op 0.34
findModifiedValidators - 100 modified validators 152.40 ms/op 305.60 ms/op 0.50
findModifiedValidators - 10 modified validators 143.08 ms/op 437.77 ms/op 0.33
findModifiedValidators - 1 modified validators 142.33 ms/op 290.92 ms/op 0.49
findModifiedValidators - no difference 151.71 ms/op 304.45 ms/op 0.50
compare ViewDUs 2.9531 s/op 4.8266 s/op 0.61
compare each validator Uint8Array 1.3487 s/op 2.3360 s/op 0.58
compare ViewDU to Uint8Array 889.57 ms/op 1.4745 s/op 0.60
migrate state 1000000 validators, 24 modified, 0 new 722.96 ms/op 805.03 ms/op 0.90
migrate state 1000000 validators, 1700 modified, 1000 new 969.01 ms/op 1.0670 s/op 0.91
migrate state 1000000 validators, 3400 modified, 2000 new 1.1765 s/op 1.2024 s/op 0.98
migrate state 1500000 validators, 24 modified, 0 new 750.99 ms/op 776.33 ms/op 0.97
migrate state 1500000 validators, 1700 modified, 1000 new 967.29 ms/op 1.0456 s/op 0.93
migrate state 1500000 validators, 3400 modified, 2000 new 1.1596 s/op 1.3031 s/op 0.89
RootCache.getBlockRootAtSlot - 250000 vs - 7PWei 4.1600 ns/op 5.4800 ns/op 0.76
state getBlockRootAtSlot - 250000 vs - 7PWei 659.24 ns/op 801.14 ns/op 0.82
computeProposers - vc 250000 6.9654 ms/op 8.5145 ms/op 0.82
computeEpochShuffling - vc 250000 40.618 ms/op 48.671 ms/op 0.83
getNextSyncCommittee - vc 250000 123.00 ms/op 151.82 ms/op 0.81
computeSigningRoot for AttestationData 24.950 us/op 29.541 us/op 0.84
hash AttestationData serialized data then Buffer.toString(base64) 1.5239 us/op 2.0813 us/op 0.73
toHexString serialized data 865.37 ns/op 1.2426 us/op 0.70
Buffer.toString(base64) 174.74 ns/op 274.03 ns/op 0.64
nodejs block root to RootHex using toHex 142.23 ns/op 186.43 ns/op 0.76
nodejs block root to RootHex using toRootHex 92.913 ns/op 115.62 ns/op 0.80
browser block root to RootHex using the deprecated toHexString 223.87 ns/op 315.46 ns/op 0.71
browser block root to RootHex using toHex 178.66 ns/op 245.27 ns/op 0.73
browser block root to RootHex using toRootHex 159.13 ns/op 218.33 ns/op 0.73

by benchmarkbot/action

@nflaig
Copy link
Member Author

nflaig commented Dec 19, 2024

This requires more changes, CI is still failing https://github.com/ChainSafe/lodestar/actions/runs/12416331817/job/34664977579?pr=7318#step:6:64

@lodestar/params: Vitest caught 1 unhandled error during the test run.
@lodestar/params: This might cause false positive tests. Resolve unhandled errors to make sure your tests are not affected.
@lodestar/params: ⎯⎯⎯⎯⎯⎯ Unhandled Error ⎯⎯⎯⎯⎯⎯⎯
@lodestar/params: Error: Couldn't find a matching firefox browser for tag "nightly_135.0a1" on platform "linux"
@lodestar/params:  ❯ setupPuppeteerBrowser ../../node_modules/@wdio/utils/build/node/utils.js:202:15
@lodestar/params:  ❯ process.processTicksAndRejections node:internal/process/task_queues:95:5
@lodestar/params:  ❯ startWebDriver ../../node_modules/@wdio/utils/build/node/startWebDriver.js:80:36
@lodestar/params:  ❯ WebDriver.newSession ../../node_modules/webdriver/build/index.js:18:31

@nazarhussain nazarhussain marked this pull request as ready for review January 2, 2025 09:15
@nazarhussain nazarhussain requested a review from a team as a code owner January 2, 2025 09:15
@nazarhussain nazarhussain merged commit ad8c10e into unstable Jan 2, 2025
20 checks passed
@nazarhussain nazarhussain deleted the nflaig/fix-browser-tests branch January 2, 2025 09:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@nazarhussain nazarhussain nazarhussain approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Fix installing firefox in browser tests
2 participants
@nflaig @nazarhussain