[Node Operator Question] failed to get L2 genesis blockhash #281

tajelp · 2024-03-12T10:50:15Z

tajelp
Mar 12, 2024

Are you running the most up to date node software?

Yes

Did you check the documentation?

Yes

Did you check for duplicate questions?

Yes

Issue Description

I upgraded op-geth and op-node to the latest releases and then I launched them with the following scripts:

op-geth:

#! /usr/bin/bash

cd /home/user/.optimism/op-geth

./build/bin/geth \
  --http \
  --http.port='8585' \
  --http.addr='127.0.0.1' \
  --authrpc.addr='127.0.0.1' \
  --authrpc.jwtsecret='/home/user/.optimism/jwt' \
  --verbosity=3 \
  --rollup.sequencerhttp='https://mainnet-sequencer.optimism.io' \
  --op-network='op-mainnet' \
  --datadir='./datadir' \
  --nodiscover \
  --syncmode='full' \
  --maxpeers='0' \
  --port='30340' \
  --authrpc.port='8586' \
  --ws \
  --ws.port '8588' \
  --ws.api 'eth,net,web3' \
  --ws.origins '127.0.0.1' \
  --ws.addr='127.0.0.1' \
  --ipcpath='geth.ipc'

op-node:

#!/usr/bin/bash

cd /home/user/.optimism/optimism/op-node

./bin/op-node \
    --l1='http://127.0.0.1:8545'  \
    --l1.rpckind='basic' \
    --l1.beacon='http://127.0.0.1:5052' \
    --l2='ws://127.0.0.1:8586' \
    --l2.jwt-secret='/home/user/.optimism/jwt' \
    --network='mainnet' \
    --rpc.addr='0.0.0.0' \
    --rpc.port='8590'

op-geth seems to have started successfully but op-node prints errors and cannot be started (see logs below).

Protocol Description

v1.101308.2
v1.7.0
mainnet/op
10
1

Node Logs

op-geth:

INFO [03-12|10:39:21.883] Starting geth on an OP network...        network=op-mainnet
INFO [03-12|10:39:21.883] Bumping default cache on mainnet         provided=1024 updated=4096
INFO [03-12|10:39:21.885] Maximum peer count                       ETH=0 total=0
INFO [03-12|10:39:21.886] Smartcard socket not found, disabling    err="stat /run/pcscd/pcscd.comm: no such file or directory"
INFO [03-12|10:39:21.890] Set global gas cap                       cap=50,000,000
INFO [03-12|10:39:21.891] Initializing the KZG library             backend=gokzg
INFO [03-12|10:39:21.912] Allocated trie memory caches             clean=614.00MiB dirty=1024.00MiB
INFO [03-12|10:39:21.912] Using pebble as the backing database
INFO [03-12|10:39:21.912] Allocated cache and file handles         database=/home/user/.optimism/op-geth/datadir/geth/chaindata cache=2.00GiB handles=32768
INFO [03-12|10:39:21.921] Opened ancient database                  database=/home/user/.optimism/op-geth/datadir/geth/chaindata/ancient/chain readonly=false
INFO [03-12|10:39:21.921] State schema set to default              scheme=hash
INFO [03-12|10:39:21.923]
INFO [03-12|10:39:21.923] ---------------------------------------------------------------------------------------------------------------------------------------------------------
INFO [03-12|10:39:21.923] Chain ID:  10 (OP-Mainnet)
INFO [03-12|10:39:21.923] Consensus: Optimism
INFO [03-12|10:39:21.923]
INFO [03-12|10:39:21.923] Pre-Merge hard forks (block based):
INFO [03-12|10:39:21.923]  - Homestead:                   #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/homestead.md)
INFO [03-12|10:39:21.923]  - Tangerine Whistle (EIP 150): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/tangerine-whistle.md)
INFO [03-12|10:39:21.923]  - Spurious Dragon/1 (EIP 155): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/spurious-dragon.md)
INFO [03-12|10:39:21.923]  - Spurious Dragon/2 (EIP 158): #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/spurious-dragon.md)
INFO [03-12|10:39:21.923]  - Byzantium:                   #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/byzantium.md)
INFO [03-12|10:39:21.923]  - Constantinople:              #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/constantinople.md)
INFO [03-12|10:39:21.923]  - Petersburg:                  #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/petersburg.md)
INFO [03-12|10:39:21.923]  - Istanbul:                    #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/istanbul.md)
INFO [03-12|10:39:21.923]  - Muir Glacier:                #0        (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/muir-glacier.md)
INFO [03-12|10:39:21.923]  - Berlin:                      #3950000  (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/berlin.md)
INFO [03-12|10:39:21.923]  - London:                      #105235063 (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/london.md)
INFO [03-12|10:39:21.923]  - Arrow Glacier:               #105235063 (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/arrow-glacier.md)
INFO [03-12|10:39:21.923]  - Gray Glacier:                #105235063 (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/gray-glacier.md)
INFO [03-12|10:39:21.923]
INFO [03-12|10:39:21.923] Merge configured:
INFO [03-12|10:39:21.923]  - Hard-fork specification:    https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/paris.md
INFO [03-12|10:39:21.923]  - Network known to be merged: true
INFO [03-12|10:39:21.923]  - Total terminal difficulty:  0
INFO [03-12|10:39:21.923]  - Merge netsplit block:       #105235063
INFO [03-12|10:39:21.923]
INFO [03-12|10:39:21.923] Post-Merge hard forks (timestamp based):
INFO [03-12|10:39:21.923]  - Shanghai:                    @1704992401 (https://github.com/ethereum/execution-specs/blob/master/network-upgrades/mainnet-upgrades/shanghai.md)
INFO [03-12|10:39:21.923]  - Cancun:                      @1710374401
INFO [03-12|10:39:21.923]  - Regolith:                    @0
INFO [03-12|10:39:21.923]  - Canyon:                      @1704992401
INFO [03-12|10:39:21.923]  - Ecotone:                     @1710374401
INFO [03-12|10:39:21.923]
INFO [03-12|10:39:21.923] ---------------------------------------------------------------------------------------------------------------------------------------------------------
INFO [03-12|10:39:21.923]
INFO [03-12|10:39:21.923] Loaded most recent local block           number=0 hash=7ca38a..3fa48b td=1 age=54y11mo3w
INFO [03-12|10:39:21.923] Genesis state is missing, wait state sync
INFO [03-12|10:39:21.923] Initialising Ethereum protocol           network=10         dbversion=8
INFO [03-12|10:39:21.923] Resuming state snapshot generation       root=eddb4c..a568eb accounts=0 slots=0 storage=0.00B dangling=0 elapsed="32.45µs"
INFO [03-12|10:39:21.923] Loaded local transaction journal         transactions=0 dropped=0
INFO [03-12|10:39:21.923] Initialized transaction indexer          limit=2,350,000
INFO [03-12|10:39:21.923] Regenerated local transaction journal    transactions=0 accounts=0
WARN [03-12|10:39:21.924] Switch sync mode from full sync to snap sync reason="head state missing"
INFO [03-12|10:39:21.925] Trie missing, state snapshotting paused  root=eddb4c..a568eb accounts=0 slots=0 storage=0.00B dangling=0 elapsed=1.305ms
INFO [03-12|10:39:21.925] Chain post-merge, sync via beacon client
INFO [03-12|10:39:21.925] Gasprice oracle is ignoring threshold set threshold=2
WARN [03-12|10:39:21.925] Engine API enabled                       protocol=eth
INFO [03-12|10:39:21.926] Starting peer-to-peer node               instance=Geth/v0.1.0-unstable/linux-amd64/go1.22.0
INFO [03-12|10:39:21.932] IPC endpoint opened                      url=/home/user/.optimism/op-geth/datadir/geth.ipc
INFO [03-12|10:39:21.932] New local node record                    seq=1,710,239,723,087 id=f8d822133cc079a1 ip=127.0.0.1 udp=0 tcp=30340
INFO [03-12|10:39:21.932] Started P2P networking                   self="enode://92511c415ba478ce8ef59afcb445362ab11ca832eda10048017ab794ab9eeb5a8ce2762073417f9e448ac06cbb136d94dd703bcc4027bba5596b03435b9d4bff@127.0.0.1:30340?discport=0"
INFO [03-12|10:39:21.932] Loaded JWT secret file                   path=/home/user/.optimism/jwt crc32=0xdc7a853e
INFO [03-12|10:39:21.933] HTTP server started                      endpoint=127.0.0.1:8585 auth=false prefix= cors= vhosts=localhost
INFO [03-12|10:39:21.933] WebSocket enabled                        url=ws://127.0.0.1:8588
INFO [03-12|10:39:21.933] WebSocket enabled                        url=ws://127.0.0.1:8586
INFO [03-12|10:39:21.933] HTTP server started                      endpoint=127.0.0.1:8586 auth=true  prefix= cors=localhost vhosts=localhost

op-node:

INFO [03-12|10:40:54.449] Not opted in to ProtocolVersions signal loading, disabling ProtocolVersions contract now.
INFO [03-12|10:40:54.454] Rollup Config                            l2_chain_id=10 l2_network=OP-Mainnet l1_chain_id=1 l1_network=mainnet l2_start_time=1,686,068,903 l2_block_hash=0xdbf6a80fef073de06add9b0d14026d6e5a86c85f6d102c36d3d8e9cf89c2afd3 l2_block_number=105,235,063 l1_block_hash=0x438335a20d98863a4c0c97999eb2481921ccd28553eac6f913af7c12aec04108 l1_block_number=17,422,590 regolith_time="@ genesis" canyon_time="@ 1704992401 ~ Thu Jan 11 17:00:01 UTC 2024" delta_time="@ 1708560000 ~ Thu Feb 22 00:00:00 UTC 2024" ecotone_time="@ 1710374401 ~ Thu Mar 14 00:00:01 UTC 2024" fjord_time="(not configured)" interop_time="(not configured)"
INFO [03-12|10:40:54.454] Initializing rollup node                 version=v0.0.0
INFO [03-12|10:40:54.456] Connected to L1 Beacon API, ready for EIP-4844 blobs retrieval. version=Lighthouse/v5.1.0-10a38a8/x86_64-linux
ERROR[03-12|10:40:54.457] Error initializing the rollup node       err="failed to init L2: failed to get L2 genesis blockhash: failed to determine L2BlockRef of height 105235063, could not get payload: not found"
CRIT [03-12|10:40:54.457] Application failed                       message="failed to setup: unable to create the rollup node: failed to init L2: failed to get L2 genesis blockhash: failed to determine L2BlockRef of height 105235063, could not get payload: not found"

Additional Information

No response

Feedback

No response

Answered by tajelp

Mar 15, 2024

I missed the --syncmode=execution-layer flag. Thanks!

View full answer

tajelp · 2024-03-12T11:18:34Z

tajelp
Mar 12, 2024
Author

I forgot to mention that on the same machine I am running an eth node (HTTP exposed on the port 8545) and a beacon client (lighthouse) configured with --execution-endpoint http://127.0.0.1:8551 and --http (default listen address: http://127.0.0.1:5052)

0 replies

imtipi · 2024-03-12T11:37:25Z

imtipi
Mar 12, 2024

--network='mainnet'
should be op-mainnet

2 replies

tajelp Mar 12, 2024
Author

Changed. Same situation, though:

INFO [03-12|11:44:41.688] Not opted in to ProtocolVersions signal loading, disabling ProtocolVersions contract now.
INFO [03-12|11:44:41.705] Rollup Config                            l2_chain_id=10 l2_network=OP-Mainnet l1_chain_id=1 l1_network=mainnet l2_start_time=1,686,068,903 l2_block_hash=0xdbf6a80fef073de06add9b0d14026d6e5a86c85f6d102c36d3d8e9cf89c2afd3 l2_block_number=105,235,063 l1_block_hash=0x438335a20d98863a4c0c97999eb2481921ccd28553eac6f913af7c12aec04108 l1_block_number=17,422,590 regolith_time="@ genesis" canyon_time="@ 1704992401 ~ Thu Jan 11 17:00:01 UTC 2024" delta_time="@ 1708560000 ~ Thu Feb 22 00:00:00 UTC 2024" ecotone_time="@ 1710374401 ~ Thu Mar 14 00:00:01 UTC 2024" fjord_time="(not configured)" interop_time="(not configured)"
INFO [03-12|11:44:41.705] Initializing rollup node                 version=v0.0.0
INFO [03-12|11:44:41.709] Connected to L1 Beacon API, ready for EIP-4844 blobs retrieval. version=Lighthouse/v5.1.0-10a38a8/x86_64-linux
ERROR[03-12|11:44:41.710] Error initializing the rollup node       err="failed to init L2: failed to get L2 genesis blockhash: failed to determine L2BlockRef of height 105235063, could not get payload: not found"
CRIT [03-12|11:44:41.710] Application failed                       message="failed to setup: unable to create the rollup node: failed to init L2: failed to get L2 genesis blockhash: failed to determine L2BlockRef of height 105235063, could not get payload: not found"

imtipi Mar 12, 2024

not sure if my browser bugged,but i can't see the '='

tajelp · 2024-03-12T12:12:19Z

tajelp
Mar 12, 2024
Author

v1.101308.2
v1.7.0
mainnet/op
10
1

edited but there's still the same problem. I have to add that I see a running op-node process that I cannot kill. I try to kill it with kill <pid> but it starts again with a new pid.

$ ps aux|grep op-node
user     3605054  6.0  0.0 1279332 38220 ?       Ssl  12:08   0:00 op-node --l1=http://127.0.0.1:8545 --l2=http://op-geth:8551 --rpc.addr=127.0.0.1 --rpc.port=9545 --l2.jwt-secret=/shared/jwt.txt --l1.trustrpc --l1.rpckind=basic --l1.beacon=http://127.0.0.1:5052 --metrics.enabled --metrics.addr=0.0.0.0 --metrics.port=7300 --syncmode=execution-layer --network=op-mainnet --rollup.load-protocol-versions=true --rollup.halt=major

kill 3605054

$ ps aux|grep op-node
user     3611241  0.1  0.0 1279448 37328 ?       Ssl  12:11   0:00 op-node --l1=http://127.0.0.1:8545 --l2=http://op-geth:8551 --rpc.addr=127.0.0.1 --rpc.port=9545 --l2.jwt-secret=/shared/jwt.txt --l1.trustrpc --l1.rpckind=basic --l1.beacon=http://127.0.0.1:5052 --metrics.enabled --metrics.addr=0.0.0.0 --metrics.port=7300 --syncmode=execution-layer --network=op-mainnet --rollup.load-protocol-versions=true --rollup.halt=major

5 replies

tajelp Mar 12, 2024
Author

And I also see this process (unkillable too):

user     3617446  0.0  0.0 652548 107912 ?       Rl   12:13   0:00 node /opt/optimism/packages/replica-healthcheck/node_modules/.bin/../ts-node/dist/bin.js ./src/service

imtipi Mar 12, 2024

seems you also running docker version of node(simple-optimism-node)?

tajelp Mar 12, 2024
Author

yes, sorry. That was it. I still have that op-node problem. I am trying to boot it up with docker too. It seems simpler.

imtipi Mar 12, 2024

so you still have issue with the script you posted above?can you post some error logs again

tajelp Mar 12, 2024
Author

It's the same error as before

sbvegan · 2024-03-12T13:36:49Z

sbvegan
Mar 12, 2024
Maintainer

Can you try removing --ipcpath='geth.ipc' and double check your ports?

0 replies

Chomtana · 2024-03-12T14:48:30Z

Chomtana
Mar 12, 2024

https://optimistic.etherscan.io/block/105235063 is a Bedrock merge block.

I think you forgot to download the initial datadir and did not enable the snap sync feature.

Currently, we recommend you use snap sync as documented in https://docs.optimism.io/builders/node-operators/management/snap-sync

2 replies

sbvegan Mar 13, 2024
Maintainer

Yeah I think this is right

tajelp Mar 15, 2024
Author

I missed the --syncmode=execution-layer flag. Thanks!

Answer selected by tajelp

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Node Operator Question] failed to get L2 genesis blockhash #281

{{title}}

Replies: 5 comments 9 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[Node Operator Question] failed to get L2 genesis blockhash #281

tajelp Mar 12, 2024

Are you running the most up to date node software?

Did you check the documentation?

Did you check for duplicate questions?

Issue Description

Protocol Description

Node Logs

Additional Information

Feedback

Replies: 5 comments · 9 replies

tajelp Mar 12, 2024 Author

imtipi Mar 12, 2024

tajelp Mar 12, 2024 Author

imtipi Mar 12, 2024

tajelp Mar 12, 2024 Author

tajelp Mar 12, 2024 Author

imtipi Mar 12, 2024

tajelp Mar 12, 2024 Author

imtipi Mar 12, 2024

tajelp Mar 12, 2024 Author

sbvegan Mar 12, 2024 Maintainer

Chomtana Mar 12, 2024

sbvegan Mar 13, 2024 Maintainer

tajelp Mar 15, 2024 Author

tajelp
Mar 12, 2024

Replies: 5 comments 9 replies

tajelp
Mar 12, 2024
Author

imtipi
Mar 12, 2024

tajelp Mar 12, 2024
Author

tajelp
Mar 12, 2024
Author

tajelp Mar 12, 2024
Author

tajelp Mar 12, 2024
Author

tajelp Mar 12, 2024
Author

sbvegan
Mar 12, 2024
Maintainer

Chomtana
Mar 12, 2024

sbvegan Mar 13, 2024
Maintainer

tajelp Mar 15, 2024
Author