[OP Stack Deployment] Creating Block Slow on Explorer and RPC

[avenbreaks]

Did you check the documentation?

• Yes

Did you check for duplicate questions?

• Yes

Issue Description

I build using op-stack and sepolia, for RPC L1 I use Quicknode with a limit of 200M / Month. but in explorer it has a little error when creating a new block, from the initial 2 seconds to more than 20 seconds, I don't see any errors in my RPC Node (L2 & L1). but I will provide logs maybe it can solve the problem.

for the op-batcher node I set --max-channel-duration=n to 120 (--max-channel-duration=120) to reduce the cost of ETH burned.

for explorer I used blockscout and took the production-optimism branch Optimism Docs Explorer

Logs

op-geth

0|op-geth  | INFO [03-09|23:51:17.950] Stopping work on payload                 id=0x482413eff298bf3b reason=delivery     elapsed=1933
0|op-geth  | INFO [03-09|23:51:17.963] Imported new potential chain segment     number=1,787,211 hash=2ca066..92b840 blocks=1 txs=1   mgas=0.050 elapsed=8.837ms      mgasps=5.713   snapdiffs=1.13MiB    triedirty=0.00B
0|op-geth  | INFO [03-09|23:51:17.967] Chain head was updated                   number=1,787,211 hash=2ca066..92b840 root=359ff8..5b2663 elapsed=1.935355ms
0|op-geth  | INFO [03-09|23:51:18.005] Starting work on payload                 id=0xa92e63b14a63f738
0|op-geth  | INFO [03-09|23:51:18.006] Updated payload                          id=0xa92e63b14a63f738 number=1,787,212 hash=991e8d..1ea39f txs=1   withdrawals=0 gas=64001     fees=0               root=2893fe..e15c7b elapsed="551.197µs"

op-node

1|op-node  | t=2024-03-04T16:05:31+0000 lvl=warn msg="Next L2 block time is past the sequencer drift + current origin time" current=0x006f6e0281d5e6e009c23fccd3fc78296011f2575f3674cd97981ddaf7197461:5414002 current_time=1,709,545,944 l2_head=0x3f39d0b8baa1bba3d1fa72fb71acbad13d1f3faed8b8618bc6ac240439a47bb4:1546344 l2_head_time=1,709,546,544
1|op-node  | t=2024-03-04T16:05:31+0000 lvl=eror msg="Error finding next L1 Origin"           err="cannot build next L2 block past current L1 origin 0x006f6e0281d5e6e009c23fccd3fc78296011f2575f3674cd97981ddaf7197461:5414002 by more than sequencer time drift, and failed to find next L1 origin: not found"
1|op-node  | t=2024-03-09T23:51:59+0000 lvl=info msg="inserted block"                         hash=0xab22182f497a2e0435d47bf38ea9d2982c470e6a3d54b2a9bff2ceaf0b62ea77 number=1,787,232 state_root=0x63bd9b4fa11451410adc700da02b1fd1169801a03e4db4066e3e58c3e8ad4eb3 timestamp=1,710,028,320 parent=0x653645dd172b136d5f8b232cab4620d70eb6f5a120c1f003fde43e2132b24d24 prev_randao=0xfcf27c6a972b6cca6e8a2fe794fc94dd67858ad7500f1f7787fcba5da9dd5c82 fee_recipient=0x4200000000000000000000000000000000000011 txs=1   update_safe=false
1|op-node  | t=2024-03-09T23:51:59+0000 lvl=info msg="sequencer successfully built a new block" block=0xab22182f497a2e0435d47bf38ea9d2982c470e6a3d54b2a9bff2ceaf0b62ea77:1787232 time=1,710,028,320 txs=1
1|op-node  | t=2024-03-09T23:52:00+0000 lvl=info msg="creating new block"                     parent=0xab22182f497a2e0435d47bf38ea9d2982c470e6a3d54b2a9bff2ceaf0b62ea77:1787232 l1Origin=0xfe011f632c7827675b9b09fbc7880304c74e8365d1365499f15d5c5a69be2ca9:5452494
1|op-node  | t=2024-03-09T23:52:03+0000 lvl=info msg="Advancing bq origin"                    origin=0x1fb1676fe106731af3c47d1b329af34c5d625c84966ce332fcd8166a20dbf505:5452496 originBehind=false
1|op-node  | t=2024-03-09T23:52:03+0000 lvl=warn msg="tx in inbox with unauthorized submitter" addr=0xf663792Be0EdD00AFFB8BBe4Ac6d8185efD5671d hash=0xb0c163e46f2c7ee298de03715ca27240e1967e5bacd6680a815f5b60554b7a5e err=nil

op-batcher

2|op-batch | t=2024-03-04T16:05:53+0000 lvl=eror msg="Failed to query L1 tip"                 err="getting latest L1 block: 401 Unauthorized"
2|op-batch | t=2024-03-04T16:05:54+0000 lvl=eror msg="Failed to query L1 tip"                 err="getting latest L1 block: 401 Unauthorized"
2|op-batch | t=2024-03-04T16:05:55+0000 lvl=eror msg="Failed to query L1 tip"                 err="getting latest L1 block: 401 Unauthorized"
2|op-batch | t=2024-03-04T16:05:56+0000 lvl=eror msg="Failed to query L1 tip"                 err="getting latest L1 block: 401 Unauthorized"
2|op-batcher  | t=2024-03-09T23:54:14+0000 lvl=info msg="added L2 block to local state"          block=0xafae84a2818f3b0d9ebdecc01b231d71d1d621908598c68ce3fe807d51aa173e:1787299 tx_count=1   time=1,710,028,454
2|op-batcher  | t=2024-03-09T23:54:16+0000 lvl=info msg="added L2 block to local state"          block=0x7ff69e2d18bde3b44d091d1d1d49582d035fca084adf89851afec92a1964c708:1787300 tx_count=1   time=1,710,028,456
2|op-batcher  | t=2024-03-09T23:54:18+0000 lvl=info msg="added L2 block to local state"          block=0x44f5e577bb19fa01590a0ffd3a3aad581c13a6515d4c40c2423708cabfb75069:1787301 tx_count=1   time=1,710,028,458
2|op-batcher  | t=2024-03-09T23:54:20+0000 lvl=info msg="added L2 block to local state"          block=0x7381ad61dcba18c300aa34abfa9115a651c8085aa022a122940ae5177d657089:1787302 tx_count=1   time=1,710,028,460

op-proposer

3|op-prop  | t=2024-03-04T16:11:02+0000 lvl=eror msg="proposer unable to get next block number" err="401 Unauthorized"
3|op-prop  | t=2024-03-04T16:11:14+0000 lvl=eror msg="proposer unable to get next block number" err="401 Unauthorized"
3|op-prop  | t=2024-03-04T16:11:26+0000 lvl=eror msg="proposer unable to get next block number" err="401 Unauthorized"
3|op-prop  | t=2024-03-04T16:11:38+0000 lvl=eror msg="proposer unable to get next block number" err="401 Unauthorized"
3|op-prop  | t=2024-03-09T23:55:55+0000 lvl=info msg="Publishing transaction"              service=proposer tx=0x87e37da9f584a29f75fd15f4ce27d51e231c1b72091769add8387698bd74fb86 nonce=12527 gasTipCap=1,000,000,000 gasFeeCap=1,184,717,134     gasLimit=87777
3|op-prop  | t=2024-03-09T23:55:55+0000 lvl=info msg="Transaction successfully published"

Backend Explorer Logs

{"time":"2024-03-09T06:09:06.575Z","severity":"error","message":"Failed to decode Ethereum JSONRPC response:\n\n  request:\n\n    url: https://onlylayer.org\n\n    body: [{\"id\":16,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000011\",\"0x1AC847\"]},{\"id\":79,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000015\",\"0x1AC80E\"]},{\"id\":18,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001\",\"0x1AC847\"]},{\"id\":54,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000011\",\"0x1AC7CB\"]},{\"id\":5,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000015\",\"0x1AC842\"]},{\"id\":65,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001\"\n\n  response:\n\n    status code: 500\n\n    body: <html>\r\n<head><title>500 Internal Server Error</title></head>\r\n<body>\r\n<center><h1>500 Internal Server Error</h1></center>\r\n<hr><center>nginx/1.18.0 (Ubuntu)</center>\r\n</body>\r\n</html>\r\n\n","metadata":{"count":100,"fetcher":"coin_balance_realtime"}}
{"time":"2024-03-09T06:09:06.575Z","severity":"error","message":"failed to fetch: {:bad_response, \"https://onlylayer.org\"}","metadata":{"count":100,"error_count":100,"fetcher":"coin_balance_realtime"}}
{"time":"2024-03-09T06:09:14.433Z","severity":"info","message":"Start sanitizing of empty blocks. Batch size is 100","metadata":{"fetcher":"empty_blocks_to_refetch"}}
{"time":"2024-03-09T06:09:14.841Z","severity":"info","message":"Batch of empty blocks is sanitized","metadata":{"fetcher":"empty_blocks_to_refetch"}}
{"time":"2024-03-09T06:09:16.225Z","severity":"info","message":"Start handling L1 block #5447214.","metadata":{"fetcher":"optimism_output_roots"}}
{"time":"2024-03-09T06:09:16.265Z","severity":"info","message":"Finish handling L1 block #5447214. Found 1 OutputProposed event(s).","metadata":{"fetcher":"optimism_output_roots"}}
{"time":"2024-03-09T06:09:17.381Z","severity":"error","message":"Failed to decode Ethereum JSONRPC response:\n\n  request:\n\n    url: https://onlylayer.org\n\n    body: [{\"id\":16,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000015\",\"0x1AC4A0\"]},{\"id\":79,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000015\",\"0x1AC2FC\"]},{\"id\":18,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000015\",\"0x1AC4A2\"]},{\"id\":54,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001\",\"0x1AC4A8\"]},{\"id\":5,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0xdeaddeaddeaddeaddeaddeaddeaddeaddead0001\",\"0x1AC5FE\"]},{\"id\":65,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000011\"\n\n  response:\n\n    status code: 500\n\n    body: <html>\r\n<head><title>500 Internal Server Error</title></head>\r\n<body>\r\n<center><h1>500 Internal Server Error</h1></center>\r\n<hr><center>nginx/1.18.0 (Ubuntu)</center>\r\n</body>\r\n</html>\r\n\n","metadata":{"count":100,"fetcher":"coin_balance_catchup"}}
{"time":"2024-03-09T06:09:17.381Z","severity":"error","message":"failed to fetch: {:bad_response, \"https://onlylayer.org\"}","metadata":{"count":100,"error_count":100,"fetcher":"coin_balance_catchup"}}
{"time":"2024-03-09T06:09:17.524Z","severity":"info","message":"Start handling L1 block #5447214.","metadata":{"fetcher":"optimism_withdrawal_events"}}
{"time":"2024-03-09T06:09:17.542Z","severity":"info","message":"Finish handling L1 block #5447214. Found 0 WithdrawalProven/WithdrawalFinalized event(s).","metadata":{"fetcher":"optimism_withdrawal_events"}}
{"time":"2024-03-09T06:09:21.366Z","severity":"error","message":"Failed to decode Ethereum JSONRPC response:\n\n  request:\n\n    url: https://onlylayer.org\n\n    body: [{\"id\":16,\"jsonrpc\":\"2.0\",\"method\":\"eth_getBalance\",\"params\":[\"0x4200000000000000000000000000000000000015\",\"0x1AC45F\"]}

Additional Information

The blockchain should have no constraints and run smoothly for blockchain explorer and not exceed the blockTime limit.

Feedback

No response

[hash1go]

It seems like there is a failure in retrieving data from the Ethereum JSON RPC.