The growth rate of indexer_tip in ckb-indexer cannot keep up with the tip growth rate in ckb-sync

[eval-exec]

Feature Request

We have observed that the growth speed of indexer_tip in ckb-indexer cannot keep up with the growth speed of tip in ckb-sync.

We should investigate and identify ways to accelerate the synchronization speed of ckb-indexer to better align it with ckb-sync.

2025-01-02 16:10:01 height: 797963 indexer_tip: 798000 mainnet_height: 15013787 difference: 14215787 height_sync_rate: 5.31% sync_rate: 5.32%
2025-01-02 16:30:01 height: 2161493 indexer_tip: 2161493 mainnet_height: 15013913 difference: 12852420 height_sync_rate: 14.40% sync_rate: 14.40%
2025-01-02 16:50:01 height: 3312887 indexer_tip: 3312887 mainnet_height: 15014059 difference: 11701172 height_sync_rate: 22.07% sync_rate: 22.07%
2025-01-02 17:10:01 height: 3346255 indexer_tip: 3346255 mainnet_height: 15014184 difference: 11667929 height_sync_rate: 22.29% sync_rate: 22.29%
2025-01-02 17:30:02 height: 3411019 indexer_tip: 3411019 mainnet_height: 15014308 difference: 11603289 height_sync_rate: 22.72% sync_rate: 22.72%
2025-01-02 17:50:01 height: 4728688 indexer_tip: 4728729 mainnet_height: 15014429 difference: 10285700 height_sync_rate: 31.49% sync_rate: 31.49%
2025-01-02 18:10:01 height: 6022006 indexer_tip: 5933000 mainnet_height: 15014540 difference: 9081540 height_sync_rate: 40.11% sync_rate: 39.52%
2025-01-02 18:30:01 height: 6769570 indexer_tip: 6364398 mainnet_height: 15014648 difference: 8650250 height_sync_rate: 45.09% sync_rate: 42.39%
2025-01-02 18:50:01 height: 7485775 indexer_tip: 6603267 mainnet_height: 15014770 difference: 8411503 height_sync_rate: 49.86% sync_rate: 43.98%
2025-01-02 19:10:02 height: 8040239 indexer_tip: 6765705 mainnet_height: 15014900 difference: 8249195 height_sync_rate: 53.55% sync_rate: 45.06%
2025-01-02 19:30:01 height: 8267192 indexer_tip: 6989070 mainnet_height: 15015034 difference: 8025964 height_sync_rate: 55.06% sync_rate: 46.55%
2025-01-02 19:50:01 height: 8724280 indexer_tip: 7251329 mainnet_height: 15015159 difference: 7763830 height_sync_rate: 58.10% sync_rate: 48.29%
2025-01-02 20:10:01 height: 9312139 indexer_tip: 7466157 mainnet_height: 15015295 difference: 7549138 height_sync_rate: 62.02% sync_rate: 49.72%
2025-01-02 20:30:01 height: 10332006 indexer_tip: 7606619 mainnet_height: 15015413 difference: 7408794 height_sync_rate: 68.81% sync_rate: 50.66%
2025-01-02 20:50:01 height: 11233384 indexer_tip: 7779772 mainnet_height: 15015571 difference: 7235799 height_sync_rate: 74.81% sync_rate: 51.81%
2025-01-02 21:10:01 height: 11921475 indexer_tip: 7982937 mainnet_height: 15015722 difference: 7032785 height_sync_rate: 79.39% sync_rate: 53.16%
2025-01-02 21:30:01 height: 12277076 indexer_tip: 8271395 mainnet_height: 15015859 difference: 6744464 height_sync_rate: 81.76% sync_rate: 55.08%
2025-01-02 21:50:02 height: 12812873 indexer_tip: 8445609 mainnet_height: 15015983 difference: 6570374 height_sync_rate: 85.33% sync_rate: 56.24%
2025-01-02 22:10:01 height: 13255637 indexer_tip: 8577838 mainnet_height: 15016121 difference: 6438283 height_sync_rate: 88.28% sync_rate: 57.12%
2025-01-02 22:30:01 height: 13462518 indexer_tip: 8731511 mainnet_height: 15016270 difference: 6284759 height_sync_rate: 89.65% sync_rate: 58.15%
2025-01-02 22:50:01 height: 13910203 indexer_tip: 8873400 mainnet_height: 15016411 difference: 6143011 height_sync_rate: 92.63% sync_rate: 59.09%
2025-01-02 23:10:02 height: 13934614 indexer_tip: 8905934 mainnet_height: 15016551 difference: 6110617 height_sync_rate: 92.80% sync_rate: 59.31%
2025-01-02 23:30:01 height: 14006562 indexer_tip: 9003382 mainnet_height: 15016704 difference: 6013322 height_sync_rate: 93.27% sync_rate: 59.96%
2025-01-02 23:50:01 height: 14013841 indexer_tip: 9041784 mainnet_height: 15016840 difference: 5975056 height_sync_rate: 93.32% sync_rate: 60.21%
2025-01-03 00:10:01 height: 14029253 indexer_tip: 9084552 mainnet_height: 15016995 difference: 5932443 height_sync_rate: 93.42% sync_rate: 60.50%
2025-01-03 00:30:02 height: 14056700 indexer_tip: 9143315 mainnet_height: 15017134 difference: 5873819 height_sync_rate: 93.60% sync_rate: 60.89%
2025-01-03 00:50:01 height: 14067774 indexer_tip: 9180143 mainnet_height: 15017274 difference: 5837131 height_sync_rate: 93.68% sync_rate: 61.13%
2025-01-03 01:10:01 height: 14077035 indexer_tip: 9217347 mainnet_height: 15017406 difference: 5800059 height_sync_rate: 93.74% sync_rate: 61.38%
2025-01-03 01:30:01 height: 14087341 indexer_tip: 9254197 mainnet_height: 15017569 difference: 5763372 height_sync_rate: 93.81% sync_rate: 61.62%
2025-01-03 01:50:02 height: 14123955 indexer_tip: 9362309 mainnet_height: 15017736 difference: 5655427 height_sync_rate: 94.05% sync_rate: 62.34%
2025-01-03 02:10:01 height: 14146343 indexer_tip: 9408207 mainnet_height: 15017890 difference: 5609683 height_sync_rate: 94.20% sync_rate: 62.65%
2025-01-03 02:30:01 height: 14159232 indexer_tip: 9448693 mainnet_height: 15018024 difference: 5569331 height_sync_rate: 94.28% sync_rate: 62.92%
2025-01-03 02:50:01 height: 14174530 indexer_tip: 9483630 mainnet_height: 15018173 difference: 5534543 height_sync_rate: 94.38% sync_rate: 63.15%
2025-01-03 03:10:01 height: 14195590 indexer_tip: 9525569 mainnet_height: 15018337 difference: 5492768 height_sync_rate: 94.52% sync_rate: 63.43%
2025-01-03 03:30:02 height: 14208095 indexer_tip: 9564168 mainnet_height: 15018500 difference: 5454332 height_sync_rate: 94.60% sync_rate: 63.68%
2025-01-03 03:50:01 height: 14261494 indexer_tip: 9780612 mainnet_height: 15018640 difference: 5238028 height_sync_rate: 94.96% sync_rate: 65.12%
2025-01-03 04:10:01 height: 14359798 indexer_tip: 10123478 mainnet_height: 15018777 difference: 4895299 height_sync_rate: 95.61% sync_rate: 67.41%
2025-01-03 04:30:01 height: 14491292 indexer_tip: 10531835 mainnet_height: 15018929 difference: 4487094 height_sync_rate: 96.49% sync_rate: 70.12%
2025-01-03 04:50:01 height: 14620943 indexer_tip: 10937073 mainnet_height: 15019064 difference: 4081991 height_sync_rate: 97.35% sync_rate: 72.82%
2025-01-03 05:10:02 height: 14740522 indexer_tip: 11355763 mainnet_height: 15019174 difference: 3663411 height_sync_rate: 98.14% sync_rate: 75.61%
2025-01-03 05:30:01 height: 14855314 indexer_tip: 11795159 mainnet_height: 15019295 difference: 3224136 height_sync_rate: 98.91% sync_rate: 78.53%
2025-01-03 05:50:01 height: 14970557 indexer_tip: 12227238 mainnet_height: 15019431 difference: 2792193 height_sync_rate: 99.67% sync_rate: 81.41%
2025-01-03 06:10:01 height: 15019600 indexer_tip: 12682601 mainnet_height: 15019600 difference: 2336999 height_sync_rate: 100.00% sync_rate: 84.44%
2025-01-03 06:30:02 height: 15019708 indexer_tip: 12986965 mainnet_height: 15019708 difference: 2032743 height_sync_rate: 100.00% sync_rate: 86.47%
2025-01-03 06:50:01 height: 15019874 indexer_tip: 13291129 mainnet_height: 15019874 difference: 1728745 height_sync_rate: 100.00% sync_rate: 88.49%
2025-01-03 07:10:01 height: 15020014 indexer_tip: 13703863 mainnet_height: 15020014 difference: 1316151 height_sync_rate: 100.00% sync_rate: 91.24%
2025-01-03 07:30:01 height: 15020122 indexer_tip: 14130184 mainnet_height: 15020122 difference: 889938 height_sync_rate: 100.00% sync_rate: 94.08%
2025-01-03 07:50:01 height: 15020245 indexer_tip: 14705556 mainnet_height: 15020245 difference: 314689 height_sync_rate: 100.00% sync_rate: 97.90%
2025-01-03 08:10:01 height: 15020384 indexer_tip: 15020384 mainnet_height: 15020384 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%
2025-01-03 08:30:02 height: 15020515 indexer_tip: 15020515 mainnet_height: 15020515 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%
2025-01-03 08:50:01 height: 15020651 indexer_tip: 15020651 mainnet_height: 15020651 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%
2025-01-03 09:10:01 height: 15020746 indexer_tip: 15020746 mainnet_height: 15020746 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%
2025-01-03 09:30:01 height: 15020864 indexer_tip: 15020864 mainnet_height: 15020864 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%
2025-01-03 09:50:01 height: 15020985 indexer_tip: 15020985 mainnet_height: 15020985 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%
2025-01-03 10:10:01 height: 15021114 indexer_tip: 15021114 mainnet_height: 15021114 difference: 0 height_sync_rate: 100.00% sync_rate: 100.00%