Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

backport: Replace fast sync with batch processing #155

Merged
merged 4 commits into from
Nov 26, 2024

Conversation

gitferry
Copy link
Member

Notable changes:

  • remove fast sync completely
  • introduce batch process for catching up
  • introduce signature submission interval to config
  • introduce batch submission size to config

Closes #118. Notable changes:
* remove fast sync completely
* introduce batch process for catching up
* introduce signature submission interval to config
* introduce batch submission size to config
@gitferry gitferry force-pushed the gai/backport-remove-fast-sync branch from 76de75b to 67b3e51 Compare November 25, 2024 11:32
Copy link
Member

@SebastianElvis SebastianElvis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! CI failed though

@gitferry gitferry force-pushed the gai/backport-remove-fast-sync branch from 214d1ab to 2a21b69 Compare November 26, 2024 03:59
@gitferry
Copy link
Member Author

@bap2pecs Do you have any ideas why op_e2e_test failed?

@bap2pecs
Copy link
Contributor

@bap2pecs Do you have any ideas why op_e2e_test failed?

i think it's due to some of our test cases depend on the fast sync logic. it probably need some non-trivial refactoring. maybe we can just disable the op_e2e_test in CI for now?

}

// UnjailFinalityProvider sends an unjail transaction to the consumer chain
func (bc *BabylonController) UnjailFinalityProvider(fpPk *btcec.PublicKey) (*types.TxResponse, error) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is this added in this PR?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Opps, should remove it

@gitferry
Copy link
Member Author

i think it's due to some of our test cases depend on the fast sync logic. it probably need some non-trivial refactoring. maybe we can just disable the op_e2e_test in CI for now?

Good. Removed it and added todos in ci

@gitferry gitferry merged commit a34b905 into base/consumer-chain-support Nov 26, 2024
14 checks passed
@gitferry gitferry deleted the gai/backport-remove-fast-sync branch November 26, 2024 08:19
SyncFpStatusInterval time.Duration `long:"syncfpstatusinterval" description:"The duration of time that it should sync FP status with the client blockchain"`
LogLevel string `long:"loglevel" description:"Logging level for all subsystems" choice:"trace" choice:"debug" choice:"info" choice:"warn" choice:"error" choice:"fatal"`
// ChainType and ChainID (if any) of the chain config identify a consumer chain
ChainType string `long:"chaintype" description:"the type of the consumer chain" choice:"babylon"`
Copy link
Contributor

@bap2pecs bap2pecs Dec 11, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ah it's caused this line change

Whoops. There was an error while executing your fpd CLI 'failed to load configuration: /home/finality-provider/.fpd/fpd.conf:6: Invalid value `OPStackL2' for option `--chaintype'. Allowed values are: 'bash-5.1$ fpd commit-pubrand -h

res, err = fp.SubmitFinalitySignature(targetBlocks[0])
} else {
select {
case <-time.After(fp.cfg.SubmissionRetryInterval):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok I just found another problem. this will wait SubmissionRetryInterval even at the first iteration. Default value is set to 300 seconds. that's why I found out batch sig submission is very slow

I will send out a fix soon

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants