Code

Feat/oracle reactor#1

Code

Merged

yan-soon merged 151 commits intov0.38.5-patchedSwitcheo/cometbft:v0.38.5-patchedfrom feat/oracle-reactorSwitcheo/cometbft:feat/oracle-reactorCopy head branch name to clipboardJun 11, 2024

+5,159-472

Commits

Commits on Oct 26, 2023

• feat: add application folder to compact

  

  holyxiaoxin

  authored and

  yan-soon

  committed
  ff92c2c

• feat: ability to specify db-names for experimental-compact-goleveldb

  

  holyxiaoxin

  authored and

  yan-soon

  committed
  21fbb31

Commits on Feb 1, 2024

• port over oracle service

  yan-soon

  committed
  ea9fac2

Commits on Feb 6, 2024

• finishing porting over oracle service and start storing votes

  yan-soon

  committed
  c507a87

Commits on Feb 16, 2024

• implement pruning, gossip and partial signing svc

  yan-soon

  committed
  9bc89f8

Commits on Feb 20, 2024

• rehaul gossiping and pruning and add new unsigned vote buffer

  yan-soon

  committed
  4d5a70b

• add notes

  yan-soon

  committed
  7d5e05f

Commits on Feb 21, 2024

• implement oracle signing svc

  yan-soon

  committed
  8fd47e5

• remove unused code from oracle reactor

  yan-soon

  committed
  945b2fa

Commits on Feb 23, 2024

• update and test gossip votes among cluster of vals

  yan-soon

  committed
  37aa8e1

• add new proto for list of gossipVotes

  yan-soon

  committed
  be0f2c5

• Revert "add new proto for list of gossipVotes"

  Show description for d4339f0
  yan-soon

  committed
  d4339f0

• test update buf build name, for exporting

  yan-soon

  committed
  c3501d7

Commits on Feb 26, 2024

• add SignGossipVote hook to proxyApp interface

  yan-soon

  committed
  a6aa022

Commits on Feb 28, 2024

• use http client to query oracle and results, instead of grpc

  yan-soon

  committed
  820ce18

• shift proto file and update package name to prevent clash with carbon

  yan-soon

  committed
  2e2f0ed

Commits on Mar 7, 2024

• remove unused grpc client from oracle service

  yan-soon

  committed
  8407ba7

• update oracle proto, for proposer verification

  yan-soon

  committed
  9cd2e53

• add logs for validator set

  yan-soon

  committed
  0262f41

• remove val set logs

  yan-soon

  committed
  c14385f

• fix bug where tx wasnt included in block

  yan-soon

  committed
  d4f658a

• account size of injected MsgCreateResult tx in block prop

  yan-soon

  committed
  ab6d575

Commits on Mar 8, 2024

• account for maxTxDataBytes when inserting oracle tx in to block prop

  yan-soon

  committed
  c96342c

• inject oracle results tx into response of prepare proposal instead

  yan-soon

  committed
  c7e19e4

• Revert "inject oracle results tx into response of prepare proposal instead"

  Show description for e6f036d
  yan-soon

  committed
  e6f036d

Commits on Mar 11, 2024

• adding logs for debugging

  yan-soon

  committed
  6a76447

Commits on Mar 12, 2024

• add string compression

  

  Yan

  authored and

  Yan

  committed
  25375f6

• test with larger max tx size for oracle gossip

  

  Yan

  authored and

  Yan

  committed
  9157efb

• add config oracle reactor

  

  Yan

  authored and

  Yan

  committed
  ded309f

Commits on Mar 13, 2024

• cut down on oracle msg size

  

  Yan

  authored and

  Yan

  committed
  9b9955c

• add back validator field to oracle vote

  

  Yan

  authored and

  Yan

  committed
  4315a35

• add back validator field to gossipVote

  

  Yan

  authored and

  Yan

  committed
  2e8c0fe

• add rest endpoint check before starting up oracle service

  

  Yan

  authored and

  Yan

  committed
  3994d10

• shift rest endpoint check to within go routine

  

  Yan

  authored and

  Yan

  committed
  37fa715

• add grpc health check before starting oracle service

  

  Yan

  authored and

  Yan

  committed
  6f52e10

• update default grpc addr

  

  Yan

  authored and

  Yan

  committed
  af0c3f9

Commits on Mar 14, 2024

• add validator check during gossiping, add gossipVoteBuffer pruner

  

  Yan

  authored and

  Yan

  committed
  a75f1b9

• add logs for validator checking on gossip

  

  Yan

  authored and

  Yan

  committed
  4ede0a5

• add more logs for debugging

  

  Yan

  authored and

  Yan

  committed
  f875f13

Commits on Mar 15, 2024

• add gossip interval to config

  

  Yan

  authored and

  Yan

  committed
  41b3fda

Commits on Mar 22, 2024

• merge v0.38.5

  

  Yan

  authored and

  Yan

  committed
  4e037d4

Commits on Apr 16, 2024

• remove oracle service

  

  yan-soon

  authored and

  yan-soon

  committed
  bbbc29a

• add new prepareOracleVotes hook

  

  yan-soon

  authored and

  yan-soon

  committed
  5ddda97

• add prepareOracleVotes impl

  

  yan-soon

  authored and

  yan-soon

  committed
  617f655

Commits on Apr 17, 2024

• test new flow

  

  yan-soon

  authored and

  yan-soon

  committed
  5d9a887

Commits on Apr 18, 2024

• impl inject oracleTx in prepareProposal and validate oracleTx in processProposal

  

  yan-soon

  authored and

  yan-soon

  committed
  66e1120

• fix index txs index out of range bug

  

  yan-soon

  authored and

  yan-soon

  committed
  637ceef

• update proto

  

  yan-soon

  authored and

  yan-soon

  committed
  d99d272

• fix bug with proto indexing

  

  yan-soon

  authored and

  yan-soon

  committed
  1dcdefd

• add validateOracleVotes hook

  

  yan-soon

  authored and

  yan-soon

  committed
  8149b71

• add back signGossipVote hook

  

  yan-soon

  authored and

  yan-soon

  committed
  7ba2168

Commits on Apr 19, 2024

• add logs

  

  yan-soon

  committed
  c2f9b72

• remove ununsed code and fix bug w process proposal

  

  yan-soon

  committed
  671ffca

Commits on Apr 21, 2024

• add logs

  

  yan-soon

  authored and

  yan-soon

  committed
  3392e0a

• add more logs

  

  yan-soon

  authored and

  yan-soon

  committed
  8618a17

• clean unused proto and fix uint64 overflow bug

  

  yan-soon

  authored and

  yan-soon

  committed
  7e742a3

Commits on Apr 23, 2024

• update config, remove unsignedBuffer, change getting of oracleVotes to blocking, some compression work

  

  yan-soon

  authored and

  yan-soon

  committed
  7d2ae5c

• fix prepareOracleVotes bug

  

  yan-soon

  authored and

  yan-soon

  committed
  5ede911

• add logs

  

  yan-soon

  authored and

  yan-soon

  committed
  ec44936

• include signedTimeStamp in signedVote

  

  yan-soon

  authored and

  yan-soon

  committed
  8651c11

Commits on Apr 26, 2024

• test w pub key

  

  yan-soon

  authored and

  yan-soon

  committed
  38b8196

• Revert "test w pub key"

  Show description for 80687bd
  

  yan-soon

  authored and

  yan-soon

  committed
  80687bd

Commits on Apr 29, 2024

• add back unsigned buffer

  

  yan-soon

  authored and

  yan-soon

  committed
  a5026bc

• remove signType from gossipVote

  

  yan-soon

  authored and

  yan-soon

  committed
  3d218ff

• convert oracleId type to int64

  

  yan-soon

  authored and

  yan-soon

  committed
  19d31dd

• test logs

  

  yan-soon

  authored and

  yan-soon

  committed
  a067ade

• test sort

  

  yan-soon

  authored and

  yan-soon

  committed
  f7083a3

• fix bug where gossipBuffer was not pruning properly

  

  yan-soon

  authored and

  yan-soon

  committed
  a161e3e

• revert oracleId type to int64

  

  yan-soon

  authored and

  yan-soon

  committed
  cd285d3

Commits on Apr 30, 2024

• remove some logs

  

  yan-soon

  authored and

  yan-soon

  committed
  7091d6c

• remove more logs

  

  yan-soon

  authored and

  yan-soon

  committed
  1fb4a5c

• fix bug for verifying vals in gossip

  

  yan-soon

  authored and

  yan-soon

  committed
  7144c7f

• update configs for maxGossipAge

  

  yan-soon

  authored and

  yan-soon

  committed
  afc8c9b

• remove unused code

  

  yan-soon

  authored and

  yan-soon

  committed
  6d3c735

• optimise gossip slightly

  

  yan-soon

  authored and

  yan-soon

  committed
  b691924

• fix bug where invalid gossipVotes are not removed during validation

  

  yan-soon

  authored and

  yan-soon

  committed
  7cbec64

Commits on May 2, 2024

• improve naming for abci oracle hook methods

  

  yan-soon

  authored and

  yan-soon

  committed
  f3f5ee5

• update val address type to string

  

  yan-soon

  authored and

  yan-soon

  committed
  42fab7f

• fix bug with prepareProposal when nil oracleCreateTx is found

  

  yan-soon

  authored and

  yan-soon

  committed
  7ef4c20

• update validateOracleVotes response

  

  yan-soon

  authored and

  yan-soon

  committed
  5ac3eba

• test without validator index for gossip votes

  

  yan-soon

  authored and

  yan-soon

  committed
  62aef7d

Commits on May 3, 2024

• test with both val index and val addr in gossipedVotes

  

  yan-soon

  authored and

  yan-soon

  committed
  664182f

• add val index as part of signature

  

  yan-soon

  authored and

  yan-soon

  committed
  cb5abc0

• add logs

  

  yan-soon

  authored and

  yan-soon

  committed
  8de22c9

• improve logs and add check to not gossip stale votes

  

  yan-soon

  authored and

  yan-soon

  committed
  efb590d

• improve check for stale gossip votes on gossip protocol

  

  yan-soon

  authored and

  yan-soon

  committed
  b4640f2

• fix nil bug on gossip

  

  yan-soon

  authored and

  yan-soon

  committed
  bd45f6c

• simplify pruning for vote buffers

  

  yan-soon

  authored and

  yan-soon

  committed
  4410992

• edit prune interval

  

  yan-soon

  authored and

  yan-soon

  committed
  ee4638f

• test without pruning gossip buffer

  

  yan-soon

  authored and

  yan-soon

  committed
  bcb8cd1

Commits on May 4, 2024

• regen proto

  

  yan-soon

  authored and

  yan-soon

  committed
  782e945

• add test logs

  

  yan-soon

  authored and

  yan-soon

  committed
  a554af9

• test without pruning

  

  yan-soon

  authored and

  yan-soon

  committed
  c19c793

• test gossiping without validator addr

  

  yan-soon

  authored and

  yan-soon

  committed
  f22af4c

• test with gossip backoff

  

  yan-soon

  authored and

  yan-soon

  committed
  d2b1ecf

• more tests

  

  yan-soon

  authored and

  yan-soon

  committed
  30ee748

Commits on May 5, 2024

• test bug fix with votes in unsignedBuffer

  

  yan-soon

  authored and

  yan-soon

  committed
  4484f3d

• test with validator field as bytes

  

  yan-soon

  authored and

  yan-soon

  committed
  8abbfbd

• test without sort

  

  yan-soon

  authored and

  yan-soon

  committed
  c16062f

Commits on May 6, 2024

• revert back to no validator field test

  

  yan-soon

  authored and

  yan-soon

  committed
  3b11cbf

• test with sort again

  

  yan-soon

  authored and

  yan-soon

  committed
  455b252

• test sort fix

  

  yan-soon

  authored and

  yan-soon

  committed
  7894d8c

• add back validator field for gossipedVotes struct

  

  yan-soon

  authored and

  yan-soon

  committed
  ee9dd54

• test no sort, with validator field

  

  yan-soon

  authored and

  yan-soon

  committed
  884ee67

• shift oracle validation logic

  

  yan-soon

  authored and

  yan-soon

  committed
  9d8eb96

• test with updated sort

  

  yan-soon

  authored and

  yan-soon

  committed
  2d973d7

• update sort func to be stricter

  

  yan-soon

  authored and

  yan-soon

  committed
  117174e

Commits on May 7, 2024

• test with stable sort

  

  yan-soon

  authored and

  yan-soon

  committed
  a3f55e8

• add logs for gossip

  

  yan-soon

  authored and

  yan-soon

  committed
  241668b

• fix sorting bug

  

  yan-soon

  authored and

  yan-soon

  committed
  00a4e74

• add pruning logs

  

  yan-soon

  authored and

  yan-soon

  committed
  e692837

• sort vote by timestamp first

  

  yan-soon

  authored and

  yan-soon

  committed
  c21f101

• remove validateOracleVotes hook

  

  yan-soon

  authored and

  yan-soon

  committed
  4c67e19

• remove testing logs

  

  yan-soon

  authored and

  yan-soon

  committed
  127a875

• remove validator field from gossipedVotes

  

  yan-soon

  authored and

  yan-soon

  committed
  197c06a

• Revert "remove validator field from gossipedVotes"

  Show description for 361b4d4
  

  yan-soon

  authored and

  yan-soon

  committed
  361b4d4

Commits on May 8, 2024

• add config for prune interval, revert go.mod go.sum

  

  yan-soon

  authored and

  yan-soon

  committed
  0448cb5

• fix logs in oracle reactor and remove unused vars

  

  yan-soon

  authored and

  yan-soon

  committed
  d7bbd24

Commits on May 9, 2024

• remove unused fields from createOracleResultTx hook

  

  yan-soon

  authored and

  yan-soon

  committed
  4b81008

• add back validateOracleVotes hook

  

  yan-soon

  authored and

  yan-soon

  committed
  8c4eef2

• resolve comments and minor fixes

  

  yan-soon

  authored and

  yan-soon

  committed
  3144a6b

Commits on May 10, 2024

• update fetchOracleVotes hook to take in multiple votes at once

  

  yan-soon

  authored and

  yan-soon

  committed
  2ee5578

• fix bug with sign votes channel

  

  yan-soon

  authored and

  yan-soon

  committed
  3f70d30

• re-implement blocking on fetchOracleVotes

  

  yan-soon

  authored and

  yan-soon

  committed
  1e4948b

Commits on May 11, 2024

• resolve more comments

  

  yan-soon

  authored and

  yan-soon

  committed
  14a668d

• fix bug with appending last block timestamps

  

  yan-soon

  authored and

  yan-soon

  committed
  2d78b6f

• add proposerAddr in createOracleResultTx hook

  

  yan-soon

  authored and

  yan-soon

  committed
  ce8eb4a

• add hard cap for maxVoteAge in the event the blocks dont move

  

  yan-soon

  authored and

  yan-soon

  committed
  7e1eb94

Commits on May 12, 2024

• remove val index from gossipedVotes

  

  yan-soon

  authored and

  yan-soon

  committed
  0ea5232

Commits on May 16, 2024

• update context for validateOracleVotes

  

  yan-soon

  authored and

  yan-soon

  committed
  49d88a5

Commits on May 21, 2024

• fix logging and add exit logic for p2p on oracle reactor

  

  yan-soon

  authored and

  yan-soon

  committed
  9c49a87

• comment out exit logic for peer

  

  yan-soon

  authored and

  yan-soon

  committed
  fb1d6a8

• test ctx, remove later

  

  yan-soon

  authored and

  yan-soon

  committed
  11ee8cf

Commits on May 23, 2024

• Revert "test ctx, remove later"

  Show description for 3af0b69
  

  yan-soon

  authored and

  yan-soon

  committed
  3af0b69

Commits on May 26, 2024

• update stop peer logic for oracle vote gossip

  

  yan-soon

  authored and

  yan-soon

  committed
  3d26f4f

Commits on May 28, 2024

• fix comments and remove unused proto imports

  

  yan-soon

  authored and

  yan-soon

  committed
  3051fd6

• fix compile errors

  

  yan-soon

  authored and

  yan-soon

  committed
  1b1ea81

• add maxOracleGossipAge as config

  

  yan-soon

  authored and

  yan-soon

  committed
  8f73c09

Commits on May 31, 2024

• shift order of insertion of oracle result tx

  

  yan-soon

  authored and

  yan-soon

  committed
  58ab1be

Commits on Jun 3, 2024

• add logs for mutex locking and unlocking

  

  yan-soon

  authored and

  yan-soon

  committed
  407f495

• remove logs for unsigned vote buffer

  

  yan-soon

  authored and

  yan-soon

  committed
  f10d307

• add clearer logs for tracking mutex lock times

  

  yan-soon

  authored and

  yan-soon

  committed
  a2c8967

• improve logs for benchmarking lock times

  

  yan-soon

  authored and

  yan-soon

  committed
  a1e4b70

• optimise locking for sending gossip routine

  

  yan-soon

  authored and

  yan-soon

  committed
  4c71a0a

• improve lock logs

  

  yan-soon

  authored and

  yan-soon

  committed
  f178e00

Commits on Jun 4, 2024

• increase threshold for lock timings

  

  yan-soon

  authored and

  yan-soon

  committed
  9a55922

• update configs for oracle reactor

  

  yan-soon

  authored and

  yan-soon

  committed
  baced90

• remove unnecessary check for pruning of oracle votes

  

  yan-soon

  authored and

  yan-soon

  committed
  ea429b7

• check for block timestamp buffer size before pruning

  

  yan-soon

  authored and

  yan-soon

  committed
  3babce3

Commits on Jun 5, 2024

• rename oracle config to oraclesvc to prevent clashing with carbon oracle flag

  

  yan-soon

  authored and

  yan-soon

  committed
  c3438e4

Commits on Jun 10, 2024

• add less aggresive configs and prune dup votes

  

  yan-soon

  authored and

  yan-soon

  committed
  d947aab