mito: Checks the entry id returned while opening the region

[evenyag]

What type of enhancement is this?

Other

What does the enhancement do?

We should check the entry id while replaying the region

greptimedb/src/mito2/src/region/opener.rs

Lines 386 to 388 in b526d15

	let mut wal_stream = wal.scan(region_id, replay_from_entry_id, wal_options)?;
	while let Some(res) = wal_stream.next().await {
	let (entry_id, entry) = res?;

If the actual entry id in the WAL is less than the flushed entry id, raft-engine might panic while writing into the memtable.

Maybe related to #3041

Implementation challenges

We might provide different recovery mode

• For strict mode we might return error
• For truncate mode we can ignore entry id less than flushed entry id and truncate the WAL

[v0y4g3r]

Maybe I should also address this issue in #3073