Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug(metrics): Invalid data reported: lru_evicted_watermark_time_diff_ms #12293

Closed
fuyufjh opened this issue Sep 14, 2023 · 3 comments · Fixed by #12431
Closed

bug(metrics): Invalid data reported: lru_evicted_watermark_time_diff_ms #12293

fuyufjh opened this issue Sep 14, 2023 · 3 comments · Fixed by #12431
Assignees
@yuhao-su
Labels
type/bug Something isn't working
Milestone
release-1.3

Comments

@fuyufjh
Copy link
Member

fuyufjh commented Sep 14, 2023

Describe the bug

Invalid data reported: lru_evicted_watermark_time_diff_ms

image

Error message/log

No response

To Reproduce

No response

Expected behavior

No response

How did you deploy RisingWave?

No response

The version of RisingWave

No response

Additional context

No response
@fuyufjh fuyufjh added the type/bug Something isn't working label Sep 14, 2023
@fuyufjh fuyufjh changed the title bug(metrics): bad bug(metrics): Invalid data reported: lru_evicted_watermark_time_diff_ms Sep 14, 2023
@github-actions github-actions bot added this to the release-1.3 milestone Sep 14, 2023
@yuhao-su
Copy link
Contributor

It's likely the node restarted at those data peaks.

@fuyufjh
Copy link
Member Author

fuyufjh commented Sep 18, 2023 •
edited
Loading

Yeah. The value is so huge that makes the normal values unable to be seen. I'm considering we should exclude these bad data in some ways

@yuhao-su
Copy link
Contributor

The value is so huge that makes the normal values unable to be seen

Yeah I failed to consider this. Will fix this.

@yuhao-su yuhao-su mentioned this issue Sep 19, 2023
Merged
8 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yuhao-su yuhao-su

Labels
type/bug Something isn't working
Projects
None yet
Milestone
release-1.3
Development

Successfully merging a pull request may close this issue.

fix(dashboard): calculate lru_evicted_watermark_time_diff_ms in promsql risingwavelabs/risingwave
2 participants
@fuyufjh @yuhao-su