Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory keeps increasing #95

Open
RicoToothless opened this issue Jan 19, 2022 · 1 comment
Open

Memory keeps increasing #95

RicoToothless opened this issue Jan 19, 2022 · 1 comment

Comments

@RicoToothless
Copy link

RicoToothless commented Jan 19, 2022

We have 40 Kusama validators and host on EKS cluster.

The ValidatorOfflineSessionLong metric start inaccurate and trigger the alert. It was recovered by itself in a short time until it was totally unrecoverable.

validator-offline-session-log

But our Kusama validators and we run Polkadot watcher locally to test the metrics were fine.

We found out the Polkadot watcher memory usage keeps increasing.

polkadot-watcher-memory-usage

After recreating the pod, Polkadot watcher was fine for a while.

@ironoa
Copy link
Contributor

ironoa commented Jan 21, 2022

Thanks for noticing that, I'll have a look at this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants