Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zongji skipping through large binlog files on restart #76

Open
arpan-jain opened this issue Feb 15, 2018 · 0 comments
Open

Zongji skipping through large binlog files on restart #76

arpan-jain opened this issue Feb 15, 2018 · 0 comments

Comments

@arpan-jain
Copy link

I have a large MySQL binlog file (FILESIZE: 328035862 Bytes) which is being read and processed through a zongji application. Also, I am storing the binlog position to which events have been processed in an external memory. During this, a stage comes when my zongji application crashes as it goes out to heap memory because of a large number of unprocessed binlog events. When I restart the zongji application using the last processed binlogName and binlogNextPos, zongji starts reading the binlog events somewhere at the end of passed binlogName file skipping over the file.

Any ideas why this might be happening and how can I prevent this?

eg.
last processed event before zongji application crash : (mysql-bin-changelog.011531, 911301)
After restarting the application with the above binlogName and binlogNextPos, next event processed : (mysql-bin-changelog.011531,329171477)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant