Created
November 17, 2016 20:23
-
-
Save edenhill/f617caa8ed671a0f960ead56556e0c5c to your computer and use it in GitHub Desktop.
offset store.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
If your processing rate is high this might not be optimal since you'll be committing for each message, even if using async commits there's some degree of performance penalty. | |
So another alternative is to keep `enable.auto.commit` set to True (default) but disable the automatic offset store. | |
So what is the offset store? | |
Each time a message is passed from the client to your application its offset is stored for future commit, the next intervalled commit will then use this stored offset. If the stored offset did not change from the last commit nothing happens. | |
So by setting `enable.auto.offset.store` to False you keep the convenient intervalled auto commit behaviour but you control what offsets are actually eligible for commit. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is there any reference?