-
Notifications
You must be signed in to change notification settings - Fork 15
REP-6735 Allow rechecks to be enqueued during recheck task gen #157
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
REP-6735 Allow rechecks to be enqueued during recheck task gen #157
Conversation
tdq45gj
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM % one small request
internal/verifier/recheck.go
Outdated
| generation++ | ||
|
|
||
| eg, groupCtx := contextplus.ErrGroup(ctx) | ||
| eg.SetLimit(100) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you add a comment to explain the purpose of the limit?
|
There were test failures in the past run, but they are unrelated & will be dealt with separately. |
Historically, the verifier blocked the enqueuing of rechecks while generating new recheck tasks. This slowed down the change stream because it couldn’t enqueue rechecks during that time.
There seems to be no reason why the change stream needs to be blocked while creating new tasks, though. This changeset removes the restriction. It also tweaks the generation-numbering so that the generation persisted with the recheck is the generation where the document will be rechecked rather than the generation where the recheck was enqueued.
The net effect here is that, with the change stream not blocked for several seconds between generations, higher throughput is possible.