Skip to content

Fix AdaptiveBatcher timeout calculation#2093

Merged
sakoush merged 1 commit into
SeldonIO:masterfrom
hanlaur:bug-batching-timeout
Apr 1, 2025
Merged

Fix AdaptiveBatcher timeout calculation#2093
sakoush merged 1 commit into
SeldonIO:masterfrom
hanlaur:bug-batching-timeout

Conversation

@hanlaur

@hanlaur hanlaur commented Mar 31, 2025

Copy link
Copy Markdown
Contributor

Before the fix, the timeout calculation subtracted the passed time from the timeout calculated for the previous round instead of subtracting it from the configured timeout value, causing time to pass quicker than expected.

Fixes #1936

Fixes #2065

Before the fix, the timeout calculation subtracted the passed time from the
timeout calculated for the previous round instead of subtracting it from the
configured timeout value, causing time to pass quicker than expected.
@CLAassistant

CLAassistant commented Mar 31, 2025

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

@sakoush sakoush left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @hanlaur thanks for your contribution.

@sakoush sakoush merged commit 4199fe1 into SeldonIO:master Apr 1, 2025
@hanlaur hanlaur deleted the bug-batching-timeout branch April 1, 2025 09:15
RobertSamoilescu pushed a commit that referenced this pull request Apr 11, 2025
Before the fix, the timeout calculation subtracted the passed time from the
timeout calculated for the previous round instead of subtracting it from the
configured timeout value, causing time to pass quicker than expected.
RobertSamoilescu pushed a commit that referenced this pull request Apr 11, 2025
Before the fix, the timeout calculation subtracted the passed time from the
timeout calculated for the previous round instead of subtracting it from the
configured timeout value, causing time to pass quicker than expected.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Adaptive batching timeout calculation mistake Adaptive batching batch timeout fires sooner than configured

3 participants