Skip to content

Commit b44f700

Browse files
authored
Revert "set default batch timeout to 1 ms (#229)" (#232)
This reverts commit 6c49137.
1 parent 6c49137 commit b44f700

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/litserve/server.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -417,7 +417,7 @@ def __init__(
417417
workers_per_device: int = 1,
418418
timeout: Union[float, bool] = 30,
419419
max_batch_size: int = 1,
420-
batch_timeout: float = 0.001,
420+
batch_timeout: float = 0.0,
421421
api_path: str = "/predict",
422422
stream: bool = False,
423423
spec: Optional[LitSpec] = None,

0 commit comments

Comments
 (0)