batched

gworker_client.lifecycle.batched

Enable dynamic input batching. When multiple inputs arrive within wait_ms of each other, they are coalesced into a single list and passed to the function together. The function receives list[input] and must return list[output] of the same length.

1batched(max_batch_size: int, wait_ms: int = 100) -> Callable[[_F], _F]

← Back to docs