concurrent

gworker_client.lifecycle.concurrent

Allow one container to handle multiple concurrent inputs simultaneously. Useful for I/O-bound class tasks (e.g. embedding servers) where GPU utilisation would otherwise be low. Apply to the class, not individual methods.

1concurrent(max_inputs: int, target_inputs: int | None = None) -> Callable[[_F], _F]

← Back to docs