Skip to content

.map/.foreach concurrency by chunks #29

Open
@ebonnal

Description

@ebonnal

either

  • chunksize: int = 1 param similar to multiprocessing.Pool's
  • param-free adaptive logic adapting chunksize dynamically depending on the state of futures in queue

Currently to achieve an equivalent behavior, one have to .group(chunksize)pior to concurrent mapping and then .flatten().

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureNew feature or request, modifies library API

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions