Skip to content

Avoid host crash due to docker excessive resources use #193

Open
@fe51

Description

@fe51

According to docker documentation :

By default, a container has no resource constraints and can use as much of a given resource as the host's kernel scheduler allows.

and this is how pyro-engine actually works.

However, we have recently encounter issues, rpi crash, probably due to a due to excessive use of multiprocessing and it has needed manual reboot.

from multiprocessing import Process, Queue, cpu_count

To prevent this kind of situation from recurring, we could consider limiting usage by docker Memory, CPUs, and GPUs.

I'd like to know the best practices on this subject (which parameters to play with ... hard or soft limits for memory..... if the rpi has 4 CPUs, is relevant to setup a limit to 3.8 .. etc ), which limitations to implement, and whether there are any constraints to implementing this type of docker limitation.

I would tend to think that we want to minimize the limits imposed on the docker service, but make sure we avoid a complete host crash

Thank you in advance for your suggestions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is neededquestionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions