What kind of hardware are you working with? What resources do you have allocated to Docker. Are you including tens of thousands of files in volume mounts?
We use docker extensively at work, and I've found it helps to have at least half of your machine's hardware available to docker. My 2018 MBP has 5 cores and 10GB RAM allocated.
However, docker is very sensitive to the amount of files being included and being watched over. SO if you have thousands to tens of thousands of files in your volume mount symlinks, performance is going to be poor.