how do we choose –nthreads and –nprocs per worker in dask distributed?
It depends on your workload By default Dask creates a single process with as many threads as you have logical cores on your machine (as determined by multiprocessing.cpu_count()). dask-worker … –nprocs 1 –nthreads 8 # assuming you have eight cores dask-worker … # this is actually the default setting Using few processes and many threads … Read more