Overriding blosc threads

[jakirkham]

Would be nice to expose to the user a way to set the number of threads to use with blosc. Suggested options would be a config file setting and some Python API to do this. Both would be great.

xref: #606 (review)

[mrocklin]

An entry in the config file sounds good to me. Client.run could probably handle the Python API in a pinch.

def f(nthreads, dask_worker=None):
    import blosc
    blosc.set_nthreads(nthreads)

client.run(f, 4)

[jakirkham]

So now that the config is revamped, how might one go about moving this parameter into the config?

[mrocklin]

Replace this line in distributed/protocol/compression.py:

n = blosc.set_nthreads(2)

With something like this?

n = blosc.set_nthreads(dask.config.get('distributed.comm.blosc.nthreads`)) 

And then add a suitable entry to distributed/distributed.yaml

[jakirkham]

What about adding it to the config?

[mrocklin]

Yes, I think that that's a good idea

[jakirkham]

Closing as Blosc was dropped ( #6027 )