bitPhile

diagnostics-local

1 min read

import dask.array as da
from dask.diagnostics import ProgressBar
a = da.arange(10000, chunks=(100))
a
                <tr>
                    <th> Bytes </th>
                    <td> 78.12 kiB </td>
                    <td> 800 B </td>
                </tr>

                <tr>
                    <th> Shape </th>
                    <td> (10000,) </td>
                    <td> (100,) </td>
                </tr>
                <tr>
                    <th> Dask graph </th>
                    <td colspan="2"> 100 chunks in 1 graph layer </td>
                </tr>
                <tr>
                    <th> Data type </th>
                    <td colspan="2"> int64 numpy.ndarray </td>
                </tr>
            </tbody>
        </table>
    </td>
    <td>
    <svg width="170" height="75" style="stroke:rgb(0,0,0);stroke-width:1" >

10000 1

Array Chunk 
with ProgressBar():
    a.mean().sum().compute()
[########################################] | 100% Completed | 109.43 ms

Graph View