Skip to content

Instantly share code, notes, and snippets.

@simon-mo
Created July 23, 2021 20:10
Show Gist options
  • Select an option

  • Save simon-mo/6396c0e604d3d61a142b5632fecbb103 to your computer and use it in GitHub Desktop.

Select an option

Save simon-mo/6396c0e604d3d61a142b5632fecbb103 to your computer and use it in GitHub Desktop.
#!/bin/bash
# NOTE: Only working for Python 3.7 on MacOS.
# NOTE: Please modify the wheel URL.
# DASK_VERSION=("2021.5.0" "2021.4.1" "2021.4.0" "2021.3.1" "2021.2.0" "2021.1.1" "2020.12.0")
DASK_VERSION=(
"2021.7.0" "2021.6.2" "2021.6.1" "2021.6.0"
"2021.5.1" "2021.5.0" "2021.4.1" "2021.4.0"
"2021.3.1" "2021.2.0" "2021.1.1" "2020.12.0"
)
unset RAY_ADDRESS
pip install --upgrade pip pytest
# Comment out the below block for testing.
echo "Please run vi dask-on-ray-test.sh and modify the ray wheel properly."
echo "Also make sure that you are in the right branch on your repo."
echo "For example, if you are using releases/1.3.0 wheel, you should checkout to that repo."
echo "Example: git checkout -b releases/1.3.0 upstream/releases/1.3.0"
#exit 1
pip uninstall -y ray
pip install -U https://s3-us-west-2.amazonaws.com/ray-wheels/releases/1.5.0/ddad6a2458bded21035797ec84ba67b8a8c15ca5/ray-1.5.0-cp37-cp37m-macosx_10_13_intel.whl
for dask_version in "${DASK_VERSION[@]}"
do # The quotes are necessary here
echo "=================================================="
echo "Downloading Dask of version '${dask_version}'"
pip uninstall -y dask
pip install -U "dask[complete]==${dask_version}"
printf "==================================================\n\n\n"
echo "=================================================="
echo "Running tests against dask version ${dask_version}"
python -m pytest -v test_dask_scheduler.py
python -m pytest -v test_dask_callback.py
python -m pytest -v test_dask_optimization.py
printf "==================================================\n\n\n"
done
Requirement already satisfied: pip in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (21.1.3)
Requirement already satisfied: pytest in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (6.2.4)
Requirement already satisfied: attrs>=19.2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (21.2.0)
Requirement already satisfied: toml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (0.10.2)
Requirement already satisfied: pluggy<1.0.0a1,>=0.12 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (0.13.1)
Requirement already satisfied: packaging in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (21.0)
Requirement already satisfied: py>=1.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (1.10.0)
Requirement already satisfied: importlib-metadata>=0.12 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (4.6.1)
Requirement already satisfied: iniconfig in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (1.1.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata>=0.12->pytest) (3.5.0)
Requirement already satisfied: typing-extensions>=3.6.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata>=0.12->pytest) (3.10.0.0)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging->pytest) (2.4.7)
Please run vi dask-on-ray-test.sh and modify the ray wheel properly.
Also make sure that you are in the right branch on your repo.
For example, if you are using releases/1.3.0 wheel, you should checkout to that repo.
Example: git checkout -b releases/1.3.0 upstream/releases/1.3.0
Found existing installation: ray 1.5.0
Uninstalling ray-1.5.0:
Successfully uninstalled ray-1.5.0
Collecting ray==1.5.0
Using cached https://s3-us-west-2.amazonaws.com/ray-wheels/releases/1.5.0/ddad6a2458bded21035797ec84ba67b8a8c15ca5/ray-1.5.0-cp37-cp37m-macosx_10_13_intel.whl (53.5 MB)
Requirement already satisfied: aioredis in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.3.1)
Requirement already satisfied: grpcio>=1.28.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.39.0)
Requirement already satisfied: protobuf>=3.15.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.17.3)
Requirement already satisfied: redis>=3.5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.5.3)
Requirement already satisfied: click>=7.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (8.0.1)
Requirement already satisfied: filelock in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.0.12)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.21.1)
Requirement already satisfied: pydantic>=1.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.8.2)
Requirement already satisfied: aiohttp-cors in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.7.0)
Requirement already satisfied: py-spy>=0.2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.3.7)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (5.4.1)
Requirement already satisfied: colorama in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.4.4)
Requirement already satisfied: aiohttp in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.7.4.post0)
Requirement already satisfied: gpustat in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.6.0)
Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.0.2)
Requirement already satisfied: opencensus in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.7.13)
Requirement already satisfied: jsonschema in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.2.0)
Requirement already satisfied: requests in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (2.26.0)
Requirement already satisfied: prometheus-client>=0.7.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.11.0)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=7.0->ray==1.5.0) (4.6.1)
Requirement already satisfied: six>=1.5.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from grpcio>=1.28.1->ray==1.5.0) (1.16.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pydantic>=1.8->ray==1.5.0) (3.10.0.0)
Requirement already satisfied: yarl<2.0,>=1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (1.6.3)
Requirement already satisfied: async-timeout<4.0,>=3.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (3.0.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (5.1.0)
Requirement already satisfied: attrs>=17.3.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (21.2.0)
Requirement already satisfied: chardet<5.0,>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (4.0.0)
Requirement already satisfied: idna>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from yarl<2.0,>=1.0->aiohttp->ray==1.5.0) (3.2)
Requirement already satisfied: hiredis in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aioredis->ray==1.5.0) (2.0.0)
Requirement already satisfied: blessings>=1.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from gpustat->ray==1.5.0) (1.7)
Requirement already satisfied: nvidia-ml-py3>=7.352.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from gpustat->ray==1.5.0) (7.352.0)
Requirement already satisfied: psutil in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from gpustat->ray==1.5.0) (5.8.0)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=7.0->ray==1.5.0) (3.5.0)
Requirement already satisfied: pyrsistent>=0.14.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from jsonschema->ray==1.5.0) (0.18.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from jsonschema->ray==1.5.0) (52.0.0.post20210125)
Requirement already satisfied: opencensus-context==0.1.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from opencensus->ray==1.5.0) (0.1.2)
Requirement already satisfied: google-api-core<2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from opencensus->ray==1.5.0) (1.31.0)
Requirement already satisfied: pytz in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (2021.1)
Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (1.53.0)
Requirement already satisfied: packaging>=14.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (21.0)
Requirement already satisfied: google-auth<2.0dev,>=1.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (1.33.1)
Requirement already satisfied: pyasn1-modules>=0.2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (4.7.2)
Requirement already satisfied: cachetools<5.0,>=2.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (4.2.2)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=14.3->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (2.4.7)
Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pyasn1-modules>=0.2.1->google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (0.4.8)
Requirement already satisfied: certifi>=2017.4.17 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from requests->ray==1.5.0) (2021.5.30)
Requirement already satisfied: charset-normalizer~=2.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from requests->ray==1.5.0) (2.0.3)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from requests->ray==1.5.0) (1.26.6)
Installing collected packages: ray
Successfully installed ray-1.5.0
==================================================
Downloading Dask of version '2021.7.0'
Found existing installation: dask 2021.2.0
Uninstalling dask-2021.2.0:
Successfully uninstalled dask-2021.2.0
Collecting dask[complete]==2021.7.0
Using cached dask-2021.7.0-py3-none-any.whl (977 kB)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (0.11.1)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (2021.7.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.6.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.2.0)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.21.1)
Collecting distributed==2021.07.0
Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.3.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (2.3.3)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (5.8.0)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (1.7.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (2.4.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (1.0.2)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (2.0.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (8.0.1)
Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (6.1)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (52.0.0.post20210125)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (8.3.1)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (3.0.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (21.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (2.8.2)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (3.10.0.0)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.07.0->dask[complete]==2021.7.0) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.7.0) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.7.0) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.07.0->dask[complete]==2021.7.0) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.07.0->dask[complete]==2021.7.0) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.2.0
Uninstalling distributed-2021.2.0:
Successfully uninstalled distributed-2021.2.0
Successfully installed dask-2021.7.0 distributed-2021.7.0
==================================================
==================================================
Running tests against dask version 2021.7.0
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 9.34s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.46s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.88s =========================
==================================================
==================================================
Downloading Dask of version '2021.6.2'
Found existing installation: dask 2021.7.0
Uninstalling dask-2021.7.0:
Successfully uninstalled dask-2021.7.0
Collecting dask[complete]==2021.6.2
Using cached dask-2021.6.2-py3-none-any.whl (973 kB)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (2021.7.0)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (0.11.1)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (5.4.1)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (2.3.3)
Collecting distributed==2021.06.2
Using cached distributed-2021.6.2-py3-none-any.whl (722 kB)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.21.1)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.3.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (52.0.0.post20210125)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (2.4.0)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (2.0.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (1.0.2)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (8.0.1)
Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (6.1)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (5.8.0)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (1.7.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (2.8.2)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (3.0.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (21.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (8.3.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (3.10.0.0)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.06.2->dask[complete]==2021.6.2) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.6.2) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.6.2) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.06.2->dask[complete]==2021.6.2) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.06.2->dask[complete]==2021.6.2) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.7.0
Uninstalling distributed-2021.7.0:
Successfully uninstalled distributed-2021.7.0
Successfully installed dask-2021.6.2 distributed-2021.6.2
==================================================
==================================================
Running tests against dask version 2021.6.2
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.56s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.35s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.75s =========================
==================================================
==================================================
Downloading Dask of version '2021.6.1'
Found existing installation: dask 2021.6.2
Uninstalling dask-2021.6.2:
Successfully uninstalled dask-2021.6.2
Collecting dask[complete]==2021.6.1
Using cached dask-2021.6.1-py3-none-any.whl (973 kB)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (2021.7.0)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.2.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (5.4.1)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (0.11.1)
Collecting distributed==2021.06.1
Using cached distributed-2021.6.1-py3-none-any.whl (722 kB)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.21.1)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.3.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (2.3.3)
Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (6.1)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (2.0.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (8.0.1)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (2.4.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (52.0.0.post20210125)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (5.8.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (1.0.2)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (1.7.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (2.8.2)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (3.10.0.0)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (21.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (8.3.1)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (3.0.1)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.06.1->dask[complete]==2021.6.1) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.6.1) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.6.1) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.06.1->dask[complete]==2021.6.1) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.06.1->dask[complete]==2021.6.1) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.6.2
Uninstalling distributed-2021.6.2:
Successfully uninstalled distributed-2021.6.2
Successfully installed dask-2021.6.1 distributed-2021.6.1
==================================================
==================================================
Running tests against dask version 2021.6.1
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 7.85s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.06s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.82s =========================
==================================================
==================================================
Downloading Dask of version '2021.6.0'
Found existing installation: dask 2021.6.1
Uninstalling dask-2021.6.1:
Successfully uninstalled dask-2021.6.1
Collecting dask[complete]==2021.6.0
Using cached dask-2021.6.0-py3-none-any.whl (965 kB)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.2.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (5.4.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.6.0)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (0.11.1)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (2021.7.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (2.3.3)
Collecting distributed==2021.06.0
Using cached distributed-2021.6.0-py3-none-any.whl (715 kB)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.3.0)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.21.1)
Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (6.1)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (2.0.0)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (5.8.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (52.0.0.post20210125)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (8.0.1)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (1.7.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (2.4.0)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (21.0)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (3.0.1)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (8.3.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (3.10.0.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (2.8.2)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.06.0->dask[complete]==2021.6.0) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.6.0) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.6.0) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.06.0->dask[complete]==2021.6.0) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.06.0->dask[complete]==2021.6.0) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.6.1
Uninstalling distributed-2021.6.1:
Successfully uninstalled distributed-2021.6.1
Successfully installed dask-2021.6.0 distributed-2021.6.0
==================================================
==================================================
Running tests against dask version 2021.6.0
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.24s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.38s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.75s =========================
==================================================
==================================================
Downloading Dask of version '2021.5.1'
Found existing installation: dask 2021.6.0
Uninstalling dask-2021.6.0:
Successfully uninstalled dask-2021.6.0
Collecting dask[complete]==2021.5.1
Using cached dask-2021.5.1-py3-none-any.whl (964 kB)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (2021.7.0)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (0.11.1)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.6.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.2.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (2.3.3)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.3.0)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.21.1)
Collecting distributed==2021.05.1
Using cached distributed-2021.5.1-py3-none-any.whl (705 kB)
Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (6.1)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (52.0.0.post20210125)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (5.8.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (2.4.0)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (1.7.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (8.0.1)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (2.0.0)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (3.10.0.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (8.3.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (21.0)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (3.0.1)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (2.8.2)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.05.1->dask[complete]==2021.5.1) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.5.1) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.5.1) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.05.1->dask[complete]==2021.5.1) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.05.1->dask[complete]==2021.5.1) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.6.0
Uninstalling distributed-2021.6.0:
Successfully uninstalled distributed-2021.6.0
Successfully installed dask-2021.5.1 distributed-2021.5.1
==================================================
==================================================
Running tests against dask version 2021.5.1
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.29s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.00s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.74s =========================
==================================================
==================================================
Downloading Dask of version '2021.5.0'
Found existing installation: dask 2021.5.1
Uninstalling dask-2021.5.1:
Successfully uninstalled dask-2021.5.1
Collecting dask[complete]==2021.5.0
Using cached dask-2021.5.0-py3-none-any.whl (960 kB)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.6.0)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.2.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (5.4.1)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (0.11.1)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (2021.7.0)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.21.1)
Collecting distributed==2021.05.0
Using cached distributed-2021.5.0-py3-none-any.whl (699 kB)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (2.3.3)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.3.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (52.0.0.post20210125)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (1.7.0)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (2.0.0)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (5.8.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (8.0.1)
Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (6.1)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (2.4.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (2.8.2)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (3.0.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (21.0)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (3.10.0.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (8.3.1)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.05.0->dask[complete]==2021.5.0) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.5.0) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.5.0) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.05.0->dask[complete]==2021.5.0) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.05.0->dask[complete]==2021.5.0) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.5.1
Uninstalling distributed-2021.5.1:
Successfully uninstalled distributed-2021.5.1
Successfully installed dask-2021.5.0 distributed-2021.5.0
==================================================
==================================================
Running tests against dask version 2021.5.0
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.13s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 22.86s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.72s =========================
==================================================
==================================================
Downloading Dask of version '2021.4.1'
Found existing installation: dask 2021.5.0
Uninstalling dask-2021.5.0:
Successfully uninstalled dask-2021.5.0
Collecting dask[complete]==2021.4.1
Using cached dask-2021.4.1-py3-none-any.whl (952 kB)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.6.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (5.4.1)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (2021.7.0)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (0.11.1)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.2.0)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.3.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (2.3.3)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.21.1)
Requirement already satisfied: distributed>=2021.04.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (2021.5.0)
Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (6.1)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (8.3.1)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (3.0.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (3.10.0.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (2.8.2)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (21.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (52.0.0.post20210125)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (5.8.0)
Collecting distributed>=2021.04.1
Using cached distributed-2021.7.1-py3-none-any.whl (766 kB)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (1.7.0)
Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB)
Using cached distributed-2021.6.2-py3-none-any.whl (722 kB)
Using cached distributed-2021.6.1-py3-none-any.whl (722 kB)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (1.0.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (2.4.0)
Using cached distributed-2021.6.0-py3-none-any.whl (715 kB)
Using cached distributed-2021.5.1-py3-none-any.whl (705 kB)
Using cached distributed-2021.4.1-py3-none-any.whl (696 kB)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (8.0.1)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (2.0.0)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2021.04.1->dask[complete]==2021.4.1) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.4.1) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.4.1) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2021.04.1->dask[complete]==2021.4.1) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2021.04.1->dask[complete]==2021.4.1) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.5.0
Uninstalling distributed-2021.5.0:
Successfully uninstalled distributed-2021.5.0
Successfully installed dask-2021.4.1 distributed-2021.4.1
==================================================
==================================================
Running tests against dask version 2021.4.1
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.04s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 22.92s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.76s =========================
==================================================
==================================================
Downloading Dask of version '2021.4.0'
Found existing installation: dask 2021.4.1
Uninstalling dask-2021.4.1:
Successfully uninstalled dask-2021.4.1
Collecting dask[complete]==2021.4.0
Using cached dask-2021.4.0-py3-none-any.whl (941 kB)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (0.11.1)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (2021.7.0)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.6.0)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (5.4.1)
Requirement already satisfied: distributed>=2021.03.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (2021.4.1)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.3.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (2.3.3)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.21.1)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (8.3.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (21.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (2.8.2)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (3.10.0.0)
Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (6.1)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (3.0.1)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (2.0.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (2.4.0)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (5.8.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (8.0.1)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (1.7.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (52.0.0.post20210125)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (1.0.2)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2021.03.0->dask[complete]==2021.4.0) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.4.0) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.4.0) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2021.03.0->dask[complete]==2021.4.0) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2021.03.0->dask[complete]==2021.4.0) (3.5.0)
Installing collected packages: dask
Successfully installed dask-2021.4.0
==================================================
==================================================
Running tests against dask version 2021.4.0
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 7.66s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 22.56s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.72s =========================
==================================================
==================================================
Downloading Dask of version '2021.3.1'
Found existing installation: dask 2021.4.0
Uninstalling dask-2021.4.0:
Successfully uninstalled dask-2021.4.0
Collecting dask[complete]==2021.3.1
Using cached dask-2021.3.1-py3-none-any.whl (935 kB)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (0.11.1)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.2.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (2021.7.0)
Requirement already satisfied: distributed>=2021.03.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (2021.4.1)
Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.21.1)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.3.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (2.3.3)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (2.8.2)
Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (6.1)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (3.0.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (3.10.0.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (8.3.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (21.0)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (5.8.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (8.0.1)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (1.7.0)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (2.4.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (1.0.2)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (2.0.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (52.0.0.post20210125)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2021.03.0->dask[complete]==2021.3.1) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.3.1) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.3.1) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2021.03.0->dask[complete]==2021.3.1) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2021.03.0->dask[complete]==2021.3.1) (3.5.0)
Installing collected packages: dask
Successfully installed dask-2021.3.1
==================================================
==================================================
Running tests against dask version 2021.3.1
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.08s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.37s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.69s =========================
==================================================
==================================================
Downloading Dask of version '2021.2.0'
Found existing installation: dask 2021.3.1
Uninstalling dask-2021.3.1:
Successfully uninstalled dask-2021.3.1
Collecting dask[complete]==2021.2.0
Using cached dask-2021.2.0-py3-none-any.whl (900 kB)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (5.4.1)
Requirement already satisfied: cloudpickle>=0.2.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (2021.7.0)
Requirement already satisfied: numpy>=1.15.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.21.1)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (2.3.3)
Requirement already satisfied: distributed>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (2021.4.1)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.3.0)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (0.11.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (3.10.0.0)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (3.0.1)
Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (6.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (21.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (2.8.2)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (8.3.1)
Collecting distributed>=2.0
Using cached distributed-2021.7.1-py3-none-any.whl (766 kB)
Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (8.0.1)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (52.0.0.post20210125)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (2.4.0)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (2.0.0)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (1.7.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (1.0.2)
Using cached distributed-2021.6.2-py3-none-any.whl (722 kB)
Using cached distributed-2021.6.1-py3-none-any.whl (722 kB)
Using cached distributed-2021.6.0-py3-none-any.whl (715 kB)
Using cached distributed-2021.5.1-py3-none-any.whl (705 kB)
Using cached distributed-2021.5.0-py3-none-any.whl (699 kB)
Using cached distributed-2021.4.0-py3-none-any.whl (684 kB)
Using cached distributed-2021.3.1-py3-none-any.whl (679 kB)
Using cached distributed-2021.3.0-py3-none-any.whl (675 kB)
Using cached distributed-2021.2.0-py3-none-any.whl (675 kB)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (5.8.0)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2.0->dask[complete]==2021.2.0) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.2.0) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.2.0) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0->dask[complete]==2021.2.0) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2.0->dask[complete]==2021.2.0) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.4.1
Uninstalling distributed-2021.4.1:
Successfully uninstalled distributed-2021.4.1
Successfully installed dask-2021.2.0 distributed-2021.2.0
==================================================
==================================================
Running tests against dask version 2021.2.0
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.02s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 22.60s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.68s =========================
==================================================
==================================================
Downloading Dask of version '2021.1.1'
Found existing installation: dask 2021.2.0
Uninstalling dask-2021.2.0:
Successfully uninstalled dask-2021.2.0
Collecting dask[complete]==2021.1.1
Downloading dask-2021.1.1-py3-none-any.whl (891 kB)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (5.4.1)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (2021.7.0)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (2.3.3)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (0.11.1)
Requirement already satisfied: numpy>=1.15.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.21.1)
Requirement already satisfied: distributed>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (2021.2.0)
Requirement already satisfied: cloudpickle>=0.2.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.6.0)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.3.0)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.2.0)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (3.0.1)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (21.0)
Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (6.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (3.10.0.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (8.3.1)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (2.8.2)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (2.4.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (52.0.0.post20210125)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (5.8.0)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (2.0.0)
Collecting distributed>=2.0
Using cached distributed-2021.7.1-py3-none-any.whl (766 kB)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (1.7.0)
Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB)
Using cached distributed-2021.6.2-py3-none-any.whl (722 kB)
Using cached distributed-2021.6.1-py3-none-any.whl (722 kB)
Using cached distributed-2021.6.0-py3-none-any.whl (715 kB)
Using cached distributed-2021.5.1-py3-none-any.whl (705 kB)
Using cached distributed-2021.5.0-py3-none-any.whl (699 kB)
Using cached distributed-2021.4.1-py3-none-any.whl (696 kB)
Using cached distributed-2021.4.0-py3-none-any.whl (684 kB)
Using cached distributed-2021.3.1-py3-none-any.whl (679 kB)
Using cached distributed-2021.3.0-py3-none-any.whl (675 kB)
Downloading distributed-2021.1.1-py3-none-any.whl (672 kB)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (8.0.1)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (1.0.2)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2.0->dask[complete]==2021.1.1) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.1.1) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.1.1) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0->dask[complete]==2021.1.1) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2.0->dask[complete]==2021.1.1) (3.5.0)
Installing collected packages: dask, distributed
Attempting uninstall: distributed
Found existing installation: distributed 2021.2.0
Uninstalling distributed-2021.2.0:
Successfully uninstalled distributed-2021.2.0
Successfully installed dask-2021.1.1 distributed-2021.1.1
==================================================
==================================================
Running tests against dask version 2021.1.1
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 7.61s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 22.75s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.72s =========================
==================================================
==================================================
Downloading Dask of version '2020.12.0'
Found existing installation: dask 2021.1.1
Uninstalling dask-2021.1.1:
Successfully uninstalled dask-2021.1.1
Collecting dask[complete]==2020.12.0
Downloading dask-2020.12.0-py3-none-any.whl (884 kB)
Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (5.4.1)
Requirement already satisfied: numpy>=1.15.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.21.1)
Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (0.11.1)
Requirement already satisfied: cloudpickle>=0.2.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.6.0)
Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (2021.7.0)
Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.2.0)
Requirement already satisfied: distributed>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (2021.1.1)
Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (2.3.3)
Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.3.0)
Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (3.0.1)
Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (6.1)
Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (3.10.0.0)
Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (2.8.2)
Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (21.0)
Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (8.3.1)
Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (1.7.0)
Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (1.0.2)
Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (2.0.0)
Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (5.8.0)
Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (8.0.1)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (2.4.0)
Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (52.0.0.post20210125)
Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2.0->dask[complete]==2020.12.0) (4.6.1)
Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (2.0.1)
Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (2.4.7)
Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2020.12.0) (2021.1)
Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2020.12.0) (0.2.1)
Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (1.16.0)
Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0->dask[complete]==2020.12.0) (1.0.1)
Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2.0->dask[complete]==2020.12.0) (3.5.0)
Installing collected packages: dask
Successfully installed dask-2020.12.0
==================================================
==================================================
Running tests against dask version 2020.12.0
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%]
test_dask_scheduler.py::test_ray_dask_persist PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 8.73s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 8 items
test_dask_callback.py::test_callback_active PASSED [ 12%]
test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%]
test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%]
test_dask_callback.py::test_postsubmit PASSED [ 50%]
test_dask_callback.py::test_postsubmit_all PASSED [ 62%]
test_dask_callback.py::test_finish PASSED [ 75%]
test_dask_callback.py::test_multiple_callbacks PASSED [ 87%]
test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
======================== 8 passed, 1 warning in 23.72s =========================
============================= test session starts ==============================
platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python
cachedir: .pytest_cache
rootdir: /private/tmp/dask-test
collecting ... collected 2 items
test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%]
test_dask_optimization.py::test_dataframe_optimize PASSED [100%]
=============================== warnings summary ===============================
../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61
/Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command.
"update your install command.", FutureWarning)
-- Docs: https://docs.pytest.org/en/stable/warnings.html
========================= 2 passed, 1 warning in 0.77s =========================
==================================================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment