Created
July 23, 2021 20:10
-
-
Save simon-mo/6396c0e604d3d61a142b5632fecbb103 to your computer and use it in GitHub Desktop.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| #!/bin/bash | |
| # NOTE: Only working for Python 3.7 on MacOS. | |
| # NOTE: Please modify the wheel URL. | |
| # DASK_VERSION=("2021.5.0" "2021.4.1" "2021.4.0" "2021.3.1" "2021.2.0" "2021.1.1" "2020.12.0") | |
| DASK_VERSION=( | |
| "2021.7.0" "2021.6.2" "2021.6.1" "2021.6.0" | |
| "2021.5.1" "2021.5.0" "2021.4.1" "2021.4.0" | |
| "2021.3.1" "2021.2.0" "2021.1.1" "2020.12.0" | |
| ) | |
| unset RAY_ADDRESS | |
| pip install --upgrade pip pytest | |
| # Comment out the below block for testing. | |
| echo "Please run vi dask-on-ray-test.sh and modify the ray wheel properly." | |
| echo "Also make sure that you are in the right branch on your repo." | |
| echo "For example, if you are using releases/1.3.0 wheel, you should checkout to that repo." | |
| echo "Example: git checkout -b releases/1.3.0 upstream/releases/1.3.0" | |
| #exit 1 | |
| pip uninstall -y ray | |
| pip install -U https://s3-us-west-2.amazonaws.com/ray-wheels/releases/1.5.0/ddad6a2458bded21035797ec84ba67b8a8c15ca5/ray-1.5.0-cp37-cp37m-macosx_10_13_intel.whl | |
| for dask_version in "${DASK_VERSION[@]}" | |
| do # The quotes are necessary here | |
| echo "==================================================" | |
| echo "Downloading Dask of version '${dask_version}'" | |
| pip uninstall -y dask | |
| pip install -U "dask[complete]==${dask_version}" | |
| printf "==================================================\n\n\n" | |
| echo "==================================================" | |
| echo "Running tests against dask version ${dask_version}" | |
| python -m pytest -v test_dask_scheduler.py | |
| python -m pytest -v test_dask_callback.py | |
| python -m pytest -v test_dask_optimization.py | |
| printf "==================================================\n\n\n" | |
| done |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Requirement already satisfied: pip in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (21.1.3) | |
| Requirement already satisfied: pytest in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (6.2.4) | |
| Requirement already satisfied: attrs>=19.2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (21.2.0) | |
| Requirement already satisfied: toml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (0.10.2) | |
| Requirement already satisfied: pluggy<1.0.0a1,>=0.12 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (0.13.1) | |
| Requirement already satisfied: packaging in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (21.0) | |
| Requirement already satisfied: py>=1.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (1.10.0) | |
| Requirement already satisfied: importlib-metadata>=0.12 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (4.6.1) | |
| Requirement already satisfied: iniconfig in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pytest) (1.1.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata>=0.12->pytest) (3.5.0) | |
| Requirement already satisfied: typing-extensions>=3.6.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata>=0.12->pytest) (3.10.0.0) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging->pytest) (2.4.7) | |
| Please run vi dask-on-ray-test.sh and modify the ray wheel properly. | |
| Also make sure that you are in the right branch on your repo. | |
| For example, if you are using releases/1.3.0 wheel, you should checkout to that repo. | |
| Example: git checkout -b releases/1.3.0 upstream/releases/1.3.0 | |
| Found existing installation: ray 1.5.0 | |
| Uninstalling ray-1.5.0: | |
| Successfully uninstalled ray-1.5.0 | |
| Collecting ray==1.5.0 | |
| Using cached https://s3-us-west-2.amazonaws.com/ray-wheels/releases/1.5.0/ddad6a2458bded21035797ec84ba67b8a8c15ca5/ray-1.5.0-cp37-cp37m-macosx_10_13_intel.whl (53.5 MB) | |
| Requirement already satisfied: aioredis in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.3.1) | |
| Requirement already satisfied: grpcio>=1.28.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.39.0) | |
| Requirement already satisfied: protobuf>=3.15.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.17.3) | |
| Requirement already satisfied: redis>=3.5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.5.3) | |
| Requirement already satisfied: click>=7.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (8.0.1) | |
| Requirement already satisfied: filelock in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.0.12) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.21.1) | |
| Requirement already satisfied: pydantic>=1.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.8.2) | |
| Requirement already satisfied: aiohttp-cors in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.7.0) | |
| Requirement already satisfied: py-spy>=0.2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.3.7) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (5.4.1) | |
| Requirement already satisfied: colorama in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.4.4) | |
| Requirement already satisfied: aiohttp in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.7.4.post0) | |
| Requirement already satisfied: gpustat in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.6.0) | |
| Requirement already satisfied: msgpack<2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (1.0.2) | |
| Requirement already satisfied: opencensus in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.7.13) | |
| Requirement already satisfied: jsonschema in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (3.2.0) | |
| Requirement already satisfied: requests in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (2.26.0) | |
| Requirement already satisfied: prometheus-client>=0.7.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from ray==1.5.0) (0.11.0) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=7.0->ray==1.5.0) (4.6.1) | |
| Requirement already satisfied: six>=1.5.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from grpcio>=1.28.1->ray==1.5.0) (1.16.0) | |
| Requirement already satisfied: typing-extensions>=3.7.4.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pydantic>=1.8->ray==1.5.0) (3.10.0.0) | |
| Requirement already satisfied: yarl<2.0,>=1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (1.6.3) | |
| Requirement already satisfied: async-timeout<4.0,>=3.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (3.0.1) | |
| Requirement already satisfied: multidict<7.0,>=4.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (5.1.0) | |
| Requirement already satisfied: attrs>=17.3.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (21.2.0) | |
| Requirement already satisfied: chardet<5.0,>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aiohttp->ray==1.5.0) (4.0.0) | |
| Requirement already satisfied: idna>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from yarl<2.0,>=1.0->aiohttp->ray==1.5.0) (3.2) | |
| Requirement already satisfied: hiredis in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from aioredis->ray==1.5.0) (2.0.0) | |
| Requirement already satisfied: blessings>=1.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from gpustat->ray==1.5.0) (1.7) | |
| Requirement already satisfied: nvidia-ml-py3>=7.352.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from gpustat->ray==1.5.0) (7.352.0) | |
| Requirement already satisfied: psutil in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from gpustat->ray==1.5.0) (5.8.0) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=7.0->ray==1.5.0) (3.5.0) | |
| Requirement already satisfied: pyrsistent>=0.14.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from jsonschema->ray==1.5.0) (0.18.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from jsonschema->ray==1.5.0) (52.0.0.post20210125) | |
| Requirement already satisfied: opencensus-context==0.1.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from opencensus->ray==1.5.0) (0.1.2) | |
| Requirement already satisfied: google-api-core<2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from opencensus->ray==1.5.0) (1.31.0) | |
| Requirement already satisfied: pytz in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (2021.1) | |
| Requirement already satisfied: googleapis-common-protos<2.0dev,>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (1.53.0) | |
| Requirement already satisfied: packaging>=14.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (21.0) | |
| Requirement already satisfied: google-auth<2.0dev,>=1.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (1.33.1) | |
| Requirement already satisfied: pyasn1-modules>=0.2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (0.2.8) | |
| Requirement already satisfied: rsa<5,>=3.1.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (4.7.2) | |
| Requirement already satisfied: cachetools<5.0,>=2.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (4.2.2) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=14.3->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (2.4.7) | |
| Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pyasn1-modules>=0.2.1->google-auth<2.0dev,>=1.25.0->google-api-core<2.0.0,>=1.0.0->opencensus->ray==1.5.0) (0.4.8) | |
| Requirement already satisfied: certifi>=2017.4.17 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from requests->ray==1.5.0) (2021.5.30) | |
| Requirement already satisfied: charset-normalizer~=2.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from requests->ray==1.5.0) (2.0.3) | |
| Requirement already satisfied: urllib3<1.27,>=1.21.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from requests->ray==1.5.0) (1.26.6) | |
| Installing collected packages: ray | |
| Successfully installed ray-1.5.0 | |
| ================================================== | |
| Downloading Dask of version '2021.7.0' | |
| Found existing installation: dask 2021.2.0 | |
| Uninstalling dask-2021.2.0: | |
| Successfully uninstalled dask-2021.2.0 | |
| Collecting dask[complete]==2021.7.0 | |
| Using cached dask-2021.7.0-py3-none-any.whl (977 kB) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (0.11.1) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (2021.7.0) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.6.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (5.4.1) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.2.0) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.21.1) | |
| Collecting distributed==2021.07.0 | |
| Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (1.3.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.7.0) (2.3.3) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (5.8.0) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (1.7.0) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (2.4.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (1.0.2) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (2.0.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (8.0.1) | |
| Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (6.1) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.07.0->dask[complete]==2021.7.0) (52.0.0.post20210125) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (8.3.1) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (3.0.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (21.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (2.8.2) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (3.10.0.0) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.07.0->dask[complete]==2021.7.0) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.7.0) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.7.0) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.7.0) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.07.0->dask[complete]==2021.7.0) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.07.0->dask[complete]==2021.7.0) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.2.0 | |
| Uninstalling distributed-2021.2.0: | |
| Successfully uninstalled distributed-2021.2.0 | |
| Successfully installed dask-2021.7.0 distributed-2021.7.0 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.7.0 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 9.34s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.46s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.88s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.6.2' | |
| Found existing installation: dask 2021.7.0 | |
| Uninstalling dask-2021.7.0: | |
| Successfully uninstalled dask-2021.7.0 | |
| Collecting dask[complete]==2021.6.2 | |
| Using cached dask-2021.6.2-py3-none-any.whl (973 kB) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.2.0) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.6.0) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (2021.7.0) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (0.11.1) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (5.4.1) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (2.3.3) | |
| Collecting distributed==2021.06.2 | |
| Using cached distributed-2021.6.2-py3-none-any.whl (722 kB) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.21.1) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.2) (1.3.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (52.0.0.post20210125) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (2.4.0) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (2.0.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (1.0.2) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (8.0.1) | |
| Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (6.1) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (5.8.0) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.2->dask[complete]==2021.6.2) (1.7.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (2.8.2) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (3.0.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (21.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (8.3.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (3.10.0.0) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.06.2->dask[complete]==2021.6.2) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.6.2) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.6.2) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.2) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.06.2->dask[complete]==2021.6.2) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.06.2->dask[complete]==2021.6.2) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.7.0 | |
| Uninstalling distributed-2021.7.0: | |
| Successfully uninstalled distributed-2021.7.0 | |
| Successfully installed dask-2021.6.2 distributed-2021.6.2 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.6.2 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.56s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.35s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.75s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.6.1' | |
| Found existing installation: dask 2021.6.2 | |
| Uninstalling dask-2021.6.2: | |
| Successfully uninstalled dask-2021.6.2 | |
| Collecting dask[complete]==2021.6.1 | |
| Using cached dask-2021.6.1-py3-none-any.whl (973 kB) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.6.0) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (2021.7.0) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.2.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (5.4.1) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (0.11.1) | |
| Collecting distributed==2021.06.1 | |
| Using cached distributed-2021.6.1-py3-none-any.whl (722 kB) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.21.1) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (1.3.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.1) (2.3.3) | |
| Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (6.1) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (2.0.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (8.0.1) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (2.4.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (52.0.0.post20210125) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (5.8.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (1.0.2) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.1->dask[complete]==2021.6.1) (1.7.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (2.8.2) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (3.10.0.0) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (21.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (8.3.1) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (3.0.1) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.06.1->dask[complete]==2021.6.1) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.6.1) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.6.1) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.1) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.06.1->dask[complete]==2021.6.1) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.06.1->dask[complete]==2021.6.1) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.6.2 | |
| Uninstalling distributed-2021.6.2: | |
| Successfully uninstalled distributed-2021.6.2 | |
| Successfully installed dask-2021.6.1 distributed-2021.6.1 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.6.1 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 7.85s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.06s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.82s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.6.0' | |
| Found existing installation: dask 2021.6.1 | |
| Uninstalling dask-2021.6.1: | |
| Successfully uninstalled dask-2021.6.1 | |
| Collecting dask[complete]==2021.6.0 | |
| Using cached dask-2021.6.0-py3-none-any.whl (965 kB) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.2.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (5.4.1) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.6.0) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (0.11.1) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (2021.7.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (2.3.3) | |
| Collecting distributed==2021.06.0 | |
| Using cached distributed-2021.6.0-py3-none-any.whl (715 kB) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.3.0) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.6.0) (1.21.1) | |
| Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (6.1) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (2.0.0) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (5.8.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (52.0.0.post20210125) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (8.0.1) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (1.7.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (1.0.2) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.06.0->dask[complete]==2021.6.0) (2.4.0) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (21.0) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (3.0.1) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (8.3.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (3.10.0.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (2.8.2) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.06.0->dask[complete]==2021.6.0) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.6.0) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.6.0) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.6.0) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.06.0->dask[complete]==2021.6.0) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.06.0->dask[complete]==2021.6.0) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.6.1 | |
| Uninstalling distributed-2021.6.1: | |
| Successfully uninstalled distributed-2021.6.1 | |
| Successfully installed dask-2021.6.0 distributed-2021.6.0 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.6.0 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.24s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.38s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.75s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.5.1' | |
| Found existing installation: dask 2021.6.0 | |
| Uninstalling dask-2021.6.0: | |
| Successfully uninstalled dask-2021.6.0 | |
| Collecting dask[complete]==2021.5.1 | |
| Using cached dask-2021.5.1-py3-none-any.whl (964 kB) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (2021.7.0) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (0.11.1) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.6.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (5.4.1) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.2.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (2.3.3) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.3.0) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.1) (1.21.1) | |
| Collecting distributed==2021.05.1 | |
| Using cached distributed-2021.5.1-py3-none-any.whl (705 kB) | |
| Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (6.1) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (52.0.0.post20210125) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (5.8.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (1.0.2) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (2.4.0) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (1.7.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (8.0.1) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.1->dask[complete]==2021.5.1) (2.0.0) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (3.10.0.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (8.3.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (21.0) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (3.0.1) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (2.8.2) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.05.1->dask[complete]==2021.5.1) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.5.1) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.5.1) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.1) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.05.1->dask[complete]==2021.5.1) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.05.1->dask[complete]==2021.5.1) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.6.0 | |
| Uninstalling distributed-2021.6.0: | |
| Successfully uninstalled distributed-2021.6.0 | |
| Successfully installed dask-2021.5.1 distributed-2021.5.1 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.5.1 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.29s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.00s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.74s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.5.0' | |
| Found existing installation: dask 2021.5.1 | |
| Uninstalling dask-2021.5.1: | |
| Successfully uninstalled dask-2021.5.1 | |
| Collecting dask[complete]==2021.5.0 | |
| Using cached dask-2021.5.0-py3-none-any.whl (960 kB) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.6.0) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.2.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (5.4.1) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (0.11.1) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (2021.7.0) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.21.1) | |
| Collecting distributed==2021.05.0 | |
| Using cached distributed-2021.5.0-py3-none-any.whl (699 kB) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (2.3.3) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.5.0) (1.3.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (52.0.0.post20210125) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (1.7.0) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (2.0.0) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (5.8.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (8.0.1) | |
| Requirement already satisfied: tornado>=5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (6.1) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (1.0.2) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed==2021.05.0->dask[complete]==2021.5.0) (2.4.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (2.8.2) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (3.0.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (21.0) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (3.10.0.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (8.3.1) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed==2021.05.0->dask[complete]==2021.5.0) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.5.0) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.5.0) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.5.0) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed==2021.05.0->dask[complete]==2021.5.0) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed==2021.05.0->dask[complete]==2021.5.0) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.5.1 | |
| Uninstalling distributed-2021.5.1: | |
| Successfully uninstalled distributed-2021.5.1 | |
| Successfully installed dask-2021.5.0 distributed-2021.5.0 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.5.0 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.13s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 22.86s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.72s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.4.1' | |
| Found existing installation: dask 2021.5.0 | |
| Uninstalling dask-2021.5.0: | |
| Successfully uninstalled dask-2021.5.0 | |
| Collecting dask[complete]==2021.4.1 | |
| Using cached dask-2021.4.1-py3-none-any.whl (952 kB) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.6.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (5.4.1) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (2021.7.0) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (0.11.1) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.2.0) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.3.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (2.3.3) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (1.21.1) | |
| Requirement already satisfied: distributed>=2021.04.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.1) (2021.5.0) | |
| Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (6.1) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (8.3.1) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (3.0.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (3.10.0.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (2.8.2) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (21.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (52.0.0.post20210125) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (5.8.0) | |
| Collecting distributed>=2021.04.1 | |
| Using cached distributed-2021.7.1-py3-none-any.whl (766 kB) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (1.7.0) | |
| Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB) | |
| Using cached distributed-2021.6.2-py3-none-any.whl (722 kB) | |
| Using cached distributed-2021.6.1-py3-none-any.whl (722 kB) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (1.0.2) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (2.4.0) | |
| Using cached distributed-2021.6.0-py3-none-any.whl (715 kB) | |
| Using cached distributed-2021.5.1-py3-none-any.whl (705 kB) | |
| Using cached distributed-2021.4.1-py3-none-any.whl (696 kB) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (8.0.1) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.04.1->dask[complete]==2021.4.1) (2.0.0) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2021.04.1->dask[complete]==2021.4.1) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.4.1) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.4.1) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.1) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2021.04.1->dask[complete]==2021.4.1) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2021.04.1->dask[complete]==2021.4.1) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.5.0 | |
| Uninstalling distributed-2021.5.0: | |
| Successfully uninstalled distributed-2021.5.0 | |
| Successfully installed dask-2021.4.1 distributed-2021.4.1 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.4.1 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.04s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 22.92s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.76s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.4.0' | |
| Found existing installation: dask 2021.4.1 | |
| Uninstalling dask-2021.4.1: | |
| Successfully uninstalled dask-2021.4.1 | |
| Collecting dask[complete]==2021.4.0 | |
| Using cached dask-2021.4.0-py3-none-any.whl (941 kB) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (0.11.1) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (2021.7.0) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.2.0) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.6.0) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (5.4.1) | |
| Requirement already satisfied: distributed>=2021.03.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (2021.4.1) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.3.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (2.3.3) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.4.0) (1.21.1) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (8.3.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (21.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (2.8.2) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (3.10.0.0) | |
| Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (6.1) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (3.0.1) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (2.0.0) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (2.4.0) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (5.8.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (8.0.1) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (1.7.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (52.0.0.post20210125) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.4.0) (1.0.2) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2021.03.0->dask[complete]==2021.4.0) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.4.0) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.4.0) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.4.0) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2021.03.0->dask[complete]==2021.4.0) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2021.03.0->dask[complete]==2021.4.0) (3.5.0) | |
| Installing collected packages: dask | |
| Successfully installed dask-2021.4.0 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.4.0 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 7.66s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 22.56s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.72s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.3.1' | |
| Found existing installation: dask 2021.4.0 | |
| Uninstalling dask-2021.4.0: | |
| Successfully uninstalled dask-2021.4.0 | |
| Collecting dask[complete]==2021.3.1 | |
| Using cached dask-2021.3.1-py3-none-any.whl (935 kB) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (0.11.1) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (5.4.1) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.2.0) | |
| Requirement already satisfied: cloudpickle>=1.1.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.6.0) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (2021.7.0) | |
| Requirement already satisfied: distributed>=2021.03.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (2021.4.1) | |
| Requirement already satisfied: numpy>=1.16 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.21.1) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (1.3.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.3.1) (2.3.3) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (2.8.2) | |
| Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (6.1) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (3.0.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (3.10.0.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (8.3.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (21.0) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (5.8.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (8.0.1) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (1.7.0) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (2.4.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (1.0.2) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (2.0.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2021.03.0->dask[complete]==2021.3.1) (52.0.0.post20210125) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2021.03.0->dask[complete]==2021.3.1) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.3.1) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.3.1) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.3.1) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2021.03.0->dask[complete]==2021.3.1) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2021.03.0->dask[complete]==2021.3.1) (3.5.0) | |
| Installing collected packages: dask | |
| Successfully installed dask-2021.3.1 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.3.1 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.08s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.37s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.69s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.2.0' | |
| Found existing installation: dask 2021.3.1 | |
| Uninstalling dask-2021.3.1: | |
| Successfully uninstalled dask-2021.3.1 | |
| Collecting dask[complete]==2021.2.0 | |
| Using cached dask-2021.2.0-py3-none-any.whl (900 kB) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (5.4.1) | |
| Requirement already satisfied: cloudpickle>=0.2.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.6.0) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (2021.7.0) | |
| Requirement already satisfied: numpy>=1.15.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.21.1) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (2.3.3) | |
| Requirement already satisfied: distributed>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (2021.4.1) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.3.0) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (1.2.0) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.2.0) (0.11.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (3.10.0.0) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (3.0.1) | |
| Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (6.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (21.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (2.8.2) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (8.3.1) | |
| Collecting distributed>=2.0 | |
| Using cached distributed-2021.7.1-py3-none-any.whl (766 kB) | |
| Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (8.0.1) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (52.0.0.post20210125) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (2.4.0) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (2.0.0) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (1.7.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (1.0.2) | |
| Using cached distributed-2021.6.2-py3-none-any.whl (722 kB) | |
| Using cached distributed-2021.6.1-py3-none-any.whl (722 kB) | |
| Using cached distributed-2021.6.0-py3-none-any.whl (715 kB) | |
| Using cached distributed-2021.5.1-py3-none-any.whl (705 kB) | |
| Using cached distributed-2021.5.0-py3-none-any.whl (699 kB) | |
| Using cached distributed-2021.4.0-py3-none-any.whl (684 kB) | |
| Using cached distributed-2021.3.1-py3-none-any.whl (679 kB) | |
| Using cached distributed-2021.3.0-py3-none-any.whl (675 kB) | |
| Using cached distributed-2021.2.0-py3-none-any.whl (675 kB) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.2.0) (5.8.0) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2.0->dask[complete]==2021.2.0) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.2.0) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.2.0) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.2.0) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0->dask[complete]==2021.2.0) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2.0->dask[complete]==2021.2.0) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.4.1 | |
| Uninstalling distributed-2021.4.1: | |
| Successfully uninstalled distributed-2021.4.1 | |
| Successfully installed dask-2021.2.0 distributed-2021.2.0 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.2.0 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.02s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 22.60s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.68s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2021.1.1' | |
| Found existing installation: dask 2021.2.0 | |
| Uninstalling dask-2021.2.0: | |
| Successfully uninstalled dask-2021.2.0 | |
| Collecting dask[complete]==2021.1.1 | |
| Downloading dask-2021.1.1-py3-none-any.whl (891 kB) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (5.4.1) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (2021.7.0) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (2.3.3) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (0.11.1) | |
| Requirement already satisfied: numpy>=1.15.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.21.1) | |
| Requirement already satisfied: distributed>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (2021.2.0) | |
| Requirement already satisfied: cloudpickle>=0.2.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.6.0) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.3.0) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2021.1.1) (1.2.0) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (3.0.1) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (21.0) | |
| Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (6.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (3.10.0.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (8.3.1) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (2.8.2) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (2.4.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (52.0.0.post20210125) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (5.8.0) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (2.0.0) | |
| Collecting distributed>=2.0 | |
| Using cached distributed-2021.7.1-py3-none-any.whl (766 kB) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (1.7.0) | |
| Using cached distributed-2021.7.0-py3-none-any.whl (1.0 MB) | |
| Using cached distributed-2021.6.2-py3-none-any.whl (722 kB) | |
| Using cached distributed-2021.6.1-py3-none-any.whl (722 kB) | |
| Using cached distributed-2021.6.0-py3-none-any.whl (715 kB) | |
| Using cached distributed-2021.5.1-py3-none-any.whl (705 kB) | |
| Using cached distributed-2021.5.0-py3-none-any.whl (699 kB) | |
| Using cached distributed-2021.4.1-py3-none-any.whl (696 kB) | |
| Using cached distributed-2021.4.0-py3-none-any.whl (684 kB) | |
| Using cached distributed-2021.3.1-py3-none-any.whl (679 kB) | |
| Using cached distributed-2021.3.0-py3-none-any.whl (675 kB) | |
| Downloading distributed-2021.1.1-py3-none-any.whl (672 kB) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (8.0.1) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2021.1.1) (1.0.2) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2.0->dask[complete]==2021.1.1) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2021.1.1) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2021.1.1) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2021.1.1) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0->dask[complete]==2021.1.1) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2.0->dask[complete]==2021.1.1) (3.5.0) | |
| Installing collected packages: dask, distributed | |
| Attempting uninstall: distributed | |
| Found existing installation: distributed 2021.2.0 | |
| Uninstalling distributed-2021.2.0: | |
| Successfully uninstalled distributed-2021.2.0 | |
| Successfully installed dask-2021.1.1 distributed-2021.1.1 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2021.1.1 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 7.61s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 22.75s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.72s ========================= | |
| ================================================== | |
| ================================================== | |
| Downloading Dask of version '2020.12.0' | |
| Found existing installation: dask 2021.1.1 | |
| Uninstalling dask-2021.1.1: | |
| Successfully uninstalled dask-2021.1.1 | |
| Collecting dask[complete]==2020.12.0 | |
| Downloading dask-2020.12.0-py3-none-any.whl (884 kB) | |
| Requirement already satisfied: pyyaml in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (5.4.1) | |
| Requirement already satisfied: numpy>=1.15.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.21.1) | |
| Requirement already satisfied: toolz>=0.8.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (0.11.1) | |
| Requirement already satisfied: cloudpickle>=0.2.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.6.0) | |
| Requirement already satisfied: fsspec>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (2021.7.0) | |
| Requirement already satisfied: partd>=0.3.10 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.2.0) | |
| Requirement already satisfied: distributed>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (2021.1.1) | |
| Requirement already satisfied: bokeh!=2.0.0,>=1.0.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (2.3.3) | |
| Requirement already satisfied: pandas>=0.25.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from dask[complete]==2020.12.0) (1.3.0) | |
| Requirement already satisfied: Jinja2>=2.9 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (3.0.1) | |
| Requirement already satisfied: tornado>=5.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (6.1) | |
| Requirement already satisfied: typing-extensions>=3.7.4 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (3.10.0.0) | |
| Requirement already satisfied: python-dateutil>=2.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (2.8.2) | |
| Requirement already satisfied: packaging>=16.8 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (21.0) | |
| Requirement already satisfied: pillow>=7.1.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (8.3.1) | |
| Requirement already satisfied: tblib>=1.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (1.7.0) | |
| Requirement already satisfied: msgpack>=0.6.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (1.0.2) | |
| Requirement already satisfied: zict>=0.1.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (2.0.0) | |
| Requirement already satisfied: psutil>=5.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (5.8.0) | |
| Requirement already satisfied: click>=6.6 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (8.0.1) | |
| Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (2.4.0) | |
| Requirement already satisfied: setuptools in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from distributed>=2.0->dask[complete]==2020.12.0) (52.0.0.post20210125) | |
| Requirement already satisfied: importlib-metadata in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from click>=6.6->distributed>=2.0->dask[complete]==2020.12.0) (4.6.1) | |
| Requirement already satisfied: MarkupSafe>=2.0 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from Jinja2>=2.9->bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (2.0.1) | |
| Requirement already satisfied: pyparsing>=2.0.2 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from packaging>=16.8->bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (2.4.7) | |
| Requirement already satisfied: pytz>=2017.3 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from pandas>=0.25.0->dask[complete]==2020.12.0) (2021.1) | |
| Requirement already satisfied: locket in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from partd>=0.3.10->dask[complete]==2020.12.0) (0.2.1) | |
| Requirement already satisfied: six>=1.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from python-dateutil>=2.1->bokeh!=2.0.0,>=1.0.0->dask[complete]==2020.12.0) (1.16.0) | |
| Requirement already satisfied: heapdict in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from zict>=0.1.3->distributed>=2.0->dask[complete]==2020.12.0) (1.0.1) | |
| Requirement already satisfied: zipp>=0.5 in /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages (from importlib-metadata->click>=6.6->distributed>=2.0->dask[complete]==2020.12.0) (3.5.0) | |
| Installing collected packages: dask | |
| Successfully installed dask-2020.12.0 | |
| ================================================== | |
| ================================================== | |
| Running tests against dask version 2020.12.0 | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_scheduler.py::test_ray_dask_basic PASSED [ 50%] | |
| test_dask_scheduler.py::test_ray_dask_persist PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 8.73s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 8 items | |
| test_dask_callback.py::test_callback_active PASSED [ 12%] | |
| test_dask_callback.py::test_presubmit_shortcircuit PASSED [ 25%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state PASSED [ 37%] | |
| test_dask_callback.py::test_postsubmit PASSED [ 50%] | |
| test_dask_callback.py::test_postsubmit_all PASSED [ 62%] | |
| test_dask_callback.py::test_finish PASSED [ 75%] | |
| test_dask_callback.py::test_multiple_callbacks PASSED [ 87%] | |
| test_dask_callback.py::test_pretask_posttask_shared_state_multi PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ======================== 8 passed, 1 warning in 23.72s ========================= | |
| ============================= test session starts ============================== | |
| platform darwin -- Python 3.7.10, pytest-6.2.4, py-1.10.0, pluggy-0.13.1 -- /Users/simonmo/miniconda3/envs/py37-1.5.0/bin/python | |
| cachedir: .pytest_cache | |
| rootdir: /private/tmp/dask-test | |
| collecting ... collected 2 items | |
| test_dask_optimization.py::test_rewrite_simple_shuffle_layer PASSED [ 50%] | |
| test_dask_optimization.py::test_dataframe_optimize PASSED [100%] | |
| =============================== warnings summary =============================== | |
| ../../../Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61 | |
| /Users/simonmo/miniconda3/envs/py37-1.5.0/lib/python3.7/site-packages/ray/autoscaler/_private/cli_logger.py:61: FutureWarning: Not all Ray CLI dependencies were found. In Ray 1.4+, the Ray CLI, autoscaler, and dashboard will only be usable via `pip install 'ray[default]'`. Please update your install command. | |
| "update your install command.", FutureWarning) | |
| -- Docs: https://docs.pytest.org/en/stable/warnings.html | |
| ========================= 2 passed, 1 warning in 0.77s ========================= | |
| ================================================== | |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment