orenitamar/Dockerfile

windlessuser · 2018-06-08T10:36:34Z

It still fails on older versions of Numpy where it was working before. I think the update was in one of the C headers it needs, During the compile, it complains about some typing issues. I've gone from version 1.14.2 - 1.13.0. Even the last known version that was working 1.14.2

LKozlowski · 2018-06-08T11:30:59Z

I had the same problem as you and found that pandas is still trying to install most recent version of numpy even if you already satisfied its requirement of numpy > 1.9 so I resolved it by:

install numpy version < 1.14.4 so 1.14.3 is fine
install python-dateutil (which is a pandas dependency)
install pandas without dependencies by running pip install --no-deps pandas==0.23.0
install other packages

gbroccolo · 2018-06-12T12:59:05Z

Also pytz>=2011k is a Pandas dependency, let's include it together with python-dateuti.

byaminov · 2018-06-12T17:26:28Z

Thanks a lot for the tip to use numpy==1.14.3! 👍

tgsmith61591 · 2018-10-31T14:29:55Z

Is this still working? I'm getting:

ERROR: unsatisfiable constraints:
  so:libgfortran.so.5 (missing):
    required by: openblas-ilp64-0.3.3-r2[so:libgfortran.so.5] openblas-ilp64-0.3.3-r2[so:libgfortran.so.5] openblas-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]

flyrev · 2018-11-12T14:37:10Z

I'm getting

fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/community/x86_64/APKINDEX.tar.gz
fetch http://dl-8.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
ERROR: unsatisfiable constraints:
  so:libgfortran.so.5 (missing):
    required by:
                 openblas-ilp64-0.3.3-r2[so:libgfortran.so.5]
                 openblas-ilp64-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]
The command '/bin/sh -c apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev' returned a non-zero code: 4

mdiazcl · 2018-11-28T19:00:00Z

I'm getting

fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/community/x86_64/APKINDEX.tar.gz
fetch http://dl-8.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
ERROR: unsatisfiable constraints:
  so:libgfortran.so.5 (missing):
    required by:
                 openblas-ilp64-0.3.3-r2[so:libgfortran.so.5]
                 openblas-ilp64-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]
The command '/bin/sh -c apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev' returned a non-zero code: 4

Had the same issue... changed the repos from dl-8 to CDN and it worked!

Here's the new Dockerfile

FROM alpine:3.4
RUN echo "http://dl-cdn.alpinelinux.org/alpine/latest-stable/main" > /etc/apk/repositories
RUN echo "http://dl-cdn.alpinelinux.org/alpine/latest-stable/community" >> /etc/apk/repositories
RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev
RUN ln -s /usr/include/locale.h /usr/include/xlocale.h
RUN pip install numpy scipy pandas matplotlib

JensRantil · 2019-01-30T13:36:11Z

gcc is likely not needed as build-base depends on it.

MartinThoma · 2019-05-06T08:13:53Z

This works for me:

FROM: python:alpine

RUN echo "http://dl-8.alpinelinux.org/alpine/edge/community" >> /etc/apk/repositories

# Add HDF5 support
RUN apk add --no-cache --allow-untrusted --repository http://dl-3.alpinelinux.org/alpine/edge/testing hdf5 hdf5-dev
RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev
RUN ln -s /usr/include/locale.h /usr/include/xlocale.h

RUN pip install numpy

The rest could be installed via the dependencies automatically by pip.

orhun · 2019-05-07T22:44:39Z

@MartinThoma what's the HDF5 library for?

promehul · 2019-05-16T14:11:32Z

This isn't working..
ERROR: Command "/usr/local/bin/python -u -c 'import setuptools, tokenize;file='"'"'/tmp/pip-install-2u_c2pqi/numpy/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' install --record /tmp/pip-record-gfsn5nsl/install-record.txt --single-version-externally-managed --compile" failed with error code 1 in /tmp/pip-install-2u_c2pqi/numpy/
This ois i am getting..

ozichert · 2019-06-26T08:37:34Z

First add py-numpy, since directly installing with pip doesn't work.
RUN apk add py-numpy
In the next step install it with pip.
RUN python -m pip install numpy

felixraboacct · 2019-07-23T08:11:10Z

First add py-numpy, since directly installing with pip doesn't work.
RUN apk add py-numpy
In the next step install it with pip.
RUN python -m pip install numpy

pip install numpy fails ... tries to install it normally. And yet without this step Python gives module not found error. So how do you tell Python that the package was already installed via linux package manager?

Faylixe · 2019-08-13T21:44:32Z

I figured out how to make numpy package from Alpine repository to work. Actually py-numpy does not really install bumpy but py3-numpy does.

But even though, py3-numpy installs libraries into /usr/lib/python3.7/site-packagesdirectory but default Python module path does not use it :

$ docker run -it python:3-alpine sh
/ # apk add --update --no-cache py3-numpy
...
/ # python
>>> import numpy
>>> ... module not found ...
>>> import sys
>>> sys.path
['', '/usr/local/lib/python37.zip', '/usr/local/lib/python3.7', '/usr/local/lib/python3.7/lib-dynload', '/usr/local/lib/python3.7/site-packages']

I fixed the problem by settings $PYTHONPATH environment variable to /usr/liblocated site packages :

FROM python:3-alpine

RUN apk add --update --no-cache py3-numpy
ENV PYTHONPATH=/usr/lib/python3.7/site-packages

EDIT: you might also need to install py-numpy-dev to get Numpy C headers required by other Python compiled libraries.

sandervh14 · 2020-04-06T14:22:45Z

I had various problems on the way starting FROM alpine, FROM python:alpine, but with the following I had a smooth docker build experience:

FROM python:slim
pip install numpy scipy

I assume you can add matplotlib and pandas as extra packages without problems.
See https://pythonspeed.com/articles/alpine-docker-python/ for my choice to start from python:slim.

photostu · 2020-04-07T14:10:23Z

@sanderzz91 Thanks!

mkdthanga · 2020-06-29T01:29:39Z

I tried using both alpine:latest image and python:slim image, both throws an error:
1)alpine:latest
Dockerfile:
FROM alpine:latest

ENV LC_ALL=C.UTF-8
ENV LANG=C.UTF-8
ENV PROJ_DIR=/usr
ENV PYTHONPATH=/usr/lib/python3.7/site-packages

RUN addgroup -S appuser ; adduser -S appuser -G appuser -h /app ;
chown appuser:appuser /app

WORKDIR /app
COPY --chown=appuser:appuser / /app

RUN apk add --update --no-cache python3 libpq uwsgi-python3;
apk add --no-cache python3-dev py3-pip alpine-sdk postgresql-dev postgresql;
apk add --update --no-cache py3-numpy;
apk add libgfortran;
apk add lapack-dev;
apk add proj proj-dev;
apk add proj-util;
pip3 install --no-cache-dir --upgrade pip ;
pip3 install --upgrade setuptools;
pip3 install --no-cache-dir -r requirements.txt

EXPOSE 5432

CMD ["python3", "/app/subscriber_db.py", "/app/resolver.py"]

Requirements:
numpy==1.14.3
pandas==1.0.5
sqlalchemy==1.3.16
paho-mqtt==1.5.0
psycopg2==2.8.5
six==1.14.0
requests==2.24.0
cython
pyproj
scipy==1.3.1
statistics==1.0.3.5
matplotlib

Console Output:
PS C:\Users\thangaraj\PycharmProjects> docker build -t grs-docker .
Collecting scipy==1.3.1
Downloading scipy-1.3.1.tar.gz (23.6 MB)
Installing build dependencies: started
Installing build dependencies: still running...
Installing build dependencies: still running...
Installing build dependencies: still running...
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
.
.
.
.
numpy.distutils.system_info.NotFoundError: No lapack/blas resources found.
----------------------------------------
ERROR: Command errored out with exit status 1: /usr/bin/python3 /usr/lib/python3.8/site-packages/pep517/_in_process.py prepare_metadata_for_build_wheel /tmp/tmp9m_79xyv Check the logs for full command output.
The command '/bin/sh -c apk add --update --no-cache python3 libpq uwsgi-python3; apk add --no-cache python3-dev py3-pip alpine-sdk postgresql-dev postgresql; apk add --update --no-cache py3-numpy; apk add libgfortran; apk add
lapack-dev; apk add proj proj-dev; apk add proj-util; pip3 install --no-cache-dir --upgrade pip ; pip3 install --upgrade setuptools; pip3 install --no-cache-dir -r requirements.txt' returned a non-zero code: 1

2) python:slim (I think its not suited for hosting postgresql DB)

Console logs:
PS C:\Users\thangaraj\PycharmProjects> docker build -t grs-docker .
Sending build context to Docker daemon 1.394MB
Step 1/10 : FROM python:slim
slim: Pulling from library/python
8559a31e96f4: Pull complete
62e60f3ef11e: Pull complete
93c8ae153782: Pull complete
ea222f757df7: Pull complete
e97d3933bbbe: Pull complete
Digest: sha256:938fd520a888e9dbac3de374b8ba495cc50fe96440030264a40f733052001895
Status: Downloaded newer image for python:slim

.
.
.

chown: invalid user: ‘appuser:appuser’
The command '/bin/sh -c addgroup -S appuser ; adduser -S appuser -G appuser -h /app ; chown appuser:appuser /app' returned a non-zero code: 1

Could anyone help/ advice me with these errors? I would really appreciate it. Thanks in advance.

rendorHaevyn · 2020-08-06T09:37:43Z

Thanks @orenitamar.

@mkdthanga: The following worked for me - I simply used python3-alpine build, and removed python, python-dev and py-pip from the apk command (line 5, OP):

FROM python:3-alpine
WORKDIR /usr/source/app
COPY requirements.txt ./

RUN apk update
RUN echo "http://dl-8.alpinelinux.org/alpine/edge/community" >> /etc/apk/repositories
RUN apk --no-cache --update-cache add gcc gfortran build-base wget freetype-dev libpng-dev openblas-dev
RUN ln -s /usr/include/locale.h /usr/include/xlocale.h
RUN pip install --no-cache-dir -r requirements.txt

PJCAfonso · 2021-04-18T21:42:30Z

I'm getting

fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.7/community/x86_64/APKINDEX.tar.gz
fetch http://dl-8.alpinelinux.org/alpine/edge/community/x86_64/APKINDEX.tar.gz
ERROR: unsatisfiable constraints:
  so:libgfortran.so.5 (missing):
    required by:
                 openblas-ilp64-0.3.3-r2[so:libgfortran.so.5]
                 openblas-ilp64-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]
                 openblas-0.3.3-r2[so:libgfortran.so.5]
The command '/bin/sh -c apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev' returned a non-zero code: 4

Had the same issue... changed the repos from dl-8 to CDN and it worked!

Here's the new Dockerfile

FROM alpine:3.4
RUN echo "http://dl-cdn.alpinelinux.org/alpine/latest-stable/main" > /etc/apk/repositories
RUN echo "http://dl-cdn.alpinelinux.org/alpine/latest-stable/community" >> /etc/apk/repositories
RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev
RUN ln -s /usr/include/locale.h /usr/include/xlocale.h
RUN pip install numpy scipy pandas matplotlib

Thanks man your answers solved my problem!

aboutmedicine · 2021-07-22T10:13:44Z

I had various problems on the way starting FROM alpine, FROM python:alpine, but with the following I had a smooth docker build experience:
FROM python:slim
pip install numpy scipy
I assume you can add matplotlib and pandas as extra packages without problems.
See https://pythonspeed.com/articles/alpine-docker-python/ for my choice to start from python:slim.

Thanks - this is a great option for my use case

pPanda-beta · 2021-08-18T22:37:57Z

In case you cant move to slim-buster, the natural answer to this is
pip install --extra-index-url https://alpine-wheels.github.io/index ...

samanthahw21 · 2022-01-02T12:46:36Z

Hi, can anyone help. I tried to execute the line in the Docker file but it takes very long to run .
Can anyone can help and what should i do ?
i didn't include panda version in my requirements - i tried but it run error . should i include and what version ? thanks

Pull a pre-built alpine docker image with nginx and python3 installed

FROM tiangolo/uwsgi-nginx-flask:python3.6-alpine3.7
ENV LISTEN_PORT=8000
EXPOSE 8000
COPY /app /app
RUN echo "http://dl-8.alpinelinux.org/alpine/edge/community" >> /etc/apk/repositories
RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev
RUN ln -s /usr/include/locale.h /usr/include/xlocale.h
RUN pip install pandas

Frikster · 2022-05-24T21:52:42Z

Thanks @orenitamar.

@mkdthanga: The following worked for me - I simply used python3-alpine build, and removed python, python-dev and py-pip from the apk command (line 5, OP):

FROM python:3-alpine
WORKDIR /usr/source/app
COPY requirements.txt ./

RUN apk update
RUN echo "http://dl-8.alpinelinux.org/alpine/edge/community" >> /etc/apk/repositories
RUN apk --no-cache --update-cache add gcc gfortran build-base wget freetype-dev libpng-dev openblas-dev
RUN ln -s /usr/include/locale.h /usr/include/xlocale.h
RUN pip install --no-cache-dir -r requirements.txt

This leads to ERROR: Failed building wheel for pyarrow for me

PaleNeutron · 2022-07-19T00:56:07Z

@Frikster If you are using python:3-alpine which means you prefer the latest python3.10 version, you could consider using package from alpine instead of from pip.

This way need python package from alpine!!!!

FROM alpine:3.16
RUN apk --no-cache --update-cache add  python3 py3-pip py3-arrow  py3-pandas # and py3-anything package need to be compiled
RUN pip install --no-cache-dir -r requirements.txt

Tejas9019 · 2023-04-07T07:38:44Z

=> ERROR [6/8] RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev 5.3s

[6/8] RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev:
nity/x86_64/APKINDEX.tar.gz
#11 5.137 WARNING: Ignoring http://dl-8.alpinelinux.org/alpine/edge/community: DNS lookup error
#11 5.215 ERROR: unable to select packages:
#11 5.252 python (no such package):
#11 5.252 required by: world[python]
#11 5.252 python-dev (no such package):
#11 5.252 required by: world[python-dev]

executor failed running [/bin/sh -c apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev]: exit code: 2

I am getting error like this pls can anyone help me out

orenitamar/Dockerfile

windlessuser commented Jun 8, 2018

LKozlowski commented Jun 8, 2018

gbroccolo commented Jun 12, 2018 •

edited

Loading

byaminov commented Jun 12, 2018

tgsmith61591 commented Oct 31, 2018

flyrev commented Nov 12, 2018

mdiazcl commented Nov 28, 2018

JensRantil commented Jan 30, 2019

MartinThoma commented May 6, 2019 •

edited

Loading

orhun commented May 7, 2019

promehul commented May 16, 2019

ozichert commented Jun 26, 2019

felixraboacct commented Jul 23, 2019

Faylixe commented Aug 13, 2019 •

edited

Loading

sandervh14 commented Apr 6, 2020 •

edited

Loading

photostu commented Apr 7, 2020

mkdthanga commented Jun 29, 2020 •

edited

Loading

rendorHaevyn commented Aug 6, 2020

PJCAfonso commented Apr 18, 2021

aboutmedicine commented Jul 22, 2021

pPanda-beta commented Aug 18, 2021

samanthahw21 commented Jan 2, 2022

Frikster commented May 24, 2022

PaleNeutron commented Jul 19, 2022 •

edited

Loading

Tejas9019 commented Apr 7, 2023

	# Below are the dependencies required for installing the common combination of numpy, scipy, pandas and matplotlib
	# in an Alpine based Docker image.
	FROM alpine:3.4
	RUN echo "http://dl-8.alpinelinux.org/alpine/edge/community" >> /etc/apk/repositories
	RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev
	RUN ln -s /usr/include/locale.h /usr/include/xlocale.h
	RUN pip install numpy scipy pandas matplotlib

orenitamar/Dockerfile

windlessuser commented Jun 8, 2018

LKozlowski commented Jun 8, 2018

gbroccolo commented Jun 12, 2018 • edited Loading

byaminov commented Jun 12, 2018

tgsmith61591 commented Oct 31, 2018

flyrev commented Nov 12, 2018

mdiazcl commented Nov 28, 2018

JensRantil commented Jan 30, 2019

MartinThoma commented May 6, 2019 • edited Loading

orhun commented May 7, 2019

promehul commented May 16, 2019

ozichert commented Jun 26, 2019

felixraboacct commented Jul 23, 2019

Faylixe commented Aug 13, 2019 • edited Loading

sandervh14 commented Apr 6, 2020 • edited Loading

photostu commented Apr 7, 2020

mkdthanga commented Jun 29, 2020 • edited Loading

rendorHaevyn commented Aug 6, 2020

PJCAfonso commented Apr 18, 2021

aboutmedicine commented Jul 22, 2021

pPanda-beta commented Aug 18, 2021

samanthahw21 commented Jan 2, 2022

Pull a pre-built alpine docker image with nginx and python3 installed

Frikster commented May 24, 2022

PaleNeutron commented Jul 19, 2022 • edited Loading

Tejas9019 commented Apr 7, 2023

=> ERROR [6/8] RUN apk --no-cache --update-cache add gcc gfortran python python-dev py-pip build-base wget freetype-dev libpng-dev openblas-dev 5.3s

gbroccolo commented Jun 12, 2018 •

edited

Loading

MartinThoma commented May 6, 2019 •

edited

Loading

Faylixe commented Aug 13, 2019 •

edited

Loading

sandervh14 commented Apr 6, 2020 •

edited

Loading

mkdthanga commented Jun 29, 2020 •

edited

Loading

PaleNeutron commented Jul 19, 2022 •

edited

Loading