Skip to content

Instantly share code, notes, and snippets.

@brianv0
Last active May 22, 2020 22:09
Show Gist options
  • Save brianv0/05907eb7007ec86184a11700d1e26d6b to your computer and use it in GitHub Desktop.
Save brianv0/05907eb7007ec86184a11700d1e26d6b to your computer and use it in GitHub Desktop.
Qserv instructions
docker run -it lsstdm/centos:7-stackbase-devtoolset-8
[root@2ad9f80b6ef1 /]# git clone https://github.com/lsst/lsstsw
Cloning into 'lsstsw'...
remote: Enumerating objects: 107, done.
remote: Counting objects: 100% (107/107), done.
remote: Compressing objects: 100% (69/69), done.
remote: Total 2412 (delta 63), reused 69 (delta 38), pack-reused 2305
Receiving objects: 100% (2412/2412), 452.65 KiB | 0 bytes/s, done.
Resolving deltas: 100% (1610/1610), done.
[root@2ad9f80b6ef1 /]# cd lsstsw/
[root@2ad9f80b6ef1 lsstsw]# bin/deploy -r u/bvan/remove-conda-thirdparties > install.log
CondaKeyError: 'channels': key 'channels' is not in the config file
/bin/sh: latex: command not found
/bin/sh: pdflatex: command not found
/bin/sh: latex2html: command not found
cp: cannot stat 'eups.pdf': No such file or directory
Cloning into 'versiondb'...
remote: Enumerating objects: 136, done.
remote: Counting objects: 100% (136/136), done.
remote: Compressing objects: 100% (136/136), done.
remote: Total 210777 (delta 0), reused 63 (delta 0), pack-reused 210641
Receiving objects: 100% (210777/210777), 145.68 MiB | 40.21 MiB/s, done.
Resolving deltas: 100% (194652/194652), done.
Cloning into 'lsst_build'...
remote: Enumerating objects: 47, done.
remote: Counting objects: 100% (47/47), done.
remote: Compressing objects: 100% (37/37), done.
remote: Total 1075 (delta 24), reused 19 (delta 4), pack-reused 1028
Receiving objects: 100% (1075/1075), 194.14 KiB | 8.82 MiB/s, done.
Resolving deltas: 100% (496/496), done.
[root@2ad9f80b6ef1 lsstsw]#
[root@2ad9f80b6ef1 lsstsw]# tail install.log | grep -- "-n"
. /lsstsw/bin/envconfig -n lsst-scipipe-u-bvan-remove-conda-thirdparties.90f14d4
[root@2ad9f80b6ef1 lsstsw]#
[root@2ad9f80b6ef1 lsstsw]# . /lsstsw/bin/envconfig -n lsst-scipipe-u-bvan-remove-conda-thirdparties.90f14d4
Setting lsst-scipipe-u-bvan-remove-conda-thirdparties.90f14d4 environment...
Creating user data directory: /root/.eups
EUPS_PATH set to /lsstsw/stack/90f14d4
notice: lsstsw tools have been set up.
[root@2ad9f80b6ef1 lsstsw]#
(lsst-scipipe-u-bvan-remove-conda-thirdparties.90f14d4) [root@2ad9f80b6ef1 lsstsw]# rebuild -r u/bvan/remove-conda-thirdparties qserv
qserv: ok (2.5 sec).
antlr4: ok (1.1 sec).
db: ok (0.9 sec).
log: ok (1.0 sec).
base: ok (1.0 sec).
sconsUtils: ok (1.1 sec).
utils: ok (1.0 sec).
pex_exceptions: ok (1.1 sec).
mariadbclient: ok (6.7 sec).
mariadb: ok (5.6 sec).
mysqlproxy: ok (1.5 sec).
json_nlohmann: ok (3.3 sec).
partition: ok (0.9 sec).
sphgeom: ok (1.0 sec).
redis_plus_plus: ok (0.8 sec).
hiredis: ok (0.9 sec).
scisql: ok (1.0 sec).
xrootd: ok (4.3 sec).
# BUILD ID: b4900
...
@brianv0
Copy link
Author

brianv0 commented May 22, 2020

config.log should show missing symbols for libcrypto/libssl/libz when trying to deal with libmysqlcient_r. I think I fixed these in scons at first - you may want to check mariadb/mariadbclient and how they are built.

Unit tests may be similarly failing.

Remember - you don't want to link to the system libraries and you don't want to use the system/GCC compiler, which will actually be setup - you want to link against conda libraries and use the conda compiler (also set up as $CXX). All conda things are installed under $CONDA_PREFIX, e.g. $CONDA_PREFIX/include $CONDA_PREFIX/lib

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment