Skip to content

Instantly share code, notes, and snippets.

@pkwv2012
Last active June 19, 2018 10:44
Show Gist options
  • Save pkwv2012/a74a4a8855081a79808fa6eed9903e3e to your computer and use it in GitHub Desktop.
Save pkwv2012/a74a4a8855081a79808fa6eed9903e3e to your computer and use it in GitHub Desktop.

内存不够

g++: internal compiler error: Killed (program cc1plus)

solution:

  1. set IMPALA_BUILD_THREADS=1
  2. increase VM memory and swap, ref

link tuple-splitter-test error

impala version: about ?
commit id: 06fe3210509424cf50fdd3cc919466a1ce6bc842
Linking CXX executable ../../build/debug/experiments/tuple-splitter-test
collect2: error: ld returned 1 exit status
be/src/experiments/CMakeFiles/tuple-splitter-test.dir/build.make:212: recipe for target 'be/build/debug/experiments/tuple-splitter-test' failed

solution:

  1. using impala: 2.12.0

docker 空间不足

Hard disk space: 120GB (for the test data)

修改docker的空间,ref

git fetch origin tags

ref

mvn 编译极其慢

CPU和MEMORY占用都很低

grep exclude or include some file

ref

指定IMPALA_HOME路径

使用绝对路径不要用相对路径

GLIBCXX not found

ubuntu 14.04 /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.20' not found

使用的是系统的GCC library,改用toolchain的GCC library,ref

PYTHONPATH 作用

PYTHONPATH 是用来指定python运行时搜索library的路径的。如果在PYTHONPATH中的目录下面有相同的package,那么在python运行的时候会引发错误。特别需要注意的是:MAC OS 是不区分大小写的(case-insensitive),所以如果是同名,但是大小写不同的package在MAC下也会认为是相同的package,不过Ubuntu是区分大小写的(case-sensitive),所以在Ubuntu下不会有问题

permission denied

host: ubuntu 14.04, docker image: 16.04, share directory: drwxrwxr-x

user: root 能创建,删除目录 user: impdev 不能创建,删除目录。如果用 sudo 来执行就可以创建删除目录

可能原因是SELinux, 尝试解决方案,没有成功。

不清楚其他原因。

python ‘datetime' module not found

impala/infra/python/env/bin/python is create from System Python.

由于分别在ubuntu 14.04 和 ubuntu 16.04上面进行build,所以python第一次被复制过去是在 14.04上,所以在16.04的docker里面再次运行的时候就不再copy 系统的Python到那个路径下面。所以就找不到 datetime了。

Sentry Access Denied

需要配置 sentry.service.admin.group为当前用户的组(至少是其中一个组) ref: Sentry Service Configuration

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment