Skip to content

Instantly share code, notes, and snippets.

@lanhuai

lanhuai/carbon

Last active August 29, 2015 14:01
Show Gist options
  • Save lanhuai/e4d20e7e1a0b8225a9e0 to your computer and use it in GitHub Desktop.
Save lanhuai/e4d20e7e1a0b8225a9e0 to your computer and use it in GitHub Desktop.
Download ZIP
在 CentOS 6.4 上 使用 virtualenv 安装 Graphite 0.9.12
Raw
carbon
#!/bin/bash
#
# Carbon (part of Graphite)
#
# chkconfig: 3 50 50
# description: Carbon init.d
. /etc/rc.d/init.d/functions
prog=carbon
RETVAL=0
start() {
echo -n $"Starting $prog: "
source /opt/virtualenvs/graphite/bin/activate
#PYTHONPATH=/usr/lib/python2.6/dist-packages/ /opt/graphite/bin/carbon-cache.py start
/opt/graphite/bin/carbon-cache.py start
RETVAL=$?
if [ $RETVAL = 0 ]; then
success "carbon started"
else
failure "carbon failed to start"
fi
echo
return $RETVAL
}
stop() {
echo -n $"Stopping $prog: "
source /opt/virtualenvs/graphite/bin/activate
#PYTHONPATH=/usr/lib/python2.6/dist-packages/ /opt/graphite/bin/carbon-cache.py stop > /dev/null 2>&1
/opt/graphite/bin/carbon-cache.py stop > /dev/null 2>&1
RETVAL=$?
if [ $RETVAL = 0 ]; then
success "carbon stopped"
else
failure "carbon failed to stop"
fi
echo
return $RETVAL
}
# See how we were called.
case "$1" in
start)
start
;;
stop)
stop
;;
status)
#PYTHONPATH=/usr/lib/python2.6/dist-packages/ /opt/graphite/bin/carbon-cache.py status
source /opt/virtualenvs/graphite/bin/activate
/opt/graphite/bin/carbon-cache.py status
RETVAL=$?
;;
restart)
stop
start
;;
*)
echo $"Usage: $prog {start|stop|restart|status}"
exit 1
esac
exit $RETVAL
Raw
install Graphite on CentOS 6.4 with VirtualEnv.md

在 CentOS 6.4 上 使用 virtualenv 安装 Graphite 0.9.12

安装 virtualenv

  1. 启用 EPEL repository

    这里使用 阿里云的镜像服务器

    mv /etc/yum.repos.d/epel.repo /etc/yum.repos.d/epel.repo.backup

    mv /etc/yum.repos.d/epel-testing.repo /etc/yum.repos.d/epel-testing.repo.backup

    wget -O /etc/yum.repos.d/epel.repo http://mirrors.aliyun.com/repo/epel-6.repo

    rpm -Uvh http://mirrors.aliyun.com/epel/6/x86_64/epel-release-6-8.noarch.rpm

    yum --enablerepo=epel

  2. 安装并创建 virtualenv

    • 安装 python packages

      yum install python-virtualenv.noarch python-virtualenvwrapper.noarch

    • 修改 ~/.bashrc，在最后加上

      export WORKON_HOME=/opt/virtualenvs

      export VIRTUALENVWRAPPER_PYTHON=/usr/bin/python2.6

      source /usr/bin/virtualenvwrapper.sh

    • 使配置生效，在命令行执行

      source ~/.bashrc

    • 然后，创建新的 virtualenv，在命令行执行

      mkvirtualenv graphite

安装和配置 Graphite1234

  1. 切换到 virtualenv graphite，在命令行执行

    [root@pc4 ~]# workon graphite

    (graphite)[root@pc4 ~]#

  2. 使用 pip 安装 graphite 和其他 python packages

    (graphite)[root@pc4 ~]# pip install graphite-web==0.9.12 carbon==0.9.12 whisper==0.9.12 twisted==11 django==1.3.7 django-tagging==0.3.1 gunicorn==18 simplejson==3.5 python-memcached

  3. 安装 cairo 和 pycairo 矢量图工具5

    (graphite)[root@pc4 ~]# yum install cairo-devel pycairo-devel

    由于使用 pip 安装 pycairo 会出错，导致无法在 virtualenv 中安装，所以将系统中装好的 cairo 软连接到 virtualenv graphite 中。

    (graphite)[root@pc4 ~]# ln -s /usr/lib64/python2.6/site-packages/cairo /opt/virtualenvs/graphite/lib64/python2.6/site-packages/cairo

  4. 创建配置文件

    cp /opt/graphite/webapp/graphite/local_settings.py.example /opt/graphite/webapp/graphite/local_settings.py

    cp /opt/graphite/conf/carbon.conf.example /opt/graphite/conf/carbon.conf

    cp /opt/graphite/conf/storage-schemas.conf.example /opt/graphite/conf/storage-schemas.conf

    cp /opt/graphite/conf/storage-aggregation.conf.example /opt/graphite/conf/storage-aggregation.conf

    • 配置graphite的数据压缩

      vi /opt/graphite/conf/storage-schemas.conf

      注释掉[default_1min_for_1day]

      [diamond]
pattern = ^servers.*
#这里的最小数据时长要和 Diamond 中 /etc/diamond/diamond.conf 配置的 interval = 60 一致
retentions = 1m:7d,15m:30d,1h:2y

[primary]
pattern = .*
retentions = 10s:24h, 1m:7d, 15m:30d, 1h:2y

#[default_1min_for_1day]
#pattern = .*
#retentions = 60s:1d
#retentions = 10s:6h,1min:7d,10min:5y

    • 修改 /opt/graphite/webapp/graphite/local_settings.py

      vi /opt/graphite/webapp/graphite/local_settings.py

      ......

SECRET_KEY = '任意值'

......

TIME_ZONE = 'Asia/Shanghai'

......

# Logging
LOG_RENDERING_PERFORMANCE = True
LOG_CACHE_PERFORMANCE = True
LOG_METRIC_ACCESS = True

DEBUG=True

......

  5. 启动 carbon

    (graphite)[root@pc4 ~]# /opt/graphite/bin/carbon-cache.py start

  6. 初始化 Graphite Django 数据库

    (graphite)[root@pc4 ~]# cd /opt/graphite/webapp/graphite && python manage.py syncdb

  7. 配置 apache 和 mod_wsgi678

    yum install httpd mod_wsgi

    vi /etc/httpd/conf.d/graphite-vhost.conf

    # This needs to be in your server's config somewhere, probably
# the main httpd.conf
# NameVirtualHost *:80

# This line also needs to be in your server's config.
# LoadModule wsgi_module modules/mod_wsgi.so

# You need to manually edit this file to fit your needs.
# This configuration assumes the default installation prefix
# of /opt/graphite/, if you installed graphite somewhere else
# you will need to change all the occurances of /opt/graphite/
# in this file to your chosen install location.

<IfModule !wsgi_module.c>
    LoadModule wsgi_module modules/mod_wsgi.so
</IfModule>

# XXX You need to set this up!
# Read http://code.google.com/p/modwsgi/wiki/ConfigurationDirectives#WSGISocketPrefix
WSGISocketPrefix /var/run/httpd/graphite

WSGIPythonHome /opt/virtualenvs/graphite

<VirtualHost *:80>
    ServerName graphite.tianjin
    DocumentRoot "/opt/graphite/webapp"
    ErrorLog /opt/graphite/storage/log/webapp/error.log
    CustomLog /opt/graphite/storage/log/webapp/access.log common

    # I've found that an equal number of processes & threads tends
    # to show the best performance for Graphite (ymmv).
    WSGIDaemonProcess graphite processes=5 threads=5 display-name='%{GROUP}' inactivity-timeout=120
    WSGIProcessGroup graphite
    WSGIApplicationGroup %{GLOBAL}
    WSGIImportScript /opt/graphite/conf/graphite.wsgi process-group=graphite application-group=%{GLOBAL}

    # XXX You will need to create this file! There is a graphite.wsgi.example
    # file in this directory that you can safely use, just copy it to graphite.wgsi
    WSGIScriptAlias / /opt/graphite/conf/graphite.wsgi 

    Alias /content/ /opt/graphite/webapp/content/
    <Location "/content/">
        SetHandler None
    </Location>

    # XXX In order for the django admin site media to work you
    # must change @DJANGO_ROOT@ to be the path to your django
    # installation, which is probably something like:
    # /usr/lib/python2.6/site-packages/django
    Alias /media/ "@DJANGO_ROOT@/contrib/admin/media/"
    <Location "/media/">
        SetHandler None
    </Location>

    Alias /grafana /opt/graphite/webapp/grafana
    <Location "/grafana">
        SetHandler None
    </Location>

    # The graphite.wsgi file has to be accessible by apache. It won't
    # be visible to clients because of the DocumentRoot though.
    <Directory /opt/graphite/conf/>
#       Order deny,allow
#       Allow from all    #  until apache 2.3
        Options All
        AllowOverride All
#       Require all granted  # since apache 2.4
    </Directory>
    <Directory /opt/graphite/webapp>
        Order deny,allow
        Allow from all   #  until apache 2.3
        Options All
        AllowOverride All
#       Require all granted  # since apache 2.4
    </Directory>
</VirtualHost>

    chown -R apache:apache /opt/graphite/storage/

    service httpd start

安装和配置 Grafana

  1. 安装 Elasticsearch9

    • 添加 yum repositories

    参考9

    • 安装

      yum install elasticsearch

  2. 下载 Grafana10

    wget http://grafanarel.s3.amazonaws.com/grafana-1.5.4.tar.gz

    tar zxf grafana-1.5.4.tar.gz

    mv grafana-1.5.4 /opt/graphite/webapp/grafana

Footnotes

  1. 阿亮的Graphite & Collectd安装记录 ↩

  2. Install Graphite on Ubuntu or Debian in a VirtualEnv ↩

  3. Graphite Install Note By Farzad Ghanei ↩

  4. 使用grafana和Diamond构建Graphite监控系统 ↩

  5. Install pycairo in virtualenv ↩

  6. Setting up Graphite on CentOS 6.5 or Scientific Linux 6.5 ↩

  7. How to run Python within a virtualenv with WSGI? ↩

  8. Django with mod_wsgi on apache - 500 error: Authtype not set? ↩

  9. Announcing Elasticsearch Deb and Rpm Repositories ↩ ↩2

  10. Grafana Download ↩

@lanhuai
Copy link
Author

lanhuai commented Jun 9, 2014

关于基于VirtualEnv安装的 Carbon 如何自启动，请参考这个：https://gist.github.com/acdha/1506392

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment