Skip to content

Instantly share code, notes, and snippets.

@Ladsgroup
Created July 19, 2016 15:43
Show Gist options
  • Save Ladsgroup/d66eec0c6857089dc0a23b40e56f8918 to your computer and use it in GitHub Desktop.
Save Ladsgroup/d66eec0c6857089dc0a23b40e56f8918 to your computer and use it in GitHub Desktop.
configs
ores:
scoring_system: local_single_thread
wsgi:
application_root: ""
url_prefix: ""
data_paths:
nltk: /srv/ores/config/submodules/wheels/nltk/
# Score cache options
score_caches:
ores_redis:
class: ores.score_caches.Redis
host: ores-redis-01
port: 6380
prefix: "ores"
socket_timeout: 15
# Metrics collection options
metrics_collectors:
local_logging:
class: ores.metrics_collectors.Logger
wmflabs_statsd:
class: ores.metrics_collectors.Statsd
host: labmon1001.eqiad.wmnet
prefix: ores.{hostname}
# Score processor
scoring_systems:
defaults:
score_cache: ores_redis
metrics_collector: wmflabs_statsd
scoring_contexts:
- arwiki
- cswiki
- dewiki
- enwiki
- enwiktionary
- eswiki
- etwiki
- fawiki
- frwiki
- hewiki
- huwiki
- idwiki
- itwiki
- nlwiki
- nowiki
- plwiki
- ptwiki
- ruwiki
- svwiki
- testwiki
- trwiki
- ukwiki
- viwiki
- wikidatawiki
local_single_thread:
class: ores.scoring_systems.SingleThread
local_process_pool:
class: ores.scoring_systems.ProcessPool
workers: 8
local_celery:
class: ores.scoring_systems.CeleryQueue
BROKER_URL: redis://ores-redis-01:6379
BROKER_TRANSPORT_OPTIONS: {'socket_timeout': 15} # seconds
CELERY_RESULT_BACKEND: redis://ores-redis-01:6379
CELERY_ACCEPT_CONTENT: ['pickle']
CELERY_TASK_SERIALIZER: 'pickle'
CELERY_RESULT_SERIALIZER: 'pickle'
CELERYD_CONCURRENCY: 16
CELERYD_MAX_TASKS_PER_CHILD: 100
timeout: 15 # seconds
queue_maxsize: 100 # pending tasks
(And lots of other common configs)
metrics_collectors:
wmflabs_statsd:
host: labmon1001.eqiad.wmnet
ores:
data_paths:
nltk: /srv/ores/config/submodules/wheels/nltk/
score_caches:
ores_redis:
host: "127.0.0.1"
port: 6380
scoring_systems:
local_celery:
BROKER_URL: "redis://127.0.0.1:6379"
CELERY_RESULT_BACKEND: "redis://127.0.0.1:6379"
score_caches:
ores_redis:
host: "127.0.0.1"
port: 6380
scoring_systems:
local_celery:
BROKER_URL: "redis://127.0.0.1:6379"
CELERY_RESULT_BACKEND: "redis://127.0.0.1:6379"
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment