celery beat

beat.bat

celery -A beat beat -l debug

beat.py

from celery import Celery
from web_tasks import Web

celery = Celery()
celery.config_from_object()

@celery.task
def web_task(site):
    print('running a web task')
    Web.open_url(site)

celeryconfig.py

from celery.schedules import crontab

# using rabbitmq
broker_url = 'amqp://user:user@localhost:5672//'
result_backend = 'amqp://user:user@localhost:5672//'

beat_schedule = {
    'every-minute': {
        'task': 'worker.web_task',
        'schedule': crontab(minute='*/1'),
        'args': ['http://google.com'],
    },
}

flower.bat

flower -A worker --port=5555

requirements.txt

celery
flower

web_tasks.py

# -*- coding: utf-8 -*-
import webbrowser

class Web:
    def __init__(self, url):
        self.url = url

    def open_url(url):
        webbrowser.open(url)

worker.bat

celery -A worker worker -l info

worker.py

from celery import Celery
from web_tasks import Web

celery = Celery()
celery.config_from_object('celeryconfig')

@celery.task
def web_task(site):
    print('running a web task')
    Web.open_url(site)

Hey Shane, nothing standing out as a major issue to me in your setup so just going to recommend some things to try. As for tasks in a file other than your celery config you can try http://docs.celeryproject.org/en/latest/_modules/celery/app/base.html#Celery.autodiscover_tasks. I'm using django so I point to my installed_apps in settings where a task sub package is referenced as a django app but should work the same. Looks like this for me
Using a string here means you won't have to pickle when using windows.

app.config_from_object('django.conf:settings')
app.autodiscover_tasks(lambda: myproject.settings.INSTALLED_APPS)

That allows me to define a background task like this - notice the way the task is referenced as a package import because it's been installed (you could do this with setuptools) not relatively imported. Here myproject.tasks is a directory with a tasks.py and other resources and defined in the settings.INSTALLED_APPS (which we autodiscovered).

    'clean_celery_results': {
        'task': 'myproject.tasks.tasks.clean_celery_results',
        'args': [dt.datetime.now() - dt.timedelta(days=45)],
        'schedule': crontab(minute=3, hour=9),
    },

Hopefully at least this gives you something to reference against as a sanity check.

celery ~= 3.1.18

For a different project I've had to pin to github because the latest version on pypi are buggy for the features I need to use (solar schedules) so I wouldn't rule out issues with the version you were on.

thanks for the tips I'll try that