首页 文章

用芹菜烧瓶 - Worker 用exitcode1退出

提问于
浏览
3

我有一个带芹菜的烧瓶应用程序 .
当我按如下方式运行worker时:

celery -A app.celery worker

我得到以下输出

-------------- celery@local-pc v3.1.22 (Cipater)
---- **** -----
--- * ***  * -- Windows-7-6.1.7601-SP1
-- * - **** ---
- ** ---------- [config]
- ** ---------- .> app:         app:0x483e668
- ** ---------- .> transport:   mongodb://localhost:27017/app
- ** ---------- .> results:     mongodb://localhost:27017/app
- *** --- * --- .> concurrency: 8 (prefork)
-- ******* ----
--- ***** ----- [queues]
 -------------- .> celery           exchange=celery(direct) key=celery


[2016-03-08 15:52:05,587: WARNING/MainProcess] celery@local-pc ready.
[2016-03-08 15:52:08,855: ERROR/MainProcess] Process 'Worker-8' pid:9720 exited with 'exitcode 1'
[2016-03-08 15:52:08,855: ERROR/MainProcess] Process 'Worker-7' pid:11940 exited with 'exitcode 1'
[2016-03-08 15:52:08,856: ERROR/MainProcess] Process 'Worker-6' pid:13120 exited with 'exitcode 1'
...

它无休止地,CPU上升到100% .

相关配置是:

CELERY_BROKER_URL = 'mongodb://localhost:27017/app'
CELERY_RESULT_BACKEND = 'mongodb://localhost:27017/'
CELERY_MONGODB_BACKEND_SETTINGS = {
    'database': 'app',
    'taskmeta_collection': 'my_taskmeta_collection',
}
CELERY_IMPORTS = ('app.tasks', )
CELERYD_FORCE_EXEC = True
CELERY_ACCEPT_CONTENT = ['json']
CELERY_TASK_SERIALIZER = 'json'
CELERY_RESULT_SERIALIZER = 'json'

我的项目结构是:

proj/
    config.py
    app/
        __init__.py
        tasks.py
        views.py

这就是我在___init___.py中配置芹菜的方式:

app = Flask(__name__)
app.config.from_object('config')
db = SQLAlchemy(app)


def make_celery(app):
    celery = Celery(app.import_name, broker=app.config['CELERY_BROKER_URL'])
    celery.conf.update(app.config)
    TaskBase = celery.Task

    class ContextTask(TaskBase):
        abstract = True

        def __call__(self, *args, **kwargs):
            with app.app_context():
                return TaskBase.__call__(self, *args, **kwargs)
    celery.Task = ContextTask
    return celery

celery = make_celery(app)

这就是我在 tasks.py

from app import celery


@celery.task()
def add_together(a, b):
    return a + b

update

当我从配置文件中删除以下行时,worker不会退出

CELERY_IMPORTS = ('app.tasks', )

但是我收到以下错误

Traceback (most recent call last):
  File "d:\python34\lib\site-packages\celery\worker\consumer.py", line 456, in on_task_received
    strategies[name](message, body,
KeyError: 'app.tasks.add_together'

1 回答

  • 1

    在Celery官方网站http://docs.celeryproject.org/en/3.1/getting-started/brokers/mongodb.html

    当使用mongoDB作为经纪人时,你自己承担风险 .

    使用MongoDB实验状态MongoDB传输需要在许多方面进行改进,并且有几个开放的错误 . 遗憾的是,我们没有足够的资源或资金来改善这种情况,因此我们正在寻找愿意提供帮助的贡献者和合作伙伴 .

    要测试这不是产生问题的原因,请尝试使用redis或rabbitMQ作为代理 .

相关问题