Skip to content Skip to sidebar Skip to footer
Showing posts with the label Celery

Celery: Is There A Way To Write Custom Json Encoder/decoder?

I have some objects I want to send to celery tasks on my application. Those objects are obviously n… Read more Celery: Is There A Way To Write Custom Json Encoder/decoder?

Celery Expires - Rise Exception

In docs link about expires # Task expires after one minute from now. add.apply_async(args=[10, 10],… Read more Celery Expires - Rise Exception

Initializing Different Celery Workers With Different Values

I am using celery to run long running tasks on Hadoop. Each task executes a Pig script on Hadoop wh… Read more Initializing Different Celery Workers With Different Values

How To Structure Celery Tasks

I have 2 types of task: async tasks and schedule tasks. So, here is my dir structure: proj | --… Read more How To Structure Celery Tasks

How To Get All Tasks And Periodic Tasks In Celery

Possible Duplicate: How can I find all subclasses of a given class in Python? In my Django projec… Read more How To Get All Tasks And Periodic Tasks In Celery

Python Celery - Get() Is Delayed

I am running the following simple example. Submit 20 jobs that take 2 seconds each using a single w… Read more Python Celery - Get() Is Delayed

How To Configure And Run Celerybeat

I am just getting started with celery,trying to run a periodic task. Configured *rabbitmq** added c… Read more How To Configure And Run Celerybeat

How To Configure Celerybeat_schedule In Django Settings?

I can get this to run as a standalone application, but I am having trouble getting it to work in Dj… Read more How To Configure Celerybeat_schedule In Django Settings?

Task Priority In Celery With Redis

I would like to implement a distributed job execution system with celery. Given that rabbitMQ doesn… Read more Task Priority In Celery With Redis

Celery Not Using All Concurrent Slots

I have a Celery cluster made up of machines with 8-core processors. Each machine has one worker th… Read more Celery Not Using All Concurrent Slots

Celery Heartbeat Not Working

I have set heartbeat in Celery settings: BROKER_HEARTBEAT = 10 I have also set this configuration … Read more Celery Heartbeat Not Working

Django-celery Infrastructure Over Multiple Servers, Broker Is Redis

Currently we have everything setup on single cloud server, that includes: Database server Apache C… Read more Django-celery Infrastructure Over Multiple Servers, Broker Is Redis

Why Does Celery Retry, But My Job Did Not Fail?

I have a celery job to run MySQL databases, however, it always got Lock Wait Timeout. After digging… Read more Why Does Celery Retry, But My Job Did Not Fail?

Celery Get List Of Registered Tasks

Is there a way to get a list of registered tasks? I tried: celery_app.tasks.keys() Which only retu… Read more Celery Get List Of Registered Tasks

Does The Number Of Celeryd Processes Depend On The --concurrency Setting?

We are running Celery behind Supervisor and start it with celeryd --events --loglevel=INFO --concur… Read more Does The Number Of Celeryd Processes Depend On The --concurrency Setting?

Celery Tasks Doesn't Works

Celery docs say that Celery 3.1 can work with django out of box. But tasks not working. I have task… Read more Celery Tasks Doesn't Works

How To Pause Or Resume Celery Task?

I am having a requirement in my project where customer can pause or resume process which are pendin… Read more How To Pause Or Resume Celery Task?

How To Run Airflow With Celeryexecutor On A Custom Docker Image

I am adding airflow to a web application that manually adds a directory containing business logic t… Read more How To Run Airflow With Celeryexecutor On A Custom Docker Image

Oserror: Dlopen(libsystem.dylib, 6): Image Not Found

Just updated my Mac to El Capitan 10.11. I am trying to run Django 1.6 with Celery 3.1 and I'm… Read more Oserror: Dlopen(libsystem.dylib, 6): Image Not Found

How To Daemonize Django Celery Periodic Task On Ubuntu Server?

On localhost, i used these statements to execute tasks and workers. Run tasks: python manage.py cel… Read more How To Daemonize Django Celery Periodic Task On Ubuntu Server?