django - How to restart Celery gracefully without delaying tasks -

-

we use celery our django webapp manage offline tasks; of these tasks can run 120 seconds.

whenever make code modifications, need restart celery have reload new python code. our current solution send sigterm main celery process (kill -s 15 `cat /var/run/celeryd.pid`), wait die , restart (python manage.py celeryd --pidfile=/var/run/celeryd.pid [...]).

because of long-running tasks, means shutdown take minute or two, during no new tasks processed, causing noticeable delay users on site. i'm looking way tell celery shutdown, launch new celery instance start running new tasks.

things didn't work:

  • sending sighup main process: caused celery attempt "restart," doing warm shutdown , relaunching itself. not take long time, doesn't work, because apparently new process launches before old 1 dies, new 1 complains error: pidfile (/var/run/celeryd.pid) exists. seems we're running? (pid: 13214) , dies immediately. (this looks bug in celery itself; i've let them know it.)
  • sending sigterm main process , launching new instance: same issue pidfile.
  • disabling pidfile entirely: without it, have no way of telling of 30 celery process main process needs sent sigterm when want warm shutdown. have no reliable way check if main process still alive.

celeryd has --autoreload option. if enabled, celery worker (main process) detect changes in celery modules , restart worker processes. in contrast sighup signal, autoreload restarts each process independently when current executing task finishes. means while 1 worker process restarting remaining processes can execute tasks.

http://celery.readthedocs.org/en/latest/userguide/workers.html#autoreloading


Comments

Post a Comment

Popular posts from this blog

jasper reports - Fixed header in Excel using JasperReports -

-
how can create excel report fixed header using japserreports? mean need header fixed when scroll excel file. this possible adding couple properties in jrxml file each report. take @ advanced excel features freeze panes. if wanted freeze after first column header (down left side basically) this: <statictext> <reportelement style="sans_bold" mode="opaque" x="0" y="60" width="104" height="20" forecolor="#ffffff" backcolor="#666666"> <property name="net.sf.jasperreports.export.xls.auto.filter" value="start"/> <property name="net.sf.jasperreports.export.xls.column.width" value="110"/> <property name="net.sf.jasperreports.export.xls.freeze.column.edge" value="left"/> </reportelement> &
Read more

media player - Android: mediaplayer went away with unhandled events -

-
i need duration of audio file series of voice announcements need play app. have added audio files resources , play fine. sample code below works perfect intended purpose: return duration of audio files. here code: float getdurationofaudioresource(locationenum loc, context context){ float duration = 0; try { mediaplayer mp; mp = mediaplayer.create(context, getaudioresource(loc)); duration = mp.getduration(); mp.release(); mp = null; } catch (illegalstateexception e) {e.printstacktrace(); logerror(25, "testdescitem:fault::could not open mediaplayer object audio resource.");} return duration; } here's weird thing. code called in main activity prepares set of audio instructions given test. there no errors within activity. second activity called, long string of errors on logcat. 03-07 13:23:43.820: i/actionlogger(21435): gentest_info_test #0 created. 03-07 13:23:43.830: i/actionlogger(21435): gente
Read more

python - ('The SQL contains 0 parameter markers, but 50 parameters were supplied', 'HY000') or TypeError: 'tuple' object is not callable -

-
import pyodbc,nltk,array cnxn = pyodbc.connect('driver={mysql odbc 5.1 driver};server=127.0.0.1;port=3306;database=information_schema;user=root; password=1234;option=3;') cursor = cnxn.cursor() cursor.execute("use collegedatabase ;") cursor.execute("select * sampledata ; ") cnxn.commit() s=[] j=[] x=[] words = [] w = [] sfq = [] pos=[] entry in cursor: s.append(entry.injury_type),j.append(entry.injury_desc) nltk.tokenize import punktwordtokenizer nltk.corpus import stopwords tokenizer = punktwordtokenizer() english_stops = set(stopwords.words('english')) in range(0,26): # filter stop words tokenizer.tokenize(j[i]) w.append([word word in tokenizer.tokenize(j[i]) if word not in english_stops]) in range(0 , 26):#converting tokenzied text ito string sfq.append(" ".join(w[a])) replacers import regexpreplacer replacer = regexpreplacer() in range (0,26):#pos tagging replacer.repl
Read more