deployment - Which is the most elegant way to start celeryd in a Django project? -

-

i'm starting out celery in django project , couldn't wonder: elegant way start start celery's workers project?

let me explain reasoning question.

currently, recommended way start celery seems python manage.py celeryd in simpler setups , along lines of /etc/init.d/celeryd start in more complex ones. however, in first case, process feels fragile since process wouldn't start automatically, while second require quite bit of project-specific configuration (virtualenv, settings etc.) latter demonstrates general feeling celery worker tied codebase it's part of , it's tied main project process, since celery worker without create tasks in practially useless (with 1 exception being celerybeat). problem init.d scripts they'd need advanced logic handling several projects per server (with separate virtual environments, settings, paths etc.)

so figured, might quite elegant configuration-wise start celeryd main process, e.g. spawn mod_wsgi withing apache (similar other setup options) , kill when main process goes down (/etc/init.d/apache2 stop). however, i'm not quite sure whether there technical traps considering performance and/or security in reasoning -- might case since i've tried googling , found virtually nothing.

  1. is reasoning flawed considering celery architecture?
  2. can somehow spawn celeryd somewhere within mod_wsgi , sensible?
  3. how start celery workers in projects?

i start celery using manage.py celeryd , managing supervisor. on each deployment modifies task restart celery after i've deployed , restarted apache.\

edit:

we use chef manage our configurations supervisor , other processes, might bit on kill. have 1 master supervisord.conf includes separate configuration file each site run. 1 of might this:

[program:celery_newproject] command = /srv/www/.virtualenvs/newprojectenv/bin/python /srv/www/projects/newproject/manage.py celeryd --concurrency=2 --settings=settings.alpha --pidfile=/var/run/celery/celery_newproject.pid user = wsgiuser environment = python_egg_cache="/tmp/.python-eggs"

on deploy run

sudo supervisorctl restart celery_newproject

this restarts supervisor process celery , picks new tasks you've defined.

there other non elegant ways well. on personal sites have cron job running checks existence of .pid file , restarts celery if doens't exist. not elegant @ all, works low reliability sites.


Comments

Post a Comment

Popular posts from this blog

jasper reports - Fixed header in Excel using JasperReports -

-
how can create excel report fixed header using japserreports? mean need header fixed when scroll excel file. this possible adding couple properties in jrxml file each report. take @ advanced excel features freeze panes. if wanted freeze after first column header (down left side basically) this: <statictext> <reportelement style="sans_bold" mode="opaque" x="0" y="60" width="104" height="20" forecolor="#ffffff" backcolor="#666666"> <property name="net.sf.jasperreports.export.xls.auto.filter" value="start"/> <property name="net.sf.jasperreports.export.xls.column.width" value="110"/> <property name="net.sf.jasperreports.export.xls.freeze.column.edge" value="left"/> </reportelement> &
Read more

media player - Android: mediaplayer went away with unhandled events -

-
i need duration of audio file series of voice announcements need play app. have added audio files resources , play fine. sample code below works perfect intended purpose: return duration of audio files. here code: float getdurationofaudioresource(locationenum loc, context context){ float duration = 0; try { mediaplayer mp; mp = mediaplayer.create(context, getaudioresource(loc)); duration = mp.getduration(); mp.release(); mp = null; } catch (illegalstateexception e) {e.printstacktrace(); logerror(25, "testdescitem:fault::could not open mediaplayer object audio resource.");} return duration; } here's weird thing. code called in main activity prepares set of audio instructions given test. there no errors within activity. second activity called, long string of errors on logcat. 03-07 13:23:43.820: i/actionlogger(21435): gentest_info_test #0 created. 03-07 13:23:43.830: i/actionlogger(21435): gente
Read more

python - ('The SQL contains 0 parameter markers, but 50 parameters were supplied', 'HY000') or TypeError: 'tuple' object is not callable -

-
import pyodbc,nltk,array cnxn = pyodbc.connect('driver={mysql odbc 5.1 driver};server=127.0.0.1;port=3306;database=information_schema;user=root; password=1234;option=3;') cursor = cnxn.cursor() cursor.execute("use collegedatabase ;") cursor.execute("select * sampledata ; ") cnxn.commit() s=[] j=[] x=[] words = [] w = [] sfq = [] pos=[] entry in cursor: s.append(entry.injury_type),j.append(entry.injury_desc) nltk.tokenize import punktwordtokenizer nltk.corpus import stopwords tokenizer = punktwordtokenizer() english_stops = set(stopwords.words('english')) in range(0,26): # filter stop words tokenizer.tokenize(j[i]) w.append([word word in tokenizer.tokenize(j[i]) if word not in english_stops]) in range(0 , 26):#converting tokenzied text ito string sfq.append(" ".join(w[a])) replacers import regexpreplacer replacer = regexpreplacer() in range (0,26):#pos tagging replacer.repl
Read more