sphinx performance after idle -

-

i'm writing web application i'm using sphinx search around million documents.

the performance excellent, typical query taking 0.05 seconds, if no queries made few hours, takes longer - 1000x longer couple of queries, returns normal. query log looks this:

[wed mar  7 17:23:55.937 2012] 0.221 sec  [wed mar  7 17:32:00.726 2012] 0.012 sec  [wed mar  7 17:32:00.984 2012] 0.052 sec  [wed mar  7 17:32:01.416 2012] 0.222 sec  [thu mar  8 09:15:10.418 2012] 10.147 sec [thu mar  8 09:16:00.560 2012] 48.262 sec [thu mar  8 09:16:55.429 2012] 54.153 sec [thu mar  8 09:17:54.454 2012] 0.012 sec  [thu mar  8 09:17:54.713 2012] 0.052 sec  [thu mar  8 09:17:55.141 2012] 0.218 sec

i'm guessing maybe busy server swapping sphinx's memory when unused or something.

how can resolve this?

i considered scripting fake queries every minute seems quite ugly hack.

how fast disks on server?

i imagine due having go disk indexes. once accessed few times, os have cached files.

it might worth considering ssd disk. small ssd disk - big enough sphinxes indexs - relativly cheap nowadays.

if memory swapping, suggests have slow disks. address. can add more memory server? (or put swap partition on newly installed ssd disk :)

btw, find out if swapping happening munin (or cacti etc)


Comments

Post a Comment

Popular posts from this blog

jasper reports - Fixed header in Excel using JasperReports -

-
how can create excel report fixed header using japserreports? mean need header fixed when scroll excel file. this possible adding couple properties in jrxml file each report. take @ advanced excel features freeze panes. if wanted freeze after first column header (down left side basically) this: <statictext> <reportelement style="sans_bold" mode="opaque" x="0" y="60" width="104" height="20" forecolor="#ffffff" backcolor="#666666"> <property name="net.sf.jasperreports.export.xls.auto.filter" value="start"/> <property name="net.sf.jasperreports.export.xls.column.width" value="110"/> <property name="net.sf.jasperreports.export.xls.freeze.column.edge" value="left"/> </reportelement> &
Read more

media player - Android: mediaplayer went away with unhandled events -

-
i need duration of audio file series of voice announcements need play app. have added audio files resources , play fine. sample code below works perfect intended purpose: return duration of audio files. here code: float getdurationofaudioresource(locationenum loc, context context){ float duration = 0; try { mediaplayer mp; mp = mediaplayer.create(context, getaudioresource(loc)); duration = mp.getduration(); mp.release(); mp = null; } catch (illegalstateexception e) {e.printstacktrace(); logerror(25, "testdescitem:fault::could not open mediaplayer object audio resource.");} return duration; } here's weird thing. code called in main activity prepares set of audio instructions given test. there no errors within activity. second activity called, long string of errors on logcat. 03-07 13:23:43.820: i/actionlogger(21435): gentest_info_test #0 created. 03-07 13:23:43.830: i/actionlogger(21435): gente
Read more

python - ('The SQL contains 0 parameter markers, but 50 parameters were supplied', 'HY000') or TypeError: 'tuple' object is not callable -

-
import pyodbc,nltk,array cnxn = pyodbc.connect('driver={mysql odbc 5.1 driver};server=127.0.0.1;port=3306;database=information_schema;user=root; password=1234;option=3;') cursor = cnxn.cursor() cursor.execute("use collegedatabase ;") cursor.execute("select * sampledata ; ") cnxn.commit() s=[] j=[] x=[] words = [] w = [] sfq = [] pos=[] entry in cursor: s.append(entry.injury_type),j.append(entry.injury_desc) nltk.tokenize import punktwordtokenizer nltk.corpus import stopwords tokenizer = punktwordtokenizer() english_stops = set(stopwords.words('english')) in range(0,26): # filter stop words tokenizer.tokenize(j[i]) w.append([word word in tokenizer.tokenize(j[i]) if word not in english_stops]) in range(0 , 26):#converting tokenzied text ito string sfq.append(" ".join(w[a])) replacers import regexpreplacer replacer = regexpreplacer() in range (0,26):#pos tagging replacer.repl
Read more