sphinx performance after idle -

-

i'm writing web application i'm using sphinx search around million documents.

the performance excellent, typical query taking 0.05 seconds, if no queries made few hours, takes longer - 1000x longer couple of queries, returns normal. query log looks this:

[wed mar  7 17:23:55.937 2012] 0.221 sec  [wed mar  7 17:32:00.726 2012] 0.012 sec  [wed mar  7 17:32:00.984 2012] 0.052 sec  [wed mar  7 17:32:01.416 2012] 0.222 sec  [thu mar  8 09:15:10.418 2012] 10.147 sec [thu mar  8 09:16:00.560 2012] 48.262 sec [thu mar  8 09:16:55.429 2012] 54.153 sec [thu mar  8 09:17:54.454 2012] 0.012 sec  [thu mar  8 09:17:54.713 2012] 0.052 sec  [thu mar  8 09:17:55.141 2012] 0.218 sec

i'm guessing maybe busy server swapping sphinx's memory when unused or something.

how can resolve this?

i considered scripting fake queries every minute seems quite ugly hack.

how fast disks on server?

i imagine due having go disk indexes. once accessed few times, os have cached files.

it might worth considering ssd disk. small ssd disk - big enough sphinxes indexs - relativly cheap nowadays.

if memory swapping, suggests have slow disks. address. can add more memory server? (or put swap partition on newly installed ssd disk :)

btw, find out if swapping happening munin (or cacti etc)


Comments

Post a Comment

Popular posts from this blog

jasper reports - Fixed header in Excel using JasperReports -

-
how can create excel report fixed header using japserreports? mean need header fixed when scroll excel file. this possible adding couple properties in jrxml file each report. take @ advanced excel features freeze panes. if wanted freeze after first column header (down left side basically) this: <statictext> <reportelement style="sans_bold" mode="opaque" x="0" y="60" width="104" height="20" forecolor="#ffffff" backcolor="#666666"> <property name="net.sf.jasperreports.export.xls.auto.filter" value="start"/> <property name="net.sf.jasperreports.export.xls.column.width" value="110"/> <property name="net.sf.jasperreports.export.xls.freeze.column.edge" value="left"/> </reportelement> &
Read more

python - ('The SQL contains 0 parameter markers, but 50 parameters were supplied', 'HY000') or TypeError: 'tuple' object is not callable -

-
import pyodbc,nltk,array cnxn = pyodbc.connect('driver={mysql odbc 5.1 driver};server=127.0.0.1;port=3306;database=information_schema;user=root; password=1234;option=3;') cursor = cnxn.cursor() cursor.execute("use collegedatabase ;") cursor.execute("select * sampledata ; ") cnxn.commit() s=[] j=[] x=[] words = [] w = [] sfq = [] pos=[] entry in cursor: s.append(entry.injury_type),j.append(entry.injury_desc) nltk.tokenize import punktwordtokenizer nltk.corpus import stopwords tokenizer = punktwordtokenizer() english_stops = set(stopwords.words('english')) in range(0,26): # filter stop words tokenizer.tokenize(j[i]) w.append([word word in tokenizer.tokenize(j[i]) if word not in english_stops]) in range(0 , 26):#converting tokenzied text ito string sfq.append(" ".join(w[a])) replacers import regexpreplacer replacer = regexpreplacer() in range (0,26):#pos tagging replacer.repl
Read more

delphi - How to convert bitmaps to video? -

-
Image
my application creates images fractals , love feeling of 'flying' around fractal. once saved 2000 bitmaps file , created avi using premiere. experience rather frustrating though succeeded in creating movie. spectacular. of course want create video application. don't care niftyness of codec, compression or whatever. want have video can replay on systems. in past have tried never succeeded. triggered question alas not ffmpeg running. update i decided adapt question , put bounty it. have seen several solutions attractive (because it's simple) seems me taviwrite. tried taviwriter did not succeed. in procedure taviwriter.write; function call around line 370 avierr := avisavev(s, // pchar(filename), nil, // file handler nil, // callback nstreams, // number of streams streams, compoptions); // compress options
Read more