dataimporthandler - Solr loading information without data import handler -

-

i have 700.000 street names, 8111 municipality names, , 80333 locality postcodes. index information in solr. user wants search information through ajax autocomplete form. have proved few data , behavoir of ajax autocomplete form it's ok. 

 <fieldtype name="text" class="solr.textfield" positionincrementgap="100">   <analyzer type="index">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.stopfilterfactory"             ignorecase="true"             words="stopwords.txt"             enablepositionincrements="true"             />     <filter class="solr.worddelimiterfilterfactory" generatewordparts="1" generatenumberparts="1" catenatewords="1" catenatenumbers="1" catenateall="0" splitoncasechange="1"/>     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.snowballporterfilterfactory" language="english" protected="protwords.txt"/>   </analyzer>   <analyzer type="query">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.synonymfilterfactory" synonyms="synonyms.txt" ignorecase="true" expand="true"/>     <filter class="solr.stopfilterfactory"             ignorecase="true"             words="stopwords.txt"             enablepositionincrements="true"             />     <filter class="solr.worddelimiterfilterfactory" generatewordparts="1" generatenumberparts="1" catenatewords="0" catenatenumbers="0" catenateall="0" splitoncasechange="1"/>     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.snowballporterfilterfactory" language="english" protected="protwords.txt"/>   </analyzer> </fieldtype>

the problem happens when loading data solr

  • how should load information solr server (i'm in grails app , need load instances have information without data input handler) today have been many hours today , grails console crashed :( --> should use grails script instead of doing service , executing grails console??
  • or should use data input handler load faster?? can concat string values diferent columns of different tables data input handler??

(it's okay have different document each 1 (700.000 + 8111 + 80.333 documents) ??)

thanks time

i assume municipalities, street names, , post codes supposed autocompleted separately. in case you'd use separate solr core each one.

or should use data input handler load faster??

dih pretty fast, , long information doesn't change often, should fine way.

can concat string values diferent columns of different tables data input handler??

yes; in data-config.xml give specific sql query , can use database's native concatenation (e.g. || in oracle).


Comments

Post a Comment

Popular posts from this blog

jasper reports - Fixed header in Excel using JasperReports -

-
how can create excel report fixed header using japserreports? mean need header fixed when scroll excel file. this possible adding couple properties in jrxml file each report. take @ advanced excel features freeze panes. if wanted freeze after first column header (down left side basically) this: <statictext> <reportelement style="sans_bold" mode="opaque" x="0" y="60" width="104" height="20" forecolor="#ffffff" backcolor="#666666"> <property name="net.sf.jasperreports.export.xls.auto.filter" value="start"/> <property name="net.sf.jasperreports.export.xls.column.width" value="110"/> <property name="net.sf.jasperreports.export.xls.freeze.column.edge" value="left"/> </reportelement> &
Read more

media player - Android: mediaplayer went away with unhandled events -

-
i need duration of audio file series of voice announcements need play app. have added audio files resources , play fine. sample code below works perfect intended purpose: return duration of audio files. here code: float getdurationofaudioresource(locationenum loc, context context){ float duration = 0; try { mediaplayer mp; mp = mediaplayer.create(context, getaudioresource(loc)); duration = mp.getduration(); mp.release(); mp = null; } catch (illegalstateexception e) {e.printstacktrace(); logerror(25, "testdescitem:fault::could not open mediaplayer object audio resource.");} return duration; } here's weird thing. code called in main activity prepares set of audio instructions given test. there no errors within activity. second activity called, long string of errors on logcat. 03-07 13:23:43.820: i/actionlogger(21435): gentest_info_test #0 created. 03-07 13:23:43.830: i/actionlogger(21435): gente
Read more

python - ('The SQL contains 0 parameter markers, but 50 parameters were supplied', 'HY000') or TypeError: 'tuple' object is not callable -

-
import pyodbc,nltk,array cnxn = pyodbc.connect('driver={mysql odbc 5.1 driver};server=127.0.0.1;port=3306;database=information_schema;user=root; password=1234;option=3;') cursor = cnxn.cursor() cursor.execute("use collegedatabase ;") cursor.execute("select * sampledata ; ") cnxn.commit() s=[] j=[] x=[] words = [] w = [] sfq = [] pos=[] entry in cursor: s.append(entry.injury_type),j.append(entry.injury_desc) nltk.tokenize import punktwordtokenizer nltk.corpus import stopwords tokenizer = punktwordtokenizer() english_stops = set(stopwords.words('english')) in range(0,26): # filter stop words tokenizer.tokenize(j[i]) w.append([word word in tokenizer.tokenize(j[i]) if word not in english_stops]) in range(0 , 26):#converting tokenzied text ito string sfq.append(" ".join(w[a])) replacers import regexpreplacer replacer = regexpreplacer() in range (0,26):#pos tagging replacer.repl
Read more