dataimporthandler - Solr loading information without data import handler -

-

i have 700.000 street names, 8111 municipality names, , 80333 locality postcodes. index information in solr. user wants search information through ajax autocomplete form. have proved few data , behavoir of ajax autocomplete form it's ok. 

 <fieldtype name="text" class="solr.textfield" positionincrementgap="100">   <analyzer type="index">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.stopfilterfactory"             ignorecase="true"             words="stopwords.txt"             enablepositionincrements="true"             />     <filter class="solr.worddelimiterfilterfactory" generatewordparts="1" generatenumberparts="1" catenatewords="1" catenatenumbers="1" catenateall="0" splitoncasechange="1"/>     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.snowballporterfilterfactory" language="english" protected="protwords.txt"/>   </analyzer>   <analyzer type="query">     <tokenizer class="solr.whitespacetokenizerfactory"/>     <filter class="solr.synonymfilterfactory" synonyms="synonyms.txt" ignorecase="true" expand="true"/>     <filter class="solr.stopfilterfactory"             ignorecase="true"             words="stopwords.txt"             enablepositionincrements="true"             />     <filter class="solr.worddelimiterfilterfactory" generatewordparts="1" generatenumberparts="1" catenatewords="0" catenatenumbers="0" catenateall="0" splitoncasechange="1"/>     <filter class="solr.lowercasefilterfactory"/>     <filter class="solr.snowballporterfilterfactory" language="english" protected="protwords.txt"/>   </analyzer> </fieldtype>

the problem happens when loading data solr

  • how should load information solr server (i'm in grails app , need load instances have information without data input handler) today have been many hours today , grails console crashed :( --> should use grails script instead of doing service , executing grails console??
  • or should use data input handler load faster?? can concat string values diferent columns of different tables data input handler??

(it's okay have different document each 1 (700.000 + 8111 + 80.333 documents) ??)

thanks time

i assume municipalities, street names, , post codes supposed autocompleted separately. in case you'd use separate solr core each one.

or should use data input handler load faster??

dih pretty fast, , long information doesn't change often, should fine way.

can concat string values diferent columns of different tables data input handler??

yes; in data-config.xml give specific sql query , can use database's native concatenation (e.g. || in oracle).


Comments

Post a Comment

Popular posts from this blog

delphi - How to convert bitmaps to video? -

-
Image
my application creates images fractals , love feeling of 'flying' around fractal. once saved 2000 bitmaps file , created avi using premiere. experience rather frustrating though succeeded in creating movie. spectacular. of course want create video application. don't care niftyness of codec, compression or whatever. want have video can replay on systems. in past have tried never succeeded. triggered question alas not ffmpeg running. update i decided adapt question , put bounty it. have seen several solutions attractive (because it's simple) seems me taviwrite. tried taviwriter did not succeed. in procedure taviwriter.write; function call around line 370 avierr := avisavev(s, // pchar(filename), nil, // file handler nil, // callback nstreams, // number of streams streams, compoptions); // compress options
Read more

jasper reports - Fixed header in Excel using JasperReports -

-
how can create excel report fixed header using japserreports? mean need header fixed when scroll excel file. this possible adding couple properties in jrxml file each report. take @ advanced excel features freeze panes. if wanted freeze after first column header (down left side basically) this: <statictext> <reportelement style="sans_bold" mode="opaque" x="0" y="60" width="104" height="20" forecolor="#ffffff" backcolor="#666666"> <property name="net.sf.jasperreports.export.xls.auto.filter" value="start"/> <property name="net.sf.jasperreports.export.xls.column.width" value="110"/> <property name="net.sf.jasperreports.export.xls.freeze.column.edge" value="left"/> </reportelement> &
Read more

python - ('The SQL contains 0 parameter markers, but 50 parameters were supplied', 'HY000') or TypeError: 'tuple' object is not callable -

-
import pyodbc,nltk,array cnxn = pyodbc.connect('driver={mysql odbc 5.1 driver};server=127.0.0.1;port=3306;database=information_schema;user=root; password=1234;option=3;') cursor = cnxn.cursor() cursor.execute("use collegedatabase ;") cursor.execute("select * sampledata ; ") cnxn.commit() s=[] j=[] x=[] words = [] w = [] sfq = [] pos=[] entry in cursor: s.append(entry.injury_type),j.append(entry.injury_desc) nltk.tokenize import punktwordtokenizer nltk.corpus import stopwords tokenizer = punktwordtokenizer() english_stops = set(stopwords.words('english')) in range(0,26): # filter stop words tokenizer.tokenize(j[i]) w.append([word word in tokenizer.tokenize(j[i]) if word not in english_stops]) in range(0 , 26):#converting tokenzied text ito string sfq.append(" ".join(w[a])) replacers import regexpreplacer replacer = regexpreplacer() in range (0,26):#pos tagging replacer.repl
Read more