CF9 - Feeding data from a NUTCH 1.3 crawl to the included SOLR

Has anybody setup Nutch 1.3 for crawling and successfully pushed that data into the coldfusion provided SOLR server?
I got the nutch crawl to generate data ok, but the 'solrindex' run of nutch fails like this:
org.apache.solr.common.SolrException: ERRORunknown_field_content
ERRORunknown_field_content
request: http://127.0.0.1:8983/solr/nerf/update?wt=javabin&version=2
at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.jav a:436)
at org.apache.solr.client.solrj.impl.CommonsHttpSolrServer.request(CommonsHttpSolrServer.jav a:245)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest. java:105)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:49)
at org.apache.nutch.indexer.solr.SolrWriter.close(SolrWriter.java:82)
at org.apache.nutch.indexer.IndexerOutputFormat$1.close(IndexerOutputFormat.java:48)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:474)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
2011-06-28 15:20:52,386 ERROR solr.SolrIndexer - java.io.IOException: Job failed!
I've tried using the schema.xml that comes with nutch in place of the CF povided one, as well as merging the two, but I'm still hitting the same error.
Alternatively would it work better to set up solr on it's own and not use the one provided by CF? Can the CF admin still work with an external SOLR install?

Hi Gersh and Nilanjan,
I did a test in a few minutes, I changed the code on default logic from this:
*XDIM_MEMBERSET CONTA = 3
*WHEN CONTA
*IS "3"
*REC(FACTOR=1,CONTA="PC012503030002")
*ENDWHEN
*COMMIT
to this:
*XDIM_MEMBERSET CONTA = PC013000000001
*WHEN CONTA
*IS "PC013000000001"
*REC(FACTOR=1,CONTA="PC012503030002")
*ENDWHEN
*COMMIT
And I load again the data, the default logic copy the value from PC013000000001 to PC012503030002, that is a good news for me, but with this I concluded, the script don't get value from parent, so is there a way to put a range of account on code ?
Best Regards
Alexandre Mendoza Collepicolo
Edited by: Alexandre Mendoza Collepicolo on Sep 23, 2010 2:27 PM

Similar Messages

How to Load the data from excel file(Extension is .CSV) into the temp.table

Hi
How to Load the data from excel file(Extension is .CSV) into the temporary table of oracle in Forms11g.
My Forms Version is - Forms [64 Bit] Version 11.1.2.0.0 (Production)
Kindly Suggest the Solution.
Regards,
Sachin

Hello Sachin,
You can use the following metalink note:How to Read Data from an EXCEL Spreadsheet into a Form Using Webutil Client_OLE2 (Doc ID 813535.1) and modify it a little bit.
Instead of copy values into forms you can save them in your temporary table.
Kind regards,
Alex
If someone's helpful or correct please mark it accordingly.

Can I retrieve data from my iPhone 4 hard drive without the SIM card?

Can I retreive data from my iPhone 4 hard drive without the sim?

There is no hard drive in an iPhone, it is all solid state memory. If the phone is working you can always copy content from it. If it is not you will need to restore and activate it, and that requires a SIM card.

How to load the data from informatica into bw & how to report the data

Hi friends,
how to load the data from informatica into bw & how to report the data
using cognos.(i.e how to access the data in sap bw using cognos 8 BI suite).
Thanks,
madhu.

Inorder to report BW data into Cognos you can extract data from using Open Hub to the DB table from which Cognos reads.
For BW informatic integration refer following docs:
http://www.aman.co.il/aman/pfd/DataInteg_BR.q103cd.pdf.pdf
http://h71028.www7.hp.com/enterprise/cache/3889-0-0-225-121.html
http://devnet.informatica.com/learning/ePresentations.asp
http://72.14.203.104/search?q=cache:C741L86Q19oJ:devnet.informatica.com/showcase/resources/Essbase_DataSheet.pdfinformaticapowerconnect(BI)&hl=en&gl=in&ct=clnk&cd=3
http://www.informatica.com/customers/utilities_energy/fpl_group.htm
http://www.informatica.com/solutions/resource_center/technote_sapbw_65241004.pdf#search=%22Informatica%20to%20Bw%22

When target DB is down in which table is the data from source is stored, also where are the error messages stored in ODI

When target DB is down in which table is the data from source is stored, also where are the error messages stored in ODI( I am not getting any error message in E$_TARGET_ANI_TEST).
When i am running the interface i am getting the below error against the errored step
"ORA-01045: user ABC lacks CREATE SESSION privilege; logon denied."
Only E$_TARGET_ANI_TEST is created with no data. No such tables like C$_0TARGET_ANI_TEST, I$_TARGET_ANI_TEST are created and also data is not inserted in the target table TARGET_ANI_TEST.

Hi,
I have checked that only E$ table is created. C$ and I$ table are not created ( I have selected my target schema as the part for the staging table).
All the parameters for dropping the tables are selected as "<default>:false".
I am importing the following KMs with the following parameters:
1) CKM Oracle
DROP_ERROR_TABLE
:false
DROP_CHECK_TABLE
:false
CREATE_ERROR_INDEX
:true
COMPATIBLE
:9
VALIDATE
:false
ENABLE_EDITION_SUPPORT
:false
UPGRADE_ERROR_TABLE
:false
2) LKM SQL to SQL
DELETE_TEMPORARY_OBJECTS
:true
3) IKM SQL Incremental Update
INSERT
:true
UPDATE
:true
COMMIT
:true
SYNC_JRN_DELETE
:true
FLOW_CONTROL
:true
RECYCLE_ERRORS
:false
STATIC_CONTROL
:false
TRUNCATE
:false
DELETE_ALL
:false
CREATE_TARG_TABLE
:false
DELETE_TEMPORARY_OBJECTS
:true

When we synch data from AD to FIM Portal 2010 r2 the data is not updates in FIM Portal.

Hi,
When we synch data from AD to FIM Portal 2010 r2 the data is not updates in FIM Portal.
Active directory attribute co have value vietnam but in FIM Portal country attribute have value VIET NAM
we simply mapped AD Attribite to FIM Attribute for inbound
co===>country
why this happen
Regards
Anil Kumar

Anil, please check what do you have in metaverse. It seems that you have attribute flow precedence configured in a way that doesn't export to FIM Portal.
Let's say you have flows like:
(AD MA)
Import flow: (AD) description -> (metaverse) description
(FIM MA)
Import flow (FIM) description -> (metaverse) description
Export flow (FIM) description <- (metaverse) description
And you have higher precedence from FIM. Then, you would never have FIM value updated - even if value in AD changes. It would be exported to FIM only when you don't have this attribute filled in FIM.
If you found my post helpful, please give it a Helpful vote. If it answered your question, remember to mark it as an Answer.

My phone is water damaged and i bought new iphone 5S can i restored the data from my previous phone cloud backup to the new one

my phone is dead due to water damaged and i bought new iphone 5S. can i restore the data from my previous phone cloud backup to the new one?

how? i can see the backup from the phone cloud setting but there is nothing to click to restored. the one ive got now is since last year

Acquiring data from daq-pad and saving video at the same time

I am trying to record data from my daq-pad at 100 samples per second. At the same time I am using a usb interfaced camera to record a video feed. The idea is that when i begin recording data i also begin recording the video feed.
The way I record the video feed works fine in its own VI (I need it to record at 30fps and it does this just fine). But when I integrate it with the data record/capture VI the framing rate slows down to only 10 fps. I suspect this is because the VI gets caught capturing the data from the daq-pad thus slowing down its ability to record the video feed. I was hoping you could give me some help with how to record the data at 100 samples per second and get the VI to capture 30 frames per second. Thanks in advance for anyone who helps out.
I've attached the VI that has both the data capture and the video capture already integrated.
Attachments:
usa_swimming with video21.vi ‏892 KB

Hi,
I took a look at your code and the problem is that you have both the data acquistion and the image acquistion in the same loop. Have you tried using parellel loops? There is more information about this in the labview tutorials that are available online if you are unsure how to do that. The problem is that you are doing a lot of things in that loop (acquiring data, doing some analysis, and writing to file), so you can't acquire images very fast because it depends on the speed of the loop iteration. I hope this helps.
Have a great day,
GG

Delete data from DSO only with a part of the key

Hi experts,
I have a DSO with 9 key fields and i want to delete some entrys. Our source system only provides 2 fields of the key. My problem is, that the BI is not able to delete from DSO unless I have the full key.
Now I want to get the rest of the key fields from the active table of the DSO. Can sombody help me please with the ABAP Code? Or is there another possibility?
I already found this thred in SDN but this is for BW 3.5:
Delete data from ODS with only part of the key
Thanks
Ralf

Ralf,
the thread pointed out by you is for passing deletion entries to the DSO / target using the deletion entries .. namely recordmode = D.
Are you looking at deleting data from the DSO as a one time activity or you want to handle the same using a start / end routine ...? and pass deletion entries to other data targets which get the data from this DSO ?
Arun

I was given a 2010 17" MacBook Pro. I want to reset it to new and then migrate only SOME of my data from my older Mac Book Pro to the newer one. How?

A friend gave me a 17" MacBook Pro used for only one project. (Lucky me) I want to reset/register the laptop as new and need to know how to do that.
THEN...
I need to migrate data from my older Macbook Pro to the newer one. I don't want to migrate all of the data. I have been moving data from one computer to another for 15 years and want to move only what is current and what I now need (Good-bye Quark files)--can I do that? How? Also, the older laptop is running Lion. The "new" one is running Leopard. Is that an issue? Do I need to upgrade the newer laptop to Lion first?
Thanks.

Install or Reinstall Lion from Scratch
If possible backup your files to an external drive or second internal drive.
Boot to the Recovery HD:
Restart the computer and after the chime press and hold down the COMMAND and R keys until the menu screen appears. Alternatively, restart the computer and after the chime press and hold down the OPTION key until the boot manager screen appears. Select the Recovery HD and click on the downward pointing arrow button.
Erase the hard drive:
Select Disk Utility from the main menu and click on the Continue button.
After DU loads select your hard drive (this is the entry with the mfgr.'s ID and size) from the left side list. Note the SMART status of the drive in DU's status area. If it does not say "Verified" then the drive is failing or has failed and will need replacing. SMART info will not be reported on external drives. Otherwise, click on the Erase tab in the DU main window.
Set the format type to Mac OS Extended (Journaled.) Click on the Erase button and wait until the process has completed.
Quit DU and return to the main menu.
Reinstall Lion: Select Reinstall Lion and click on the Install button.
Note: You can also re-download the Lion installer by opening the App Store application. Hold down the OPTION key and click on the Purchases icon in the toolbar. You should now see an active Install button to the right of your Lion purchase entry. There are situations in which this will not work. For example, if you are already booted into the Lion you originally purchased with your Apple ID or if an instance of the Lion installer is located anywhere on your computer.
Unfortunately, Setup Assistant or Migration Assistant are set up to migrate your entire Home folder, third-party applcations and support files, and system preferences. If you use the Setup Assistant that opens the first time you boot Lion after installing, then you should migrate your Home folder, etc. This is the easiest way to do it.
Once migration is finished you can delete what you don't want.

Reading the data from 2 files and writing it into the 3rd file?

Hi,
I am reading datas from 2 files Say,
Example1.txt Example2.txt
Ashok ^data1^data2^data3
Babu ^data1^data2^data3
Chenthil ^data1^data2^data3
Danny ^data1^data2^data3
I want those data's to be written in a 3rd file. Say,
Example3.txt
Ashok^ data1^data2^data3
Babu^ data1^data2^data3
Chenthil^ data1^data2^data3
Danny^ data1^data2^data3
So that i can tokenize it with a delimeter(^) and get the values. Here how to append the datas in this form in Example3.txt. Eventhough u use FileWriter with append "true" as a parameter how they will apend like the Example3.txt file? Please do provide an answer for this..Since this is very urgent to be delivered...Expecting postive response.
Thanx,
JavaCrazyLover

import java.io.*;
import java.util.*;
public class en
public static void main(String args[]) throws IOException
{int data,data1,offset,offset1;
          FileOutputStream fos1=new FileOutputStream("c:/example3.txt");
          FileInputStream fis=new FileInputStream("c:/example1.txt");
          FileInputStream fis1=new FileInputStream("c:/example2.txt");
while((data=fis.read())!=-1)
     fos1.write(data);
while((data=fis1.read())!=-1)
fos1.write(data);
fis.close();
fis1.close();
fos1.close();
}first create those 3 files in c:

Fetching data from a table and displaying it on the text box

Hi,
I have created a dialog program in which created a container(text box) to enter data upto 1000 characters.
Iam capturing the data and storing it in a custom table. In PBO I want to fetch data from my custom table (if data is already present :1000 characters data) and display it on screen.
Please let me know how do i do it?

hii Pavani,
declare this two sttements in Screen
MODULE STATUS_DATA.
MODULE SELECT_DATA.
In PBO, Under SELECT_DATA write Select query like:
(considering the DB field to be text and Screen Field to be SC_TEXT)
select text from <DB Table> into SC_TEXT where <condition>.
*note if u r selecting more than one field than write fields in ( ),eg. (f1....f2) )
Plz let me know for any further queries.
Regards,
Apoorv

HT1408 I have just purchased a mac book pro. I've linked this to my windows pc to transfer the data from my windows to my mac using the migration assistant. The serial code comes up on both computers but having commenced transfer it then stops! why?

I have tried to transfer data from my old Windows PC to my new MacBook Pro via Ethernet cable. The function starts to download and then aftera while it stops unexpectedly and both computers say they are "trying to reconnect"> This transfer has failed on three attempts so far. What am I doing wrong? Help please. I am simlply tyring to transfer my itunes library and photos to the new Mac.

Forget Migration Assistant. Just copy the files you want to transfer to an External drive and then move that drive to the Mac and copy them over to the Mac. Does matter what the external drive format is as OS X can read from NTFS, Windows, formatted drives.

How to input data from labview to executable application and export the results back to labview

I have a simple function written in m file under Matlab enviornment,
function [c]=myadd2(a,b)
c=a+b;
I built it into a executable file (.exe), then I want to call it in labview and get the results.
I followed this tutorial and some other information on line:
http://digital.ni.com/public.nsf/allkb/5CF9526FF069EA8E862564C400579DBA
But I didn't see any telling me how to get the Labview array data input to the EXE file and return the results data back to another indicator in labview.
Any one have some idea?
I appreciate the help very much.
Arnold

You probably need to include some command line arguments on your executable that would be the name of a file to get the data from. You could also include a command line argument telling that exe where to store the results.
I am not familiar with Matllab to give you advice on how specifically to do that with your exe though.
Mark Yedinak
"Does anyone know where the love of God goes when the waves turn the minutes to hours?"
Wreck of the Edmund Fitzgerald - Gordon Lightfoot

Capturing Data from forms before it is stored in the table

Hi...I would like to capture data from a form before the data is stored in the database. that is, i would like to access whatever data is entered into a field right after the user pushes the Insert button. I would like to do some processing on the data and then store it in the table along with the data from the other fields. Is it possible to access it through a bind variable or something? Please tell me how to go about it. Thanks

Hi,
You can make of the session variables to access the values. Every field in the form has a corresponding session variable with the name "A_<VARIABLE_NAME>". For example for deptno the session variable will be "A_DEPTNO"
Here is a sample.
declare
flightno number;
ticketno varchar2(30);
tdate date;
persons number;
blk varchar2(10) := 'DEFAULT';
begin
flightno := p_session.get_value_as_varchar2(
p_block_name => blk,
p_attribute_name => 'A_FLIGHT_NO');
ticketno := p_session.get_value_as_varchar2(
p_block_name => blk,
p_attribute_name => 'A_TICKET_NO');
tdate := p_session.get_value_as_date(
p_block_name => blk,
p_attribute_name => 'A_TRAVEL_DATE');
persons := p_session.get_value_as_number(
p_block_name => blk,
p_attribute_name => 'A_NOF_PERSONS');
p_session.set_value(
p_block_name => blk,
p_attribute_name => 'A_FLIGHTNO',
p_value => to_char(NULL)
p_session.set_value(
p_block_name => blk,
p_attribute_name => 'A_TICKETNO',
p_value => to_char(NULL)
p_session.set_value(
p_block_name => blk,
p_attribute_name => 'A_TRAVEL_DATE',
p_value => to_char(NULL)
end;
In the above example the values of the variables are got into temporary variables and session variabels are set to null.
Thanks,
Sharmil

CF9 - Feeding data from a NUTCH 1.3 crawl to the included SOLR

Similar Messages

Maybe you are looking for