Flat-file Reconciliaiton

I have used the following link to perform a flat-file reconciliation. I assumed this sample would handle adds, updates and deletions. However, that does not seem to be the case. If I modify or delete an existing record from the file and then re-run the recon I get errors that process failed. For the modifications it complains about a duplicate ID. Is there some other configurations that I need to do in order to make this work?
A second question I have is there a way to build custom Mapping Actions? I need to create on that generates a login based on the first and last name instead of it being passed in as in the example. I would also like a Concat action that allows more than two attributes.
Thanks,
Pete

I have been able to complete a successfully creation. However, I am still unable to successfully capture updates or deletes. I am using the Process Definition that was created by the GTC. By default the Process has the following tasks: Reconciliation Update Received and Reconciliation Delete Received. I assume that these are the tasks that should handle the update and deletes, respectively.
As far as I can tell the error I am getting during an update is the following:
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataBase/readPartialStatement entered.
INFO,06 Oct 2009 14:05:50,166,[XELLERATE.DATABASE],DB read: select evt.evt_key, evt.evt_name, evt.evt_package from dob dob, evt evt, dvt dvt where dob.dob_key=dvt.dob_key and dvt.evt_key=evt.evt_key and (dob.dob_name='com.thortech.xl.dataobj.tcRCE' or dob.dob_name='com.thortech.xl.dataobj.tcTableDataObj' or dob.dob_name='com.thortech.xl.dataobj.tcDataObj' ) and dvt.dvt_post_update_sequence>0 order by dvt.dvt_post_update_sequence
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.DATABASE],select evt.evt_key, evt.evt_name, evt.evt_package from dob dob, evt evt, dvt dvt where dob.dob_key=dvt.dob_key and dvt.evt_key=evt.evt_key and (dob.dob_name='com.thortech.xl.dataobj.tcRCE' or dob.dob_name='com.thortech.xl.dataobj.tcTableDataObj' or dob.dob_name='com.thortech.xl.dataobj.tcDataObj' ) and dvt.dvt_post_update_sequence>0 order by dvt.dvt_post_update_sequence
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj/update left.
ERROR,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj/save Error :Data Update Failed
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataBase/getError entered.
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataBase/readPartialStatement entered.
INFO,06 Oct 2009 14:05:50,166,[XELLERATE.DATABASE],DB read: select err_key, err_code, err_desc, err_rowver, err_remedy, err_count, err_last_occurance, err_action, err_help_url, err_severity from err where err_code='DOBJ.UPDATE_FAILED'
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.DATABASE],select err_key, err_code, err_desc, err_rowver, err_remedy, err_count, err_last_occurance, err_action, err_help_url, err_severity from err where err_code='DOBJ.UPDATE_FAILED'
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataBase/substitute entered.
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataBase/substitute entered.
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj:handleErr - Data: poError.isAction - Value: E
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj:handleErr - Data: poError.isCode - Value: DOBJ.UPDATE_FAILED
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj:handleErr - Data: poError.isDescription - Value: Update failed.
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj:handleErr - Data: poError.isRemedy - Value:
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj:handleErr - Data: poError.isDetail - Value:
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcErrorList/addError entered.
DEBUG,06 Oct 2009 14:05:50,166,[XELLERATE.SERVER],Class/Method: tcDataObj/doRollback entered.
ERROR,06 Oct 2009 14:05:50,166,[XELLERATE.DATABASE],Class/Method: tcDataBase/rollbackTransaction encounter some problems: Rollback Executed From
java.lang.Exception: Rollback Executed From
at com.thortech.xl.dataaccess.tcDataBase.rollbackTransaction(Unknown Source)
at com.thortech.xl.dataobj.tcDataObj.rollback(Unknown Source)
at com.thortech.xl.dataobj.tcDataObj.doRollback(Unknown Source)
at com.thortech.xl.dataobj.tcDataObj.save(Unknown Source)
at com.thortech.xl.dataobj.tcTableDataObj.save(Unknown Source)
at com.thortech.xl.dataobj.tcRCE.finishDataReceived(Unknown Source)
at com.thortech.xl.schedule.jms.reconOffline.ProcessOfflineReconMessages.finishReconciliationEvent(Unknown Source)
at com.thortech.xl.schedule.jms.reconOffline.ProcessOfflineReconMessages.execute(Unknown Source)
at com.thortech.xl.schedule.jms.messagehandler.MessageProcessUtil.processMessage(Unknown Source)
at com.thortech.xl.schedule.jms.messagehandler.ReconMessageHandlerMDB.onMessage(Unknown Source)
at weblogic.ejb.container.internal.MDListener.execute(MDListener.java:466)
at weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:371)
at weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:327)
at weblogic.jms.client.JMSSession.onMessage(JMSSession.java:4547)
at weblogic.jms.client.JMSSession.execute(JMSSession.java:4233)
at weblogic.jms.client.JMSSession.executeMessage(JMSSession.java:3709)
at weblogic.jms.client.JMSSession.access$000(JMSSession.java:114)
at weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:5058)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
INFO,06 Oct 2009 14:05:50,182,[XELLERATE.DATABASE],Class/Method: tcDataBase/setTransaction: ##########setTransaction getting called from: #######
DEBUG,06 Oct 2009 14:05:50,182,[XELLERATE.SERVER],Class/Method: tcDataObj/doRollback left.
DEBUG,06 Oct 2009 14:05:50,182,[XELLERATE.SERVER],Class/Method: tcDataObj/save left.
ERROR,06 Oct 2009 14:05:50,182,[XELLERATE.JMS],An error occurred while processing the off lined reconciliation events
ERROR,06 Oct 2009 14:05:50,182,[XELLERATE.JMS],Processing Reconciliation Message with ID 47 failed.
Unfortunately I can't seem to find the root cause of the error from this message. Is there something I was supposed to configure during the creation of the GTC in order to support updates/deletes? One post mentioned that "Match Only" should be checked. I am not sure what they really means or how it would effect updates.
Thanks,
Pete

Similar Messages

Refreshing the data in a flat file

Hi
I am working on data integration.
I need to fetch data from Oracle data base and then write it to a flat file.
It is working fine now,but for the next fetch I don't need the old data to remain there in the file.The data should get refreshed and only the newly fetched data should be present.
After the data is written to the flat file can i rename the file?
I need the format of the file to be 'File_yyyyMMDDHHmmss.txt'.
My final question is how should I FTP this to the target?
Please help me on this as soon as possible since this is needed in an urgent part of the delivery.

All you ask is achievable:
1) The IKM SQL to file has a TRUNCATE option, which will if set to YES, will start from a clean file.
2) You could rename the file after writing it, but why not just write it with that name? If you set the resource name to be a variable, (e.g. #MyProj.MyFilename), and be sure to set the variable in the package before executing your interface, you should be able to get the file you want. Otherwise, you can use the OdiFileMove tool in your package to rename the file.
To set the name of the variable you can use a query on the database (if you are using Oracle, something like SELECT 'File_'||TOCHAR(SYSDATE) from DUAL.)
3) ODI has ftp classes built in- you can find the doc under doc\webhelp\en\ref_jython\jyt_ex_ftp.htm
Hope this helps
Message was edited by:
CTS

Loading multiple flat file at a time.

hi experts,
I am having 15 flat files with same data structure.so how do i load all the fileswith out creating 15 info packges .
( say all the files are on the desktop.)
I had seen the option that ABAP code an be written in info package in extraction tab.
Can any one share me the abap code
Regards
Laxman.

You can write dynamic code using ABAP if your number of flat files are not fixed...but if you have to 15 flat files always just creating multiple infopackages.
For code, you have to store file names/name pattern in some table and reading it at run time. You can use function modules starting with BAPI_IPAK* to create/change/start template IP like BAPI_IPAK_START. You can set IP parameters at run time using FM RSBATCH_MAINTAIN_PAR_SETTINGS.
Kamaljeet

InfoSpoke Flat File Extract to Logical Filename

I'm trying to extract data from an ODS to a flat file. So far, I've found that the InfoSpoke must write to the application server for large data volume. Also, in order for the InfoSpoke to transport properly, I must use logical filenames. I've attempted to implement the custom class and append structure as defined in the SAP document "How To... Extract Data with OPEN HUB to a Customer Defined Logical Filename". I'm getting an error when attempting to import the included transports (custom class code). It appears to be a syntax error. Has anyone encountered this, and, if so, how did you fix it?

Hello.
I'm getting a syntax error also. I did not import the transport, but applied the notes thru the appendix. When I modified the method "GET_OBJECT_REF_INT" in class CL_RSB_DEST as below, I get a syntax error on the "create object" statement.
    when rsbo_c_desttype_int-file_applsrv.
*{   REPLACE        &$&$&$&$                                          1
*\      data: l_r_file_applsrv type ref to cl_rsb_file_applsrv.
      data: l_r_file_applsrv type ref to zcl_rsb_file_logical.
*}   REPLACE
      create object l_r_file_applsrv
        exporting i_dest    = n_dest
                  i_objvers = i_objvers
Class CL_RSB_DEST,Method GET_OBJECT_REF_INT
The obligatory parameter "I_S_VDEST" had no value assigned to it.

Dynamic file name from input payload (RFC 2 flat file)

Hi,
I have an RFC to flat file scenario. The output flat file has not an XML structure, it's just a plain text file generated with abap mapping.
In my source interface (RFC), I have a field called <FILENAME>, I want to use the value of that field to create the target file using dynamic file name. But if in variable substitution I use payload:ZRFC_NAME,1,FILENAME,1 It doesn't work because the dynamic variable substitution try to access to output payload, not the source one...
What can I do?

Hi Marshal,
You can add a extra node to your target strucutre like
FileName- Node
--FileName - Element.
do the mapping from the field filename of RFC to FileName field in u r target strucure. And use this field path at Refrence in variable subtituion.
In the Content converison add the Name & Values as below
FileName.fileldNames -- FileName
FileName.fieldFixedLengths -- 0
FileName.fixedLengthTooShortHandling -- Cut
So the extra field in u r target structure would not populate in u r target text file.
Cheers
Veera

Non English Charaters in Flat file(Note pad)

Dear Friends,
I have a flat file from presentation server which needs to be uploaded and do some validations on that file based on the data existing.
I have some Russian language words in that file. E.g: "ОЩИ В ПОДГ". If this word exists in the file i need to get some other data from a database table. But when trying to check for the word, these characters are appearing as junk characters like ####&^^.
I tried logging into RU language also, but still not working. And also tried changing the file as type Unicode, ASCII and also not worked.
Please let me know how to get identify these words to see the exact russian words.
Thanks for your help.
Srinivas.

Hello,
Is your file .txt file.If yes,while saving it gives a pop up for file name.There you have option for encoding, there select encoding as
Unicode and try to upload.
It worked for me.I tried with the data provided by you.
data:begin of it_tab occurs 0,
      val type string,
     end of it_tab.
CALL FUNCTION 'GUI_UPLOAD'
EXPORTING
    filename                      = 'C:\Documents and Settings\xxx\Desktop\SDN1.txt'
FILETYPE                      = 'ASC'
HAS_FIELD_SEPARATOR           = ' '
HEADER_LENGTH                 = 0
READ_BY_LINE                  = 'X'
DAT_MODE                      = ' '
CODEPAGE                      = ' '
IGNORE_CERR                   = ABAP_TRUE
REPLACEMENT                   = '#'
CHECK_BOM                     = ' '
VIRUS_SCAN_PROFILE            = VIRUS_SCAN_PROFILE
NO_AUTH_CHECK                 = ' '
IMPORTING
FILELENGTH                    = FILELENGTH
HEADER                        = HEADER
TABLES
    data_tab                      = it_tab
EXCEPTIONS
   FILE_OPEN_ERROR               = 1
   FILE_READ_ERROR               = 2
   NO_BATCH                      = 3
   GUI_REFUSE_FILETRANSFER       = 4
   INVALID_TYPE                  = 5
   NO_AUTHORITY                  = 6
   UNKNOWN_ERROR                 = 7
   BAD_DATA_FORMAT               = 8
   HEADER_NOT_ALLOWED            = 9
   SEPARATOR_NOT_ALLOWED         = 10
   HEADER_TOO_LONG               = 11
   UNKNOWN_DP_ERROR              = 12
   ACCESS_DENIED                 = 13
   DP_OUT_OF_MEMORY              = 14
   DISK_FULL                     = 15
   DP_TIMEOUT                    = 16
   OTHERS                        = 17
IF sy-subrc <> 0.
MESSAGE ID SY-MSGID TYPE SY-MSGTY NUMBER SY-MSGNO
        WITH SY-MSGV1 SY-MSGV2 SY-MSGV3 SY-MSGV4.
ENDIF.
Thanks.
Ramya.

Error while uploading data from a flat file to the hierarchy

Hi guys,
after i upload data from a flat file to the hierarchy, i get a error message "Please select a valid info object" am loading data using PSA, having activated all external chars still get the problem..some help on this please..
regards
Sri

there is o relation of infoobject name in flat file and infoobjet name at BW side.
please check with the object in the BW and their lengths and type of the object and check your flat file weather u have the same type there,
now check the sequence of the objects in the transfer rules and activate them.
there u go.

How can we search data in flat files

I need to search for a particular list of account numbers whose data is stored in a flat file. Each line represents data for one account number. I also need to put all data for the searched account number into a new flat file.
Can anyone help me on this??
Thanks in advance....

I m very new to java programming and dont know what
to write in the code i.e are there any available
methods to do so..or do we need to write a search
logic..That's correct you have to implemetn the logic, but it's pretty easy. Just a loop which reads each line from the file, and looks for the information.
Kaj

How can we append data in existing flat file

how can we append data to a existing flat file (Text file).

just fill the itab from data which suppose to append to text file.than read text file from GUI_UPLOAD and loop on itab and with the use of read statements you may append the data.

Can we load data in variable screen from flat file?

Hello all,
One of my user once asked me she needs to run a report for some employees, i said you can just type that in employee varaible input box.
She said I need to run the report and I need it for 120 employees, she has the employee numbers in excel sheet.
What is the best way of doing this if any ?
Thanks

This can be done from a flat file, which has list of all values.
If you are using Bex 3.5, then we have an icon in variable screen bottom right to upload values, where we can specify the path of the file.
Naveen.a

HUGE amount of data in flat file every day to external system

Hello,
i have to develop several programs to export all tables data in a flat file for external system ( EG. WEB).
I have some worries like if is possible by SAP export all KNA1 data that contains a lot of data in a flat file using the extraction:
SELECT * FROM KNA1 ITO TABLE TB_KNA1.
I need some advices about these kind of huge extractions.
I also have to extract from some tables, only the data changes, new record, and deleted records; to do this I thought of developing a program that every day extract all data from MARA and save the extraction in a custom table like MARA; the next day when the programs runs compare all data of the new extraction with the old extraction in the ZMARA table to understand the datachanges, new records or deleted record.. It's a righ approach? Can have problems with performance? Do you now other methods?
Thanks a lot!
Bye

you should not have a problem with this simple approach, transferring each row to the output file rather than reading all data into an internal table first:
open dataset <file> ...
select * from kna1 into wa_kna1
transfer wa_kna1 to <file>
endselect
close dataset <file>
Thomas

What is the diff b/w flat file and legacy system?

Hi everyone,
when v say v r working on scenario FILE to FILE? which format of file r v usually working on? and what is the diff b/w flat file and legacy system?
thanx

Hi,
<i>when v say v r working on scenario FILE to FILE? which format of file r v usually working on?</i>
>>>Many a times it will be a Flat file with CSV format,Tab delimited format, fixedlength fields.
<i>what is the diff b/w flat file and legacy system?</i>
>>>We can not differeniate like this..
Flat file may come from any systems, it may be live system or legacy system.
Legacy system- is something like old, or past one. If you talk about SAP , then older versions of SAP can be called as a legacy system.
So it may be a file system, or any system which is old version but it doesnot mean it is not in use,
Regards,
Moorthy

How to Add Header and Footer in Flat file

HI All,
I am using ODI 11g.
MY interface is populating data from joining to 2 tables through sql query and Loads in to Flat file.
But i need to add Header and Footer in the Flat file.
In the below 3 lines
The 1st line is header ....2nd line is Data ....3rd line is Footer.
Any ideas how to work on this.
HSB9KT.KTPRTO.EBSDATA.D0000000 20120626020636
CFFE00263 SOLGSR014991340000527894536058173880207SOLNE06242012072420120000009048382650000247MRS
T00000000000000000000
Thanks,
Lony

Hi Drieux,
i am able to add Header and Footer in this.
But i want the header like Its like HSB9KT.KTPRTO.EBSDATA.D0000000 || SYSDATE (YYYYMMDDHHMMSS)
In my Out put i only see header as HSB9KT.KTPRTO.EBSDATA.D0000000 .
I have added a Variable where i am using SELECT to_char(sysdate,'YYYYMMDDHHMMSS') FROM DUAL query.
create header (HSB9KT.KTPRTO.EBSDATA.D0000000 #v_DATE)
/*$$SNPS_START_KEYSNP$CRDWG_TABLESNP$CRTABLE_NAME=FFT_SOLSNP$CRLOAD_FILE=/home/tarak/FFT_SOL.datSNP$CRFILE_FORMAT=FSNP$CRFILE_SEP_FIELD=0x0009SNP$CRFILE_SEP_LINE=0x000ASNP$CRFILE_FIRST_ROW=0SNP$CRFILE_ENC_FIELD=SNP$CRFILE_DEC_SEP=SNP$CRSNP$CRDWG_COLSNP$CRCOL_NAME=descrSNP$CRTYPE_NAME=STRINGSNP$CRLINE_OFFSET=1SNP$CRLENGTH=994SNP$CRPRECISION=994SNP$CR$$SNPS_END_KEY*/
Any idea why this sysdate part is not showing in Header.

How to create flat file with fixed lenght records

I need help to export an Oracle table to a flat file with fixed lenght and without columns separator.
the fixed length is the more important demand.
My table have 50 columns with varchar, date and number .
Date and number columns may be empty, null o with values.
Thanks a lot for any help.
[email protected]

Hi,
You can use this trick:
SQL>desc t
Name                                      Null?    Type
NAME                                               VARCHAR2(20)
SEX                                                VARCHAR2(1)
SQL>SELECT LENGTH(LPAD(NAME,20,' ')||LPAD(SEX,1,' ')), LPAD(NAME,20,' ')||LPAD(SEX,1,' ') FROM T;
LENGTH(LPAD(NAME,20,'')||LPAD(SEX,1,'')) LPAD(NAME,20,'')||LPA
                                      21                    aF
                                      21                    BM
                                      21                    CF
                                      21                    DM
4 rows selected.
SQL>SELECT * FROM t;
NAME                 S
a                    F
B                    M
C                    F
D                    M
4 rows selected.Regards

SSIS Flat File Source not populating varchar column

I have SSIS package that imports flat files with column separator | from "Flat File Source" into the database trough "OLE DB Destination".
For one of the columns (file contains UIDs in curly brackets) destination column is varchar(250) null-able, when "Retain nulls" is set to true complete data have been imported, but when "Retain nulls" is set to false beside fact that in
the file data is not null and it is not empty string it is not imported and in the destination column is empty string.
I know that this "Retain nulls" applies to the columns that contains NULLs but this is not the case.
If someone have experience with such issue please help.
Thank you in advance.

From your statement it looks like when you have curly brackets it skips the value and inserts nulls instead. And that may be the reason why its working fine when you change retain null value.
I would suggest
Make your setting "retain null" to true and load the flat file, then check what happens to the values having curly braces (is there any value or null) , if there is value we need to check for that(please share a sample file). And if it having null
instead of "{value}", I would suggest to put a script task to remove { from your flat file and then try load the data.
Hope this helps.
Regards, -Amit

Flat-file Reconciliaiton

Similar Messages

Maybe you are looking for