File to JDBC ....file sequencing

Hi
I have a file to JDBC insert async scenario.
My requirement is the source files should be processed according to Date and in sequence ..
Option 1 :
I think it can be done through a) processing seq as DATE b) EOIO queue in the sender adapter..
Option 2 :
But because there will be only 1 source file generated every 12 hours....would it be a better option like whenever 1 file goes in error ...just stop the sender channel....sort out the problem and then once the 1st file is sent OK ...then only start the file channel again...
Also if I go for option 1 i think the sequencing is only till IE....what if the 1st file fails at the receiver adapter...can it guarantee sequencing in that case as well..

Hello,
1. but wouldn't processing sequence by date + EOIO be a better option...
say if PI system is down and there are several files gathering in the source folder then when the PI system comes up..
it should not pick up files in any random order....it should pick up files by DATE and then EOIO makes sure that if the older file fails the newer doesnot go through.....
Only possible if you use NFS instead of FTP option in file adapter. You could try mounting ( a technique used for UNIX file systems).
2. Are we sure that EOIO gurantees sequence even if the message fails at the receiver adapter
As far as I know, EOIO will guarantee that sequence. The maintain order at runtime option was made for adapters that do not natively support EOIO (please correct).
3. Also i have many interfaces ...abt 100 of them ....do i need to provide separate queue names in the sender channel for each one of them....do i need to create 100 queues separately
If you could give more details regarding the interfaces, then maybe we can comment on how you can handle them e.g do they have common filenames, etc.
Hope this helps,
Mark

Similar Messages

File to JDBc to File using BPM

Hi All,
I want to create a scenario for JDBC to File. But i want to trigget this scenario and not to schedule it. So i have one option to put a file in any ftp folder and the this file will trigger my JDBC->file scenario hence my scenario becomes like File(Trigger)->JDBC->File.
I have added Receive and Send Steps in my scenario and it is ok for JDBC->File scenario. But to add this triggering mechanism i think i need to add on more receiver step which will receive file. I tried to add one more receive step at start but it is asking for Correlation... Here i am confused as i don't know why to use correlation in my scenario.....? Can anybody please suggest me how to use correlations in my case?
I just want to receive a flat file which will trigger JDBC->File Scenario.
Thanks,
Rohan.

It is just a simple select query.... will i need to make it sync then also....?
Yes if u use BPM.
It is possible to trigger the interface without BPM directly polling the database using JDBC sender as i earlier said.
With BPM, even for the select query, do message mapping. Do not assign any field from file to JDBC structure. Just assign the constants. This way select query ll be called. Map the output of select query to the receiver file structure.
Ur scenario BPM config would be similar to
/people/arpit.seth/blog/2005/06/27/rfc-scenario-using-bpm--starter-kit
Regards,
Prateek

File---- XI----- JDBC(synchronus)---- transformation-------- Proxy ??

can u tell me,
if i have scenario with multiple receivers,
file-->XI->JDBC(synchronus)>transformation--
>Proxy
i want to make it without BPM,
how can i do that,
coz, without BPM, how will the sequence of those two receivers(JDBC and Proxy) be specified, coz in my ID, when i do receiver determionation for the two receivers, how will the sequence be maintained....

Your scenario isn't simply multiple receivers, as you have also multiple senders (JDBC here plays as receiver and sender).
You can't do it properly without BPM.
And by properly I mean maintaing all the correct logical routing steps (receiver/interface determination etc).
What you could do is a File2Proxy async scenario and in mapping you could perform Lookup in DB. That is only way of achieving it without BPM.
Regards,
Henrique.

File to Jdbc: how to get record count from DB table

Hello,
i have a scenario file to JDBC....ihave to insert input file data to DB table.
now my requirement is ..if i insert a file with 50 records to db table on first time, and then next time if i insert the file with 100 records to db table....the count should start from 51 in db table.
if i insert another file 3rd time, with 25 records, the count shold start from 151...so how can i achieve this functionality....
i think following options:
1. in mapping write lookup to call JDBC sender channel and fetch count and map same to target filed of DB. if this is ok...please provide UDF code..2. db triggers (not suitable for my req.)
So kindly let meknow possible solutions and required UDF codes..please
Thanks in advance...SARAN

>>>..if i insert a file with 50 records to db table on first time, and then next time if i insert the file with 100 records to db table....the count should start from 51 in db table.
if i insert another file 3rd time, with 25 records, the count shold start from 151...so how can i achieve this functionality....
i think following options:
Suggestions:
1)Create an id column in db table. Talk to DB guy to create oracle sequencer for that column. So, every time you insert record that field will be updated with oracle sequencer. You dont need to handle this.
Refer this link
http://www.techonthenet.com/oracle/sequences.php
2) If you want to handle via pi, following suggestions..
If you use PI 7.1 or above, use jdbc lookup in the mapping and do the query something like this
Refer this link
/people/jin.shin/blog/2008/02/15/sap-pi-71-mapping-enhancements-series-graphical-support-for-jdbc-and-rfc-lookups
Do select query as below
select count(*) from tablename;
the above query will return number of rows exist in the table. So use that value and map it in the target field.
If you use pi 7.0 or below then use the previous reply and do the UDF implementation for jdbc lookup during mapping. Because jdbc lookup does not support in those versions.
Hope that helps.
Baskar

Loading big XML files using JDBC gives errors

Hi,
I've created a XMLType table using binary storage, with the restriction that any document stored has a (any) schema:
CREATE TABLE XMLBIN OF XMLTYPE
XMLTYPE STORE AS BINARY XML
ALLOW ANYSCHEMA;Then I use JDBC to store a relatively large document using the following code:
Class.forName("oracle.jdbc.driver.OracleDriver").newInstance();
String connectionString = "jdbc:oracle:thin:@host:1521:sid";
File f = new File("c:\\temp\\big.xml");
Connection conn = DriverManager.getConnection(connectionString, "username", "password");
XMLType xml = XMLType.createXML(conn,new FileInputStream(f));
String statementText = "INSERT INTO xmlbin VALUES (?)";
OracleResultSet resultSet = null;
OracleCallableStatement statement = (OracleCallableStatement)conn.prepareCall(statementText);
statement.setObject(1,xml);
statement.execute();
statement.close();
conn.commit();
conn.close();Loading a file of 61Mb (real Mb, in non-IT Mb (where 1Mb seems to be 10^6) it is 63.9Mb) or less doesn't give any errors, loading a file bigger then that gives the following error:
java.sql.SQLRecoverableException: Io exception: Software caused connection abort: socket write error
        at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:101)
        at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:112)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:173)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:229)
        at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:458)
        at oracle.jdbc.driver.T4CCallableStatement.executeForRows(T4CCallableStatement.java:960)
        at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1222)
        at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3381)
        at oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3482)
        at oracle.jdbc.driver.OracleCallableStatement.execute(OracleCallableStatement.java:3856)
        at oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1373)
        at jdbctest.Tester.main(Tester.java:60)A succesful insert of a 63Mb file takes about 23 seconds to execute. The 70Mb file fails already after a few seconds, so I'm ruling out any time outs.
I'm guessing there are some buffers that need to be enlarged, but don't have a clue which ones.
Anyone any idea what might cause the problem and how to resolve?
My server runs Oracle 11g Win32. The client is Windows running Sun Java 1.6, using ojdbc6.jar and Oracle 11g Client installed.
Cheers,
Harald

Hi Mark,
The trace log in the OEM shows me:
Errors in file d:\oracle11g\app\helium\diag\rdbms\helium\helium\trace\helium_ora_6948.trc (incident=7510): ORA-07445: exception encountered: core dump [__intel_new_memcpy()+613] [ACCESS_VIOLATION] [ADDR:0x0] [PC:0x6104B045] [UNABLE_TO_WRITE] [] If needed I can post the full contents (if I find out how, am still a novice :-))
Cheers,
Harald

How can I see the information about a file used in a sequence?

How can I see the information about a file used in a sequence?

You can use pretty much any two or multiple button mouse on a Mac, right out of the box.
I use this one: http://www.apple.com/mightymouse/

Saving data retrieved from text file to JDBC table

Hi,
I would like to save data, loaded from a text file to a dataset, into an existing JDBC table.
The documentation I found on this subject is very brief, and no matter how I tried, I couldn't succeed.
I would appreciate any help.
Thank you in advance

Hi there,
Here is an example of reading a String and a date from a text file. Once you have what you need in the Strings (or whatever) it should be easy to insert them into and SQL statement. Let me know if you need an example of this as well and I'll post it in the morning. Right now I'm off to bed :o)
Cheers
Mark
import java.io.*;
import java.util.*;
import java.text.*;
public class WriteTest {
public static void main(String [] arg) throws Exception {
   Date today = new Date();
   String name = "";
   SimpleDateFormat formatter = new SimpleDateFormat("ddMMyyyy");
   File myfile = new File("hello.txt");
   // how to input
   BufferedReader in = new BufferedReader(new FileReader(myfile));
   String name="",
   date="";
   boolean eof = false;
   do {
      name = in.readLine();
      date = in.readLine();
      if(!(eof = (name==null || date==null)))
      System.out.println(name+" "+formatter.parse(date));
   while(!eof);
}

Can't read special characters in an excel file using JDBC

Hi! I 've a code to read an excel file using JDBC-ODBC bridge. I can read the values, but any special characters is readed wrong, just symbols. The special characters are of spanish language. This is my code:
                Locale currentLocale;
          currentLocale = new Locale("es", "MX");
          Locale.setDefault(currentLocale);
               Class.forName( "sun.jdbc.odbc.JdbcOdbcDriver" );
               c = DriverManager.getConnection("jdbc:odbc:Driver={Microsoft Excel Driver (*.xls)};DBQ=comisionesperfiles.xls");
               stmnt = c.createStatement();
               String query = "Select * from [Hoja1$]" ;
               ResultSet rs = stmnt.executeQuery( query );
               while( rs.next() ){
                    String valor = rs.getString(2) ;
                    if(valor != null && !"null".equalsIgnoreCase(valor)){
                         if(!comisiones.contains(valor)){
                              System.out.println(valor);
                              comisiones.add( valor );
               rs.close();
               stmnt.close();As you can see, I've tried to set the locale, but it didn't work.
I'm using Excel 2003, Java Version 1.4.2_07 and Windows XP Professional (in latin american spanish).
Hope someone can help me!

FYI: Apache's POI can read/write Excel files in Java:
http://jakarta.apache.org/poi/index.html

Test cases for File to JDBC scenario?

Hi Experts,
I would like to know what are the things needs to be tested to ensure that the File to JDBC scenario holds good in the PI box. Your valuable inputs are required to verify /check my scenario configuration is free of errors.
Thanks & Regards,
Pcv.

Hi,
You can try the following:
1) If the end systems require authentication and the same is not provided in PI then it should throw an error.
2) Check what happens when you dont give a mandatory field.
3) check what result you will get when you give a wrong input.
4) Check whether all your restrictions (in mapping and/or in receiver determination) are working properly.
5) Check what you need to do when the target system is down.
6) If using any FCC then check whether the conversion is done properly.....
7) See to it that you have defined a proper DB structure when you are communication with JDBC
8) Check with the end system whether your statement (Insert/Update/Delete etc) is performed properly
Regards,
Abhishek.
Edited by: abhishek salvi on Dec 4, 2008 9:58 AM

File to JDBC - JDBC database not getting updated using UPDATE_INSERT

Hi ,
I have a done a file to JDBC Scenario.File is successfully picked up by sender file channel and recieved by reciever JDBC channel.There is no error in receiver communication channel.I used UPDATE_INSERT action in mapping which has to update the database with all records it recieve.But,i found there is no update in Database table.I donot have access to database,so i made a sender jdbc channel querying all data in it to see what new value is populated.
I made a dummy sender jdbc channel to check what are the values updates on the run of above interface.But , i found no update occur.Please help me out of this problem.
Thanks
Deepak Jaiswal

The reason I ask , because you will see whether the message got successfully delivered to the target system.
I want to see information like below
2010-04-14 14:31:35 Success Message successfully received by messaging system. Profile: XI URL: http://server:port/MessagingSystem/receive/AFW/XI Credential (User): PIISUSER
2010-04-14 14:31:35 Success Using connection JDBC_http://sap.com/xi/XI/System. Trying to put the message into the receive queue.
2010-04-14 14:31:35 Success Message successfully put into the queue.
2010-04-14 14:31:35 Success The message was successfully retrieved from the receive queue.
2010-04-14 14:31:35 Success The message status set to DLNG.
2010-04-14 14:31:35 Success Delivering to channel: Communuication channel
2010-04-14 14:31:35 Success MP: Entering module processor
2010-04-14 14:31:35 Success MP: Processing local module localejbs/CallSapAdapter
2010-04-14 14:31:35 Success Receiver JDBC adapter: processing started; QoS required: ExactlyOnce
2010-04-14 14:31:35 Success JDBC adapter receiver channel CC: processing started; party , service DB_BS
2010-04-14 14:31:35 Success Database request processed successfully
2010-04-14 14:31:35 Success MP: Leaving module processor
2010-04-14 14:31:35 Success The message was successfully delivered to the application using connection JDBC_http://sap.com/xi/XI/System.
2010-04-14 14:31:35 Success The message status set to DLVD.
raj.

File adapter: file processing in correct sequence

Hello All
We have inbound file scenario.
File will be picked up and processed by XI and sent to SAP system.
All the files have to be processed in the same sequence.
Once the file is picked and processed in XI, data will be sent to receiving SAP system thru proxy call.
But, if there is an error in processing received data in the receiving system (because of duplicate data or any other application related error, which is specific to receiving application), how can we stop XI from picking and processing the next file?
Second file should be picked and processed by XI only after 1st file is successfully processed by the receiving system.
How can i ensure this?
Please let me know...
Many Thanks
Chandra

Hi Chandra
If you are on NFS then you can enable Processing Sequence by Name or Date in sender file adapter. With this you need to implement EOIO this allows messages to be picked in sequence and process in queue. If one of the file failed the queue will error.
To avoid more than one thread processing you can use additional parameter "clusterSyncMode" refer Note 801926.
With the above other solution can be creating a SYNC or interface that can act as an ACK from the system then you process the next message. BPM can also be useful if you use Fault messages and capture them for errors for processing of next message.
Hope above info can be used to come to a final approach for you
Thanks
Gaurav

Error in File-XI-JDBC Scenario

Dear All,
I am working on File-XI-JDBC scenario which is using stored procedure (SP_UPDATE). When I am processing the file it is giving me the following error in the message monitoring:
Unable to execute statement for table or stored procedure. 'SP_UPDATE' (Structure 'Statement') due to java.sql.SQLException: ERROR: Invalid XML document format for stored procedure: 'type="<SQL-type>"' attribute is missing for element 'access' (Setting a SQL-type (e.g. INTEGER, CHAR, DATE etc.) is mandatory !)
Please guide me what is this error all about and how this can be resolved.
Warm Regards,
N.Jain

Dear All,
Now, I am able to update the SQL Server database but only one record is coming at the target. Can anyone please guide me what is he error in my Data types o in my mappings. Following is the source Data Type:
MT_TEST_FILE_T179T      1..1     DT_TEST_FILE_T179T
     ROOT                         1..unbounded
        PRODH                    1..unbounded     xsd:string
        VTEXT                      1..unbounded     xsd:string
        DATUM                     1..unbounded     xsd:string
Following is the target Data Type:
MT_TEST_JDBC_T179T      1..1     DT_TEST_JDBC_T179T
     STATEMENT                1..1
        SP_UPDATE             1..1
            action                    required     xsd:string
            TABLE                  1..1                     xsd:string
                PRODH             1..unbounded     xsd:string
                   type               optional            xsd:string
                VTEXT               1..unbounded     xsd:string
                   type               optional            xsd:string
                DATUM              1..unbounded     xsd:string
                   type               optional            xsd:string
Following are the mappings done:
EXECUTE-->@action
storedprocedurename-->TABLE
PRODH-->PRODH
VTEXT-->VTEXT
DATUM-->DATUM
CHAR-->@type.
With this stucture and mapping i am able to insert only one recored in the database even though there are multiple entries in the file.
Please guide me in solving this error so that multiple records can be inserted.
Warm Regards,
N.Jain

Strange error in File-XI-JDBC scenario

Dear All,
I am working currently on File-XI-JDBC scenario and is facing with a stange problem.
I have writtern one simple query which is downloading the data from R/3 and is sending to XI Server local folder. From that folder File is getting picked by XI and is posted into SQL database.
Now, when I am generating the required file from R/3-DEV server then my scenario is getting executed successfully but if file is generated thru R/3-QAS Server then the scenario is giving the following error "Message processing failed. Cause: com.sap.aii.af.ra.ms.api.RecoverableException: Error processing request in sax parser: Error when executing statement for table/stored proc. 'MARA_UPDATE' (structure 'Statement'): java.sql.SQLException: [Microsoft][SQLServer 2000 Driver for JDBC][SQLServer]Error converting data type nvarchar to smalldatetime."
Also, if I am copying the complete data from the error file and paste it into a new file and executing again then the scenario is executing correctly.
I have checked the payload and didn't find anything there.
Kindly help me in solving this error.
Regards,
N.J

Hi Farooq,
Thanx for your reply. But this scenario is running when we are sending the file from R/3-DEV Server and also if I am copying all the contents of the error file and pasting it into a new file and then processing the file then the scenario is getting executed and I am getting no error with the same data which I have processed earlier and has thrown error.
Reg,

File to Jdbc Scenario

Hi All,
       I am doing a File to JDBC scenario, where sender side message type occurance is 0..unbounded and receiver side message type occurance is 1 in message mapping. The whole scenario working fine when both sender and receiver side message type occurance is 1 in message mapping.
When Sender side occurance is 1.
<?xml version="1.0" encoding="UTF-8"?>
<ns0:mt_smtjdbc_sender xmlns:ns0="http://SmartJDBC">
   <NAME>A</NAME>
   <DEPT>B</DEPT>
</ns0:mt_smtjdbc_sender>
When Sender side occurance is 0..unbounded.
<?xml version="1.0" encoding="UTF-8"?>
<ns0:Messages xmlns:ns0="http://sap.com/xi/XI/SplitAndMerge">
   <ns0:Message1>
      <ns1:mt_smtjdbc_sender xmlns:ns1="http://SmartJDBC">
         <NAME>Dip</NAME>
         <DEPT>xi</DEPT>
      </ns1:mt_smtjdbc_sender>
   </ns0:Message1>
</ns0:Messages>
If I use Sender side occurance as 0..unbounded I am getting the following error in adapter engine Communication channel monitor (for receiver communication channel)
Error while parsing or executing XML-SQL document: Error processing request in sax parser: No 'action' attribute found in XML document (attribute "action" missing or wrong XML structure)
Can anybody please help me how to solve this problem?
Dipankar

Hi,
My Sender side structure as follows.
<?xml version="1.0" encoding="UTF-8"?>
<ns0:Messages xmlns:ns0="http://sap.com/xi/XI/SplitAndMerge">
   <ns0:Message1>
      <ns1:mt_smtjdbc_sender xmlns:ns1="http://SmartJDBC">
         <NAME>DIp</NAME>
         <DEPT>XI</DEPT>
      </ns1:mt_smtjdbc_sender>
   </ns0:Message1>
</ns0:Messages>
My corresponding Receiver side structure as follows.
<?xml version="1.0" encoding="UTF-8" ?>
<ns0:Messages xmlns:ns0="http://sap.com/xi/XI/SplitAndMerge">
<ns0:Message1>
<ns1:mt_smtjdbc_receiver xmlns:ns1="http://SmartJDBC">
<Statement>
<dbTableName action="INSERT">
<TABLE>SMARTOP</TABLE>
<access>
<NAME>DIp</NAME>
<DEPT>XI</DEPT>
</access>
</dbTableName>
</Statement>
</ns1:mt_smtjdbc_receiver>
</ns0:Message1>
</ns0:Messages>

File-XI-JDBC error

Hello XI Gurus,
     Thanks for all the help so far. Right now I am in the process of doing file to jdbc scenario. I am following this link: /people/sap.user72/blog/2005/06/01/file-to-jdbc-adapter-using-sap-xi-30
<b>I am getting the follwoing error in the JDBC adapter monitoring:</b>
Receiver Adapter v2606 for Party '', Service 'JDBC_Service':
Configured at 16:31:32 2006-09-08
Last message processing started 16:47:07 2006-09-08, Error: TransformException error in xml processor class, rollback:
Error processing request in sax parser: No 'action' attribute found in XML document (attribute "action" missing or wrong XML structure)
SXMB_Moni says that the message has been processed succesfully.
Here are my data:
<b>Here is my Source XML(XI is picks this xml file thru file adapter):</b>
<p2:data_filesender_MT xmlns:p2="http://filetojdbc">
   <EMPID>JDK</EMPID>
   <EMPNAME>JohnDoe</EMPNAME>
   <EMPAGE>3</EMPAGE>
   <FLAG>Yes</FLAG>
</p2:data_filesender_MT>
<b>Here is my target XML (in the message mapping test window)</b>
<p2:data_jdbcreceiver_MT xmlns:p2="http://filetojdbc">
   <STATEMENTNAME>
      <Table1>
         <action>INSERT</action>
         <TABLE>Table1</TABLE>
         <access>
            <EMPID>JDK</EMPID>
            <EMPNAME>JohnDoe</EMPNAME>
            <EMPAGE>3</EMPAGE>
            <FLAG>Yes</FLAG>
         </access>
      </Table1>
   </STATEMENTNAME>
</p2:data_jdbcreceiver_MT>
Please let me know what I am doing wrong:
Regards,
N.S

Hi Swamy,
As Bhavesh mentioned check the mapped xml message i.e JDBC message structure. By seeing the your post, you mentioned action as a element. It should be attribute.
<p2:data_jdbcreceiver_MT xmlns:p2="http://filetojdbc">
<STATEMENTNAME>
<Table1 action = INSERT</Table1>
<TABLE>Table1</TABLE>
<access>
<EMPID>JDK</EMPID>
<EMPNAME>JohnDoe</EMPNAME>
<EMPAGE>3</EMPAGE>
<FLAG>Yes</FLAG>
</access>
</Table1>
</STATEMENTNAME>
</p2:data_jdbcreceiver_MT>
In this Table1 should be your Table Name.
To know more
http://help.sap.com/saphelp_nw2004s/helpdata/en/2e/96fd3f2d14e869e10000000a155106/content.htm
btw what is the error in the RWB->message monitoring->Message DisplaY tool . also check JDBC communication channel in the Adapter monitoring
Regards,
Moorthy

File to JDBC ....file sequencing

Similar Messages

Maybe you are looking for