Batch Processing of records using JDBC adapter

Dear all,
We are working on JDBC-JDBC scenario and the flow is as below. Source is ORACLE and Target is SQL SERVER.
We need to pick up 2000 records from Source . PI should split them ito 4 batches of 500 each and should insert in SQL DB.While inserting the records, if there are any errors, those records should sent back to Source again. It is Synchronous scenario.
1) But as far as I know Batch Processing mode, INSERT option cannot be used.(From SAP help)
2) Will the connection break if we are sending the error records back to sender.
Any thoughts would be helpful.
regards,
babu

Hi,
The below links may help U.
JDBC ADAPTER
http://help.sap.com/saphelp_nw04/helpdata/en/7e/5df96381ec72468a00815dd80f8b63/content.htm
/people/saravanakumar.kuppusamy2/blog/2005/01/19/rdbms-system-integration-using-xi-30-jdbc-senderreceiver-adapter
/people/sap.user72/blog/2005/06/01/file-to-jdbc-adapter-using-sap-xi-30 - File to JDBC
JDBC - http://help.sap.com/saphelp_nw2004s/helpdata/en/64/ce4e886334ec4ea7c2712e11cc567c/content.htm
multiple tables with JDBC - http://help.sap.com/saphelp_nw04/helpdata/en/2e/96fd3f2d14e869e10000000a155106/content.htm
JDBC Response /people/swaroopa.vishwanath/blog/2006/12/28/send-rfc-to-sap-xi-150-asynchronous
Regards
Pullarao

Similar Messages

NCHAR issue with oracle database using JDBC adapter

Hi,
We have a requirement to develop an XI interface from FTP server(File adapter) to oracle database using JDBC adapter. In the oracle database table few fields are of type NCHAR/NVARCHAR. when we try to insert the character(A,B,c..) values into oracle table fields of type NCHAR/NVARCHAR, we are getting the following error message in the JDBC adapter audit log. IF we pass the numeric value to the same field, then we are able to insert the records successfully.
Unable to execute statement for table or stored procedure. 'IPCSDD_DOWNLOAD_PROCESS' (Structure 'StatementName1') due to java.sql.SQLException: ORA-00904: "P": invalid identifier
2010-10-19 22:29:59 Error JDBC message processing failed; reason Error processing request in sax parser: Error when executing statement for table/stored proc. 'IPCSDD_DOWNLOAD_PROCESS' (structure 'StatementName1'): java.sql.SQLException: ORA-00904: "P": invalid identifier
2010-10-19 22:29:59 Error MP: Exception caught with cause com.sap.aii.af.ra.ms.api.RecoverableException: Error processing request in sax parser: Error when executing statement for table/stored proc. 'IPCSDD_DOWNLOAD_PROCESS' (structure 'StatementName1'): java.sql.SQLException: ORA-00904: "P": invalid identifier
Please find the system information below.
Oracle version- 10.2.4
XI version - 3.0/ service pack 19
JDBC driver- oracle.jdbc.driver.OracleDriver
Please suggest.
Thanks,
Venkata
Edited by: Venkata Narayana Eepuri on Oct 21, 2010 12:10 AM

Dear Venkata Narayana,
Concerning the error, kindly go through the following note :
731 - Collective note: ORA-00904
follow the recommendations mentioned in that and please check if that helps.
Best Regards
Nishwanth

How many records does JDBC adapter can obtain in one polling?

Hello everybody,
I need to do an interface between legacy system and SAP ECC, the legacy systems have a DB so i use the jdbc adapter (sender) and receive the information to SAP ECC with proxy, so i need to activate the polling option from my jdbc adapter working as a sender, i read a table with lot of records, and i need to know how many records does jdbc adapter support when the polling is executed, because is necessary read all records from the table and change the status of the processed field.
Is possible to get all the records from that table in one polling interval (50,000 records aprox)?, or i need to do the polling by blocks of records until finish all records from the table?, the second option, i dont have idea how can i do it.
Regards,
Vicman

Hi again!,
i still working on that, but i have a question, is possible to handle Store Procedure in jdbc adapter?? is supported?, like PL SQL, because i was working in the next query but i don't know if it works and where do i need to locate the query in the Query SQL Statement or in Update SQL Statement field or both? but how?.
DECLARE c_cursor CURSOR FOR
SELECT * FROM tablename
WHERE processed=0
OPEN c_cursor
   FETCH NEXT FROM c_cursor
WHILE @@FETCH_STATUS = 0
BEGIN
   update tablename set processed=1
   FETCH NEXT FROM c_cursor
END
CLOSE c_cursor
DEALLOCATE c_cursor
Regards,

How to handle the BOLB column Using JDBC adapter

Hi,
I want to sending of a BOLB column from a DB2 database table to another DB2 database, and the sender and receiver both by using JDBC adapter. The two tables in each other database have the same columns.
Here is the table's structure:
<ID>string type</ID>
<PDF>blob type</PDF>
Also, i haved create two DataTypes in PI system.
Sender DataType:
ns:DT_PDF_Req xmlns:ns="http://XXXXX.com/sap/xi">
   <row>
     <ID>1</ID>
     <PDF></PDF>
   </row>
</ns:DT_PDF_Req>
Receiver DataType:
<ns0:DT_PDF_Res xmlns:ns0="http://XXXX.com/sap/xi">
<STMT>
<dbtable action="INSERT">
<table>tablename</table>
<access>
   <ID></ID>
   <PDF></PDF>
</access>
</dbtable>
</STMT>
</ns0:DT_PDF_Res>
When test this interface, i found the that we can get the data, but when execute the insert stms the follow errors occured in RWB :
<ERROR>
Could not execute statement for table/stored proc. "DBDPUSER.pdf" (structure "STMT") due to com.ibm.db2.jcc.b.nm: DB2 SQL Error: SQLCODE=-103, SQLSTATE=42604, SQLERRMC=255044462d312e330a25c7ec8fa20a352030206f626a0a3c3c2f4c656e677468203620, DRIVER=3.50.153
JDBC Message processing failed, due to Error processing request in sax parser: Error when executing statement for table/stored proc. 'DBDPUSER.pdf' (structure 'STMT'): com.ibm.db2.jcc.b.nm: DB2 SQL Error: SQLCODE=-103, SQLSTATE=42604, SQLERRMC=255044462d312e330a25c7ec8fa20a352030206f626a0a3c3c2f4c656e677468203620, DRIVER=3.50.153
</ERROR>
Can anybody tell me how to resolve the problems?
And tell me about how to deal BOLB column using PI.
Best Regards
Terry

Hi Terry Qin,
I understand, you are getting below XML from sender JDBC channel. But when you getting SAX parser error, in receiver JDBC.
<ns:DT_PDF_Req xmlns:ns="http://XXXXX.com/sap/xi">
<row>
<ID>1</ID>
<PDF></PDF>
</row>
</ns:DT_PDF_Req>
I think it is because the XML which is going to receiver JDBC channel is not well formed (because pdf can containg < & characters).
You can achive this sceanrio, by selecting receiver JDBC channel as Message Protocol "Native SQL Format" [Link1|http://help.sap.com/saphelp_nwpi711/helpdata/en/44/7c24a75cf83672e10000000a114a6b/frameset.htm] you can send non XML to receiver channel.
Before that, you have convert above input XML into SQL statement, using Java Mapping.
Regards,
Raghu_Vamsee

Problem with Progress DB while using to connect using JDBC Adapter

Hi,
I am facing Problem with Progress DB while using to connect using JDBC Adapter. I am getting the following error in auditlog file like,
Error during database connection to the database URL jdbc:JdbcProgress:T:156.5.31.65:2545:/mfgprodev/devbadb
/devsche/i_apoext.db using the JDBC driver "com.progress.sql.jdbc.JdbcProgressDriver" : com.sap.aii.adapter.jdbc.sql.DriverManagerException: Unable to locate a suitable JDBC driver to establish a connection to URL " jdbc:JdbcProgress:T:156.5.31.65:2545:/mfgprodev/devbadb
/devsche/i_apoext.db "
I tried using the following all URLs,
1. jdbc:JdbcProgress:T:156.5.31.65:2545:i_apoext.
2. jdbc:JdbcProgress:T:156.5.31.65:2545:i_apoext.db
3.
jdbc:JdbcProgress:T:156.5.31.65:2545:/mfgprodev/devbadb
/devsche/i_apoext.
4.
jdbc:JdbcProgress:T:156.5.31.65:2545:/mfgprodev/devbadb
/devsche/i_apoext.db.
Can anyone please help me out in solving this issue.
May be the cause for this is :
1) The Wrong URL format
2) CLASSPATH is not setted properly..
Can you look more into this stuff.
Thanks,
Soorya.

Hi,
To access any database fromm XI, using the JDBC adapter, the corresponding drivers have to be installed on the XI server.
Just check this note 831162.
Also, check this PDF to install Drivers in XI,
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3867a582-0401-0010-6cbf-9644e49f1a10

Using JDBC Adapter posting data from Oracle database to Falt file????

Hi All,
By using JDBC adapter, for now I have to connect to Oracle Database and then get the employee information from the Employee Table and post it to the flat file, can you please help me out the complete procedure...
Thanks in advance
Andy

Hi Andy,
have a look at the help for configuring a JDBC Sender adapter: http://help.sap.com/saphelp_nw04/helpdata/en/7e/5df96381ec72468a00815dd80f8b63/content.htm
It mentions all the settings you'll need to make e.g. the connection URL as posted above.
And it also lists how an XML file looks like that contains the query results according to the SQL Select statement in the adapter.
<resultset>
<row>
<column-name1>column-value</ column-name1>
<column-name2>column-value</ column-name2>
<column-name3>column-value</ column-name3>
</row>
<row>
<column-name1>column-value</ column-name1>
<column-name2>column-value</ column-name2>
<column-name3>column-value</ column-name3>
</row>
</resultset>
So you have to create a datatype, message type and message interface to match this structure (of course you'll need to substitute column-name1 etc. with the column names in your select statement).
Now if you want to create a flat file from that, you have to create an XML representation of that flat file and use the content conversion in the receiver file adapter as defined here: http://help.sap.com/saphelp_nw04/helpdata/en/d2/bab440c97f3716e10000000a155106/content.htm
Regards
Christine

Can we use JDBC adapter at ECC side to extract the data directly

Hi ,
Is it possible in any way we can use JDBC adapter at SAP to extract data from sap tables.because as far as i know jdbc adapter used only when we having some database system at sender side.
Regards

Hi,
SAP R3 is installed over a DB (Oracle, DB2 etc) this DB as a persistent storage for storing data and other information. R3 rovides a layer over the underlying database so that no one can directly access or modify the contents (due to security and data integrity issues). Hence it exposes its own RFC's for data access and modifications...
But like I said before SAP recommends to make use of RFC's or BAPI's to access data stored in R3 tables; but we can also access them directly.You need to take the help of a DB admin for this
Regards
Suraj

Populating SAP Database table using JDBC adapter

Hi Folks,
I have a requirement to populate a SAP database table say ZTABLE using XI. The Model is the table has to be populated through a file which will be processed by SAP XI. Basically this is a File to JDBC scenario. The database used is ORACLE. Kindly provide me some idea to go ahead.

I tried to place the MS access table in the shared folder of the Application server system but still it seems the table is not being populated.
did you check the log in your receiver channel? (/people/sameer.shadab/blog/2005/10/24/connecting-to-ms-access-using-receiver-jdbc-adapter-without-dsn)
The requirement is to update the tables directly as those are the custom tables.
i would still say that do not update SAP tables directly from XI/ PI.....this is not a standard architecture/ solution....

Inserting Multiple Rows into Database Table using JDBC Adapter - Efficiency

I need to insert multiple rows into a database table using the JDBC adapter (receiver).
I understand the traditional way of repeating the statement multiple times, each having its <access> element. However, I am just wondering whether this might be performance-inefficient, as it might insert records one by one.
Is there a way to ensure that the records are inserted into the table as a block, rather than record-by-record?

Hi Bhavesh/Kanwaljit,
If we have multiple ACCESS tags then what happens is that the connection to the database is made only once. But the data is inserted row by row.
Why i am saying this?
If we add the following in JDBC Adapter..logSQLStatement = true. Then incase of multiple inserts we can see that there are multiple
<i>Insert into tablename(EMP_NAME,EMP_ID) VALUES('J','1000')
Insert into tablename(EMP_NAME,EMP_ID) VALUES('J','2000')</i>
Doesnt this mean that rows are inserted one by one?
Correct me if i am wrong.
This does not mean that the transaction is not guaranted. Either all the rows will be inserted or rolled back.
Regards,
Sumit

Message error ORA-00936 when using JDBC adapter

Hi all,
I'm using the folow scenario:
RFC --> XI --> JDBC
RFC <-- XI <-- JDBC (response)
It's a SYNCHRONOUS interface.
RFC call without COMMIT WORK:
CALL FUNCTION 'Y_TESTE_NEI'
    DESTINATION 'RFC_XI'
EXPORTING
   DATE_FROM       = v_data_from
   DATE_TO         = v_data_to
TABLES
    t_return        = t_dados.
I'm not using KEY in JDBC message, because for test I want to get entiry table, and I set the communication channel JDBC to KEY not mandatory.
I'm not having mapping error, in SXMB_MONI I can see the two messages of interface, but both with SYSTEM ERROR.
In JDBC adapter in Runtime Workbench apears the follow message error:
com.sap.aii.af.ra.ms.api.DeliveryException: Error processing request in sax parser: Error when executing statement for table/stored proc. 't7_productionorder' (structure 't7_productionorder'): java.sql.SQLException: ORA-00936: missing expression
And DUMP in function call in R/3: CALL_FUNCTION_REMOTE_ERROR
Could anyone help me about this problem ?
Thanks in advance.
Regis Ferrato

Hi Regis,
I did the same scenario just now. The error you get is, you need to check whether the fields you are entering into the database have correct datatypes.
Check out your database structure with your structure in XI, and also test in Message Mapping, to make sure you are sending correct values.
In my case I was sending date like this '10-12-06', but my DB accepts only '101206'. So I removed the '-'. It was fine .
The Dumping error is not due to your ABAP, due to the DB operation.
Let me know Whether I am correct.
Raj.

Error while retrieving data from sql using jdbc adapter

hi all,
i m working on one scenario where i m sending data using HTTP and receiver is jdbc adapter which is retrieving me data from sql server.
i have checked the structure both for req and res.
i m getting this error
<SAP:Error>
<SAP:Category>Application</SAP:Category>
<SAP:Code>MAPPING.EXCEPTION_DURING_EXECUTE</SAP:Code>
<SAP:P1>com/sap/xi/tf/_INF57285_DB_HR_RES_</SAP:P1>
<SAP:P2>com.sap.aii.utilxi.misc.api.BaseRuntimeException</SAP:P2>
<SAP:P3>RuntimeException in Message-Mapping transformatio~</SAP:P3>
<SAP:Stack>During the application mapping com/sap/xi/tf/_INF57285_DB_HR_RES_ a com.sap.aii.utilxi.misc.api.BaseRuntimeException was thrown: RuntimeException in Message-Mapping transformatio~</SAP:Stack>
</SAP:Error>
can somebody help me with this.
Thanks & Regards
Aruna

thnks bhavesh i think i made it that way
JDBC REQ
<ns:INF57285_DB_Request xmlns:ns="http://www.infosys.com/xi/training/hyd/57285">
<Employee>
    <EmpDetails action="SELECT">
      <table>EmpDetails</table>
      <access>
        <Name />
        <EmpId />
        <Band />
        <Salary />
      </access>
      <Key>
        <EmpId>57285</EmpId>
      </Key>
    </EmpDetails>
</Employee>
</ns:INF57285_DB_Request>
JDBC RES
<ns:INF57285_DB_Request_response xmlns:ns="http://www.infosys.com/xi/training/hyd/57285">
<Employee_response>
    <row>
      <Name>aruna</Name>
      <EmpId>57285</EmpId>
      <Band>A</Band>
      <Salary>4675776</Salary>
    </row>
</Employee_response>
</ns:INF57285_DB_Request_response>
my hr req is which i mapped with DB req
<ns:INF57285_HR_Req xmlns:ns="http://www.infosys.com/xi/training/hyd/57285">
<REQUEST>
    <EmpNo>57285</EmpNo>
</REQUEST>
</ns:INF57285_HR_Req>
my hr res is which i mapped with DB res
<ns:INF57285_HR_Res xmlns:ns="http://www.infosys.com/xi/training/hyd/57285">
<response>
    <row>
      <Name>aruna</Name>
      <Empld>57285</Empld>
      <Salary>4675776</Salary>
    </row>
</response>
</ns:INF57285_HR_Res>
and interestingly i am not getting any error in sxmb_moni
it's not showing any error
plz suggest me something wht to do ....
thnks & regards
Aruna

Insert Multiple records using Database adapter with Stored procedure func

Hi All,
I want to insert multiple records on a database using a stored procedure. I wanted to insert those records using a Database Adapter and the Database adapter should be invoked by a Mediator.
Can somebody suggest me with ideas whether it can be acheived with OOB capabtilities in SOA suite or not?
Thanks for your help in advance.
Thanks,
Shiv

The use case you want to achieve is feature supported by the DBAdapter and it is possible to invoke the same from mediator.
Please have a look at the oracle documentation and you should be able to get the necessary information.
The below links should help you as well:
http://download.oracle.com/docs/cd/E15523_01/integration.1111/e10231/adptr_db.htm
http://blogs.oracle.com/ajaysharma/2011/03/using_file_adapter_database_adapter_and_mediator_component_in_soa_11g.html
There are some video tutorials as well :)
http://www.youtube.com/watch?v=dFldS-fDx70 This should also help
Thanks,
Patrick

Access an Oracle DB using JDBC adapter

Hi, I'm trying to make an simple test for checking if the connection between XI and Oracle DB is working fine and following the weblog nr. 2018 ( Save Time with generalized JDBC datatypes ) i've made my structures in order to achived that. I've declared the field action as SELECT than the table name ... and in the IB set the needed configurations. So when i exec my interface i've got the black/white flag bur if i look at the adapter engine i see that the JDBC adapter is achieved but i got 2 errors " <b>No 'action' attribute found in XML document('action' attribute missing or wrong XML structure)</b> and <b>Exception caught by adapter framework: error processing request in sax parser: No 'action' attribute found in XML document('action' attribute missing or wrong XML structure)</b>. Can anybody provide me some help ??? Thanks in advance.
JMMatos

Hi,
This is how my DT looks like:
Structure           Category      Type
Data_JDBCReceiver   Complex Type
Statement
    Table_name
      action        Attribute
      table
    access                        Data_FileSender
      cod
    key                           Data_FileSender
      cod
This is my DT and in MM i fill field <b>action</b> with constant value(SELECT/INSERT), field <b>table</b> with the name of the corresponding DB table, fields <b>access/key</b> with constant value(empty). At this moment, I got the following error <b>Exception caught by adapter framework: Error processing request in sax parser: Error when executing statement for table/stored proc. 'v01_sap_xi' (structure 'Statement'): java.sql.SQLException: FATAL ERROR: Column 'cod' does not exist in table 'v01_sap_xi'</b>; according with the people responsible for the DB this column named <b>cod</b> does really exist !! What can I do ?!?!? Some help will be ... Thanks !!!

No error generated if batch process load file uses wrong naming convention

Another interesting one...
When using the batch processing functionality of FDM, which can be executed by either:
- FDM Workbench (manually)
- Hyperion FDM Task Manager (scheduled)
- upsShell.exe (scheduled and executed from a batch script)
..., one has to name the data file (to be loaded) using a specific file naming convention (i.e. "A~LOCATION~CATEGORY~PERIOD~RA.csv" format, for example). However, if one does not name the file correctly and then tries to process the file using batch processing functionality using any of the above three methods, FDM happily moves the file out of the OpenBatch folder and into a new folder, but the file is not loaded as it does not know where to map it to (as expected). However, there are no errors in Outbox\Logs\<username>.err to inform the user, so one is non the wiser that anything has gone wrong!
When using FDM Workbench, an error is displayed on the screen (POV - "Batch Completed With Errors, ( 1 ) Files Contained Errors"), but this is the only indication of any error. And normally, one would be scheduling the load using upsShell.exe or Hyperion FDM Task Manager anyway...
Has anyone else noticed this, or am I doing something wrong here? :-)

Yes, as per my original post the only feedback on any POV errors appears to be when using the FDM Workbench Batch Processing GUI.
Regarding the "Batch Process Report in FDM" you mentioned, are you referring to Analysis | Timeline accessible via FDM web client? Unfortunately this does not appear to provide much in the way of detail or errors, only general events that occurred. I cannot locate any batch process report, other than the log output I defined when calling upsShell.exe. However, this contains no POV errors...

How to eliminate inserting Duplicate rows into database using JDBC Adapter

File->Xi->JDBC
In above Scenario if the file has two rows their values are identical, then how can we eliminated inserting Duplicate rows into database using JDBC Adapter

Database is a consumer of a SERVICE (SOA!!!!!!).
Database plays a business system role here!!!!
Mapping is part of an ESB service
Adaptor is a technology adapted to ESB framework to support specific protocol.
ESB accomplish ESB duties such as transformation, translation, routing. Routing use a protocol accepted by the consumer. In a JDBC consumer it is JDBC protocol and hence it a JDBC adaptor.
There is clear separation on responsibilities among business system and ESB. ESB do not participate in business decision or try to get into business system data layer.
So who ever are asking people to check duplicate check as part of mapping (an ESB service) may not understand integration practice.
Please use an adaptor module which will execute the duplicate check with business system in a plug and play approach and separate that from ESB service so that people can build integration using AGILE approach.
Thanks

Batch Processing of records using JDBC adapter

Similar Messages

Maybe you are looking for