JDBC to CSV file Scenario
Hi ALL,
I have a scenario where the integration results in the jdbc to csv file format.
Here the data is following from non-sap system (Ccure system with progress database) to SAP (ECC).
we have pull data from non-sap on daily bases that is once in a day (say morning @ 7 am), create a file in csv format and place this file in ECC.
the issue over is, how to make it run on daily basis and retrieve only particular information from the progress database.
please put on your thoughts on this issue.
Thanks,
Lalitkumar.
Hi,
how to make it run on daily basis and retrieve only particular information from the progress database.
1.how to make it run on daily basis
Through Available Time Planing in RWB--> CC Monitoring.
Here u have the option for choosing the the time at which u want to run the CC
2.retrieve only particular information from the progress database
There are lot of techniques to do this.
a. when ever u retrieve the data from Database and if it is successful them mark the record as read.
For this u can have extra column in table and set the flag as read/unread or 0/1.
when u select in next query, select based on this field also..
Babu
Similar Messages
-
MS Access (JDBC Sender) to File Scenario
Hi,
I want to read an MS Access File thru JDBC Sender Adapter & send the entire details present in MS Access to a File .
Kindly need your valid inputs on this .Hi,
I have configured Sender JDBC adpater as follows :
JDBC Driver : sun.jdbc.odbc.JdbcOdbcDriver
Connection : jdbc:odbc:Driver={Microsoft Access Driver (*.mdb)};DBQ=
piramid\data\PNG\inf78786\IN\Employee.mdb;
I am getting the following error in Communication Channel monitoring ->
Error during database connection to the database URL 'jdbc:odbc:Driver={Microsoft Access Driver (*.mdb)};DBQ=
piramid\data\PNG\inf78786\IN\Employee.mdb;' using the JDBC driver 'sun.jdbc.odbc.JdbcOdbcDriver': 'com.sap.aii.adapter.jdbc.sql.DriverManagerException: Can not establish connection:: SQLException: [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified'
What might be the issue here ? -
Hi
Needed your inputs to take forward this scenario
It is an IDOC - CSV File scenario where WBS elements are sent across in the file to the legacy system
9 fields are sent in the file and in those 2 fields are mapped with constants .
Requirement here is to have a duplication of record in the file with only one constant changed My CSV file should look like this for each IDOC occurence
AAA,0123.45,Edgbaston,1234,WBS_Code1,,Airline,
AAA,0123.45,Edgbaston,1234,WBS_Code2,,Airline,
it would just be the duplication of record with only one field changed (WBS_Code1 and WBS_code2) so that each IDOC occurence would comprise one WBSelement information sent from the IDOC and the generated file would have 2 lines of the same record
Thanks
AnushaHi
Unable to get you and I have my receiver strcuture as mentioned below .And only last 2fields are getting populated from the IDOC and rest all mapped with the constants
<?xml version="1.0" encoding="UTF-8"?>
<ns0:MT_WBSCodes xmlns:ns0="http://us.abc.com/PI/aaaat">
<WBSFile> 0..unbounded
<RecordTypeIdentifier>FIELDLISTVALUES</RecordTypeIdentifier>
<CompanyID>UNIT_TOP</CompanyID>
<CustomFieldID>CL_WBS_CODE_1</CustomFieldID>
<CustomFieldValue1></CustomFieldValue1>
<CustomFieldValue2></CustomFieldValue2>
<Status></Status>
</WBSFile>
<WBSFile>0..unbounded
<RecordTypeIdentifier>FIELDLISTVALUES</RecordTypeIdentifier>
<CompanyID>UNIT_TOP</CompanyID>
<CustomFieldID>CL_WBS_CODE_2</CustomFieldID>
<CustomFieldValue1> - </CustomFieldValue1>
<CustomFieldValue2></CustomFieldValue2>
<Status></Status>
</WBSFile>
</ns0:MT_WBSCodes>
Edited by: Anusha Ramsiva on Sep 3, 2010 4:58 PM -
File - to - JDBC- to - File Scenario using Stored Procedure
Hi,
I want to do File - to - JDBC - to - File scenario, because I'm getting data in a file format and that data i want to load in a database. Database level i have a stored procedure. if any exceptions. my stored procedure will give the Response. so, now i want to store that resposne in a file..
for this. what are the steps we have to use. is this scenario will comes in Synch ronous or Asynchronous ? and I have searched the web blogs also. al the blogs are related to Http or Soap with JDBC . so, please give me some input help about this...
how many data types we have to create... any body having step step procedure for this...
regards
JainHi,
You will need a BPM in your design as Sender File adapter does not support Synchronous messaging. Refer my answer in this thread (page 2) and have your design accordingly....instead of RFC you will have a file adapter as the ultimate receiver.
Re: BPM FILE--> JDBC--> RFC
Just take care of below things:
1) JDBC message format is as per the guidelines
[Message format for sending req to JDBC|http://help.sap.com/saphelp_nw04/helpdata/en/2e/96fd3f2d14e869e10000000a155106/content.htm]
2) check for the format of your source and target file format (if it is a Flat-file with a xml structure that XI can parse then no need of FCC but if it is a CSV file then you will need FCC)
Regards,
Abhishek
Edited by: abhishek salvi on Apr 14, 2009 7:32 PM -
JDBC-XI-FILE scenario. How to extract data from more than one table in JDBC
Hi,
I was asked a question like in JDBC-XI-FILE scenario........ How to extract data from more than one tables (i.e from JDBC system) ?? What is the logic to do the same ??
I am not sure whether this is a valid question..........but any help in this regards is highly appreciated.
Regards
KumarHI,
Yes it can be possible ,please see the following links
JDBC Receiver with Oracle Stored Procedures
configuring jdbc adapter with multiple tables
RFC -> XI -> JDBC Scenario Updating Multiple Tables
/people/alessandro.berta/blog/2005/10/04/save-time-with-generalized-jdbc-datatypes
JDBC Adapter multiple Selects
https://www.sdn.sap.com/irj/sdn/advancedsearch?query=jdbc%20with%20multiple%20tables&cat=sdn_all
Regards
Chilla.. -
What is the best way to load a csv file using JDBC link? Right now I basically read a line and insert it, batching it doesn't seem to speed it up either.
Thanks
Brian Timothy
nullHai !
I think i can help u in this as i have done almost the same thing...
In Oracle for importing the data from other databases there is one bulk insert command ie SQLLDR...This commands takes parameters as a Control File(*.ctl) and data file ie(*.csv) ......You can get more help on it on the site if you search for SQL Loader....
But i think it cann't be executed from StoredProcedure's so what i am doing is running this command from my java application using Runtime.exec("SQLLDR...................") .
I think this will help you ...You are always welcome for any more clarifications....
Regards
Brijesh Kumar
SSI-Technologies -
Help with jdbc to file scenario
Hi guys,
I want to do a JDBC to file scenario. I need to do a SELECT * query from my table.
An external application does the updation into my tables. I needed XI to connect to my JDBC system whenever there is an update in the tables and post it as a file.
Please guide me on this guys
Varunas pointed out have a indicator in ur table that is updated by the external system for setting that the record is read when the jdbc is polled. this would be help for avoiding reading the same records again and again whioch results in duplication. u can follow this blog (reve engg )
/people/bhavesh.kantilal/blog/2006/07/03/jdbc-receiver-adapter--synchronous-select-150-step-by-step -
Scenario Mail (ZIP) -- PI -- CSV file!!
Dear forum members,
I am new to PI, I have very little awareness on these environments, But I want to develop more. But in the part of my practice, I have got one scenario as follows, will you please guide me how to resolve this thing, you are highly appreciated.
one of the financial organization is sending creditcard details with mail an zip attachment( single file in CSV) format. This mail comes my client mail server. Once we receive, how does, PI knows we have received a mail? Once PI sense this how to download this zip file on app server? How to Unzip and keep it as a csv file on app server?
Once it unzips it, we can able to pick this file and transform into other CSV to receiver.
Thanks in advance
RoopaHello
As you are new to the forum, please familiarise yourself with the forum [Rules of Engagement|https://wiki.sdn.sap.com/wiki/display/HOME/RulesofEngagement]. Please note, this is an expert forum designed for expert users.
Please use the search functionality to answer basic questions which have been answered many times before.
Regards
Moderator -
Csv file to rfc scenario..process multiple rows of csv
Hi Experts,
I have been trying a few tings but has nt worked so far.. this is my scenario..
There is a csv file with say 100 rows, even if one column is erroneous the interface halts and there r no updates in the z table..
I have used 1:n multi mapping ....any idea how i can proceed to satisfy the above scenario?Hi,
This i feel to take care from the RFC side as the rfc functions looks like handling using transaction mechanisms..
which will commit only after successfully operations of all or rollback if anything in between fails...
by the way is the problem of record is with source data type itself or with in the PI ...?
or one thing you need to look is to execute the RFC for each record..which is not a performance efficient and not a good solution when you can pass all the records in a single call
HTH
Rajesh -
Dear Bhavesh,
I am doing a File to JDBC to File Scenario from your reference blog https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/3928. [original link is broken] [original link is broken] [original link is broken] [original link is broken] This scenario is same as File to RFC to File scenario I believe. The only change I found is in Message Interface.
The Message Interface used here are:
1. OB File Request
2. OB Abs File Request
3. IB File Response
4. IB Abs File Response
5. Abs Syn File Request File Response
6. Abs Syn JDBC Request JDBC Response.
I am able to get the response from JDBC but while mapping to file I am getting mapping error. In fact I have followed ur Blog as it is.
The IP steps are:
Receive Step , Syn Send (Abs Syn File Request File Response) Step , Send Step.
Could you please help me out, if you have time .
Thanks in advance.
ShaikHi ,
Sorry for pointing you the thread.
I have created the IR as it is in File RFC File Scenario, but I have created Abs Syn Message Interface for JDBC request and Response.
I have two Abs sync Message Interface and two mapping programs, namely
Source Interface:
Abs Sync Message Interface
File Request
File Response
Target Interface:
Abs Sync Message Interface
JDBC Request
JDBC Response
Mapping Interface:
File Request to JDBC Request
JDBC Response to File Response. -
JDBC wrapper for CSV files?
I wrote my own method to read in CSV files into a table structure (String[][]). For big CSV files, I added several functionalities to ignore specific data lines that have specific values. All this looks quite similar to a database table that I do a select * for and reduce the resulting rows via specific WHERE clause criterias. So I wonder if there's already such a JDBC wrapper around CSV files?
Yes. I believe the JDBC-ODBC bridge can use an Excel URL to read in a CSV. Though don't quote me on that one.
However, why not simply use your RDBMS data-import utility? You can invoke it from a scheduler or from Runtime.exec(). It should perform MUCH better than middleware for a huge CSV file. If manipulation needs to occur for the data, write it first to a temp table, then manipulate it.
- Saish -
Hi All,
Could JDBC API read off values from an excell csv file? Such that they could be transferred easily to JTables? Thanx again ^^you could configure the "Microsoft Text Driver" (which is for CSV and text files), from 32-bit ODBC option of control panel in Windows Systems (if u r using windows).
Then u can query using normal JDBC SQL syntax,
Class.forName("sun.jdbc.odbc.JdbcOdbcDriver");
Connection con = DriverManager.getConnection("jdbc:odbc:myDsn");
Statement stmt = con.createStatement();
ResultSet rs = stmt.executeQuery("select * from myCsvFile.csv");
Priya. -
Hi all,
I am designing a scenario following the given blog:
<i><b>/people/kausik.medavarapu/blog/2005/12/29/csv-file-lookup-with-http-request-and-response-in-xi
In this blog i am mainly dealing with the first half i.e the CSV File Lookup part.
I have created the csv file as mentioned. Converted it into a jar and included that jar file in the repository under the Imported Archive tab.
I have done certain manipulation in the given code to suit my design:
<b>String price = "0";
try
Class.forName("<i>the name of my imported jar file</i>");
Connection con=DriverManager.getConnection("jdbc:driver:""/""/"+"pciib04530/users/");
PreparedStatement stmt=con.prepareStatement("select itemno,price from price where itemno=?");
stmt.setString(1,a);
ResultSet rs=stmt.executeQuery();
while(rs.next())
price = rs.getString("price");
con.close();
return price;
catch(Exception e)
return "-1";
}</b>
On testing the mapping the error msg i get is Method findPrice with 1 arguments not found in class com.sap.xi.tf._Request_MM_
where findPrice is the name of my method and Request_MM is my message mapping.
I dont know what is wrong.
Pls guide.
If anyone can mention help documents on CSV Lookup, it would be very helpful.
Thanks in advance
Regards
NeetuHi Prashanth,
I have already gone through the both the blogs mentioned by you.
The first one speaks about CSV Lookup.
Here the author mentions about some driver <b><i>"its possible by means of a driver that makes the flat file (here CSV file) to appear as a database table to the API."</i></b>
But he does not mention the name of the driver.
The Blog is also not very elaborate.
Can you suggest the name of the driver?
Regards,
Neetu -
If CSV file contains multiple structure...
If CSV file contains multiple structures...then how should set vaules in file content conversion.
pls mention any links regarding File Content Conversion
thanks in advance..
RameshHi,
You are using RecordSet. Here are some scenarios.
http://help.sap.com/saphelp_nw04/helpdata/en/2c/181077dd7d6b4ea6a8029b20bf7e55/frameset.htm
/people/venkat.donela/blog/2005/03/03/introduction-to-simple-file-xi-filescenario-and-complete-walk-through-for-starterspart2
/people/prateek.shah/blog/2005/06/08/introduction-to-idoc-xi-file-scenario-and-complete-walk-through-for-starters - IDoc to File
/people/ravikumar.allampallam/blog/2005/03/14/abap-proxies-in-xiclient-proxy - ABAP Proxy to File
/people/sap.user72/blog/2005/06/01/file-to-jdbc-adapter-using-sap-xi-30 - File to JDBC
/people/prateek.shah/blog/2005/06/14/file-to-r3-via-abap-proxy - File to ABAP Proxy
/people/venkat.donela/blog/2005/03/02/introduction-to-simplefile-xi-filescenario-and-complete-walk-through-for-starterspart1 - File to File Part 1
/people/arpit.seth/blog/2005/06/27/rfc-scenario-using-bpm--starter-kit - File to RFC
https://www.sdn.sap.com/irj/sdn/weblogs?blog=/pub/wlg/1685 [original link is broken] [original link is broken] [original link is broken] [original link is broken] - File to Mail
Regards,
Wojciech -
Hello All,
I have a simple scenerio IDOC to File.
We had a requirement of making a XML file of IDOC received in PI , ery simple and straight forward.
Now Target side as a requirement to place a file in CSV format.
I mean the IDOC received in PI should be placed in target directory as CSV file.
I am working on PI7.11 , can anyone help me with some info.
Thanks a lot in advance.
Regards,
VikrantHi Vikrant,
>>Now Target side as a requirement to place a file in CSV format. I mean the IDOC received in PI should be placed in target directory as CSV file.
If you want the XMLized IDoc to be converted to a plain IDoc, either use the approach suggested by Michal in this blog (use tunneling and create a by-pass scenario)
/people/michal.krawczyk2/blog/2005/11/21/xi-idoc-to-idoc-tunneling--how-fast-and-easy-can-you-get
or
download the IDoc as a flat Idoc and use PI to transfer the content from one directory to another.
PS: All this is applicable if you want the Flat version of XMLized Idoc
Regards
Suraj
Maybe you are looking for
-
Hello, I have a problem with web dynpro. I want to include several links in an image. Is there any possibility I can define a "link-area", which acts as link, when I press it? If that doesn't work, is there a solution to position a button (or more) o
-
Hi all, I m using Condition Based Receiver Determination where I need to map different receivers based on the existence of a particular field. i.e. if a particular field exists- Receiver A if it doesnt exists - Receiver B There is a operator
-
How to make iPod Touch screen more sensitive?
My iPod touch screen is not very sensitive to the touch. Sometimes i have to press down with a little force to get it to press what i want. I have tried other peoples iPod's, and compared to theirs, mine is not very sensitive. PLEASE HELP!
-
Dear Sir, We need to generate a Report showing all changes made in a BOM during a period . For making such a Report we are facing following problem : a) The problem related to DELETED Item : Say on 01/04/2009 , for a Material BOM of Item 'HEADER
-
Functional module for 12 MONTHS AVERAGE SALARY
hi all, I want to get the average salary for an employee for past 12 months from cluster tables. I believe the cluster table for that is PCL2? . I want to know the name of the function module to get the average salary for an employee for past 12 mont