Urgent help in reading data from oracle

Hi All
I was reading the data from an oracle database table through jdbc and storing them in an ArrayList, since there were around 1000 records and performing the action by iterating through the arrayList
But now the record count has gone up to 200000, so i don't want to store them in the ArrayList rather process them one after the other so that i can save the memory of the ArrayList
What are the best ways of achieving this, do i need to use some tools or anything, please let me know?
Any help would be greatly appreciated.
Thanks
Diana

Reading one record at a time from the database is very very very slow. I suggest keeping it in a large array. Memory is cheap. Read up on 'java -xmx' on how to increase the amount of memory available for java if you think you are running out of memory.
Do you really need all fields in a record and all records?
If still need to process all records, you can fetch a subset of records (say, 10000) and process them, then fetch another subset. Your sql may support fetching a subset but I dont recall the syntax.

Similar Messages

Gurus..need help in reading data from virtual infocube

Gurus,
I have to read data from an virtual infocube...I am trying to use FM RSDRI_INFOPROV_READ to read data but it doesn't work..
I am doing exactly what has been done in the demo program RSDRi_INFOPROV_READ_DEMO...
Please help me...its really URGENT...
Thanks
sam

Check out this thread....
must be helpful
Re: Read data from 0BWTC_C02 via ABAP

Read data from Oracle , not all data brought over

I have a strange problem when read data from Oracle and save to SQL Server.
For example , there are 20k rows of data in Oracle , I created SSIS data flow, and data saved in SQL Server , Everything looks fine. But late you will find only first 16k rows of data in SQL Server , the rest is simple missng. no error or any waring.
I am using OLE DB .
Great appreciate for any help.
Ray

Thanks. I think that UseSessionFormat=true
helped me fixed this kind of issue in my other project.
I actually found out this issue for this case I was asking. I am actually not missing data. It was a data type issue. A column was using a wrong datatype, so when I run a query and didn't get result I supposed.

Problem reading data from oracle database 11g using OleDbDataReader

Hi everyone I work with Visual Studio 2010 and C# programming language. I have a problem reading data from the oracle database. I created a WPF application with my main Window Xaml and class files and 1 more class called DataFiles. The thing I want is to read some data from the database on my grid in my WPF window. Problem is even though it connects to the database the grid is always empty. It isn't the connection string as I tested it and it connects to the database the problem seems to be in showing the LASTNAME (PREZIME in my native tongue) on the grid which is what it's supposed to do.
Here is the code:
Data Files Code
using System;
using System.Collections.ObjectModel;
using System.Data.SqlClient;
using System.Data.OleDb;
namespace SQLKonekcija
    public class clsEmployee
        public string Prezime { get; set; }
    public class DataAccess
        OleDbConnection oleCon;
        OleDbCommand oleComd;
        public DataAccess()
            string connectionString = "provider=ORAOLEDB.ORACLE; data source=ORCL; password=****; user id=****;";
            oleCon = new OleDbConnection(connectionString);
        public ObservableCollection<clsEmployee> GetAllEmployee()
            ObservableCollection<clsEmployee> EmpCol = new ObservableCollection<clsEmployee>();
            oleComd = new OleDbCommand();
            oleComd.Connection = oleCon;
            oleComd.CommandText = "Select PREZIME from UPOSLENICI";
            oleCon.Open();
            OleDbDataReader Reader = oleComd.ExecuteReader();
            Reader.Read();
            while (Reader.Read())
                EmpCol.Add(new clsEmployee()
                    Prezime = Reader["PREZIME"].ToString()
            oleCon.Close();
            return EmpCol;
        }And here is my main window.cs code
public partial class MainWindow : Window
        clsEmployee objEmpToAdd;
        DataAccess objDs;
        public MainWindow()
            InitializeComponent();
        private void Window_Loaded(object sender, RoutedEventArgs e)
            objDs = new DataAccess();
            dgEmp.ItemsSource = objDs.GetAllEmployee();And the XAML
<Window x:Class="SQLKonekcija.MainWindow"
        xmlns="http://schemas.microsoft.com/winfx/2006/xaml/presentation"
        xmlns:x="http://schemas.microsoft.com/winfx/2006/xaml"
        Title="MainWindow" Height="350" Width="525" Loaded="Window_Loaded">
    <Grid>
        <DataGrid AutoGenerateColumns="False" Height="237"
                  HorizontalAlignment="Left" Margin="18,66,0,0" Name="dgEmp"
                  VerticalAlignment="Top" Width="466" ColumnWidth="*"
                   >
            <DataGrid.Columns>
                <DataGridTextColumn Binding="{Binding PREZIME}" Header="Prezime"></DataGridTextColumn>
            </DataGrid.Columns>
        </DataGrid>
        <TextBlock Height="42" HorizontalAlignment="Left" Margin="18,15,0,0" Name="textBlock1" Text="TEST CONNECTION" VerticalAlignment="Top" Width="462" TextAlignment="Center" FontSize="28" FontWeight="ExtraBold" />
    </Grid>
</Window>
The guys on the MSDN forums told me I should ask the question here so sorry if it's not your field.
Hope u guys can help, thanks.

I tried it, commented out the reader.read and have the following connection string
string connectionString = "provider=ORAOLEDB.ORACLE; data source=ORCL; password=****; user id=****; OLEDB.NET=True"
Unfortunately the result is the same.
Edited by: Dino2dy on Nov 24, 2011 12:53 AM

Urgent help on reading data into ByteBuffer

Hi,
I am trying to read data into ByteBuffer using SocketChannel.
The following code working fine but the problem is with ByteBuffer size.
The data varies from request to request .
How do I read data into ByteBuffer with out specifing size .
The problem with size is some records has more than 500 bytes and some are less than 500 bytes.
I want to read all the data .. ( even if it has more than 500 bytes ..)
How do i solve this problem ..
Is there any way to read data dynamically from socket channel ...
Any help on this please ...
The data I have to read is in the following format ..
XXX ... yyyyy
AAA
BBBBBBBBBBBBBBBBBBBBBB
CCCCCCCCCCCCCCCCCCCC
DDDDDDDDDDDDDDDDDDDDDDd
etc ...
Here is my Code:
public ByteBuffer getResponse(byte[] request) throws Exception {
int lenth = 500;
InetSocketAddress isa = new InetSocketAddress("ip", port);
SocketChannel channel = SocketChannel.open(isa);
ByteBuffer requestBuffer = ByteBuffer.wrap(request);
channel.write(requestBuffer);
ByteBuffer responseByteBuffer = ByteBuffer.allocate(length);
int num = 0;
while (num == 0 ) {
responseByteBuffer.rewind();
num = channel.read(responseByteBuffer);
channel.close();
return responseByteBuffer;
Thanks.

Two possible solutions
1. Read in as many bytes as you can until you hit the EOS OR you fill the byte buffer. If you fill the buffer (try checking for BufferUnderFlowException), you could move the read bytes into a dynamically allocated memory Collection such as an ArrayList. When you hit the EOF, you could then do whatever else you need to do from then on.
2. I use this option: Implement a site local protocol for transmitting data. Provide a header first containing 2 ints (compressed size, uncompressed size - so you can also use compression when sending), and send the remainder as a payload.
Therefore
Read in the header first (always 8 bytes)
Then extract those integer values. They will tell you how much is being sent. Set you byte buffer for the payload to be the correct size for this transmission.
Reset and wait for next connection

Urgent: Problem with reading data from cube.

Hi Gurus,
I am trying to read the data from the cube. Below is my code. It returns nothing. Could any please help me to solve this.
TYPES:
BEGIN OF S_DATA,
    Z_CHAR1    like /BIC/CTABLE-ZCHAR1,
    Z_CHAR2    like /BIC/CTABLE-ZCHAR2,
    Z_CHAR3    like /BIC/CTABLE-ZCHAR3,
    Z_FISCPER like /BIC/CTABLE-0FISCPER,
    0AMOUNT    type p DECIMALS 2,
END OF S_DATA.
data:
       i_s_data TYPE s_data,
       i_t_data TYPE STANDARD TABLE OF s_data
                      WITH DEFAULT KEY INITIAL SIZE 10,
       c_data TYPE s_data occurs 0 with header line,
       i_s_sfc   TYPE rsdri_s_sfc,
       i_th_sfc TYPE rsdri_th_sfc,
       i_s_sfk   TYPE rsdri_s_sfk,
       i_th_sfk TYPE rsdri_th_sfk,
       i_s_range TYPE rsdri_s_range,
       i_t_range TYPE rsdri_t_range.
DATA: end_of_data TYPE rs_bool,
     clear: i_th_sfc.
     g_s_sfc-chanm    = 'Z_CHAR1'.
     g_s_sfc-chaalias = 'Z_CHAR1'.
     g_s_sfc-orderby = 0.
     INSERT i_s_sfc INTO TABLE i_th_sfc.
     clear: i_s_sfc.
     g_s_sfc-chanm    = 'Z_CHAR2'.
     g_s_sfc-chaalias = 'Z_CHAR2'.
     g_s_sfc-orderby = 0.
     INSERT i_s_sfc INTO TABLE i_th_sfc.
     clear: i_s_sfc.
     g_s_sfc-chanm    = 'Z_CHAR3'.
     g_s_sfc-chaalias = 'Z_CHAR3'.
     g_s_sfc-orderby = 0.
     INSERT i_s_sfc INTO TABLE i_th_sfc.
     clear: i_s_sfc.
     g_s_sfc-chanm    = 'Z_FISCPER'.
     g_s_sfc-chaalias = 'Z_FISCPER'.
     g_s_sfc-orderby = 0.
     INSERT i_s_sfc INTO TABLE i_th_sfc.
     clear: i_s_sfk..
     g_s_sfk-kyfnm    = '0AMOUNT'.
     g_s_sfk-kyfalias = '0AMOUNT'.
     g_s_sfk-aggr     = 'SUM'.
     INSERT i_s_sfk INTO TABLE i_th_sfk.
      clear: i_t_range, i_s_range.
      i_s_range-chanm    = 'Z_FISCPER'.
      i_s_range-sign     = rs_c_range_sign-including.
      i_s_range-compop   = rs_c_range_opt-equal.
      i_s_range-low      = 200601.
      i_s_range-high     = 200606.
      APPEND i_s_range TO i_t_range.
        CALL FUNCTION 'RSDRI_INFOPROV_READ'
          EXPORTING
            i_infoprov             = 'ZC_CUBE'
            i_th_sfc               = i_th_sfc
            i_th_sfk               = i_th_sfk
            i_t_range              = i_t_range
            i_reference_date       = sy-datum
            i_save_in_table        = rs_c_false
            i_save_in_file         = rs_c_false
            i_packagesize          = 20
          IMPORTING
            e_t_data               = i_t_data
            e_end_of_data          = end_of_data
          CHANGING
            c_first_call           = i_first_call
          EXCEPTIONS
            illegal_input          = 1
            illegal_input_sfc      = 2
            illegal_input_sfk      = 3
            illegal_input_range    = 4
            illegal_input_tablesel = 5
            no_authorization       = 6
            ncum_not_supported     = 7
            illegal_download       = 8
            illegal_tablename      = 9
            OTHERS                 = 11.
            append lines of I_t_data to c_data.
Thanks
Regards
aarthi
[email protected]

Due to the nature of the cube design, that would be difficult, that's why there are API's, FMs, and MDX capabilities - to eliminate the need to navigate the physical structure. Otherwise you would have to concern yourself with:
- that there are two fact tables E and F that would need to be read. The Factview could take of this one.
- you would want to be able to read aggregates if they were available.
- the fact table only as DIM IDs or SIDs (for line item dims) to identify the data, not characteristic values. A Dim ID represents a specific combination of characteristic values.

Need help in reading data from Database.

Hi experts,
I have created a custom smartforms and custom print program. In my print program i have read all the data and populated the internal table and i am able to display the data in the smartform output.
I'm using Tcode me23n to print preview the form. i have to read the "text" tab from the me23n tcode using FM "READ_TEXT". The data is getting populated into an internal table. I coded these statements in Initialization tab in global definition.
Now my problem is ..... Can anyone tell me how to display the data into the forms.
please help.
Thanks

Follow below example to using FM 'READ_TEXT'
DATA BEGIN OF i_tlines OCCURS 0.
        INCLUDE STRUCTURE tline.
DATA END   OF i_tlines.
DATA: w_textname(70) TYPE c.
w_textname = vbdkr-vbeln.
CALL FUNCTION 'READ_TEXT'
    EXPORTING
      client                        = sy-mandt
      id                            = 'Z006'
      language                      = 'E'
      name                          = w_textname
      object                        = 'VBBK'
    TABLES
      lines                         = i_tlines.
IF sy-subrc = 0.
    READ TABLE i_tlines INDEX 1.
    t_in-m1 = i_tlines-tdline.   "Now t_in_m1 will have the value
ENDIF.
Regards,
SaiRam

Need Help in reading data from URLConnection in servlets

hi i created GUI which sends d username n password to the servlets via URLConnection.n am sending the same to Server program via sockets.but when i read d data in the servlet am getting only null value...need help here....
This is my button's ActionPerformed code
private void LoginActionPerformed(java.awt.event.ActionEvent evt) {
String uname = UserName.getText();
char [] pwd = PassWord.getPassword();
String pword = new String(pwd);
try
String url = "http://localhost:8080/MIMServlets/hit";
URL ucon = new URL(url);
URLConnection conn = ucon.openConnection();
conn.setDoOutput(true);
conn.setDoInput(true);
          conn.setUseCaches (false);
conn.setDefaultUseCaches (false);
conn.setRequestProperty("Content-Type", "text/plain");
System.out.println(uname);
     System.out.println(pword);
     PrintWriter out = new PrintWriter( conn.getOutputStream() );
BufferedReader in = new BufferedReader(
new InputStreamReader(
conn.getInputStream()));
     out.print(uname);
out.print(pword);
     out.close();
String inputLine = in.readLine();
Status.setText(inputLine);// TODO add your handling code here:
}catch(MalformedURLException e)
System.out.println("Exception"+e);
catch(IOException e1)
System.out.println("Exception"+e1);
This is my Servlet code........
import java.io.*;
import java.net.*;
import java.util.*;
import java.sql.*;
import javax.servlet.*;
import javax.servlet.http.*;
public class MIMServlets extends HttpServlet
PrintWriter out,out1;
     BufferedReader in,in1;
     String host = "localhost";
     String fromServer = "";
     String username,password;
     int a;
     public void init()
out=null;
out1=null;
public void doPost(HttpServletRequest request,HttpServletResponse
               response)throws ServletException,IOException
          response.setContentType("text/html");
          out=response.getWriter();
          try{
          InetAddress address = InetAddress.getByName(host);
Socket theSocket = new Socket(address, 4444);
out1 = new PrintWriter(theSocket.getOutputStream(),true);
in = new BufferedReader(new InputStreamReader(theSocket.getInputStream()));
in1 = new BufferedReader(new InputStreamReader(request.getInputStream()));
          String username = in1.readLine();
          String password = in1.readLine();
System.out.println(username);
          System.out.println(password);
out1.println(username);
          out1.println(password);
          out1.println("Yahoo");
          out1.flush();
while ((fromServer = in.readLine()) != null)
out.println("From Server: " + fromServer);
          break;
     out1.close();
in.close();
theSocket.close();
     }catch(IOException e)
System.out.println("Exception");
System.exit(-1);
          public void destroy()
     out.close();
thanks in advance.......

Follow below example to using FM 'READ_TEXT'
DATA BEGIN OF i_tlines OCCURS 0.
        INCLUDE STRUCTURE tline.
DATA END   OF i_tlines.
DATA: w_textname(70) TYPE c.
w_textname = vbdkr-vbeln.
CALL FUNCTION 'READ_TEXT'
    EXPORTING
      client                        = sy-mandt
      id                            = 'Z006'
      language                      = 'E'
      name                          = w_textname
      object                        = 'VBBK'
    TABLES
      lines                         = i_tlines.
IF sy-subrc = 0.
    READ TABLE i_tlines INDEX 1.
    t_in-m1 = i_tlines-tdline.   "Now t_in_m1 will have the value
ENDIF.
Regards,
SaiRam

Urgent help with simple BPEL process for reading data from database

Hello there,
I need help with BPEL project.
i have created a table Employee in Database.
I did create application, BPEL project and connection to the database properly using Database Adapter.
I need to read the records from the database and convert into xml fomat and it should to go approval for BPM worklist.
Can someone please describe me step by step what i need to do.
Thx,
Dps

I have created a table in Database with data like Empno,name,salary,comments.
I created Database Connection in jsp page and connecting to BPEL process.
It initiates the process and it goes automatically for approval.
Please refer the code once which i created.
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd">
<%@page import="java.util.Map" %>
<%@page import="com.oracle.bpel.client.Locator" %>
<%@page import="com.oracle.bpel.client.NormalizedMessage" %>
<%@page import="com.oracle.bpel.client.delivery.IDeliveryService" %>
<%@page import="javax.naming.Context" %>
<%@page import="java.util.Hashtable" %>
<%@page import="java.util.HashMap" %>
<%@ page import="java.sql.*"%>
<%@ page import= "jspprj.DBCon"%>
<html>
<head>
<title>Invoke CreditRatingService</title>
</head>
<body>
<%
DBCon dbcon=new DBCon();
Connection conn=dbcon.createConnection();
Statement st=null;
PreparedStatement pstmt=null;
Hashtable env= new Hashtable();
ResultSet rs = null;
Map payload =null;
try
env.put(Context.INITIAL_CONTEXT_FACTORY, "com.evermind.server.rmi.RMIInitialContextFactory");
env.put(Context.PROVIDER_URL, "opmn:ormi://localhost:port:home/orabpel");//bpel server
env.put("java.naming.security.principal", "username");
env.put("java.naming.security.credentials", "password");//bpel console
Locator locator = new Locator("default","password",env);
IDeliveryService deliveryService =
(IDeliveryService)locator.lookupService(IDeliveryService.SERVICE_NAME );
// construct the normalized message and send to Oracle BPEL Process Manager
NormalizedMessage nm = new NormalizedMessage();
java.util.HashMap map = new HashMap();
st=conn.createStatement();
out.println("connected");
String query1="Select * from EMPLOYEE";
rs=st.executeQuery(query1);
/*reading Data From Database and converting into XML format
so that no need of going to BPEL console and entering the details.
while (rs.next()){
String xml1 = "<AsynchBPELProcess1ProcessRequest xmlns='http://xmlns.oracle.com/AsynchBPELProcess1'>"+
"<Empno>"+rs.getString(1)+"</Empno>"+
"<EmpName>"+rs.getString(2)+"</EmpName>"+
"<Salary>"+rs.getString(3)+"</Salary>"+
"<Comments>"+rs.getString(4)+"</Comments>"+
"</AsynchBPELProcess1ProcessRequest>";
out.println(xml1);
nm.addPart("payload", xml1 );
// EmployeeApprovalProcess is the BPEL process in which human task is implemented
deliveryService.post("EmployeeApprovalProcess", "initiate", nm);
// payload = res.getPayload();
out.println( "BPELProcess CreditRatingService executed!<br>" );
// out.println( "Credit Rating is " + payload.get("payload") );
//Incase there is an exception while invoking the first server invoke the second server i.e lsgpas13.
catch(Exception ee) {
//("BPEL Server lsgpas14 invoking error.\n"+ee.toString());
%>
</body>
</html>
Its working fine.And i want it for Bulk approvals.please help me step by step procedure if any other way to implement this.

Oracle DB: How to read data from a corrupted database table.

Hi All,
Wanted to know if there is a way I could read data from a corrupted Oracle database table?
Are there any tools that I can use? Or does Oracle provides any mechanism to do that?
Any pointers in this regard would be helpful.
Thanks in Advance.

user10600611 wrote:
Table shows inconsistent data.You are going to have to be more specific. Inconsistent in what sense? A correct data model should not allow for inconsistencies to crop up.
However, you may be able to use one of the many FLASHBACK features of Oracle to look at the table at a prior point in time before the corruption.
HTH!

We want to read data from weigh bridge and display in oracle forms & store

Sir/Madam,
in our organisation we had one requirement. i.e is reading data from weigh bridge using serial port, displying that data in oracle forms and when ever user click save button we store that into my oracle database. we are using oracle 8i and forms 6i and windows OS environment. we don't know reading data from serial port and placing that into form items. please help me as early as possible if there is any property available in d2k regarding this requirement .
thank you,
vishnu

There's no property in Forms that makes you read serial ports, but as far as I know you need to know the API of the machine which you want to read data from (it should come with machine's manual) and then it will be easy to store it in forms item.
Tony

Read data from Excel and write into oracle database

Hi
I want to know how can i read data from excel and write into oracle database using java.Kindly help me out to find a solution.
Thanks and Regards
Neeta

Hai,
I am suggesting the solution.
I will try out and let u know soon.
Make a coma separated file from your excel file.
Assuming that your requirement allows to make a csv file.
This file may be passed as an file object to be read by java.Using JDBC you must be able to populate the data base.You can also use String Tokenizer if needed.
You do not want to go via sql Loader?
For reading the excel file itself do you want java?

Ugrent help. User exit- Read data from BW BPS layout and write to ODS

Hi,
I am new to BW BPS and have a req. where i need to read data from BPS layout (EXCEL) and write it to ODS.
Is there any function module or user exit which read data from excel layout and upload it to ODS. Or can any one help me out how can i write a code for this.
It is urgent and i need your help.
Appreciate any kind of input.
Thanks
Mamatha

Dear Mamatha,
read following documents. i hope it will work for you.
[http://www.geocities.com/cynarad/reference_for_bps_programming.pdf]
[Accessing BW Master Data in BPS Functions using ABAP ( Exit Function )|https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/d3dcc423-0b01-0010-4382-aa3e0784b61e]
Regards,
Malik
Give me points if its helpful for you.

Help Required -- Can we use SQL Query to READ data from SAP MDM Tables

Hi All,
Please help.........
Can we use SQL Query to READ(No Creation/Updation/Deletion just Read) Data from SAP MDM tables directly, without using MDM Syndicator.
Or direct SQL access to SAP MDM tables is not possible. Only through MDM Syndicator can we export data.
Thanks in Advance
Regards

All the tables you create in Repository comes under A2i_CM_Tables in Database named as your repository name. So the tables names are fields of table A2i_CM_Tables. Now i tried it but cant make it.
Now, I dont think its possible to extract all fields in tables and there values using select query. May be pure sql guy can do that or not.
But there is no relation of data extraction and syndicator. Data is viewed in Data Manager. and you can also store data in a file from DM also.
BR,
Alok

Read data from an external Oracle-DB: Codepage problems

Hi,
I try to get data from an external Oracle-DB which runs under NLS_CHARACTER
WE8ISO8859P1. In this DB are russian texte stored. If I read these texts via native-SQL I obviously get wrong characters. (e.g. Èíñòðóìåíòû äëÿ óãëîâîé øëèôîâàëüíîé ìàøèíû instead of Инструменты для угловой шлифовальной машины). If I save the text as a html file and then open it with IE. I can change the encoding and get the right view.
Has anybody got an idea ? (Mabye I can read the data in a different codepage or maybe there is a possibility to convert the codepage in SAP after reading it from oracle)
Thanks a lot !!!!

The problem is solved.
Many thanks !

Urgent help in reading data from oracle

Similar Messages

Maybe you are looking for