Fast data retrieval from large tables
Hello,
we have created a table in oracle 10g DB. at an average there are around 20-30 rows inserted onto the table. so in 1 mnth the record count for the table is around 800-900 rows.
in one year which is becoming to 10,000 rows. so speed up data retreval from this bulk data we need suggestion. various things that come to my mind are -
Indexing of table/# Index of table/partitioning of table/materialized view etc.
but not sure what exactly needs to be done here. please suggest on how smooth data retreival can be chaived whatever be the size of the table.
Thanks,
Sam
Here is a simple look of your data progression.
year Row
1 10,000
5 50,000
10 1,00,000
50 5,00,000
100 10,00,000You need to wait another 100 years to reach a million. And million is not a big number when it comes to Oracle.
So as others have stated what the objective behind your question?
basically the choice of Index or Partition mainly depends on how the data is going to be accessed from a table. If I am going to access all the rows of a table every time then there is no use of both the features. I would just prefer a FTS. In that situation i would be looking how to optimize my FTS.
So you need to set you objective clear before picking up the solution. Just because you have a hammer you cant go around banging the wall ;)
Similar Messages
-
Data Retrieval from Cluster Table - BSEG
Hi all,
I need to retreive data related to document line items from BSEG whose CLEARING DATE (AUGDT) is greater than a user given date for TWO COMPANY CODES (say 0010/0200).
as BSEG is a cluster table, it has huge data and taking large amt of time can anybody suggest a better way of retrieving data for the above conditions(fastly)
Thanks in Advance,
Lakshmihi,
use second. index tables:
customers: BSAD
vendors: BSAK
G/L acc.: BSAS
sample:
SELECT (felder) FROM bsad into TABLE stab
WHERE bukrs = bukrs
AND kunnr IN kunnr
AND gsber IN gsber
AND augbl <> space
AND hkont IN akont
AND augdt GT p_date.
regards Andreas
Message was edited by: Andreas Mann -
I need to retrieve data from ZL table and prepare a report comparing the Actual, Previous and Old records in the table for an employee for a particular period.
Are there any particular function modules for this data retrieval?
Thanks.Hi bala,
I did not get what you were trying to tell me. I went to SE37 and tried for anything that starts with "zlit" .. but returned no results.
And also I dont want time management to payroll.
I want to retrieve data from the B2 in PCL2 cluster.
i.e I want to retrieve data from the ZL table in the cluster for a particular payperiod and particular employee.
Thanks very much in advance! -
Function modules for data retrieval from diff. tables
Hi,
I would just like to ask if there are function modules that can be used to retrieve data from the ff. tables:
TSAD3T
KNVV
ESTRH
for TSAD3T i need to get the value of title_medi
for KNVV i need to get the fields klabc vkorg vtweg
for ESTRH i need to get the fields subcat subid.
Thanks.I doubt if you have such a FM
-
Data retrieve from one table control to another table control
Hi all,
I had an requirement like to create Two table controls.
for first Table control i had an sel field defined as 'MARK'.
when i check the row in the first table control think it is header data for sales order .
all the item details have to retrieve in the second table control.
This is my requirement, i am not able to trigger when selecting the row in table control.
will anybody had an experience like this.
Regards,
MadhaviHi Madhavi,
If we need the case to display header and item as mentioned in 2 table controls....
we can display in table control 2/item only (the line items of the one selected in the table control 1 or the header )...so ,at a time we need to display line items for only 1 header ....
so ...first disable the selections/multiple selections to disable the row selector
We have already declared a field type C to capture the value for the field selector...so we can convert this field to a radio button and then assign a function code to the radio button at screen level
Whenever you click on the radio button ..immediately the function code is triggered..then in PAI ..we can check and find the header record with 'X' and populate the data for the table control 2
Hope it helps
Regards
Byju -
Data retrieval from keko table with conditions as for a group of same mat
hi Freinds,
the problem iam facing here is i have certain materials in table keko , among which i need to retrieve the material with date as the latest one for that particular material provided costing status is 'FR' and Release is "X'.
here is the example i gave where material 14ce2-1krs has 3 different dates , i need to retreive the latest one .... like this for 15ce2..
plz reply ... thanks...
Material Costing Date Costing Status Release 14CE2-1K-RS 02.25.2007 FR 14CE2-1K-RS 04.01.2007 FR X 14CE2-1K-RS 04.29.2007 FR X
15CE2 01.20.2007 FR X
15CE2 03.10.2007 FR X
15CE2 05.14.2007 FR X
15CE2 07.22.2007 FR XHi,
Sort ITAB by <Material> <Date> descnding.
Delete adjacent duplicates comparing Material.
Then table will contain material with latest date.
Hope this helps... -
Hi,
I have used smartforms for generating suppler payment statement for financial department. more time duration is taken by the program when it is generating.
I think this problem comes while data fetching from BSEG table. because, it has more records for one vendor ID.
I want reduce this time duration.
Please guide me.Have you tried this selection in se16? I'm quite sure that It will take
a long time.
The problem has been explained in this group before and I think you
should search for bseg in the answers given.
As a hint: It has to do with the selection universe. You are restricting
only bukrs from the primary key (all the other restrictions in your
where clause are filters that are applied on SAP's side (not on the
database side)). The problem is that bseg isn't stored as separated
fields in the RDBMS, but as a table with the primary key and a stream of
bits in a raw field.
You should review and change the logic you're using before reading bseg.
It's the only way you'll improve the performance of this select. (for
example, you could use one or more secondary index tables - bi or ba
to retrieve belnr and access bseg with a better where clause). -
Tell me how to format a date retrieved from a MS SQL Server 2000 database?
Tell me how to format a date retrieved from an MS SQL Server 2000 database for various uses in my JSP page?
Or if you want to use JSTL instead of a scriptlet see:
http://forum.java.sun.com/thread.jspa?threadID=676754&tstart=0 -
While Creating New Insert Form Existing Data Display from the Table
Hi
I am New To Sun Java Studio Creator and New to Java Also While Creating New Insert Form Existing Data Display from the Table while i am Run the Form. Can any one help me to Solve this oneDear Giri,
As per your Advise, Literally I have Search the Properties for the Components to set value Null, but I am Unable to find the Value in Properties palate. I have tried in various options like
In the Properties Palate
TextField1_onselect use Value null
TextField1_text I have selected use Value option and I have manually Keyed-in null;
In the JSP Page, I have manually keyed in the null value below said
<ui:textField binding="#{BI.textField2}" id="textField2" style="position: absolute; left: 240px; top: 96px" text="#{BI.bDataProvider.value['ISSUENO'] = null}"/>
<ui:textField binding="#{BI.textField2.Value = null }" id="textField2" style="position: absolute; left: 240px; top: 96px" text="#{BI.bDataProvider.value['ISSUENO'] = null}"/>
At last I am Failure. I am ignorant of it. Can you please help me on this where I have to set null value for the components? I will be very kind of you -
Data fetching from Standard tables or transaction to SAP PI
Dear Friends !
Good day ! How are you ?
I have one requirement , My client asks me to develop a solution in that I should get the data from standard SAP tables like EKKO, EKPO ( MM related ) etc.. and send it to PI system and then PI system sends it to third party system database system.
We have current scenario is working fine, I have abap proxy that I called in various standard transaction codes ( MIRO, MIGO, etc ) ' Baddis just beforethe commit stament and it passed the data to SAP PI system and it sends to SQL system.
but my client dont want me to use Baddis. Client wants like u should read from those EKKO,EKPO tables as soon as you get new entry there and send it to PI system. I have no clue How can I go further in that. Shall I use events ? but then question is same I need to trgger them somewere? Is any one have idea How I can send the data to PI system frm SAP standard tcodes and tables without using Baddis.
Please reply me. your any help will be appreciated.
Regards
NaeemThe current Approach of your development perfectly good approach,
it is not possbiel to read data directly from SAP Tables, you have to use IDoc/RFC/Proxy,if you want to avoid BADI's then better to contact ABAP Team, they will help you different approches .
But you have to use Porxy/IDoc/BAPI for sure.
Regards,
Raj -
Value Set whose Data come from customize table with distinct record
Dear All,
I am new in Oracle EBS, currently i am creating value set whose data come from customize table which have 40 duplicate record in which distinct column return 27 record .
Table XX_ROUND_SET
Columns (Transactions_id,set_record)
Total Record (40)
Distinct Record (Set_Record --> 27)
I just want to show only 27 record in it.
Thanks
RehanHi Rehan,
PL.IGNORE MY EARLIER UPDATE AND TREAT THIS UPDATE AS YOUR SOLUTION.
Method 1
Create the VIEW based on DISTINCT values; use the VIEW for creates the VALUESET.
Method 2
Paste the QUERY in TABLE field with alias name, and give the column name (with alias name).
(in your case )
TABLE NAME : ( select distinct transactions_id, set_record from XX_ROUND_SET ) Y
VALUE : Y.transactions_id
HTH
Sanjay -
Need to load large data set from Oracle table onto desktop using ODBC
I don't have TOAD nor any other tool for querying the database. I'm wondering how I can load a large data set from an Oracle table onto my desktop using Excel or Access or some other tool using ODBC or not using ODBC if that's possible. I need results to be in a .csv file or something similar. Speed is what is important here. I'm looking to load more than 1 million but less than 10 million records at once. Thanks.
hillelhalevi wrote:
I don't have TOAD nor any other tool for querying the database. I'm wondering how I can load a large data set from an Oracle table onto my desktop using Excel or Access or some other tool using ODBC or not using ODBC if that's possible. I need results to be in a .csv file or something similar. Speed is what is important here. I'm looking to load more than 1 million but less than 10 million records at once. Thanks.
Use Oracle's free Sql Developer
http://www.oracle.com/technetwork/developer-tools/sql-developer/downloads/index.html
You can just issue a query like this
SELECT /*csv*/ * FROM SCOTT.EMP
Then just save the results to a file
See this article by Jeff Smith for other options
http://www.thatjeffsmith.com/archive/2012/05/formatting-query-results-to-csv-in-oracle-sql-developer/ -
Saving data retrieved from text file to JDBC table
Hi,
I would like to save data, loaded from a text file to a dataset, into an existing JDBC table.
The documentation I found on this subject is very brief, and no matter how I tried, I couldn't succeed.
I would appreciate any help.
Thank you in advanceHi there,
Here is an example of reading a String and a date from a text file. Once you have what you need in the Strings (or whatever) it should be easy to insert them into and SQL statement. Let me know if you need an example of this as well and I'll post it in the morning. Right now I'm off to bed :o)
Cheers
Mark
import java.io.*;
import java.util.*;
import java.text.*;
public class WriteTest {
public static void main(String [] arg) throws Exception {
Date today = new Date();
String name = "";
SimpleDateFormat formatter = new SimpleDateFormat("ddMMyyyy");
File myfile = new File("hello.txt");
// how to input
BufferedReader in = new BufferedReader(new FileReader(myfile));
String name="",
date="";
boolean eof = false;
do {
name = in.readLine();
date = in.readLine();
if(!(eof = (name==null || date==null)))
System.out.println(name+" "+formatter.parse(date));
while(!eof);
} -
How to get data from large table (more than 9 million rows) by EJB?
I have a giant table, it has more than 9 million rows.
I want to use ejb finders method to get data from this table but always get not enough memory error or time out error,
Can anyone give me solutions?
ThxYour problem may be that you are simply trying to load so many objects (found by your finder) that you are exceeding available memory. For example if each object is 100 bytes and you try to load 1,000,000 objects thats 100Mb of memory gone.
You could try increasing the amount of memory available to OC4J with the appropriate argument on the command line (or in the 10gAS console). For example to make 1Gb available to OC4J you would add the argument:
-Xmx1000m
Of course you need have this available as hard memory on your server or you will incur serious swapping.
Chris -
Data Retrieval from SSRS 2008 R2 to SQL Server 2012 standard
Hello,
We have a virtual machine running SSRS 2008 R2 and a physical server running SQL server 2012 standard. We are having an issue with a report that is taking almost 10 minutes for the data to be retrieved from the sql 2012 database. We used the
execution logging query to debug and analyze. We see that it renders and processes very fast, but the data retrieval time is very slow. When the same query is run using sql studio mgr. from the SSRS server it runs just fine...it
takes seconds for the results to come up.
I don't believe there is a compatibilty issue because other reports run fine. We're just having problems with one report.A long shot, but I've seen where the data type of a report parameter is mismatched against the data type of the table it is being compared against. SQL profiler would show this clearly.
This would explain why the query returns quickly in ssms but not with the report.
Maybe you are looking for
-
How to delete one perticular message from a user and not the whole messages
hi i would like to know how can i delete a single message sent by a person and not the complete list of message received by me from the same person also how can i forward a message received by me
-
I sold my iPod 5 and now getting random texts
So, I sold my iPod 5, I thought I deleted everything but apparently I did not. So now I have an iPhone 5c, and someone has been recieving my texts, and I also revieve thiers from their e-mail! They will text someone and it will show up that I did so.
-
Inbox time received doesn't reflect Daylight Savings - Timestamp Correct
The inbox list view in Mail of From, Subject, Date and Time Received does not reflect the correct time. The email itself in the header has the correct time received however the list view is an hour ahead. Considering the last time change was springin
-
Unusually high CPU usage in Snow Leopard (10.6.1)
I upgraded from Leopard to 10.6.1 and the fans started to run a lot more often then they did in Leopard. I checked 'Activity Monitor' and the processes that usually were consuming 99-100% CPU and heating up the notebook were Dashboard Client or Syste
-
R3load argument values for OS/DB migration from HP-UX/ORA to WINTEL/MSSQL
Greetings, I am looking for a comprehensive list of R3load task and load argument values for both export and import. We are using distribution monitor 1.9.1 I'm looking for possible values for the following parameters in distmon properties file. r3lo