Does use of pipelined/pipe row have a limitation on amount of data returned
We are using Oracle 9i.
We have an existing function that pipes data. Select * from table(cast(schema.my_pkg.get_data() as schema.t_my_data_tab))
Function runs, but only returns around 10,000 records. There are actually about 50,000 records to be returned. I do not believe it is just erroring out one a single and stopping because I sorted my cursor multiple ways to show that in one sort certain records do not show, but when sorted another way they do. It is still possible something is stopping it - I will continue looking. But I would like to know if anyone is aware of any size limitations in the amount of data to be piped? I've looked at the types created & the function and do not see anything that was set for a size. Any ideas?
I apologize I do not know all the correct terms to use. I am taking this over from someone else - hopefully an example of their code will help. Thank you very much.
FUNCTION get_data(p_id NUMBER DEFAULT NULL)
RETURN t_my_data_tab PIPELINED
AS
v_temp VARCHAR2(10);
BEGIN
PIPE ROW
(t_links_contracts_rec
(...data values....)
RETURN;
END;
I'm not sure really, if there was a limitation I believe it would be documented and even would raise an exception. I've only used pipelined table function for smallish sets of data. I can't simulate much as I only have access to 10g and 11g here, so I ran a query with 50,000, but I'm only posting its count for obvious reasons.
Connected to Oracle Database 10g Enterprise Edition Release 10.2.0.4.0
Connected as fsitja
SQL> create or replace type t_tab is table of number;
2 /
Type created
SQL>
SQL> create or replace function test_pipe return t_tab pipelined as
2 begin
3 for i in 1 .. 50000
4 loop
5 pipe row (i);
6 end loop;
7 end;
8 /
Function created
SQL> select count(*) from table(test_pipe);
COUNT(*)
50000
SQL> Some docs referencing the subject from 9i:
http://download.oracle.com/docs/cd/B10501_01/appdev.920/a96624/08_subs.htm
http://download.oracle.com/docs/cd/B10501_01/appdev.920/a96595/dci12tbl.htm
Similar Messages
-
So i tried downloading ios8 and my phone is stuck in recovery mode. i have tried to restore it in itunes and it continues to say itunes does not recognize my phone. i have all my systems up to date and i have tried restarting my computer. help
Me too and I have 4 devices which are now not recognized by iTunes but were immediately before ios8 upgrade
Come on Apple get your finger out and help us here please ? -
I know the FIRST_ROWS hint tells the optimizer to minimize time to first row. I know the new 12c functionality for "FETCH [FIRST|NEXT] [N] ROWS [ONLY|WITH TIES]"fetch first/next N rows only/with ties" will implement the query using ROW_NUMBER(). Should I leave hint in case it improves performance, or does the FETCH FIRST clause make this hint redundant?
maybe the answer to this question is more complicated then I assumed at first: as Randolf Geist wrote in his presentation Everything You Wanted To Know About FIRST_ROWS_n But Were Afraid To Ask a rownum predicate implicitly defines a first rows n optimization. So I guessed that the fetch first clause would trigger a similar optimization. But a rownum predicate and a fetch first clause are not transformed into the same operation:
create table t
as
select rownum id
from dual
connect by level <= 1000000;
select id
from t
where rownum <= 5;
ID
1
2
3
4
5
| Id | Operation | Name | Rows | Bytes | Cost (%CPU)| Time |
| 0 | SELECT STATEMENT | | 5 | 25 | 2 (0)| 00:00:01 |
|* 1 | COUNT STOPKEY | | | | | |
| 2 | TABLE ACCESS FULL| T | 5 | 25 | 2 (0)| 00:00:01 |
Predicate Information (identified by operation id):
1 - filter(ROWNUM<=5)
select id
from t
fetch first 5 rows only;
ID
1
2
3
4
5
| Id | Operation | Name | Rows | Bytes | Cost (%CPU)| Time |
| 0 | SELECT STATEMENT | | 1000K| 24M| 427 (1)| 00:00:01 |
|* 1 | VIEW | | 1000K| 24M| 427 (1)| 00:00:01 |
|* 2 | WINDOW NOSORT STOPKEY| | 1000K| 4882K| 427 (1)| 00:00:01 |
| 3 | TABLE ACCESS FULL | T | 1000K| 4882K| 427 (1)| 00:00:01 |
Predicate Information (identified by operation id):
1 - filter("from$_subquery$_002"."rowlimit_$$_rownumber"<=5)
2 - filter(ROW_NUMBER() OVER ( ORDER BY NULL )<=5)
Looking at a CBO trace for the two operations I see signs of a first rows optimization only for the query with the rownum predicate:
Final query after transformations:******* UNPARSED QUERY IS *******
SELECT "T"."ID" "ID" FROM "C##TEST"."T" "T" WHERE ROWNUM<=5
First K Rows: Setup begin
And so I think there is no first rows optimization for the fetch first clause. Of course the analytics would make an optimization for fast response almost impossible if there is an order in the query since in this case the analytics have to read the complete set before the filtering takes place.
Regards
Martin Preiss -
Does using WKA instead of multicast have negative side effects?
Will it impact Performance?
Hi Colin,
I would not expect the performance benefits of multicast to help you out here unless the query (not the result) is very very large, i.e. multi megabyte. Even when unicast is used, we still send the requests out to all nodes asynchronously, so the increase in latency over the multicast approach would be minimal.
If you are seeing query times increase as the cluster grows it would be more likely attributable to lack of indexs on your caches, or not having indexes on the attributes used in your query. Without an index Coherence is forced to not only iterate every cached item, but also deserialize them (yes it is stored in serialized form).
Finally cluster wide queries are by their vary nature not scalable unless you've also increased the query set size. Think of it this way, if you have N records in M nodes and perform a query each node will do the following work:
Q + N/M + A
Where Q means process the question, and A means send an answer. If N increases and M decreases each node will be able to compute the answer quicker (and it will trend towards zero). But each node still must perform the constants Q and A, so from a cluster wide perspective you are performing M*(Q+A) work and M is increasing. Now if N is also increasing you will still see scalability benefits, as it would have taken a smaller cluster longer to run the query on the bigger data set, but for a fixed size data set you should see diminishing returns.
In such cases it would be useful to have a look at KeyAssociation, an KeyAssociatedFilter. This approach allows for scalable queries even at fixed size data sets.
http://download.oracle.com/otn_hosted_doc/coherence/342/com/tangosol/net/cache/KeyAssociation.html
http://download.oracle.com/otn_hosted_doc/coherence/342/com/tangosol/util/filter/KeyAssociatedFilter.html
thanks,
Mark
Coherence Development Team -
AT&T and Apple is going to cause people to look elsewhere in order to obtain services to operate their products which might not affect Apple all that much but AT&T may suffer a little bit and apple needs to go ahead provide the means for various ways to connect their devices through AT&T rather than forcing their customers to be locked in to paying an extreme amount of money for service.
IF you're using more than 2GB per month, you have the wrong device for online service. It's unclear as to how you are using the iPad. If you're at home most of the time, you should be using wifi instead. Much cheaper for extensive data streaming. If you're instead out and about, knock off the video/audio streaming.
If you go into System Preferences/Usage/Cellular Usage, it will show you exactly where you are. I strongly suggest you "zero" out the counter at the start of your monthly data plan and then monitor it from time to time. -
I have a function that returns pipelined row, and need to pass parameter to oracle report to call this function, how can i do it in the report query?
following is a sample:
function get_info (v1 number, v2 varchar2)
return my_row pipelined
pipe row ( ......).
now in the report query
select * from table(get_info(????)),
how to pass these as parameter?It was a bug on the PC I worked on.
Problem solved -
ERROR MESSAGE WHEN DOING SIMPLE QUERY TO RETRIEVE LARGE AMOUNT OF DATA
Hello,
Am querying my database(mysql) and displaying my data in a
DataGrid (Note that am using Flex 2.0)
It works fine when the amount of data populating the grid is
not much. But when I have large amount of data I get the following
error message and the grid is not populated.
ERROR 1
faultCode:Server.Acknowledge.Failed
faultString:'Didn't receive an acknowledge message'
faultDetail: 'Was expecting
mx.messaging.messages.AcknowledgeMessage, but receive Null'
ERROR 2
faultCode:Client.Error.DeliveryInDoubt
faultString:'Channel disconnected'
faultDetail: 'Channel disconnected before and acknowledge was
received'
Note that my datagrid is populated when I run the query on my
Server but does not works on my client pcs.
Your help would br greatly appreciated here.
Awaiting a reply.
RegardsHello,
Am using remote object services.
USing component (ColdFusion as destination). -
i've downloaded some free games for my iphone4 but they are using my internet because they have ads. does anyone know if there are any games that don't have these ads and don't require internet AT ALL?and if i disable my internet connexion, does it help?
Thank you. I put it in airplane mode like you suggested, but it looks to me like all the applications and ads are still running. Anyway, I'm just gonna play when I'm really really bored and use them as less as possible. Thank you again for your quick answer.
-
I have made a website using iweb, as this will no longer be supported by apple, does that mean the gallery I have created on my website will no longer work even though I am hosting it with a different hosting provider. Will the other widgets no longer work?
There are a few things that won't work on other hosting sites; hit counters and pop-up slide shows for sure.
See http://oldtoadstutorials.net/No.iW11.html for more info, and/or the iWeb forum at https://discussions.apple.com/community/ilife/iweb -
I've got problem with opening a file in InDesign. The file type is an InDesign Markup Document. The error message is: Either the file does not exist, you do not have read access to it, or use the file in another application. What's wrong?
-
Does anyone use a LaCie external hard drive with their Mac using imovie '09? I have some questions.
Are you actually having a problem with the new Lacie drive, or are you just asking is the Lacie drive somehow different from your old G-Drive?
From a connection standpoint, most Lacie desktop drives have both USB and FireWire connections, just like the G-Drives do. You would connect and use it the same as a G-Drive.
Regarding capturing to the external HD, if you are using a camcorder that has FireWire (iLink) connection, it is not advisable to have an external FireWire HD connected to your Mac at the same time as your camcorder; there are often communication conflicts between the camcorder and the hard drive if they are connected at the same time. The conflicts usually appear as either dropped frames or a complete freeze. This is more common with Canon miniDV camcorders but I have also seen this behavior with Sony miniDV camcorders. (The problem is the camcorder's FW implementation, not the hard drive.) The workaround is to capture to your Mac's internal HD and later copy the captured video to your external HD. -
I have CD version of Adobe Photoshop Element 9. I have CD version of Adobe Photoshop Element 9. I have purchased the new Macbook which does not have DVD drive. Can I download this software over the web and install using the Serial Number I have. Thanks,@
yes,
Downloads available:
Suites and Programs: CC | CS6 | CS5.5 | CS5 | CS4 | CS3
Acrobat: XI, X | 9,8 | 9 standard
Premiere Elements: 12 | 11, 10 | 9, 8, 7
Photoshop Elements: 12 | 11, 10 | 9,8,7
Lightroom: 5 | 4 | 3
Captivate: 8 | 7 | 6 | 5
Contribute: CS5 | CS4, CS3
Download and installation help for Adobe links
Download and installation help for Prodesigntools links are listed on most linked pages. They are critical; especially steps 1, 2 and 3. If you click a link that does not have those steps listed, open a second window using the Lightroom 3 link to see those 'Important Instructions'. -
Either the file does not exist, you do not have permission, or the file may be in use
Had this file open this morning all the sudden Im getting this error.
Either the file does not exist, you do not have permission, or the file may be in use
Useing win 7 64bit.
I think its version 6
ThanksWas it properly closed? There may still be a lock file (.idlk) in the folder where it is saved.
-
Why does my hard drive state I have used 500 gb when I have only used 280 gb?
Why does my hard drive state I have used 500 gb when I have only used approximately 280 gb?
Have you emptied your trash lately...
Also... See these links...
Apple ML = Increase Disc Space
http://support.apple.com/kb/PH10677
See Here > Where did my Disk Space go?
And Here > The Storage Display -
Are there any apps which will allow local calling using data only (not minutes, no extra charge) that do not require any special numbers called out initially and does not require the receiver to have a similar app or account? Just for random local calling.
Yup.
Here is a way you could solve this by adding an extra column and a small lookup table:
The lookup table is here for the copying:
0
1
k
kilo
2
M
mega
3
G
giga
4
T
tera
5
P
peta
6
E
exa
7
Z
zetta
8
Y
yotta
In table 8 (the one on the left in the image) column A is where the values are.
B1=A1÷(1024^VLOOKUP(INT(LOG(A1, 1024)), Binary Prefixes::A:D, 1))&" "&VLOOKUP(INT(LOG(A1, 1024)), Binary Prefixes::A:D, 2)&"B"
this is shorthand for... select cell B1, then type (or copy and paste from here) the formula:
=A1÷(1024^VLOOKUP(INT(LOG(A1, 1024)), Binary Prefixes::A:D, 1))&" "&VLOOKUP(INT(LOG(A1, 1024)), Binary Prefixes::A:D, 2)&"B"
select cell B1, copy,
now select all the cells in column B, paste
Maybe you are looking for
-
iMac (27-inch, Mid 2011) 2.7 GHz Intel Core i5 4 GB 1333 MHz DDR3 running10.10.2 (14C1514). Trying to install Windows 7 64 bit from an install disc. When attempting to create an ISO image I can save the file in disk utility but can convert cdr to iso
-
Running Windows 7 [64 bit]-Do I need to install Quicktime?
Hello all, This is my first Post. I'm a Premier Elements 9 Newbee and want to know if Apple Quicktime is needed with Windows 7? If so, do I download the 64 Bit version? My Premier Elements 9 software is working fine without it. I'm using a Canon Vixi
-
Beginner help to send an email from PHP
I hope this isn't too easy to answer - I think I must be doing something fairly simple wrong. I want to send an email from a PHP page, using SOAP so the mail appears in the sender's sent items, as if it was done in the usual way. We're using Groupwis
-
Hi All, I am new to ABAP webdynpro. In my application I am reading customer (from KNA1) depending on account group and i want to display these customer records with F4 help. Please guide me how can implement custom f4 help? Thanks and regards Uma
-
I can't flag emails in OS5. Only gives me the option to Unread.
Still reading the OS5 manual. It says I can flag email, I read my work email off an Outlook enterprise server. The flag option doesn't appear when I mark in edit. I can unread it only. Is this a server issues? It's an iPhone 4.