Max fetch size in DataScrollerComponent

Hi
If i cap a max fetch size of 2000 on a query that i know will return 8000 rows the DataScroller still reports 1-rageSize of 8000 ?
If i try and navigate past row 2000 the component correctly sees the max fetch size and displays 1-rangeSize of 2000 ??
Whats going on ?
Thanks
Matt

Got to the bottom of this by replacing a the code in the DataScroller component so we could view (and change) the source code. The component files are :
ScrollBarTag.java - used in <jbo:DataScroller> tag
DataScrollerComponent.jsp - the page that renders the dropdown list and next / previous values
DataScroller.java - the bean used in the jsp that contains state information about the current datasource.
When the DataScroller bean is initialised it sets up range values to enable calculation of entries in the scroller (e.g 1-100 0f 1000000). It derives the datasource from PageContext and looks at the RowSet directly.
The problem is that it uses the getEstimatedRowCount() API on the RowSet driectly (i.e. not via the ViewObject).
This figure returned doesnt consistently obey a cap on the max fetch size and will be a nasty bottleneck if you are querying on very large result sets. Mysteriously, if you try to navigate past the end of your maxFetchSize in the scroller the second pass through the code will get the estimated row count correct and obey the cap on maxFetchSize ?
If you change the call to use the getRowCount() API instead, this figure seems to consistently obey the maxFetchSize cap.
We had to look into this code as this component will perform very badly against 6 and 7 figure ResultSets as its not taking into account any caps set.
As a matter of interest, changing the code in the bean to ask the view object directly for its getEstimatedRowCount() seems to consistently obey any caps !?! :
ds = Utils.getDataSourceFromContext(pageContext, dsName);
RowSet rs = ds.getRowSet();
ApplicationModule am = rs.getApplicationModule();
ViewObject dvo = am.findViewObject(Constants.SOME_DVO);
if (dvo != null)
System.out.println("dvo "+dvo.getName());
System.out.println("est rows "+dvo.getEstimatedRowCount());
System.out.println("rows "+dvo.getRowCount());
This code will get the figure right and if run before the
rs.getEstimatedRowCount seems to force the correct value in the RowSet.
Matt

Similar Messages

  • Set max fetch size on application module

    Is there a way to set max fetch size on application module level, rather then setting it for every view object separately? I don't want to allow any of my view objects in application module to fetch more then 1000 rows.

    Hi,
    Tools-->... contains option for setting rows in batches of... , but doesn't contain option for setting max fetch size. I guess I'll have to do it in implementation class for view objects... Thanks anyway
    Dragana

  • Oracle - Informatica transfer speed fetch size and SQL*Net message from c

    Hi,
    I'm testing how fast informatica can take data from our 10.2.0.3 and using large (140GB 1 200 000 000 rows) table as source and doing simple
    select * from large_table .
    Here goes quite interesting wait time analyze :) .
    call     count       cpu    elapsed       disk      query    current        rows
    Parse        0      0.00       0.00          0          0          0           0
    Execute      0      0.00       0.00          0          0          0           0
    Fetch   186994    131.84     198.25     127545     314167          0    25431184
    total   186994    131.84     198.25     127545     314167          0    25431184
    Misses in library cache during parse: 0
    Parsing user id: 400
    Elapsed times include waiting on following events:
      Event waited on                             Times   Max. Wait  Total Waited
      ----------------------------------------   Waited  ----------  ------------
      db file scattered read                       9122        0.33         64.71
      SQL*Net more data to client                529327        0.00          8.34
      SQL*Net message from client                186994        0.21        478.74
      SQL*Net message to client                  186994        0.00          0.30
      db file sequential read                       145        0.01          0.49
      gc cr multi block request                    6998        0.01          6.30
      gc current grant 2-way                          9        0.00          0.00
      gc cr grant 2-way                              67        0.00          0.03The interesting part is ' SQL*Net message from client 186994 0.21 478.74'
    so looks like from Informaticka point of view (client side) is lagging 478 sec , so its lagging .
    Doing some math 25431184/186994 = 136 .
    Could You share with me Your experience in that matter ?
    Looks like to speed up I need to :
    1. increase fetch size (not sure how to do that).
    2. increase SDU client and probably server side .
    Network is 100Mbit ethernet so about 10MBytes per second .
    Regards
    GregG

    Have you solve your problem ?
    If yes I'm strongly interest by the solution.
    If you have a question of issue create your own thread and provide the particulars of your use case. This thread is year old.
    OP likely did NOT have any problem. As OP stated the max throughput for a 100 Mbit network is about 10 MB per second. So do the math for moving 140 GB and you will see that the network itself will be the limiting factor.

  • Sophos AV max scanning size / timeout

    Hi,
    I haven't found any changeable settings for max. scanning size or scanning timeout on a S160 v7.1.3 with Sophos AV.
    In the GUI under "Security Services-->Anti-Maleware"  it shows  "Object Scanning Limits: Max. Object Size:  32 MB".
    I'm not able to change it. This parameter seems not to belong to the Sophos AV.
    I can change it only after enableing Webroot or McAfee first.
    The CLI has no commands for adjusting AV settings.
    How can I control the max. scanning size or scanning timeout with Sophos-AV?
    Has it fixed values for it?
    Does anyone have an idea, how it works?
    Kind regards,
    Manfred

    With administrator rights, the value should be editable.  The object size is applied to all scanners which have been licensed and enabled on the appliance.
    ~Tim

  • REPORT PERFORMANCE TUNING:Array FETCH SIZE

    Hi Folks,
    DOES any one has an idea about   array fetch size  in CRYSTAL REPORTS XI connected to oracle database.
       I have two basic questions here
               1.   What is the default array fetch size in CRYSTAL XI 
               2.   how to change this parameter.
    Thanks In advance
    Mani

    Please re-post if this is still an issue to the Data Connectivity - Crystal Reports Forum or purchase a case and have a dedicated support engineer work with you directly

  • Can you set a large fetch size for the standard popup LOV

    I'm trying to increase the fetch size that the popup LOV uses when I set a LOV up for an attribute.  It seems to have a default of 25.  I don't really have the issue when I'm on a PC, but when we run the app under Safri on an IPAD it will not automatically fetch the next 25 rows when the user scrolls down like it does in IE.  I had the same issue with tables, but I can change the fetch size on the table.  I really need to set the fetch size on the LOV.  ANyone know how to do this?  I don't even care if the setting would be across the board or just specific to one view.   

    I'm on 11g.  I'm using input list of values.  I don't want to wait for the whole list since the search could return 1000's of rows.  I like the automatic fetching I get with IE.  The IPAD is the issue.  It does not do an automatic fetch when you scroll to the end.  So, the user is limited to 25 rows no mater what their selection criteria is.  I'd like this to be around 400 if I could get it. 

  • "max-pool-size"   what is it good for?

    SCreator simple CRUD use:
    After a while I get:
    " Error in allocating a connection. Cause: In-use connections equal max-pool-size and expired max-wait-time. Cannot allocate more connection"
    Which is odd, because its just me using the server/database. It looks like every tiime I run a test, another conection is lost.
    Do I have to restart the server? Is there a way to say "its only me, reuse a single connection"
    why does "connection pooling" make life harder?
    Can I turn it of?
    cheers
    cts

    I got the same error in my JSC project. I search for few days and i found the solution. I do a mistake in my page Navigation. I forgot a slash in <to-view-id>.
    A bad example:
    <navigation-rule>
    <from-view-id>/*</from-view-id>
    <navigation-case>
    <from-outcome>page13</from-outcome>
    <to-view-id>page13.jsp</to-view-id>
    </navigation-case>
    A good example:
    <from-view-id>/*</from-view-id>
    <navigation-case>
    <from-outcome>page13</from-outcome>
    <to-view-id>/page13.jsp</to-view-id>
    </navigation-case>
    with this mistake, the afterRenderedResponse() was never called, and the ResultRowSet was never closed.
    Korbben.

  • SharePoint - Error_1_Error occurred in deployment step 'Add Solution': Timeout expired. The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool size was rea

    Hi,
    I am Shanmugavel, SharePoint developer, 
    I am facing the below SharePoint 2013 deployment issue while deploying using VS2012.
    If i will deploy the same wsp or existing wsp
    (last build) using direct powershell deployment, the solution adding properly, but the same timeout exception coming while activation the features.  Please find the below error.
    I tried the below activists:
    1. Restarted my dev server, DB server. 
    2. tried the same solution id different server
    3. tried existing wsp file (last build version)
    4. Deactivated all the features, including project Active deployment configuration.... but still i am facing the same issue.
    I hope this is not coding level issue, because still my code is not start running, before that some problem coming.
    Please help me any one.....  Last two days i am struck because of this...

    What you need to understand is the installation of a WSP does not do much. It just makes sure that you relevant solution files are deployed to the SharePoint farm.
    Next comes the point when you activate the features. It is when the code which you have written to "Activate" certain features for your custom solution.
    Regarding the error you are getting, it typically means that you have more connections (default is I guess 100) open for a SQL database then you are allowed to.
    If you have a custom database and you are opening a connection, make sure you close it as well.
    Look at the similar discussion here:
    The timeout period elapsed prior to obtaining a connection from the pool. This may have occurred because all pooled connections were in use and max pool
    size was reached[^]
    I would suggest further to look at the
    ULS logs[^] to get better insight.
    Manas Bhardwaj's Stream : www.manasbhardwaj.net

  • Need info about max HDD size available for Satellite Pro M30-813

    Hello,
    The following question is mainly to be addressed to authorized Toshiba support personnel. What exactly is the limitation of a maximum size of an internal HDD that I could use with my Satellite Pro M30-813?
    Recently, I have bought and installed seagate 160 GB SATA drive, onto which I have successfully installed WXP Pro and have been running it for quite a while with no problems. Recently, I have been copying large amount of data from an external hard drive to my new internal disk, and as the files were being copied as I noticed having about 50 GB free space left, I had experienced windows "delayed write failed" and a massive partition failure with no possibility to recover data. The system would no longer boot and the whole MBR was damaged. As the result, I have lost all data on my new disk.
    Although, I realize that Toshiba is not responsible for additional hardware that I use with my laptop and that is not officially supported by Toshiba, I am certain that as an end user of a Toshiba product I have the right to know about a max HDD size limitation information for my notebook model. Therefore, I request Toshiba technical support representative to give me a straight official answer to my question.
    Thank you in advance,
    Andrejs
    (You may also contact me privately at my e-mail address)

    Hi Andrew
    > The following question is mainly to be addressed to authorized Toshiba support personnel
    I think you are in the wrong area if you are looking for an answer from an authorized Toshiba support.
    This is a Toshiba user-to-user forum! You will meet here Toshiba notebook owner and enthusiasts who share knowledge and tries solve problems but nobody from Tosh :(
    I could provide my experience with the M30 Satellite and the HDD upgrade possibilities.
    In my knowledge the Sat M30 supports a 40GB, 60GB and 80GB HDD for sure.
    In my opinion you could use the 100GB HDD but bigger HDDs will not run and functions correctly.
    So switch to a lower HDD size and enjoy the notebook!
    Ive goggled a little bit and found compatible HDD and the part numbers
    HITACHI GBC000Z810 -> 80GB
    HITACHI GBC00014810 -> 80GB
    TOSHIBA HDD2188B -> 80GB
    HITACHI G8C0000Z610 -> 60GB
    HITACHI G8BC00013610 -> 60GB
    TOSHIBA HDD2183 -> 60GB
    TOSHIBA HDD2184 -> 60GB
    I hope this could help you a little bit!
    Best regards

  • How to set  max-heap-size outside the jnlp file?

    Due to bug_id=6631056 It may not be possible to specify max-heap-size within
    the JNLP file for certain jnlp java applications.
    Are there other possibilities to specify this Jvm parameter?
    In the ControlPanel there is the possibility to specify Xmx for applets but not for jnlp.
    I have tried to add properties like
    "deployment.javaws.jre.0.args=Xmx\=128M" without success
    Many thanks

    Even in JNLP also you can specify the max heap size
    <j2se version="1.5+" initial-heap-size="128m" max-heap-size="512m"/>
    Thanks,
    Suresh
    [http://sureshdevi.co.in|http://sureshdevi.co.in]

  • Different max photo sizes in emails, beams, photo stream?

    I've noticed differences in file sizes when emailing photos from the iPhoto app, when inserting in an email, and when emailing directly from the photo.  I've found that iOS 6 is able to send the largest file when inserting it into an email. If I select email from iPhoto, the full size option is a fraction of that. If I email a photo directly from the photo itself, the full size seems to be somewhere in-between.  I sent a panoramic photo three times, once using each method. Each time I selected to send the FULL file sizes, and each time they were different:
    iPhoto: 1918K
    insert in email: 12004K
    email from photo itself: 3529K
    Is there a reason iOS 6 does this? 
    Why are the full photo file sizes not universal?
    Are the max file sizes being uploaded to photo stream?
    What is the best way to get the largest photo jpg off of the iPhone aside from syncing?

    John,
    You have several options for re-sizing photos, though (continuing from what V.K. has already stated). If you want to "customize" the size of each photo, you'll need to do so before you attach them to an email. They can be re-sized in iPhoto, or they can be opened in Preview and exported as whatever size you like.
    If your images are in iPhoto, select one, then choose File>Export. Use the export dialogue to select the size and compression of the resulting file, save it to someplace like your Desktop, then attach it to an email. The choices, here, are the same as they would be within Mail, but will be applied on an image-by-image basis.
    Scott

  • How to determine "fetch size" of an application?

    Hi, all.
    The db is 11.2.0.3 on a linux machine.
    I would like to know the "fetch size" of an application, but I was not able to find any related meteris in v$statname.
    The application configruation is invisible to me.
    Do I need to do some calculations based on statistic metrics from v$statname?
    If so, what meteris should be considered for the assumption for "fetch size" ?
    The following is from manual, but the application configuration is invisible to me.
    http://docs.oracle.com/cd/E11882_01/java.112/e16548/resltset.htm#i1023619
    Setting the Fetch Size
    The following methods are available in all Statement, PreparedStatement, CallableStatement, and ResultSet objects for setting and getting the fetch size:
    •void setFetchSize(int rows) throws SQLException
    •int getFetchSize() throws SQLExceptionThanks in advance.
    Best Regards.

    or;
    compare rows_processed, executions and fetches from v$sql for queries from your application.
    HASH_VALUE EXECUTIONS    FETCHES ROWS_PROCESSED
    4157030199      39288     510744       50193247
    SQL> select
      fetches/executions "fetch per exec",
      rows_processed/executions "rows per exec",
      rows_processed/(executions+fetches) "avg fetch size"
    from v$sql where hash_value=4157030199;
    fetch per exec rows per exec avg fetch size
                13    1277.57439     91.2553134the query assumes the app is doing it 'right', and is fetching from the first execute as well as the following fetches.
    the 91.25... is not the real fetch size ofcourse, as the #rows returned will typically not be an exact multiple of the 'application fetch size', but we can guess it may be 100 in this case.
    also note that you speak of an application fetch size, but the fetch size is really specified per-statement (OCIStmtExecute). some applications (or API's) do indeed use a 'one size fits all', which is still better than using no array fetching at all.

  • What is the max file size that a Adapter Engine [J2SE] can handle ?

    We are having a scenario where a 4 GB compressed file needs to be sent across without mapping, I'm trying to explore the possible options to tackle this scenario.
    Some of the options, we are considering :
    - Sending a file from one Adapter Engine [J2SE] to another Adapter Engine [J2SE] bypassing PI. Adapter Logs will be monitored. What is the maximum file size that can be then handled assuming a standard installation ?
    - What is the max file size that Adapter Engine [J2SE] can send through PI without mapping?
    Any help with the above options or with any other possible solutions to handle extremely large file transfers will be much appreciated.

    Hi,
    j2se is not a good option here
    if you have 4gb then you need a copy solution
    a) build an proxy that will just copy the file from sender dest to receiver
    b) build an adapter that will do the same as proxy)
    this way processing of this message will be controlled with SAP PI/XI
    it will be as quick as copy & paste of the 4gb file
    I did the a) for one of the flow for 300 mb and it works perfectly
    Regards,
    Michal Krawczyk

  • Automation in saving a image file with a specific max file size

    Hi everyone,
    I hope someone can help me by this.
    Background info:
    We got several image files every 2 weeks which should be edited and mainly reduced in size for web purpose. This work needs 1 work day for one man/woman to do, because he/she has to open the file save for web and then set the quality to a value were the file is nearly about 150-200 KB in size.
    The images are different, some have few colors, some have a lot of colors and there are also different in resolution. But they should not be reduced in resolution, only in quality. All other specs of the image should be kept 
    Is there any possible script, plug-in or similar which can do the same (Saving with a specific max. file size) in some automatic and faster way?
    Any help is really appreciated!
    Thanks in advance!
    Kind regards
    Packesel

    *push*
    Hi everyone,
    I still need help with this. Is there any tool (OS X) or script for Photoshop who can fulfill this (see title).
    ANY help is really appreciated!
    Thanks in advance.
    Regards
    Packesel

  • What is te max. file size for lightroom

    i have some very big files. lightroom says that the are to big to catalog. but what is the max. file size ?

    There is no MAX file size.
    As John points out, the limits are on the number of pixels, not file size

Maybe you are looking for

  • Installing windows 8 through bootcamp on macbook pro mid 2010

    i know there are a lot of posts about this but i've not seen anything to help me.  i have a mid 2010 macbook pro with maverick installed and completely updated.  i'm want to try bootcamp to install windows for my database class that is using microsof

  • How to have a unique list of items for separate dropdown lists?

    Software: Acrobat X (10) pro on Windows I want to create a pdf form in which all dropdown lists are populated with the same list of items to choose from. If I use the same field name for all drop down lists, the item selected in one dropdown list is

  • Just installed itunes upgrade.Now it does not do anything at all...

    Had the old itunes working happily. Installed the new itunes upgrade thing, and the Quicktime upgrade that comes with it. The same itunes icon is on my computer, but does absolutley nothing when I click on it... no error code, no response, nada, zip,

  • ITunes will not exit Full Screen Mode.

    It automatically boots into a Full screen desktop, and has no menu bar on top hover. I have hovered and pushed to every corner, no menu drops down. I need to be able to turn off full screen. WIthout a magic mouse or touchpad, I cannot switch out of i

  • Button link to keyboard

    I have 7 flash button like following: http://www.oniva.com/upload/1356/bu.jpg each button has on (release) function when button is clicked some event occur http://www.oniva.com/upload/1356/bu2.jpg But how can I link button to "UP" "DOWN" and "ENTER"