Maximum Data Retrieval

Hi
I have to fetch more that 60,000 records from a Standard table of a 3rd party application(SQL DB). Will my interface be able to fetch such large volume of data. If no, then what will the other alternative to fetch large volume of data? Will stored procedures be helpful in this case? Kindly share your experience.
The source adapter is JDBC and target is either a file or proxy
Reg
Shru

Hi Shruthi,
Similar kind of Scenerio we come acrossed since we where using XSLT mapping it was occupying more memory so we went for batches and is it fine.
Regards
Agasthuri Doss
Message was edited by: Agasthuri Doss Baladandapani

Similar Messages

WAD : Result set is too large; data retrieval restricted by configuration

Hi All,
When trying to execute the web template by giving less restiction we are getting the below error :
Result set is too large; data retrieval restricted by configuration
Result set too large (758992 cells); data retrieval restricted by configuration (maximum = 500000 cells)
But when we try to increase the number of restictions it is giving output. For example if we give fiscal period, company code ann Brand we are able to get output. But if we give fical period alone it it throwing the above error.
Note : We are in SP18.
Whether do we need to change some setting in configuration? If we yes where do we need to change or what else we need to do to remove this error
Regards
Karthik

Hi Karthik,
the standard setting for web templates is to display a maximum amount of 50.000 cells. The less you restrict your query the more data will be displayed in the report. If you want to display more than 50.000 cells the template will not be executed correctly.
In general it is advisable to restrict the query as much as possible. The more data you display the worse your performance will be. If you have to display more data and you execute the query from query designer or if you use the standard template you can individually set the maximum amount of cells. This is described over [here|Re: Bex Web 7.0 cells overflow].
However I do not know if (and how) you can set the maximum amount of cells differently as a default setting for your template. This should be possible somehow I think, if you find a solution for this please let us know.
Brgds,
Marcel

Query Error Information: Result set is too large; data retrieval ......

Hi Experts,
I got one problem with my query information. when Im executing my report and drill my info in my navigation panel, Instead of a table with values the message "Result set is too large; data retrieval restricted by configuration" appears. I already applied "Note 1127156 - Safety belt: Result set is too large". I imported Support Package 13 for SAP NetWeaver 7. 0 BI Java (BIIBC13_0.SCA / BIBASES13_0.SCA / BIWEBAPP13_0.SCA) and executed the program SAP_RSADMIN_MAINTAIN (in transaction SE38), with the object and the value like Note 1127156 says... but the problem still appears....
what Should I be missing ?????? How can I fix this issue ????
Thank you very much for helping me out..... (Any help would be rewarded)
David Corté

You may ask your basis guy to increase ESM buffer (rsdb/esm/buffersize_kb). Did you check the systems memory?
Did you try to check the error dump using ST22 - Runtime error analysis?
Edited by: ashok saha on Feb 27, 2008 10:27 PM

Result set is too large; data retrieval restricted by configuration

Hi,
While executing query for a given period, 'Result set is too large; data retrieval restricted by configuration' message is getting displayed. I had searched in SDN and I had referred the following link:
http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/d047e1a1-ad5d-2c10-5cb1-f4ff99fc63c4&overridelayout=true
Steps followed:
1) Transaction Code SE38
2) In the program field, entered the report name SAP_RSADMIN_MAINTAIN and Executed.
3) For OBJECT, entered the following parameters: BICS_DA_RESULT_SET_LIMIT_MAX
4) For VALUE, entered the value for the size of the result set, and then executed the program:
After the said steps, the below message is displayed:
OLD SETTING:
OBJECT = VALUE =
UPDATE failed because there is no record
OBJECT = BICS_DA_RESULT_SET_LIMIT_MAX
Similar message is displayed for Object: BICS_DA_RESULT_SET_LIMIT_DEF.
Please let me know as to how to proceed on this.
Thanks in advance.

Thanks for the reply!
The objects are not available in the RSADMIN table.

How to select maximum date in report

i have tried to select maximum date in my report by this way:
select max(date) from a
but the result came out same as "select date from a"
there is no different whether i put a max or not. is anyone there can help me on this please....
Thank you....

Hi Sharon,
Since you cannot execute this query from SQL, I assume that the DB does not support the function MAX(expr). Am not sure which DB versions support this function, probably the Database forum will be a better place to ask that.
As a workaround, what you could try is to use this statement
select hire_date from employees order by hire_date desc
and in the report data model, you make a summary column and choose Function > First, Source > Hire_Date, and Reset At > Report.
Hope that helps.
Navneet.

What is the maximum,data we can pull in BI-7.0 a day.

Hi,
All, there is a small isuue standing, can any one tell me as to how much data can we pull in a dfay my client wants to pull 250k a day is it possible?
Somebody pls give me the specifications as to how much of maximum data can we pull in BI-7.0, in a day .
Thanks in advance,
Point's will be awarded
Regards
Kittu

Kittu,
We don't have any Measurements... it's all depends on your Hardware.. DB Background Process etc.
In my last client(3.1C), we used pull daily delta around 150K to 250K. we didn't have any Isuues.
Nagesh Ganisetti.
Assign points if it helps.

Real tough data retrieval - assistance needed

Late 2011 Macbook Pro with 500GB hard drive
Lion 10.7
One morning out of absolutely nowhere I get this grey screen with a flashing question mark folder. I take it to the geniuses at the Apple store and they tell me my hard drive has failed (no explanation). My mac is under warranty so they gave me a new hard drive for free, bagged my old hard drive and told me "good luck" retrieving the data.
I'm on a mission to retrieve the data without paying for services. I have never retrieved data before but I've been doing a lot of forum reading and I have been getting protips from an IT friend who has saved my PC data before.
As of now, I have been unable to even access the hard drive and so I am reaching out to the community to help me conquer this project.
the problem is not the OS (according to Apple store)
when hooking up with the dongle, neither Finder nor Disk Utility detect the bad drive
the drive will spin when forced by the dongle (so I've ruled out the freezer method)
I was advised (by friends and forums alike) to download so powerful data retrieval software:
Data Rescue [did not detect bad external drive]
Disk Drill [did not detect bad external drive]
TestDisk (http://www.cgsecurity.org/wiki/TestDisk) [I can get it up and running but I have no idea how to use this software]
So that seems to be the big problem, when I hook up my failed drive as an external hard drive, there is no acknowledgement from my MBP that it is connected and as such data recovery programs cannot access it. When I still had it installed in my computer, there was no clicking sound and it doesn't seem like any of the components are jammed up as it still spins.
Where do I go from here? Please keep in mind that I am new to resolving my own technical problems but I'm willing to learn. Tired of being one of those people who look at computer parts and get anxious.
NOTE: I haven't tried Target Mode as I do not have a firewire cable or access to another mac (yet). If you think I should try this, please let me know.

A hard drive that will not divulge BOTH its Make&Model and a reasonable size/capacity to the likes of Disk Utility and data rescue programs has died, and connot be repaired with any software.
Target Disk mode will not improve anything. The drive is read as a Mac Volume by software. If it won't mount under Mac OS X, it won't mount under Target Disk Mode.

How to find out Maximum date value in RPD.

Hi All,
I have a date column i want to get the maximum date value from that column. I am trying this expression MAX( "sales"."book"."date") in new logical column i am getting the RPD inconsistence error. Database is SQL server 2005. Is there any problem in my syntax?
Thanks in advance.

Is that column date part of time dimension?
What does error say? syntax should be ok - maybe something to do with your DB settings in physical layer.
can you try to create the same column in Answers? (select fx button of the column and then add MAX ( ) around the column.
Edited by: wildmight on Jun 12, 2009 10:09 AM

Should I use a data retrieval service or software to recover data ?

Please pardon the length of this post.
Here's the setup for our office:
Computer 1:
10.4.8 OS X
1 GHZ PowerPC G4: silver grey tower, grey apple
1MB L3 Cache
256 MB DDR SDRAM
Computer 2:
10.4.8 OS X
Dual 450 MHZ PowerPC G4: blue grey tower, blue apple
256 MB SDRAM
Computer 3:
10.4.8 OS X
1 GHZ PowerPC G4 IMac Flat Screen:
256 MB DDR SDRAM
I have 2 LaCie Big Disk d2 Extremes daisy chained and connected to the IMac. We use the first to store all of our data to keep our local disks free. The second d2 is the backup to the first. The other 2 computers connect to the d2's via an ethernet hub. The d2's are each partitioned into 4 compartments.
A couple of days ago I started the system up when I got in in the morning, and the main d2 would not open. I ran disk utility, but it said that the drive was damaged beyond it's ability to repair. I ran DiskWarrior, and it gave me this message:
"The directory of disk 'G4' cannot be rebuilt. The disk was not modified. The original directory is too severely damaged. It appears another disk utility has erased critical directory information. (3004, 2176)."
I contacted Disk Warrior tech support and after a series of exchanges that had me send him dated extracted from the terminal function, he said this:
"It appears that the concatenated RAID inside your LaCie
drive has failed (your 500GB drive is actually 2 250GB
hard drives). That is why we only saw 2 partitions
on "disk3". A possible cause could be a failed bridge
in the case.
You may be looking at sending this drive to a data recovery service.
However, it is possible that we may be able to recover data
from the partitions that we CAN see. What we would be doing would cause no damage to your data
unless the hard drives were having a mechanical failure (ie, the
head crashed and was contacting the platters, similar to scratching
a record). But from what I've seen, I don't feel that is the case.
I believe the piece of hardware that 'bridges' the two drives to
make them act as one has failed. that's why we can only see data
about 1 of the 2 drives in the case.
We would only be attempting to gather data off the drive. Since
data recovery services sometimes charge for amount of data retrieved,
it's up to you how you want to proceed."
Most of the data from the past 5 years for our business stands at being lost. Only some of it had been properly backed up on the second drive, due to some back up software issues. I want to do whatever I can to retrieve all of, or at least some of the data. From what the Alsoft technician said, do you think that the data recovery software available to the consumer is going to be robust enough to retrieve at least the data from the one disk in the drive that is recognizable (there are 2 250gig disks in the d2X. Only one is responding at all). If so, do these Softwares further damage the disks? Or should I just send the drive to a data recovery service?
I'd like to try to extract some of it myself via over the counter retrieval software, but I don't know whether to trust these programs?
Any advice would be greatly appreciated.
Thanks in advance.
Peter McConnell
1 GHZ PowerPC G4 IMac Flat Screen Mac OS X (10.4.8) Posted

Peter
My 2 cents:
I have used FileSalvage
http://www.subrosasoft.com/OSXSoftware/index.php?mainpage=product_info&productsid=1
to recover files from damaged disks. It works as advertised, within limits. Some files may be too damaged to recover. More importantly yo get to scan the disk before actually recovering, and it will give you a list of what it thinks it can recover.
My experience was that it recovered approx 85% of the data.
YMMV but they do have a trial.
Regards
TD

Report Developed in Webi Rich Client Consuming more time in Data Retrieval

Dear All,
I am a BO Consultant, recently in my project I have developed one report in Webi Rich Client., at the time of development and subsequent days the report was working fine (taking Data Retrieval time less than 1 minute), but after some days its taking much time (increasing day by day and now its taking more than 11 minutes).
Can anybody point out what could be the reason?????
We are using,
1. SAP BI 7.0
2. SAP BO XI 3.1 Edge
3. Webi Rich Client Version :12.3.0 and Build 601
This report is made on a Multiprovider (Sales).
What are the important points that should be considered so that we can improve the performance of Webi Reports????
Waiting for a suitable solution.....................
Regards,
Arun Krishnan.G
SAP BO Consultant
Edited by: ArunKG on Oct 11, 2011 3:50 PM

Hi,
Please come back here with a copy/paste of the 2 MDX statements from the MDA.log to compare the good/bad runtimes.
& the 2 equivalent DPCOMMANDS clauses (good and bad) from the WebI trace logs.
Can u explain what u really mean in the bold text above..................Actually I didn't get you..........
Pardon, I have only 3 months experience in BO.
Regards,
Arun
Edited by: ArunKG on Oct 11, 2011 4:28 PM

Maximum Data file size in 10g,11g

DB Versions:10g, 11g
OS & versions: Aix 6.1, Sun OS 5.9, Solaris 10
This is what Oracle 11g Documentation
http://download.oracle.com/docs/cd/B28359_01/server.111/b28320/limits002.htm
says about the Maximum Data file size
Operating system dependent. Limited by maximum operating system file size;typically 2^22 or 4 MB blocksI don't understand what this 2^22 thing is.
In our AIX machine and ulimit command show
$ ulimit -a
time(seconds)        unlimited
file(blocks)         unlimited <-------------------------------------------
data(kbytes)         unlimited
stack(kbytes)        4194304
memory(kbytes)       unlimited
coredump(blocks)     unlimited
nofiles(descriptors) unlimited
threads(per process) unlimited
processes(per user) unlimitedSo, this means, In AIX that both the OS and Oracle can create a data file of any Size. Right?
What about 10g, 11g DBs running on Sun OS 5.9 and Solaris 10 ? Is there any Limit on the data file size?

How do i determine maximum number of blocks for an OS?df -g would give you the block size. OS blocksize is 512 bytes on AIX.
Lets say the db_block_size is 8k. What would the maximum file size for data file in Small File tablespace and Big File tablespace be?Smallfile (traditional) Tablespaces - A smallfile tablespace is a traditional Oracle tablespace, which can contain 1022 datafiles or tempfiles, each of which can contain up to approximately 4 million (222) blocks. - 32G
A bigfile tablespace contains only one datafile or tempfile, which can contain up to approximately 4 billion ( 232 ) blocks. The maximum size of the single datafile or tempfile is 128 terabytes (TB) for a tablespace with 32K blocks and 32TB for a tablespace with 8K blocks.
HTH
-Anantha

Oracle Database Express Edition maximum data size

Hi
We just need to know what is the maximum data(in gb) Oracle database express edition 10g can store in it?
Thanks

915071 wrote:
Hi
We just need to know what is the maximum data(in gb) Oracle database express edition 10g can store in it?
Thanks4GB

What is the Maximum Data can a file adapter can send at a time.

Hi ,
What is the Maximum Data can a file adapter can send at a time.Is there any maximum limit data can adapters will send.
can any one help on this.
regrads
Raghu

Hi Reddy,
I have raised the same question and I got correct answer.
Refer the below thread which will give u information.
Wat is the maximu size of data XI can handle
Thnx
Chirag

Data retrieval for Sony handycam with 60G harddrive.

Does BestBuy do data retrieval? I have a handycam with work video on it that accidentaly got formated. I know with a standard harddrive you can still retrieve it if there has not been recording since the formatting but I am not sure about camera harddrives. If BestBuy does not do it, does anyone know where it can be done and approximate cost. I live in the New Orleans area.
I may try the same question in computers if nobody knows. Thanks in advance for any guidance at all.

Best Buy sends out for data retrieval. You can have it sent out through geek squad to get the estimate of cost.
Crystal
Superuser
Forum Guidelines | Terms & Conditions | Community Guidelines | What is a Superuser?
*Remember to mark your questions solved and click the star to give kudos to show your thanks!*
While I used to be a Best Buy Employee, I no longer have any affiliation with Best Buy.
My opinions do not in any way shape or form represent Best Buy's Official decisions.

Data Retrieval Speed in Oracle Spatial vs. ESRI ArcSDE

I would appreciate any opinions regarding data retrieval
performance between Oracle Spatial and ESRI ArcSDE. Would an end-
user (using ESRI software) experience significant differences in
data retrieval speed depending on how the data were stored in
Oracle (MDSYS.SDO_GEOMETRY verses ESRI Binary/Blob formats).
Knowing that the ESRI binary formats are tailored to their
software front-end apps (ArcGIS, ArcMap, ArcCatalog, and
ArcInfo), wouldn't this be a "non-issue" until the spatial
dataset gets "large", and even then, wouldn't performance be
(almost) equal if the spatial indexes were created properly?
Thanks for your inputs,
Bruce

John,
You can't do that type of query in sql from sql*plus using
SDEBINARY. HOwever, you can perform spatial queries in ArcMap
if you are using SDEBINARY.
You can use the query builder to perform point-in-polygon type
queries.
Hope that helps.
For my two cents, I think SDO_GEOMETRY gives you a more robust
database to work with, because you have the added power of
Oracle Spatial functions. If you are using SDEBINARY you are
limited to only what you can do thru ArcGIS.
If you are concerned more about performance than accessibility,
especially with a large number of users, then SDEBINARY might
be the better choice.
I love Oracle Spatial and am hoping that the performance issue
will not be a serious one when we start putting ArcIMS developed
apps into production.
Dave

Maximum Data Retrieval

Similar Messages

Maybe you are looking for