How to manage large database records in enterprise application

Hi All,
I am working on a large enterprise application relating to Capital Market. I am working in Java and with its extended technology. I am facing one critical problem which needs solution from your side. I have a database table which contains approximately more than 5 millions of records, I want to display the records with proper pagination. Here I am using Hibernate for database related stuffs. I am using a query which contains a join query to load the records. After the query the filtered records come to approcimately 80,000. I am unable to make proper pagination, everytime for next or previous set of 10 records I hit the database which is a time consuming affair. I do not know what I will do , should I cache the data for pagination. Everytime I load more than 80,000 records, think that in an web based application, the no of users are 5000, then how to manage. I need core java level solution not in the JSP level. Please help me in this regard.

After the query the filtered records come to approcimately 80,000. I am unable to
make proper pagination,Just a thought. If you display 50 per page, that's 1600 pages. Say it takes the user
15 seconds to read the page: total 400min=6 2/3 hours and probably a bad case of RSI.
The proper pagination would possibly be no pagination.

Similar Messages

How to build dynamic databases(record set) for mobile?

Hi All ,
i have an applocation that needs to personalize the data for users .
i have the data available , but dont know how to personalize it fot users to download special version of my application.
how to build dynamic databases(record set) for mobile?

In the load rule in the dimension build settings you would need to go to the tab dimension definition, choose the time dimension and right click on it. Select Edit properties. If you have not done so, set the dimension to be the time dimension. Then go to the generations/levels tab and set the generation names you need. For example if you want YTD, you would set the generation name to Year, if you want QTD set it to Quarter. You would set the number to the generation number that coorisponds to the generation. The DBAG has the list of names for all of the DTS members.

How to manage several databases with DWH

hi,
How to manage several databases within an Oracle datawarehouse.
I.e. to memorize in a DWH the informations along various axes of analysis relating to each databases (I mean : operations, breakdowns, parmeters, caracteristic technical, statistics ...)
Thanks
Robert

Mylenium, thanks for a helpful hint!
I tried your suggestions and it seems that i have to save
- mask shape and
- Stroke effect settings incl. key frames
as separate things, if i want them in the effects panel.
When i set the Stroke effect to my preferred look (with custom colours, width, key frames for Start and Opacity) and save this as an effect, i cannot re-apply this to another mask with any of my custom settings still there. When i re-apply the saved custom Stroke effect, all settings like keyframes, custom colours and width are lost and it arrives with default settings and without any keyframes.
Maybe i do something very wrong here?
I wondered if i should save the mask with Stroke effect as an AE file and re-import it. But this mask can only be saved together with some footage and i don't see how to bring mask including Stroke effect into an existing composition and which of the File/Import ways to use.
Thanks again!

Managing multiple database in 10g enterprise manager without Grid control

Hi,
How do we manage multiple databases using oracle 10 g enterprise manager?.
Do we have any java console EM, so that we can add databases as in 9i EM?
Thanks and regards
Suresh HT

Grid Control is the replacement for 9i EM. Without GC, you'll have to manage each database using its database control which isn't good if you have many many databases.
On the client CD, there is a java console you can install which has some packs like change manager but this console is only there temporarily. My understanding is it's there for some features that haven't been added to GC.
HTH

How to manage 1Lakh of records of data in ADF table

We have requirment on ADF table component in jdev11g.
Currently we have to manage large amount of data (1million ) of records in database and we have to
display arount 1lakh in jsp page using adf table with pagination and sorting .
is it possible or good approch to use ADF table? any cautions we need to take care?
any altrnative solution will be helpfull.
Thanks for all help.

ADF table does not do pagination out-of-the-box - it does scrolling, which is different.
However, my main concern would be that no user can make sense of 100's of 1,000's of records. Even Google only gives you 1000 actual results back, and no one ever scrolls to "Page 47" of the results.
John

How to delete a database record by using EJB entity beans

Hi, All,
Does anyone know how to use entity bean to delete a database record? I have all the EJB entity beans created, including access beans to each. I can successfully create records, find and update records, however, I haven't find a way to delete records yet.
Your response is appreciated.
Cathy

Please see EJB Forums for continue discussion on this subject.
Reference titile: "how to delete database record by using CMP entity beans "

How to manage large partitioned table

Dear all,
we have a large partitioned table with 126 columns and 380G not indexed can any one tell me how to manage it because now the queries are taking more that 5 days
looking forward for your reply
thank you

Hi,
You can store partitioned tables in separate tablespaces. This does the following:
Reduce the possibility of data corruption in multiple partitions
Back up and recover each partition independently
Control the mapping of partitions to disk drives (important for balancing I/O load)
Improve manageability, availability, and performance
Remeber as the doc states :
The maximum number of partitions or subpartitions that a table may have is 1024K-1.
Lastly you can use SQL*Loader and the import and export utilities to load or unload data stored in partitioned tables. These utilities are all partition and subpartition aware.
Document Reference:
http://download-east.oracle.com/docs/cd/B19306_01/server.102/b14231/partiti.htm
Adith

What to audit and how to manage the audit records in oracle 11gr2

can anyone help me how to audit and manage the audit records in oracle 11gr2

867726 wrote:
can anyone help me how to audit and manage the audit records in oracle 11gr2
Hi,
I would recommend have a read this link for details http://download.oracle.com/docs/cd/E11882_01/server.112/e10575/tdpsg_auditing.htm#TDPSG50000
Cheers

How to manage large pages

Just wondering... What is a good way to manage large pages?
Let's say a page with a pannelTabbed with 7 or 8 tabs. Each tab shows a table that is bound to a different VO. Most of the tabs also have a add,delete,edit button and i'm using popups for that.
So as you can see, their will be lots of bindings and lots of components on such a page.
If i create all this on a single page i think it will be a few thousands of lines which is not realy nice...
Should i create page fragments or create taskflows per tab or something like that?
Currently i have created the page with just the panelTabbed and then for each tab i created a taskflow and dropped that inside the showDetailItem. For each popup, i also created a taskflow so i could reuse it later when i need the same popup in other pages.
I'm wondering... what is a correct approach for such large pages. Are their any guidlines for this?

Hi,
we decided to use dynamic regions (11g) for our application.
This means we only have 1 jspx for the whole application and exchange the content at runtime.
For each "block" (e.g. a table, a tab or a popup) we have a single page fragment and task flow.
One page fragment consists normaly only of one view object.
With this concept we can reuse e.g. the same (similar) table on different pages too.
Hope this helps.
regards
Peter

How do I invoke servlets in an enterprise application?

"I've had success with the following in Weblogic:
          - Creating, packaging and deploying a Web Application
          - Creating, packaging and deploying an Enterprise application with a servlet
          that invokes an EJB in its init() method, and a JSP.
          What I am unable to do is invoke the servlet in the Enterprise Application from
          a browser client. I can't seem to get access to it through the correct URL. I
          can make it work as a Web Application on Bea Weblogic and on Tomcat, so I know
          it's a valid configuration, including <servlet-mapping> in the web.xml file. I
          know the servlet is working in the Enterprise App because it is calling the EJB
          in its init() method and printing to the console with a result on startup.
          Here is the contents of my application.xml file:
          <?xml version="1.0" encoding="UTF-8"?>
          <!DOCTYPE application PUBLIC '-//Sun Microsystems, Inc.//DTD J2EE Application
          1.2//EN' 'http://java.sun.com/j2ee/dtds/application_1_2.dtd'>
          <application>
          <display-name></display-name>
          <module>
          <ejb>EJBHello.jar</ejb>
          </module>
          <module>
          <web>
          <web-uri>pilots.war</web-uri>
          <context-root>pilots</context-root>
          </web>
          </module>


          Have you tried "http://localhost:7001/Pilots" ?
          Howard Hyde <[email protected]> wrote:
          >"I've had success with the following in Weblogic:
          >- Creating, packaging and deploying a Web Application
          >- Creating, packaging and deploying an Enterprise application with a servlet
          >
          >that invokes an EJB in its init() method, and a JSP.
          >
          >What I am unable to do is invoke the servlet in the Enterprise Application
          >from
          >a browser client. I can't seem to get access to it through the correct
          >URL. I
          >can make it work as a Web Application on Bea Weblogic and on Tomcat, so
          >I know
          >it's a valid configuration, including <servlet-mapping> in the web.xml file.
          > I
          >know the servlet is working in the Enterprise App because it is calling
          >the EJB
          >in its init() method and printing to the console with a result on startup.
          >
          >
          >Here is the contents of my application.xml file:
          >--------------------------------------
          ><?xml version="1.0" encoding="UTF-8"?>
          ><!DOCTYPE application PUBLIC '-//Sun Microsystems, Inc.//DTD J2EE Application
          >
          >1.2//EN' 'http://java.sun.com/j2ee/dtds/application_1_2.dtd'>
          ><application>
          > <display-name></display-name>
          > <module>
          > <ejb>EJBHello.jar</ejb>
          > </module>
          > <module>
          > <web>
          > <web-uri>pilots.war</web-uri>
          > <context-root>pilots</context-root>
          > </web>
          > </module>
          >%

How to use multiple databases in oracle10g enterprise manager

i have two databaases in my system
when i opened my enterprise manager
its always displayed to log in the already created database
but it does not display the just created db .
Pls give me solution for that its urgent

nitesh piyaranjan wrote:
i have two databaases in my system
when i opened my enterprise manager
its always displayed to log in the already created database
but it does not display the just created db .
Pls give me solution for that its urgentWith the same thoughts on "urgent", if your issue is to have another db being used with the EM, you must have noticed in the url in your browser, a port number is shown. Like this one,
http://localhost:1158/emHere it is 1158. For the 2nd db, there would be another port number assigned. All you have to do is to use the correct port number and you would eb able to use the 2nd db with EM. All the port numbers are in teh files, portlist.ini which will be under Oracle_home/install folder.
HTH
Aman....

How to manage a Database Application with more than two tables

Hello All,
I need to manage (reconciliation and provisioning) a database application where user attributes are strored in seven tables.
Reference guide for Database Applications Table connector says that only two tables can be managed using this connector.
Which is the best way to solve this problem? Could I create a view in my database ? are database views supported? Must I create a new conector?
Thanks in advance.

Hi ,
I developed it from scratch due to complex requirements for accessing tables and their relationship. You can use current connector for your reference.at higher level you need to do only two change (1) build query from xml files to add,update,delete* record across seven tables - (2) changing oim elememnt ( use connector guide for changing element to match your needs)
To develop new connector :
(1) study relationship between these tables (1:*) and fields of interest and also ,as earlier mentioned timestamps for fetching changed record. based on your requirement.
(2) create OIM elements , something you have when you deployed DB app. connector. modify it for requirement. i.e fields .. trusted , non trusted. process task,adapter
(3) Develop classes to get execute query on database. create adapters to perform add/update/delete operation on 7 tables.

Performance: How to manage large reports with high data volume

Hi everybody,
we actually make some tests on our BO server system, to define limitations and oppertunities. Among other things we constructed a large report with a high data volume (about 250.000 data records).
When executing the query in SAP Query Designer it takes about 10 minutes to display it. In Crystal Reports we rebult the row and column structure of the query. The data retrieval in Crystal Reports Designer last about 9 minutes - even faster as in the query.
Unfortunately in BO InfoView the report is not displayed. After 30 minutes of loading time we get a timeout error RCIRAS0244.
com.crystaldecisions.sdk.occa.managedreports.ras.internal.ManagedRASException:
Cannot open report document. ---
The request timed out because there has been no reply from the server for 600.000 milliseconds.
Also a refresh of an report with saved data is not possible.
Now we are asking us some questions:
1. Where can we set the timeout for InfoView to a value larger than 30 minutes?
2. Why is InfoView so slow compared to Crystal Designer? Where is the bottleneck?
3. Whats the impact of SAP single sign-on compared to Enterprise logon on the performance?
Thanks for any helps and comments!
Sebastian

Hi Ingo,
thank you for your reply.
I will check the servers and maybe change the time limits.
Unfortunately we have a quite slow server system that probably cause this timeout. In CR Designer we have no problems, its really quick. Is it to expect that CR Designer and InfoView have almost the same performance?
Another nice point: When we execute the query in SAP BEx Query Designer it takes about 10 minutes to open it, in Crystal Designer it needs just about 5-6 minutes. We integrated exactly the same fields in the report, which exist in die SAP BEx query.
What may cause the difference?
- Exceptions and conditions in the query?
- Free characteristics in the query?
- anything else?
Best regards,
Sebastian

How to manage large Remote Sensing image in oracle

I want to manage many Remote Sensing images in Oracle database. Which model is more reasonable? Please all my friends give me your suggestions.

This MyApp application (Application 100) was created by the HR Oracle account.
I could use
http://127.0.0.1:8080/htmldb/f?p=100
to run this application by logging in as hr/hr .
For the above URL, if I logged in as anotherOracleAccount/password, I got the 'Invalid Login Credentials' message.
As you said, I could use
http://127.0.0.1:8080/htmldb/f?p=4550
to get into HTML DB of the Oracle XE environment by logging in as anotherOracleAccount/password.
Since MyApp is using the HR-owned 'employees' table, should we grant some privileges on hr.employees to anotherOracleAccount?
I tried this, I still got the 'Invalid Login Credentials' message.

How to manage my database?

Hello,
I'm thinking about how to structureproducts in my database. I
want to set it up as efficient as possible at the start so this
will save me time in the future. How I'm thinking about setting it
up:
In my industrie (strollers) there are often mainmodels which
are available in lots of collors. Because they are treated as
different products with each its own ean code, every color gets its
own product information. Sometimes, all these colors have the same
accessoiries (like a black umbrella or something), other times each
color stroller has its own coller accessoiries and more often its a
combination of both.
I'm thinking of setting up my internal ID's like this:
<b>ID-------Name------Categorie</b>
1000-----Black "something" stroller----Stroller
1001-----Red "something" stroller-----Stroller
1002-----Blue "something" stroller-----Stroller
1100----Black "Umbrella" accessorie----Stroller accessorie
1101----Red "Umbrella" accessorie----Stroller accessorie
1102----Blue "Umbrella" accessorie----Stroller accessorie
1110----Universal stroller accessorie----Stroller accessorie
Problem 1: For product 1000 I want to be able to "cross sell"
1100 and 1110. This can be done manualy in a special table whre I
link each id alone. Or, do you guyz think there is a better way to
automize this?
Problem 2: When I want to show a list of different strollers
I only want a specific moddel to show up once with small foto's of
other colors in the information which can be seen underneath the
foto of all the different types. In this set up it would need to
show all products with categorie "Stroller" (so far pretty straight
forward), but it also only needs to show 1 model, for instance the
black one (1000). Is it smart to make id numbers by the thousand
and give each main product for its type a 1000th id? (for instance
id: 1000, 4000, 12000 etc..)? Is it possible to extract only
strollers that have these numbers?
I can understand this is not very clear at once, if you have
any further questions, please let me know!
Thanks!

"SyKeSnr1" <[email protected]> wrote in
message
news:ggh2ik$bjd$[email protected]..
> Problem 1: For product 1000 I want to be able to "cross
sell" 1100 and
> 1110.
> This can be done manualy in a special table whre I link
each id alone. Or,
> do
> you guyz think there is a better way to automize this?
>
> Problem 2: When I want to show a list of different
strollers I only want a
> specific moddel to show up once with small foto's of
other colors in the
> information which can be seen underneath the foto of all
the different
> types.
> In this set up it would need to show all products with
categorie
> "Stroller" (so
> far pretty straight forward), but it also only needs to
show 1 model, for
> instance the black one (1000). Is it smart to make id
numbers by the
> thousand
> and give each main product for its type a 1000th id?
(for instance id:
> 1000,
> 4000, 12000 etc..)? Is it possible to extract only
strollers that have
> these
> numbers?
>
> I can understand this is not very clear at once, if you
have any further
> questions, please let me know!
what ecommerce app are you using? I'm asking because some
treat things kind
of how you're wanting to structure it. I.e., a unique Product
Name and then
various SKUs under the product for variables. Take a look at
Cartweaver to
see what I mean (www.cartweaver.com)

How to manage large database records in enterprise application

Similar Messages

Maybe you are looking for