Design partner for hug amounts of db connections and data?

I am new to J2EE and I have a question to the more experienced architects here. I would like to build an application based on a J2EE server that will regularly poll multiple databases from different manufactures over the network or the Internet (could be several 1000) and save this data in a central database. This would mean that a full-scale application could receive hug amount of data in bursts or sent on an e2e fashion. For a web shop type of application there is the MVC architecture but is there a design partner for this type of problem where I need to handle hug amounts of db connections and data?
Any help or suggestion would be greatly appreciated.

Are you talking about merging serveral data base to a single repository database ?

Similar Messages

Free Report Writer for Oracle Database except Crystal Report and Data Vison

Dear All,
I want Free Report Writer for Oracle Database except Crystal Report and Data Vision software.
Wr are working on Linux and windows both platform.
Any one have direct link or website address for it ?
Regards,
Vipul Patel
Ahmedabad

Please check the following link -
http://www.google.co.in/search?client=firefox-a&rls=org.mozilla%3Aen-US%3Aofficial&channel=s&hl=en&q=open+source+report+writer+for+oracle&meta=&btnG=Google+Search
Regards.
Satyaki De.

Report in Excel format fails for huge amount of data with headers!!

Hi All,
I have developed an oracle report which fetches upto 5000 records.
The requirements is to fetch upto 100000 records.
This report fetches data if the headers are removed. If headers are given its not able to fetch the data.
Have anyone faced this issue??
Any idea to fetch huge amount of data by oracle report in excel format.
Thanks & Regards,
KP.

Hi Manikant,
According to your description, the performance is slow when display huge amount of data with more than 3 measures into powerpivot, so you need the hardware requirements for build a PowerPivot to display huge amount of data with more than 3 measures, right?
PowerPivot benefits from multi-core processors, large memory and storage capacities, and a 64-bit operating system on the client computer.
Based on my experience, large memory, multiprocessor and even
solid state drives are benefit PowerPivot performance. Here is a blog about Memory Considerations about PowerPivot for Excel for you reference.
http://sqlblog.com/blogs/marco_russo/archive/2010/01/26/memory-considerations-about-powerpivot-for-excel.aspx
Besides, you can identify which query was taking the time by using the tracing, please refer to the link below.
http://blogs.msdn.com/b/jtarquino/archive/2013/12/27/troubleshooting-slow-queries-in-excel-powerpivot.aspx
Regards,
Charlie Liao
TechNet Community Support

Just purchased Airport Extreme ac and lost internet connection 3X. Reset to factory settings and worked for 2 days then lost connection and remedied by unplugging power supply. Anyone else having problems?

Just purchased Airport Extreme ac and lost internet connection 3X in less than one week. Fisrt time, reset to factory settings and fixed problem. Has occurred 2 additional times and connection re-established by unplugging AP extreme. Anyone else having these problems? Do I have a bad router? Thanks.

I definitely think this is a Mavericks issue. My iMac running Mavericks is the ONLY system in the house that drops the network randomly while all other systems never lose the network. No idea how to resolve this, but here is the workaround I'm posting:
I've had the 'network drop' issue with my Airport Extreme for the last 2 months. It reconnects when I pull the ethernet cable and plug it back in. I've tried downgrading the AE firmware, resetting to factory, etc. Nothing worked. I finally threw in the towel and created a script that monitors my network connectivity and restarts my interface if it senses it has dropped:
#!/bin/ksh
while true
do
yup=`ping -c1 -t2 www.google.com|grep from`
if [[ -n $yup ]]
     then echo "Internet is connected!"
else
        ifconfig en0 down; ifconfig en0 up
        echo "Down at `date +%m%d%Y%H%M%S`">>./dropped.out
fi
sleep 5
clear
done
I know its a workaround, but its saving me the headache of constantly pulling my cable and putting it back in!
Good luck!
-Mike Gray

Netflix app error - Please make sure network connectivity and date and time are accurate

Am getting this error message when trying to view instant movies via ipad2 or iphone. Anyone have this error? I can't connect to Netflix via either device - I've tried unistalling & re-installing Netflix app on both devices. I am connected to the internet via our home network and date & time are correct on all devices & home computer - any other setting I'm missing? I didn't have any of these problems before I installed the new iOS5 on my devices. Netflix said it's an apple operating setting that needs to be modified.
Any help would be greatly appreciated.
Thanks!
Kristen

HI Jason,
I feel for you. That's a lot of work!
How large is the partition you tried to create using BootCamp for Windows?
And how much free disk space is on the MacBook startup disk?
Right or control click the MacintoshHD icon. Click Get Info. In the Get Info window you will see Capacity and Available. Make sure you always have a minimum of 10% to 15% free disk space at all times.
Just in case, check the Mac startup disk for errors.
Insert Installer disk and Restart, holding down the "C" key until grey Apple appears.
Go to Installer menu (Panther and earlier) or Utilities menu (Tiger and later) and launch Disk Utility.
Select your HDD (manufacturer ID) in the left panel.
Select First Aid in the Main panel.
(Check S.M.A.R.T Status of HDD at the bottom of right panel. It should say: Verified)
Click Repair Disk on the bottom right.
If DU reports disk does not need repairs quit DU and restart.
If DU reports errors Repair again and again until DU reports disk is repaired.
When you are finished with DU, from the Menu Bar, select Utilities/Startup Manager.
Select your start up disk and click Restart
Carolyn
Message was edited by: Carolyn Samit

Smart Connect and data

I tried using Smart Connect (on my E4G) at night - to turn off wifi and data at night and turn them back on in the morning. The wifi part worked flawlessly. Data connection do get disabled at night, but wont re-enable in the morning - I have to manually enable it. Any workaround?
With SmartConnect on, phone loses only 4% charge overnight, otherwise it is 10-12% - it would be wonderful, if it is completely automatic.
Thanks,
Anoop
Solved!
Go to Solution.

@anoopr
There was a similar question, regarding low battery mode, you will have to enable it manually.
"I'd rather be hated for who I am, than loved for who I am not." Kurt Cobain (1967-1994)

Need help in designing fetching of huge amount of records from a DB

Hello,
I am having a starard application which fetches data from MSSQL Server using this standard code:
CallableStatement cs;
Connection connection;
cs = connection.prepareCall("{call " + PROCREQUEST_SP + "(?,?,?)}");
cs.execute();
ResultSet rs = cs.getResultSet();
while (rs.next())
Most of the queries the users run are no more than 10,000 records and the code works OK like this.
But, the Database contains more the 7 million records and I would like to enable the user to see all these records if he wants to.
If I enable it at the current code I finally receive java.lang.OutOfMemory Exception. How can I improve my code in order to do this kind of task?

Hello Roy,
Yes the DB is connected again and only the data chunk asked for is called. eg. if user is on page 2, containing recoreds 1000-2000, and clicks on 3 only records from 2000-3000 should be fetched from the DB. This logic should be taken care by your query.
This saves a lot of Memory,so you wouldn't face MemoryException.
Regards,
Rahul

Any option is there to find the error record in loop for huge amount of rec

Hi Guru's,
In our production system we got a error. While debugging we found one of our loop getting 1 lakh records. One of the record from the internal table having some wrong values because of that its giving a error message. But we are not getting any proper message.
Now our problem is its very difficult to debug all the records one by one. Even its not possible to give Watchpoint. bze in what situations its giving this error that also not predictable. So how to find the error record?
Kindly suggest.
Ananadhan

Need a lot more info.
To start with is this CR Designer or some other product?
I suspect it's classic SAP products like Business One etc., if so please mark as answered and post your question int the correct forum.
Thank you
Don

I Purchased Adobe Creative Suite 5 Design Premium for Mac about 4 years ago and now every time i launch one of the applications it says "Trial expired"

I purchased Adobe Creative Suite 5 and Premiere Pro CS5 in late 2010 and I use the applications on a daily basis, until now. About a month ago I decided to create an adobe account and log in since it asks me every time, after i logged in the applications worked for about a day or two but on the third day i was getting an error that said trial expired on every CS5 application i opened except for Adobe Premiere Pro CS5 Adobe Bridge CS5 and Adobe Onlocation CS5, I no-longer have the original boxes with the serial numbers due to the fact that I moved about a year ago and the boxes with the serial numbers must have been accidentally thrown away (trust me i have spent hours looking for them, i opened every box i have). What can i do to get my products working again? To repurchase all of the products it will cost thousands of dollars that i don't have.
Thanks for reading!

Find your serial number quickly
Sign in, activation, or connection errors | CS5.5 and later
Contact Customer Care
Mylenium

Ipod nano 6th gen askinh for resore every time i connect and after the restore not showing the sysnced song on ipod

i have a ipod nano 6th gen, few days back when i tried to add few songs through iTunes it gave me error that it "can't connect to ipod . restore it" so i did and after that i synced al the songs and it showed that my my empty ipod has been up few GB's. after i disconnected , i could not see any song on the ipod . when it connected back the ipod the got same error about restore. i dont know what to do now , please help.

Hello Singhindia,
It sounds like you restored your iPod Nano when iTunes prompted you and it appears to sync. When you disconnect it and look at the content, the songs arent there, and when you plug it back into iTunes you get the same message again. I would recommend these troubleshooting sections from the following article to help isolate the issue to hardware or software:
iPod nano: Error message saying that iPod 'could not be identified properly'
http://support.apple.com/kb/TS3218
Verify that iTunes is installed and updated
Restart the computer
Verify that Apple Mobile Device Support is installed
Verify the device's USB connection
Verify that the Apple Mobile Device Service and iPod service are both running
Verify that the Apple Mobile Device Driver is installed
Remove and reinstall iTunes
If the issue continues, gathering iPod Diagnostics may be helpful for you or for support personnel in identifying the issue.
Additional Information
Certain phone connectivity software from vendors such as Samsung, Nokia, Bora, Novatel, and Sony may also cause this issue. If you have such software on your computer:
Uninstall your Samsung, Nokia, Bora, Novatel, or Sony phone connectivity software and test. Contact the manufacturer of this software for assistance in doing this.
Remove iTunes and all related Apple software by following this article (for Windows XP), or this article (for Windows Vista and Windows 7).
After reinstalling iTunes, test the iPod nano.
If you still need your phone connectivity software that was removed, reinstall this software and test your iPod nano to ensure it still functions with iTunes. Contact the vendor of your phone connectivity software if the issue returns.
While the error message is different than you are seeing, the troubleshooting is relevant for you.
Thank you for using Apple Support Communities.
All the best,
Sterling

Huge amount of virtual memory and system slows to a crawl

I have a mac mini with 5 GB of memory running os x mavericks and server 3, prior to the mavericks upgrade, it ran fine.Now it is showing an excessive amount of virtual memory in use, 40-70 gb, and the system slows to a near stop: e.g. switching apps takes over 30 seconds, starting one takes well over a minute, pressing command tab doesn't respond with list of apps and the display doesn't always wake up. A hard reboot (hold down power button to turn off, then back on) seems to be the only thing that works to get out of this. I tried scheduling a shutdown and reboot with energy saver but that just resulted in a completely non-responsive system. When the display does wake up, there's nothing in the activity monitor memory display that indicates a high memory usage.
I'm considering wiping out the hard drive and reinstalling unless somebody has some other ideas.
Does anybody have similar problems with mavericks and server 3?

I managed to look at it before the system hung up and it looks like devicemgrd is the top user of memory. Of course, I don't know if this is indicative of a problem as I have only 1 server. I saw it up to 1.4 GB just a little bit ago and now it is down below 800MB and dropping.

I unwittingly opened a huge amount of documents simultaneously and this crashed my Mac. How do I tell the Mac to do not open these documents on the startup?

I use iMac with Mac OS X (10.5.4). Thanks!

Check System Preferences / Accounts - Login Items.
BTW... if you are running v10.5.4, there are updates available. The latest version for Leopard is v10.5.8.
Click your Apple menu / Software Update...

Step by step guide to create a RFC connection and data transfer

hi
could i get a step by step guide to transfer/read data from SAP and legacy system using the concept of RFC.
Regards
Shiva

hi
Here are the steps.
SM59 Transaction is used for Connection Establishment with Destination.
When you establish a connection to a client through a destination, the HTTP connection must first be entered in transaction SM59.
There are two types of HTTP connection in transaction SM59: Call transaction SM59 to display the different RFC destinations.
The HTTP connection to the external server (connection type G) and the HTTP connection to the R/3 system (connection type H) are different only in their logon procedures. Their technical settings are the same. To display the technical settings, double-click a connection.
You can choose from three tabs. Under Technical Settings, you can specify the following:
· Target Host: The host to which you want to connect.
Note that if you are using HTTPS as a protocol, you have to specify the full host name (with domain).
· Service No.: Here, you specify the port. The destination host must of course be configured in such a way that the specified port understands the corresponding protocol (HTTP or HTTPS). See Parameterizing the ICM and the ICM Server Cache.
· Path Prefix: At the time when the connection to this destination is initiated, the system inserts this sub-path before ~request_uri.
· HTTP Proxy Options: Here, you can configure a proxy for HTTP connections: You can determine the proxy host and service, as well as users and passwords for the HTTP connection.
The tab page Logon/Security will be different depending on whether you have selected a HTTP connection to an external server (connection type G) or a HTTP connection to an R/3 system (connection type H).
HTTP Connection to an External Server (Connection Type G)
Choose the connection you want to use. You can choose from the following logon procedures:
· No Logon: The server program does not request a user or password.
· Basic Authentication: The server program requests a user and password. Basic Authentication is a standard HTTP method for authenticating users. When a user logs on to the target system, he or she provides a user ID and password as authentication. This information is then sent in a header variable as a Base 64-encoded string to the server, through the HTTP connection.
· SSL Client Certificate: If you use client certificates for authentication, the client authentication is performed through the Secure Sockets Layer (SSL) protocol. In this case, you must also select the SSL Client PSE of the SAP Web AS that contains the relevant certificate for the authentication. The target system must handle the issuer of the SAP Web AS client certificate as a trusted system.
Under Logon/Security, you can also activate SSL to ensure that HTTPS is the protocol used (if you select SSL, make sure that the correct port is entered under Technical Settings). In the security transaction STRUST you can determine which type of SSL client is used. (Getting Started with the Trust Manager, Trust Manager).
The field Authorization for Destination has been implemented as an additional level of protection. We recommend that you specify a user and password for the RFC destination.
HTTP Connection to an R/3 System (Connection Type H)
Here, you can specify more settings for authentication in the target system.
The settings under Technical Settings and Special Options are the same as for connection type G. Under Logon/Security, the connection type H has additional logon procedures. As with external servers, you can activate and deactivate SSL and specify an authorization.
Because the target system is an SAP system, you can set the client and language for the logon as well as the user name and password. If you check Current User, you have to specify the password.
The following authentication procedures are available: Basic Authentication, SAP Standard, and SAP Trusted System, and SSL Client Certificate.
· HTTP Basic Authentication: Logon with user and password
· SAP Standard: This procedure uses an RFC logon procedure. The RFC Single Sign-On (SSO) procedure is valid within the one system. The same SAP user (client, language, and user name) is used for logon.
· SAP Trusted System: Trusted RFC logon to a different SAP system (see Trusted System: Maintaining Trust Relationships Between SAP Systems)).
· SSL Client Certificate: The SSL protocol enables you to use client certificates for the logon.
Type G/H (SM59)
Timeout:
When sending a HTTP request, you can use this parameter to specify the maximum response time for the connection.
HTTP Setting:
You can use the HTTP version to specify the protocol version of the HTTP request (HTTP 1.0 or 1.1).
Compression:
You can use this option to activate the gzip compression for the request body. This can only be activated in HTTP Version 1.1.
Compressed Response:
In the standard setting, the SAP Web Application Server sends the Accept Encoding field as a header field with the value gzip, if the application server can handle this compression. This notifies the partner that the caller can handle gzip decompression, and that the partner can send compressed data. If you want to prevent a compressed response being sent, choose the option No.
HTTP Cookie:
You can use this option to control the way received cookies are handled.
You can specify the following for cookies:
· Accept them automatically
· Reject them automatically
· Accept or reject them in a prompt
· Use a handler for the event IF_HTTP_CLIENT~EVENTKIND_HANDLE_COOKIE to process the cookies in the program.
· In the next section, you can read about the parallelization of requests.
Thanks,
vijay
reward points if helpful

Oracle DB Connect and Dates

Hello
From what I have read, reading dates from a table connected via dbconnect is not easy. OSS recommends that you create a view in the source system with a character mask on the date fields as Oracle stores dates in a unique way.
In my situation I cannot create views in the source system. Does anyone know of a way to convert this number using ABAP ?
Thanks
Cameron

Hi Cameron,
I'm using two types of such views:
1. a view in the remote system that reads SAP tables
2. a view in SAP that replaces a SAP table, that reads a table in the remote system. In order to do so:
2.1. rename the table in the SAP system: for example: RENAME zfbuz TO zfbuz_backup
2.2. create the view in the SAP system: for example: CREATE OR REPLACE VIEW sapr3.zfbuz AS SELECT ... to_char(date_column, "YYYYMMDD")... FROM ...@dblink
Pls write back if you need more help. BR,
Alvaro

No cell connection and date shows January 6, 1980

I have lost cell service and the date on my device shows January 6, 1980

Let's bring your phone back to present time, SnowTx. Does your phone indicate that it is connected to 3G at all? Are you able to dial *228 and select option 1? Have you recently activated this device?
AndreaS_VZW
Follow us on Twitter @VZWSupport

Design partner for hug amounts of db connections and data?

Similar Messages

Maybe you are looking for