Database connection way to slow (~60sec!)

my program consistently polls a COM port and grabs the information as it arrives. it then creates a new thread to put this info into a mysql database.
my problem is that when i am trying to get a connection with the database, ie. via the line:
con = DriverManager.getConnection("jdbc:mysql://localhost:3306/SMS_DB?user=xxx&password=xxx");
it takes over 60 seconds!
this line of code is in the constructor of my database connection thread.
i have looked at my task manager whilst running the code and the program uses nearly all the cpu time (96-98%!). i'm thinking this is the reason why the database thread takes such a long time to get a connection to the database.
any suggestions would be much appreciated.

no my connection doesnt take this long with a database connection program.
i think i have just found the problem though...my program gets stuck in a while loop and just keeps iterating (thus causing huge amounts of cpu time. please delete the initial thread to stop people from thinking they are going to find an answer to some question here...

Similar Messages

Slow Initial Database Connection

I think I have a slowness issue with the initial Oracle database connection. When I try to connect initially, the connection , it takes a long time. Is there anyway to speed this up...
I am using encryption and jdbc on oracle.
This takes a good 20 - 30 seconds....
Class.forName("oracle.jdbc.driver.OracleDriver");
PARAMETERS.put("oracle.net.encryption_client","REQUIRED");
PARAMETERS.put("oracle.net.encryption_types_client","DES40C");
PARAMETERS.put("oracle.net.crypto_checksum_client","REQUESTE");
PARAMETERS.put("oracle.net.crypto_checksum_types_client","MD5");
PARAMETERS.put("user",user);
PARAMETERS.put("password",password);
connect = DriverManager.getConnection(dbUrl,PARAMETERS);

Didn't I answer this question?
The process of encrypting the connection, and generating MD5 checksums for each message sent over that connection both take considerable time to set up and the only way to make it go faster is to throw more processing power at it (i.e., get a faster computer), or switch to a far weaker form of encryption (but that means we can break the code in mere minutes).
This is a known feature. This is why the National Security Agency (NSA) and the National Reconniassance Office (NRO) have more supercomputers than any other US Government Agency.
If time really is a factor, then I suggest that you drop the MD5 requirement. MD5 essentially confirms that you have received all of the data you are expecting (and in a particular order) and no more than that. Attempting to decrypt DES also confirms that you have received all of the data you wanted (in the correct order) and no more than that. In other words, the two functions are redundant.
However, MD5 is a one way function whereas DES is two way; DES allows you to decrypt the message itself, but MD5 only allows you to confirm that the message is genuine. Hence, drop MD5 in favor of DES.
If you're really interested in rewriting the DES and MD5 schemes for more speed, do some reading on the cryptography forums, or check out an appropriate book at the library.

Opening multiple reports in Crystal Reports for VS causes database connect limit to be reached. Seems to be no way to force Crystal Reports to close database connection (other than exiting application)

I am working on upgrading an application that has been in use for many years. The application is written in VB6 and I have been tasked with upgrading the current application to Crystal Reports for Visual Studio. I am using Crystal Reports for VS Version 13.0.12.1494. The system's database is a Sybase SQL Anywhere 16 database with an ODBC connection using integrated login. Each of the reports has the database connection set up from within the report. There is only once database server, so each of the reports are pointing to the same DB. The database server is currently installed as a "Personal Server" with a limit of 10 connections.
I have implemented the CR viewer as part of a COM-callable wrapper that exposes a COM interface for VB6 to interact with. Inside of my viewer component is a Winform that embeds the Crystal's Report viewer. The COM interface basically maps the basic Crystal apis to methods that the VB6 can call (i.e., Load Report, Set Field Text, Update SQL Query, etc). This architecture is working as designed and the reports are displaying correctly and responding correctly to changes in queries, etc.
The issue is that after I open 9 reports, the tenth one will respond with an error indicating that the database connection limit has been reached. The database connections used by the reports aren't released until after the application is closed. The application is designed for a secure environment that prohibits the non-administrative user from accessing the systems desktop, so asking the user tor restart the application after 10 reports isn't a viable option.
I have checked and database connection pooling is turned off for the SQL Anywhere 16 driver.
I have been digging on this for a few days and have tried adding code in the FormClosed event to close and dispose of the Report Document as follows:
ReportDocument reportDoc= (ReportDocument) crystalReportViewer1.ReportSource;
reportDoc.Close();
reportDoc.Dispose();
GC.Collect();       // Force garbage collection on disposed items
I have also tried the following (as well as maybe 20 or so other permutations) trying to fix the issue with no success.
ReportDocument reportDoc= (ReportDocument) crystalReportViewer1.ReportSource;
foreach (Table table in reportDoc.Database.Tables)
     table.Dispose();
crystalReportViewer1.ReportSource = null;
reportDoc.Database.Dispose();
reportDoc.Close();
reportDoc.Dispose();
reportDoc = (ReportDocument)crystalReportViewer1.ReportSource;
GC.Collect();       // Force garabe collection on disposed items
Any ideas or suggestions would be greatly appreciated. I have been pulling my hair out on this one!

Hi Ludek,
Thanks so much for the quick reply. Unfortunately I did not have time to work on the reporting project Friday afternoon, but did a quick test this morning with some interesting results. I'm hoping if I describe what I'm doing, you can show me the error of my ways. This is really my first major undertaking with Crystal Reports.
If I simply load the report, then close and dispose, I don't hit the limit of 10 files. Note that I do not logon manually in my code as the logon parameters are all defined within the reports themselves. The logon happens when you actually view the report. Loading the report doesn't seem to actually log in to the DB.
What I did was create a very simple form with a single button that creates the WinForm class which contains the Crystal Viewer. It then loads the report, sets the ReportSource property on the CrystalReportsViewer object contained in the WInForm and shows the report. The report does show correctly, until the 10 reports limit is reached.
The relevant code is shown below. More than I wanted to post, but i want to be as complete and unambiguous as possible.
This code displays the same behavior as my earlier post (after 10 reports we are unable to create another connection to the DB).
// Initial Form that simply has a button
public partial class SlectReport : form
        public SelectReport()
            InitializeComponent();
        private void button1_Click(object sender, EventArgs e)
            ReportDocument rd = new ReportDocument();
            ReportForm report = new ReportForm();
            try
                rd.Load(@"Test.rpt");
                report.ReportSource = rd;
                report.Show();
         catch (Exception ex)
              MessageBox.Show(ex.Message);
// The WinForm containing the Crystal Reports Viewer
    public partial class ReportForm : Form
        public ReportForm()
            InitializeComponent();
        private void Form1_Load(object sender, EventArgs e)
            this.crystalReportViewer1.RefreshReport();
            this.FormClosed += new FormClosedEventHandler(ReportForm_FormClosed);
        void ReportForm_FormClosed(object sender, FormClosedEventArgs e)
            ReportDocument rd;
            rd = (ReportDocument)crystalReportViewer1.ReportSource;
            rd.Close();
            rd.Dispose();
        public object ReportSource
            set { crystalReportViewer1.ReportSource = value; }
Again, any guidance would be greatly appreciated.

Oc4j and database connections issue (way too many created)

I seem to be experiencing a serious issue every time someone connects to my application. New connections are made to the database instead of using existing connections (i.e. pooling doesn't seem to work). In my data-sources.xml, the pools are set to have a max-connections of 3, yet when I query the v$sessions view, there are additional sessions created every time the application is hit which has sent it way over the max-connections parameter in the data-sources.xml file. If oc4j is pooling the connections how can this happen? Is there any way of tracking where this is occurring or what could be causing this? (SQLNET.EXPIRE_TIME has been set, database is 10g, oc4j is 101202 and oc4j on linux platform)
Thanks
Paul

Paul,
According to the documentation for OC4J 10.1.2, if you use the value of the "ejb-location" attribute (from the "data-sources.xml" file) when doing a JNDI lookup of your datasource, then you should be using connection pooling.
It's probably also an idea to not define a "pooled-location" attribute in your "data-sources.xml" file.
Also, you can get database connection information via the "Spy" [Web] application. Use the following URL:
http://oc4jHost:oc4jPort/dmsoc4j/Spy
Of-course you need to replace "oc4jHost" and "oc4jPort" with the appropriate values. For example if you open your Web browser on the same machine that OC4J is running on, and if you are using the default port, then the URL will be:
http://localhost:8888/dmsoc4j/Spy
Good Luck,
Avi.

Slow database connection with mysql

I am using MySQL Server 5.0 as my backend and java1.5 as my front end for the GUI. The following statements I use to connect to MYSql.
Class.forName("com.mysql.jdbc.Driver").newInstance();
String url = "jdbc:mysql://localhost:3306/mysql";
The database access seems to be very slow.
I have a data file with about 3000 lines. The parser reads the file one line at a time, formats an insert query and calls executeUpdate. The process takes more than 2 minutes.
What is slowing down my process? Please help
Thanks

I am using MySQL Server 5.0 as my backend and java1.5
as my front end for the GUI. The following statements
I use to connect to MYSql.
Class.forName("com.mysql.jdbc.Driver").newInstance();
String url = "jdbc:mysql://localhost:3306/mysql";
The database access seems to be very slow.
I have a data file with about 3000 lines. The parser
reads the file one line at a time, formats an insert
query and calls executeUpdate. The process takes more
than 2 minutes.
What is slowing down my process? Please help
ThanksHi,
1. Are you opening and closing the database connection ,During inserting every record from data file?
If so, please avoid opening closing connection for each query execution.
Because , opening and closing the database connection is a time consuming one.
You should open all the required database connections, before you use them or use
Database connection pooling if your application is sucah a big one.
2. Try PreparedStatment instead of Statement. Because Prepared statment query is
compiled and stored into Cache. so if you are executing the same query again and again, the compiled query will be picked up from cache, by replacing with new
parameters
3. Check the logic you used to pick record from datafile and insert into database .
4. Check your RAM size , if you installed database and jvm on same machine.
if so , increase your RAM size.
thanks,
nvseenu

Im trying to download the Io6 update but my connection is too slow and the update is too big is there another way to download the update?

Im trying to download the Io6 update but my connection is too slow and the update is too big is there another way to download the update? Any ideas or help and what can i do? The update starts again if it is paused

Use your friend's internet to update.

I am using the database connectivity toolkit to retrieve data using a SQL query. The database has 1 million records, I am retrieving 4000 records from the database and the results are taking too long to get, is there any way of speeding it up?

I am using the "fetch all" vi to do this, but it is retrieving one record at a time, (if you examine the block diagram) How can i retrieve all records in a faster more efficient manner?

If this isn't faster than your previous method, then I think you found the wrong example. If you have the Database Connectivity Toolkit installed, then go to the LabVIEW Help menu and select "Find Examples". It defaults to searching for tasks, so open the "Communicating with External Applications" and "Databases" and open the Read All Data. The List Column names just gives the correct header to the resulting table and is a fast operation. That's not what you are supposed to be looking at ... it's the DBTools Select All Data subVI that is the important one. If you open it and look at its diagram, you'll see that it uses a completely different set of ADO methods and properties to retrieve all the data.

New database connection failed with oepe

Hi everybody,
@http://docs.oracle.com/cd/E27086_02/help/oracle.eclipse.tools.common.doc/html/install.html#install_oepe
Oracle Enterprise Pack for Eclipse Installation Guide says:
"You can install OEPE using any of the following ways:
Download, and then unzip OEPE plugins directly into the Eclipse dropins folder and restart Eclipse."
This is what I have done,
then when I create a new database connection, and I press the button "test connection" i got a pop up saying "Ping failed" giving details:
java.lang.ClassNotFoundException: oracle.jdbc.OracleDriver
     at java.net.URLClassLoader$1.run(Unknown Source)
     at java.security.AccessController.doPrivileged(Native Method)
     at java.net.URLClassLoader.findClass(Unknown Source)
     at java.lang.ClassLoader.loadClass(Unknown Source)
     at java.net.FactoryURLClassLoader.loadClass(Unknown Source)
     at java.lang.ClassLoader.loadClass(Unknown Source)
     at oracle.eclipse.tools.database.connectivity.db.OracleJDBCConnection.createConn(OracleJDBCConnection.java:198)
     at oracle.eclipse.tools.database.connectivity.db.OracleJDBCConnection.createConnection(OracleJDBCConnection.java:149)
     at org.eclipse.datatools.connectivity.DriverConnectionBase.internalCreateConnection(DriverConnectionBase.java:105)
     at org.eclipse.datatools.connectivity.DriverConnectionBase.open(DriverConnectionBase.java:54)
     at org.eclipse.datatools.connectivity.drivers.jdbc.JDBCConnection.open(JDBCConnection.java:73)
     at oracle.eclipse.tools.database.connectivity.db.OracleJDBCConnectionFactory.createConnection(OracleJDBCConnectionFactory.java:26)
     at org.eclipse.datatools.connectivity.internal.ConnectionFactoryProvider.createConnection(ConnectionFactoryProvider.java:83)
     at org.eclipse.datatools.connectivity.internal.ConnectionProfile.createConnection(ConnectionProfile.java:359)
     at org.eclipse.datatools.connectivity.ui.PingJob.createTestConnection(PingJob.java:76)
     at org.eclipse.datatools.connectivity.ui.PingJob.run(PingJob.java:59)
     at org.eclipse.core.internal.jobs.Worker.run(Worker.java:54)
Did I miss something?

The documentation is out of date. The unzip to dropins method is no longer supported. The OEPE zip you downloaded is actually an archived repository. You can follow the instruction for installing using Eclipse Update Manager and point to the downloaded zip instead of the online repository.
I will follow up to get the docs updated.
- Konstantin

How to correct close database connection after report generation

Hello
I have problem a with alive database connection after report creation and report closing. How to properly to close connection to database?
Best regards
Edited by: punkers84 on Jun 17, 2011 10:38 AM

that's what I am doing... after viewing the report, I call the close method on the window closing event of the container window. but the connection is still open. I had a lot of other issues with my jdbc driver but after downgrading to an older version those issues are resolved.Only this one is still there! Is there any other way to close the connection (like using dbcontroller or etc.)?

How database connection pooling works in a application

Hi Guys,
I am new to Java and looking into best way of doing J2ee database conectivity. I am using Eclipse galileo3.5 J2EE with Mysql database and Tomcate 6.0.
I am developing an email application where I need to implement MVC model for my webapplication, using jsp for presentation, servlet for control and java beans for model.
I came across two tutorial for database connection pooling as given below.
Eclipse Corner Article: Creating Database Web Applications with Eclipse - In this tutorial connection pooling is configure in Tomcate 6.0
It says Copy and paste the following into your context.xml file (you may have to click on the Source tab at the bottom of the editor to be able to paste). This defines a DataSource with the name "jdbc/SampleDB". Our application will retrieve database connections from the pool using this name.
<?xml version="1.0" encoding="UTF-8"?>
<Context>
<Resource name="jdbc/SampleDB" auth="Container"
type="javax.sql.DataSource"
username="app" password="app"
driverClassName="org.apache.derby.jdbc.ClientDrive r"
url="jdbc:derby://localhost:1527/sample"
maxActive="8" />
</Context>
Where as in second tutorial - http://www.roseindia.net/answers/viewanswers/2838.html
It uses java bean for connection pooling and then use straight way in JSP and no Servlet used.
conpool.jsp
<%@page import="java.sql.Connection"%>
<jsp:useBean id="pl" class="com.CoreJava.ConnectionPooling"/>
<% Connection con = pl.getConnection(); %>
//do something using con
connectionPooling.java
import com.mysql.jdbc.jdbc2.optional.MysqlConnectionPoolD ataSource;
public class ConnectionPooling
static Connection con=null;
public static Connection getConnection()
try
MysqlConnectionPoolDataSource po=new MysqlConnectionPoolDataSource();
po.setServerName("localhost");
po.setPortNumber(3306);
po.setDatabaseName("mydatabase"); //changeur database name
po.setUser("root");//ur username
po.setPassword("");//ur password
con = po.getConnection();
catch(Exception e)
System.out.println("Exception Connection :"+e);
return con;
Please some one explain which is the best way of doing connection pooling to the database by using MVC pattern
Please if some one advise me how to use MVC architecture for simple email application and database connectivty.
Thanks

>
>
Where as in second tutorial - http://www.roseindia.net/answers/viewanswers/2838.html
Never EVER use roseindia. It is terrible shit.
[http://balusc.blogspot.com/2008/06/what-is-it-with-roseindia.html]
The correct answer is what you found in the eclipse article. And you can read the Tomcat docs for more.
As per usual the code you have posted from Roseindia is a big pile of rubbish that was written by a complete idiot. I mean the person who wrote it apparently doesn't know much Java at all. Let alone JDBC. Or Connection pools. Or J2EE. It's not the worst I've seen from them but it's pretty bad.

Problem in getting the database connection from a connection pool

Hai All,
I am facing a problem in getting the database connection from a connection pool created on weblogic server 8.1.
I am using the Oracle database 8.1.7.
I have configured my connection pool, datasource and JNDI in weblogic.
In my java program i have the following code to retrieve the connection.
import java.sql.*;
import java.util.Hashtable;
import javax.naming.Context;
import javax.naming.InitialContext;
class jdbcshp1 {
    public static void main(String[] args) {
     Connection connection = null;
     try {
           Hashtable ht = new Hashtable();
           ht.put(Context.INITIAL_CONTEXT_FACTORY,"weblogic.jndi.WLInitialContextFactory"); // Wanna get rid of this.
           ht.put(Context.PROVIDER_URL,"t3://localhost:7001"); // wanna get rid of this.
           // Get a context for the JNDI look up
           Context ctx = new InitialContext(ht);
        javax.sql.DataSource ds = (javax.sql.DataSource) ctx.lookup ("myjndi1");
          //Create a connection object
          connection = ds.getConnection();
     The above code is working fine but, the two ht.put statements are creating problem.
The problem is, after converting the application into WAR file it can be deployed
on any machine or different port on same machine. My application fails if its deployed on
weglogicserver which is at different port.
Is there any way that i can get rid of those ht.put statements or any other way to solve the problem.
any help is appreciated.
Thanks in advance
Pooja.

Hai All,
Firstly, thanks for ur reply.
Even i have seen some code which uses context constructor with out any parameter and works fine.
i dont understand why its not working for my code.
When i remove those ht.put code and use context constructor with out any parameter, it giving an error.
Context ctx = new InitialContext();
javax.sql.DataSource ds = (javax.sql.DataSource) ctx.lookup ("ocjndi");
connection = ds.getConnection();The error is as follows:
javax.naming.NoInitialContextException: Need to specify class name in environment or system property, or as an applet parameter, or in an application resource file: java.naming.factory.initial
the above error is forcing me to include those code but if the port number is changed the code will not work. Plz let meknow if some setting have to be made.
I appreciate all ur valuable help.
Thanks once again.
Pooja.

How to reuse a 9iAS Portal database connection in a BC4J application?

Hi,
I have a 9iAS Portal 9.0.2 application, and I want to call a BC4J/UIX application from the Portal application. Ideally I would like to reuse the database connection already established within Portal, because it has authenticated the user with the SSO, and has all of the Portal and VPD settings already in the environment. I don't want to ask the users to re-log in.
I have looked at the Portal Java PDK and cannot find anything appropriate - has anyone accomplished this, or is there another way of doing this?
Thanks,
Steve

BC4J supports JAAS authentication.. look at the jazn stuff. When u deploy your application on 9ias one of the pages in the wizard asks what kind of authenticatoin you would like to use, you might be able to set something up there...
Also you an secure the URL in the httpd.conf file so that if a user directly attemps to access that application they are presented with the SSO log in screen.

Performance with MySQL and Database connectivity toolbox

Hi!
I'm having quite some problems with the performance of MySQL and Database connectivity toolbox. However, I'm very happy with the ease of using database connectivity toolbox. The background is:
I have 61 variables (ints and floats) which I would like to save in the MySQL-database. This is no problem, however, the loop time increases from 8ms to 50ms when using the database. I have concluded that it has to do with the DB Tools Insert Data.vi and I think that I have some kind of performance issue with this VI. The CPU never reach more the 15% of its maximum performance. I use a default setup and connect through ODBC.
My questions are:
1. I would like to save 61 variables each 8-10ms, is this impossible using this solution?
2. Is there any way of increasing the performance of the DB Tools Insert Data.vi or use any other VI?
3. Is there any way of adjusting the MySQL setup to achieve better performance?
Thank you very much for your time.
Regards,
Mattias

First of all, thank you very much for your time. All of you have been really good support to me.
>> Is your database on a different computer? Does your loop execute 61 times?
Database is on the same computer as the MySQL server.
The loop saves 61 values at once to the database, in one SQL-statement.
I have now added the front panel and block diagram for my test-VI. I have implemented the queue system and separate loops for producer and consumer. However, since the queue is building up faster then the consumer loop consumes values, the queue is building up quite fast and the disc starts working.
The test database table that I add data to is created by a simple:
create table test(aa int, bb char(15));
...I'm sure that this can be improved in some way.
I always open and close the connection to the database "outside the loop". However, it still takes some 40-50 ms to save the data to the database table - so, unfortunatly no progress to far. I currently just want to save the data.
Any more advise will be gratefully accepted.
Regards,
Mattias
Message Edited by mattias@hv on 10-23-2007 07:50 AM
Attachments:
front panel 2.JPG ‏101 KB
block diagram.JPG ‏135 KB

How to use Forms Default Database Connection in java class

When a form based application is started, a connection is made with underlying database. This is the Default (Primay) Database Connection.
The problem is I have some of my business logic implemented in a java class. In this class I have to make a another connection with the same database. What I want to do is to use the original Database Connection in the java class. In this I may avoid the overhead of reconnection.
Could anyone pls guide me in this way...

you can't share the forms connection. Sorry :(

How can I use SQL TOOLKIT concurrently with Database Connectivity ?

I have installed LabVIEW 6.1 with the Database Connectivity Toolkit and the SQL Compatibility Toolkit (e.g. _SQL folder). I am trying to make the transition from the SQL Toolkit VIs to the Database Connectivity toolkits, but for compatability with existing systems I would like to be able to run the two sets of VIs concurrently (but not in the same app).
When I read into 6.1 a connection VI that I wrote with LabVIEW 6.0 and the SQL toolkit the connection reference type gets changed from a number to type connection (see attachments) . Does compatbility mean that my SQL toolkit VIs are converted to a form compatible with the new ADO ?
Can I use the SQL Toolkit VIs or the Database connectivit
y VIs in the same installation of 6.1 ?
Can I have the SQL Toolkit VIs appear on the functions pallette and function as they did when only the SQL toolkit was installed ?
Attachments:
CNNCT.vi ‏20 KB
CNNCT.vi ‏22 KB

In response to your #2 below:
Actually it is possible to have the old SQL Toolkit and new Database
connectivity in the same installation of LabVIEW. I have only tried it on
6i, but don't see why it wouldn't work on 6.1. The trick is not to install
the SQL toolkit compatabitily VI's. The old SQL toolkit uses the Intersolve
dll through ODBC while the new Database connectivity uses ADO so it is
possible to use both methods not only in the same LabVIEW install, but it
the same running application. It has been a while since I originally did
this, so I am posting only to mention that it is possible and not exactly
how to do it. If anyone is interested in more details just respond.
Brian
"Jeff B" wrote in message
news:[email protected]...
> First, direct answers to your direct questions:
>
> 1. Does compatbility mean that my SQL toolkit VIs are converted to a
> form compatible with the new ADO ?
>
> Yes
>
> 2. Can I use the SQL Toolkit VIs or the Database connectivity VIs in
> the same installation of 6.1 ?
>
> No
>
> 3. Can I have the SQL Toolkit VIs appear on the functions pallette
> and function as they did when only the SQL toolkit was installed ?
>
> No
>
>
> Now an elaboration:
>
> Having the old SQL Toolkit and the new Database Connectivity Toolset
> installed on the same version of LabVIEW on the same computer is not
> supported.
>
> Once you install the Database Connectivity Toolset, any VIs written
> with the SQL Toolkit will run, but with the ADO layer, as you
> suspected.
>
> Internally, the only way we can have both the SQL Toolkit and the
> Database Connectivity Toolset installed on the same computer for
> troubleshooting customer issues is to have them installed on different
> versions of LabVIEW. I, for example, have LabVIEW 5.1.2, 6.0.3, and
> 6.1 all installed on my computer, and I have the SQL Toolkit install
> on LabVIEW 5.1.2, and the Database Connectivity Toolset installed on
> LabVIEW 6.0.3. In this configuration I can still run SQL Toolkit VIs
> independent of the Database Connectivity Toolset if I open and run
> them in LabVIEW 5.1.2.

Database connection way to slow (~60sec!)

Similar Messages

Maybe you are looking for