Ultra heavy DB access (INSERTS)

Well, I knew this day would come... I have an application that I originaly wrote in PHP, that writes to a MySQL DB every time an advertisment gets an impression. Using the Zend optimizer I have managed to keep up with demand fairly well. However the day of reconong is upon me so to speak and Im thinking about redevloping that part of the app in Java... Dose any one have any sugestions that would help the application stand up to 20 million+ updates per day? Its handling around 6 mill now and running on a dedicated intell based Linux dist.

Thanks, atehrani_java
actually I have thought about using a flat file as a "go between" for the data. But with so much simultaneous access I was worried about issues with locking. also I'm not sure that it would be faster to 1. open read/write access to the file go through it line by line till I find the record I'm looking for then increment that value by one. I have also thought about using files that contained a single line and using a regexp to locate the data for the update, but that's just to ugly :) the other option is loading the table into memory on the server ( like the old RAM drives :) that's a lot faster but I loose the data if a reboot occurs so I will have to import every hour... that's where I'm leaning right now.
I'm using the Resin JDBC driver and TomCat/Jakarta ( I'm not sure if Jakarta is good for this volume, any input? )
Thanks again.
Richard Corsale

Similar Messages

How to access "Insert Bar" by keyboard in Dreamweaver CS5.5

Hi All,
Now I need to support Section 508 compliance, but I don't find how to access "Insert Bar" by keyboard.
For Examlpe: The focus be in "INSERT", but it doesn't move to other operations(red color) by keyboard.
Could you help me to resolve the problem or give any information?
Thanks,
Dennis

Hy Dennis, here are some shortcuts for DW
Keyboard Commands
PC Shortcut
Mac Shortcut
Create a new document
Control+N
Command+N
Open an existing document
Control+O
Command+O
Save an open document
Control+S
Command+S
Close an open document
Control+W
Command+W
Close all open documents
Control+Shift+W
Command+Shift +W
Exit/Quit Dreamweaver
Control+Q or Alt+F4
Command+Q or Opt+F4
Undo
Control+Z or Alt+Backspace
Option+Delete
Redo
Control+Y or
Control +Shift+Z
Command+Y or Command+Shift+Z
Cut
Control+X or
Shift+Delete
Command+X or
Shift+Delete
Copy
Control+C
Command+C
Paste
Control+V
Command+V
Paste special
Control+Shift+V
Command+Shift+V
Select all
Control+A
Command+A
Find and replace
Control+F
Command+F
Open the Preferences panel
Control+U
Command+U
Show/hide rulers
Control+Alt+R
Command+Option+R
Show/hide guides
Control+;
Command+;
Show/hide visual aids
Control+Shift+I
Command+Shift+I
Show/hide grid
Control+Alt+G
Command+Option+G
Edit page properties
Control+J
Command+J
Refresh Design view
F5
F5
Make selected text bold
Control+B
Command+B
Make selected text italic
Control+I
Command+I
Apply paragraph formatting to selected text
Control+Shift+P
Command+Shift+P
Apply heading formatting (H1–H6) to selected text
Control+1 through 6
Command+1 through 6
Add new paragraph
Return
Return
Add a line break <BR>
Shift+Return
Shift+Return
Insert a nonbreaking space
Command+Shift+Spacebar
Command+Shift+Spacebar
Move object or text
Drag selection to new location
Drag selection to new location
Copy object or text
Control-drag selection to new location
Option-drag selection to new location
Select a word
Double-click
Double-click
Select a row or text block
Triple-click
Triple-click
Insert image
Control+Alt+I
Command+Option+I
Insert table
Control+Alt+T
Command+Option+T
Run a spell check
Shift+F7
Shift+F7
Open the Help window
F1
F1
Zoom in
Control+=
Command+=
Zoom out
Control+-
Command+-
Preview in primary browser
F12
Option+F12
Preview in secondary browser
Shift+F12 or Control+F12
Command+F12
Live View
Alt+F11
Option+F11
Freeze JavaScript
F11
F11
Inspect
Alt+Shift+F11
Option+Shift+F11
Code Navigator
Control+Alt+N
Command+Option+N
Get
Control+Shift+D
Command+Shift+D
Put
Control+Shift+U
Command+Shift+U
Check in
Control+Alt+Shift+U
Command+ Option+Shift+U
Check out
Control+Alt+Shift+D
Command+ Option+Shift+D
Hope it helps
brezplačna izdelava spletnih strani

Calendar can't access/insert events on a specific date

Since 2009 I've been experiencing problems inserting and viewing events around the day october 17th - weird but is my marriage date.
I know that very well because was the time I started using alot more the calendar because of the huge "to do lists" I had that time. Since then I tried to export date (backup) delete the files and restore the date. Somehow every oct 17th on my calendar (+one day more o less) is blocked on my computer.
Unfortunately I don't have a genius bar in Brasil and during trips to the US I always had limited time and in Miami a representative asked me to re-install everything but wasn't possible at that time. I did it afterwords - by myself - and didn't chance. Now, with mavericks I went to 2010 for no reason and found out it is finaly working fine all years since 2009. Problem: now the October 20th is behaving just like.
Seem to me that I can't access the day but when I change de view from month to week I see there's no sunday oct 20th at all (see attach_1) and whe I change to daily view the right side of the day is empty and all my tries to add an event on the 20th ended up on the 19th...
What can I do ? I use macbook air with mavericks just upgraded.
Thank you.
Claudio.
Rio de Janeiro - Brasil.

Hi,
Your problem seems to be similar to mine, with events changing 1 day position.
https://discussions.apple.com/message/23568141#23568141
Before Mavericks I used latest Mountain Lion, without this problem for sure.
To me, seems like a bug that Apple needs to solve.
Regards,
Fabrício

HEAVY disk access and I can't figure out what's doing it

Since installing Snow Leopard, I'm running into period of heavy disk usage (not idle). I can't seem to figure out what it is, because as soon as I get Activity Monitor up, it's calmed down. It's similar in usage to Spotlight indexing, but that's not what it is. The only thing I notice is the Quick Look Helper seems to at 16% CPU usage when this happens, quickly dropping below 1%. Anyone have any ideas of what I might look for? Is there a log I could check to see disk access?

Hi,
You could look at the Console.app in the Utilities folder and the 'top' command in the Terminal.app

When trying to send an email I can not access "insert addresses" link, what is wrong?

I am using Windows XP and when trying to send an email using Yahoo email I can not insert address from that link. It will not open. I can not find a way to solve this. Help. Thanks

See this:
[http://support.mozilla.com/en-US/kb/Changing+the+e-mail+program+used+by+Firefox]

Ultra VNC / no access from external IP

Hi Router: Linksys WRT 54 GL (latest firmware) Config: There is port forwarding on Router: any external IP ; port 5900-5901 ; to 192.168.1.101 (my comp in LAN) External IP of Router: let's say A.B.C.D Application: Ultra VNC ver. 1.1.0.2 (server and repeater run on LAN comp 192.168.1.101) Internal comp has no firewall, only antyvirus application - Avast What happens: If I try to connect to LAN comp from external IP - using Ultra VNC Viewer - I get info "Fail to connect to server". I do it by giving the external IP of my Router: A.B.C.D. If I try to connect to LAN comp from internal IP (so from comp which is in the same LAN - connected to the same router) - everything works perfectly. I do it by giving the external IP of my Router A.B.C.D. If I try to use telnet on port 5900 or 5901 on IP: A.B.C.D - from external IP - I get info: "Could not open connection to the host on port 5900 - conection failed". If I use port scan of A.B.C.D - it shows that only regular ports are open so only: 25, 110 and 80. Any thought what I do wrong? In addition, I tried to do it on Tomato firmware and it did not worked - same story. Maybe internal comp is configred wrongly in some way, maybe ports are blocked - but as I mentioned - there is no firewall on this internal comp.

http://forums.linksys.com/linksys/board/message?board.id=Wireless_Routers&thread.id=113119
I am having the same problem with my WRT54GL; the "live support" people have told me that the newest firmware will fix that, along with a 'random disconnect' problem. However, the link they sent me only brings up an older firmware. I can only assume the new one isn't posted / completed yet.

INSERT statement in Java and MS Access

Hi all,
can anyone please tell me how to insert data to an MS Access table using JSP i tried INSERT statement of java but it is getting errors saying INSERT statement is wrong. I have no idea about MS access insert statement. i am totally tired of this. Please someone help me.

Hello,
MS Sql can cause problems where it goes off standard, however I dont think insert is any different.
INSERT INTO table_name (column1, column2) VALUES (variable1, variable2)
Make sure your table and column names are exactly right, Java is case sensitive, so make sure the case is correct also.
The other common error is if you have a required field in the database that is not populated by your program, so, if for instance there was a column3 in the table for the above example, which was a required field, the sql would fail as there is no data being entered for column3.

Access to Ultra Search Packages/Procedures?

I'd like the ability to build an Ultra Search application using custom stored procedures similar to how one can use Oracle Text.
Does Ultra Search provide access to its stored pacakges and procedures, or does it force one to use the Java API that's included?
Thanks,
Chris
[email protected]

If you log-on to the database as "WKSYS", you will see all the packeges, procs and functions that perform various admin related tasks.
You might want to look at those to see if they perform the search as well. My guess is that using these procedures search is also possible.
I had created my own procs in the database which basically call a few WKSYS functions in a specific sequence to do some admin related tasks (like crawling, creating/deleting groups etc.)
Regards,
Amit

KT4 Ultra + Sata

Hi there,
Got rather strange problem that came up after i had some heavy file accessing in lan movin numerous files sizing from 600mb to 2gb.
i have system which has system drive on ide raid cable. 2 regular ide drives on primary ide, one burner on secondary ide and 2 serial ata drives Seagate 160gb.
I've had this system runnin on windows xp pro past year now, up 24/7 and only rebootin it for updates and such, but basically its up months straight.
well, i went to lan-party and took my machine there ofcourse. everything worked ok there the first day but on the second windows decided to lost SATA drives from the system, well i booted, promise controller showed the drives on bootup ok and i thought no big deal, but then when i got windows up it gave "Delayed Write Failed" and only showed one of the SATA drives (other ide drives were visible)
first i thought that the other drive had died (these things happens) and shutted the machine down, i took the power cable and sata cable out from that drive and started again. much to my amaze when windows booted up it gave the same error message and couldnt find the drive that was visible last time. at that point i thought it might be motheboard gone bad. Anyway, i took both sata drives offline for the duration of the lan-party since i woudn't want to think it there.
now I've searched web for solution for similar problems, found some, but those has been related either fresh install of winxp or installing drivers or modifying cache settings etc. In my case, the machine has been up and running over a year and last thing i updated was some drivers a month ago.
if it were only one drive doing this i would simply change it at work and hopefully begone with it, but 2 identical drives bought at different times and installed at different times can't brake down at the same time, (well allright Mr.Murphy has been evil to me before but still ).
Strange thing also is that i can use both drives short amount of time, i can access all the files ok and nothing seems to be corrupt yet. both drives also makes sound that is like they're shutting down and then restarting. which would suggests that they have gone bad but then again 2 drives at same time.. grr..
I was thinkin that if the PSU has gone bad it might do this but if its that's the case, shouldn't then all the drives shutdown and restart..
i can test with another PSU but not until few days until i get back to work.
phew.. went kinda long..
ps: exact system config: Kt4 ultra bfisr, Athlon 2400xp, 2x256mb(ddr333), 1x512mb(ddr333), 40gb seagate(ide), 60gb ibm(ide), 80gb seagate(ide), msi dvd+-burner(4x), 2x160gb seagate(sata), Radeon 9800pro, Live player 5.1, Sirtech 360W PSU, 3com 10/100, buffalo 10/100.

Quote
Originally posted by Louhikarme
Hi,
it was 360W sirtec with followin stats: dc output : +5V 35A, +3.3V 28A, +12V 17A, -5V 0.3A, -12V 0.8V, +5VSB 2A.
I changed it to 420W sirtec, didn't look it stats tho but. now everythin seems to be ok. both drives keep runnin ok sofar about half hour uptime now. i hope this is the solution otherwise this will get tricky.
+5v 35A
+3.3V 28A need higher than 30A
+12V 17A Need higher than 20A

JDBC sender: after read insert records into another table

Hi all,
I send records from a SQL view (not a table) to RFC via proxy method.
After reading a record from the view I would like to move this record to a database table called CHECKED. Can anyone provide me a solution for this or is this impossible. (there are 6 fields that have to be inserted in DB CHECKED after reading: admin, bukrs, dagbknr, bkstnr, datum, regel)
Can I use an INSERT statement in my Update SQL Statement with variables or do I have to create an SP?
Hope someone can help me out of here...
Thanks in advance!
Wouter.

ur strucutre would of:
<root>
<Satement1>
<TableName action=INSERT>
<table>checked</table>
<access>
<admin>val</admin>
<bukrs>val</bukrs>
<dagbknr>val</dagbknr>
<bkstnr>val</bkstnr>
<datum>val</datum>
<regel>val</regel>
</access>
</dbTableName>
</StatementName1>
</root>
or u can use a SQL DML which wud pose a strucutre similar to
<root>
<stmt>
    <Customers action="SQL_DML">
      <access> INSERT CHECKED SET admin=$admin$, bukrs=$bukrs$', dagbknr=$dagbknr$, bkstnr=$bkstnr$', datum=$datum$, regel.=$regel.$'
      </access>
    </Customers>
</stmt>
</root>
for more inputs refer to <a href="/people/sap.user72/blog/2005/06/01/file-to-jdbc-adapter-using-sap-xi-30 link on jdbc</a>

Sql - Insert problem in MsAccess

Hello!!!
J have problem with INSERT function, I use MsAccessm as database. My query is :
INSERT INTO [Produkty-www] ( Id,Nazwa,Kod,Cena)
VALUES 6646545,"Zlaczka
prosta 22mm 1/2 ' z (KRoCIEC)",'JGK22-1/2Z',10.00)
this is very import symbol ' in 1/2 ' z must be at the place. When I execute this query I have exception. In maaccess I create query and also msaccesse show me when is the bad part of query the sybmol ' is underline.
So I create a new query but in access :
INSERT INTO [Produkty-www] ( Id,Nazwa,Kod,Cena) VALUES (6646545,"Zlaczka prosta 22mm 1/2 ' z (KRoCIEC)",'JGK22-1/2Z',10.00)
and ok access add record, now I copy this query to my java application and I also have exception.
Why this query don`t work.. ?

Ok, it`s done :
PreparedStatement statement = podlaczenie.prepareStatement("INSERT INTO [Produkty-www] (id, Nazwa, Kod, Cena) VALUES (?,?,?,?)");
statement.setInt(1,2);
statement.setString(2,"ffsdfds'fdsfs");
statement.setString(3,"kod");
statement.setInt(4,124);
statement.execute();
But I need a sql query print to console, a search a method of statement but I dont find that I look for, it is some method that give my sql query in string ?
Thank`s for help

Requerying MS Access table?

Hi,
Ok, I got my insert statement to work now using a preparedstatement. I noticed now that my JTable doesn't reflect the new record unless I stop and restart my application.
I'm using a JTabbedPane and adding a class that extends AbstractTableModel on one tab. On another tab I have a JPanel with my controls for inserting a record.
I setup a ChangeHandler and add it to the listener of the JTabbedPane, this detects when I switch tabs. If the current tab is my table tab I set the tableModel = null and rebuild it. This seemed the best approach. When I do this I get an SQLException from the tableModel.getValueAt() method saying the result set is closed.
Here's what I think is the pertenant code (let me know if you want to see something else):
private class ChangeHandler implements ChangeListener
public void stateChanged( ChangeEvent e )
if ( tabbedPane.getSelectedIndex() == 0 )
tableModel = null;
buildResultTable();
} // end if
} // end method stateChanged
} // end private inner class ChangeHandler
public void buildResultTable()
// create TableModel
tableModel = new MyTableModel( dbConnection );
try
tableModel.setQuery(
"SELECT date, odometer, trip_meter, no_gallons FROM records ORDER BY date desc" );
} // end try
catch ( SQLException sqlException )
JOptionPane.showMessageDialog( null, sqlException.getMessage(),
"Database Error - buildResultTable", JOptionPane.ERROR_MESSAGE );
} // end catch
// create JTable delegate for tableModel
resultTable = new JTable( tableModel );
resultTablePane = new JScrollPane( resultTable );
} // end method buildResultTable
public void setQuery( String query ) throws SQLException, IllegalStateException
// ensure database connection is available
if ( !connectedToDatabase )
throw new IllegalStateException( "Not Connected to Database" );
// specify query and execute it
resultSet = statement.executeQuery( query );
if ( resultSet == null )
System.out.println( "Query didn't work!" );
// obtain meta data for ResultSet
metaData = resultSet.getMetaData();
// determine number of rows in ResultSet
resultSet.last(); // move to last row
numberOfRows = resultSet.getRow(); // get row number
// notify JTable that model has changed
fireTableStructureChanged();
} // end method setQuery
public Object getValueAt( int row, int column ) throws IllegalStateException
if ( !connectedToDatabase )
throw new IllegalStateException( "Not Connected to Database" );
// obtain value at specified REsultSet row and column
try
resultSet.absolute( row + 1 );
return resultSet.getObject( column + 1 );
} // end try
catch ( SQLException sqlException )
JOptionPane.showMessageDialog( null, sqlException.getMessage(),
"Database Error - getValueAt", JOptionPane.ERROR_MESSAGE );
} // end catch
return ""; // if problems, return empty string object
} // end method getValueAt
I'm new to Java so I'm sure there's a better way to do what I'm trying to do. Any ideas where I went wrong or a better way to do it? Any help is greatly appreciated.
Thanks in advance,
Linn

Ok, I got my insert statement to work now using a
preparedstatement. I noticed now that my JTable
doesn't reflect the new record unless I stop and
restart my application.MS Access? That question is asked every week here.
Here's an instance I picked at random from a forum
search for "access insert":
http://forum.java.sun.com/thread.jspa?forumID=48&threa
dID=348300Yeah, I thought it would be a common issue but I've spent the better part of three days going over google searches for this answer but no luck yet. Probably just haven't found the right combination of search terms yet.
I checked that forum thread you suggest and it, like all the others I've found, don't actually answer the question. They all seem to end with someone asking the original poster for more information and that's the end of the discussion thread.
Maybe if I rephrase the question, here's what I'm doing...
I query Access and build a JTableModel from a resultset.
I insert a new record into Access.
I switch over to Access and see that the record is inserted, Access shows that the insertion worked. (I switch tasks in Windows without quiting out of my Java app.)
I switch back to my Java app. and look at the table and the inserted record is not there yet.
So, what I'm thinking is that I need to "requery" the Access database and the new record should be included. My question is, how do I do that? How do I requery or refresh my resultset?
Oh, let me mention that I open the database connection and setup statement and resultset objects when I launch my app. and close them when I exit the app.
If I simply try to requery the database it throws an sqlException in the getValueAt() method of my TableModel extension class.
sqlException: Result set is closed is the message and is thrown by the line resultSet.absolute( row + 1 ); Here is the getValueAt() method code:
public Object getValueAt( int row, int column ) {
// obtain value at specified ResultSet row and column
try {
resultSet.absolute( row + 1 );
return resultSet.getObject( column + 1 );
catch ( SQLException sqlException ) {
sqlException.printStackTrace();
return ""; // if problems, return empty string object
} // end method getValueAt
Any help is greatly appreciated.
Thanks,
Linn

Does finding putting reverbs on inserts odd make me old?

I saw another guy (who is 10 years younger than me) work the other day and he was putting reverbs on inserts and adjusting the wet dry mix.
I thought that was odd because I have always had the approach that (unless you were doing some specific effect) you put reverb on an aux send bus. Compression and EQ and stuff where you want to alter the whole signal goes on inserts.
Then I thought maybe that is cos I used to use analogue mixers and outboard gear and then computers that could only handle one or two reverb plugins and I was carrying on work practices from previous types of technologies into a new situation in a way that isn't really rational. what do you guys (young and old) think?
best tommy banana

Great observation!
IMO, heavier utilization of inserts in a DAW is definitely a 'younger generation' thing (myself being part of that 'younger generation').
As processing power has become less of a concern on modern computer, I would often find myself simply duplicating reverb plug-ins to other track inserts and adjusting the wet/dry mix to suit. I think this method is easier to visualize for those who are used to the DAW environment, as opposed to the 'classic' bussing method.
That being said, I more recently have found it beneficial to use an aux effects send now that I have a deeper understanding of effects routing. For one, it certainly never hurts to utilize internal signal flow to conserve CPU power. This setup also makes it easier to adjust reverb levels using the bus mix control directly from the timeline window rather than continually jumping between plug-in windows.
Message was edited by: Nathan Edwards1

Tables Accessed

Hi Friends.
I have one application in C++, that access my Oracle Database. I can to know what tables were accessed (insert, update, delete, select) during the execution: as audit my schema.
Thanks a lot for any idea.

Check This .... If its useful
SELECT * FROM V$SQL;
Ashok

Ultra 10 down for the count

I mistakenly switched off my Ultra 10 as it was starting the boot process. Now it won't boot, even respond to Stop-A, or anything else. Just a blank screen after the keyboard is acknowledged. No OpenBoot, anything.
Any ideas?
U10 w/ Solaris 10
Peter
It is now running after being without power most of the day.
Thanks.

Hello Peter,
<b>ultra 10 remote access</b>
did you obtain the USB-Serial adapter for your notebook or have another system with a serial port available?
I would suggest that you attach to the serial port of the Ultra 10 and review the output.
<i>Just a blank screen after the keyboard is acknowledged</i>
Maybe the system is running full-diagnostics. Check if the keyboard is properly attached.
If a serial console ist still not available, use the <b>Power-On Self Test (POST) / Keyboard LEDs</b> from the following document.
http://docs.sun.com/app/docs/doc/800-6358-11/6hne6kjq2?l=en& amp;a=view#z40001bb1511
Michael

Ultra heavy DB access (INSERTS)

Similar Messages

Maybe you are looking for