Are there any programmatic means of reducing paging and increasing efficiency of insert/updates?

We have a multi-terabyte database which daily receives tens of thousands of records to insert or update. Most online advice on reducing memory paging covers server memory options and dynamic memory management techniques.
Are there any tested programmatic or database design techniques that could also be explored to increase efficiency?
Thanks,
Tom

> How long is it taking now to process this workload?
About four hours. The record data is inserted/updated across multiple related tables.
Across about how many tables?
Four hours seems a bit long for 100k rows to merge, say half updates and half new inserts (and whatever you do about deletes, maybe treat them as slowly changing dimensions), but my first move would be to just treat it as an optimization question and use
the profiler to get a list of the longest running and most expensive queries, and see if they can be individually improved.
Just basic stuff - do you handle the rows one at a time and commit for each one, or are the processes done relationally and with one commit per batch?
Josh

Similar Messages

  • I live in South Africa and I am looking to get a mac book air to help me with all of my schoolwork and presentations. Are there any discounts that students can get and if so how much of a discount?

    I live in South Africa and I am looking to get a mac book air to help me with all of my schoolwork and presentations. Are there any discounts that students can get and if so how much of a discount?

    Hi, actually there is, but you have to inquire according to Apple.com/za website. Here is the statement:
    Student Discounts
    Students, staff and academic institutions are eligible for ongoing discounts on Apple products and solutions. Call 011 535 9080 for further information.

  • Are there any conflict issues with Mountain Lion and Quicken Essentials Ver. 1.7.2

    are there any conflict issues with Mountain Lion and Quicken Essentials Ver. 1.7.2 ?

    https://qlc.intuit.com/app/full_page#

  • Are there any functional differences between the trial and the paid version?

    Are there any functional differences between the trial and the paid version for Labview 2009?  Thank you.
    Solved!
    Go to Solution.

    This outlines the limitations of the eval version of Labview: Limitations of the LabVIEW Evaluation Version
    Cheers, 
    Misha

  • I set a restriction password to my child's iphone 3gs and I forgot it.  Is there any way to recover it?  And if I do an update on it, will that delete it?  This is all new to me so thx in advance!

    I set a restriction password to my child's iphone 3gs and have forgotten it.  Is there any way to recover it?  And if I do an update will that delete password?  This is all new to me so thanks in advance!

    raider1990 wrote:
    I set a restriction password to my child's iphone 3gs and have forgotten it.  Is there any way to recover it?
    No.
    And if I do an update will that delete password? 
    No. To remove a forgotten restrictions passcode requires restoring the device as "New" in iTunes, NOT from backup.

  • How to reduce costs and increase efficiency of pho...

    Dear Skype community! 
    I need to find some information about how to reduce costs and increase efficiency of phone calls in sales organisation? 
    What are advantages of Skype contarry to the concurrence ? I'm Inside Sales manager SEMEA
    Is there anyone who can explaine ? 
    thanks a lot !
    Solved!
    Go to Solution.

    Tilly_in_action,
    Review the following link:
    http://blogs.skype.com/2012/05/24/5-real-benefits-of-using-skype/
    Thanks,
    Kent C.

  • Are there any mp3 players that CANT record and runs by replacable batteri

    hello,
    like the topics says, are there any mp3 players that DOES NOT have the recording function and runs by replacable alkaline batteries?
    i really need one as i am working in a place that requires stay in and i cant charge players, what makes it worst is that there are like top secret information there and they forbits any recording devices, which most mp3 players have XD
    Some help please? thanks! =D

    You can check out the MuVo Sport C00 and MuVo Mix player. They are both operating using AAA battery and without voice recorder.
    Jason

  • Are there any technical Differences between stanard R3 and ISU

    Hello everyone,
    I have recently been speaking to a client who is running ISU.  They are asking for assistance with thier landscape from a technical perspective (BASIS and DB).  i.e. monitoring db growth, reorgs, etc.
    Now, I have been working in BASIS for over 10 years now, and am very comfortable with the above rols.  My question however is -  are there any "technical" differences between the standard SAP system, and ISU?  or are the differences mainly seen on the functional side?
    Thank you very much for any insight any of you can provide.
    Kind regards
    Richard Rog

    Hi Richard,
    I have been a Basis administrator for IS-U/CCS systems for 7 years.  The points Juris made are correct. 
    There are no new transactions or procedures for maintaining and monitoring an ISU system.  ISU "sits" on top of R/3.  The main ISU transaction for customer contact CIC0 has an HTML component that needs an ITS server.  In a 4.6C system you will need to maintain an external ITS.  In ECC 6.0 you will have an integrated ITS.  The main difference from a Basis perspective is support pack application. 
    In 4.6C ISU is an add-in installed in SAINT.  There are conflict resolution support packages (CRT's) that are installed at the same time the SAP_APPL support packages are applied.  In fact SPAM recognizes the ISU add-in and won't let you upgrade APPL (and sometimes Basis) support packs without the CRT's.
    In ECC 6.0 IS-U isn't an add-in any more and has it's own support packs in module IS-UT.  IS-U must be turned on though during an installation or upgrade.  This is done in SPRO with "Activate Business Funcitons".
    Dustin
    Edited by: Dustin Justet on Jun 27, 2008 10:47 AM
    Edited by: Dustin Justet on Jun 27, 2008 10:51 AM

  • Are there any issues with Adobe Photoshop CS5 and OS X Yosemite 10.10?

    Are there any known issues with Adobe Photoshop CS5 and OS X Yosemite 10.10? I heard I would need an older Java version to start it.
    [ spammy links removed by admin ]

    You'll need to reinstall Photoshop CS5 after installing the MacOS 10.10 update -- for some reason the OS updater stomps on some of the Photoshop files.

  • Are there any PC cards which have sample and hold capability

    Are there any PC A/D cards which have sample and hold capabilities up to a 10 Khz sampling rate which we are interested in for modal testing of engine structures. Also if this type of card is available what would be the maximum input channel count of this card. We would be interested in the highest count available up to 64 channels.
    A second question: We currently have a 64 channel PCI 6071 capable of 1.25 MS/s throughput. If we are using all 64 channels what would be the interchannel delay between the first and last recorded channel and at what frequency would we have to be sampling to even be able to see the affect of the interchannel delay of this specific card.
    This issue has been debated wi
    th in our group and your insight would be appreciated as you are the experts in this field.

    Dear Sir,
    Thank you for using NI Developer Zone.
    National Instruments has a product line designed specifically for acquisition of dynamic signals, it is called DSA - Dynamic Signal Analyzers. In according to the description of your application the card that best fits your needs is the NI-4472 that is available in PCI and PXI format. This card is able to acquire 8 channels simultaneously, as opposed to the regular DAQ cards that have a single A/D converter and a multiplexer. The NI-4472 has 8 Delta-Sigma A/D converters one per channel, what results in a better performance than having a single A/D converter in combination with a sample and hold and a multiplexer. To Acquire 64 channels you would have to have 8 boards and synchronize all 64 channels. The Synchronization process is very simple and with a couple of software calls we can synchronize as many as 112 channels for simultaneous acquisition at 102.4K samples per second per channel.
    Regarding your second question, the PCI-6071 will sample between channels in a single scan at the maximum sample rate of the board (1.25 MS/s) but the
    scan rate, i.e. the rate in which the same channel is sampled is defined by the user. Being that said, we can conclude that the interchannel delay will be the inverse of the 1.25 MS/s clock, or 0.8 micro seconds.
    For a 1 KHz sine waveform, this represent a phase delay of 0.288 degrees between consecutive channels. For a channel list of 64 channels each one having the same 1 kHz sine waveform, the phase delay between the first and the last waveform will be 18.432 degrees.
    I really recommend the NI-4472 as a very good solution for your application, besides that the combination of the NI-4472 with LabVIEW and the sound and vibration toolset will give you a tremendous tool to solve not only your immediate need but also provide you a system that will be easily modified and adapted for future needs.
    If you need more info, feel free to contact me and I can give you more details about this product.
    Call 1 800 IEEE488 and ask to speak with the Computer Based Instruments (CBI) support team.
    Best Regards.
    Omar De Andrade
    Applications Engineer - Computer Based Instruments
    http://www.ni.com/support/

  • I am frequently unable to join the internet or it runs very slowly.  I have a Time Capsule in my LAN. Are there any compatibility issues with Time Capsules and any ISPs?

    I am frequently unable to join the internet or, if I can, it is exceptionally slow. The ISP says nothing is wrong ontheir end.  Are there any compatibility issues with any ISPs when using Time Capsule and/or iMacs?

    Tried this several times to no avail.  I believe it is the ISP causing the problem...Time Warner.

  • Are there any command can list all container and XML doc which in DB

    When I use BDB XML shell,
    are there any command can list all container or xml document which in database,
    maybe like command dir(in windows), can list all exist directory and file.
    Thank very much.
    Henry Wang

    Hi Henry,
    When I use BDB XML shell,
    are there any command can list all container or xml
    document which in database,
    maybe like command dir(in windows), can list all
    exist directory and file.If you type "help" in the dbxml shell you'll get a list of all the commands available. As you will observe, you can use the "getDocuments" command to retrieve all the documents within a container. You will have to open the container first.
    If you want to list all the files within a directory you'll need to simply use the command prompt's "dir" (naming all your containers within a directory in the <container_name.dbxml> would allow you get the list by running a "dir *.dbxml" command).
    Not sure that this is what you really want, but if you would like to keep track of all the containers within a directory, or other directories, you can use a container with a special role, that of a catalogue, to hold the list of all created containers on disk, and eventually other specific information.
    Regards,
    Andrei

  • Are there any issues with MacPros+Dual Displays and FCP?

    I have a MacPro (2.1) with an ATI X1900XT graphics card (2 DVI ports). It is currently hooked up to a single 24". My usage is mostly Browsing, Final Cut Suite and Video. I am planning on upgrading to Dual Displays (2*24" or 2*27") but read about some vague issues the ATI might have when using dual displays and FCP (Color more specifically). Are there any specific issues I should be aware of before getting a second display?
    Many thanks in advance

    One graphics card? Two displays? ZERO ISSUES! Not sure what "vague issue the ATI" cards have, but I have that exact card, and run two 24" displays with no problems. I have run dual displays for years. I find working with one very...cramped.
    Shane

  • Are there any known conflicts between Mountain Lion and Microsoft Outlook for Mac? After installing, I can't send or receive eMails

    Are there any known conflicts between Mountain Lion (10.8.3) and Microsoft Outlook for Mac? After installing, I can't send or receive eMails. Using a Macbook Pro.

    Is this a recent problem or has it been going on for some time.  If you just updated to ML, you might want to confirm that you've update to the latest MS Office / Outlook patches.

  • My backround on the new tab page is gone. The boxes are there but I mean the actual background. It went away after updating an I wanna fix it.

    After updating my Firefox, the background for my new tabs page is gone. The boxes are there. But the rest of the screen is just plain white and I dont know how to fix it.

    The background on my new tabs page is white - actually bright grey, which is evidently the default. For changing colors used see
    [[Change the fonts and colors websites use]]
    Check the '''Allow pages to choose their own colors, instead of my selections above.''' If unchecked, so only boxes without any content are shown.

Maybe you are looking for

  • Javascript to save as template file in predetermined directory with prompt for filename.

    I've seen a bunch of examples of how to save a regular illustrator file, but I can't seem to find the syntax for saving a file as a .ait file? Am i just missing something incredibly obvious here?? I know this is not right at all.. but this is what i

  • Charged twice, skype refuses to refund

    I had a subcription for a month of unlimited calls on my account and due to accidentally emptying my account at the ATM on the same day when the skype payment was due it obviously failed to take the money from my bank account. In the past if this hap

  • Late deliveries by vendor

    Hi Gurus, is there a way we can try to capture the following informatiuon. We need to measure late deliveries. A report is needed or a transaction that can be extracted into excel that shows late deleveries by computing the number of days difference

  • Pound (£) sign prefixed with Â

    Hi, I've setup a form which processes/emails the data using PHP. The form gathers data including price (in GBP). When the form results come in by email, the £ sign is prefixed with a Â. Is there a way I can change the php script to remove this charac

  • Hierarchy in Infospoke

    Hello, I want to create an infospoke with the values of the different hierarchy levels. The hierarchy is extracted from datasource 0material_lprh_hier. Do you know some alternative way to put the hierarchy in the infospoke? Thank you in advance. Rega