Best way to update 8 out of10 million records

Hi friends,
I want to update a table 8 million records of a table which has 10 millions records, what could be the best strategy if the table has a BLOB column with 600GB worth of data. BLOB itself is 550GB.  I am not updating the BLOB column.
Usually with non-BLOB data i have tried doing "CREATE TABLE new_table as select <do the update "here"> from old_table;" method .
How should i approach this one?

@Mark D Powell
To give you a background my client faced this problem  a week ago , This is part of a daily cleanup activity .
Right now i don't have the access to it due to security issue . I could only take few AWR reports and stats when the access window was opened. So basically next time when i get the access i want to close the issue once and for all
Coming to your questions:
So what is wrong with just issuing an update to update all 8 Million rows? 
In a previous run , of a single update with full table scan in the plan with no parallel degree it started reading from UNDO(current_obj=-1 on event "db file sequential read" wait event) and errored out after 24 hours with tablespace full on the tablespace which contains the BLOB data(a separate tablespace)
To add to the problem redo log files were sized too less , about 50MB only .
The wait events (from DBA_HIST_ACTIVE_SESS_HISTORY )for the problematic sql id shows
-  log file switch (checkpoint incomplete) and log file switch completion as the events comprising 62% of the wait events
-CPU 29%.
-db file sequential read 6%.
-direct path read 2% and others contributing a little.
30 % of the samples "db file sequential read" had a current_obj#=-1 & p1 showing undo file id.
Is there any concurrent DML against this table? If not, the parallel DML would be an option though it may not really be needed. 
I think there was in the previous run and i have asked to avoid in the next run.
How large are the base table rows?
AVG_ROW_LEN is 227
How many indexes are effected by the update if any?
The last column of the primary key column is the only column to be updated ( i mean used in the "SET" clause of the update)
Do you expect the update will cause any row migration?
Yes i think so because the only column which is going to be updated is the same column on which the table is partitioned.
Now if there is a lot of concurrent DML on the table you probably want to use pl/sql so you can loop through the data issuing a commit every N rows so as to not lock other concurrent sessions out of the table for too long a period of time.  This may well depend on if you can write a driving cursor that can be restarted in the event of interruption and would skip over rows that have already been updated.  If not you might want to use a driving table to control the processing.
Right now to avoid UNDO issue i have suggested to use PL/SQL approach & have asked increasing the REDO size to atleast 10 times more.
My big question after seeing the wait events profile for the session is:
Which was the main issue here , redo log size or the reading from UNDO which hit the update statement. The buffer gets had shot to 600 million , There are only 220k blocks in the table.

Similar Messages

  • Which is the Best way to upload BP for 3+ million records??

    Hello Gurus,
                       we have 3+million records of data to be uploaded in to CRM coming from Informatica. which is the best way to upload the data in to CRM, which takes less time consumption and easy. Please help me.
    Thanks,
    Naresh.

    do with bapi BAPI_BUPA_FS_CREATE_FROM_DATA2

  • Best way to update a solaris jumpstart OS image.

    Hi all,.
    Ive been recently building some v240's but have run into trouble with the rather out of date 02/02 instance of Solaris 8 (yes, i did say solaris 8 - it's a political thing..)
    Anyhow, I have cd images of Solaris 8 02/04 and have a copy of the Sun Blueprints Jumpstart book by "Howard and Noordergraph".
    On page 92, it says to use the "setup_install_server" script with the -b option for /jumpstart/OS/Solaris-xx-xx-xx.
    Ive done that without any probs, then it goes on to say if you want an install server do the same command again without the -b switch.
    Problem is that it spews out this message.
    733 root&#64;bbs00080 # ./setup_install_server -b /jumpstart/OS/Solaris_8_02-2004/
    Verifying target directory...
    setup_install_server:
    The target directory /jumpstart/OS/Solaris_8_02-2004/ is not empty. Please choose an empty
    directory or remove all files from the specified directory and run
    this program again.
    So i chose an empty directory and it goes and does it.
    Is this an errata?
    I already have /jumpstart/OS/Solaris_8_02-2002/ and I wanted to update the files so that I can boot the v240r.
    Except 02/02 doesnt let me do that as it doesnt support the v240r arch.
    Sun told me this, but I'm lost because my existing profile for this box, lists all the packages I want to install, but it whinges about not being able to find a .cdrom toc file.
    I already have three flash archives which i created from good builds from 02/02, in my rules file which work, but this pesky update for the 240r is getting to be a little tricky.
    So far, ive tried copying all the packages from 02/02/Products directory into 02/04/Products but some of them don't install despite being there.
    Can anyone suggest the best way to update my 02/02 with the 02/04 boot loader for the v240?
    Thanks in advance and sorry for any confusion.
    D.

    I'm sorry. I meant. Say my array of x positions is 3, 4, 9. I change 9 to 30. How can I make the polygon see that change?

  • Best Way to Update: Over-the-air OR Via PC (Thru N...

    Which way do you think is the best and MOST RELIABLE way to update the Nokia Nseries? Which way do you use?
    1- Over-the-air
    2- Via Nokia Software Updater (PC)
    Your Thoughts?
    Thanx.
    Solved!
    Go to Solution.

    28-Dec-2008 08:47 PM
    grschinon wrote:
    28-Dec-2008 03:44 PM
    nirav_m_suthar wrote:
    Best way to update the firmware is the via PC coz there are many reason like it takes less time than any other methods, very secury etc.
    That is absolutely not true.
    An NSU update for the N96 at least is a 125MB download or thereabouts.
    V10.043 to V11.018 was about 3.5MB via FOTA, V11.018 to V11.101 was no more than a few hundred KB, and V11.101 to V12.043 was once again about 3MB.
    FOTA is far more reliable than NSU since there are fewer machines involved (the phone grabs the update directly from Nokia instead of having it buffered by a machine, a machine running one of the most notoriously unreliable operating systems ever created) and therefore fewer points of potential failure.
    As psychomania pointed out, there are cases of people bricking their phones with NSU daily on these forums. To date, we have see one case of a failed FOTA update. Draw your own conclusions.
    Like our resident psycho, I hope that FOTA becomes far more widespread in the future. It is much more reliable and quick.
    Message Edited by grschinon on 28-Dec-2008 04:50 PM
    although i tend to agree that FOTA should be safer, but i think we might be jumping to conclusions to early, as there are about 91 phones supported by NSU, most of which are updated by the conventional PC way, whereas there are very few that uses FOTA (i knew of 2 handsets), hence the relatively lower incidence of failures...

  • What's the best way to update my Mac with the latest version of Adobe Flash Player?

    I've been getting prompts whenever I look at certain websites to download the latest version of Adobe Flash Player.  I'm skeptical as to responding to those prompts.  What is the best way to update my Mac Pro with the latest version of Adobe Flash Player?

    You might also want to consider uninstalling Adobe Flash... I currently don't have it installed and haven't needed to install it.  Most websites are now coded in HTML 5 so that the iOS devices can actually visit them.  I can still watch YouTube videos et al.  About the only thing I can't do is play Flash games... but they're a resource hog anyways. 
    Try going without for a day or two and see just how many sites you visit no longer require it.  A lot of people keep it installed out of habit, not out of necessity.  If you have Flash installed, visit a site and it's out of date, it will tell you to update your Flash.  What it won't do is tell you is that had Flash not been installed, it would have used the HTML 5 code instead.  Think about it... if an iOS device can't run Flash at all... it can't visit this site if it were written only to use Flash.  What site would eliminate such a huge portion of their market base?  You'd be surprised at how many sites use HTML 5.  Uninstall Flash and see for yourself.

  • Best way to update individual rows of a Table?

    I've taken a look at some examples, though haven't gotten any clarification on this.  I am looking to have something close to a listbox or table to where I can update just a single column of row values at a 1 time per second pace.  I am looking to display our data-acquisition values in a table or listbox.  The single listbox seemed to work good for this, but I was unable to use row headers to list the channel names next to the channel values.  I was thinking about connecting the cursor values of two list-boxes to do this, but didn't find any info on this for the single list-box.
    I have a few questions:
    1) I have a 1D array to where I want to use that array of data to constantly update the first column (with a multitude of rows) of a table.  I am looking for the best route so as not to take up too much processing time in doing this.
    What is the best way to update individual rows of a table?   Invoke Node "Set Cell Value" ... or is there another method?
    2) Why is it that after every other iteration the row values are erased? 
    Also, for adding additional strings to the original arrray ... is it best to use the "Array Subset" and then the "Build Array" function, or the "Array Subset" and "Insert Into Array" function?
    See the attached example.
    Thanks.
    Solved!
    Go to Solution.
    Attachments:
    Table Example.vi ‏19 KB

    Jeff·Þ·Bohrer wrote:
    2) Why is it that after every other iteration the row values are erased?
    Classic race condition.  dump the for loop and p-node and just wire the 2D array to the table terminal.!
    I'm not seeing the race condition.  What I am seeing is the table emptying after the last element was written to it on every other run.  I saw watched this with highlight execution on.
    But I'm in full agreement with just writing to the terminal.  It is a 1D array, so you will need to use a build array and transpose 2D array in order for it to write properly.
    There are only two ways to tell somebody thanks: Kudos and Marked Solutions
    Unofficial Forum Rules and Guidelines

  • Best way to update audio files in library

    I have quite a few audio files in the library for a Captivate project.  I just modifed a bunch of them, and I am wondering the best way to update the library.
    If I delete the files in the library, I lose all the links to which audio went with which slide.
    If I go into each slide and replace the audio, that is more time consuming, and still a problem when the old audio file is still in the library
    I don't see an option for directly replacing the audio in the library; if I put the new version (same name) it just adds it with a (2), i.e. audioclip and audioclip(2)
    The update option does not give me what I need, unless I am missing something.  First of all, I am using both a Windows computer at the client site, and my own Mac, so the paths are different.  To use the update I would have to update the path for each audio file, which is more trouble that updating every file manually.
    Any ideas?
    Thanks.

    Hi there,
    The recommended way is to go to that slide and import the slide audio again, new audio will replcae the old.
    Once you have replaced all the audios, the audio files that are not in use in the project will still show up in Library.
    You can get rid of all unused items from the library, by clicking on the icon for unused icon and then delete icon:
    Thanks.

  • Best way to update firmware?

    Hi everyone,
    I just wanted to ask you which is the best way to update the firmware for my phone?I mean with usb cable,FOTA etc.
    Thanks in advance!
    Regards 

    Nokia seems to be comitted to improve the user experience... Its really good to know that... They have to do it to survive... BTW Nokia N78 latest firm ware is a little better. The operations seems to be fast. 
    It has just been a day with the firmware.. So far no problem... I faced a few problems while updating the USB get disconnected when the update is about to begin... but the latest software update program has all required warning... It asked me to restart my pc and my cell phone... And try again ... I did it Alas it worked ... got it updated ...
    I found a few things new :
    The icons for videos (The one in old version was better) and search are all new.
    I am from india. I brought this phone seeing the FM transmitter option. But after i brought the phone i found it missing.
    But with this software update i got the option under the music menu :-) thanks a lot nokia.
    Few problems with the camera still remains... music volume has come down a bit... the gps seems to be working a little faster.

  • Best way to update DR database from PROD server automatic ?

    Hello Gurus,
    I want to decide best solution.
    Goal: Best way to update DR Database from PROD Server Database automatic.
    System: 32 bit Linux system with Oracle Database 10g Release 10.2.0.4.0 - Production (database version) Oracle version is standard.
    Please let me know how i can update my DR server with PROD data and this task should be automatic.
    Please ask me more information if required to solve this issue.
    Thanks- Priyank
    Edited by: Oracle DBA P on Nov 19, 2010 3:06 AM

    you mean to say data guard needs to implement ? i think that's one option but what you said is different ?
    tell me procedure how i can implement your idea ? steps i have to perform.
    Thanks
    Edited by: Oracle DBA P on Nov 19, 2010 3:38 AM

  • Best way to update drivers?????

    I'd like to get advice on the best way to update my MB drivers.
    If I update my NVIDIA nForce4 System Driver, does that update my AMD 64 4000+ CPU? or do I need to go to AMD's site and get that update??????
    I'm new to this building PC's so please bear with me.  Thanks==db

    No, it does not update the drivers for your CPU, you have to go to the AMD site to get the drivers for the CPU, and also get the drivers from nVidia.
    Be well....

  • Best way to update RBSELBEST table for invoice

    what is the best way to update RBSELBEST table for PO invoice? Is there any BAPI or FM for this?

    Thanks. I tried this one also, but it does not update the table.
    in case if someone used this, what parameters i need to pass for this to work?

  • Best way to update a polygons position?

    What is the best way to update a polygons position? I don't want to create a new one each time, and there is no setBounds method.

    I'm sorry. I meant. Say my array of x positions is 3, 4, 9. I change 9 to 30. How can I make the polygon see that change?

  • Best way to update AC97 audio drivers?

    Is the best way to update AC97 audio drivers = dl. from msi the latest drivers which are 5.10.00.5970 (A3.80) I currently have 5890. Then uninstalling old ones from add-remove programs then install newest ones. Since live update doesn't seem to get it done. Thanks
    Den

    I agree with the package that is in Dr Stu's link, I downloaded that complete package which includes NVMixer for speaker setup and fine tuning your sound system.
    Regards; Pop's

  • Best way to update apps

    Is the best way to update apps through the ipod touch or through the computer to which the ipod syncs?
    I once updated the apps on the computer and synced my ipod with the computer but the apps on the ipod touch were not updated. Is it because the sync was not properly done?
    Thanks.

    the best way is to install all apps and updates from your computer. this will also drastically decrease your backup time. i recently deleted all my apps and reinstalled them from my computer, and my backup time dropped from 9 hours to about 10 mins. i was told this was prob caused by orphan data and errors from installing from the app store on your touch.

  • Best way to update exposed schema as WCF service ?

    Hi,
    I am newbie to WCF + BizTalk. I am doing small POC's on exposing & consuming orchestration & schemas as WCF service. I had successfully exposed schema as WCF service also consumed this service using C# client code.
    My question is that suppose if there is a change in the existing exposed schema say a field has to be added then what is the best way to update a service. Do we need to add a field in schema & again expose this schema and update our service referernce
    in the client code ? Or this can be achieved in a better way ???
    Regards,
    Rahul Madaan
    BizTalkVillage.blogspot.com

    Hi Rahul,
    When you expose Orchestration or Schema as a WCF service and let's say if there are only few fields which got updated/added then there are multiple options to handle it.
    For example-
    1) You can go ahead and update the XSD files within AppCode folder. You can find this folder by doing explore on web application(in iis manager). Whenever we expose schema or orchestration these schemas are generated and kept in this folder. When you check
    the WSDL it will have reference to these schemas and they will define the contract of incoming and outgoing message(request and response). This is the easiest way. I prefer it for Dev environments and testing.
    2) But I would suggest you to run the publishing wizard again as it's less error prone.
    Please understand that BizTalk will always remain unaffected of the type of message it receives from the isolated host, the actual problem comes when hits the first receive shape(typed message).
    Thanks,
    Prashant
    Please mark this post accordingly if it answers your query or is helpful.

Maybe you are looking for

  • DNS resolution on Anyconnect - multiple different internal DNS servers

    All,    We have multiple different internal windows AD domains within our network, that currently do not replicate their DNS zones between them. Is there anyway with an ASA/anyconnect VPN to create a configuration so the ASA inspects the DNS lookups

  • Output to DivX file, but as .avi

    My client has requested I output a sequence as a DivX (.avi) file. This is for playback to a large screen monitor from a CF card. I downloaded the DivX software, so that now within FCP, under export using QT conversion, there is an option DivX I down

  • How to number pages in a movie?

    Hi there, i would need to know how I can number the pages of a movie. I've done the following but it doesn't work, could you help me please?? 1) created a text member called "slideNumber" 2) created a Movie Script: global gMarkerList on startMovie  

  • Your customer care department

    I think ur customer care department and the delivery for attending the problem is just horrible. only if u try getting in touch with the customer care department u will come to know that it is very difficult to get across the right person to take car

  • Text/email/call notification screen -- TMI!

    Is there any way to modify or disable the notification screen that pops up on the wallpaper when a text, call, or email comes in? Too much information there for my kids to see when they want to use the phone for a game, etc.