Long estimate times when exporting with EXPDP

Hello Everyone,
I have a few questions about using EXPDP. I'm running Oracle Database 10g Enterprise Edition Release 10.2.0.1.0.
I'm trying to understand whether or not the export times I'm seeing are reasonable. First, I am performing a SCHEMA export, excluding users, grants, roles, statistics, and several tables. When using block estimation, the following operations take 10 minutes to complete for a single schema:
6/7/2010 12:39:39 PM: Processing object type SCHEMA_EXPORT/TABLE/TABLE_DATA
6/7/2010 12:49:12 PM: Total estimation using BLOCKS method: 512 KB
6/7/2010 12:49:13 PM: Processing object type SCHEMA_EXPORT/TABLESPACE_QUOTA
6/7/2010 12:49:14 PM: Processing object type SCHEMA_EXPORT/TABLE/TABLE
10 minutes seems completely unreasonable for 6 tables composing so little data. The 10 minute times appears to be constant regardless of the data size. For example, another schema (with about 30 tables) produces the following output:
6/7/2010 12:10:52 PM: Processing object type SCHEMA_EXPORT/TABLE/TABLE_DATA
6/7/2010 12:20:33 PM: Total estimation using BLOCKS method: 16.08 GB
6/7/2010 12:20:35 PM: Processing object type SCHEMA_EXPORT/TABLE/TABLE
6/7/2010 12:20:36 PM: Processing object type SCHEMA_EXPORT/TABLE/INDEX/INDEX
Also in about 10 minutes! I wouldn't expect these times to be so close for about 100000x more data! Why does the estimate take so much time? I would expect the block estimate to be a simple calculation over data the DB server is already keeping around.
When using estimate=statistics, the behavior is even stranger. In this case, the "Processing object type SCHEMA_EXPORT/TABLE/TABLE_DATA" operations all take ~17 minutes (regardless of the volume of data in the schema), and the actual export lines in the output (". . exported "test_schema"."table_a" 5.056 MB 5782 rows") complete very quickly (< 2 secs).
Is this kind of behavior expected?
To collect these times, I wrote a small application that kicks off expdp and reads the output along with a timestamp one line at a time. If the tool is buffering it's output, that might explain some of this, though for the block estimate, I see the following output during the table exports, which seems reasonable:
6/7/2010 12:20:47 PM: . . exported "test_schema"."table_a" 2.332 MB 915 rows
6/7/2010 12:22:58 PM: . . exported "test_schema"."table_b" 954.8 MB 32348 rows
6/7/2010 12:23:59 PM: . . exported "test_schema"."table_c" 975.6 MB 60573 rows
6/7/2010 12:24:38 PM: . . exported "test_schema"."table_d" 553.8 MB 973 rows
6/7/2010 12:24:56 PM: . . exported "test_schema"."table_e" 159.6 MB 2562 rows

The command:
expdp 'schema/********@server' estimate=blocks directory=DATA_PUMP_DIR dumpfile=8be7d007-e6c1-4e10-8164-db27d9fce103.dmp logfile=8be7d007-e6c1-4e10-8164-db27d9fce103.log SCHEMAS='schema' EXCLUDE=SCHEMA_EXPORT/USER,SCHEMA_EXPORT/SYSTEM_GRANT,SCHEMA_EXPORT/ROLE_GRANT,SCHEMA_EXPORT/DEFAULT_ROLE,SCHEMA_EXPORT/PRE_SCHEMA/PROCACT_SCHEMA,SCHEMA_EXPORT/TABLE/INDEX/STATISTICS/INDEX_STATISTICS,SCHEMA_EXPORT/TABLE/COMMENT,SCHEMA_EXPORT/TABLE/STATISTICS/TABLE_STATISTICS
The new output:
6/7/2010 4:22:19 PM: Estimate in progress using BLOCKS method...
6/7/2010 4:22:19 PM: Processing object type SCHEMA_EXPORT/TABLE/TABLE_DATA
6/7/2010 4:29:48 PM: . estimated "schema"."table1" 11.89 GB
6/7/2010 4:29:48 PM: . estimated "schema"."table2" 1.298 GB
6/7/2010 4:29:48 PM: . estimated "schema"."table3" 1.041 GB
Judging by the output, I'm guessing that expdp is buffering the output and my tool is reading it all at once, such that each "estimated" line has nearly the same time. Is there a better way to to timing information from the estimation?
Thanks for the help!

Similar Messages

  • Incredibly Long Lag Time When Working With Effects in Premiere Pro CC 2014

    I am having incredibly long lag times when working with effects in Premier Pro CC 2014.  Like 60 seconds or more.  This also happens periodically when I am doing something as simple as cutting into a timeline (just ripple deleting from and in to an out point). 
    I have a MacBook Pro running OSX 10.9.4 2 GHz Intel Core i7 with 16 GB 1600 MHz DDR3. 
    I have seen that some people are having different versions of the same problem.  I do have RedGiant plug-ins, but I am not using any of them in this project.  The Red Giant plugs (again, not being used in the project) include MOJO and Universe.  The previous version most certainly did not work like this.  Any ideas?  I did try moving the Red Giant plugs out of the COMMON folder and "alt" starting up to reset preferences.  Still having same problems.
    A specific example is I have an interview shot.  I add brightness and contrast.  Just making a change to the effect (increasing brightness) causes freezing of the interface and long delays.  I added a piece of transparent video on a top layer to add a CIRCLE to create a vignette effect.  Same deal -- ridiculously long times for effect changes to take place.
    Does anyone have any clues as to how to fix these problems? 
    THANKS FOR ANYONE'S HELP!!!!!!!

    Got the same Error. Previous I worked with a GTX 760, and was hoping to get it fixed with using a GTX 780 6GB. But just as you, didn't solve the Problem.
    Usually I got the Problem solved, with exiting Premiere, restarting it, reset my Workspace. Then the Problem of having the bugged Workspace was gone. And also the Problem of the missing Video Tracks.
    At the moment I started on a new Project. Pretty simple, with only a 21 second DV footage. And here I was switching tabs with my Browser, came back to the Project, and the Video Tracks were gone. I saved, closed Premiere, restated and the Video Tracks are still  missing.
    So I made a new Sequence, voilá the Video Tracks are there. Thus I need to copy and paste the Tracks onto the new Sequence.
    But that is not really a solution!
    I was on the Phone with Adobe, and on Chat, but they couldn't help me. They suggested to get a Tesla or Quadro Card, or at least a GPU that got confirmed as working on their page. I did that, but obviously, that is not the issue.

  • ORA-39126 when exporting with expdp

    Hi there,
    I'm getting a crash on 11g 11.1.0.7 when exporting a schema using expdp:
    expdp
    Connected to: Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production
    With the Partitioning, OLAP, Data Mining and Real Application Testing options
    Estimate in progress using BLOCKS method...
    Processing object type SCHEMA_EXPORT/TABLE/TABLE_DATA
    Total estimation using BLOCKS method: 3.096 GB
    ORA-39126: Worker unexpected fatal error in KUPW$WORKER.UNLOAD_METADATA [TABLE_DATA:"NSNPL"."SYS_EXPORT_SCHEMA_02"]
    ORA-22813: operand value exceeds system limits
    ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
    ORA-06512: at "SYS.KUPW$WORKER", line 7839
    ----- PL/SQL Call Stack -----
      object      line  object
      handle    number  name
    0x14d81a160     18237  package body SYS.KUPW$WORKER
    0x14d81a160      7866  package body SYS.KUPW$WORKER
    0x14d81a160      2744  package body SYS.KUPW$WORKER
    0x14d81a160      8504  package body SYS.KUPW$WORKER
    0x14d81a160      1545  package body SYS.KUPW$WORKER
    0x14d81db88         2  anonymous block
    ORA-39126: Worker unexpected fatal error in KUPW$WORKER.UNLOAD_METADATA []
    ORA-22813: operand value exceeds system limits
    ORA-06512: at "SYS.DBMS_SYS_ERROR", line 86
    ORA-06512: at "SYS.KUPW$WORKER", line 7834
    ----- PL/SQL Call Stack -----
      object      line  object
      handle    number  name
    0x14d81a160     18237  package body SYS.KUPW$WORKER
    0x14d81a160      7866  package body SYS.KUPW$WORKER
    0x14d81a160      2744  package body SYS.KUPW$WORKER
    0x14d81a160      8504  package body SYS.KUPW$WORKER
    0x14d81a160      1545  package body SYS.KUPW$WORKER
    0x14d81db88         2  anonymous block
    Job "NSNPL"."SYS_EXPORT_SCHEMA_03" stopped due to fatal error at 00:57:23
    This look awfully similar to bug 6991626 (cf ID 737618.1), however the database has already been successfully patched (and in fact even repatched) for this bug:
    $ORACLE_HOME/OPatch/opatch lsinventory
    Invoking OPatch 11.1.0.6.2
    Oracle Interim Patch Installer version 11.1.0.6.2
    Copyright (c) 2007, Oracle Corporation.  All rights reserved.
    Oracle Home       : /opt/oracle/db11g
    Central Inventory : /opt/oracle/inventory
       from           : /etc/oraInst.loc
    OPatch version    : 11.1.0.6.2
    OUI version       : 11.1.0.7.0
    OUI location      : /opt/oracle/db11g/oui
    Log file location : /opt/oracle/db11g/cfgtoollogs/opatch/opatch2010-06-02_08-23-53AM.log
    Lsinventory Output file location : /opt/oracle/db11g/cfgtoollogs/opatch/lsinv/lsinventory2010-06-02_08-23-53AM.txt
    Installed Top-level Products (2):
    Oracle Database 11g                                                  11.1.0.6.0
    Oracle Database 11g Patch Set 1                                      11.1.0.7.0
    There are 2 products installed in this Oracle Home.
    Interim patches (6) :
    Patch  6991626      : applied on Tue Jun 01 22:35:32 WET 2010
       Created on 14 Oct 2008, 23:25:07 hrs PST8PDT
       Bugs fixed:
         6991626
    [...]Does anyone have an idea on what might be the culprit here?
    Thanks for your help,
    Chris

    Hi Prathmesh,
    in fact I saw this very thread before and I made sure that both solutions were applied. Moreover as I said patch 6991626 had already been applied earlier, precisley to fix this problem, and I've had been able to successfully export other albeit somewhat smaller schemas (500M instead of 3GB) in the last few months. This is why I was so puzzled to see that exact bug raise its ugly head again. As far as I can tell I didn't do any modification to the DB since that last patch in nov. 2009. In fact the DB has been running pretty much untouched since then.
    I even tried yestereday to reinstalled the patch again; opatch does the operation gracefully, first rolling back the patch then reapplying it again, with only a warning about the patch being already present. However the pb does not get fixed any better.
    Thanks a lot for your help,
    Chris

  • Problem with long response time when looking at queues!

    Hello,
    I have a problem with extream long response times, when looking at the queues in Message mapping test tool . Does anyone know how to improve performance.
    The source message I use is about 200 segments (idoc)
    The mapping is done with the graphical tool, with 10-15 field contain standard sap functions for mapping.
    Target structure is EDIFACT (xml)
    Brgds
    Karl Bergströ

    Hi Rod.
    Go to Apple Menu > System Preferences > Network > Show: Network Port Configurations. Make sure that the configuration used to connect to Internet is at the top of the list. Also, disable any communications/networking configuration enabled, but not in use.
    If the above doesn't fix the problem, open Keychain Access > Preferences, and disable Search .Mac For Certificates if it's enabled. Take a look at the following articles for an explanation of why this could fix the problem:
    http://www.hawkwings.net/2006/07/18/apple-mail-phones-home-too/
    http://www.macgeekery.com/tips/mailapp_doesnt_phone_homeeither

  • My new iMac with FCPX crashes when rendering complex templates and crashes when exporting with Motion 5

    My new iMac with FCPX crashes when rendering complex templates and crashes when exporting with Motion 5
    Using Motion 5.0.6 and Final Cut Pro X 10.0.7 on New iMac (December 2012)  Mountain Lion,
    Intel Core i7 quad-core a 3,4GHz, Turbo Boost fino a 3,9GHz
    32GB di SDRAM DDR3 a 1600MHz - 4 x 8GB
    Fusion Drive da 3TB
    NVIDIA GeForce GTX 680MX 2GB GDDR5
    During the rendering of complex FCPX mac crashes and I have to force a restart.
    I also happens when I try to export movies with Motion 5.
    Does anyone have the same problem with my new iMac?

    Problems such as yours are sometimes caused by files that should belong to you but are locked or have wrong permissions. This procedure will check for such files. It makes no changes and therefore will not, in itself, solve your problem.
    First, empty the Trash.
    Launch the Terminal application in any of the following ways:
    ☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
    ☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
    ☞ Open LaunchPad. Click Utilities, then Terminal in the icon grid.
    Triple-click anywhere in the line below to select it, then drag or copy it — do not type — into the Terminal window:
    find . $TMPDIR.. \( -flags +sappnd,schg,uappnd,uchg -o ! -user $UID -o ! -perm -600 -o -acl \) 2> /dev/null | wc -l
    Press return. The command may take a noticeable amount of time to run. Wait for a new line ending in a dollar sign (“$”) to appear.
    The output of this command, on a line directly below what you entered, will be a number such as "35." Please post it in a reply.

  • Footage pixelated when exported with compressor

    I've film HD video and edited with FCP, the aspec ratio on the sequence is 720x480 anamorphic, and it looks great, when I export it with QuicK Time it looks great but DVD Studio Prp doesn't support the settings. when I export it with Compressor, DVD Studio Pro imports it fine, but it is very, very pixelated.
    What would be the best option to use when exporting with Compressor.
    What I want is that the WideScreen image shrinks when viewing it on a Standard TV, I've done it with iDVD but when watching it on a standard tv is cuts the two sides of the image.
    Thank you for your help.

    If editing HD material you would be best off editing in the HD timeline, size and Codec (not sure if you did that and then down rezzed?) SD DVDs used compressed video, so anything that compresses things more prior to the compression to an SD m2v (video used on DVDs) can lead to more of a quality hit.
    Anyway what you would do is export the movie as self-contained movie, reference movie or directly to Compressor to a 16:9 m2v preset (including one you made yourself) and use that in DVD SP
    Take a look [at this thread|http://discussions.apple.com/thread.jspa?messageID=11040698&#11040698] and [this thread|http://discussions.apple.com/message.jspa?messageID=11287710#11287710]
    I outline the procedures a bit more and also include links to some movies and other information

  • I recently upgraded to 10.6.7 and Safari 5.05. Safari now has a long load time when you initially boot it up and when selecting a new tab. Other than that it works fine. What can I do ?

    I recently upgraded to 10.6.7 and Safari 5.05. Safari now has a long load time when you initially boot it up and when selecting a new tab. Other than that it works fine. What can I do ?

    Check Safari / Preferences - Extensions. If you have any installed, turn that off, relaunch Safari.
    If it's not Extensions, check for third party Safari add ons.
    http://support.apple.com/kb/TS3230?viewlocale=en_US

  • Computer freezes when exporting with Adobe Media Encoder

    Hi, whenever I start to export via media Encoder, my computer kind of freezes...I am not able to edit or even use any other applictions when exporting with Adobe media encoder. This did not happen with the older version CC7. Any hints please? Very frustrating.

    I think the same problem:
    Part of audio missing in mp4 AAC rendered files from Watched Folders
    Probably with cached files. Try this: Adobe Media Encoder 2014.2 Part of audio missing in mp4 AAC rendered files - cache problem? - Video Production Stack Exc…

  • Long waiting times when going back to the organizer after doing changes of images. Elements 11.

    After doing changes of images and going back to the organizer I have to wait a long time. This was not the case when I used elements 9. I have a lot of images stored around 18000. There are also often long waiting times when I move around in the organizer. Any suggestion?
    Bo Augustsson

    Please see blog: http://psekb.blogspot.in/2013/04/how-to-improve-pses-performance-please.html
    Please let me know if that doesn't helps.
    ~Andromeda

  • Estimate size of export with datapump

    Hi,
    When i run an expdp with estimate_only=TRUE, the estimate give me 383M.
    When i run expdp the sum of the files generated are not equal to 383M but 143.64M.
    Why.
    Regards

    Fahd Mirza wrote:
    Hi,
    Estimate size of expdp is calculated using statistics for each table. That's wrong, well, at least by default estimate is working based on BLOCKS, not on STATISTICS.
    Find out more Understanding the ESTIMATE and ESTIMATE_ONLY Parameters in Export DataPump ID 786165.1+
    And using blocks method may give less accurate on estimation size when tables have been created with large extents, or mass delete...
    Nicolas.

  • How do I stop Illustrator automatically adding numbers to file name when exporting with artboard?

    I need to export with artboard. Illustrator automatically adds a number to my original file name. It won't even let me replace the old file. It is extremely annoying and makes flow with other programs really hard because they can't auto update, since the file name  changes. When you have multiple files, you can't be manually renaming all the time. Anyone knows how to fix this? Thanks.

    This has been discussed a few times, and here is a summary of the usual solutions.
    http://forums.adobe.com/message/2989508#2989508
    What is it EXACTLY you are trying to do. Are you trying to export a single page from filename.ai  and make it filename.psd, (without any number afterwards). In that case you could delete the extra artboards prior to export, and then you won't have to checked use artbaords as there is only one page. Otherwise I would plan ahead so your end result will be filename-01.jpg,  filename-02.jpg, and then everytime you use export artbaords those names will replace.
    I am happy with the function as is, and would prefer to have a serial number automatically after the name when checking use artboards. But sounds liek you and others desire more options and thte ability to turn off adding to the filename.

  • Non-functioning booksmarks when exporting with Acrobat X

    Using InDesign CS5, I export my book documents to PDF Print and include bookmarks and hyperlinks. This has been working just fine using Acrobat Standard, and the person reading the document can navigate through the pages using either the document's Table of Contents or the Adobe bookmarks panel. I recently upgraded to Acrobat Pro X, and now this function no longer works properly. When you click on any Table of Contents bookmark, they all take you to the first page of the document. In addition, the bookmarks in the Adobe bookmark panel do not work at all. When I look at the bookmark properties, they all point to p0.  It is possible to manually reset the properties of the Adobe panel bookmarks, but not the TOC, but this is time consuming and doesn't solve the problem. Besides removing Acrobat Pro X from my computer, has anyone found another solution for this problem?

    I believe this is a known bug when exporting Books from CS5, and that it is not restricted to Acrobat X.
    The only workaround I know is to combine the files into one document.

  • How do I keep the date/time when exporting photos?

    When exporting photos from Photos.app on my Mac, it doesn't use the metadata that it displays in Photos--it uses the current date/time. So when I export a photo from 2010, it says it's dated 2015 when I import it into Aperture.
    Is there a way to export an image with its original timestamp? Is this a bug? Thanks.

    If you are editing tif files, then you have only a couple of choices.
    Flatten the image before you save it.  This will reduce it down to one layer. That's the smallest you can get.
    When you first open the image, look to see if it's 8 bit or 16 bit tif.  It won't help you, but if the image is 8 bit, and you save it as 16 bit, you will have dramatically increased the size of the file for nothing.  If it's started as 16, no worries!
    check if you are saving with compression.   Tif compression is lossless, so unless you did something like resize+resample, it remains the same bit density, etc, so should be just as printable as what they sent you (unless you messed up!).
    Cheers!

  • Strong red tint when exporting with prores

    Hello There,
    I'm using 5D Footage that i converted to AppleProRes (HQ) with the compressor and edited it in FCP plus did some grading in Color. Everything looks fine when I export with H.264.
    However, I need to export the material with ProRes again because it will be used in Adobe After Effects, so i want to keep a high qualitiy. Now, when i'm exporting from FCP with the prores422(HQ) codec all the midtones have an extremely red tint and the contrast and the saturation is much higher than how i see it in Colors and FCP. Is this some kind of error or is there something i'm doing wrong here?
    THX for ur help!

    Prores LT is more than good enough for your 5D footage. You will not get any more quality than is already there by going to ProRes HQ. You will get considerably larger files that might not play back smoothly on your computer.
    Humor us and tell us what happens when you run this workflow on a short ProRes LT clip.

  • What Rendering intent is used when exporting with a different color space?

    Hi,
    I would be ever so grateful if any one can tell me what rendering intent is used by LR4 when exporting using a custom colour space as there is not an option as there is with the print module.
    Thanks.
    Message title was edited by: Brett N

    Jeff Schewe wrote:
    Bob_Peters wrote:
    The rendering intent in the Export dialog is Perceptual.
    Actually, an RGB color space to RGB colorspace is always only Relative Colorimetric...and adding Perceptual would only work with certain V4 ICC color spaces (you can find perceptual V4 color spaces for sRGB and ProPhoto I think but I'm not sure they would work in Lightroom anyway).
    When using an RGB print output profile you can select either Perceptual or Relative and have the intents actually applied.
    True.
    The case of interest to me is when I have to print a lot of files using a third-party profile and maintain the original filename so it appears on the back.  That is why I made the request more than a year ago.
    The problem with the Print module is that it clobbers the filename but does allow 2 choices for the rendering intent.  Having to deal with weird filenames creates a mess when matching, say, 50 prints with custom notecards.

Maybe you are looking for

  • .m4v file icons have become solid white in Lion Finder under iTunes 10.6.3

    Hi there, I'm making this a dual category post, since I cannot determine whether this is an iTunes issue or a Lion issue. I discovered that after updating iTunes to 10.6.3, all Finder icons for file container type .m4v have changed from their standar

  • Restarting after waking from sleep

    I have a mid 2010 macbook pro running Mountain Lion OS X 10.8.3 of which keeps restarting after being left in sleep mode for an hour or two. When waking from sleep mode, the mac functions for about 5 seconds, before restarting by itself. I have tried

  • SATA Disks Issues with OEL 5.8 uek 64Bit

    Hi Oracle Linux Experts/Tech Gurus!, We are facing lot of issues with SATA disks at both Internal and External, if we use any SATA USB External Disk it make server hang and sometimes restart We face this issues with external SATA ARRAY connected at D

  • BBP_OM_DETERMINE_RESP_PGRP returns to many rows when using CATEGORY_ID

    Hi, i need a function that gives me the purchase group of a certain category-id. i filled IS_RESP_ITEM_DATA-CATEGORY_ID with the correct value but the function returns all purchase groups as result. In the OM the responsiblity for purchase group and

  • TS3252 Can i use OSX10.8, with aperture 3

    Can i ues osx10.8 , with aperture 3