Export/import vs. sqlloader performance

Does anyone have any benchmarks or observations regarding which is faster execution wise?
We have some very large tables and I need to know if sqlloader would work faster than export/import in those situations.
Thanks.

It would help to know what you are trying to accomplish.
Import / Export are designed to provide a transfer mechanism to move database objects from one database to another. In order to use the import utility, you must already have a file which was created with the export utility.
SQL*Loader is designed to provide a mechanism to load data from external files into Oracle.
There are various optimizations available for each technique (including parallel processing, direct load, etc). It really depends on the problem you are trying to solve.
Also, other techniques might be useful, including:
- external tables (available starting with 9i, allows querying text files with SQL - no SQL*Loader necessary)
- database links (can be used as an alternative to import/export if your goal is simply to move data from one Oracle database to another)
- Data Pump, starting with Oracle 10g

Similar Messages

  • Low Hit Ratio for Export/Import Buffer

    Hi,
    Do low hit ratio (less than 70%) for Export/Import buffer causes performance issue?
    I didnt get any Note related to this.
    Any help will be appreciated.
    Thanks,
    Saurabh

    Thanks everyone,
    Basicaly all the buffers(Program/Nametab/CUA/Screen/Genric Key/Single record) has hit ratio around 99% , but for export/import buffer its 60%. which is indeed less.
    This is what i intended to ask, if this low hit ratio for export/import buffer has much impact ?
    Any note if anyone remembers?
    Thanks,
    Saurabh

  • Bad performance on system, export/import buffer many sawps

    Hello,
    I have an ECC 6.0 system on AIX with 6 application servers. There seems to be a performance problem on the system, this issue is being noticed very well when people are trying to save a sale order for example, this operation takes about 10 minutes.
    Sometimes we get short dumps TSV_TNEW_PAGE_ALLOC_FAILED or MEMORY_NO_MORE_PAGING but not very often.
    I am not very good at studying the performance issues, but from what I could see is that there are may swaps on buffer export/import, program and generic key. Also the HitRatio is 88% at  buffer export/import, which I think is pretty low.
    I know that the maximum value accepted of swaps per day is 10000, is that right?
    Can you please advice me what needs to be done in order for these swaps to decrese and hit ratio to increase? And also what else I should do in order to analyse and root cause and the bad performance of the system?
    Many thannks,
    manoliv

    Hi,
    sappfpar determines the minimum and maximum (worst-case) swap space requirements of an R/3 application server. It also checks on shared memory requirements and that the em/initial_size_MB and abap/heap_area_total parameters are correctly set with the following procedure:
    /usr/sap/<SYSTEMNAME>/SYS/exe/run/sappfpar check pf=/usr/sap/<SYSTMENAME>/SYS/profile/<Profile name>
    At the end of the list, the program reports the minimum swap space, maximum heap space, and worst case swap space requirements:
    Additional Swap Space Requirements :
    You will probably need to increase the size of the swap space in hosts in which R/3 application servers run.
    As a rule of thumb, swap space should equal
    3 x Size of Main Storage or at least 1 GB, whichever is larger.
    SAP recommends a swap space of 2-3 GB for optimal performance.
    Determining Current Swap Space Availability: memlimits
    You can find out how much swap space is currently available in your host system with R/3’s memlimits program.
    Here’s how to run memlimits:
    From the UNIX command prompt, run the R/3 memlimits program to check on the size of the available swap space on the host system on which an R/3 application server is to run.
    The application server must be stopped, not running.
    /usr/sap/<SYSTEMNAME>/SYS/exe/run/memlimits | more
    The available swap space is reported in the output line Total available swap space: at the end of the program output. The program also indicates whether this amount of swap space will be adequate and determines the size of the data segments in the system.

  • ABAP Memory (EXPORT/IMPORT) - Performance Issue

    Performance wise, is it a good idea to use ABAP memory to export and import data between programs?
    Thanks in advance,
    JT

    IMHO is you EXPORT/IMPORT a couple of variable...Your not going get any performance issues....So go ahead -:)
    Greetings,
    Blag.

  • Performance benefits from database export import

    Hi guru,
    I have SAP R3 47.X110 WIN/SQL2005.
    I want to improve performance by a sort of database reorganization.
    I read this note  Note 159316 - Reorganizing tables on SQL Server SQL 2000/2005
    but , there the method descrived is not much quick to do.
    The question is : there is lot performance's benefits from make an export of my instance then re-import , according system copy procedure?
    Or there is another quick way to reorganize database?
    Thank you very much for answer.
    Antonio.

    You want to do an export/import or a reorganization to get more performance. The question is: does it make sense? The given Microsoft article and the mentioned notes describe pretty well, in which cases it makes sense and in which not.
    I wouldn´t start with the last step (reorganization) but I would more try to find out, where the real problems are. Checking the I/O system throughput using performance monitor (perfmon.exe) on Windows, checking long running statements using ST05 and finding out if you have a real index fragmentation using the given DBCC procedures.
    If you come to the conclusion then, that a reorganization makes sense, then I would do it.
    And as stated in the SAP note, if it would become faster after such a task, the underlying I/O subsystem is not fast enough to serve all the requests.
    There´s no general statement as "if you do reorganization using method A or method B it will be faster" because the reasons for a slow performance can vary.
    Markus

  • Error in Client export/import

    Dear all
                     i have test system i would like to perform client export/import in single system correct if made a mistake
    i have export client which create 3 request namely SIDKOxxxxxx , SIDKTxxxxxx,SIDKXxxxxx .i had selected target SID as system same sid bcaz i have only one system
    then i login again with scc4 create new client and login in that sap* and pass then when i run command stms_import to import all three transport into that client as said my message server gets disconnected correct me i am wrong
    or i have to directely run scc7 bcaz the request already in /usr/sap/trans then these error won't occur  i have the back up of database
    now i am getting error oracle disconnected
    Regrards

    Dear Pavan
    I tried last night as you said i made new client as 300 in ides and copy user profile to that
    when i tried to configure stms by setting CTC =1 when i configure transport routes i don't find any client number
    to provide source and target client
    kindly send some screen shots if u have that would great support
    .Delete the existing TMS configuration.
    2.In 000 client by using the user ddic create TMS configuration using STMS.
    3.Click on the system, in transport tool tab add a parameter CTC and set it to 1.
    4.Now configure the transport routes, there you can find the client number in consolidation routes.
    5.Provide your source and destination client and create routes.
    Regards

  • Offline Instantiation of a Materialized View Site Using Export/Import

    Has anyone had any success performing offline instantiation of a materialized view site using export/import in Oracle9?

    This is what I wanted to ask in the forum. I want to use datapump for the initial instantiation because I believe that indexes (the actual indextables, not just the definition) are also replicated using datapump.
    So, is it possible to do the instantiation using datapump?

  • Upgrade from 8.1.6 to 9.2.0.7 via export/import

    Has anyone done this or know if it's possible to simply build a 9.2.0.7 instance, then use export/import to perform the upgrade from 8.1.6 to 9.2.0.7 since a direct manual upgrade from 8.1.6 is not supported??
    TIA

    Yes, building a database in a new release and then exporting the existing database using its version of the exp utility, performing a binary copy of the exp file to the new server, and then running the new version imp utility using the transferred dmp file was the standard method of moving databases to new platforms/versions for many years. The same process could always be used on the same server between equal or from a current to a new release.
    HTH -- Mark D Powell --

  • Client Copy Export/Import on large system. 1.5 TB

    Hi,
    We have a 3 tier landscape. DEV, TST, PRD.
    Database size in PRD is 1.5 TB (1500 GB)
    Our developers need fresh master and trans data in TST and DEV.
    We are thinking about making a
    PRD --> TST  (1.5 TB) we do a system copy.
    TST --> DEV (1.5 TB) we can't do a system copy. (Company policy says not to touch repository objects, version management what so ever in DEV....)
    1. How long will a client export / import take from TST --> DEV,  lets say we have "good HW" ?  Will it work ?
    2. I've read about TDMS but its toooo expensive.....is there maybe any 3 party tool that is good for this purpose ? Transfering 1.5 TB of data ...
    Br,
    Martin

    Hi,
    >1. How long will a client export / import take from TST --> DEV, lets say we have "good HW" ? Will it >work ?
    In my opinion, a 1.5 TB database is much too big for a client copy.
    It will work but may last a full week and would degrade the production system performance.
    We have 1.3 TB databases and stopped using client copies since the system was 300 GB...
    We only use database restores and renaming for system refresh even for the dev system.
    There is procedure to keep the versionning of sources.
    Regards,
    Olivier

  • Export/Import and Client Copy

    Hi All,
    Could you please help me with what are the major differences between Export/Import...client copy...and a System Refresh.How they differ from each other.
    Regards
    Rajesh

    Hello Rajesh ,
    I have capture some data from SAP Help :
    Local Copy: Copying Clients Within a System:
    You can improve the performance of the client copy by, for example, by excluding tables or packages, with Edit -> Expert Settings.
    You can exclude tables from the client copy, for example if they are not relevant for the target client, in the Tables tab
    Copying Clients Between Systems (Remote Copy):
    The same product is installed, with the same release, in both systems
    The client copier can copy a client into another system. The systems can be on different platforms. You can change the client number.
    When you copy a client from one system to another, the data is transferred directly via the RFC interface - there is no intermediate storage on hard disk.
    Transporting Clients Between Systems ;Client export (SCC8):
    The client copier can copy a client into another system, which can be on a different platform. You can change the client number.
    You are no longer required to transport clients before you can copy them between systems. You can make a remote copy instead.
    Up to three transport requests are created, depending on the selected copy profile and the existing data.
    The transport request for texts is e.g. only created if the source client contains customer texts.
    <sid>KO<no>  cross-client data
    <sid>KT<no>  client-specific data
    <sid>KX<no>  texts and forms
    The data export is performed automatically asynchronously. The output of the export includes the names of the transport requests that are to be imported.
    Import transport requests into the target client (STMS)
    Choose one of the transport requests of the client transport in the Transport Management System (TMS). The other transport requests belonging to this client transport are then automatically added in the correct order.
    Import these transport requests into the target client.
    client import postprocessing (SCC7)
    You need to perform postprocessing activities to adapt the runtime environment to the current state of the data.
    Copy by Transport Request :
    This function transports customizing changes that have been recorded in a transport request between two clients in a system.
    You can choose whether you only copy the object list of the request or also the object lists of unreleased tasks in the request.
    Entries in the target client are overwritten or deleted according to the key entries in the transport request.
    Choose Administration -> System administration -> Administration -> Client admin. ->Special Functions -> Copy Transport Request.
    <a href="http://help.sap.com/saphelp_nw70/helpdata/en/69/c24c0f4ba111d189750000e8322d00/frameset.htm">For more info Click here</a>
    Regards ,
    Santosh Karadkar

  • Doubt in  export, import and table para when creating Function Module

    Dear fellow ABAPers,
    I have a doubt in defining export, import and table parameter while creating a function module.
    I am calling a function module inside a user exit. Now in the user exit the SAP fills an internal table called i_lfa1 with all the data user has eneterd.
    Now I want to pass this whole internal table to function module and the perform some checks on the values of internal table.
    After that function module fills an error structure with values depending on some check.
    1)
    How do I pass this internal table to function module ? 
    When I am creating function module in se37 where do I define this iternal table type ? Is it in Import or Table parameter during function module creation?
    2)
    Where do I define error structure type (which is returned by function module to main program)? Is it in Export or table parameter during function module creation?
    Please clear my doubt..
    Relevant points will be awarded.
    Regards,
    Tushar.

    Hi Tushar,
    1. How do I pass this internal table to function module ?
       I assume u are creating your own Y/Z FM.
       Pass it thru TABLES parameter.
    2. When I am creating function module in se37 where do I define this iternal table type
       Define this in TABLES interface.
       What Type ?
       THE SAME TYPE WHICH HAS BEEN DEFINED
        WHILE PASSING IN THE USER-EXIT FUNCTION MODULE.
       IF U SEE THE FM OF THE USER-EXIT,
       U WILL COME TO KNOW.
    3.
    Where do I define error structure type (which is returned by function module to main program)? Is it in Export or table parameter during function module creation?
    Define it in TABLES interace. (not in export, import)
      (Since what u are going to return is an internal table)
      U can take for eg. BDCMSGCOLL.
      OR u can create your own Y/Z structure
    for the same purpose.
      (or u can use the structure type T100)
    I hope it helps.
    Regards,
    Amit M.

  • SLD Export / import Technical and Business systems

    Dear all,
    I am new to SLD administration.
    We have task to update the local SLD on the Production PI system PPI ( Target ) with the business systems ZEC, ZSC from the Production Master SLD on Production solution manager system
    PSM ( source ) using Export/Import on the necessary technical and business systems.
    Please confirm whether i am following correct steps :
    Go to SLD Administration on PPI target system
    ALL Instances
    Instances by Class
    Model
    ( which one of this option need to be selected , please let me know  ?? )
    Go to SLD Administration on PSM source system.
    select Export button ->
    Select business systems one by one and perform Export which will create .ZIP file
    at local machine.
    Go to SLD Administration on PPI target system
    select Import button ->
    Select Export ZIP file which created in previous steps from PSM and provide location from desktop
    Start Import button ( only if you get Continue import option )
    Please let me know if above procedure is correct for business systems
    if yes then  what need to be done for Technical system ??...do they require Export/import also ?
    If yes when i go to technical system option i get Export option disabled...but same way when i go to
    business systems option i get Export button enable and able to perform the export.
    Do i need to only Export / Import business systems ?
    Plese help me.
    Regards,
    RR

    Manoj,
    It seems entries are added manually .... should we remove and run Import for the same ...
    or just try to overwrite .... in case of overwrite option ( as we have open OSS message ) SAP has suggested through OSS message that If you end up with problems when trying to overwrite, then the PPI SLD is broken and will have to be re-built because someone made a manual change to it and got the GUIDs out of synch with the master.
    I do not understand if target system PPI SLD gets broken during overwriting operation as mentioned by SAP ... whats is the way / steps / procedure to Re-build SLD .
    In rebuilt - process do i need to Import ( Export -> Export lines -> ALL ) the export backup created before start of this activity ? please let me know SLD rebuilt steps and about Remove - reimport issue.
    Appreciate you time on this. thanks in advance.

  • (ABAP+JAVA) system is too big to export/import

    We have some NW04s and ECC6 dual stack systems that we want to frequently clone using homogeneous system copy method.
    However they can be as big as many terabytes.
    Is there a way to clone they using a way other than export/import?
    Thanks!

    Hi,
    As of SAP NetWeaver 7.0, you can copy ABAPJava systems in one run using either database-specific methods or database-independent methods. In a ABAPJAVA stack system, you need to run a separate export for the Java engine to archive SDM and application specific file contents. You will have to supply that java Export location on the target system, while performing DB specific system copy procedure.
    Please refer [system copy guide for ABAP+JAVA stack |http://service.sap.com/~form/sapnet?_SHORTKEY=01100035870000670917&_SCENARIO=01100035870000000112&_OBJECT=011000358700000416402008E] along with the previously suggested links to get more information.
    Regards
    Bhavik G. Shroff

  • How do you produce both Customs Export & Import documentation in an STO?

    Hello All -
    How do you produce both Customs Export & Import documentation in an STO scenario? For instance, if a company would like to create a STO in SAP to move materials from one plant to another and would like to produce both the Export & Import paperwork in GTS, what documents would be needed in R/3 to make this possible?
    Would the following be needed, or is there some other way?
    - STO
    - Outbound Delivery & F8 Invoice to generate the Customs Shipment in GTS for the Export documentation
    - Inbound Delivery to generate the Customs Declaration in GTS for the Import documentation

    Thanks Sameer -
    Yes, for the Import documentation, I think we will be declaring prior to Goods Receipt, so we will first use the Inbound delivery, and then the GR document later on once the materials have been received. (I believe you and I were talking about some of this in another thread actually.) Thank you for confirming this.
    As for the Note, I have also seen this - but thought that this was to more or less give visibility to the sending plant up-front at STO of what export licenses might be needed. (According to the note, currently they would only be able to check if licenses were needed at the outbound delivery, and not on the PO)
    Per the note: "Given a Stock Transport Purchase Order scenario: Plant A in Germany issues a STO PO against vendor plant US10 in the US. GTS looks at the PO in terms of importing from the US (departure country) coming into Plant A in Germany and performs compliance checks. Meanwhile, exporting plant US10 only has visibility at outbound delivery creation to see if am Export License is needed. Exporting plant US10 may want to know if they need a license to the country of destination, in this case Germany, at STO PO creation."
    However with the proper country-level export/import activation of the legal regulations, I believe that you can still have the STO check export-related licenses even though it is mapped to GTS as IMPORD. I have done some testing on this and it appears to work (you just need to ensure that you are activating the relevant countries for export/import properly in the legal regulation, and you can have both export & import documents check the same legal regulation and deliver the correct license determination). I was just wondering if you had any experience with this that was contrary to what I have found, or if there is something you think I am missing..
    Thanks

  • Migrate Database- Export/Import

    Hi,
    I need to migrate an Oracle database 9i from Sun Solaris to Linux. The final target database version would be 11g.
    Since this is a 9i database, I see that we have only option of export and database. We have around 15 schemas.
    I have some queries related to it.
    1. If I perform a export with full=y rows=y, Does it export Sys, System Schema objects also?
    2. Can we perform export in Oracle 9i and use datapump import on targert 11g?
    3. What is the ebst approach - a) to perform schema by schema export or b) to perform a full database export with exp / file=xxx.dmp log=xxxx.log full=y?
    Since there is a database version different I dont want to touch sys, system schema objects.
    Appreciate your thoughts.
    Regards
    Cherrish Vaidiyan

    Hi,
    Let me try to answer some of these questions you queried for:
    1. If I perform a export with full=y rows=y, Does it export Sys, System Schema objects also?Export won't export sys objects. For example, there are tables in sys, like obj$ that contain information for other metadata objects, like scott.emp, etc. This is not exported becuase when scott.emp is exported, the data from obj$ is essentially exported that way. When the dumpfile is imported and scott.emp is recreated, the data in sys.obj$ will be restored through the create table statement. As far as the SYSTEM schema is concerned, some objects are exported and some are not. There are tables in system that contain information about queues, jobs, etc. These will probably not make any sense on the target system so those types of tables are excluded from the export job. Other objects make sense to export/import so those are done. This is all figured out in the internals of export/import. Thre are other schemas that are not exproted. Some that I can think of are DMSYS, ORDSYS, etc. This would be for the same reason as SYS.
    2. Can we perform export in Oracle 9i and use datapump import on targert 11g?No, the dumpfiles are formatted differently. If you use exp, then you must use imp. If you use expdp, then you must use impdp. You can do exp on 9i and imp on 11g with the dumfile that was created on 9i.
    3. What is the ebst approach - a) to perform schema by schema export or b) to perform a full database export with exp / file=xxx.dmp log=xxxx.log full=y?This is case by case decision. It depends on what you want. If you want the complete database moved, then I would personally think that a full=y is what you would want to do. If you just did schema exports, then you would never export the tablespaces. This would mean that you would have to create the tablespaces on the source system before you ran imp. There are other objects that are not exported when a schema level export is performed that are exproted when a full is performed. This information can be seen in the utilities guide. Look to see what is exported when in user/schema mode vs full/database mode.
    Since there is a database version different I dont want to touch sys, system schema objects.This is all done for you with the internal workings of exp/imp.
    Dean
    Edited by: Dean Gagne on Jul 29, 2009 8:38 AM

Maybe you are looking for

  • Error While Executing the Asset history report S_ALR_87011990

    Hi, I am getting the below error while executing the Asset History Report - S_ALR_87011990 No data was selected Message no. AB064 Kindly advice me

  • Photos sent to Online printing service darker than on calibrated monitor

    ok, I know that prints are typically darker than what is shown on the screen(with loss of detail in the shadows that was visible on the screen.) I calibrated my monitor using both the eyeone display 2 puck and coloreyes software using gama 2.2, D65,

  • Viewing online images in native phone apps with AIR?

    Gidday guys What's the standard way of loading an online image into a native phone app? An image that can't be packaged with the app as it may have been changed by the user eg a profile picture, or their logo? Cheers

  • How to stop the software update

    The software update of my Curve9360 has started automatically and is blocked at 9% since a very long time, while the blackberry is hot and I can't exit in any way. How can I stop the process? I've tried to take off the battery, but when I put it insi

  • Time Data Upload

    Here we are using positive time management, where all actual time in and time out has been recorded in the time machines installed at factory gates. We want the daily time data has to uploaded to SAP System to run the time evaluation. Does SAP have a