Approach for downloading bulk records

Hi,
We have a join condition which is joining oracle tables alongwith oracle views ( there are around 3 tables and 4/5 views). The total number of records is around 10 +E10. Our problem is related to the performance as the query keeps on executing for more than 2 hours.
On top of that our application is required to work online and not as a part of batch job.
Could anyone help us in providing us a suitable approach to tackle this. It could be administration changes or query optimising techniques. Anyhelp would be appreciated.
Thankx a lot :)

I would also look at what is in the views you are accessing to do the query. It is often much more efficient to write the query from scratch than it is to use existing views. In many cases, the existing views contain columns that are not required in your main query, or joins to other tables that are not really required for your main query. You usually can eliminate some extra overhead by re-writing the query using only base tables.
John

Similar Messages

  • How to approach for downloading a CSV file?

    I'm running the following query and  QoQ . Could you tell me how should I proceed for the "Download  CSV" file option?
        <!--- QoQ for FIRSTCONN --->
        <cfquery datasource = "XX.XX.X.XX" name="master1">
             SELECT STR_TO_DATE(date_format(Timedetail,'%m-%d-%Y'),'%m-%d-%Y') as FIRSTCONN
                    , COUNT(Timedetail) as FIRSTOccurances
                    , EVENTS
             FROM  MyDatabase
             WHERE EVENTS = "FIRST"
             GROUP BY FIRSTCONN ;
        </cfquery>
        <!--- Detail Query --->
        <cfquery dbtype="query" name="detail1">
            SELECT  *
            FROM master1
            WHERE FIRSTCONN  >= <cfqueryparam value="#form.startdate#" cfsqltype="cf_sql_varchar">
            AND   FIRSTCONN  <  <cfqueryparam value="#dateAdd('d', 1,form.enddate)#" cfsqltype="cf_sql_varchar">;
        </cfquery> 
        <!--- QoQ for SECONDCONN --->
        <cfquery datasource = "XX.XX.X.XX" name="master2">
            SELECT STR_TO_DATE(date_format(Timedetail,'%m-%d-%Y'),'%m-%d-%Y') as SECONDCONN
                   , COUNT(Timedetail) as SECONDOccurances
                   , EVENTS
            FROM  MyDatabase
            WHERE EVENTS = "SECOND"
            GROUP BY SECONDCONN ;
        </cfquery>
        <cfquery dbtype="query" name="detail2">
            SELECT  *
            FROM   master2
            WHERE  SECONDCONN  >= <cfqueryparam value="#form.startdate#" cfsqltype="cf_sql_varchar">
            AND    SECONDCONN  <  <cfqueryparam value="#dateAdd('d', 1,form.enddate)#" cfsqltype="cf_sql_varchar">;
        </cfquery> 
        <cfchart format="flash"  chartwidth="1000" chartheight="500" scalefrom="0" scaleto="50000" xAxisTitle="Dates" yaxistitle="Number of Connections">
             <cfchartseries  query="detail1" type="line" itemColumn="FIRSTCONN" valueColumn="FIRSTOccurances" >
             <cfchartseries  query="detail2" type="line" itemColumn="SECONDCONN" valueColumn="SECONDOccurances" >
             </cfchartseries>
        </cfchart>
    The cfform code I'm using is as follows:
    <cfform format="flash" preloader ="false">
    <cfformgroup type="horizontal">
      <cfinput type="dateField" name="startdate" label="Start Date" width="100" value="#form.startdate#">
      <cfinput type="dateField" name="enddate" label="End Date" width="100" value="#form.enddate#">
      <cfinput name="submitApply" type="submit" value = "Apply">
      <cfinput name="cancel" type="submit" value="Download CSV">
    </cfformgroup>
    Desired Output:
    I have attached the image for the output below. Please find it attached.
    Basically, if a date range is 21June to 21 July. The output must be as shown in the image. (I have omitted THIRDCONN etc for the sake of simplicity in my code).
    Please let me know how should I go about this problem and let me know if I can answer more questions.

    It's not built into the language. Your best bet is probably to put the CSV-Reading logic into its own class.
    Or find one of the thousands of classes that already implement such a thing.

  • I have doubt in inserting bulk records

    hai good morning to all
    my company having millions of records to insert into the DB ..
    is there any program or tool to insert bulk records..
    anyone plz help me..

    I don't think so, such tool available for inserting bulk records. What you can do is, write a PL/SQL programs to insert bulk records.
    Search in the SQL and PL/SQL Forums for sample PL/SQL code who have already done, or check in asktom for such PL/SQL samples.
    PL/SQL
    http://asktom.oracle.com
    Regards,
    Sabdar Syed.

  • Problems for download Recording Repair Assistant

    Hi, yesterday (1 September 2014) was launched an update for Jaydeep's Recording Repair Assistant, the problem is that when i go to download it, i need to login on my.adobeconnect.com and i dont have any user for login for download it.
    I work with about 1000 recordings of adobe connect every week, and always we have 3 or 4 with problems with audio or video that we repair with Jaydeep's Recording Repair Assistant.
    Can anyone help us with an alternative link for download the update of Jaydeep's Recording Repair Assistant?
    Thank you so much.
    Eduardo.

    Problem was solved, the link was fixed, we dont need loguin to download the software.
    Here the link to download it:
    https://my.adobeconnect.com/JRRA
    Bye

  • Retrieve relationship records for bulk records

    Hi
    I would like to know is there any possibility to retrieve relationship records for bulk records with out using loop through RetrieveRelationshipsCommand.
    Problem :
    I have 100 records from a given table. I would like to retrieve related records for all 100 records at a single shot with out loop through RetrieveRelationshipsCommand execute() method.
    Thanks!
    Someshwar

    sql>select pidm, term
      2    from (select a.pidm, b.term, row_number() over (partition by a.pidm order by b.term) rn
      3            from tablea a, tableb b
      4           where b.pidm = a.pidm)
      5   where rn <= 3;
    PIDM TERM
    0034 2004
    0034 2006
    0034 2007
    1125 2006
    1125 2007
    1125 2009
    6 rows selected.

  • Best approach for syndication in Central MDM

    MDM 7.1
    CE 7.2
    ERP 6 EHP4
    PI 7.1 EHP1
    We are currently developing a custom application using CE/BPM workflow for central maintenance of customer master data. One of the topics under discussion is the right approach for syndication once a record is complete.
    [This |http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/60a3118e-3c3e-2d10-d899-ddd0b963beba?quicklink=downloads&overridelayout=true] SAP document on collaborative material master data creation provides one way to achieve this syndication by first calling a web service from BPM to create record in ERP before checking in MDM. While I am personally fine with the approach, some of the other colleagues aren't too keen on issuing synchronous calls from BPM. Rather, they would like to use the syndication engine of MDM to transmit data to downstream systems (currently only SAP ERP) using Idocs. But there is a caveat here. To use syndication, the record has to be checked in.
    The problem is that if the record is checked in MDM, it is ready for modification. However, the asynchronous call to ERP using Idocs for creation of customer master might fail for any number of reasons. In this case, the MDM record might need a modification before resubmitting to ERP. In the meantime, since the record was checked in before syndication, someone else might have checked it out, potentially resulting in data quality issues. So to avoid this situation, the developer has decided to take the approach to check in -> syndicate -> check out -> wait for confirmation Idoc -> check in if success. This isn't a clean approach to syndicate but might address the record locking issue.
    Another consideration is to design the application with the view that sometime in the future, this master data might have to be syndicated to other SAP and non-SAP systems as well. To ensure syndication to all downstream systems is complete before checking in MDM can be a tricky requirement and might need some complex ccBPM development or evaluating something similar to two-phase commit (might be an overkill). In any case, a best practice approach for keeping downstreams systems in sync with MDM in case of central MDM has to be shared by SAP. So it would be good to have comments of the people who developed the reference application for collaborative material master data creation.
    If there are any customers who have come up with a custom solution which works, please do share the experience.
    Thanks and regards,
    Shehryar

    Thanks Ravi. While there are more than one possible solutions to the immediated problem, I am actually looking for a design pattern which SAP recommends or a customer has developed to address the issues related to synchronization of master data in a Central MDM environment.
    The idea behind a central master data management function, as you know, is that all participating business systems use the same basic master data being authored in MDM. This data has to be synchronized with all participating systems, rather than just one system. To me, a ccBPM workflow or 2 phase commit design pattern seem to be the solution. But it would be good to know how other customers are addressing the issue of master data synchronization with multiple systems, or SAP's recommendations for this issue.
    Regards,
    Shehryar

  • How to provide the user with a list of files to pick from...for downloading

    hai..
    I have uploaded the file succesfully.. now we need to download the file...... which has been uploaded..... for that we have implemnted the Query as..
    select max(id) from APEX_APPLICATION_FILES ,here the latest uploaded record will be retrieved and shown.
    Now We want to provide the user with a list of files to pick from for downloading..,Dat is he should be shown the list of files which is available from dat he has to select one file to downlaod ???
    can u plz tell me how to do it....
    anoo

    Hi Anoo,
    Create a report using the following SQL statement:
    SELECT ID,
    FILENAME,
    CREATED_ON
    FROM APEX_APPLICATION_FILES
    ORDER BY CREATED_ON DESCThere are other fields available from the table, but the above gives you a start.
    Then edit the report's Report Attributes.
    Edit the CREATED_ON column and pick a Number/Date Format to use for the display and Apply Changes
    Edit the ID column. In the Column Link section, enter:
    Link Text: &lt;img src="#IMAGE_PREFIX#download.gif" alt="Download"&gt;
    Target: URL
    URL: p?n=#ID#
    Apply Changes and run your report
    Andy

  • There is no source data for this data record, Message FZ205

    Hi Experts,
    I am facing a problem with the DME File download. This problem happened all of sudden in our production system since last month and it was never before. Our system landscape has also not been changed but as per our basis consultant he has added two-three more new application server to the Production client. Even we do not have this problem in our testing clients.
    Please note that we have been using the output medium '1' from the day one and thus the system has been generating the DME in 'File System' which we download on the desktop and upload the same to the bank online. After running the payment run when we trying to download the DME File, the system gives the error "There is no source data for this data record, Message FZ205".
    I tried to fix this issue through many ways but not able to. So can you please let me know the reason of this error and solution to fix this.
    With best regards,
    BABA

    Hi Shailesh,
    Please share how you solved this problem.
    Many Thanks,
    Lakshmi

  • What's the best approach for handeling about 1300 connections in Oracle.

    What's the best approach for handling about 1300 connections in Oracle 9i/10g through a Java application?
    1.Using separate schema s for various type users(We can store only relevant data with a particular schema.     Then No. of records per table can be reduced by replicating tables but we have to maintain all data with a another schema     Then we need update two schema s for a given session.Because we maintain separate scheama for a one user and another schema for all data and then there may be Updating problems)
    OR
    2. Using single schema for all users.
    Note: All users may access the same tables and there may be lot of records than previous case.
    What is the Best case.
    Please give Your valuable ideas

    It is a true but i want a solution from you all.I want you to tell me how to fix my friends car.

  • Best approach for IDOC - JDBC scenario

    Hi,
    In my scenarion I am creating sales order(ORDERS04) in R/3 system and which need to be replicated in a SQL Server system. I am sending the order to XI as an IDoc and want to use JDBC for sending data to SQL Server. I need to insert data in two tables(header & details). Is it possible without BPM?  Or what is the best approach for this?
    Thanks,
    Sri.

    Yes, this is possible without the BPM.
    Just create the Corresponding Datatype for the insertion.
    if the records to be inserted are different, then there wil be 2 different datatypes ( one for header and one for detail).
    Do a mutlimapping, where your Source is mapped into the header and details datatype and then send using the JDBC sender adapter.
    For the strucutre of your Datatype for insertion , just check this link,
    http://help.sap.com/saphelp_nw04/helpdata/en/7e/5df96381ec72468a00815dd80f8b63/content.htm
    To access any Database from XI, you will have to install the corresponding Driver on your XI server.
    https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3867a582-0401-0010-6cbf-9644e49f1a10
    Regards,
    Bhavesh

  • Instructions for Downloading and Activating the JCOP Tools

    In response to my question:
    I refer to JCOP Tools available on Eclipse.
    If the plug-in free for download?
    If it is not, kindly provide a proper hyperlink from which those interested can place their order.Listed below is the reply from IBM. Can anyone who has successfully obtained the activation code this way confirm whether you need to foot the postage?
    Cheers!!!!
    There is no charge for the JCOP Tools. The tools are provided as-is with no warranty or support. Instructions for downloading and activating the tools follow.
    Please note that because our Java Card operating system is now available for more than one silicon vendor, IBM will no longer act as a distributor for sample cards. If you require a sample card, you must now approach the silicon vendors directly . Our current silicon partners are Philips Semiconductor, Samsung and Sharp. In addition you may be able to obtain JCOP sample cards from suppliers on this list http://www.zurich.ibm.com/jcop/order/cards.html
    JCOP Tools are subject to US Government Export Controls, and therefore each install has to be activated individually to ensure compliance. Please follow the instructions below for each copy of the tools that need to be activated.
    Prerequisites:
       1. If you do not already have a Java Runtime Environment (JRE) installed, download and install a JRE or JDK. You can do so from this website (http://java.sun.com/j2se/1.4.2/download.html). Please note that we recommend the use of JRE version 1.4.2.
       2. If you do not already have the open source software development environment Eclipse installed, download and install Eclipse (http://www.eclipse.org/), You can do so from this website(http://www.eclipse.org/downloads/index.php). JCOP Tools require Eclipse 3.1
    To download the tools and start install:
       1. Download the current Update Site image from here (http://www.zurich.ibm.com/jcop/download/eclipse/image/tools.zip)
       2. Unzip the downloaded file to a location of your choice
       3. Start the Eclipse IDE
       4. From the menu bar click on Help > Software Updates > Find and Install
       5. In the Install/Update Dialog select Search for new features to install
       6. Click Next
       7. Click on New Archived Site . . . and browse to the location chosen in step 2
       8. Select the file tools.zip
       9. Click Open then OK then Finish
      10. Eclipse Update Manager will start to install the plug-in, continue with the install as needed.
    For an activation code please send me ([email protected]) the following information:
       1. Your full postal address  - the serial number will be sent via International Courier for US Export control reasons.
       2. Your contact telephone number
       3. The serial number of your JCOP tools install
       4. Your planned usage/reason for needing the JCOP tools
       5. If a student, a copy (fax or digital photo) of your student ID
    For the serial number (item 3 above):
       1. Ensure you have downloaded and installed the JCOP Tools
       2. Start the Eclipse IDE
       3. From the menu bar click on File > New > Project
       4. In the New Project Dialog expand the Java Card folder
       5. Select Java Card Project
       6. Click Next
       7. You should now see the JCOP Licensing Wizard
       8. Click Next
       9. Select Verify an Activation Code
      10. Click Next
      11. The Serial Number should appear on the next page, above the Activation Code entry fields.
      12. Once you have that number click on Cancel then Abort (Note: the Java Card project choice will be disabled until the next time you restart Eclipse)

    For those who are interested to use the JCOP simulator for a start, I have checked that the plug-in and feature files (in tools.zip) for Eclipse are still available at IBM site, please download and install yourself.
    I still keep a copy of user guide for JCOP tools (version 3.1.1a) and the contents are still relevant to Version 3.1.1b simulator in tools.zip.
    If you are interested to have a copy of such document, kindly drop me an email to [email protected]

  • How to download the recorded video from my ipad to my PC ?

    How to download the recorded video from my ipad to my PC?

    See this support document for assistance. Import photos and videos from your iPhone, iPad, or iPod touch to your Mac or Windows PC - Apple Support

  • Re: JDBC 10.2.0.3 available for download

    kmensah Posted this on Mar 14, 2007 3:25 PM:
    Some of you have requested when 10.2.0.3 will be available for download; here it is:
    http://www.oracle.com/technology/software/tech/java/sqlj_jdbc/index.html
    But the link 10.2.0.3 link gives a 404 NOT FOUND error message.

    kmensah Posted this on Mar 14, 2007 3:25 PM:
    Some of you have requested when 10.2.0.3 will beavailable for download; here it is:
    >
    http://www.oracle.com/technology/software/tech/java/sq
    lj_jdbc/index.html
    But the link 10.2.0.3 link gives a 404 NOT FOUND
    error message.Tried this today and I have the same problem. Please see below: Any thoughts on when this might be fixed?
    Thanks!!!
    -Mike
    We're sorry, the page you requested was not found.
    We have recorded this error (404) to help us fix the problem.
    You may wish to try again using one of the tools below.
    Back to Previous Page
    Site Map
    Product Index
    To search for your page, try our Search function.
    All Technology Network PartnerNetwork (Public Only) Video and Multimedia Refine Search
    RSS | Legal Notices and Terms for Use | Privacy Statement

  • Approach for managing Store IDs

    Hi,
    What is a good approach for managing the IDs used for accessing the different application stores (Windows Phone Store, Itunes store, Google Play Store ...) when rolling out a mobile device solution such as Windows Intune?
    Is it something that a user is responsible for? I think it is quite difficult for a company to manage all those IDs. For example, a user has an Iphone and an Apple ID, the company decides to give every employee a Windows Phone that will be managed by Windows
    Intune. Not every employee will already have a Microsoft account and the Microsoft account will have to be created. Should the corparate email be used as Microsoft account? Or should we leave the option to the user? Can these accounts be created in bulk if
    the corporate email address is used?
    Another thing, applications from the stores can be deployed to the users. It don't see any issue when these applications are free, but how to manage applications that need to be purchased from the store?
    Cédric.

    Hi
    The user has to manage this themselves. All the various APP Stores are end-user based by nature and no central administration/user provisioning exists as such.
    The various IDs used for accessing the App Store are personel and when users purchase applications they are owned by that users (ID). You cannot move APPs between users/IDs.
    So you really have to decide whether you want to allow access to the various stores from Company owned devices or not. It you decide you do, you could create guides explaining how to create users ID etc. and have some processes in place to deal with administration
    and issues.  

  • How to make Book WSDL available for download?

    Hi,
    I would like to download Book WSDL v2.0. The Web service API document says "To download the Book WSDL, you must be given access to the Book object". However, i did not find any option inside "role management>record types access" to make it available for access.
    Can anyone explain how the BOOK WSDL can be enabled for download?
    Note: I am not using Trial Account.
    Thanks
    Ravish
    Edited by: 833189 on Mar 11, 2011 8:35 AM

    Thanks for input.
    I have ensured that "Company Profile > Company Data Visibility Settings > Display Book Selector" setting is enabled. I did not find any BOOK specific privilege under role management wizard.
    Can you please tell me the exact setting that i need to ensure for BOOK WSDL access?
    Note: My user's role is admin.

Maybe you are looking for

  • Experience so far with BT Home Hub 5?

    So a few of you have installed the Home Hub 5. Like me, I'm sure a few of us would be interested to hear your experiences with this new piece of kit.

  • Selection Profile to Filter by Forwarding Order type in Transportation Cockpit

    Hi All, we need to configure Selection Profile / Planning Profile to consider only certain forwarding order type. The following settings have been done in the additional attributes of the Selection profile. And this selection profile is assigned to t

  • Problem in Date Comparision

    Hi, There is one messageTextInput in which date is being entered. I want to compare this date with system date and according to go in next page or throw an error. But when I do OAMessageDateFieldBean endDate = (OAMessageDateFieldBean)oawebbean.findCh

  • Delivery Note under not yet proceeded

    Dear Experts, Would you kindly tells me any SAP T-code can show Delivery Note under not yet proceeded u201Cpost goods issueu201D and u201Cconvert to sales invoiceu201D. Thanks! Wilson Hong

  • Delivery Date in SO not calculated with Route Transit Time

    Hello Experts, We are not able to calculate the delivery date in Sales Orders based on the Route transit time.We are using the Transportation group from Material master , Shipping condition from sold to Party , and Receiving issuing plants and zones