Uploading large Product CSV's

Anyone have success uploading large CSV files,
I have split the 25,000 item CSV file in 5k item batches, and works 25% of the time, As this will have to be done each day ($ movements and remote stock) I am trying to find a better way... / ... way that actually works.
A portion of the time I don't get the "success Report" -Time Taken [41.12] so not sure they are all going up. other times i get the below report.
Server Error in '/' Application.
Runtime Error
Description: An application error occurred on the server. The current custom error settings for this application prevent the details of the application error from being viewed remotely (for security reasons). It could, however, be viewed by browsers running on the local server machine.
Details: To enable the details of this specific error message to be viewable on remote machines, please create a <customErrors> tag within a "web.config" configuration file located in the root directory of the current web application. This <customErrors> tag should then have its "mode" attribute set to "Off".
<!-- Web.Config Configuration File -->  <configuration> <system.web> <customErrors mode="Off"/> </system.web> </configuration>
Notes: The current error page you are seeing can be replaced by a custom error page by modifying the "defaultRedirect" attribute of the application's <customErrors> configuration tag to point to a custom error page URL.
<!-- Web.Config Configuration File -->  <configuration> <system.web> <customErrors mode="RemoteOnly" defaultRedirect="mycustompage.htm"/> </system.web> </configuration>

That's a .Net error which is probably logged at BC, so you should approach
support and have them look at the logs and tell you where the error is.
Cheers,
_M

Similar Messages

  • OOM happens inside Weblogic 10.3.6 when application uploads large files

    Oracle Fusion BI Apps application is uploading large files (100+ MB) onto Oracle Cloud Storage. This application works properly when ran outside weblogic server. When deployed on Fusion Middleware Weblogic 10.3.6, during upload of large files we get this OOM error
    java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 268435472
        at jrockit/vm/Allocator.allocLargeObjectOrArray(JIZ)Ljava/lang/Object;(Native Method)
        at jrockit/vm/Allocator.allocObjectOrArray(Allocator.java:349)[optimized]
        at weblogic/utils/io/UnsyncByteArrayOutputStream.resizeBuffer(UnsyncByteArrayOutputStream.java:59)[inlined]
        at weblogic/utils/io/UnsyncByteArrayOutputStream.write(UnsyncByteArrayOutputStream.java:89)[optimized]
        at com/sun/jersey/api/client/CommittingOutputStream.write(CommittingOutputStream.java:90)
        at com/sun/jersey/core/util/ReaderWriter.writeTo(ReaderWriter.java:115)
        at com/sun/jersey/core/provider/AbstractMessageReaderWriterProvider.writeTo(AbstractMessageReaderWriterProvider.java:76)
        at com/sun/jersey/core/impl/provider/entity/InputStreamProvider.writeTo(InputStreamProvider.java:98)
        at com/sun/jersey/core/impl/provider/entity/InputStreamProvider.writeTo(InputStreamProvider.java:59)
        at com/sun/jersey/api/client/RequestWriter.writeRequestEntity(RequestWriter.java:300)
        at com/sun/jersey/client/urlconnection/URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:213)
        at com/sun/jersey/client/urlconnection/URLConnectionClientHandler.handle(URLConnectionClientHandler.java:149)
    Looks like weblogic is using its default Weblogic HTTP handler, switching to Sun HTTP handler via start up JVM/Java Option "-DUseSunHttpHandler=true" solves the OOM issue.
    Seems instead of streaming the file content with some fixed size byte array its being on the whole file into memory during upload.
    Is it possible to solve this OOM by changing any setting of Weblogic HTPP handler without switching to Sun HTTP handler as there are many other application deployed on this weblogic instance?
    We are concerned whether there will be any impact on performance or any other issue.
    Please advice, highly appreciate your response.
    Thanks!

    Hi,
    If you have a back then restore the below file back and then try to start weblogic:
    \Oracle\Middleware\user_projects\domains\<domain_name>\config\config.lok
    Thanks,
    Sharmela

  • Adding facebook comments to large product page

    hi guys I just wanted to go over the facebook intergration process *** ive read this http://kb.worldsecuresystems.com/kb/add-social-media.html
    but couldnt find the container.html page in admin, only dreamweaver.
    plus when ive checked out the forums on intergrating facebook comments there seems a work around because the current module doesnt work the way people want it. to.
    Is this still the case or should I go about intergrating facebook as described http://kb.worldsecuresystems.com/kb/add-social-media.html
    What I want to do is use it on this site on the large product section instead of the comments module ive inserted
    http://www.ceramicplanet.co.uk/bathroom-tiles/relief-white-5445-25x33cm
    would adding the script to the large product template manually work better than adding it to the facebook container.html page in the social modules folder?
    plus I got the impression peeps had trouble having the comments for that one item showing just on its own page. I want just comments for the product on show appearing on that product page not just any old list of random comments. Is this easy to do now or is there extra url tags needed?
    any advice or help will be greatly appreciated
    Dave
    oh just to say this is the code facebook gave out when I pressed get code but Ive noticed different versions on forum pages, is it right to use this
    <div id="fb-root"></div>
    <script>(function(d, s, id) {
      var js, fjs = d.getElementsByTagName(s)[0];
      if (d.getElementById(id)) return;
      js = d.createElement(s); js.id = id;
      js.src = "//connect.facebook.net/en_GB/all.js#xfbml=1";
      fjs.parentNode.insertBefore(js, fjs);
    }(document, 'script', 'facebook-jssdk'));</script>
    <div class="fb-comments" data-href="http://example.com/comments"
    data-colorscheme="The color scheme used in the plugin" data-numposts="5"
    data-width="420"></div>

    If you just want to keep it simple, Facebook has a social widget system that works from the URL, as long as the URL stays the same the comments will he there for that product or whatever you need.
    It is very easy to implment and even has a wizard to help you config the size and look.
    https://developers.facebook.com/docs/plugins/

  • How to create power shell script to upload all termset csv files into the SharePoint2013 local taxonomy ?

    Hi Everyone,
    I want to create a powershell script file
    1) Check a directory and upload all termset csv files into the SharePoint local taxonomy.
    2) Input paramaters - directory that containss termset csv files, Local Termstore to import to,
    3) Prior to updating get a backup of the existing termstore (for rollback/recovery purposes)
    4) Parameters should be passed in via XML file.
    Please let me know how to do it.
    Regards,
    Srinivas

    Hi,
    Please check this link
    http://termsetimporter.codeplex.com/
    Please remember to click 'Mark as Answer' on the answer if it helps you

  • Issue while uploading large size file to sharepoint

    How to upload 2GB into sharepoint 2010 document library using client object model. Upto 150MB its working well. While uploading more than 150MB i faced this error-- system.outofmemory exception was thrown

    Hi lililil,
    According to your description, my understanding is that you can't upload file which is larger than 150MB in your environment.
    To fix this issue, you need to set the Maximum Upload Size in Central Administration->Application Management->Manage Web Applications->General Settings.
    More information about set Maximum Upload Size:
    http://www.anmolrehan-sharepointconsultant.com/2012/01/sharepoint-2010-document-library-upload.html
    Also, you need to set maxAllowedContentLength in IIS web.config file:
    http://blogs.technet.com/b/sharepointcomic/archive/2010/02/14/uploading-large-files-to-sharepoint-on-windows-server-2008-and-iis7.aspx
    Best Regards
    Zhengyu Guo
    TechNet Community Support

  • Upload large file in sharepoint

    hi
    is it possible upload large file in sharepoint in our scenario we need upload large file >3gb in document libraries
    where sharepoint store files? is there any way we can have a custom aspx page for uploading large files in chunks in document library?
    kindly suggest.
    Thankyou

    is not possbile upload more than 2Gb
    If you try to upload big files you will need to make some change on your Sharepoint to support the 2Gb.
    Error message when you try to upload a large file to a document library on a Windows SharePoint Services 3.0 site: "Request timed out"
    http://support.microsoft.com/?id=925083
    With files bigger than 2GB can recomend creeate linked files to that files where you can download.
    André Lage Microsoft SharePoint and CRM Consultant
    Blog:http://aaclage.blogspot.com
    Codeplex:http://spupload.codeplex.com/http://simplecamlsearch.codeplex.com/

  • How to process large input CSV file with File adapter

    Hi,
    could someone recommend me the right BPEL way to process the large input CSV file (4MB or more with at least 5000 rows) with File Adapter?
    My idea is to receive data from file (poll the UX directory for new input file), transform it and then export to one output CSV file (input for other system).
    I developed my process that consists of:
    - File adapter partnerlink for read data
    - Receive activity with checked box to create instance
    - Transform activity
    - Invoke activity for writing to output CSV.
    I tried this with small input file and everything was OK, but now when I try to use the complete input file, the process doesn't start and automatically goes to OFF state in BPEL console.
    Could I use the MaxTransactionSize parameter as in DB adapter, should I batch the input file or other way could help me?
    Any hint from you? I've to solve this problem till this thursday.
    Thanks,
    Milan K.

    This is a known issue. Martin Kleinman has posted several issues on the forum here, with a similar scenario using ESB. This can only be solved by completely tuning the BPEL application itself, and throwing in big hardware.
    Also switching to the latest 10.1.3.3 version of the SOA Suite (assuming you didn't already) will show some improvements.
    HTH,
    Bas

  • How to upload large file with http via post

    Hi guys,
    Does anybody know how to upload large file (>100 MB) use applet to servlet with http via post method? Thanks in advance.
    Regards,
    Mark.

    Hi SuckRatE
    Thanks for your reply. Could you give me some client side code to upload a large file. I use URL to connect to server. It throws out of memory exception. The part of client code is below:
    // connect to the servlet
    URL theServlet = new URL(servletLocation);
    URLConnection servletConnection = theServlet.openConnection();
    // inform the connection that we will send output and accept input
    servletConnection.setDoInput(true);
    servletConnection.setDoOutput(true);
    // Don't used a cached version of URL connection.
    servletConnection.setUseCaches (false);
    servletConnection.setDefaultUseCaches(false);
    // Specify the content type that we will send text data
    servletConnection.setRequestProperty("Content-Type",
    +"application/octet-stream");
    // send the user string to the servlet.
    OutputStream outStream = servletConnection.getOutputStream();
    FileInputStream filein = new FileInputStream(largeFile);
    //BufferedReader in = new BufferedReader(new InputStreamReader
    +(servletConnection.getInputStream()));
    //System.out.println("tempCurrent = "+in.readLine());
    byte abyte[] = new byte[2048];
    int cnt = 0;
    while((cnt = filein.read(abyte)) > 0)
    outStream.write(abyte, 0, cnt);
    filein.close();
    outStream.flush();
    outStream.close();
    Regards,
    Mark.

  • How to get the document path of the pictures uploaded for products?

    Hi Gurus,
    How to get the document path of the pictures uploaded for products uploaded through tcode COMMPR01?
    Many Thanks,
    Neeraj

    client path.
    I need to get the client path in order to download files form server to client.
    Best regards,
    Huy.

  • Uploading Large videos Files to SharePoint 2010

    Uploading Large video  Files to SharePoint 2010  for employee training portal
    Saidireddy

    Hello ,
    The default maximum file size for SharePoint Lib is 50 MB. You can change the maximum file upload size in SharePoint 2010 .However;
    a large volume of very large files can affect farm performance.
    Ref to change maximum file upload size 
    http://aryannava.com/2011/05/30/how-to-change-the-maximum-file-upload-size-in-sharepoint-2010/
    I would suggest you that instead of uploading large files to SharePoint, you can Upload those files to File server or
    media steaming server and Share those links to SharePoint server.
    You can embed those links to SharePoint Silver Media player in .mp4 or .wmv formats. 
    Best Regards Kuldeep Verma
    Please remember to click "Mark As Answer" if a post solves your problem or "Vote As Helpful" if it
    was useful.

  • Once attribute price selected, updating the price on the large product layout?

    For my e-commerce site I need to setup, when a customer picks an attribute (such as 'Custom Artwork +£5.00') The price on the large product layout updates automatically before proceeding to the Shopping Cart for the price to update.
    Is this achievable?

    Hi Paul,
    In case you still in need, (assuming you are using the attribute to pass the information to the cart) you can adjust the displayed price to reflect the selected option.
    --not sure if this is the right way.. however it works.
    ---html--
    <div id="catProdAttributes2_8090953" class="productAttributes">
         <div class="catProductAttributeGroup" data-productattributegroup="1851262">
              <div class="catProdAttributeTitle">Warehouse</div>
              <div class="catProdAttributeItem">    
              <input type="radio" id="13466918" name="1851262" mandatory="1" />    
              <span>US Warehouse $0</span>
              <img src="/images/attributeimageUS.png" alt="US Warehouse" border="0" /></div>
              <div class="catProdAttributeItem">
              <input type="radio" id="13466919" name="1851262" mandatory="1" />
              <span>AUS Warehouse $2.26</span>
              <img src="/images/attributeimageAUS.png" alt="AUS Warehouse" border="0" />
              </div>
         </div>
    </div>
                    <span class="updated_price">{tag_totalprice}</span>
                    <span style="display:none;" class="original_price">{tag_totalprice}</span>
    --Script---
    <script type="text/javascript">
    $('.catProdAttributeItem img').on("click",function(){
    $(this) .siblings ('input[type=radio]') .attr('checked', true);
    var original_price = $('.original_price').text() .replace(/[^0-9\.]/g, '');
    parseFloat(this.original_price);
    var warehouse_price = $(this).siblings('.catProdAttributeItem span') .text() .replace(/[^0-9\.]/g, '');
         warehouse_price=parseFloat(warehouse_price);
    var total_price = parseFloat(original_price) + parseFloat(warehouse_price);
    $('.updated_price').html('$' + total_price.toFixed(2));
    </script>

  • Upload large file on doSubmit in javascript

    Hi all,
    I'm currently having some problems uploading large files using a custom Upload button (button calls doSubmit from javascript).
    When using an Upload button with unconditional branch to the same page (no js) it works perfectly. Now I have to use my own Upload button that calls some javascript and AJAX and then Submit the page (with doSubmit); in this case I can only upload very small files (< 100k) ...
    I understand the mechanism of the file browse and its uploading to the table WWV_FLOW_FILE_OBJECTS, but I cannot figure out why my configuration does not work when it does stricly the same but from js ...
    Someone experienced the same issue ? How to submit the upload in javascript side with doSubmit ??
    Best regards,
    Othman

    Hi Othman,
    did you find a solution for this. I'm facing nearly the same problem, I'm calling a popup, where the user can upload up to 5 files. Then on clicking a button, javascript is called, that's calling the doSubmit and some others things and at the end the popup is closed.
    Sometimes the upload of 5 files is working, sometimes only 1 file is possible (obvisiously it's depending on the filesize).
    function addFile()
    doSubmit('FILE');
    opener.actualizeProject('TAB4');
    close();
    }chrissy

  • Large product page not displaying correctly on responsive webpage.

    Large product page not displaying correctly on responsive webpage. Not really sure what to adjust or correct.
    http://iamartde.businesscatalyst.com/apparel-1/i-am-art-sweatshirt-white

    Hi,
    I think it may be <div class="html5gallery-viral-0"> (contains the social media buttons) // screencasteu.worldsecuresystems.com/AP/2013-08-01_1033.png
    It's the only element that isn't in sync with the other elements on page, when compared to home.html for example.
    Kind Regards,
    Alex Pavelescu

  • Hi is there any way around showing large product lay out through separate template from Over all layout?

    Hi, I have been thinking why everything except for the small product back up is tied up to the over all layouts template. Could any one give me advice on some ways I could display my large product page using a different template?
    Any suggestion will be appreciated. Thank you very much 

    Only with javascript and CSS and of a new template per catalog.

  • What is considered to be a large production client?

    I'm about to perform a client transport and would like to know about how many gb in database size is considered to be a large production client?
    Thank you

    Dear,
    Please note  in SAP everything is Possible , if your database size is 80G or  1TB we are having various methods of transferring  data from one system to the other system.
      You can do  it by 1. System copy.
                                2. Remote client copy.
                                3.  Client Export & Import.
    Warm regards.
    Hassan Naveed

Maybe you are looking for

  • Weblogic  10.3.5.0 and JSF 2.0 ?

    Hi We have Weblogic 10.3.5 even though we are extending our domain with jdeveloper 11.1.2 runtime but we still are unable to find the jsf 2.0 being deployed. I deployed the jsf-2.0 libraries after uninstalling the jsf-1.2 , jsf#[email protected] After this

  • How to put (reload) imessages on another idevice

    i lost my iphone, so i want to put my old messages on my ipad so i can get in contact with my family again. Help me please

  • Create clustered table from heap table

    Hi I have a table with more than 15 million rows. I want to create a clustured table from this heap table and as you know, I can't use CTAS for clustered table I created a clustered table and started insert data to it (Using append hint and parallel

  • To_Number function is changing decimal places????

    Hi all..I have a number 11,308,861.09 To sum up with another..I have to use to_number function When I am using this function, I am viewing that as 1.13088610859 Please help....

  • Hotmail on blackberry bold

    well since ive had my phone its never let me sign into msn or hotmail it says "invaild email address or password" for both of them but I know its correct as i use the passwords everyday for my laptop? so I dont know why my blackberry wont let me do i