Uploading large Product CSV's
Anyone have success uploading large CSV files,
I have split the 25,000 item CSV file in 5k item batches, and works 25% of the time, As this will have to be done each day ($ movements and remote stock) I am trying to find a better way... / ... way that actually works.
A portion of the time I don't get the "success Report" -Time Taken [41.12] so not sure they are all going up. other times i get the below report.
Server Error in '/' Application.
Runtime Error
Description: An application error occurred on the server. The current custom error settings for this application prevent the details of the application error from being viewed remotely (for security reasons). It could, however, be viewed by browsers running on the local server machine.
Details: To enable the details of this specific error message to be viewable on remote machines, please create a <customErrors> tag within a "web.config" configuration file located in the root directory of the current web application. This <customErrors> tag should then have its "mode" attribute set to "Off".
<!-- Web.Config Configuration File --> <configuration> <system.web> <customErrors mode="Off"/> </system.web> </configuration>
Notes: The current error page you are seeing can be replaced by a custom error page by modifying the "defaultRedirect" attribute of the application's <customErrors> configuration tag to point to a custom error page URL.
<!-- Web.Config Configuration File --> <configuration> <system.web> <customErrors mode="RemoteOnly" defaultRedirect="mycustompage.htm"/> </system.web> </configuration>
That's a .Net error which is probably logged at BC, so you should approach
support and have them look at the logs and tell you where the error is.
Cheers,
_M
Similar Messages
-
OOM happens inside Weblogic 10.3.6 when application uploads large files
Oracle Fusion BI Apps application is uploading large files (100+ MB) onto Oracle Cloud Storage. This application works properly when ran outside weblogic server. When deployed on Fusion Middleware Weblogic 10.3.6, during upload of large files we get this OOM error
java.lang.OutOfMemoryError: allocLargeObjectOrArray: [B, size 268435472
at jrockit/vm/Allocator.allocLargeObjectOrArray(JIZ)Ljava/lang/Object;(Native Method)
at jrockit/vm/Allocator.allocObjectOrArray(Allocator.java:349)[optimized]
at weblogic/utils/io/UnsyncByteArrayOutputStream.resizeBuffer(UnsyncByteArrayOutputStream.java:59)[inlined]
at weblogic/utils/io/UnsyncByteArrayOutputStream.write(UnsyncByteArrayOutputStream.java:89)[optimized]
at com/sun/jersey/api/client/CommittingOutputStream.write(CommittingOutputStream.java:90)
at com/sun/jersey/core/util/ReaderWriter.writeTo(ReaderWriter.java:115)
at com/sun/jersey/core/provider/AbstractMessageReaderWriterProvider.writeTo(AbstractMessageReaderWriterProvider.java:76)
at com/sun/jersey/core/impl/provider/entity/InputStreamProvider.writeTo(InputStreamProvider.java:98)
at com/sun/jersey/core/impl/provider/entity/InputStreamProvider.writeTo(InputStreamProvider.java:59)
at com/sun/jersey/api/client/RequestWriter.writeRequestEntity(RequestWriter.java:300)
at com/sun/jersey/client/urlconnection/URLConnectionClientHandler._invoke(URLConnectionClientHandler.java:213)
at com/sun/jersey/client/urlconnection/URLConnectionClientHandler.handle(URLConnectionClientHandler.java:149)
Looks like weblogic is using its default Weblogic HTTP handler, switching to Sun HTTP handler via start up JVM/Java Option "-DUseSunHttpHandler=true" solves the OOM issue.
Seems instead of streaming the file content with some fixed size byte array its being on the whole file into memory during upload.
Is it possible to solve this OOM by changing any setting of Weblogic HTPP handler without switching to Sun HTTP handler as there are many other application deployed on this weblogic instance?
We are concerned whether there will be any impact on performance or any other issue.
Please advice, highly appreciate your response.
Thanks!Hi,
If you have a back then restore the below file back and then try to start weblogic:
\Oracle\Middleware\user_projects\domains\<domain_name>\config\config.lok
Thanks,
Sharmela -
Adding facebook comments to large product page
hi guys I just wanted to go over the facebook intergration process *** ive read this http://kb.worldsecuresystems.com/kb/add-social-media.html
but couldnt find the container.html page in admin, only dreamweaver.
plus when ive checked out the forums on intergrating facebook comments there seems a work around because the current module doesnt work the way people want it. to.
Is this still the case or should I go about intergrating facebook as described http://kb.worldsecuresystems.com/kb/add-social-media.html
What I want to do is use it on this site on the large product section instead of the comments module ive inserted
http://www.ceramicplanet.co.uk/bathroom-tiles/relief-white-5445-25x33cm
would adding the script to the large product template manually work better than adding it to the facebook container.html page in the social modules folder?
plus I got the impression peeps had trouble having the comments for that one item showing just on its own page. I want just comments for the product on show appearing on that product page not just any old list of random comments. Is this easy to do now or is there extra url tags needed?
any advice or help will be greatly appreciated
Dave
oh just to say this is the code facebook gave out when I pressed get code but Ive noticed different versions on forum pages, is it right to use this
<div id="fb-root"></div>
<script>(function(d, s, id) {
var js, fjs = d.getElementsByTagName(s)[0];
if (d.getElementById(id)) return;
js = d.createElement(s); js.id = id;
js.src = "//connect.facebook.net/en_GB/all.js#xfbml=1";
fjs.parentNode.insertBefore(js, fjs);
}(document, 'script', 'facebook-jssdk'));</script>
<div class="fb-comments" data-href="http://example.com/comments"
data-colorscheme="The color scheme used in the plugin" data-numposts="5"
data-width="420"></div>If you just want to keep it simple, Facebook has a social widget system that works from the URL, as long as the URL stays the same the comments will he there for that product or whatever you need.
It is very easy to implment and even has a wizard to help you config the size and look.
https://developers.facebook.com/docs/plugins/ -
Hi Everyone,
I want to create a powershell script file
1) Check a directory and upload all termset csv files into the SharePoint local taxonomy.
2) Input paramaters - directory that containss termset csv files, Local Termstore to import to,
3) Prior to updating get a backup of the existing termstore (for rollback/recovery purposes)
4) Parameters should be passed in via XML file.
Please let me know how to do it.
Regards,
SrinivasHi,
Please check this link
http://termsetimporter.codeplex.com/
Please remember to click 'Mark as Answer' on the answer if it helps you -
Issue while uploading large size file to sharepoint
How to upload 2GB into sharepoint 2010 document library using client object model. Upto 150MB its working well. While uploading more than 150MB i faced this error-- system.outofmemory exception was thrown
Hi lililil,
According to your description, my understanding is that you can't upload file which is larger than 150MB in your environment.
To fix this issue, you need to set the Maximum Upload Size in Central Administration->Application Management->Manage Web Applications->General Settings.
More information about set Maximum Upload Size:
http://www.anmolrehan-sharepointconsultant.com/2012/01/sharepoint-2010-document-library-upload.html
Also, you need to set maxAllowedContentLength in IIS web.config file:
http://blogs.technet.com/b/sharepointcomic/archive/2010/02/14/uploading-large-files-to-sharepoint-on-windows-server-2008-and-iis7.aspx
Best Regards
Zhengyu Guo
TechNet Community Support -
Upload large file in sharepoint
hi
is it possible upload large file in sharepoint in our scenario we need upload large file >3gb in document libraries
where sharepoint store files? is there any way we can have a custom aspx page for uploading large files in chunks in document library?
kindly suggest.
Thankyouis not possbile upload more than 2Gb
If you try to upload big files you will need to make some change on your Sharepoint to support the 2Gb.
Error message when you try to upload a large file to a document library on a Windows SharePoint Services 3.0 site: "Request timed out"
http://support.microsoft.com/?id=925083
With files bigger than 2GB can recomend creeate linked files to that files where you can download.
André Lage Microsoft SharePoint and CRM Consultant
Blog:http://aaclage.blogspot.com
Codeplex:http://spupload.codeplex.com/http://simplecamlsearch.codeplex.com/ -
How to process large input CSV file with File adapter
Hi,
could someone recommend me the right BPEL way to process the large input CSV file (4MB or more with at least 5000 rows) with File Adapter?
My idea is to receive data from file (poll the UX directory for new input file), transform it and then export to one output CSV file (input for other system).
I developed my process that consists of:
- File adapter partnerlink for read data
- Receive activity with checked box to create instance
- Transform activity
- Invoke activity for writing to output CSV.
I tried this with small input file and everything was OK, but now when I try to use the complete input file, the process doesn't start and automatically goes to OFF state in BPEL console.
Could I use the MaxTransactionSize parameter as in DB adapter, should I batch the input file or other way could help me?
Any hint from you? I've to solve this problem till this thursday.
Thanks,
Milan K.This is a known issue. Martin Kleinman has posted several issues on the forum here, with a similar scenario using ESB. This can only be solved by completely tuning the BPEL application itself, and throwing in big hardware.
Also switching to the latest 10.1.3.3 version of the SOA Suite (assuming you didn't already) will show some improvements.
HTH,
Bas -
How to upload large file with http via post
Hi guys,
Does anybody know how to upload large file (>100 MB) use applet to servlet with http via post method? Thanks in advance.
Regards,
Mark.Hi SuckRatE
Thanks for your reply. Could you give me some client side code to upload a large file. I use URL to connect to server. It throws out of memory exception. The part of client code is below:
// connect to the servlet
URL theServlet = new URL(servletLocation);
URLConnection servletConnection = theServlet.openConnection();
// inform the connection that we will send output and accept input
servletConnection.setDoInput(true);
servletConnection.setDoOutput(true);
// Don't used a cached version of URL connection.
servletConnection.setUseCaches (false);
servletConnection.setDefaultUseCaches(false);
// Specify the content type that we will send text data
servletConnection.setRequestProperty("Content-Type",
+"application/octet-stream");
// send the user string to the servlet.
OutputStream outStream = servletConnection.getOutputStream();
FileInputStream filein = new FileInputStream(largeFile);
//BufferedReader in = new BufferedReader(new InputStreamReader
+(servletConnection.getInputStream()));
//System.out.println("tempCurrent = "+in.readLine());
byte abyte[] = new byte[2048];
int cnt = 0;
while((cnt = filein.read(abyte)) > 0)
outStream.write(abyte, 0, cnt);
filein.close();
outStream.flush();
outStream.close();
Regards,
Mark. -
How to get the document path of the pictures uploaded for products?
Hi Gurus,
How to get the document path of the pictures uploaded for products uploaded through tcode COMMPR01?
Many Thanks,
Neerajclient path.
I need to get the client path in order to download files form server to client.
Best regards,
Huy. -
Uploading Large videos Files to SharePoint 2010
Uploading Large video Files to SharePoint 2010 for employee training portal
SaidireddyHello ,
The default maximum file size for SharePoint Lib is 50 MB. You can change the maximum file upload size in SharePoint 2010 .However;
a large volume of very large files can affect farm performance.
Ref to change maximum file upload size
http://aryannava.com/2011/05/30/how-to-change-the-maximum-file-upload-size-in-sharepoint-2010/
I would suggest you that instead of uploading large files to SharePoint, you can Upload those files to File server or
media steaming server and Share those links to SharePoint server.
You can embed those links to SharePoint Silver Media player in .mp4 or .wmv formats.
Best Regards Kuldeep Verma
Please remember to click "Mark As Answer" if a post solves your problem or "Vote As Helpful" if it
was useful. -
Once attribute price selected, updating the price on the large product layout?
For my e-commerce site I need to setup, when a customer picks an attribute (such as 'Custom Artwork +£5.00') The price on the large product layout updates automatically before proceeding to the Shopping Cart for the price to update.
Is this achievable?Hi Paul,
In case you still in need, (assuming you are using the attribute to pass the information to the cart) you can adjust the displayed price to reflect the selected option.
--not sure if this is the right way.. however it works.
---html--
<div id="catProdAttributes2_8090953" class="productAttributes">
<div class="catProductAttributeGroup" data-productattributegroup="1851262">
<div class="catProdAttributeTitle">Warehouse</div>
<div class="catProdAttributeItem">
<input type="radio" id="13466918" name="1851262" mandatory="1" />
<span>US Warehouse $0</span>
<img src="/images/attributeimageUS.png" alt="US Warehouse" border="0" /></div>
<div class="catProdAttributeItem">
<input type="radio" id="13466919" name="1851262" mandatory="1" />
<span>AUS Warehouse $2.26</span>
<img src="/images/attributeimageAUS.png" alt="AUS Warehouse" border="0" />
</div>
</div>
</div>
<span class="updated_price">{tag_totalprice}</span>
<span style="display:none;" class="original_price">{tag_totalprice}</span>
--Script---
<script type="text/javascript">
$('.catProdAttributeItem img').on("click",function(){
$(this) .siblings ('input[type=radio]') .attr('checked', true);
var original_price = $('.original_price').text() .replace(/[^0-9\.]/g, '');
parseFloat(this.original_price);
var warehouse_price = $(this).siblings('.catProdAttributeItem span') .text() .replace(/[^0-9\.]/g, '');
warehouse_price=parseFloat(warehouse_price);
var total_price = parseFloat(original_price) + parseFloat(warehouse_price);
$('.updated_price').html('$' + total_price.toFixed(2));
</script> -
Upload large file on doSubmit in javascript
Hi all,
I'm currently having some problems uploading large files using a custom Upload button (button calls doSubmit from javascript).
When using an Upload button with unconditional branch to the same page (no js) it works perfectly. Now I have to use my own Upload button that calls some javascript and AJAX and then Submit the page (with doSubmit); in this case I can only upload very small files (< 100k) ...
I understand the mechanism of the file browse and its uploading to the table WWV_FLOW_FILE_OBJECTS, but I cannot figure out why my configuration does not work when it does stricly the same but from js ...
Someone experienced the same issue ? How to submit the upload in javascript side with doSubmit ??
Best regards,
OthmanHi Othman,
did you find a solution for this. I'm facing nearly the same problem, I'm calling a popup, where the user can upload up to 5 files. Then on clicking a button, javascript is called, that's calling the doSubmit and some others things and at the end the popup is closed.
Sometimes the upload of 5 files is working, sometimes only 1 file is possible (obvisiously it's depending on the filesize).
function addFile()
doSubmit('FILE');
opener.actualizeProject('TAB4');
close();
}chrissy -
Large product page not displaying correctly on responsive webpage.
Large product page not displaying correctly on responsive webpage. Not really sure what to adjust or correct.
http://iamartde.businesscatalyst.com/apparel-1/i-am-art-sweatshirt-whiteHi,
I think it may be <div class="html5gallery-viral-0"> (contains the social media buttons) // screencasteu.worldsecuresystems.com/AP/2013-08-01_1033.png
It's the only element that isn't in sync with the other elements on page, when compared to home.html for example.
Kind Regards,
Alex Pavelescu -
Hi, I have been thinking why everything except for the small product back up is tied up to the over all layouts template. Could any one give me advice on some ways I could display my large product page using a different template?
Any suggestion will be appreciated. Thank you very muchOnly with javascript and CSS and of a new template per catalog.
-
What is considered to be a large production client?
I'm about to perform a client transport and would like to know about how many gb in database size is considered to be a large production client?
Thank youDear,
Please note in SAP everything is Possible , if your database size is 80G or 1TB we are having various methods of transferring data from one system to the other system.
You can do it by 1. System copy.
2. Remote client copy.
3. Client Export & Import.
Warm regards.
Hassan Naveed
Maybe you are looking for
-
I found the HTML code for including the Facebook widget buttons on my webiste...now I also wanted to include some other widget so I looked at www.widgetbox.com....I can download the html code and once I put that on my webpage then I have the widget o
-
After updating my iPhone 5, my screen won't turn on. How do i fix this?
I updated my iPhone 5 and my screen seems to be unresponsive. The home button, when held, activates siri and unplugging it and replugging it, makes it vibrate. But my screen just won't tell on. I am very disappointed in Apple Products and will probab
-
Problem with passing variable to restful uri's.
I have a restful URI in the format http://localhost/functionname/{itemID}. I use this URI to retrieve JSON formatted information. Through Flash Builder 4 data services I create an operation that makes use of this URI and I also hame itemID a URL para
-
How do you stop the message, disc ejected improperly
First time pulled out my back up program instead of ejecting it. Every day received message disc was ejected improperly How do I stop this? Took to Apple Store with my Apply Care and they did not fix it.
-
How to send output of a XML report to certain email Ids
Hi, I have used rdf as well as rtf file and created my xml report. Now i want to send my report output(pdf or excel) to certain email ids and i donot want to use email bursting technique for this. So please tell me the other ways to do this thing. Th