CF8.01 Large Files Upload issue

We are having an issue with posting large files to the server
through CFFile. Our server is running on Windows 2003 R2 SP2 with
2GB of RAM. The average upload size is 800MB and we may run into
multiple simultaneous uploads with the large file size. So, we have
adjusted the "Maximum size of post data" to 2000 MB and "Request
Throttle Memory" to 5000 MB in the ColdFusion admin setting to
hopefully can allow up to 5 simultaneous uploads.
However, when we tried to launch two 800MB uploads at the
same time from different machines, only one upload can get through.
The other one returned "Cannot connect to the server" error after a
few minutes. No errors can be found in the W3C log and the
ColdFusion logs (coldfusion-out.log and exception.log) but it is
reported in the HTTPErr1.log with the following message:
2008-04-18 08:16:11 204.13.x.x 3057 65.162.x.x 80 HTTP/1.1
POST /testupload.cfm - 1899633270 Timer_EntityBody DefaultAppPool
Can anyone shed some light of it? Thanks!

quote:
Originally posted by:
Newsgroup User
Don't forget that your web server (IIS, Apache, etc.) can
have upload
throttles as well.
We did not throttle our IIS to limit the upload/download
bandwidth.
Is there a maximum limit for "Request Throttle Memory"
setting? Can we set it over the available physical RAM size?

Similar Messages

Large File Upload ~50mb Fails using Firefox/Safari. Upload Limit is 1gig set at Web App. IIS timeout set at 120 seconds.

Strange issue. User can upload the file using IE9, but cannot do the same using Safari, Chrome, or FireFox. The library resides in a Site Collection that was migrated from a 2010 Site Collection. The timeout on IIS is 120 seconds.Very strange
indeed.
Haven't been able to trace the Correlation ID at this point.

try using rest api for this much file upload if you are using custom solution.
try below links for reference:
http://blogs.technet.com/b/praveenh/archive/2012/11/16/issues-with-uploading-large-documents-on-document-library-wss-3-0-amp-moss-2007.aspx
https://angler.wordpress.com/2012/03/21/increase-the-sharepoint-2010-upload-file-size-limit/
http://social.technet.microsoft.com/wiki/contents/articles/20299.sharepoint-2010-uploading-large-files-to-sharepoint.aspx
http://stackoverflow.com/questions/21873475/sharepoint-2013-large-file-upload-1gb
https://answers.uchicago.edu/page.php?id=24860
http://sharepoint.stackexchange.com/questions/91767/multiple-file-upload-not-working
Please mark it as answer if you find it useful happy sharepointing

Can't Upload Large Files (Upload Fails using Internet Explorer but works with Google Chrome)

I've been experience an issue uploading large (75MB & greater) PDF files to a SharePoint 2010 document library. Using normal upload procedures using Internet Explorer 7 (our company standard for the time being) the upload fails. No error message is thrown,
the upload screen goes away and the page refreshes and the document isn't there. I tried upload multiple and it says throws a failed error after a while.
Using google chrome I made an attempt just to see what it did and the file using the "Add a document" uploaded in seconds. Can't figure out why one browser worked and the other doesn't. We are getting sporadic inquiries with the same issue.
We have previously setup large file support in the appropriate areas and large files are uploaded to the sites successfully. Any thoughts?

File size upload has to be configured on the server farm level. Your administrator most likely set
up the limit to size of files that can be uploaded. This size can be increased and you would then be able to upload your documents.

File Upload issue in MVC

Hi,
For my MVC application, I have created a main controller.
On the DO_REQUEST of the main controller, I am setting the sub controllers, and directly calling that controller using create_controller, controller_set_active, and call_controller.
I included dispatch_input( ) in the Main controller's DO_REQUEST method.
Inside the DO_REQUEST of the sub controller, I am creating a view using create_view and call_view methods.
In this view, I have a <htmlb:tableView /> and a <htmlb:fileUpload />, with a button. The issue is that, when the button is clicked, in the DO_HANDLE_EVENT method of the sub-controller, I am not getting the File Data, or the table data.
For File upload, I use the following -
data lv_fupld_data TYPE REF TO cl_htmlb_fileupload.
lv_fupld_data ?= cl_htmlb_manager=>get_data(
                      request = runtime->server->request
                      name    = 'fileupload'
                      id      = 'fupld_1').
I have the <htmlb:form method       = "post"
                  encodingType = "multipart/form-data" > etc in the view.
When I call this sub-controller directly from the browser (after including the dispatch_input( ) part in DO_REQUEST), I do not get any issue. I am able to read the file data and upload the file.
Any Idea why this is happening?

Hi Rakesh,
I think I got your problem:
You only have the htmlb:form in your view of the subcontroller, and not in the main view.
Therefore the subcontroller works by itself, but not within the main controller.
If you are including subcontrollers, then make sure the form element is only present in the view of the main controller, wrapping around any subcontroller calls. And don't use the form tag anymore in the subcontrollers.
Just as you put dispatch_input() just in your top controller, also place htmlb:form only in your top view.
Regards,
Max

Very large file upload 2 GB with Adobe Flash

Hello, anyone know how can I upload very large files with Adobe Flash or how to use SWFUpload?
Thanks in Advance, All help will be very appreciated.

1. yes
2. I'm getting error message from php
if( $_FILES['Filedata']['error'] == 0 ){
if(move_uploaded_file( $_FILES['Filedata']['tmp_name'], $uploads_dir.$_FILES['Filedata']['name'] ) ){
echo 'ok';
exit();
echo 'error'; // Overhere
exit();

Help with Aperture/T2i/iMovie/large file ( 2GB) issue.

I am having an issue with a very large file (3.99 GB) that I shot with my Rebel T2i. The file imports fine into Aperture, but then it isn't recognized at all by iMovie. I found out that iMovie can only handle files that are 2 GB or smaller.
So now, I am trying to figure out how to chop my mega file neatly into a pair of 2GB halves. When I use the trim function, that does not seem to do the trick -- this may be a case of Aperture's non-destructive nature actually working against me.
Does anyone have a solution for this? My intuition suggests that this may be a job for QuickTime Pro -- but I wasn't sure how that works now that we all have QuickTime X.
Much appreciated.

The file may well be in the wrong format, can you tell us more about it. See This

Large file upload

Hi all,
Is there a way to upload a large file.
The problem:
1 file with fixed length records (59 bytes wide)
Over 17million lines available (actually a download from an extreme old system), making a total of almost 1Gb.
I have a database table that exactly machtes the record data.
So the question is: How to upload this amount of data. The normal upload functions do not apply because i run out of memory space (system I-MODE too large).
Regards,
Rob.

Hi Rob,
I'm not too sure if this solution will be acceptable in your case, but here's one way that I can think of -
You can FTP this file to the Application Server and then process this file through a simple ABAP program and update the file's data to the desired database table.
Regards,
Anand Mandalika.

Struts commons binary file upload issue

Hi,
I was wondering if someone could help me with uploading binary files using jakarta commons file upload. I've looked at several examples and forums and it seems to work but sometimes the binary files that I upload get corrupted. I have no idea why this might be happening. Here is a snippet of my code.
    UploadFileForm uploadFileForm = (UploadFileForm)form;
    FormFile file = uploadFileForm.getFile();
    String dirName = "/tmp/";
    InputStream inputStream = null;
    OutputStream bos = null;
    inputStream = file.getInputStream();
    bos = new FileOutputStream(dirName + file.getFileName());
    int bytesRead = 0;
    byte[] buffer = new byte[4096];
    while ((bytesRead = inputStream.read(buffer, 0, 4096)) != -1) {
        bos.write(buffer, 0, bytesRead);
    }            Am I doing something wrong?
Thanks.
PV

FormFile myFile    = myForm.getTheFile();
    byte[] fileData    = myFile.getFileData();
    BufferedReader in = null;
   try{
       in = new BufferedReader(new InputStreamReader(new   ByteArrayInputStream(fileData)));
       // in = new BufferedReader(new InputStreamReader(myFile.getInputStream()));
       String str;
        while ((str = in.readLine()) != null) {
                System.out.println(str);
   }catch(Exception exp){
       exp.printStackTrace();
    }finally{
         if(in != null){
            try{
               in.close();
            }catch(Exception ep){
                   ep.printStackTrace();
    } Hope this might help :)
and a small advice please do reactivate archived posts.It'd be lot better if you start with a new one.
Hope there are no hard and fast issues on this.
REGARDS,
RaHuL

Large file uploads with jersey client

Hello All,
I am getting heap spcace iissue while uploading large files via jersey client , the jvm will run out memory
Can any one help me in understanding how can i send large file about 300mb
via jersy client.
code that i have wriiten is:
WebResource webResource = client.resource(url);
MultiPart multiPart = new MultiPart();
FileDataBodyPart filePart = new FileDataBodyPart("file", file,
MediaType.APPLICATION_OCTET_STREAM_TYPE);
multiPart.bodyPart(filePart);
multiPart.bodyPart(new FormDataBodyPart("code", code));
ClientResponse response = webResource.type(MediaType.MULTIPART_FORM_DATA).post(ClientResponse.class,
multiPart);
Thanks

Thanks for ur reply but i have tried it by using
client.setChunkedEncodingSize(10000);
WebResource webResource = client.resource(url);
          // file to multi part Request
          MultiPart multiPart = new MultiPart();
          FileDataBodyPart filePart = new FileDataBodyPart("file", file,
                    MediaType.APPLICATION_OCTET_STREAM_TYPE);
          multiPart.bodyPart(filePart);
          multiPart.bodyPart(new FormDataBodyPart("code",code));
          ClientResponse response = null;
               response = webResource.type(MediaType.MULTIPART_FORM_DATA).post(ClientResponse.class,
                         multiPart);
Now the file are easily send in chunked but the problem is i am not able to receive value of code now..
On the other server where i am sending this file along code is:
public void upload(@RequestParam("file") MultipartFile uploadedFile,
               @RequestParam("code") String code,
               Writer responseWriter) throws IOException
}

Axis large file uploads

Hi,
I am running axis1.3 on websphere Z/OS and i am uploading large files. I a getting the following error when
error1:
1)i try to upload the files of size 30mb. Initially i tried to upload 30mb it got success
2) tried to upload again 30mb but this time the error occurs as below
Exception in thread "main" AxisFault
faultCode: {http://xml.apache.org/axis/}HTTP
faultSubcode:
faultString: (0)null
faultActor:
faultNode:
faultDetail:
{}:return code: 0
{http://xml.apache.org/axis/}HttpErrorCode:0
(0)null
at org.apache.axis.transport.http.HTTPSender.readFromSocket(HTTPSender.j
ava:744)
at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144)
at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrateg
y.java:32)
at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
at org.apache.axis.SimpleChain.invoke (SimpleChain.java:83)
at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165)
at org.apache.axis.client.Call.invokeEngine(Call.java:2784)
at org.apache.axis.client.Call.invoke(Call.java :2767)
at org.apache.axis.client.Call.invoke(Call.java:2443)
at org.apache.axis.client.Call.invoke(Call.java:2366)
at org.apache.axis.client.Call.invoke(Call.java:1812)
at gov.ssa.ere.client.EREWSSOAPStub.submitBulk (Unknown Source)
at gov.ssa.ere.client.StubClient.main(Unknown Source)
the same error occurs when i tried to upload more than 30mb ....
error2:
sometimes my request got into the server and the server even process my requests in the mean time my client got the error as below (i have used the client timeout also as 100000)
Exception in thread "main" AxisFault
faultCode: {http://xml.apache.org/axis/}HTTP
faultSubcode:
faultString: (0)null
faultActor:
faultNode:
faultDetail:
{}:return code: 0
{http://xml.apache.org/axis/}HttpErrorCode:0
(0)null
at org.apache.axis.transport.http.HTTPSender.readFromSocket(HTTPSender.j
ava:744)
at org.apache.axis.transport.http.HTTPSender.invoke(HTTPSender.java:144)
at org.apache.axis.strategies.InvocationStrategy.visit(InvocationStrateg
y.java:32)
at org.apache.axis.SimpleChain.doVisiting(SimpleChain.java:118)
at org.apache.axis.SimpleChain.invoke (SimpleChain.java:83)
at org.apache.axis.client.AxisClient.invoke(AxisClient.java:165)
at org.apache.axis.client.Call.invokeEngine(Call.java:2784)
at org.apache.axis.client.Call.invoke(Call.java :2767)
at org.apache.axis.client.Call.invoke(Call.java:2443)
at org.apache.axis.client.Call.invoke(Call.java:2366)
at org.apache.axis.client.Call.invoke(Call.java:1812)
at gov.ssa.ere.client.EREWSSOAPStub.submitBulk (Unknown Source)
at gov.ssa.ere.client.StubClient.main(Unknown Source)

I would imagine that this has to do with you reading the entire file into memory to send it via HTTP. This would be a limitation of the WebKit implentation that currently exists. I don't know if it has been fixed in the latest AIR 2.0 beta that just got pushed out onto Labs.
Ultimatly, you may want to take one of these OSS projects you found (the as3httpclientlib looks most promising), and compile a very small flash app that co-exists in your JS AIR app. You would be able to call it directly from JS, and use the functions that you expose just like the rest of the API's that exist in the AIR framework.

16.0.2 crashes with large file uploads

Hi, I have noticed that Firefox 16.0.2 crashes when I try uploading a large file (1.2GB) to a website.
The entire browser closes and I get a window offering to submit a report for me. Can anybody tell me what I need to change to stop this from happening please?
Thanks,
Paul

Be sure to rollback to 16.0.1; the initial v16 update had serious security flaw.

IPlanet 6.0 SP4 crashes for large file uploads

Environment:
iPlanet 6.0 SP4,iPlanet App Server 6.5, with maintenance update 3 installed running on the same machine on Solaris 8.0 (Sparc)
When I try to upload large file( > 10 MB) using HTTP POST MULTIPART/FORM-DATA the web server crashes with the following errors.
[18/Oct/2002:16:52:02] catastrophe ( 600): Server crash detected (signal SIGSEGV) [18/Oct/2002:16:52:02] info ( 600): Crash occurred in function memmove from module /export/home/iplanet/web60sp4/bin/https/lib/liblibdbm.so [18/Oct/2002:16:52:02] failure ( 376): Child process admin thread is shutting down [18/Oct/2002:16:52:05] warning ( 624): On group ls2_default, servername oberon does not match subject "192.168.0.35" of certificate Server-Cert. [18/Oct/2002:16:52:05] info ( 624): Installing a new configuration [18/Oct/2002:16:52:05] info ( 624): [LS ls1] http://oberon, port 80 ready to accept requests [18/Oct/2002:16:52:05] info ( 624): [LS ls2] https://oberon, port 443 ready to accept requests [18/Oct/2002:16:52:05] info ( 624): A new configuration was successfully installed [18/Oct/2002:16:52:05] info ( 624): log.cpp:openPluginLog() reports: Environment variable IAS_PLUGIN_LOG_FILE is not set. All plugin messages will be logged in the web server log file
[21/Oct/2002:10:40:02] catastrophe ( 1210): Server crash detected (signal SIGSEGV) [21/Oct/2002:10:40:02] info ( 1210): Crash occurred in NSAPI SAF gxrequest [21/Oct/2002:10:40:02] info ( 1210): Crash occurred in function __1cIGXBufferLAllocMemMap6ML_L_ from module /export/home/iplanet/app65mu3/ias/gxlib/libgxnsapi6.so [21/Oct/2002:10:40:02] failure ( 715): Child process admin thread is shutting down [21/Oct/2002:10:40:05] warning ( 1230): On group ls2_default, servername oberon does not match subject "192.168.0.35" of certificate Server-Cert. [21/Oct/2002:10:40:05] info ( 1230): Installing a new configuration [21/Oct/2002:10:40:05] info ( 1230): [LS ls1] http://oberon, port 80 ready to accept requests [21/Oct/2002:10:40:05] info ( 1230): [LS ls2] https://oberon, port 443 ready to accept requests [21/Oct/2002:10:40:05] info ( 1230): A new configuration was successfully installed
Do I need to set anything in the web server or app server? Any help is appreciated.

Be sure to rollback to 16.0.1; the initial v16 update had serious security flaw.

Tips or tools for handling very large file uploads and downloads?

I am working on a site that has a document repository feature. The documents are stored as BLOBs in an Oracle database and for reasonably sized files its not problem to stream the files out directly from the database. For file uploads, I am using the Struts module to get them on disk and am then putting the blob in the database.
We are now being asked to support very large files of 250MB+. I am concerned about problems I've heard of with HTTP not being reliable for files over 256MB. I'd also like a solution that would give the user a status bar and allow for restarts of broken uploads or downloads.
Does anyone know of an off-the-shelf module that might help in this regard? I suspect an ActiveX control or Applet on the client side would be necessary. Freeware or Commercial software would be ok.
Thanks in advance for any help/ideas.

Hi. There is nothing wrong with HTTP handling 250MB+ files (per se).
However, connections can get reset.
Consider offering the files via FTP. Most FTP clients are good about resuming transfers.
Or if you want to keep using HTTP, try supporting chunked encoding. Then a user can use something like 'GetRight' to auto resume HTTP downloads.
Hope that helps,
Peter
http://rimuhosting.com - JBoss EJB/JSP hosting specialists

File Upload issues

There is a file upload that I have and I am getting an
error...
Notice: Undefined variable: file_list in
C:\vhosts\mysite\upload\index.php on line 20
On line 20 in my php page happens to be the following code
that is giving an error...$file_list .= "<option value=\"$file\"
>$file</option>";
<?php
#for windows...
$dirname = $_SERVER['DOCUMENT_ROOT'].'/_assets/professor/';
//$dirname = "C:\\wamp\\www";
#(for Linux... $dirname = "user/local/apache/bin";)
$dir = opendir($dirname);
while(false != ($file = readdir($dir))){
if(($file != ".") and ($file != "..")){
$file_list .= "<option value=\"$file\"
>$file</option>";
closedir($dir);
?>
This is what is in the body...
<form enctype="multipart/form-data" action="uploaded.php"
method="POST">
<fieldset><legend>Upload Professor
Image</legend>



Send this file: <input name="userfile" type="file" />
<div align="center"><input type="submit"
value="Send File" /></div>
</fieldset>
</form>
<br>
<br>
<form action="delete.php" method="post">
<fieldset><legend>Delete Professor
Image</legend>
<select name="deleteFile">
<?php echo($file_list); ?>
</select>
<div align="center"><input type="submit" name="go"
value="Delete File"></div>
</fieldset>

AdonaiEchad wrote:
> There is a file upload that I have and I am getting an
error...
> Notice: Undefined variable: file_list in
C:\vhosts\mysite\upload\index.php on
> line 20
> On line 20 in my php page happens to be the following
code that is giving an
> error...$file_list .= "<option value=\"$file\"
>$file</option>";
What that's telling you is that you're adding a value to a
variable that
doesn't yet exist. In your case, it probably doesn't matter,
but using
undefined variables is a potential security risk. To
eliminate the
warning - and the risk - declare $file_list before using it:
$file_list = '';
David Powers, Adobe Community Expert
Author, "The Essential Guide to Dreamweaver CS3" (friends of
ED)
Author, "PHP Solutions" (friends of ED)
http://foundationphp.com/

Large file download issue

When we are downloading a large file 100MB + with Internet Explorer the
workstation will at some point report that the connection was reset by the
server and we lose the download. This is kind of random and I've only seen
it in IE. I have and use Firefox at my desk and I have no trouble like
this. But our campus standard is IE and I really would like to pin this down.
My fear is the Packet filters. I went and looked at the packet filters we
have set up and was shocked to see we had 77 filter exceptions. My last
look only showed 45 so I need to sit down and review every filter exception
and thin the heard. Anyway, below are the exception for http which is what
I believe IE uses in downloading files. Right? and wanted a second option
from you guys.
We have NW 6.5 sp 5 BM 3.8 sp 4 ir3 and I use Craigs tuneup and proxycfg.
the packet typ HTTP is defines as:
Protocol TCP
SRC Port ALL
DEST Port 80
ACK bit Filtering disabled
Stateful Filtering enabled
The filter exception are:
#15
Packet Type: HTTP
Source: B57_1_EII
All Circuits
Any Address
Destination: B57_2_EII
All Circuits
66.89.73.96/255.255.255.224
Comment:
#22
Packet Type: HTTP
Source: <All Interfaces>
All Circuits
Any Address
Destination: CE1000_1
All Circuits
Any Address
Comment:
#24
Packet Type: HTTP
Source: B57_2_EII
All Circuits
Any Address
Destination: <All Interfaces>
All Circuits
Any Address
Comment: Added by BRDCFG to allow HTTP proxy.
#67
Packet Type: HTTP
Source: B57_2_EII
All Circuits
12.22.25.0/255.255.255.240
Destination: <All Interfaces>
All Circuits
192.168.3.7
Comment: Inbound http for powerschool
#75
Packet Type: HTTP
Source: B57_1_EII
All Circuits
192.168.3.6
Destination: <All Interfaces>
All Circuits
Any Address
Comment:
Thanks
David

When I looked at the version level of Proxy.cfg I use that you wrote it was
version 21, I did download the current version. Would the differences
between the versions cause any of the behavior I've seen. I didn't see much
in there that looked too different.
Other Comments inside the threaded message:
> On your stateful HTTP exceptions, you are:
> #15 Allowing all HTTP to network 66.89.73.96/255.255.255.224
To allow private LAN access to the Public IP subnet range to allow
management of Routers etc. that are outside of this firewall.
> #22 Allowing all HTTP to cross interface CE1000_1 - if this is the public
> interface, you are allowing all outbound HTTP without using a proxy. If
> this is the private interface, you are allowing all inbound HTTP through
> any static NAT connection.
CE1000_1 is the interface that is connected to our DMZ. We host 3 webserver
in the DMZ for public access. One is our Groupwise Webaccess.
> #24 Allowing all HTTP as long as it originates from the B57_2 interface.
> If the public IP address were also specified, it would be one of the
> default exceptions intended to allow proxy to send HTTP requests out from
> the server to the Internet. Because source/destination IP address is
> missing, it effectively allows traffic into the B57_2 interface as well,
> assuming the B57_2 interface is public.
#24 here is the default added by BM. I don't think I ever touched this one.
This is a set of filters that were imported from our earlier BM versions
when we built this box. Sounds like it should have the Public IP address
listed as the source IP. Would you suggest adding that in?
> #67 Assuming B57_2 is public, you are allowing HTTP traffic to come from
> a specific network, into a host at 192.168.3.7, via static NAT.
Correct. We have a turn key box with a windows application that is managed
by the vendor via HTTP and that is their IP range and the target IP is
192.168.3.7 and it hold a static NAT in the 66.89.73 range on the BM Server.
> #75 Hard for me to tell what this is doing, as it appears the B57
> interface is your public interface. It will allow any HTTP from IP
> address 192.168.3.6 to anywhere, but only if that address is on the B57
> side of the server, which sounds incorrect. I'm guessing that the
> 192.168.3.x network is on the CE1000 side of the server, in which case
> this is a useless filter exception.
The Interface is B57_1_EII and this is the Private LAN interface. The
intent is to allow the SPAM filter box http access to the internet without
requiring a proxy. The box is unable to accept a proxy setting and the way
it gets it's updates from the vendor is via HTTP.
Thanks
David

CF8.01 Large Files Upload issue

Similar Messages

Maybe you are looking for