Handling a very larger file from Sender system

Hi Sdn,
Can you please tell me, what should be done from an SAP+XI side to handle a very large file coming from the sender system to be posted to the receiver? What should be done in XI end so that there is no problem in handling the larger file.
Thanks and regards,
Aniruddha Bhattacharya

Hi Aniruddha,
Go to below link and check point number 3.1.1 maintain parameters as mentioned in that point.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/70ada5ef-0201-0010-1f8b-c935e444b0ad

Similar Messages

Very odd and very large file found in system library: maremoted

Hello,
Using a single 1.25 G4 with 10.3.9. It's been acting up and running out of space.
We located a file called maremoted, (which we're guessing is some kind of Remote Daemon), fil, which is upwards of 30 GB. It's run by the root user and trying to trash it causes a Kernel Panic. We took out the drive and sey it as a slave to mine and I deleted it.
The machine started up fine, but it's come back and growing. It's currently 1 GB.
Anyone have any idea what this thing is and how to get rid of it?
Thank you for any suggestions.
-Vincent

This is a daemon that is running as part of the Track-It! auditing software by Numara. I have it crashing on several Macs and respawning with a new PID which makes it impossible to kill the process. The only file that I have found growing in size is the log file found in /Library/Logs/Track-It!/Mac Audit. Both the maremoted.log and the maauditord.log are growing in size from the crashdumps. Possibly due to the server and the clients being out of sync version wise?
The symptom is as you describe; sluggishness and unresponsiveness while performing various tasks such as Application switching, network file transfer, and typing.
Placed a call into Numara and the two Mac experts are not in to assist. Will be calling first thing tomorrow.

Tips or tools for handling very large file uploads and downloads?

I am working on a site that has a document repository feature. The documents are stored as BLOBs in an Oracle database and for reasonably sized files its not problem to stream the files out directly from the database. For file uploads, I am using the Struts module to get them on disk and am then putting the blob in the database.
We are now being asked to support very large files of 250MB+. I am concerned about problems I've heard of with HTTP not being reliable for files over 256MB. I'd also like a solution that would give the user a status bar and allow for restarts of broken uploads or downloads.
Does anyone know of an off-the-shelf module that might help in this regard? I suspect an ActiveX control or Applet on the client side would be necessary. Freeware or Commercial software would be ok.
Thanks in advance for any help/ideas.

Hi. There is nothing wrong with HTTP handling 250MB+ files (per se).
However, connections can get reset.
Consider offering the files via FTP. Most FTP clients are good about resuming transfers.
Or if you want to keep using HTTP, try supporting chunked encoding. Then a user can use something like 'GetRight' to auto resume HTTP downloads.
Hope that helps,
Peter
http://rimuhosting.com - JBoss EJB/JSP hosting specialists

Upload very large file to SharePoint Online

Hi,
I tried uploading very large files to SharePoint online via the REST API using JAVA. Uploading files with a size of ~160 mb works well, but if the filesize is between 400mb and 1,6 gb I either receive a Socket Exception (Connection reset by peer) or an error
of SharePoint telling me "the security validation for the page is invalid".
So first of all I want to ask you, how to work around the security validation error. As far as I understand the token, which I have added to my X-RequestDigest header of the http post request seems to be expired (by default it expires after 1800 seconds).
Uploading such large files is time consuming, so I can't change the token in my header while uploading the file. How can I extend the expiration time of the token (if it is possible)? Could it help to send post requests with the same token
continuously while uploading the file and therefore prevent the token from expiration? Is there any other strategy to upload such large files which need much more than 1800 seconds for upload?
Additionally any thoughts on the socket exception? It happens quite sporadically. So sometimes it happens after uploading 100 mb, and the other time I have already uploaded 1 gb.
Thanks in advance!

Hi,
Thanks for the reply, the reason I'm looking into this is so users can migrate there files to SharePoint online/Office 365. The max file limit is 2gb, so thought I would try and cover this.
I've looked into that link before, and when I try and use those end points ie StartUpload I get the following response
{"error":{"code":"-1, System.NotImplementedException","message":{"lang":"en-US","value":"The
method or operation is not implemented."}}}
I can only presume is that these endpoints have not been implemented yet, even though the documentation says they only available for Office 365 which is what I am using.
Also, the other strange thing is that I can actually upload a file of 512mb to the server as I can see it in the web UI. The problem I am experiencing is get a response, it hangs on this line until the TimeOut is reached.
WebResponse wresp = wreq.GetResponse();
I've tried flushing and closing the stream, sendchunked but still no success

Clients Time-Out When Retrieving Large Files From Our PureFTPd Server

Hi, not sure if this is the right place to get help, but didn't know where else to look. And let me begin by saying I'm not a server admin by trade, but that is the role I've fell into at a design firm. So please bear with my lack of knowledge on some of the more technical details.
We have OS X Server 10.4.11 running here with PureFTPd installed and managed through PureFTPd Manager application. It has been fairly reliable for us for the last 2-3 years once the initial setup craziness was complete.
But lately we've had 2 clients say that they've had difficulty downloading larger files from us. They get a time-out or error message on their end. They are most likely using Windows Explorer on a PC to do the transfer, which has always been the easiest method for our clients.
One client had no problem getting files up to 14MB or so. But when trying to download a certain file that was about 80MB, it would not work. I tried different things here, and she tried multiple times, but no luck. I tried zipping the file to see if that would help, but no luck.
Then another client had a similar problem today with a file that was only 25MB.
We don't send large files very often, so I'm not sure if this is a recent thing or not. It seems like we've received some large files recently though.
In PureFTPd manager, I usually leave all of the fields in the Transfers tab empty for all users. I didn't see anywhere else that would seem to impart a file-size limitation.
• Any ideas at all?
• If not, any other forums that I could search for help on? It looks like the developers site for PureFTPd Manager hasn't been updated in a year or two.
Thanks in advance!

Some years back I had trouble at a customer that had a ADSL using PPPoE connection to their ISP.
Their router/modem (Speedtouch) couldn't cope with the LAN MTU when they sent files out so I had to lower it on their computers (running Panther?) ethernet interface from 1500 to 1492 (PPPoE overhead was 8 byte). The communication used to stall at about 25MB but the MTU change helped resolving that.
My guess is that the router had to fragment (split in two) all outgoing packets it recived from the LAN computers and it just couldn't cope after a while.
In your case it can be other network related things too like maybe needing traffic prioritizing, if receiving a lot of traffic from Internet and trying to send at the same time.

Re: Transfer Large Files between SAP Systems

Dear All.
Please can someone advice a quick way of transferring large files from one sap system to the other. Can we use ALE? Can Ale handle large files? If there are others ways please advice at your earliest. thx alot

yes ,you can use ALE between two SAP R/3 system..
it is efficient way to transfer from One SAP R/3 to Other SAP R/3

Very large file upload 2 GB with Adobe Flash

Hello, anyone know how can I upload very large files with Adobe Flash or how to use SWFUpload?
Thanks in Advance, All help will be very appreciated.

1. yes
2. I'm getting error message from php
if( $_FILES['Filedata']['error'] == 0 ){
if(move_uploaded_file( $_FILES['Filedata']['tmp_name'], $uploads_dir.$_FILES['Filedata']['name'] ) ){
echo 'ok';
exit();
echo 'error'; // Overhere
exit();

Unable to copy very large file to eSATA external HDD

I am trying to copy a VMWare Fusion virtual machine, 57 GB, from my Macbook Pro's laptop hard drive to an external, eSATA hard drive, which is attached through an ExpressPort adapter. VMWare Fusion is not running and the external drive has lots of room. The disk utility finds no problems with either drive. I have excluded both the external disk and the folder on my laptop hard drive that contains my virtual machine from my Time Machihne backups. At about the 42 GB mark, an error message appears:
The Finder cannot complete the operation because some data in "Windows1-Snapshot6.vmem" could not be read or written. (Error code -36)
After I press OK to remove the dialog, the copy does not continue, and I cannot cancel the copy. I have to force-quit the Finder to make the copy dialog go away before I can attempt the copy again. I've tried rebooting between attempts, still no luck. I have tried a total of 4 times now, exact same result at the exact same place, 42 GB / 57 GB.
Any ideas?

Still no breakthrough from Apple. They're telling me to terminate the VMWare processes before attempting the copy, but had they actually read my description of the problem first, they would have known that I already tried this. Hopefully they'll continue to investigate.
From a correspondence with Tim, a support representative at Apple:
Hi Tim,
Thank you for getting back to me, I got your message. Although it is true that at the time I ran the Capture Data program there were some VMWare-related processes running (PID's 105, 106, 107 and 108), this was not the case when the issue occurred earlier. After initially experiencing the problem, this possibility had occurred to me so I took the time to terminate all VMWare processes using the activity monitor before again attempting to copy the files, including the processes mentioned by your engineering department. I documented this in my posting to apple's forum as follows: (quote is from my post of Feb 19, 2008, 1:28pm, to the thread "Unable to copy very large file to eSATA external HDD", relevant section in >bold print<)
Thanks for the suggestions. I have since tried this operation with 3 different drives through two different interface types. Two of the drives are identical - 3.5" 7200 RPM 1TB Western Digital WD10EACS (WD Caviar SE16) in external hard drive enclosures, and the other is a smaller USB2 100GB Western Digital WD1200U0170-001 external drive. I tried the two 1TB drives through eSATA - ExpressPort and also over USB2. I have tried the 100GB drive only over USB2 since that is the only interface on the drive. In all cases the result is the same. All 3 drives are formatted Mac OS Extended (Journaled).
I know the files work on my laptop's hard drive. They are a VMWare virtual machine that works just fine when I use it every day. >Before attempting the copy, I shut down VMWare and terminated all VMWare processes using the Activity Monitor for good measure.< I have tried the copy operation both through the finder and through the Unix command prompt using the drive's mount point of /Volumes/jfinney-ext-3.
Any more ideas?
Furthermore, to prove that there were no file locks present on the affected files, I moved them to a different location on my laptop's HDD and renamed them, which would not have been possible if there had been interference from vmware-related processes. So, that's not it.
Your suggested workaround, to compress the files before copying them to the external drive, may serve as a temporary workaround but it is not a solution. This VM will grow over time to the point where even the compressed version is larger than the 42GB maximum, and compressing and uncompressing the files will take me a lot of time for files of this size. Could you please continue to pursue this issue and identify the underlying cause?
Thank you,
- Jeremy

How do I control read start position in a very large file where start byte position may be larger than I32 (+/- 2^31)?

Using LabView, I am trying to read a very large file which may be on the order of 2^32 bytes. I need to be able to step into the file at a byte position which may be greater than the I32 limit set by the read file.vi. Are there any options to the read file.vi or a method of circumventing this limitation?

I'm not sure but i think that you can manage the "pos mode" in the "seek" sub-vi.
The "pos mode" let you choose the initial position to add the numbers of bytes you want to move.
I think that you can add a i32 number from the "initial" in the "pos mode" an latter use the "pos mode" in "current" to add another value. Then the next time you can move more than 2^31 bytes to the initial position.
I hope you understand my idea, i wasn't try it before, but i think that would work.

Exporting to iTunes results in a very large file

I have been making music on Garageband and when I export it to itunes, it becomes a very large file. This makes disables me from being able to post my music on my website or email it. What can I do to make the file smaller?
imac G5 Mac OS X (10.4.5) 1.9 GHz PowerPC G5

You should convert your file to an MP3 in iTunes:
- Make sure that in the import options of iTunes, MP3 is selected.
- Mark your song in iTunes and select "convert to MP3" in the menu.
- This creates a new file in iTunes with the same title. If you don't know which is which, apple-I will tell you if it's an AIFF or an MP3, and the file size.

How do share a very large file?

How do share a very large file?

Do you want to send a GarageBand project or the bounced audio file? To send an audio file is not critical, but if you want to send the project use "File > Compress" to create a .zip file of the project before you send it.
If you have a Dropbox account, I'd simply copy the file into the Dropbox "public" folder and mail the link. Right-click the file in the Dropbox, then choose Dropbox > Copy Public Link. This copies an Internet link to your file that you can paste anywhere: emails, instant messages, blogs, etc.
2 GB on Dropbox are free. https://www.dropbox.com/help/category/Sharing

Sorting very large file

Hi,
I've a very large file (1.3G, more than 10 million records) that I need to sort, what is the best possible way to do that, without using a database?
Thanks,
Gary

Just a suggestion:
If you create a sorted red/black tree of record numbers (i.e. offsets in the data file), you could get an equivalent sort as follows (probably without a huge amount of memory...):
Here's the strategy:
Create a comparitor that compares two Long objects. It performs a seek in the data file and retrieves the records pointed to by those two Longs and compares them using whatever record comparitor you were going to use.
Create a sorted list based on that comparitor (a tree based list will probably be best)
Run a for loop going from 0 to the total records in the data file, create Long objects for each value, and insert that value into the list.
When you are done, the list will contain the record numbers in sorted order.
Create an iterator for the list
For each element in the list, grab the corresponding data file record from the source file and write it to the destination file.
voila
Some optimizations may be possible (and highly desirable, actually):
When you read records from the file, place them into an intermediate cache (linked list?) of limited length (say 1000 records). When a record is requested, scan the cache for that record ID - if found, move it to the top of the list, then return the associated data. If it is not found, read from the file, then add to the top of the list. If the list has more than X records, remove the last item from the list.
The upper pieces of the sort tree are going to get hammered, so having a cache like this is a good idea.
Another possibility: Instead of inserting the records in order (i.e. 0 through X), it may be desirable to insert them in pseudo-random order - I seem to remember that there was a really nice algorithm for doing this (without repeating any records) in an issue of Dr. Dobbs from awhile back. You need to get a string of random numbers between 0 and X without repeats (like dealing from a card deck).
If your data is already in relatively sorted order, the cache idea will not provide significant bennefit without randomizing the inputs.
One final note: Try the algorithm without the cache first and see how bad it is. The OSes disk caching may provide sufficient performance. If you encapsulate the data file (i.e. an object that has a getRecordBytes(int recNumber) method), then it will be easy to implement the cache later if it is needed.
I hope this provides some food for thought!
- K

Very large files checkin to DMS/content server

Dear experts,
We have DMS with content server up and running.
However, there is a problem with very large files (up to 2GB!) - these files cannot be checked in due to extremely long upload times and maybe GUI limitations.
Does anyone have suggestions how we could get very large files into the content server ? I only want to check them in (either via DMS or directly to the content server) and then get the URL back.
best regards,
Johannes

Hi Johannes,
unfortunatly there is a limit for files regarding the Content Server which is about 2GB. Please note that such large files will cause very long upload times. If possible I would recommend you to split the files to smaller parts and try to check it in.
From my point of view it is not recommended to put files directly on the Content Server, because this could lead to inconsistencies on the Content Server.
Best regards,
Christoph

Having a prob importing a large file from a sony DR 60 external drive via log a transfer in FCP this is the first time this has happened have the sony plug. HDisc compatibility is sorted as the first 2 short clips are imported. Any advice will be welcome

problem importing a large file from a Sony DR60 external drive to FCP. Never had a problem before first two shot clips are captured in log and transfer but the larger 2 hour clip only downloads the first few seconds. Any advice?

I can think of 2 things to check.
1. The Scratch disc has plenty of space.
2. System Settings>Scratch Disc does not have a restriction in the Limit Capture/Export File Size Segment To:
Al

Delete a .csv file from desktop system

Hi All,
My requirement is to read the .csv file from the desktop system having the shared folder and delete the file after read successfully.
Here I can read the .csv file from the location using the function RFC_REMOTE_FILE and updated the content into internal table.
But I cant delete the file from the presentation server ( Desktop system).
Can anyone tell me how to delete the .csv file from the desktop system on different location.
Note:
I followed this link to read file:
http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/9831750a-0801-0010-1d9e-f8c64efb2bd2&overridelayout=true

Hi Rob,
Thanks. I solved this problem myself.
The solution to delete the file from remote system is
concatenate 'DEL' i_filename i_dirname into v_bkfile separated by space .
call function 'RFC_REMOTE_EXEC'
destination c_dest
exporting
    command               = v_bkfile
exceptions
    system_failure        = 1 MESSAGE v_ermsg
    communication_failure = 2 MESSAGE v_ermsg.

Handling a very larger file from Sender system

Similar Messages

Maybe you are looking for