Splitting large video files into small chunks and combining them

Hi All,
Thank you for viewing my thread. I have searched for hours but cannot find any information on this topic.
I need to upload very large video files. The files can be something like 10GB in size, currently .mpeg format but they may be .mp4 format later on too.
Since the files will be uploaded remotely using using internet from the clients mobile device (3G or 4G in UK) I need to split the files into smaller chunks. This way if there is a connection issue (very likely as the files are large) I can resume the upload without doing the whole 10gb again.
My question is, what can I use to split a large file like 10Gb into smaller chunks like 200mb, upload the files and then combine them again? Is there a jar file that I can use. i cant install stuff like ffmpeg or JMF on the clients laptops.
Thank you for your time.
Kind regards,
Imran

There is a Unix command called split that does just that splits a file into chunks of a size you specify. When you want to put the bits bact together you use the command cat.
If you are comfortable in the terminal you can look at the man page for split for more information.
Both commands are data blind and work on binary as well as text files so I would think this should work for video but of course check it out to see if the restored file still works as video.
regards

Similar Messages

Splitting a large video file into smaller segments/clips using FCE

Is there a way to split a large FCE / iMovie Captured event into smaller segments/clips.
Am attempting to convert my home videos ( Analog: 8mm) into iMovie clips.
Used a ADS Pyro that converts my composite signal ( RCA: Yellow+Red/White) to a digital signal via Firewire using the iMovie capture. However, this creates a single 2 hour file that takes approx 26Gb because there is now DV information.
I would like to (a) Break this into smaller segments/clips then (b) Change the date on these.

afernandes wrote:
Thanks Michel,
I will try this out.
Do you know if this will create a new file(s) ?
http://discussions.apple.com/thread.jspa?threadID=2460925&tstart=0
What I want to do is to break up my 2 hours video into smaller chunks then burn the good chunks as raw footage ( AVI/MOV) onto backup data DVDs. Then export all the chunks into compresssed files (MPEG-4?) and save these on another data DVD.
Avoid to compress. Save as quicktime movie.
Michel Boissonneault

How to split large video files into multiple individual clips by date

Hello. I'm looking for a freeware/shareware program (if one exists, or willing to pay for one if it does this well) that will:
1) Analyze a large AVI file identifying the start/start points of each segment of video and the dates the video segments were shot.
2) Then allow me to organize (for example, join 2 or more segments together if it's a video with a lot of start/stop points during the same shot) the segments identified in step 1 into logical clips that could be split apart from the 1 large AVI file.
3) Lastly, it would split my one large AVI file into the multiple clips or files that I identified in step 2.
A piece of software called FootTrack does a great job analyzing AVI files as I describe in steps 1 & 2, but it doesn't allow you to split or export the one avi file into multiple avi files.
I really don't want to have to do this one clip at a time, I've got to believe there's a program out there that will automate this process for me.
Thanks

I don't know of a way to automate it. I just did about 15 years worth. It wasn't too hard. I use an application called mpegstreamclip. Its very easy and free to download either from the apple site or direct from its site.
http://www.squared5.com/
Bascically you set the in and out points with the i and o keys and export.

How to cut up a large video file into smaller files?

I have a 30 minute video file I recorded on my camera. I need to make it into 6 smaller video so I can work on them separately instead of importing such a large file in final cut. Is there a way I can do this with Final Cut Pro?
Thanks in advanced!

No. FCP is a non-destructive editor. Once you ingest a clip it stays there on your drive unchanged until you delete it. FCP is really a dataaaaabase with instructions for playing back clips in order, applying filters, audio adjustments etc. If you want separate clips you have two options: either log and capture in chunks, or set markers on the clip and export smaller pieces, then re-import them.
But I guess the question in my mind is, if it's already captured, why bother? you'll do your editing of the segments and export the finished pieces anyway...

Big files into smaller chunks to process them til EOF

Hello,
I have a file that is about 10,000 (+ or - 500) which I want to process them by about 2500 lines at a time. I am reading each line by line and stroing them in object to update the database. The reason I am doing this is beacuse I get aan OutOfMemoryError Does anyone have ideas?? if you do can you kinda give me an idea how i can write it since i am new to the java.
Thanks
Here are the basic concept of the code that i am using
while ( line != null )<--will access each line of the file
processLines();<- process the files accordingly

The answer to your question
try {
String line = "";
BufferedReader in = new BufferedReader(new FileReader("filename"));
while (line != null) {
    for (int i = 0;i < 2500 && line != null;i++)
      parseLine(line);
      line = in.readLine();
    doDatabaseStuff()
} catch (Exception e) {
e.printStackTrace();
}Although it answers your question, it does not solve the real problem, which is why are you getting an out of memory exception. Unless you working on a machine with 8MB RAMM, I don't see how reading in a 10,000 line file will cause this. Java will try to use 64MB at most of RAMM, unless you specify more. I think the real issue has to do with what you are doing with the Strings once they are read in.

What is the best program for splitting large video files (for archiving)?

I have just finished a project and I want to back up everything to DVD-R discs, including all my capture files and completed movies exported from Final Cut. Some of the files are 5 or 6 Gb, too large for one DVD-R disc.
I tried downloading a program called MacHacha, and did a test on one file, splitting it into 3 segments and then joining it back together with the same program. The resulting file should have been a duplicate of the original, but it was not. It was not even recognized by QuickTime Player as a .mov file.
What program do you use for this purpose? What program is reliable for this and produces a joined file that is identical to the original?
Thank you for your reply.

Thank you for your help and suggestions. I tried a couple of experiments with a video file that has chapter markers. This was created in FCE using the "Export - QuickTime Movie" command.
One experiment was to bring the file into a new, blank sequence in FCE. Then export it right back out as a QuickTime movie. The resulting movie appears to be identical to the original, except that there are no chapter markers any more.
The second experiment was to make a duplicate of the original sequence which I used to make the movie in the first place. In this duplicate, I deleted everything except the chapter markers. I then brought in the video file into that sequence and exported it. The resulting file appears to be identical, and this one does have the chapter markers.
The only problem with doing it that way is that I lose all my edits. What if I wanted to edit something or adjust one of my original edits? I can't go back to that stage, with all my original edits, if I don't have all the original source files.
In addition, it's not clear to me exactly how I would use FCE as the "splitting program." How do you split a sequence into smaller parts?
All I really want to do is take a "snapshot" of the entire project, including all the source files, capture scratch files, etc. I don't need to back up the render files because those can easily be re-rendered. The entire project is taking up about 72 Gb on my hard drive, and I want to offload the whole thing. Even if it takes me 20 DVD-R discs to do it, that's no problem. Someone must have come up with a program or solution to do this.
Thanks!

Split a ZIP File in smaller Chunks / payloads on ECC 6.0 (NOT PI)

I call a external web service directly from ECC6.0. In one of the proxy class's methods I need to send a zip file. I can generate ZIP file using SAP supplied class. The file size of this zip file 150 MB and I want to break this file in smaller chunks say 2 MB chunks. Is there a FM / Class / some way to break this file into smaller chunks?
Appreciate your inputs
Thanks,
Vikram

Hi Vikram,
You can use the FM DX_SPLIT_FILE to split the zip file.
Regards,
Ashvin

How can I split a pdf file into smaller files using Acrobat XI

How can I split a pdf file into smaller files using Acrobat XI?

Hi laforcej
Open the PDF In Acrobat ...
Go to Tools -> Pages -> Extract
Now Select the Page Number you Want to Extract and Save them

I have a mac ox 10.5.8 and I'm trying to download a downloader that converts video files into mp3 but none of them wont open. Can anyone help?

I have a mac ox 10.5.8 and I'm trying to download a downloader that converts video files into mp3 but none of them wont open. Can anyone help?

http://software-download.name/video-to-mp3-converter-osx/
http://www.macworld.com/article/1161412/how_to_convert_audio_and_video_files_for _free.html
http://www.applemacvideo.com/howtoconvert/flvmac/flv-to-mp3-mac.html
http://www.iskysoft.com/convert-audio/convert-mpeg1-to-mp3-mac.html
Not sure if any are PPC, oR 10.5.8 compliant, still, if you give a link to one you're trying, it may be helpful.

Break large TDMS file into small files

hello all
My TDMS file is around 3g, and needs changed into around 10M size files.
I ran McRorie's splitFiles.vi ‏15 KB in this page. and set the number of samples per file as 5000000, however, I cannot get the results I need. every small file is only 1KB, and no data inside. What is the possible problem in this?
Also, I tried to write a vi based on sample vi(Read TDMS File) by adding one "write to measurement file.vi". However, when I set the small file size as 10M Byte inside the"write to measurement file.vi", the first file could be around 20M, and the next few files may be correct as 10M, and then it just stop splitting, edding with a file even much larger than original file. I uploaded my vi here, maybe someone can help to find some mistake for me.
Thanks very much!
Wuwei Mao
Solved!
Go to Solution.
Attachments:
Read TDMS File.vi ‏54 KB

Hi Wuwei,
After giving the correct data type to TDMS Read node in splitFiles.vi, it works as expected. ( See the attached two VIs: createFile.vi and the modified splitFiles.vi)
Because I don't know how you created your TDMS file, I write a new 3G bytes TDMS file, which has one group and one channel. The data type of samples is unsigned 16-bit Integer. The total number of samples is 1610612736. Then I set the number of samples per file to 5000000 as you did. So after splitting, each file size is 5000000*(16/8) bytes (around 10M bytes).
Please make sure the followed steps have been done before you run the splitFiles.vi:
1. The TDMS file will be split has been put on the proper path;
2. The correct group and channel names have been given;
3. The correct data type to TDMS Read node has been given.
Because your second option using "write to measurement file.vi" to split TDMS file will lose some information, such as group and channel names. So I suggest using the method used by splitFiles.vi to accomplish your goal.
Jie Zheng
NI R&D

Splitting Large Video Files

I have just finished crafting my sisters wedding video and the resultant M2T file generated by PE9 is 10GB - and looks great on the computer. However,the file size has presented a problem, how on earth do I get it onto a PS3? For my home PS3, I can transfer it over wireless. But my plan to ship it on a USB stick for my sister to put in her PS3 has come undone thanks to the FAT file size limitations.
So apart from reducing the video quality or buying a bluray burner (neither option attractive), how can I do it? If I could split it the file up into smaller parts I could create a playlist on the PS3 to join the parts together but I'm not exactly keen on rendering lots of small parts with PE9. I guess I'm looking for some 3rd party tool to split the M2t file?
Any ideas?

The splitting will certainly work, with a bit of effort and downloading two copies (one for you and one for her) of the free utility - great utility, BTW.
You could also pick up an external with USB connections, Convert it to NTSF, and then the file size limitation goes away. Now, whether a PS3 will read NTSF is beyond my knowledge. Also, I do not know if a memory stick can be Converted. Just in case, this ARTICLE will give you tips.
Were it me, I'd opt for the BD burner route, but even with the prices falling, I understand why one might not run that out instantly.
Good luck,
Hunt

Loading large text files into java vectors and outof memmory

Hi there,
need your help for the following:
i'm trying to load large ammoubnts of data into a Vector in order to concatenate several text files and treat them, but i'm getting outofmemory error. I even tried using xml structure and saving to database but the error is still the same. Can you help?
thanks
here's the code:
public void Concatenate() {
try {
//for(int i=0;i<1;i++) {
vEntries = new Vector();
for(int i=0;i<BopFiles.length;i++) {
MainPanel.WriteLog("reading file " + BopFiles[i] + "...");
FileInputStream fis = new FileInputStream(BopFiles);
BufferedInputStream bis = new BufferedInputStream(fis);
DataInputStream in = new DataInputStream(bis);
String line = in.readLine();
Database db = new Database();
Connection conn = db.open();
while(line != null) {
DivideLine(BopFiles[i], line);
line = in.readLine();
FreeMemory(db, conn);
MainPanel.WriteLog("Num of elements: " + root.getChildNodes().getLength());
MainPanel.WriteLog("Done!");
} catch (Exception e) {
e.printStackTrace();
public void DivideLine(String file, String line) {
     if (line.toLowerCase().startsWith("00694")) {
          Header hd = new Header();
          hd.headerFile = file;
          hd.headerLine = line;
          vHeaders.add(hd);
     } else if (line.toLowerCase().startsWith("10694")) {
          Line entry = new Line();
          Vector vString = new Vector();
          Vector vType = new Vector();
          Vector vValue = new Vector();
          entry.name = line.substring(45, 150).trim();
          entry.number = line.substring(30, 45).trim();
          entry.nif = line.substring(213, 222).trim();
          entry.index=BopIndex;
          entry.message=line;
          entry.file=file;
          String series = line.substring(252);
          StringTokenizer st = new StringTokenizer(series, "A");
          while (st.hasMoreTokens()) {
               String token=st.nextToken();
               if(!token.startsWith(" ")) {
                    vString.add(token);
                    vType.add(token.substring(2,4));
                    vValue.add(token.substring(4));
               token=null;
          entry.strings= new String[vString.size()];
          vString.copyInto(entry.strings);
          entry.types= new String[vType.size()];
          vType.copyInto(entry.types);
          entry.values= new String[vType.size()];
          vValue.copyInto(entry.values);
          vEntries.add(entry);
          entry=null;
          vString=null;
          vType=null;
          vValue=null;
          st=null;
          series=null;
          line=null;
          file=null;
          MainPanel.SetCount(BopIndex);
          BopIndex ++;
public void FreeMemory(Database db, Connection conn) {
try {
//db.update("CREATE TABLE entries (message VARCHAR(1000))");
               db.update("DELETE FROM entries;");
               PreparedStatement ps = null;
               for( int i=0; i<vEntries.size(); i++ ) {
                    Line entry = (Line) vEntries.get(i);
                    String value = "" + entry.message;
                    if(!value.equals("")) {
                         try {
                              ps = conn.prepareStatement("INSERT INTO entries (message) VALUES('" + Tools.RemoveSingleQuote(value) + "');");
                              ps.execute();
                         } catch(Exception e) {
                              e.printStackTrace();
                              System.out.println("error in number->" + i);
               MainPanel.WriteLog("Releasing memory...");
     vEntries = null;
     vEntries = new Vector();
     System.gc();
          } catch (Exception e1) {
               e1.printStackTrace();

Well, i need to treat those contents, and calculate values withing those files, so wrinting files using FileInputstream wont do. for instance i need to get line 5 from file 1, split it, grab a value according to its class (value also taken) and compare it with another line of another file, adding those values to asingle file.
that's why i need vector capabilities, but since these files have more than 5 Mb each, an out of memory error is returned by loading those values into vector.
A better explanaition:
Each file has a line like
CLIENTNUM CLASS VALUE
so if the client is the same withing 2 files, i need to sum the lines into a single file.
If class is the same, then sum values, if not add it to the front.
we could have a final line like
CLIENTNUM CLASS1 VALUE1 CLASS2 VALUE2

How can I cut up a video file into smaller bits?

I shot around 3 hrs of 1920x1080 AVCHD in 2 clips (a wide shot of the stage of a musical production I performed in) It all fits in the internal memory of my camera.
Two friends shot medium and closeups in Standard AVI with a view of making a DVD (2 disks)
They will be editing it in Premier Pro standard def.(a 3 camera production!)
When I convert my AVCHD to AVI SD, each of my 2 reduced clips is still too big to fit on one dvd disk as a data disk.
How can I cut each clip in half to fit on a total of 4 disks so I can send them the video?
If I make two AVCHD projects out of each clip in PE9 and share as DV, the quality is badly degraded. Near vertical lines become very jagged and the picture is much softer than if it had been originally shot in SD.
If I make a PE9 DV project and import the AVCHD instead, I get the red line and the picture once rendered is no better.
I have seen references to a lossless codec. Would this do the job in PE9 and how do I implement it?
The 4Media converter does a much better job of converting to SD but how can I cut the new file in half?

I would point out that Standard Def here in Australia(576) is 12% better vertical resolution that in USA(480).
So European & Aussie SD doesnt look quite so bad compared with full HD
In fact if you stand more than 4 metres from a 40" screen, most people cant see the difference between good SD and full HD.because the eye cant resolve such fine detail at that dustance even with perfect vision.
This is providing the original material was shot with a good camera capable of HD and it was downscaled properly.
Converters
I. downloaded trials of the following converters and rank them in the following order
1. 4Media version 6 AVCHD to AVI converter ($37)
2. Prism
3. AVS
4. Wondershare
5. PE9 making seperate SD projects
I found them obviously different with PE9 right at the bottom of the scale! I will never use it again to make a SD project.
Blurryness and jagged or twinkling diagonal lines were the most common faults.
4Media shone above all the others. When used on the highest bit rate was only slightly softer than the ACVHD material with no jagged diagonal lines but it produced an AVI file the same size as the AVCHD.
When I set the bit rate so the AVI file produced was half the original AVCHD, the quality was equal to original SD video Shot on my old Sony Camera that cost me $2000 5 years ago.
I can split the files with this program too!
Judging picture quality
All pictures will have errors and be less than ideal. It's just a matter of how many are acceptable.
The ONLY way to evaluate how good a picture is to view it on the best possible setup. You can't judge vertical resolution on an old CRT TV which is a different number of lines anyway (525 or 625) so evaluation is impossible. Digital TV thru a set top box to a CRT TV is far worse than the original analog.
Because everyone knows SD is worse then HD but it should only be half as bad (576 is about half of 1080)
Because I wear glasses that perfectly correct my focus and slight astigmatism, I have a good rough method of calibrating my eyes so I can relatively judge quality of different pictures on different systems.
I vary the difference between myself and the screen so the left and right edges are in line with my fingers inside the frames of my glasses!
This is equivalent to sitting two thirds from the screen in the average picture theatre where you can comfortably sit without being disturbed by deficiencies of most film and HD projection.
Applying this to my computer screen I can now judge pretty well. If a picture looks really good under these circumstamces it IS good and I can easily see any meaningfull errors.
Using my calibration "method", I found that full HD on my 40" LCD is noticeably sharper than the best cinema in our city (we have 39 of them, some with 8 theaters ) and after enquiries found they are all 1440x768 and not true HD at all.If you get there earlier than when they boot up their projector you can often see this in their boot up screen.
Worse still they slightly defocus them so you can see the pixel structure close up!
The now rare 35mm Film projection ranks even lower by the time copies are distributed.
You can't buy analog TVs or CRT screens anymore here anyway and Analog TV finishes here completely next year.

How to load PDF files into oracle database and display them in APEX

Hi All,
We have a requirement for loading the Loading PDF files (lots of PDf files) to the oracle database and then display the PDF files in the Oracel APEX report.
So that User can view the PDF files. Our current APEX verison is 3.2..
Please let me know how to implement it and where to find the sample application!
Thanks in advanced!
Jane

Thanks Tony for your quick response!
We need to load a lot of PDfs (history + current).
I have a questions about the SQL loader. I am trying to insert a pdf file into a table by following the oracle loading sample:
http://download.oracle.com/docs/cd/B10501_01/text.920/a96518/aload.htm
Example Data File: loader2.dat
This file contains the data to be loaded into each row of the table, articles_formatted.
Each line contains a comma separated list of the fields to be loaded in articles_formatted. The last field of every line names the file to be loaded in to the text column:
Ben Kanobi, plaintext,Kawasaki news article,../sample_docs/kawasaki.txt,
But i don't know to where should I put my pdf file on the server.
for example:
,../sample_docs/kawasaki.txt,
Where is the file 'kawasaki.txt'??
I try my local path, it didn't work. like c:\temp.
then I loaded teh PDf file into our server(/findev20/olmtest/orafin/11.5.7/olmtestcomn/temp) , and In my data file. I put the path
1, pdf_emp1,../findev20/olmtest/orafin/11.5.7/olmtestcomn/temp
but I got the error: the system can not find the file specified.
Where should I put the PDf files on the server and how to specify the path in the data file?
Thanks!
Jane

How to convert cXML dtd files into xsd format and use them into BPEL application

Hi,
In my BPEL application I have to use cXML dtd files by converting them into xsd format.
I have used 'Microsoft Visual Studio' for converting cXML.dtd file into xsd format, for this 1 dtd file I am getting three xsd files (cXML.xsd, cXML1.xsd and cXML2.xsd).
Please check this once and let me know
1. why I am getting three xsd files for one dtd file,
2. how can I use cXML.xsd file in my application, do I ll have to use all the three files in my BPEL app and
3. what should I include in main xsd file (cXML.xsd) to import other two xsd files.
kindly check this once and let me know your suggestions .
Thanks

Hi,
While downloading the cXML dtd there will be example xml files. Using this xml's we can generate xsd.
Regards,
KANN.

Splitting large video files into small chunks and combining them

Similar Messages

Maybe you are looking for