Working with big files

I would appreciate any suggestion as to how best one can work with big files. I have eight one hour tapes containing information about various places I visited. Some contain only one place while others can contain two or more places. As a preference I like to create up to one hour DVDs that contain an identifiable segment; eg either one place only or more but I do try not to break up a place and record it on two DVDs. However, the problem I faced in the past, is that by the time I get to the end of an hour, the program Premiere Elements 7 (PE7) is getting slow and keeps telling me that it is running out of memory. That is despite the fact that I have 3 GM of RAM and over 200 GB of dedicated separate hard drive. I tried saving segments under ‘Share’, ‘DV AVI’ and selecting ‘DV PAL Standard’ (the system I use), but the result, as far as quality was concerned, was very disappointing. There is no option to change or set quality as was the case in previous versions of PE. Nor can I combine two .prel files into one while I am editing.
Is there any other way I can work in segments, say 15 minutes, and combine them at the end without losing on the quality?
Any suggestion would be most appreciated.
Tom

Hi Steve
It is a Sony DCR-HC40E PAL, and they were captured as AVI clips.
The project settings are:
General – not highlighted but it shows DV Pal and 25.00 frame/second
Video – 720 horizontal 576vertical (4/3)
Display format - 25 fps Timecode
Capture – DV Capture
Tom

Similar Messages

Problem of crashing in Ill. CS5 when working with big files.....

Hello, I'm working as a cartographer at Port of Rotterdam and frequently work with big maps in Illustrator CS5. As soon as the filesize exceeds 150 MB, and especially when small rasterfiles (mostly jpg's) are placed inside the document, either embedded or not-embedded, me and my collegue get notifications indicating "Can't show preview"or worse: The operation can't be concluded due to lack of RAM (dutch translation). This being a last warningsign just before CS5 collapses and it thus becomes impossible to make any Save on the document.... The hardware we work with: Quad Core 3GHz;NVidia Quadro 1GB;Windows XP with SP3, DirectX9; 8GB int. memory. We hope to find out the reasons of the frequent collapses and if you know of any possible solutions. On behalf of many of my collegues, thank you in advance for replying, greetings, Fred van Eck

There can be other causes for instance if your scratch disk is fragmented and if your scratch disk has gotten overloaded with actual files storage.
Or if the permissions for the scrtch has been changed for some reason.
The scratch need a lot of free contigious free space to work well with large files.
Even with CS 6 you can have a problem if your scratch is not healthy.
Do you have a dedicated drive or partition of one as a primary scratch, does the scratch have a fast enough buffer (cache)? Current drives run 32 MB and 64 MB cache.
Is the file stored on a fast disk?
If you work on large files consider storing them on a RAID 0 for while working on them and storing the final some where else.
CS 6 should be helpful but you need lots for RAM I would not run a system and work on large files with 8GB of memeory 16GB should be your minimum.
If you are working in a professional envoronment then you really need a professional set up and make your life easier and save money in the time you save.
It is expensive to set up but wotth it in the end.

Advice needed: The way to solve out of memory problem (or the way to work with big csv files)

Hello:)
I'm in trouble: I have a big csv file (over 5gb of web-analytics data) and my 64 bit excel (and 6gb ram)
I cant load file to data model because of it's size. There is an error "out of memory" in power query.
This is the first time when I encountered such a problem.
What options do I have to work with such a file? To increase memory in my computer? Would it solve the problem? How much do I need to work with 6gb csv?
Or may be I can upload my data somewhere to azure and work with it there?
So the problem - is there any way to deal with big files using power query? Or I need to become a developer and learn sql or other languages?
Thanks in advance.
Max

Hi Miguel!
Thanks for your answer.
I've tried to load this file on virtual pc from azure cloud with this config:
I have increased memory limit in power query settings:
And still, the proble is the same:
What I do wrong?

Working with RAW files in PSE9: Doable or better to use PSE12?

I have PSE 9 and will soon get a camera with RAW capability. I notice that Adobe no longer supports PSE 9. Am I in for trouble if I don't upgrade to PSE 12 since I don't know how to work with RAW files? It sounds as if I will need something to convert RAW files? Where do I get it? Is it a big deal for a beginner with no software skills?

You can download a free DNG Converter from Adobe and then convert your RAWs to DNGs which can be used in PSE9.
You don't need PSE12, but if you want to purchase PSE 12, you get the most current features in the Raw processor (which in my opinion is a huge improvement over what is available in PSE9), and you don't need the extra step of converting to DNG.

Adobe MEdia Encoder Crashes with big files inputed

Hello,
There isn't a forum for the Adobe Media Encoder, so I thought this would be a good spot. I am an after effects and Premiere user who likes the idea Adobe seems to have of using the media encoder to cover all my encoding needs.
My typical workflow, especially since these days I'm doing more shorter form animations, is to render out to a Quicktime Animation codec file as my main archive file. From there, output all the various different web versions, flv, etc from that core archive file. Since my projects usually aren't running more than 5 minutes, this leaves me with a nice 3 - 7gig file.
Problem: I'm running CS4 and the media encoder crashes when I input files that are in this file size range. The program locks up when I push start que, and then eventually crashes. Works fine with smaller size files that are about under a gig.
I can run a render out of after effects, which seems to be more stable. But I'd love to be able to use this great new tool.
Here's my machine specs if it helps:
PC
Intel Quad Core Q9550 @ 2.83 ghz
4gB RAM
Windows Vista 64 bit ultimate
All updates current for CS4 apps as of 01/30/08
Running Adobe Media Encoder V 4.01.078
Hard drives are nothing special. 7200 rpm western digital internal and external. I've tried all sorts of hard drive configurations, where the input is coming from, where it's going, etc. No difference.
I have been experimenting with using Lossless AVI's as my "uncompressed" archive file. Works well, but same crashing with the Media Encoder.
Also tried experimenting with frame size alterations during encoding, no difference there. Also, whatever the output codec is, be it FLV, H264, etc. no difference.
Anyone have any thoughts or have experienced similar issues? I hope all my MAC friends aren't right, seems like all my attempts to streamline my workflow with this CS4 and beefy PC combo are crashing and burning.
Anyone else feeling this pain, or have recommendations?
Thanks,

Thomas, thanks for your suggestions on Vista optimization. That Sheer Codec looks nice, but hard justify the cost when I've been working for years with essentially uncompressed codecs that work well. Will play more though to see if the cost would actually pay off in the long run though.
In general I made a decision that it was too early to throw in the towel on my old uncompressed codecs. The Quicktime animation codec has always been for me the safest, most universally accepted, and most reliable "uncompressed" codec. It's always worked in the past, not gonna give up just cuz media Encoder CS4 has troubles.
Mylenium, thanks for the reminder about the silly platform wars. I've always felt the same as you, but when I'm stressing sometimes the silly propaganda can get to me. Makes me forget that no matter what system ya got, it never works perfect!
Here's an update. I have trying my best to learn more about the bug and have come to some interesting realizations. The AME does work with larger files, just not the larger files that I had been using at the current moment. Older files of mine as big as 20GB can be inputed into AME with fine results.
This being said, it scratches out most of the RAM overload thoughts with AME.
The difference with my current files that were causing AME crashes: larger than a few GB, came from AE, had the 1.21 pixel aspect ratio metadata.
When I re-interpreted the file in AE into a square pixel aspect ratio, exported it, it was then successfully inputed into AME.
I have read just now that there were changes in After Effects widescreen pixel aspect ratio interpretation in CS4. Can this change be causing problems in my AME. Not positive, but I'm now thinking after many days of testing that the bug could have its roots somewhere in this ball park.
If anyone from Adobe is reading this, I would love any ideas you might have on this issue. In general, there is really no support for the Adobe Media Encoder itself. This is not good, considering how it is so necessary for AE and Premiere users like myself.
Thanks,

Has anyone not working with .dv files had synchronization problems?

Has anyone not working with .dv files had sound synchronization problems? I'm not exactly sure what the alternatives to DV are, but I think one of them is HD.
The reason for asking this question is to help isolate the nature and cause of a very serious flaw in iMovie '11. In the original release of iMovie '11 (version 9.0) there was a small--but serious--synchronization problem. In the 9.01 there is a large synchronization problem. We know of one person who has not experienced the problem, and he is not working with DV files (media). So we want to find out if anyone who is using something other than .dv files is experiencing a lack of synchronization between sound and picture. Knowing the answer to this will help with figuring out where the cause lies. For the initial iMovie '11 release (9.0), you probably would not notice a problem unless you had very long event-clips, e.g., two hours long. Events get this long if you are transferring from analog 8 mm tapes. Even then, it would have to be in scenes in which the connection between event and sound is obvious, e.g., close ups of people talking. It isn't until the 9.01 release that most people would notice anything. All we need to do is establish one case of a synchronization problem in which the person is using something other than DV.
Message was edited by: Paul Bullen

Hopefully, the 9.0.2 release will make my question moot. Zyfert must have posted the announcement of the release just as I was formulating my question. Still, if you have information on the subject, it would be interesting to hear.

Very slow responce when working with Office file on DFS-Share

Very slow responce when working with Office file on DFS-Share
We have implemented the following configuration
Domain level Windows 2000. Two member servers with Windows Server 2008 R2, sharing the same DFS namespace with, at the moment, one folder target called Home.
Users complaining that the access to different MS Office files is very slow. Even creating a new MS Word document using right click context menu takes up to 4 minutes to open. Saving, for example, one singe Excel sheet takes also few minutes.
Tested with both, MS Office 2007 and MS Office 2010. Makes no difference. When using Office 2010 you can see the message like contacting:
\\DomainName\Root\Home\UserName. Other files like TXT, JPG or PDF are not affected.
What makes the thing really weird is the fact, that the behavior described above can absolutely change after client machine being rebooted, suddenly everything becomes very fast and this condition can revert back again just after the next
reboot.
Considerations until now:
1. This has nothing to do with the file size. Even tiny files are affected.
2. AD Sites are configured correctly and the client workstations see themselves in the correct sites.
3. This is not an Office issue. If I map my folder target not as DFS, but directly as shared network drive
\\ServerName\Root\Home\UserName , everything functions as expected
What makes me suspicious: when using f.e. TCPView to monitor connections, I can see, that each time I make any operation on an office file, there will be a connection established to one of the domain controllers, sometimes to remote ones,
located in other countries. But on the other side, even if the connection is established to the nearest DC, operations are still very very slow!
Just forget to say. All clients are Windows 7
Thanks to all who respond.

Dear all,
sorry for the delayed reply. The problem has been solved now and since September 19<sup>th</sup>. everything is functioning as expected.
What was done:
Deleted replication targets excepting the initial ones
Carefully recreated folder targets
Deleted and recreated replication groups
Disabled SNP features on both namespace servers
Created EnableTCPA registry entry
Checked that the following Updates are installed
http://support.microsoft.com/kb/2688074
http://support.microsoft.com/kb/2647452
Concering Office File validation KB2553065 - This Update was already declined on our WSUS server
Kind Regards
Eduard

Working with RAW files in iPhoto 5.0.4 and Elements 4.0.1

I take photos in RAW mode and download them to iPhoto. When I try to edit the photo in iPhoto, the picture is a tiny little file that is impossible to enlarge with any sort of clarity. Also, the word "RAW" does not appear anywhere on the iPhoto window like I read it is supposed to.
When I drag the file to Photoshop Elements, I get an editing window that has none of the tools usually associated with JPEG files. I get a separate window in which I can darken or lighten the image, that's it.
Clearly, I'm doing something wrong. No one in their right mind would ever use RAW if this is how it works.
Any ideas?

Hi Jack!
If you're new working with RAW files, your right, it just doesn't make sense. RAW <imho> is a bit overrated. One thing you will need to keep in mind when shooting in RAW, is you will still need to take a well exposed image. What RAW files will allow are CHANGES in all areas of the image v. JPEG which may allow you to ADJUST a few settings in the image. My only suggestion would be to kepp playing around with PSE until you get the hang of it, it is an excellent image editing software. But realize, a well exposed JPEG and RAW file are hard to tell apart...
Personally, I do not directly download RAW files through iPhoto but will create a folder and download to here, and simply drage folder to iPhoto to import (which are then 'converted' into JPEG files). This way I have the original RAW images safely located outside of iPhoto as well as in iPhoto. You should set Elements as your choice of application to edit files inside iPhoto.
Good luck, Rick
Good link: http://www.elementsvillage.com/forums/ and just for fun: http://www.photoshopcosmetics.com/index.php

Working with Large files in Photoshop 10

I am taking pictures with a 4X5 large format film camera and scanning them at 3,000 DPI, which is creating extremely large files. My goal is to take them into Photoshop Elements 10 to cleanup, edit, merge photos together and so on. The cleanup tools don't seem to work that well on large files. My end result is to be able to send these pictures out to be printed at large sizes up to 40X60. How can I work in this environment and get the best print results?

You will need to work with 8bit files to get the benefit of all the editing tools in Elements.
I would suggest resizing at resolution of 300ppi although you can use much lower resolutions for really large prints that will be viewed from a distance e.g. hung on a gallery wall.
That should give you an image size of 12,000 x 18,000 pixels if the original aspect ratio is 2:3
Use the top menu:
Image >> Resize >> Image Size

Unexpected problem: uncaught exception when working with audio files in Soundtrack Pro

Hey,
Whenever I double click an audio file in the timeline to work on it, I end up getting the Error message: "Unexpected problem: uncaught exception" and Soundtrack Pro eventually crashes. Also, this happens when I try to work with audio files in the file editor. I have Leopard and am using Logic Studio 8. Any insight would be much appreciated. Thanks
Matt

Didnt know how to remove the original clip from the STP arrange window - or whatever it's called in STPro. So I could go no further in my perverse science experiment.
It also appeared that I could only import an aif but not a wav?
I gave up on STPro and did what I needed to do in Logic, which I use regularly.
Thank you for folowing up on this.
PS. I used to use an old PowerPC version (1.0.3) of STPro and loved the way it visually showed the change in the waveform when you added each efffect. It appears that the new version (3.0.1) does not allow you to do this anymore? You can render or flatten the effects to see the final waveform, but then you are dead in the water and cant make changes?
Im such a newbie at STPro that I am probably not using it right?

Working with Multiple Files in Workspace Layout

If I was working with multiple files in the workspace layout, they each used to be available for selection from a tab. Now I can either cascade the files horizontally or vertically - but not have them appear in a tab across the top of the workspace layout.
Does anyone know how to set the workspace to present multiple files in tabs? I have CS3.

Tanya,
This may not help, but the times when that happens to me is when I go too fast and some operations haven't finished. I then try to select a file that hasn't completed and the file I select is in the process of having the data updated. The worst is when it is trying to render as I am doing something.
I hope this helps some.
Mel

Help: Working with .MOV files in FCP and forced to RENDER FOR EVERY EDIT

I'm working with .MOV files from my digital camera in Final Cut Pro and every time I make a new edit, I have to render it in order to see it in the canvas.
How do I make it so that I don't have to render every edit in order to see it?
(I've worked with files straight from a DV camera, and editing went fine. I'm assuming it has to do with the .MOV files)

DV Cameras are not the same thing as a Digital camera. Digital cameras offer video on a limited basis and it's usually highly compressed in a non-editing format such as MPEG-2 or similar. NLEs are made to work with video cameras, not still cameras which is why you're having trouble.
That's not to say you can't edit video captured with a digital camera, but you need to know how to prep it for editing. Some digital cameras shoot at odd frame rates and they all use some form of compression that is not typically used in editing. This means that you'll likely need to convert your clips to an editable format first using Compressor.
Andy

How Can I Work With PHTML Files In Dreamweaver ??

I want to work with PHTML files in Dreamweaver CS3 - How do I
go about getting this to work?

The solutions is either of the following:
Adobe Lightroom - Find moved or missing files and folders
Copy the photos back into the exact same folder and folder location that they were in before
I don't know what you actually did "when I pasted it back" ... but the bigger issue is that you shouldn't be working with these files in your operating system, period. Once you import them into Lightroom, you don't manage these files in your operating system.

Do I need BootCamp in order to work with Publisher files?

I need to be able to create and work with Publisher files. From what I've read, the only two options are: 1. buy a PC (UGH) and then purchase Windows and Publisher.
OR
2. Purchase BootCamp, Windows and Publisher.
I was hoping that by some miracle, some software company has addressed this. Like Pages or Word.
Any recommendations?
Thanks

You need MS Publisher which is not available for the Mac, there are no compatible programs as far as I know.
Do you need BootCamp? if you are planning on installing Windows natively then yes, or you could run it in a VM, but with less performance usually.
Or buy a cheap PC (with windows) and run it there.

Problem when load more swf files work with xml files into my movie

hi ;
I have one flash file & more of swf files which work with xml files .
when I load one swf file into my flash file and remove it and load anther one on the same movieclip in my flash file it load the old swf file.
when i load one on movieclip and remove it and load anther swf on anther movieclip the file doesn`t work and stoped.
when test my flash file to load and remove swf files without xml file it work fine but when repleaced the swf files with other work with xml files the problem hapend.
thanks;

YOu should trace the names of the files that are being targeted for loading to see if they agree with what you expect. If you want help with the coding you will need to show the code that is relevant to your problem (not all of it)

Working with big files

Similar Messages

Maybe you are looking for