Batch conform/index?

Hi all,
I have a huge project that will involve footage from seven shoots. We already got 85GB of footage from the first shoot so I was really excited to learn about Prelude and the ease in which it could make subclips for me.
However, since we shoot with a Canon XF300 (MTS files) and a Canon XH-A1s with a Sony CF recorder (M2T files) those require conforming and indexing respectively. Unless I'm missing a trick, it looks like the only way to have a clip conform or index is to double-click it to open it. With 85GB and a ton of clips for only 1/7 of my project already, this is going to get very irritating. Right now if I want to log efficiently, I have to open all of my clips one at a time while I'm working on something else so they can all be conformed when I'm actually ready to log. It would take way too long to try to log my footage and let each clip conform before I mark it.
Is there a batch confrom/index feature or some way to open all of my clips at once so conforming can happen in the background or overnight?
Thanks,
David

Prelude only conforms the clip once opened. Please do file a feature request at http://adobe.com/go/wish
Thanks!

Similar Messages

Replacement for Apple Cinema Tools to batch conform for overcrank?

Apologies if I am asking this question in the wrong forum. And If I am, perhaps you could refer me to the right place,.
I use it to batch conform 60 fps (shot on my 7D) to other frame rates (30, 24 etc) to achieve smooth slow motion.
I know that there are ways to conform clips one-at-a-time in After Effects.
But I am seeking a simple one-step batch conform tool that will convert like Cinema Tools.
I also tried Red-Giant grinder, however it does not recognise the files coming out of my GoPro Hereo 3+.
Is there a way to do this with Adobe's products?
Thanks.

This forum is for supporting people who have issues downloading and installing Adobe software. It sounds like you are looking for help with an application, and since you mention After Effects, maybe that would be a better place to start. After Effects

Is there any field " Batch number index" in Batch Management

Hi
Is there any field " Batch number index" in Batch Management.
My clients requirement:
Currently raw material batch allocation to the process orders is based on batch number index. Clent does not enter manufacturers date when materials are received and hence the numeric batch number serves FIFO correctly based on batch creation date.
Change needed - Planning to change the business process to enter the manufacturers date for each raw material batch receipt so that Shelf Life Expiry Date comes in to play and expired dated raw material does not go into Process production.
Is there any other solution linked or not linked to the above "Batch number index" ??
Kindly reply ASAP
cheers
Maruthi Ram

hi,
Hope Charge Number is the Batch Number.
May be i am wrong.
Reward points if it is helpful.
Regards,
Sangeetha.A

Conforming & Indexing of Files

Wil Renczes, from Adobe, just posted a great outline of what happens with Conforming and Indexing of files on Import. He was replying in the PrPro forum, but you can substitute PrE for PrPro in his post, as they are the same here. He also addresses why/how Conforming can not take, and the program will do this every time that the Project is opened, though the processes have already taken place before.
Wil writes:
PPro generates two potential sidecar files for audio - PEK and CFA files. The PEK file is simply a quick data pass of the audio data that allows the app to draw waveforms (ie it should be pretty quick) - the CFA files are required if the file source is either too slow to decode the audio in realtime (like some MPEG long GOP, for instance), or if there's a mismatch in the sample rate depth. The idea is that the conform files will match your sequence's audio bitrate settings so that the app can play & mix audio in realtime.
How does PPro track these additional files? Every file that is imported is stamped with XMP, which is how we handle metadata on source files. XMP creates a unique ID which the app uses as a lookup value when it wants to find the PEK & CFA files that it generated for a file. So, usually, if you have a project where certain clips constantly reconform, it has something to do with XMP. Why? Usually it's because XMP can't write to the file. So, every time you launch PPro and open the same project, the media file has no XMP data, so it tries to generate a new ID, so any old CFA/PEK files have an ID mismatch and the app thinks it needs to generate new ones.
Typical cases why XMP can't stamp files:
- the media file is read-only.
- the media's hard drive is read-only.
- the file itself is corrupted/malformed, and XMP takes the safe route & decides not to try to write any additional data to the file. (I've personally witnessed this occur with WAV files captured by a Tascam field recorder.)
- someone deleted the XMP files by hand (certain media types have it as a sidecar .XMP file instead of embedded). (Don't laugh - I recently encountered a case where people had instituted a server folder rule to delete all files on a network share that weren't .mpg. )
A workaround you can try:
There's a preference setting to turn off injecting XMP into your media. If that setting is in effect, PPro will not rely on the XMP ID for the CFA/PEK files.
One other note, if your problem is specific to MPEG files: it might be that PPro isn't able to index the file properly. If it can't index, it might be trying to re-index on each launch; audio conforming always triggers after indexing. So watch for it constantly indexing - if that's the case, all the XMP stuff I described above has nothing to do with the problem. It's a side effect of something in the MPEG stream that we're barfing on. If you do see it constantly re-indexing MPEG files, it would be really helpful to send in a sample so that we can examine the stream.
Cheers Wil
If someone is having problems with continuing Conforming, though it completed earlier, think about what Wil has said.
Good luck,
Hunt

Along with Wil's comments, here is a bit of background on the Conforming and PEK generation process. Premiere will need to Conform the Audio Stream to create the CFA files, which will be 48KHz and 32-bit, floating point, for accurate editing. Premiere can handle a lot of popular Sample-Rates and Bit-Depths, but some can create problems. The closer that the Audio Stream is to 48KHz 16-bit (the DVD/BD standard), the easier it is for Premiere to Conform. The farther away the Audio Stream from those specs., the longer that it will take. The total time to Conform is related to how far off the Audio Stream is, the Duration of the file(s) Imported and the speed of one's computer. The progress bar tells you how much Conforming has been done per file, and gives an indicataion of how much Conforming is left to do. It is a good practice to not touch the computer, while Conforming is on-going, as this can cause the process to stop (usually leading to truncated Audio), the program to crash/hang, or even the computer to crash/hang.
The PEK file is the Waveform Display, that one sees, when the Audio Clip is placed onto the Timeline, or opened in the Source Monitor.
The CFA and PEK files are stored in the Media Cache, and located where one sets them in the Edit>Preferences>Scratch Disks.
For some background info on the Media Cache, see this ARTICLE.
Hunt

Conforming and Indexing Errors, Media Pending, Audio won't play in timeline

I'm working on a desktop PC which is running Windows 7 Professional 64-bit and Adobe Premiere Pro (version CS5.5). It's currently utilizing a second gen. 3.4Ghz i7 2600 processor, 16GB of 1600Mhz RAM, 64GB solid-state drive and a ASUS P8Z68-V Intel Z68 Motherboard with onboard audio (Realtek ALC892 chipset) and onboard video. My problem is this:
The conforming and indexing of all of my imported media never seems to finish regardless of how many times I reopen the project file and wait for it. On the lower right-hand portion of the screen, next to the conforming/indexing progress bar, is a little red "X". When clicked, it pops up with a list of errors that read: "An unexpected error occurred while performing a conform action on the following file...". As a result, my audio channels have no waveform and during playback there are no audible tones or levels. On some video clips there's just text that reads "Media Pending". This only appears to happen with project files that I saved on external hard drives, and I suspect it has something to do with the Media Cache Files folder and how Premiere Pro locates these conform/index files. I've also encountered this problem in CS3 and CS4.
I have a few questions:
1) How do I avoid error messages in regards to indexing and conforming
2) How do you know when indexing/conforming has completed itself? (there doesn't seem to be a progress log or a list of commands/executions)
3) Indexing and conforming appears to be an automatic process, but is there a way to do it manually?
4) What's the best way to setup your media cache files when you click EDIT > PREFERENCES > MEDIA?
5) If I have approximately 1 hour of footage, what's an average wait time for conforming/indexing? What about 5 hours of footage? 10?
6) Adobe recommends not editing until the conforming and indexing has completed itself-- how important is this?
7) Sometimes it appears as though the conforming and indexing has finished, but then I still have problems with playback. Do I have to reopen the project for it to continue with the conforming/indexing progress? I've already determined that the video file I'm working with is intact and free of any corruption.
I'm fine with having to wait for a project to conform and index, but it never seems to complete itself! Any help regarding this matter would be greatly appreciated.

Harm filled in pretty much all the salient details, but I'll do another pass here.
1) How do I avoid error messages in regards to indexing and conforming
Two parts here. One, conforming only happens for certain media files, ie the ones where performance is critical and we can't depend on extracting the audio fast enough for realtime playback. That's basically anything in an .mpeg wrapper, or AVCHD material. So if you edit XDCAM HD/EX or P2, or RED, or even AVIs or QT, those formats don't require audio conforming.
If you're stuck editing AVCHD or MPEG2, then it needs to conform. But, that being said, you shouldn't be getting errors in the first place. I think it's related to your external drives. More below...
2) How do you know when indexing/conforming has completed itself? (there doesn't seem to be a progress log or a list of commands/executions)
Nope, you have a progress status bar indicating which file it's working on. If there's an error, it shows up in the events panel.
3) Indexing and conforming appears to be an automatic process, but is there a way to do it manually?
No.
4) What's the best way to setup your media cache files when you click EDIT > PREFERENCES > MEDIA?
While some people like having the check box for having the conform files beside the media, I hate it. Yes, it means that if you move the project to a different system & reopen, it means that you potentially can avoid recreating CFA files, but I find the drive littering not worth it. I much prefer having setting the Media prefs to point to a specific media drive. Usually a raid, if available. Definitely not an external drive that you disconnect & walk away with. If you don't have a permanent raid on your system, then preferably a dedicated internal drive for media (think along the lines as your Photoshop 'scratch disk'). Failing that, leave it on your C: drive, although with a 64 Gig SSD, you probably don't have much room for transient temporaries.
5) If I have approximately 1 hour of footage, what's an average wait time for conforming/indexing? What about 5 hours of footage? 10?
Like Harm said. Totally dependant on the media container & the speed of your drive i/o. The conforming is iterating through the entire file & pulling audio data, so it's not CPU intensive, it's all i/o.
6) Adobe recommends not editing until the conforming and indexing has completed itself-- how important is this?
If you're trying to play/scrub while conforming, it's going to be pokey. Esp. if you're trying to access the file that's actively being conformd. As I just said, we're hitting the files for all the audio. The i/o is being saturated already, so unless you have a stellar raid, you don't have much headroom.
7) Sometimes it appears as though the conforming and indexing has finished, but then I still have problems with playback. Do I have to reopen the project for it to continue with the conforming/indexing progress? I've already determined that the video file I'm working with is intact and free of any corruption.
You should be good to go. Sounds like there's something else at play here.
Okay, back to what I think is wrong: you don't mention what kind of external drives you're using. You're making a bad assumption that blowing away conformed files & doing a reconform is buggy - I doubt it, as that's the same process that happened when you initially brought in the files. I've blown away my media cache folder multiple times and have never seen failures on reconform. So it's got to be one of two things: either a read error from the source when attempting to pull the audio, or a write error to the destination. Now I don't know where you currently are pointing the media cache directory, or what your source drive is, so I can only speculate.
My suggestion is to do some elimination. Copy one of the files that failed on you to your C drive, & target your media cache directory also to C:. Pick a new project, import your copied file, confirm that it conforms correctly & behaves. Then, try to use the same clip from your external drive, keeping the media cache to C:. If that's still good, then try targeting another (local/internal) drive as your media cache target; close/restart, then import the clip from C:, and then import the clip from your external drive. This troubleshooting should give us something.
PS, if you're trying to edit from external USB drives, good luck. I find it a major PITA that I avoid as much as possible. Firewire isn't much better. I know some people do it successfully, but I think it's a road fraught with peril. These devices are generally not designed for heavy duty I/O and a flaky connection or drive is nothing but pain.
Cheers

Temporal compression conforming HDV 1080i60 to 23.98fps

Footage was shot on Sony EX1. Then Sony's transfer tool was used to bring it into FCP. Before import, the file says it is 59.94i (23.98p).
In final cut it says 29.97 (basically the same).
The footage needs to be changed in 23.98 fps. In cinema tools, the clip analysis says HDV 1080i60 29.97 quality:normal with temporal (what is that)?
The button to conform is grey and not active. I have tried batch conform and that leads to cinema tools creating a new source folder for "skipped clips" due to "temporal compression"
What is up?

CT doesn't convert 60i to 24p.
CT doesn't work with native HDV or MPEG2 footage.
Solution, http://www.nattress.com/Products/standardsconversion/standardsconversion.htm my conversion software which does a great 60i to 24p conversion even on HDV.
Graeme

Multiple Alter Table Statements in one batch

Hi Team,
We have in one of our upcoming release two columns being added to a table that has over 20 million records and 14 indexes.
We needed to add two columns to the table both not null (bit). Because it was taking a while to add the columns, we thought that putting these two alter statements in one batch would speed up the operation significantly but to my surprise it did not.
Conclusion from my test: individual alter statements or batch alter statements take the same time
Here are me test and results - table Order1 and Order2 are exactly the same structure and data.
Test case 1:
===================
ALTER TABLE Order1
ADD OR_N BIT DEFAULT 0 NOT NULL
go
ALTER TABLE AccountTradeConfirmation_Alter1
ADD OR_S BIT DEFAULT 0 NOT NULL
Go
Elapsed Time: 2 hrs
             Mar 18 2015 5:56PM
(1 row affected)
Non-clustered index (index id = 3) is being rebuilt.
Non-clustered index (index id = 4) is being rebuilt.
Non-clustered index (index id = 5) is being rebuilt.
Non-clustered index (index id = 6) is being rebuilt.
Non-clustered index (index id = 7) is being rebuilt.
Non-clustered index (index id = 8) is being rebuilt.
Non-clustered index (index id = 9) is being rebuilt.
Non-clustered index (index id = 10) is being rebuilt.
Non-clustered index (index id = 11) is being rebuilt.
Non-clustered index (index id = 12) is being rebuilt.
Non-clustered index (index id = 13) is being rebuilt.
Non-clustered index (index id = 14) is being rebuilt.
(21777920 rows affected)
Non-clustered index (index id = 3) is being rebuilt.
Non-clustered index (index id = 4) is being rebuilt.
Non-clustered index (index id = 5) is being rebuilt.
Non-clustered index (index id = 6) is being rebuilt.
Non-clustered index (index id = 7) is being rebuilt.
Non-clustered index (index id = 8) is being rebuilt.
Non-clustered index (index id = 9) is being rebuilt.
Non-clustered index (index id = 10) is being rebuilt.
Non-clustered index (index id = 11) is being rebuilt.
Non-clustered index (index id = 12) is being rebuilt.
Non-clustered index (index id = 13) is being rebuilt.
Non-clustered index (index id = 14) is being rebuilt.
(21777920 rows affected)
             Mar 18 2015 7:52PM
Test case 2:
===================
ALTER TABLE Order2
ADD OR_N BIT DEFAULT 0 NOT NULL, OR_S BIT DEFAULT 0 NOT NULL
go
2 hrs elapsed time
             Mar 20 2015 11:10AM
(1 row affected)
Non-clustered index (index id = 3) is being rebuilt.
Non-clustered index (index id = 4) is being rebuilt.
Non-clustered index (index id = 5) is being rebuilt.
Non-clustered index (index id = 6) is being rebuilt.
Non-clustered index (index id = 7) is being rebuilt.
Non-clustered index (index id = 8) is being rebuilt.
Non-clustered index (index id = 9) is being rebuilt.
Non-clustered index (index id = 10) is being rebuilt.
Non-clustered index (index id = 11) is being rebuilt.
Non-clustered index (index id = 12) is being rebuilt.
Non-clustered index (index id = 13) is being rebuilt.
Non-clustered index (index id = 14) is being rebuilt.
(21777920 rows affected)
             Mar 20 2015 1:12PM

Hi Kiran,
I have read your response a few times and I was not able to understand your angle. I assume based on the results of my test that Sybase does the following in processing the alter statements
ALTER TABLE Order2
ADD OR_N BIT DEFAULT 0 NOT NULL, OR_S BIT DEFAULT 0 NOT NULL
go
process alter ADD OR_N BIT
-- > make copy of table
---> alter original table
--> put data back in
process alterOR_S BIT
-- > make copy of table
---> alter original table
--> put data back in
rebuild index
my expectation was that it would make a copy of the table only once and process the two alter statements. Also when doing the alter separately (test1) it rebuilt the index twice, however using the batch the index was rebuilt once (at least only one message displayed).
Regards.

Query tuning and using the "better" index.

I have a database table with about 40,000 records in it. Using
a certain index first limits the number of rows to 11,000
records. Using a different index first (by disabling the other
index in the query) limits the number of rows to 2,500 records.
Using the explain plan, the rest of the query is parsed the same
way for both queries. What reasons can explain why when the
index that returns 11,000 records first runs faster than
the "better" index? I thought the whole idea behind query
tuning is to use the index that limits the data the most.

It looks like Oracle likes the equality condition more than the greater than -less than combination (which you might like to recode as a BETWEEN condition for clarity).
There are a number of factors here.
i) Are the "test names" equally distributed? Do some test names appear with greater frequency than others? If so, collecting column statistics might cause the BATCH_2 index to be used for some test names, and not for others.
ii) Likewise, what is the distribution of cdates? How does the distribution of cdates vary by test name?
iii) You could force the use of the BATCH_6 index over the BATCH_2 by using an optimizer hint instead of dropping the BATCH_2 index ...
select /*+ index(batch batch_6) */ id, test, cdate
from batch
where test = 'Some test name'
and cdate >= &start date&
and cdate < &end date& + 1
... or even try prompting Oracle to use both indexes ...
select /*+ index(batch batch_6) index(batch batch_2) */ id, test, cdate
from batch
where test = 'Some test name'
and cdate >= &start date&
and cdate < &end date& + 1
... and test the response times, then chose to use the optimizer hint in your application
iv) You might like to replace the rather unselective BATCH_2 index with a BATCH_2_6 index on both test and cdate (in that order). That would probably give you an excellent result, and the BATCH_6 index can still be used to satisfy queries slective on cdate that are not selective on test (in very recent versions of Oracle the BATCH_2_6 index might be used for such an operation, and you could drop both BATCH_6 and BATCH_2)
Well, see if any of this helps.

Conform greyed out in the Clip Window?

It used to be easy . . .
I want to conform a 720p 50fps QT clip to 25fps.
As per the Manual, I opened the clip in CT but "Conform" is greyed out in the Clip Window.
I attempted a Batch Conform but it showed the process at 50% then CT quit.
+Where did I go wrong!+ ??

is fcp showing your original clip as 720p50 or 720p25 ?
If it shows as 720p25 with 50fps (lets say you used 720pN mode on hvx200) then CT should conform ok. if it shows 720p50 at 50fps then it wont (i dont know why though sorry..)

ODC - Insert Page During Indexing

Using ODC 10.3.5.1, a user has a document that has been committed using Import Server (or possibly scanned via Batch Manager). In either event, the document goes into the indexing queue. While indexing the document, the user wants to insert a page, ideally a separator. Can inserting a page be done in the INDEXING process?
The main use case is an email with multiple attachments being ingested via Import Server. The user will not have an opportunity to insert a page in the batch scan process in this case, and would need to separate the attachments from the indexing queue. This newly inserted page would really function as a patch page.

You might not be able to add any page to the batch while Indexing (with batch created by any option ie.Importing/Manually Scanning/etc.).
But if you are scanning a batch via Batch Manager, while "Review Batch" you can add any page into the batch.
But the scenario that youave depicted, doesnt it seperate the attachments by default while importing emails?
Will try to check this further.
regards,
Pradeep Mahajan.
http://ucmchronicles.wordpress.com

Sorted dynamic list problem - Azure Search Index

Hello Everyone,
Let's consider following problem: Vote app - we have 1000 NBA players and we want to create an app which first: let user vote for a player he wants to see in the All Star Game, second: user gets current rank list (example: Michael Jordan 1st - 1M votes,
Derrick Rose 2nd - 0,9M votes, .. , Freddy Kruger - 999th - 0 votes and so on).
Question: what is the best structure that can be implemented here to keep this data sorted? I would like to query this data source already sorted - it is not allowed to get the list of 1000 and sort locally in app. For example: 800 players can have 0 votes
and I do not want to download their names just to display '0 votes' next to their names. I would like to get only 50 with highest score at the moment. Index should be refreshed-rebuild after each new POST-vote request.
Can Azure Search service and its Index help me to solve this problem? The perfect .NET SortedList synchronized structure would look like this [votes][name]:
SortedList[99982]['Michael Jordan']
SortedList[89921]['Derrick Rose']
SortedList[0]['Freddy Kruger']
SortedList[0]['Ace Ventura'] -> but SortedList does not allow the 0 KEY to appear twice.
Regards,

Hi pr0t,
It should be straightforward to get the data you want using the $orderby, $filter, and $top options. For example, if you have a field named vote, you could include this in your search request:
/indexes/players/docs?$orderby=vote desc&$filter=vote gt 0&$top=50
This will give the top 50 players by vote in descending order by vote. You can then put the data in whatever data structure you like on the client.
One thing to be aware of though is the way you update votes in the index. We highly recommend batching index updates as much as possible rather than updating one document at a time. You can have up to 1000 documents in a single batch when indexing. This
reduces overhead and indexing pressure on your search service.
Hope this helps,
-Bruce

Conforming 30P to 25P

I have 30P media which needs to be conformed to 25P. Do I just drop my clips on a 25P timeline, and select conform speed? or would I batch conform in Cinema Tools?

Cinema Tools if you're working with QT files outside of FCP X, but don't alter files already in an Event folder.
Conform in FCP X is, in fact, the Cinema Tools algorythm, so it's all the same thing.

Best way to conform to 24fps

I have some videos(29.97fps) what I want to conform to 24fps.
What is the best way to do?
thx

Cntl-Click on one of the files, open with Cinema Tools, click conform in lower right corner select frame rate. You can also Batch conform from the File menu in Cinema Tools.
You do understand that conform means modify playback speed so each individual frame is retained but play at a different speed. Conforming 29.97 to 24 (or 23.976) will slo-mo the video to approx 80% of normal.

My source audio isn't importing. Any ideas for how to fix?

The audio is there. I've watched it in VLC, and the audio is there. Whenever I import the footage, though, it goes missing. Any ideas for how to fix it?

Welcome to the forum.
First, more information would be useful. See this FAQ Entry for what info will help: http://forums.adobe.com/thread/961741?tstart=0
Also, when you Import your AV file, do you allow PrPro time to Conform the Audio portion? For more info on Conforming, Indexing and PEK file creation, see this article: http://forums.adobe.com/message/3892177#3892177
Good luck,
Hunt

Premiere Timelines - Best Practice and Workflows

Hello all, I am wondering if you can offer some advice.
I have been a Final Cut Pro 7 user my whole life - and more recently FCP X. We are currently looking into the possibility of switching some of our programs over to Premiere because it seems to have a mix of features somewhere between 7 and X. However, I am finding it a little hard to come to terms with the way Premiere handles codecs, timelines, transcode workflows, etc.
For example... In FCP 7 you would usually create a timeline that uses ProRes422, convert what you need (either log & ingest or batch conforming) and then edit with the ProRes footage and then export directly to ProRes for broadcast or Compressor for previews.
The upside being that all your rendered frames on the timeline are stored and ready for when you need to export.
With Premiere... It seems to 'not mind' when footage comes in Natively (C300, XDCAM MXFs, etc.)... Great! Except, using the workflow mentioned earlier leaves you with:
- A ProRes Timeline
- A tonne of unconformed media
- A rendered timeline that seems to have no bearing on the final export speed.
I'm flummoxed! Even when I've checked 'use preview files' (from a rendered timeline), I seem to have large waits on my hands. It's not hardware, we're fully tooled with new iMacs and even MacPros - I've tried all the different settings for CUDA, Mercury, Software Only, etc. etc.
So for an FCP user, can anyone recommend improvements to this workflow? What am I doing wrong? Premiere seems like a very good, solid & stable editor now (where previously it wasn't) but the export and render times are not leaving me impressed, especially when FCP X seems to leave it in the dust!
Any and all advice welcome - thanks very much!

The first important step is to forget about 'log & ingest' or 'batch conforming'. PR edits natively, thus saving you the time consuming conversion step before you can start editing.
Because PR edits natively, you don't end up with a ProRes timeline, but only with native material.
Conforming audio is still needed. Nothing can be done about that.
Rendering a timeline has no bearing at all on exporting. Rendering is only necessary in limited cases for preview purposes.
It is better not to check 'use preview files' when exporting, because it can lead to quality loss.
In general, copy your source material to a local hard drive, import with the Media Browser, create sequence from clip (so your sequence settings match your source material) and edit away. For preview purposes you may want to render the timeline occasionally. When done, you export to the destination format without using 'use preview files' or 'match sequence settings'.
If you find render times too long to your liking, you may need to increase your CPU power (more cores, higher clock-speed) and get more memory.

Batch conform/index?

Similar Messages

Maybe you are looking for