Kernel 2.6.32 will boost x264 encode speed BIG TIME for multicore CPUs

It's due to a tweaked scheduler in the 2.6.32 codebase. I measured a 53 % speed boost comparing 2.6.31-5 to 2.6.32-rc6 on my quad. See my post over at the handbrake forum here for details and see this page too.
The test encode was a 60 fps 720p (1280x720) encode using the "High Profile" on handbrake snapshot 2907 (which you can get in the AUR here):
Arch x86_64 (kernel 2.6.31.5): avg 15.99 fps
Arch x86_64 (kernel 2.6.32-rc6): avg 24.45 fps
Linux (kernel 2.6.31-bfs): avg 24.49 fps
Win XP 64-bit edition: avg 20.41 fps
Linux is 53 % faster w/ the new kernel and 20 % faster than Windows. Can't wait for 2.6.32 to go final!
Last edited by graysky (2009-12-06 10:57:58)

bangkok_manouel wrote:
MP2E wrote:Epic! I always encode things in x264(though through FFMPEG, though that shouldn't make a difference since it uses the x264 library, should it?) but I'm a user of BFS. Since you are referring to a scheduler change, will this affect me?
you'll need to go back to the mainline CPU sched (CFS)
But this bug was noticed in the first place because BFS kicked CFS's ass with x264, so sticking with BFS is fine
@tomd123: It's a general improvement in the scheduler, which should translate to other workloads as well. x264 got a huge boost, not everything will get such a huge increase in speed.

Similar Messages

Premiere export for X264 encoding in Quicktime

If I am going to ecnode a file through X264 encoder after editing in Permiere Pro 5.5, what codec should I export out of Premiere or Adobe Media Encoder first? =
Thanks

Peter.
Some times you have to let things go a bit because "video" is a different world to stills and print media. (although that is a can of worms in itself)
Your clients or audience do not have a side by side comparison ( as you do) and their display devices and set ups are simply something you have no control over.
Something you do have control over is your own system so set it up and then trust the waveforms and other scopes. That is your personal reference point.
I see no value in getting a "TV" for this purpose. A decent Computer Monitor will serve you better.
BTW - here is no harm in making a little "compensation" for the export media. I wil often add 'Gamma Correction' (Effect) for a QT Export intended for broadcast. ( I add +1 to base of 10. ie. 11)

Quicktime encoding using x264 encoder failing in AME 6.0.2.81 and Mac OS 10.8.2

I'm trying to encode an x264 codec Quicktime using AME 6.0.2.81 and Mac OS 10.8.2. I also tried it with two versions of the x264 encoder which I downloaded from here: http://www.macupdate.com/app/mac/24173/x264encoder
This encoder works 100% fine and better than the h264 encoder when using Apple Compressor and Apple QT Pro V7. I've been however trying to transition all of my video encodes to AME due to a number of reasons: dynamic link to AE, Premiere and the interface to name a few.
Everytime I start an encode it gives me an error and I hear that blasted sheep. lol. This is what the log displays, which is frankly probably no help to anyone.
- Encoding Time: 00:00:00
01/13/2013 04:48:10 PM : Encoding Failed
Export Error
Error compiling movie.
Unknown error.
I've also tried to specify the bitrate and have had no luck. Whether I specify the bitrate or not, I still get the error. The source video has been PNG sequences and ProRes movies at 1920x1080, 29.97fps. Both result in the same unknown error.
Any suggestions? Thanks!

I know this is pretty old now, but I thought I'd add a reply for those who are having this issue. I just had AME CC 2014 fail on me today, and this is the FIRST thing I've ever tried to render with it. I'm using a TGA sequence and exporting to an X264 codec Quicktime MOV file at 720p. I restarted a few times, repaired permissions etc. and nothing worked except for the following.
I went to:
Library/Preferences/Adobe/Adobe Media Encoder/8.0/
I deleted the entire 8.0 folder (or you could delete whatever version you are having problems with). I then restarted AME and the preferences were recreated and I could successfully use the x264 codec again. Hope this helps someone.

When will Adobe media encoder 8.0 with wraptor DCP support be availabile

when will Adobe media encoder 8.0 with wraptor DCP support be availabile

Was that a video showing the 2014 updates?
Do you have the CC 2014 updates installed?
Have you checked with other user in that forum to see if there is more information there? Adobe Media Encoder (AME)

Project Settings vs. Encoding and Encore Resolution for BR

I am editing HDV footage from a Canon HV20. When I setup my project in Pr Pro I used the recommended
default HDV project settings. Hopefully these are correct. I will be burning a Blu-Ray disc for the project.
I assume like other products I have used, the best answer here is the native resolution of your source which hopefully is what I am getting.
Now when I render it via media encoder, it asks me for the "frame size"/resolution for the Blu-Ray disc output.
Also when opening a new project in Encore, it asks for similar information. I am in NTSC land.
I am familiar with the HD standard and resolutions, and the end result of this project is a Blu-Ray disc played on HDTV's.
However what is the best media encoder resolutoin and encore "frame size" settings for a Blu-Ray disc with an HDV source?
I saw several articles and videos from Adobe about these settings and they explain what they are, but not what the recommended selections are.
As a sidenote, once you are working on a project in PP can you change the settings/resolution of the project?
Thanks,
BJBBJB1
PS...Did not know which forum to post this in as it straddles all 3 products!!

First, thanks to both of you for your help! Hmmm, I am sure the confusion is on my end....
Both of you recommend H.264 vs. MPEG 2 for encoding. If I am rendering a 1 hour 20 minute Blu-ray, for burning Blu-Rays that I need to paly on a white variety of standalone players, what is the better choice and whay? I was planning on burning to single layer Blu-Ray at best quality. I am also using 5.1 audio.
For the encoder, I was going to use "HDTV 1080i 29.97 High Quality" as my rendering preset with MPEG2.
However now I am wondering if I should be using H.264? Harm, you mention it and you also mention "square pixels". I am familiar with this concept due to my photography work and slide shows vs. video, but where is this "square pixel" setting in the media encoder??
Anna, I appreciate your comment regarding keeping it simple, however, although I am far from a PPro expert, I definitely am into Home Video and understand quality and resolutions, etc., so I want to get the best quality even if I have to do a little work.. So I'll get there. I see that clicking on that menu item allows you to choose maximum render quality. I have plenty of RAM but since I am not going SD to HD or SD to HD, perhaps it won't matter much. However I am confused by the resolution you are showing there, 1440x1080?
As far as my initial question regarding how to setup my encore project, I may have answered it myself by playing around with the media encoder box. I opened up the drop down advanced section and I see it presents the frame dimensions there. I would assume I would use the exact same frame dimensions in Encore when setting up my project.
So I guess at this point my only decisions are:
1) What codec should I use when exporting from PPro? h.264 or MPEG-2. If it matters, I am using 5.1 audio also. (thanks for all your help with that Harm months ago, it works great!).
2) What resolution to use in media encoder?
3) How do I set square pixels?
4) Once exported, in Encore, is my assumption correct that I will just use the same resolution as exported from P Pro.
Perhaps that is what Anna was recommending, keep the same resolution and then let Encore render to 1920X1080 however I would want to get all my rendering out of the way during the export process and just keep it all the same in Encore if that is a good workflow.
Thanks again for all the help!
BJBBJB1

XMLReader throws "Invalid UTF8 encoding." - Need parser for ISO-8859-1 chrs

Hi,
We are facing an issue when we try to send data which is encoded in "ISO-8859-1" charset (german chars) via the EMDClient (agent), which tries to parse it using the oracle.xml.parser.v2.XMLParser . The parser, while trying to read it, is unable to determine the charset encoding of our data and assumes that the encoding is "UTF-8", and when it tries to read it, throws the :
"java.io.UTFDataFormatException: Invalid UTF8 encoding." exception.
I looked at the XMLReader's code and found that it tries to read the first 4 bytes (Byte Order Mark - BOM) to determine the encoding. It is probably expecting us to send the data where the first line is probably:
<?xml version="1.0" encoding="iso88591" ?>
But, the data that our application sends is typically as below:
========================================================
# listener.ora Network Configuration File: /ade/vivsharm_emsa2/oracle/work/listener.ora
# Generated by Oracle configuration tools.
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = semsa2)
(ORACLE_HOME = /ade/vivsharm_emsa2/oracle)
LISTENER =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = tcp)(HOST = stadm18.us.oracle.com)(PORT = 15100))
========================================================
the first 4 bytes in our case will be, int[] {35, 32, 108, 105} == chars {#, SPACE, l, i},
which does not match any of the encodings predefined in oracle.xml.parser.v2.XMLReader.pushXMLReader() method.
How do we ensure that the parser identifies the encoding properly and instantiates the correct parser for "ISO-8859-1"...
Should we just add the line <?xml version="1.0" encoding="iso88591" ?> at the beginning of our data?
We have tried constructing the inputstream (ByteArrayInputStream) by using String.getBytes("ISO-8859-1") and passing that to the parser, but that does not seem to work.
Please suggest.
Thanks & Regards,
Vivek.
PS: The exception we get is as below:
java.io.UTFDataFormatException: Invalid UTF8 encoding.
at oracle.xml.parser.v2.XMLUTF8Reader.checkUTF8Byte(XMLUTF8Reader.java:160)
at oracle.xml.parser.v2.XMLUTF8Reader.readUTF8Char(XMLUTF8Reader.java:187)
at oracle.xml.parser.v2.XMLUTF8Reader.fillBuffer(XMLUTF8Reader.java:120)
at oracle.xml.parser.v2.XMLByteReader.saveBuffer(XMLByteReader.java:450)
at oracle.xml.parser.v2.XMLReader.fillBuffer(XMLReader.java:2229)
at oracle.xml.parser.v2.XMLReader.tryRead(XMLReader.java:994)
at oracle.xml.parser.v2.XMLReader.scanXMLDecl(XMLReader.java:2788)
at oracle.xml.parser.v2.XMLReader.pushXMLReader(XMLReader.java:502)
at oracle.xml.parser.v2.XMLReader.pushXMLReader(XMLReader.java:205)
at oracle.xml.parser.v2.XMLParser.parse(XMLParser.java:180)
at org.xml.sax.helpers.ParserAdapter.parse(ParserAdapter.java:431)
at oracle.sysman.emSDK.emd.comm.RemoteOperationInputStream.readXML(RemoteOperationInputStream.java:363)
at oracle.sysman.emSDK.emd.comm.RemoteOperationInputStream.readHeader(RemoteOperationInputStream.java:195)
at oracle.sysman.emSDK.emd.comm.RemoteOperationInputStream.read(RemoteOperationInputStream.java:151)
at oracle.sysman.emSDK.emd.comm.EMDClient.remotePut(EMDClient.java:2075)
at oracle.sysman.emo.net.util.agent.Operation.saveFile(Operation.java:758)
at oracle.sysman.emo.net.common.WebIOHandler.saveFile(WebIOHandler.java:152)
at oracle.sysman.emo.net.common.BaseWebConfigContext.saveConfig(BaseWebConfigContext.java:505)

Vivek
Your message is not XML. I believe that the XMLParser is going to have problems with that as well. Perhaps you could wrap the message in an XML tag set and begin the document as you suggested with <?xml version="1.0" encoding="iso88591"?>.
You are correct in that the parser uses only the first 4 bytes to detect the encoding of the document. It can only determine if the document in ASCII or EPCDIC based. If it is ASCII it can detect only between UTF-8 and UTF-16. It will need the encoding attribute to recognize the ISO-8859-1 encoding.
hope this helps
tom

Will a 256 gig SSD be enough for caches or should i go for 500?

I'm getting a laptop for AE which will come with a terabyte HDD. Im going to put the OS and AE on an SSD. Do you think 256 gigs will be enough or should i go for 500? How much space would be enough for caching? I dont want to get a 500GB SSD and then realize it was overkill. thanks

Yes, you're right about the boot and application start.
And that's just the point for putting user files on the SSD. SSD's are far faster at reading & writing than a hard drive... with no physical wear & tear. And when you're reading a hundred layers of HD footage and a hundred more layers of Photoshop & Illustrator documents -- for each and every frame of your AE composition -- you stand to boost the machine's performance significantly with shorter read times multiplied by 200... to say nothing of the absence of physical wear & tear.
You might also consider putting media files on an external hard drive.

What factors affect encoding speed the most?

Hello everyone,
I am actually quite happy with the encoding speed to DVD formats. I was under the impression that encoding was "real-time". Encoding a 1 hour long PAL 48kHz capture from VHS to DVD only took ~30m.
I opened the task manager and noticed that both cores of my Athlon X2 5400 were running flat out during this process. Thus I take it encoding can utilise multiple cores.
My questions are:
If I upgrade to a Quad core CPU what performance increase would I see with the encoding example above? 15m?
What influence does hyperthreading have -if any?
Do you expect that PE8 will support nVidia CUDA at some stage? I notice that the latest Roxio software does.
Will the encoding slow down dramatically when I start working with HD content?
Do any of the Matrox hardware encoders work with PE8? They only seem to support Premiere CS4
I have SATA-II RAID 0, 2GB RAM, AMD Athlon X2 5400+ and XP SP3
Justin.

Export and Rendering speed can also be affected by one's I/O sub-system, i.e. your HDD's (Hard Disk Drives), their speed, amount of free space, the controller type and how you have these HDD's allocated.
With the exception of AVCHD, which Steve mentions, having separate physical HDD's (not partitions - logical drives), will speed things up greatly, as all operations on the computer, access to the OS, the program, the media files and then outputting from the program, will be spread over several HDD's. If you only have one physical HDD, everything has to flow through one "pipeline," and this adds significant time to the processes. Having partitions will slow things down even more, and can even cause hangs, because the OS "thinks" that it has multiple HDD's to use, but only has one. It cannot understand what's taking so long, and grows impatient.
With AVCHD, the CPU is used much more than even the I/O sub-system, and becomes the most important link in the chain.
Good luck, and let us know all about your HDD's, their number, size, speed, controller type, say SATA II, and how you have these allocated.
Hunt

Encode speed

I was running a few experiments with iMovie encoding and was wondering whether my experience was 'typical'.
I was encoding 1 minute of PAL DV video to h.264 at full quality (25 fps, full resolution, any more important parameters I should mention?) and it took about 4 minute using the single pass encoding. It took around 9 minutes using the multi-pass encoding.
I have seen some people talking about real-time encoding and was wondering if iMovie managed this or if it was just something you got with Final Cut Pro or similar?
(Also, I noticed horrendous tearing in all motion which I presume are interlacing artifacts as a result of some known iMovie bug - is this where I need to use JES deinterlacer to fix this in some way? What exactly do I need to do? It kept giving me a "movie time error #-2015" whenever I tried to open the exported movie)

Seems that the Quicktime H.264 encoder is pretty slow. Found that the open source x264 encoder in Handbrake seems to work much faster.

Improve encoding speed for WMV output?

Hi,
Firstly, apologies if I am posting this in the incorrect area of the forums. I'm not entirely sure it's a hardware issue, I think it might be codec related.
I am trying to find a way to reduce encoding times for a (on average) 4 minute clip using Premiere/AME CS5
My input format is either XDCAM HD or IMX50, my output formate is always wmv, 720x 576 (PAL) interlaced, currently single pass encoding (because of the time taken) using the Windows Media Encoder (wmvencod.dll).
There are no effects, nor transistions in my sequence. 2 tracks of video - 1 actual video, the second a logo overlay. 1 stereo pair for the audio.
Hardware is a single Intel Xeon, quad core 2.5Ghz processor, currently with 10Gb memory. I have tried doubling up on the processors and also increasing the memory up to 16Gb but the improvements are marginal. Switching hyperthreading off also provides a marginal improvement in encoding time.
I am running this on a server class 1u box. Currently it only has the standard vga server graphics card in it. I have mixed feelings about installing a graphics card as I have read conflicting information about whether it will provide an improvement in my encoding time.
I don't think MPE is relevant, given that I'm not doing any effects processing.Will the CUDA architecture provide a significant improvement?
I can only find 2 graphics cards that I think will fit in the box and these are the Quadro 4000 and Quadro FX 3800 that retail at around £650 - £800 + so it's a significant punt if they aren't going to provide an improvement.
In essence, I have a template (well a couple of) project that I add the source file to each time that gets dropped into AME for encoding. For HD source encoding takes about 4 times real time. For SD it's about real time.
If I chose a different output format, with the same input format eg h264 or DV (avi) then the encoding time is reduced to roughly 1/3rd of what I am experiencing at the moment. That gives me the impression that the wmv encoder is the bottle neck
Are there alternatives to using the standard Microsoft WMV encoder? If so, how do I go about getting AME to use them, given that prior to installing Media Player I didn't even have wmv as an export option.
Any thoughts on this would be appreciated.

I couldn't tell you whether or not it uses the same dlls as the Microsoft program... that's getting deeper under the hood than I usually go! :-) If it is, then you're correct in that going to an intermediate and using WME isn't going to speed up your process.
For more info on hardware, go to www.ppbm5.com and look at the test results page... see what folks were using who got the higher results. IIRC, your specific processor (even in its dual form) is a rather poor performer with this kind of stuff, and the Core i7 line is much better.
Out of my own curiosity, I'm running a test on my system to see if I can reproduce the similarly long encode times with WMV versus h.264. I've got a 4:23 AVCHD clip which I'm rendering first using h.264 MainConcept to PAL DV Widescreen HQ (the only reason I'm using PAL here isbecause that's what you're using, and I wondered if it would go differently than NTSC... I've never used PAL before). The full encoding time for that in h.264 was about 1:45, so a little better than double real time. The same clip, rendered with WMV using PAL Widescreen source to HQ Download is taking about 3:15, so pretty much double the h.264 clip's time, but still better than realtime, and nowhere near the results you're getting.
I don't remember what you said your HD setup was like, but make sure you've got multiple hard drives, preferably a RAID for your data disk. I learned that having a good disk configuration can really make a lot of difference, all other things being equal!

Hi Team, Showing Yellow icons after every 15 to 20 Min and internet stop working.when we enable- disbale the network connection then will internet start working fine.Some time network connection is disable but when we renable that connection it will st

Hi Team,
Showing Yellow icons after every 15 to 20 Min and internet stop working.when we enable- disbale the network connection then will internet start working fine.Some time network connection is disable but when we renable that connection it will stuck on enabling
and will not renable till i am not restart that machine. I have 350 Machine in network but facing this issue in 25 machines. Kindly help me on this issue .
Regards
Sahil bhateja

Hi，
So switch a LAN card fix this issue...seems a compatibility issue or maybe some packs or programs you installed recently cause this issue.
Have you manually check the network adapter driver from the PC's manufacture website? sometimes, it will be a time delay before Microsoft push out the driver update.
Check if issue exists in safemode with network, this mode will launch Windows with limited sets of files and drivers.
if you have a restore point, restore the pc to a previous point at which the pc is functioning fine.
Yolanda Zhu
TechNet Community Support

My G Drive will not show up on my desktop for use. It did yesterday. It is not full and currently the light turns on and seems to be running but will not show up on my desktop. What can I do?

My G Drive will not show up on my desktop for use. It did yesterday. It is not full and currently the light turns on and seems to be running but will not show up on my desktop. What can I do?

1. verify on another Mac first. and another port.
2. very likely dead SATA card
read about it here:
Your dead external hard drive is likely fine! Great hope for your 'faulty' external HD

I have a macbook pro 10.8.5 and the Application Safari will not open no matter what i do, I try to open the menu of Safari but it won't let me either, the mouse will just be loading. Each time i open it, it says "Application Not Responding"

I have a macbook pro 10.8.5 and the Application Safari will not open no matter what i do, I try to open the menu of Safari but it won't let me either, the mouse will just be loading. Each time i open it, it says "Application Not Responding" and I try opening it in my Finder and it'll say "The Application 'Safari' cannot be opened." and below that it'll say "-1712" Please help? I would really like to open it again.

The application Safari can't be opened -1712
What to do about "The application 'Safari' can't be opened" -1712 ?

What would happen if I turn off my backup and delete backup data From my device? Will it delete my music and everything for ever or just stay in the cloud but not on my device?

What would happen if I turn off my backup and delete backup data From my device? Will it delete my music and everything for ever or just stay in the cloud but not on my device?

If you have multiple devices backing up to the Cloud, you will see all of them listed. You would click on each device to change what is backed up from that device. You can then delete your individual back-ups.
Once you have all your settings to your liking, you can then go back to Settings>iCloud>Storage & Backup, and click on Back Up Now (bottom of the screen) to create a fresh backup with your new settings.
Cheers,
GB

HT4325 Will there be a point in time when I can multiple speaker play to my Air devices, and my AppleTvs? Or do I need redundant Air @ the tv too?

Background
I drank the coolaid and have a MacMini command center along with all my PC's and Wifi and this and that.
I have a few Airport expresses in random locations.. bathroom.. kitchen... I also have an Apple Tv in the fam room, and bedroom.
From the Mac I see I can play songs in iTunes, click Multiple speakers, and choose all my AirExpress devices. However I cannot also mutiple to the AppleTvs. Of course I can AirPlay to a single tv, or a single AirExpress.
Question
Will there be a point in time where I can choose 'Multiple Speaker', and select all my home AirExpress class devices, and the AppleTv devices?
Current Infrastucture --- Will easily support my ambient musical desires.
     Mac Mini 2012, running 10.8.
     AirPort Expresses, newest generation.
     AppleTv 3's, 5.1 not the developer 5.1+ yet.
     Whole house each floor and exterior, one SSID wifi network, multiple bands, (cisco e3000)'s running dd-wrt with a backend WDU.
     Multiple Linksys (SRW208P)'s wired switching fabric, 802.1q and all that jazz.

Ok looks like the latest updates made this possible.

Kernel 2.6.32 will boost x264 encode speed BIG TIME for multicore CPUs

Similar Messages

Maybe you are looking for