Help for Image detection in video & hardware issues

Hi,
I am trying to develop a web app that lets the user select shapes in a video(user can click only on detected shape if clicked elsewhere it should inform user to click only on the detected shape)
Then the location of the clicked position is determined & a robotic arm(at remote location) is moved to that position
I am a newbie on JMF
I do have a solution: load video on an applet(which can help in determining location of click but how would it know that the clicked position has the detected shape or not)
And here are my questions:
Is solution right?
Are there other solutions that i miss up?
What is the best language for hardware (microcontroller) programming here?
Is interaction between JMF & remote hardware possible & how?
Thank u all in advance

saurabh.nigam wrote:
Is solution right?The thing you're calling a "solution" doesn't appear to be a solution. Normally, solutions don't have questions embedded in them...
Are there other solutions that i miss up?Again, you're not being clear and you're nowhere near a solution...
What is the best language for hardware (microcontroller) programming here?That's not a question for this forum. This forum is for questions about the JMF API...
Is interaction between JMF & remote hardware possible & how?Yeah, you can always send commands via a socket using normal Java stuff. JMF isn't a special langauge or anything, it's just some Java classes that do media stuff...
In order to do what you're wanting to do, you'd have to implement a series of "not easy" things to implement.
1) You'd need to implement some sort of blob detection / extraction code that would take in an image and detect / extract the blobs in it.
2) You'd need to implement some sort of blob shape filter that would filter out all of the detected blobs that aren't a shape you're happy with
3) You'd need to embed your blob code into a JMF effect class so it could process video frames as they come through
4) You'd probably also want to augment the video stream with outlines or translucent colored regions to indicate to the user where the clickable blobs are...
5) You'd need to implement a socket-based control protocol for controlling the remote hardware.
All of that is possible with Java / JMF, but none of it is easy.

Similar Messages

  • Help for image pattern matching

    Hello Everyone
    I am working for my last year project. In my project I will work on the image processing to find a moving object. I will work by JMF. I have finished to grab a frame from the webcam video clips. Now I need a algorithm to find a Image pattern from the grabed image. But I donot know which algorithm is fine for image pattern matching as well as how can I implement in java. Is anyone know please help me very urgently.
    Thank you
    Md. Mainul Hasan

    If you would like to take a look at http://www.exactfutures.com/index01.htm and http://www.exactfutures.com/index02.htm and http://www.codeproject.com/useritems/activity.asp then these pages and links may well be useful to you. It may not be exactly what you are looking for, but it does point to some examples with source for video analytics, and at the very least they illustrate how to capture & handle the data including a fast movement detection algorithm. If you want to find a specific shape then search the internet for information on chamfer distance transforms - one can use JMF or extend these simple examples to apply those techniques.

  • Hi Everyone,I need your help for Recovery as I face APPCRASH issue :(

    Hi,
    since I bought my laptop I noticed that no application of Cyberlink was working like DVD Suite or Power2go.But I did not pay attention to that.
    But nowafter one and hal years when I want to refresh my laptop by using Recovery Manager and recovery Disc Creation, it is giving me same APPCRASH error as it has been giving for Power2go or DVD Suite.
    F11 does not work as well it says something like drive is inaccessible or software/hardware issue...
    Still my laptop is fine but a little heavy that s why I wanted to refresh it
    No hardware or sofware changes were made ever.
    Laptop specs. are:
    HP Pavilion dv4i 2100, Notebook PC
    Serial # {Removed for privacy}
    Product # VN673AV
    Warranty has been expired  
    At HP website regarding this issue they say to turn on wireless before Recovery but it does not work for me.
    Please anyone HELP me out please.
    waiting anxiously for any positive reply!!!
    Kind Regards,
    Jawwad

    I did exactly as I described in my loaner Envy17-3002ea's Disk management. see the image 
    ****Please click on Accept As Solution if a suggestion solves your problem. It helps others facing the same problem to find a solution easily****
    2015 Microsoft MVP - Windows Experience Consumer

  • Creative Sound Blaster Audigy LS "WINDOWS CANNOT DETECT A SOUNDBLASTER HARDWARE" Issue!!!

    <EM>Hi all to cut the long story short I have had my audigy Ls card for a little over an year now, everything worked fine until I have decided to reformat my computer due to regular maintenance and this was roughlly 2 month ago, anyway I have explored all the different avenues and have found my self stranded to this point. </EM>
    <EM></EM>
    <EM>Basically</EM> <EM>I have the drivers (from creative official driver downloading page) for the sound card installed and its running fine however not flawless due to the fact that my original CD that came bundled with the card cannot be installed anymore, ever since I have reformatted my PC. windows just couldn't detect my exisiting AUDIGY LS card and keeps error out when the installation starts and states that windows can not detect a sound blaster card in your system etc etc. </EM>
    <EM></EM>
    <EM>Now I know for a fact that everything worked fine with the drivers installed correctly without any issue prior to my format. is there any any any any!!! way to actually overcome this nuisance ? Im getting really pissed of as I no longer could enjoy the full benefit of my sound blaster </EM>
    <EM></EM>
    <EM>e.g creative media centre, sound equilizer, 6/24bit adjustment. </EM>
    <EM>I have switched the card in other PCI slot, it's no use and I have tried and obviously failed to do everything I could to solve this problem. the onboard sound has been disabled.AC97 and I really couldn't figure out why...strange ...</EM>
    <EM></EM>
    <EM>I have searched the forum for valuable infomation as I seen a couple of people are suffering the EXACT same issue as I'am. </EM>
    <EM></EM>
    <EM>My system spec is as follows.</EM>
    Asus P4P800 Deluxe MOBO
    P4 3G CPU H. T Enabled
    G KINGSTON RAM
    6600GT WINFAST GFX CARD
    <EM></EM>
    <EM></EM>

    Hi All,
    I am pretty much in the same boat but with an Audigy 2 Value Sound Card.
    Removed some old piece of rubbish card (6MB Aztech PCI 288 Q3D using a Trident 4DWave-NX Chip.... yes about 6 yrs old !) in my daughters pc and replaced it with the new one.
    Same error message i.e. hardware not detected... ihave already posted as im trying to find and install the right drivers. I have also tried the PCI-slot hopping etc etc.
    So what next people ?

  • Scripting help for image pop-up within a PDF

    Hi,
    I'm creating some sample eBooks in Acrobat Professional 9 (Mac), and I am stuck on one element that needs to be present. In the text within the PDF, there might be a phrase like, "See Fig. 1". Fig. 1 might not be on that page, however. I know how to create a link in a PDF that will navigate the reader to the page with the image referenced, but that's not good enough. I'd like to have this happen:
    User clicks on "See Fig. 1".
    Popup window appears with the referenced thumbnail image.
    The image's popup window will stay on-screen until dismissed by the user.
    Clicking on the popup thumbnail image calls up a full-size image.
    The added wrinkles are many after we figure out the scripting for the above, but here are two major ones to be addressed right away:
    1) The images are already part of the typeset document converted to PDF, so I am guessing the images would have to be bundled with the PDF somehow. Our users need to use the PDFs in an offline environment, so a call-out to a URL is out of the question.
    2) The PDFs will be read on Macs, PCs, and possibly iPads. If a bundled, local file is called out when a user clicks on "See Fig. 1", how do I set a relative filepath in the call-out?
    Thanks for any help you can provide.
    Andrew

    Here's a sample document that demonstrates some of what you're asking about: https://acrobat.com/#d=aP-2xL45pM57xVkT6d6fSg
    The images are stored in buttons, so there is no concern about having to use external images. Note that this may not work on an iPad since most (all?) PDF viewers on the iPad do not have JavaScript support.

  • Need Help for Image Processing

    Hi everyone,
    my name is Davide and I am a new member. I apologize in advance for my English that It's not very good.
    I have to do an exercise where I have to draw a SAR(Synthetic Aperture Radar) Image. The problem is that the input image is composed by a binary raster plus an XML parameters file. The XML file contains all the information to correctly read the image.
    I downloaded Java Advancing Imaging Library but I've never worked with this image format and I don't know where to start.
    Can anyone help me? How should i do with the binary raster file? How can i read it?
    Thank you very much.

    Hi everyone again,
    I followed your advice and I studied the theory on raster data so I have made some step forward. Now I have a new problem that I will try to explain you in the better way. I was able to obtain from the binary raster data an array of float.
    From the XML parameters file I know that the rows number are 1000, the columns number are 2000, the pixel type is complex float and that the real and imaginary parts are put side-by-side on a column basis. I created two array, one of the real parts and one of the imaginary parts:
    for (int i=0;i < SIZE_X*SIZE_Y; i++){
       if(i%2 == 0){
          real[k] = bin_input;
    if(Math.abs(real[k]) > max_value_re){
    max_value_re = Math.abs(real[k]);
    k++;
    }else{
    img[n] = bin_input[i];
    if(Math.abs(img[n]) > max_value_im){
    max_value_im = Math.abs(img[n]);
    n++;
    Then I create an array with the absolute value of complex number:for (int i=0;i < SIZE_X/2*SIZE_Y; i++){
    mag[i] = (float) (Math.sqrt(Math.pow(real[i]/max_value_re,2) + Math.pow(img[i]/max_value_im,2)));
    Now I have an array of float with values from 0 and 1. I tried to create a gray scale image because in the XML file it says that the number of channels is 1:BufferedImage theImage = new BufferedImage(SIZE_X/2, SIZE_Y, BufferedImage.TYPE_4BYTE_ABGR);
    WritableRaster wr = (WritableRaster) theImage.getData();
    wr.setPixels(0, 0, SIZE_X/2, SIZE_Y, mag);
    File outputfile = new File("C:\\Sviluppo\\workspace\\Java\\SAR\\Milano.png");
    try {
    ImageIO.write(theImage, "png", outputfile);
    } catch (IOException e) {
    // TODO Auto-generated catch block
    e.printStackTrace();
    The problem is that the image is all black as if the method is not able to interpret the float values and puts everything at zero.
    First of all, do you think the process can be right or is there some logical/theorical error? If it's ok, How can I fix the problem?
    Thank you.                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • Help for Image Distortion Anyone?

    Is there an easy way to get one line of distortion through text like shown in the picture?
    or maybe a similar effect?
    Thank you for any suggestions.

    Good day!
    Depending on the intended use of the text it might be advisable to use vector data.
    If you want to use pixel data there are several options.
    I would recommend using the Filter Displace as a Smart Filter with a custom Displacement Map.
    Regards,
    Pfaffenbichler

  • Newbie Mac user needs help for mac to tv video/audio connection.

    Alright so I scrolled through the forum posts of lots of people with specific problems on connecting to their tvs, but I have a far more general problem.
    I really have no idea what cable(s) I need to in order to watch items playing on my laptop on my tv. It is an older tv, so I don't have HDMI connectivity, so right now my choices are basic 3 component or the 5 input color stream component.
    So what cable(s) do I need to do this? A link to the item(s) in question in the apple store would be very helpful.
    Thanks so much!

    Alright so I scrolled through the forum posts of lots of people with specific problems on connecting to their tvs, but I have a far more general problem.
    I really have no idea what cable(s) I need to in order to watch items playing on my laptop on my tv. It is an older tv, so I don't have HDMI connectivity, so right now my choices are basic 3 component or the 5 input color stream component.
    So what cable(s) do I need to do this? A link to the item(s) in question in the apple store would be very helpful.
    Thanks so much!

  • Need help for image flipping

    How can i flip an image without using g.drawImage method
    bcos i have already used this method in
    public void paint(Graphics g)
    and i can not use this method again it print out errors..
    i want to use anthoer g.drawimage

    here's a short program that loads an image, flips it, and shows it on screen:import java.awt.geom.AffineTransform;
    import java.awt.image.AffineTransformOp;
    import java.awt.image.BufferedImage;
    import java.io.File;
    import javax.imageio.ImageIO;
    import javax.swing.ImageIcon;
    import javax.swing.JFrame;
    import javax.swing.JLabel;
    class Flip {
        public static void main(String[] args) throws Exception {
         // Load jpg file to a BufferedImage.
         File f = new File("/home/jsalonen/Desktop/small.jpg");
         BufferedImage bi = ImageIO.read(f);
         // Flip that image.
         BufferedImage flipped = new BufferedImage(
                       bi.getHeight(),
                       bi.getWidth(),
                       BufferedImage.TYPE_INT_RGB);
         AffineTransform trans = new AffineTransform(0, 1,  1, 0, 0, 0);
         AffineTransformOp op = new AffineTransformOp(trans,
                       AffineTransformOp.TYPE_NEAREST_NEIGHBOR);
         op.filter(bi, flipped);
         // Show it on screen.
         JFrame jf = new JFrame("Flip");
         jf.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
         JLabel showLabel = new JLabel(new ImageIcon(flipped));
         jf.getContentPane().add(showLabel);
         jf.pack();
         jf.show();
    }

  • Help for mature newby with IPad app issue

    Mature user new to IPad just bought ex demo IPad3. Problem, all pre installed Apps are Provisioning Profile Expired. What do I have to do to activate them?

    As far as I know, the device should have been erased and all contents removed befor you bought it.
    That would be done by going to Settings>General>Reset>erase all content and settings and that should (under normal circumstances) totally erase the device and you will have to start all over again. When you activate the device, (which you will have to do since you wiped it) the apps should downlaod as part of the iOS.

  • History of images "captured" from video

    Usually when you import an image, in the History panel you find the first entry states when it was imported eg. "Import (date time)"
    Could we have something the same in the History panel for images captured from video?  At present there is nothing there when you first check it out and you can't truely go back to the start (unless you managed to remember to take a snapshot before you touch a slider.)
    I'm using the Windows 32 bit version.  The above issue is consistent with both the DSLR (Canon 5D II) and normal video I borrowed from my Dad.

    Hi Sarah,
    Good idea. I can't promise you anything on this one but I'll raise it with the team.

  • Why is it that Apple have no interest in helping I have a iPhone 4S and since updating to ISO 7.0.4 I have no wifi at all told me it's a hardware issue and I will be charged for the repair sick of it what a scam

    Why is it that Apple have no interest in helping I have a iPhone 4S and since updating to ISO 7.0.4 I have no wifi at all told me it's a hardware issue and I will be charged for the repair as it's just over a yr old so I've got a 24 month contract so 12 months with a phone that is not working right I have read loads of other people that have the same problem so how can they put it down to the phone and when asked where to take it was told to google it not happy at all apple u need to sort it out never again am I buying anything for yourselfs again DISTGUSTED would be an understatement

    No joy at all they just keep saying it's the phone but was fine before update and @metasolaray why should I pay for extra cover when the fault is not the phone but the update they have put out for everyone to install and I am far from being the only person as there is hundreds of people going through the same with this update and it's not been the first time they messed it up
    WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    56888 Views 229 Replies Latest reply: Dec 8, 2013 9:14 AM by Cheney1980   Branched to a new discussion.
    Go to original post 1 ... 6 7 8 9 10 ... 16  Previous Next
    Calculating status...
    sugaaarbabe
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 14, 2013 9:18 AM (in response to Tarrantion82)
    Apple should take resonsibility for this, otherwise they will lose lots of loyal customers. I have moved away from the ipad due to expense and am now very tempted to do so away from the iphone. Selling a product that prompts an update that breaks the phone is not good.
    Like (0) Reply
    Calculating status...
    punkinbits
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 14, 2013 11:31 AM (in response to Tarrantion82)
    Have had the same issues with iPhone 4S since the upgrade.  No wifi button, battery draining every 8 hours with no use, phone shutting on &amp; off for no reason at all.  I gave in and tried the hair dryer method.  Turned the phone off and hel d the dryer over the camera lense area for one minute.  Turned the phone back on and to my shock, had wifi button back again.  That was 2 days ago.  Battery is lasting normal amount of time again and I can use wifi again!  Hopefully this will last.  I know it doesn't work for everyone but it doesn't hurt to try.  Much better than spending the $200 at the Apple store, which by the way, the genius said Apple is aware of the problems but there is nothing they can do.
    Like (2) Reply
    Calculating status...
    Shell1331
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 15, 2013 1:07 AM (in response to Tarrantion82)
    I have exactly the same issue, apple are phoning me this evening.  I am not happy and this has really put me off using iphone.  It's my first iphone and if Apple don't fix it, it will be my last iphone!!
    Like (1) Reply
    Level 1 (0 points)
    lin777
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 15, 2013 3:17 AM (in response to Shell1331)
    you will be fine if you have warranty
    If not Apple won't want to know
    I know I've tried but they will not help.
    I've email bbc watchdog the consumer
    Programme to see if they can help.
    GOOD LUCK
    Like (0) Reply
    Calculating status...
    justezenu
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 15, 2013 4:47 AM (in response to Tarrantion82)
    Mine happened to with an update.  I had nothing wrong before that.
    Like (0) Reply
    Level 1 (0 points)
    justezenu
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 15, 2013 4:50 AM (in response to lin777)
    I am booked in for the same problem on Thursday.  Looks like I won't have much luck.
    Like (0) Reply
    Calculating status...
    ljguadagnini
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 15, 2013 1:11 PM (in response to justezenu)
    Having the same issue: iOS 7.0.2 with no WiFi / poor Battery stamina and really slow software experience when opening several options at Settings icon.
    Apple care agent contacted me and we try all alternatives to isolate and detect if this is regarding a hardware problem. Of course they told me it is. Too sad. My phone is in immaculate condition.
    My mother has an Iphone, my father has an Iphone, my 2 sisters have Iphones, my brother, wife and daugther... we all have Iphones. Mine's the only one with this fault (my personal experience: fail prob is 12,5% -1 out of 8).
    At this point, I'm evaluating to stop buying apple products for fear that in the future the same will happen with some "premium" product that ultimately they are not.
    Too sad, sorry but this is too much.
    Like (4) Reply
    Level 1 (0 points)
    lin777
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 16, 2013 5:08 AM (in response to ljguadagnini)
    Join the IOS 7.02 not working club.COME ON APPLE DO SOMETHING YOU MUST B READING ALL THE
    COMMENTS.ive emailed bbc watchdog consumer programme havent had reply yet.
    Like (0) Reply
    Level 1 (0 points)
    Jungletooth
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 16, 2013 6:15 AM (in response to lin777)
    I got my 4s in August 2012, as an upgrade on my Vodafone contract Following the installation of IOS 7 I also experienced greying out of wifi and bluetooth. I tried various options suggested on forums however none worked. I took my phone to Vodafone who told me it was a problem they were aware of but couldn't do anything about as Apple had to deal with it. I took it to my nearest Apple store (60 miles round trip!) to be told it was not their responsibility, it was Vodafone's - something to do with consumer law! They also said I would have to pay £160 for a replacement phone as it couldn't be repaired. The 'Genius' was very cagey about it being a common problem by the way!! Back to Vodafone who said it was not their responsibility so back to Apple. This time I spoke with a Manager who told me in not so many words that it was an issue and agreed to halve the replacement cost of £160 to £80. By this time I just wanted it sorted to reluctantly paid £80 for a replacment phone. Seeing as this is CLEARLY a design fault, Apple should have replaced it free of charge. This experience just confirms what I am reading in lots of places about the Apple Company. I was going to buy an iPad but have decided not to now. I shall NOT be replacing the iphone when my contract is up. I too will be writing to BBC Watchdog.
    Like (2) Reply
    Level 1 (0 points)
    Jungletooth
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 16, 2013 6:18 AM (in response to justezenu)
    justezenu wrote:
    I am booked in for the same problem on Thursday.  Looks like I won't have much luck.
    You will probably be told that the solution is a replacement phone. Ask to speak to a Manager and insist on getting it at a lower price. I did this and got it at 50% of the usual repacement cost. Still not ideal but at least it saves you a bit of the money you shouldn't have to pay in the first place!
    Like (0) Reply
    Level 1 (0 points)
    lin777
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 16, 2013 6:58 AM (in response to Jungletooth)
    Yes I had the same problem with 02 and apple no one wants to take the blame.Im glad you are writing to watchdog
    As well every one must email them or write to them and I'm sure they will take up the problem for us all.
    Like (0) Reply
    Calculating status...
    vinayak4816
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 19, 2013 7:24 AM (in response to Tarrantion82)
    no
    Like (0) Reply
    Calculating status...
    Jerome101
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 19, 2013 8:30 AM (in response to ljguadagnini)
    I depend alot on my Iphone and this Wifi greyed out issue is really getting to me!! This caused me to lose some business, but I'm sure I will make up for that in Andriod World. Switching back to andriod should have never switched to apple in the first place.
    Like (0) Reply
    Calculating status...
    Deanmort13
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 19, 2013 9:22 AM (in response to Tarrantion82)
    4s owner in the same boat as everyone else.
    I setup a service call with apple on Monday this week and was told it's quite a common hardware failure. When I asked why I should be paying for a new phone I was advised to book an appointment in store. Well I've just returned from my appointment with a "genius" who told me that when the update is installing if any component is weak when installing it will be permanently disabled.  Was then told £150 for a new phone which I declined.
    I've had  iPhones for 4 years now but due to this issue and apple washing their hands of any responsibility it will be my last.
    Disappointed that a premium product has such poor backup from the manufacturer. If it was only my phone and not thousands of others I'd have probably paid for a new phone but I'll never give apple another penny again.
    Like (1) Reply
    Calculating status...
    Coatezy
    Re: WIFI disabled - Greyed out since iOS 7 update on iphone 4s
    Oct 19, 2013 11:16 AM (in response to Tarrantion82)
    Same problem with my partners iPhone 4s. Restored the device but still no luck. Going to book an appointment but it sounds like we wont have much luck as it is just over a year old.
    Nexus 5 time I think for both of us.
    Like (0) Reply
    1 ... 6 7 8 9 10 ... 16  Previous Next
    Up to Discussions in iPhone Hardware  Go to original post Reply to original post

  • TS4436 hi, when zooming in to capture still images, the image is really blurred and out of focus. is this a hardware issue and is there any solution for this?? or is my device faulty?

    hi, when zooming in to capture still images, the image is really blurred and out of focus. is this a hardware issue and is there any solution for this?? or is my device faulty?

    If you are using the iPhone camera zoom then remember that this is a digital zoom not an optical zoom. The zoomed in area will have fewer pixels and not appear as clear. The more you zoom the worse it gets. It's like cropping a picture after it has been taken.

  • Netflix says"Video Playback Error  Your device has a hardware issue, which is preventing Premium Video Playback. Contact Apple Support for more information. Error Code: S7363-1261-FFFFD000" What is wrong?

    My mac is working fine. No noticeable problems. Then went onto netflix everything was working apart from the watching of the film and it popped up
    "Video Playback Error  Your device has a hardware issue, which is preventing Premium Video Playback. Contact Apple Support for more information. Error Code: S7363-1261-FFFFD000".
    Not sure what is wrong but would appreciate any help

    Netflix not working with yosemite
    Re: I think there is a hardware issue with my computer and i am not sure what to do it won't let me play netflix
    Netflix streaming gives Error Code: S7363-1261-FFFFD000

  • Help with Video Performance Issues using Flash

    Asking on behalf of a customer who has been unable to get any answers so far - are you able to help?
    Background:
    We have a port of our Game Development Kit which allows us to recompile all our games using Crossbridge (http://adobe-flash.github.io/crossbridge/) into SWF without any code modifications.
    Overview:
    Our framework is using OpenGL for rendering and we have successfully ported it along with the audio and video to run in Flash.
    We are experiencing performance issues using Video. We cannot use image sequence as some of the video animations are too long and would increase the download to an unacceptable size.  Assets vary between 256x256 - 1024x1024 videos.

    Here's the rest of the story.  Let me know if you can see any resolution, and I will connect him to the forums.  Thank you.
    Current Video Solution:
    We create an instance of NetConnection, NetStream, and Video according to most samples out there, and invoke draw to rasterize the Video DisplayObject into a BitmapData instance.
    The BitmapData instance has a fixed color component layout which is not compatible with Stage3D texture and is therefore has to be reformatted before uploaded to Stage3D Texture (See Code Listing below).
    Our Problems:
    Performance issues with RGBA conversion (either using copyChannel or manually reformatting is not fast enough) natively in as3; this required for stage3d texture.Copying each channel individual using bitmapdata.Copychannel seems faster, but not significantly faster.
    Cannot detect when video frame has been updated, therefore we may copy pixels that are not needed in enterframe (processpixel).
    Looping video, our current solution uses the NET_STATUS event Buffer empty; Is there a better way to loop videos than checking buffer and seeking to 0.
    Stepping video, loading FLV or MP4 side by side assets from HTTP or embedded does not support stepping? Is there another way?
    ActionScript Code Listing:
    video_nc = new NetConnection();
    video_nc.addEventListener(NetStatusEvent.NET_STATUS , onConnect);
    video_nc.addEventListener(AsyncErrorEvent.ASYNC_ERROR , trace);
    video_nc.connect(null);
    // OnConnect Event:
    this.ns = new NetStream(e.target as NetConnection);
    eventclient = new Object();
    eventclient.onMetaData = onMetaData;
    this.ns.client = eventclient;
    ns.play(flvfile);
    ns.pause();
    //onMetaData event:
    this.width = infoObject.width;
    this.height = infoObject.height;
    this.textureWidth = NextPowerOfTwo(this.width);
    this.textureHeight = NextPowerOfTwo(this.height);
    cliprect = new Rectangle(0, 0, this.width ,this.height);
    cliprect.x = 0;
    cliprect.y = 0;
    cliprect.width = this.textureWidth;
    cliprect.height = this.textureHeight;
    totalFrames = infoObject.duration * infoObject.fps;
    this.hasAlpha = true;
    if(infoObject.videocodecid == 5)
    this.hasAlpha = true;
    this.bitmapData = new BitmapData(this.textureWidth, this.textureHeight, hasAlpha, 0xff000000);
    this.video = new Video(this.width, this.height);
    this.video.attachNetStream(ns);
    this.video.addEventListener(Event.ENTER_FRAME, processPixels);
    // processPixel method:
    BitmapData.draw(video);
    GLAPI.instance.glBindTexture(GLAPI.GL_TEXTURE_2D,this.textureId);
    var fmt:uint = GLAPI.GL_ARGB;
    // converting pixels using copychannel or loop through pixels
    GLAPI.instance.glBindTexture(GLAPI.GL_TEXTURE_2D,this.textureId);
    GLAPI.instance.glTexImage2D(GLAPI.GL_TEXTURE_2D, 0, fmt, this.textureWidth, this.textureHeight, 0,fmt, GLAPI.GL_UNSIGNED_BYTE, 0, convBitmapData.getPixels(cliprect));

Maybe you are looking for