Extracting frames from video

Hi
Can anyone say me how to extract disismlar frames from a video
Thanks in advance
kokila

What is your definition of a scene ?
If a camera is not moving, you can probably do some vague matching of the background...... say if a certain percentage of pixels match up from one frame to the next.
But if the camera is moving, then every single frame will be different.
When you buy a commercial DVD, it is broken up into chapters / scenes.... but I assume that is a manual process performed by film editors.
Some DVD players have "auto-chapter", which just means that they create a chapter every X minutes regardless of the "scene".
regards,
Owen

Similar Messages

Plz Help : How to use FrameGrabbingControl to extract frame from video.

I m trying to extract frame from the video (from .mpg file)using FrameGrabbingControl on the click of the button.There is no problem related to playing video.
import javax.media.control.*
public void actionperformed(ActionEvent ae)
String s = ae.getActionCommand();
if(s.equals("click") )
FrameGrabbingControl fgc = (FrameGrabbingControl) player.getcontrol("FrameGrabbingControl"); //it is returning null
Buffer bf = fgc.grabFrame(); // so here nullpointerException
}

hi I am also experiencing the same prob.can u send me the code if u got one..my mail id is [email protected].we are working on a proj to extract jpeg images from any movie file in jmf...can u help us

This is how you extract frames from video

right then, in answer to many posts about how to get the individual frames from video, here is my solution. it seems to work with mpg files but it doesnt seem to work with any of the avi files i tried. not sure why it doesnt work with those. i have modified javas frame access.
nothing is displayed except it prints which frame it is doing.
if anyone wants to improve it, please do. i still dont understand fully how it works so i probably wont be able to answer many questions about it. anyway here it is:
* @(#)FrameAccess.java 1.5 01/03/13
* Copyright (c) 1999-2001 Sun Microsystems, Inc. All Rights Reserved.
* Sun grants you ("Licensee") a non-exclusive, royalty free, license to use,
* modify and redistribute this software in source and binary code form,
* provided that i) this copyright notice and license appear on all copies of
* the software; and ii) Licensee does not utilize the software in a manner
* which is disparaging to Sun.
* This software is provided "AS IS," without a warranty of any kind. ALL
* EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY
* IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR
* NON-INFRINGEMENT, ARE HEREBY EXCLUDED. SUN AND ITS LICENSORS SHALL NOT BE
* LIABLE FOR ANY DAMAGES SUFFERED BY LICENSEE AS A RESULT OF USING, MODIFYING
* OR DISTRIBUTING THE SOFTWARE OR ITS DERIVATIVES. IN NO EVENT WILL SUN OR ITS
* LICENSORS BE LIABLE FOR ANY LOST REVENUE, PROFIT OR DATA, OR FOR DIRECT,
* INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL OR PUNITIVE DAMAGES, HOWEVER
* CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF THE USE OF
* OR INABILITY TO USE SOFTWARE, EVEN IF SUN HAS BEEN ADVISED OF THE
* POSSIBILITY OF SUCH DAMAGES.
* This software is not designed or intended for use in on-line control of
* aircraft, air traffic, aircraft navigation or aircraft communications; or in
* the design, construction, operation or maintenance of any nuclear
* facility. Licensee represents and warrants that it will not use or
* redistribute the Software for such purposes.
import java.awt.*;
import javax.media.*;
import javax.media.control.TrackControl;
import javax.media.Format;
import javax.media.format.*;
import java.io.*;
import javax.imageio.*;
import javax.imageio.stream.*;
import java.awt.image.*;
import java.util.*;
import javax.media.util.*;
* Sample program to access individual video frames by using a
* "pass-thru" codec. The codec is inserted into the data flow
* path. As data pass through this codec, a callback is invoked
* for each frame of video data.
public class FrameAccess implements ControllerListener {
     Processor p;
     Object waitSync = new Object();
     boolean stateTransitionOK = true;
     public boolean alreadyPrnt = false;
     * Given a media locator, create a processor and use that processor
     * as a player to playback the media.
     * During the processor's Configured state, two "pass-thru" codecs,
     * PreAccessCodec and PostAccessCodec, are set on the video track.
     * These codecs are used to get access to individual video frames
     * of the media.
     * Much of the code is just standard code to present media in JMF.
     public boolean open(MediaLocator ml) {
          try {
               p = Manager.createProcessor(ml);
          } catch (Exception e) {
               System.err.println(
                    "Failed to create a processor from the given url: " + e);
               return false;
          p.addControllerListener(this);
          // Put the Processor into configured state.
          p.configure();
          if (!waitForState(Processor.Configured)) {
               System.err.println("Failed to configure the processor.");
               return false;
          // So I can use it as a player.
          p.setContentDescriptor(null);
          // Obtain the track controls.
          TrackControl tc[] = p.getTrackControls();
          if (tc == null) {
               System.err.println(
                    "Failed to obtain track controls from the processor.");
               return false;
          // Search for the track control for the video track.
          TrackControl videoTrack = null;
          for (int i = 0; i < tc.length; i++) {
               if (tc.getFormat() instanceof VideoFormat) videoTrack = tc[i];
               else     tc[i].setEnabled(false);
          if (videoTrack == null) {
               System.err.println("The input media does not contain a video track.");
               return false;
          String videoFormat = videoTrack.getFormat().toString();
          Dimension videoSize = parseVideoSize(videoFormat);
          System.err.println("Video format: " + videoFormat);
          // Instantiate and set the frame access codec to the data flow path.
          try {
               Codec codec[] = { new PostAccessCodec(videoSize)};
               videoTrack.setCodecChain(codec);
          } catch (UnsupportedPlugInException e) {
               System.err.println("The process does not support effects.");
          // Realize the processor.
          p.prefetch();
          if (!waitForState(Processor.Prefetched)) {
               System.err.println("Failed to realise the processor.");
               return false;
          p.start();
          return true;
     /**parse the size of the video from the string videoformat*/
     public Dimension parseVideoSize(String videoSize){
          int x=300, y=200;
          StringTokenizer strtok = new StringTokenizer(videoSize, ", ");
          strtok.nextToken();
          String size = strtok.nextToken();
          StringTokenizer sizeStrtok = new StringTokenizer(size, "x");
          try{
               x = Integer.parseInt(sizeStrtok.nextToken());
               y = Integer.parseInt(sizeStrtok.nextToken());
          } catch (NumberFormatException e){
               System.out.println("unable to find video size, assuming default of 300x200");
          System.out.println("Image width = " + String.valueOf(x) +"\nImage height = "+ String.valueOf(y));
          return new Dimension(x, y);
     * Block until the processor has transitioned to the given state.
     * Return false if the transition failed.
     boolean waitForState(int state) {
          synchronized (waitSync) {
               try {
                    while (p.getState() != state && stateTransitionOK)
                         waitSync.wait();
               } catch (Exception e) {
          return stateTransitionOK;
     * Controller Listener.
     public void controllerUpdate(ControllerEvent evt) {
          if (evt instanceof ConfigureCompleteEvent
               || evt instanceof RealizeCompleteEvent
               || evt instanceof PrefetchCompleteEvent) {
               synchronized (waitSync) {
                    stateTransitionOK = true;
                    waitSync.notifyAll();
          } else if (evt instanceof ResourceUnavailableEvent) {
               synchronized (waitSync) {
                    stateTransitionOK = false;
                    waitSync.notifyAll();
          } else if (evt instanceof EndOfMediaEvent) {
               p.close();
               System.exit(0);
     * Main program
     public static void main(String[] args) {
          if (args.length == 0) {
               prUsage();
               System.exit(0);
          String url = args[0];
          if (url.indexOf(":") < 0) {
               prUsage();
               System.exit(0);
          MediaLocator ml;
          if ((ml = new MediaLocator(url)) == null) {
               System.err.println("Cannot build media locator from: " + url);
               System.exit(0);
          FrameAccess fa = new FrameAccess();
          if (!fa.open(ml))
               System.exit(0);
     static void prUsage() {
          System.err.println("Usage: java FrameAccess <url>");
     * Inner class.
     * A pass-through codec to access to individual frames.
     public class PreAccessCodec implements Codec {
          * Callback to access individual video frames.
          void accessFrame(Buffer frame) {
               // For demo, we'll just print out the frame #, time &
               // data length.
               long t = (long) (frame.getTimeStamp() / 10000000f);
               System.err.println(
                    "Pre: frame #: "
                         + frame.getSequenceNumber()
                         + ", time: "
                         + ((float) t) / 100f
                         + ", len: "
                         + frame.getLength());
          * The code for a pass through codec.
          // We'll advertize as supporting all video formats.
          protected Format supportedIns[] = new Format[] { new VideoFormat(null)};
          // We'll advertize as supporting all video formats.
          protected Format supportedOuts[] = new Format[] { new VideoFormat(null)};
          Format input = null, output = null;
          public String getName() {
               return "Pre-Access Codec";
          //these dont do anything
          public void open() {}
          public void close() {}
          public void reset() {}
          public Format[] getSupportedInputFormats() {
               return supportedIns;
          public Format[] getSupportedOutputFormats(Format in) {
               if (in == null)
                    return supportedOuts;
               else {
                    // If an input format is given, we use that input format
                    // as the output since we are not modifying the bit stream
                    // at all.
                    Format outs[] = new Format[1];
                    outs[0] = in;
                    return outs;
          public Format setInputFormat(Format format) {
               input = format;
               return input;
          public Format setOutputFormat(Format format) {
               output = format;
               return output;
          public int process(Buffer in, Buffer out) {
               // This is the "Callback" to access individual frames.
               accessFrame(in);
               // Swap the data between the input & output.
               Object data = in.getData();
               in.setData(out.getData());
               out.setData(data);
               // Copy the input attributes to the output
               out.setFlags(Buffer.FLAG_NO_SYNC);
               out.setFormat(in.getFormat());
               out.setLength(in.getLength());
               out.setOffset(in.getOffset());
               return BUFFER_PROCESSED_OK;
          public Object[] getControls() {
               return new Object[0];
          public Object getControl(String type) {
               return null;
     public class PostAccessCodec extends PreAccessCodec {
          // We'll advertize as supporting all video formats.
          public PostAccessCodec(Dimension size) {
               supportedIns = new Format[] { new RGBFormat()};
               this.size = size;
          * Callback to access individual video frames.
          void accessFrame(Buffer frame) {
               // For demo, we'll just print out the frame #, time &
               // data length.
               if (!alreadyPrnt) {
                    BufferToImage stopBuffer = new BufferToImage((VideoFormat) frame.getFormat());
                    Image stopImage = stopBuffer.createImage(frame);
                    try {
                         BufferedImage outImage = new BufferedImage(size.width, size.height, BufferedImage.TYPE_INT_RGB);
                         Graphics og = outImage.getGraphics();
                         og.drawImage(stopImage, 0, 0, size.width, size.height, null);
                         //prepareImage(outImage,rheight,rheight, null);
                         Iterator writers = ImageIO.getImageWritersByFormatName("jpg");
                         ImageWriter writer = (ImageWriter) writers.next();
                         //Once an ImageWriter has been obtained, its destination must be set to an ImageOutputStream:
                         File f = new File(frame.getSequenceNumber() + ".jpg");
                         ImageOutputStream ios = ImageIO.createImageOutputStream(f);
                         writer.setOutput(ios);
                         //Finally, the image may be written to the output stream:
                         //BufferedImage bi;
                         //writer.write(imagebi);
                         writer.write(outImage);
                         ios.close();
                    } catch (IOException e) {
                         System.out.println("Error :" + e);
               //alreadyPrnt = true;
               long t = (long) (frame.getTimeStamp() / 10000000f);
               System.err.println(
                    "Post: frame #: "
                         + frame.getSequenceNumber()
                         + ", time: "
                         + ((float) t) / 100f
                         + ", len: "
                         + frame.getLength());
          public String getName() {
               return "Post-Access Codec";
          private Dimension size;

The quality of the produced video from this example is very poor.
It comes to huuuuge surprise the following fact.
If you comment the line where you set the PostAccessCodec, the chain of the codecs is:
MPEG-1 decoder -> YUV2RGB -> Direct Draw Renderer. ( The one used from the system to decode and render)
If you run the example purely as is above you get the following sequence(as long with the poor quality):
MPEG-1 decoder -> YUV2RGB -> Windows GDI Renderer.
So you say lets set another Renderer. So
you add the following line videoTracker.setRenderer( new DDRenderer() )
What comes to a surprise is the following chain of codecs:
MPEG-1 decoder -> YUV2RGB -> Post Codec -> Java RGB Converter - > DDRenderer
The quality now may be perfect but video runs to slow. The surprising thing here is that even though we have set the outputFormat of the PostAccessFrame codec to RGBFormat the system converts it again to RGB through codec Java RGB Format.
After searching a lot and reaching the conclusion that the deference between the 2 RGB's is their sizes I sudently was brought in front of a method called grabFrame(). Bels started ringing inside my head. Starts were comming up. Looking at the definition of the class com.sun.media.renderer.video.DDRenderer I descovered that this damn class implements the FrameGrabbingControl Interface. What the f.....? The problem that consumed 4 days of my life and multiplied with 10 to give hours has finally come to an and.
Summing up the solution for grabbing frames is this!!!!!
DDRenderer renderer = new DDRenderer();
videoTrack.setRenderer( renderer );
and in your actionPerformed implementation
FrameGrabbingControl fr = (FrameGrabbingControl)renderer.getControl( "javax.media.control.FrameGrabbingControl");
Buffer frame = fr.grabFrame();
The following stuff ...are stated in FrameAccess
--Sniper

Extracting frames from videos files

Hi!
I'm looking for a Object that can help me to extract video component such as I-Frame, P-frame.
As a matter of fact, I would like to modify the DCT of I-Frame of a MPEG4 video file.
Thanks

if your file hold byte[] data you can use the following code to get the byte[] data as RGB
public byte[][] getData(int frameNum) throws Exception {
FramePositioningControl fpc = getPositionControl();
FrameGrabbingControl      fgc = getGrabControl();
Buffer           buf;
RGBFormat     format;
int          width, height, pixelStride, lineStride, idx;
byte[][]     rgbData;
byte[]          data;
Object          dataObj;
// skip to the requested frame
fpc.seek(frameNum);
// get the data
buf = fgc.grabFrame();
// support RGB Format
format = (RGBFormat)buf.getFormat();
width = format.getSize().width;
height = format.getSize().height;
pixelStride = format.getPixelStride();
lineStride = format.getLineStride();
dataObj = buf.getData();
if (!(dataObj instanceof byte[]))
return null;
data = (byte[])dataObj;
// create the data;
rgbData = new byte[3][width*height];
idx = 0;
for (int i = 0; i < data.length; i += pixelStride) {
// bgr order
rgbData[2][idx] = data;
rgbData[1][idx] = data[i+1];
rgbData[0][idx] = data[i+2];
idx++;
if (format.getFlipped() == 1) {
rgbData[0] = flipImageTopBottom(rgbData[0], width, height);
rgbData[1] = flipImageTopBottom(rgbData[1], width, height);
rgbData[2] = flipImageTopBottom(rgbData[2], width, height);
return rgbData;

Told by adobe that I should purchase photoshop elements 13 to extract photo from video but it will not even open a video file -- what am I missing?

I am supposed to be able to extract a frame from PSE 13 but it will not let me do so. Specifically, Select File > Import > Frame From Video is supposed to allow this but when I click Import, there is no Frame from video option.
Here are the instructions from the Adobe website:
You can play a video from within Photoshop Elements and grab frames to edit and save as images.
Select File > Import > Frame From Video.
Browse and select the video.
Click Play.The video starts playing in the Frame From Video dialog box. You can use the playback controls to display the frames your want to grab. If you find the audio distracting, select Mute.
Click Grab Frame.Photoshop Elements places the grabbed frames as images in new files., ready for editing.
Click Done.

This is strange because I found the following on the adobe PSE 13 website (but the Select File/Import does not include Frame From Video:
You can play a video from within Photoshop Elements and grab frames to edit and save as images.
Select File > Import > Frame From Video.
Browse and select the video.
Click Play.The video starts playing in the Frame From Video dialog box. You can use the playback controls to display the frames your want to grab. If you find the audio distracting, select Mute.
Click Grab Frame.Photoshop Elements places the grabbed frames as images in new files., ready for editing.
Click Done.

When I capture a still frame froma video in Llightroom 4.3, where does the captured frame end up?

When I capture a still frame froma video in Llightroom 4.3, where does the captured frame end up? I cannot find it. Stan

It will be right next to the movie in your library and the jpg file will end up on your hard disk right next to the movie file. You can see the actual file by right (or control) clicking on the image in the library view and selecting "show in Finder/Explorer"

Is it possible in java to extract audio from video file and ...

Hi,
Is there any API in java for creating DVD video from Normal TV and extract audio from video file and convert MP3 to WMA file. What about java Media Framework and Java 3D API?
If it is notpossible in java which will be the next option. Vc++?
Please help me.
Thanking in advance.
From,
Vinod A

lol
If all you want is to create a backup of some file you can do:public class Foo
    public static void main(String[] args) {
        Foo f = new Foo();
        f.createBackup("something.xls");
    public void createBackup(String inFile) {
        FileInputStream in = null;
        FileOutputStream out = null;
        try {
            in = new FileInputStream(inFile);
            out = new FileOutputStream(inFile + ".bak");
            int read;
            while ((read = in.read()) > -1) {
                out.write(read);
            out.flush();
        } catch (FileNotFoundException e) {
            e.printStackTrace();
        } catch (IOException e) {
            e.printStackTrace();
        } finally {
            if (in != null) {
                try {
                    in.close();
                } catch (IOException e) {
                    e.printStackTrace();
            if (out != null) {
                try {
                    out.close();
                } catch (IOException e) {
                    e.printStackTrace();
}

Extracting audio from video clip to use as narration?

Hi there,
I have a video clip in which I want to take the audio of actor speaking and put it onto another video.
I.e. he is speaking about walking in the park. I want to take him speaking about walking in the park and put it onto the clip where he is actually walking in the park.
How do I do this in premiere elements 10?

Hi Bill,
Thanks for the quick response. I guess my question now is how would I do those two things?
In terms of exporting the audio, where can I find that option when I'm on timeline?
What do you mean by "Alt-click" and what is a "muxed file"?
Thanks again,
Mallory
Date: Fri, 13 Jan 2012 19:01:51 -0700
From: [email protected]
To: [email protected]
Subject: Extracting audio from video clip to use as narration?
    Re: Extracting audio from video clip to use as narration?
    created by Bill Hunt in Premiere Elements - View the full discussion
Welcome to the forum. There are several ways to accomplish this, and your choice might well rest on how you like to work, and what you are doing, such as Deleteing Video. First, you could Export/Share just the Audio as a PCM/WAV @ 48KHz 16-bit, from your Timeline, and Import that into a New Project, where the Audio WAV file would be used. OTOH, you could Atl-click on the Video portion of the muxed file, and Delete the Video, leaving only the Audio portion. Good luck, Hunt
     Replies to this message go to everyone subscribed to this thread, not directly to the person who posted the message. To post a reply, either reply to this email or visit the message page: http://forums.adobe.com/message/4139273#4139273
     To unsubscribe from this thread, please visit the message page at http://forums.adobe.com/message/4139273#4139273. In the Actions box on the right, click the Stop Email Notifications link.
     Start a new discussion in Premiere Elements by email or at Adobe Forums
For more information about maintaining your forum email notifications please go to http://forums.adobe.com/message/2936746#2936746.

Where Is PS CS3's "Frame from Video Grabber"?

In Photoshop Elements 2 there was an excellent "Frame from Video" tool which enabled you to play video clips and easily navigate to the exact frame.
You then pressed a "Grab Frame" button and the job was done.
I can't find this item in PS CS3 Extended. The only thing I can find is the "Import Video to Layers" command which isn't quite the same.

Thanks a lot ekim wahs.
Why do I keep getting this image of a mirror .............. ?
Your information (together with a few things I have managed to dig out) has helped clarify the situation.
There are certainly more possibilities than in the old PSE 2 but I tend to like simple things ......... they go better with my simple mind.
Thanks again !

Importing frames from video help please

Why is photoshop elelments 9 not recognizing .wmv or .avi files when trying to import photos from videos. I have used this feature before without problems using .wmv videos, why did it quit working all of the sudden?

When something goes awry, start by resetting the preferences. Quit the editor, then restart it from the button in the organizer or the button in the Welcome Screen, whilie holding down Ctrl+Alt+Shift (command+option+shift on a mac). Keep the keys down till you see a window asking if you want to delete the settings file. You do.
However, having said that, are you sure these wmv files are the same as the ones you did before? Frame from video doesn't work with high-def videos, for example, and it's not great with long ones, either.

Extracting Stills from Video in PS CS6

Hi there, just wondering how you extract a still frame from a video file in Photoshop CS6.
Thanks in advance, Will.

Select all, copy&paste or simply save a copy to a "flat" image format that discards the video and only exports the currently visible set of pixels like JPEG; TIFF, PNG or whatever.
Mylenium

Still frame from video: PS Elements 9

I am new to PS, trying to get a still frame from a video. My camera uses a file MP4, but PS says it does not accept that format. How do I convert my MP4 videos so I can get some still pix from it? I did the file>import>> frame for video>browze. It works with a sample video on my computer but not the video from my camera. PLEASE HELP! Thank you

One more thing---I'm working with PC: Windows 7 and only the PSE, not the premier version.

How to find the start and end duration of "Selected frames" from Video using didFinishPickingMediaWithInfo?

I am doing slow motion in audio and video using AVFoundation(for Video) and Dirac(Audio). As part of it, i will show the video as frames in which the user will select the frames to do slow motion. Eg: 5-6 min of 10 min video.
I have to show the users two kinds of videos 1. through the video recorder from my application itself. 2. from the gallery.
Case1: No problem Now,i can record the videos though my video recorder and show the videos as frames to the user to select. Once the user selects some frames(Eg: 5 to 6 min of 10 min recorded video), using the below code, i am able to find the start/end duration of the selected frames or video.
NSNumber *start = [info objectForKey:@"_UIImagePickerControllerVideoEditingStart"]; NSNumber *end = [info objectForKey:@"_UIImagePickerControllerVideoEditingEnd"]; int startMilliseconds = ([start doubleValue] * 1000);int endMilliseconds = ([end doubleValue] * 1000);
Case2: In this case, i am able to pick the video from the gallery and show them to the user in the form of frames to select. However, when i try to find the start/end duration of the video as i did in case 1 with the same code, its not working. I am always getting "0" for start/end duration.
Can you please give some suggestion on my Issue ?

+1 .. also. i'd to know is using "_UIImagePickerControllerVideoEditingStart"
the app won't be rejected..
thanks,
F

Extracting Audio from Video With QuickTime Pro?

I read on another discussion board that QuickTime Pro could record/extract audio only from a video file. So I purchased the QuickTime Pro upgrade today (for Windows XP) but can't seem to find out how to do it, assumimg that post was correct and it can be done at all.
The Nero video editing software I use can get the video file in MPEG-2, MPEG-1, AVI and other formats. I tried MPEG-1, but even the conversion to QuickTime's .mov format came up with no audio at all. I noticed a post here saying that was a limitation of the software. I could purchase the QuickTime MPEG-2 add-on but that seems to only allow playback and doesn't look like it will help any.
Another post on the other discussion board said that virtualdub.org has a software program that could do this extraction, but silly me I went with Apple and was delighted to read about the no refund policy just now. :-/
I'm guessing another possible approach is some kind of hardware solution -- a recording device of some sort?

In order to extract a track (video or audio) the file first must have those as independent tracks.
MPEG 1 and 2 are "muxed" (video and audio in the same track) so QuickTime Pro has nothing to extract.
MPEG Streamclip (free) can convert .mpg and .mpeg files to QuickTime formats.
If you export from Nero as .avi you can also use QuickTime Pro to extract tracks as it will have at least two.
MPEG 1 and 2 are playback formats and are not intended to be edited.

V2.2 bug: Album art sometimes appears as still frames from video podcasts

I subscribe to the CNN "in case you missed it" video podcast. I have noticed that intermittently, the album art appearing on the iPhone screen for the playing song is a "stolen" frame from one of the CNN video podcasts. I have taken screenshots when this occurs and I can post them if desired.
This is a question that I will mark as answered when I see that the problem has been corrected in a future firmware.

This bug seems to have been fixed in IOS 3

Extracting frames from video

Similar Messages

Maybe you are looking for