RTP formats
Hi,
I'm using AVTransmit3 code to transmit a .wav file. I have jmf.jar (cross-platform) and at first it only found and worked with 5 formats, like these:
dvi/rtp, 8000.0 Hz, 4-bit, Mono
dvi/rtp, 11025.0 Hz, 4-bit, Mono
dvi/rtp, 22050.0 Hz, 4-bit, Mono
gsm/rtp, 8000.0 Hz, Mono, FrameSize=264 bits
ULAW/rtp, 8000.0 Hz, 8-bit, Mono, FrameSize=8 bits After, I installed the windows performance pack, and it found and worked with 12 formats, (last five, and seven more). The "new formats are:
{code}
g723/rtp, 8000.0 Hz, Mono, FrameSize=192 bits
mpegaudio/rtp, 48000.0 Hz, 16-bit, Stereo, BigEndian, Signed
mpegaudio/rtp, 44100.0 Hz, 16-bit, Stereo, BigEndian, Signed
mpegaudio/rtp, 22050.0 Hz, 16-bit, Stereo, BigEndian, Signed
mpegaudio/rtp, 48000.0 Hz, 16-bit, Mono, BigEndian, Signed
mpegaudio/rtp, 44100.0 Hz, 16-bit, Mono, BigEndian, Signed
mpegaudio/rtp, 22050.0 Hz, 16-bit, Mono, BigEndian, Signed
{code}
And now, I unistall windows perfomance pack, and I'm working again with cross-platform jar, and it find the 12 formats, but only works with the first five formats.
I have this problem:
{code}Track 0 is set to transmit as: mpegaudio/rtp, 48000.0 Hz, 16-bit, Stereo, BigEndian, Signed
Failed to build a graph for the given custom options.
Failed to realize: com.sun.media.ProcessEngine@1a28362
Cannot build a flow graph with the customized options:
Unable to transcode format: LINEAR, 16000.0 Hz, 8-bit, Mono, Unsigned, 16000.0 frame rate, FrameSize=8 bits
to: mpegaudio/rtp, 48000.0 Hz, 16-bit, Stereo, BigEndian, Signed
outputting to: RAW/RTP
Error: Unable to realize com.sun.media.ProcessEngine@1a28362
INFO: Couldn't realize processor{code}
As I read in : [http://java.sun.com/javase/technologies/desktop/media/jmf/2.1.1/formats.html] these rtp formats are supported for crossplatform version (a-law not for encoded and transmit, but mpegaudio, yes)
I don`t know if i'm wrong, nor what may be failing. Any idea?
Thanks
Ok, Thanks. Now I understand it better.
Similar Messages
-
Help with RTP: Format of Stream not supported in RTP Session Manager
Hello everyone,
I am quite new to JMF and RTP. So far I've succeeded in capturing audio from the microphone and playing it back. However, I failed when I tried to send the stream over using RTP.
Here's my program, all it does is: get a DataSource from the CaptureDevice, create a Processor with that DataSource, convert the tracks in the Processor to one of the RTP formats, and create an RTP SendStream using the Processor's output DataSource.
I can hear sound by creating a Player for the DataSource; however I get errors when I try to create RTP SendStream for the same output DataSource.
Here's my code:
CaptureDeviceInfo cdinfo;
Format fmt = new AudioFormat(AudioFormat.LINEAR, 8000, 8, 1);
Vector deviceList = CaptureDeviceManager.getDeviceList(fmt);
if (deviceList.size() > 0) {
System.out.println("Device Found.");
cdinfo = (CaptureDeviceInfo) deviceList.firstElement();
} else {
System.out.println("No device!");
return;
DataSource ds = Manager.createDataSource(cdinfo.getLocator());
Processor processor = Manager.createProcessor(ds);
StateHelper sh = new StateHelper(processor);
if (!sh.configure(10000)) {
System.out.println("Could not configure...");
System.exit(-1);
// Get the track control objects
TrackControl track[] = processor.getTrackControls();
System.out.println("Number of tracks:" + track.length);
boolean encodingPossible = false;
// Go through the tracks and try to program one of them to outout some "RTP format"
for (int i = 0; i < track.length; i++) {
try {
track.setFormat(new AudioFormat(AudioFormat.DVI_RTP));
encodingPossible = true;
} catch (Exception e) {
// cannot convert
track[i].setEnabled(false);
if (!encodingPossible) {
System.out.println("Could not encode..");
sh.close();
return;
processor.setContentDescriptor(new ContentDescriptor(ContentDescriptor.RAW));
if (!sh.realize(10000)) {
System.out.println("Could not realize...");
System.exit(-1);
System.out.println("Realized...");
DataSource outSource = processor.getDataOutput();
System.out.println(outSource.getContentType());
processor.start();
player = Manager.createRealizedPlayer(outSource);
player.start();
SessionAddress addr = new SessionAddress(InetAddress.getByName("224.144.251.104"), 8194, 4);
manager.initialize(addr);
//manager.addFormat(new AudioFormat(AudioFormat.GSM_RTP), 1);
System.out.println("RTP Session started...");
stream = manager.createSendStream(processor.getDataOutput(), 0);
I get an error on the last line, the error is: javax.media.format.UnsupportedFormatException: Format of Stream not supported in RTP Session Manager And again, if I try to encode the tracks into *AudioFormat.GSM_RTP* instead of *DVI_RTP*, I get a different error on the same line:Exception in thread "AWT-EventQueue-0" java.lang.NullPointerExceptionWell I don't understand what's happening, is there something I need to do before I can use RTP?
Hope you guys help :)Hi,
seems that you are encoding a track to RTP format but outputting a RAW format.
Your encoding section is also a little bit lazy as you don't check supported formats...
Try this between configured and realized state:
// Get the tracks from the processor
TrackControl [] tracks = processor.getTrackControls();
// Do we have at least one track?
if (tracks == null || tracks.length < 1)
return "Couldn't find tracks in processor";
// Set the output content descriptor to RAW_RTP
// This will limit the supported formats reported from
// Track.getSupportedFormats to only valid RTP formats.
ContentDescriptor cd = new ContentDescriptor(ContentDescriptor.RAW_RTP);
processor.setContentDescriptor(cd);
Format supported[];
Format chosen;
boolean atLeastOneTrack = false;
// Program the tracks.
for (int i = 0; i < tracks.length; i++) {
Format format = tracks.getFormat();
log.info("Input format for RTP conversion: " + format);
if (tracks[i].isEnabled()) {
supported = tracks[i].getSupportedFormats();
// We've set the output content to the RAW_RTP.
// So all the supported formats should work with RTP.
if (supported.length > 0) {
if (supported[i] instanceof VideoFormat) {
tracks[i].setEnabled(false);
continue;
else if (supported[i] instanceof AudioFormat) {
// set audio format for RTP transmission
chosen = new AudioFormat(AudioFormat.DVI_RTP);
tracks[i].setFormat(chosen);
tracks[i].setEnabled(true);
atLeastOneTrack = true;
else
tracks[i].setEnabled(false);
else
tracks[i].setEnabled(false);
else
tracks[i].setEnabled(false);
if (!atLeastOneTrack)
return "Couldn't set any of the tracks to a valid RTP format";
The important thing should be theContentDescriptor cd = new ContentDescriptor(ContentDescriptor.RAW_RTP);part. -
JMF error - Format of Stream not supported in RTP Session Manager
java.io.IOException: Format of Stream not supported in RTP Session Manager
at com.sun.media.datasink.rtp.Handler.open(Handler.java:139)
why this erro occors?
I already created the DataSink.
When I try to do this...
dsk.open(); //here the error got
dsk.start(); Code of server of media
I want to sent audio (wav) like a radio, but from file. Without stop to send streaming. PullBufered
*Class Server that you offers Streaming of midia
public class Servidor {
private MediaLocator ml;
private Processor pro;
private javax.media.protocol.DataSource ds;
private DataSink dsk;
private boolean codificado = false;
//start the server service, passing the adress of media
// ex: d:\music\music.wav
// pass the ip and port, to make a server works
public void iniciarServicoServidor(String end,String ip, int porta)
try {
//capture media
capturarMidia(end);
//creates processor
criarProcessor();
// configure the processor
configurarProcessor();
//setContent RAW
descreverConteudoEnviado();
//format the media in right RTP format
formatRTP();
//creat the streaming
criarStreaming();
//configure the server
configurarServidor(ip, porta);
//in this method raise the excepition
iniciarServidor();
//when I try to open the DataSink.open() raises the exception
//java.io.IOException: Format of Stream not supported in RTP Session //Manager
// at com.sun.media.datasink.rtp.Handler.open(Handler.java:139)
} catch (RuntimeException e) {
System.out.println("Houve um erro em iniciarServicoServidor");
e.printStackTrace();
public void capturarMidia(String endereco)
try {
System.out.println("**************************************************************");
System.out.println("Iniciando processo de servidor de multimidia em " + Calendar.getInstance().getTime().toString());
ml = new MediaLocator("file:///" + endereco);
System.out.println("Midia realizada com sucesso.");
System.out.println ("[" + "file:///" + endereco +"]");
} catch (RuntimeException e) {
System.out.println("Houve um erro em capturarMidia");
e.printStackTrace ();
public void criarProcessor()
try {
System.out.println("**************************************************************");
pro = Manager.createProcessor(ml);
System.out.println("Processor criado com sucesso.");
System.out.println("Midia com durcao:" + pro.getDuration().getSeconds());
} catch (NoProcessorException e) {
System.out.println("Houve um erro em criarProcessor");
e.printStackTrace();
} catch (IOException e) {
System.out.println ("Houve um erro em criarProcessor");
e.printStackTrace();
public void configurarProcessor()
try {
System.out.println("**************************************************************");
System.out.println("Processor em estado de configura��o.");
pro.configure();
System.out.println("Processor configurado.");
} catch (RuntimeException e) {
System.out.println("Houve um erro em configurarProcessor");
e.printStackTrace();
public void descreverConteudoEnviado()
try {
System.out.println("**************************************************************");
pro.setContentDescriptor(new ContentDescriptor(ContentDescriptor.RAW));
System.out.println("Descritor de conteudo:" + pro.getContentDescriptor().toString());
} catch (NotConfiguredError e) {
System.out.println("Houve um erro em descreverConteudoEnviado");
e.printStackTrace();
private Format checkForVideoSizes(Format original, Format supported) {
int width, height;
Dimension size = ((VideoFormat)original).getSize();
Format jpegFmt = new Format(VideoFormat.JPEG_RTP);
Format h263Fmt = new Format(VideoFormat.H263_RTP);
if (supported.matches(jpegFmt)) {
// For JPEG, make sure width and height are divisible by 8.
width = (size.width % 8 == 0 ? size.width :
(int)(size.width / 8) * 8);
height = (size.height % 8 == 0 ? size.height :
(int)(size.height / 8) * 8);
} else if (supported.matches(h263Fmt)) {
// For H.263, we only support some specific sizes.
if (size.width < 128) {
width = 128;
height = 96;
} else if ( size.width < 176) {
width = 176;
height = 144;
} else {
width = 352;
height = 288;
} else {
// We don't know this particular format. We'll just
// leave it alone then.
return supported;
return (new VideoFormat(null,
new Dimension(width, height),
Format.NOT_SPECIFIED ,
null,
Format.NOT_SPECIFIED)).intersects(supported);
public void formatRTP()
try {
// Program the tracks.
TrackControl tracks[] = pro.getTrackControls();
Format supported[];
Format chosen;
for (int i = 0; i < tracks.length; i++) {
Format format = tracks.getFormat();
if (tracks[i].isEnabled()) {
supported = tracks[i].getSupportedFormats();
// We've set the output content to the RAW_RTP.
// So all the supported formats should work with RTP.
// We'll just pick the first one.
if (supported.length > 0) {
if (supported[0] instanceof VideoFormat) {
// For video formats, we should double check the
// sizes since not all formats work in all sizes.
chosen = checkForVideoSizes(tracks[i].getFormat(),
supported[0]);
} else
chosen = supported[0];
tracks[i].setFormat(chosen);
System.err.println("Track " + i + " is set to transmit as:");
System.err.println(" " + chosen);
codificado = true;
} else
tracks[i].setEnabled(false);
} else
tracks[i].setEnabled(false);
} catch (RuntimeException e) {
// TODO Auto-generated catch block
e.printStackTrace();
public void tocar()
pro.start();
public void criarStreaming()
try {
System.out.println("**************************************************************");
if (codificado)
System.out.println("Midia codificada...");
System.out.println("Processor entra em estado de realize.");
pro.realize();
System.out.println("Processor realized.");
System.out.println("Adquirindo o streaming a ser enviado.");
ds = pro.getDataOutput();
System.out.println("Streaming adquirido pronto a ser enviado.");
} catch (NotRealizedError e) {
System.out.println("Houve um erro em criarStreaming");
System.out.println(e.getMessage());
e.printStackTrace();
catch (Exception e) {
System.out.println(e.getMessage());
public void configurarServidor(String ip, int porta)
System.out.println("**************************************************************");
String url = "rtp://" + ip + ":" + porta + "/audio/1";
System.out.println("Servidor ira atender em " + url);
MediaLocator mml = new MediaLocator(url);
System.out.println("Localizador de midia ja criado");
try {
System.out.println("Criando um DataSink a ser enviado.");
dsk = Manager.createDataSink(ds, mml);
System.out.println("DataSink criado.");
} catch (NoDataSinkException e) {
e.printStackTrace();
public void iniciarServidor()
try {
System.out.println("**************************************************************");
dsk.open();
System.out.println("Servidor ligado.");
dsk.start();
System.out.println("Servidor iniciado.");
} catch (SecurityException e) {
e.printStackTrace();
} catch (IOException e) {
e.printStackTrace();
Gives that output console.
All methods are executed but the last doesnt works.
The method that open the DataSink.
What can I do?
Iniciando processo de servidor de multimidia em Sun May 13 22:37:02 BRT 2007
Midia realizada com sucesso.
[file:///c:\radio.wav ]
Processor criado com sucesso.
Midia com durcao:9.223372036854776E9
Processor em estado de configura��o.
Processor configurado.
Descritor de conteudo:RAW
Midia codificada...
Processor entra em estado de realize.
Processor realized.
Adquirindo o streaming a ser enviado.
Streaming adquirido pronto a ser enviado.
Servidor ira atender em rtp://127.0.0.1:22000/audio/1
Localizador de midia ja criado
Criando um DataSink a ser enviado.
streams is [Lcom.sun.media.multiplexer.RawBufferMux$RawBufferSourceStream;@a0dcd9 : 1
sink: setOutputLocator rtp://127.0.0.1:22000/audio/1
DataSink criado.
Track 0 is set to transmit as:
unknown, 44100.0 Hz, 16-bit, Stereo, LittleEndian, Signed, 176400.0 frame rate, FrameSize=32 bits
java.io.IOException: Format of Stream not supported in RTP Session Manager
at com.sun.media.datasink.rtp.Handler.open(Handler.java:139)
at br.org.multimidiasi.motor.Servidor.iniciarServidor(Servidor.java:291)
at br.org.multimidiasi.motor.Servidor.iniciarServicoServidor(Servidor.java:43)
at br.org.multimidiasi.motor.ConsoleServidor.main(ConsoleServidor.java:30)
Since already thanks so much.
Exactally in this method raises erros.
Ive tried another formats (avi, mp3) but all with the same error, what I can do?
[code] public void iniciarServidor()
try {
System.out.println("**************************************************************");
dsk.open();
System.out.println("Servidor ligado.");
dsk.start();
System.out.println("Servidor iniciado.");
} catch (SecurityException e) {
e.printStackTrace();
} catch (IOException e) {
e.printStackTrace();
Track 0 is set to transmit as:
unknown, 44100.0 Hz, 16-bit, Stereo, LittleEndian, Signed, 176400.0 frame rate, FrameSize=32 bits
java.io.IOException: Format of Stream not supported in RTP Session Manager
at com.sun.media.datasink.rtp.Handler.open(Handler.java:139)
at br.org.multimidiasi.motor.Servidor.iniciarServidor(Servidor.java:291)
at br.org.multimidiasi.motor.Servidor.iniciarServicoServidor(Servidor.java:43)
at br.org.multimidiasi.motor.ConsoleServidor.main(ConsoleServidor.java:30)unknown, 44100.0 Hz, 16-bit, Stereo,
LittleEndian, Signed, 176400.0 frame rate,
FrameSize=32 bits
java.io.IOException: Format of Stream not supported
in RTP Session Manager
The fact that it doesn't know what the format is
might have to do with the problem. I've had similar
problems, and I've traced it back to missing jars and
codecs. Have you tried running the same code locally
without the transmission to see if you player will
even play the file?Already and it works, I used Player to play it and play normally, I try to make it with the diferents codecs of audio and video, but no sucess. -
Custom RTP Payload Types in JMF
I have a completely non-audio/video content type that I've sourced from an SVG based whiteboard, which generates a Media Locator. Instantiating a DataSource via the Manager from this Media Locator grabs the correct whiteboard from a static list, and generates a series of controls for how often full updates of the board are sent, collision handling, etc. (Works)
This generates a custom Format output which is basically the SVG's XML representation (Works)
Feeding this into a processor, you can request BZIP compression of this data to minimize the transmission bandwidth (works)
Further feeding this data into a a custom packetizer class breaks the data into chunks, and adds FEC packets to the stream when the buffer has to be broken into 2 or more chunks. Output is a derivative of the earlier custom format. (Works)
Muxing this data back together gets you a custom DataSource of type "fec.rtp", which technically could handle any data type, but only advertises support for my custom packetized data formats. (Muxer is based on RTPSyncBufferMux - Works)
Here's where things are getting frustrating. Calling com.sun.media.rtp.RTPSessionMgr.formatSupported (part of RTPSyncBufferMux) will tell you that I've correctly registered these custom formats for RTP transmission, but attempting to create a sendStream gives this error:
javax.media.format.UnsupportedFormatException: Format of Stream not supported in RTP Session Manager
at com.sun.media.rtp.RTPSessionMgr.createSendStream(RTPSessionMgr.java:1104)
at com.sun.media.rtp.RTPSessionMgr.createSendStream(RTPSessionMgr.java:1262)
This is extremely frustrating to put it mildly to have gotten this far and not be able to proceed, but I'm smack up against a brick wall at this point, and pressed for time to get this done. Basically I just want RTP Session Manager to take one buffer at a time and send it over the network. The FEC Depacketizer handles the work of reassembling the chunks, and passing along the data once it has enough to reconstruct a full buffer. (Uses an expiring cache so the data goes away automatically if too much is dropped to reconstruct a full buffer)
My gut tells me there's some sort of helper that processes the dataSource, and hands data to the RTP Session Manager in a way that it understands that it has a "single packet chunk" (I've seen some classes in the com.sun.media tree that suggest as much to me) but I haven't figured this part out yet. Does anyone have experience enough with this particular API to point me in the right direction?
Is there any good documentation for the com.sun.media tree incidentally? I'm using a LOT of helper classes from in there because once you look at the source, it's easy to see how useful they are, but it's a pain to dig through 5 or 6 classes to find out what I need to override and what I shouldn't touch.Switched everything over to using RTPManager, and found I had to register the type with each individual instance, instead of just doing it once. The resulting exception is now further down in the RTPSessionMgr source, which I'm assuming is progress, though that's a dangerous assumption.
javax.media.format.UnsupportedFormatException: Format not supported
at com.sun.media.rtp.RTPSessionMgr.createSendStream(RTPSessionMgr.java:1147)
at com.sun.media.rtp.RTPSessionMgr.createSendStream(RTPSessionMgr.java:1262)
at SVGEditorPanelTest.DialogTest(SVGEditorPanelTest.java:238)Here's the code, from RTPManager.newInstance to SendStream.start
// Create the transmitter
RTPManager rtpMgr = RTPManager.newInstance();
Codec c = new Packetizer();
// Register the RTP stream formats
Format f = c.getSupportedOutputFormats(null)[0];
Logger.global.info("Registering format: " + f);
rtpMgr.addFormat(f, 105);
SessionAddress localAddr = new SessionAddress(InetAddress.getLocalHost(), 1057);
String cname = "test@localhost";
String username = System.getProperty("User.name");
// create our local Session Address
SourceDescription[] userdesclist = new SourceDescription[]{
new SourceDescription(SourceDescription.SOURCE_DESC_EMAIL,
"[email protected]",
1,
false),
new SourceDescription(SourceDescription.SOURCE_DESC_CNAME,
cname,
1,
false),
new SourceDescription(SourceDescription.SOURCE_DESC_TOOL,
"Whiteboard Test",
1,
false),
new SourceDescription(SourceDescription.SOURCE_DESC_NAME,
username,
1,
false)
rtpMgr.initialize(new SessionAddress[]{localAddr}, userdesclist, 0.05,
0.25, null);
SessionAddress destAddr = new SessionAddress(
InetAddress.getByName("127.0.0.1"),
1058);
System.out.println("Adding target: " + destAddr.toString());
rtpMgr.addTarget(destAddr);
System.out.println("--- Creating Send Stream on port " + localAddr.getDataPort() + " ---");
System.out.println("Content Type: " + dataOutput.getContentType());
System.out.println("Stream Format: " + format + "(" + format.getDataType().getCanonicalName() + ")");
Object[] controls = dataOutput.getControls();
for (int i = 0; i < controls.length; i++) {
System.out.println("Control Type: " + controls.getClass().getName());
rtpMgr.getLocalParticipant().setSourceDescription(userdesclist);
try {
SendStream sendStream = rtpMgr.createSendStream(dataOutput, 0);
sendStream.start();
System.out.println("New Stream SSRC: " + sendStream.getSSRC());
System.out.println("New Stream Source: " + sendStream.getDataSource());
} catch (UnsupportedFormatException ex) {
System.out.println("Failed format is: " + ex.getFailedFormat());
throw ex;
It may be worth noting that this is part of a Unit Test, hence the lack of exception handling.
Stdout looks like:RTP Format Supported
Adding target: DataAddress: /127.0.0.1
ControlAddress: /127.0.0.1
DataPort: 1058
ControlPort: 1059
--- Creating Send Stream on port 1057 ---
Content Type: fec.rtp
Stream Format: bzipsvgwb/rtp(byte[])
Failed format is: bzipsvgwb/rtp
Edited by: sh0ckbyt3 on Dec 29, 2008 12:05 PM -
Can't play mp3 file through RTP
I created an server/client application to play remote file through RTP using JMF. However, it works with *.wav and video track of mpg file only, can't work when playing *.mp3 and audio track of mpg file. Do anyone know the reason?
No any errors.
I just follow the code sample "AVTransmit2" & "AVReceive2" and change the format.
I change the format of mpg file audio stream to G723, it works now! So I think I used wrong format, but I found there is only two supported RTP format for mp3 file and it doesn't work for both of them. -
Hi all, I am trying to beat a problem and am running out of idea: poor audio quality. Here is the gis of the problem:
- Audio source: microphone on PC
- RTP format: G711 uLaw
- Audio quality is excellent when the two parties of a conversation are both PC running my JMF app
- Audio quality is poor when one party uses my JMF app (on PC), and the other a 3rd party IP phone. The audio played out on the PC (originated from the IP phone) is clear, the audio played out on the IP phone is scratchy and appeared to have a cyclical ticking sound.
- Audio quality between two IP phones is excellent.
Hypotheses:
- Codec mismatch - This can be ruled out since the audio sent from the IP phone to the PC sounded perfectly clear.
- Poor sound capture on the PC - This can be ruled out since the audio quality between two PC's was perfect.
- Data transmission rate problem - Possible: the IP phone ran an RTOS which generated an RTP packet more or less every 20ms. The IP phone has little to no jitter buffer. The RTP packets generated from the PC were bursty (I couldn't get a very accurate timer going in Java), JMF has a good jitter buffering algorithm (for incoming packets).
Has anyone else run into similar problem? Any suggestion as to ways to verify the cause of the problem, I am thinking of capturing the RTP stream using a packet sniffer and then play it back using a third party tool to rule out poor audio quality in the capturing phase on the PC.Hello Hai.Vu!
I would like to use a pc-microphone (not usb and not microphone of my webcam). You've wrote that the quality were excellent.
Really? How you doing that?
I'm using the AVTRansmit2 code which I've found on this plattform.
Thanks for feedback!
Nahya -
How do I transmit an RTP stream using only a datasource?
I've been following this tutorial: http://members.jcom.home.ne.jp/3117216601/jmf2guide/RTPPresenting.html
And I have clients that can send me RTP audio streams, which are received in the update method.
Now, update generates a NewReceiveStreamEvent. Which has a datasource that I can play.
But what I want to do. Is have send the DataSource back to that client. (The ip address is unknown... but that shouldn't matter, as RTP is two-way).
I want to send the DataSource back to the client, because later, we will be routing different clients, and who they can talk to and such. But I want to start with the basics.captfoss wrote:
DerNalia wrote:
But what I want to do. Is have send the DataSource back to that client. (The ip address is unknown... but that shouldn't matter, as RTP is two-way).RTP isn't two-way, RTP is one way... RTCP is two-way. The data transport is duplex, the QOS/control messages are duplex...
So you do need to know the IP address of the client in order to send anything to him...
I want to send the DataSource back to the client, because later, we will be routing different clients, and who they can talk to and such. But I want to start with the basics.You should just be able to turn around and give the DataSource that's receiving the RTP stream to an RTPManager and broadcast it back out... assuming you're not transcoding it out of its RTP format or anything.I don't have the IP address. So is this even possible without switching to RTCP? if so if you an example, that would be awesome. Also an example of two way communication with RTCP would be awesome too.
Does RTCP used the same sort of structure that RTP does? like is there a DataSource that could be merged with other datasources, and sent back to where one of the datasources came frome? -
Hi,
I am trying out a "live" application in FMS3.0 which
involoves streaming a live feed from a host in rtp format to
fms3,and i want fms to broadcast this live feed again...so just
wanted to know whether anyone has tried rtp support for
fms3.FMS3 doesn't support RTP/RTSP stream ingest.
-
About transmitting audio by RTP
Hi, there,
I want to create a simple application that transfers audio online through RTP. both the sender machine and receiver machine have public ip address. I tried JMStudio and AVTransmit2/AVReceiver2 without success till now! it drives me crazy. I really don't know what's wrong here. is there anyone really make it work?
even I can see the receiver machine keep receiving data through the port I specify to transfer data(the port is 22224), the JMStudio or AVReceiver2 on receiver machine just waiting for data, also I can see the statistic of JMStudio on sender machine reports transfer successful and the data keeping transferred. I also tried to use broadcast way, that is, changing the last part of sender's ip address to 255, still no luck! the receiver can't receive any data!
since I use Ubuntu, there is no firewall, no port is blocked. I can access from receiver to sender or vice versa using SSH. I don't think there is any connection problem, also I can see the receiver keeping receive data.
I transfer a mp3 file through RTP session. I installed mp3 plugin on both receiver machine and sender machine. I can play it using JMStudio on both receiver machine and sender machine locally.
could anyone kindly let me know how I should do, or if there is any very very simple java program to transfer anything using RTP on internet? could you please tell me your configuration if you happen to make it work?
any hint will great appreciate!
Samif you have a microphone in your pc, AVTranmit2 and AVReceive2 command should be:
on your own pc:
java AVTransmit2 dsound:// targetIP 42050
on target pc:
java AVReceive2 yourIP/42050
since the same port cannot be used simutaneously by two applications(avreceive2 and avtransmit2), the above command can only be used on two different pcs (your pc and target pc).
if you wanna execute AVReceive2 and AVTransmit2 on the same pc, you have to modify the source codes. I have done that.
commond
java AVTransmit2 dsound:// yourip 42050 42100
java AVReceive2 yourip/42050 yourip/42100
the modified source files are as follows:
/*****************AVReceive2.java**********************************/
* @(#)AVReceive2.java 1.3 01/03/13
* Copyright (c) 1999-2001 Sun Microsystems, Inc. All Rights Reserved.
* Sun grants you ("Licensee") a non-exclusive, royalty free, license to use,
* modify and redistribute this software in source and binary code form,
* provided that i) this copyright notice and license appear on all copies of
* the software; and ii) Licensee does not utilize the software in a manner
* which is disparaging to Sun.
* This software is provided "AS IS," without a warranty of any kind. ALL
* EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY
* IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR
* NON-INFRINGEMENT, ARE HEREBY EXCLUDED. SUN AND ITS LICENSORS SHALL NOT BE
* LIABLE FOR ANY DAMAGES SUFFERED BY LICENSEE AS A RESULT OF USING, MODIFYING
* OR DISTRIBUTING THE SOFTWARE OR ITS DERIVATIVES. IN NO EVENT WILL SUN OR ITS
* LICENSORS BE LIABLE FOR ANY LOST REVENUE, PROFIT OR DATA, OR FOR DIRECT,
* INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL OR PUNITIVE DAMAGES, HOWEVER
* CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF THE USE OF
* OR INABILITY TO USE SOFTWARE, EVEN IF SUN HAS BEEN ADVISED OF THE
* POSSIBILITY OF SUCH DAMAGES.
* This software is not designed or intended for use in on-line control of
* aircraft, air traffic, aircraft navigation or aircraft communications; or in
* the design, construction, operation or maintenance of any nuclear
* facility. Licensee represents and warrants that it will not use or
* redistribute the Software for such purposes.
import java.io.*;
import java.awt.*;
import java.net.*;
import java.awt.event.*;
import java.util.Vector;
import javax.media.*;
import javax.media.rtp.*;
import javax.media.rtp.event.*;
import javax.media.rtp.rtcp.*;
import javax.media.protocol.*;
import javax.media.protocol.DataSource;
import javax.media.format.AudioFormat;
import javax.media.format.VideoFormat;
import javax.media.Format;
import javax.media.format.FormatChangeEvent;
import javax.media.control.BufferControl;
* AVReceive2 to receive RTP transmission using the new RTP API.
public class AVReceive2 implements ReceiveStreamListener, SessionListener,
ControllerListener
String sessions[] = null;
RTPManager mgrs[] = null;
Vector playerWindows = null;
boolean dataReceived = false;
Object dataSync = new Object();
public AVReceive2(String sessions[]) {
this.sessions = sessions;
protected boolean initialize() {
try {
InetAddress ipAddr;
SessionAddress localAddr = new SessionAddress();
SessionAddress destAddr;
mgrs = new RTPManager[sessions.length];
playerWindows = new Vector();
SessionLabel session;
// Open the RTP sessions.
for (int i = 0; i < sessions.length; i++) {
// Parse the session addresses.
try {
session = new SessionLabel(sessions);
} catch (IllegalArgumentException e) {
System.err.println("Failed to parse the session address given: " + sessions[i]);
return false;
System.err.println(" - Open RTP session for: addr: " + session.addr + " port: " + session.port + " ttl: " + session.ttl);
mgrs[i] = (RTPManager) RTPManager.newInstance();
mgrs[i].addSessionListener(this);
mgrs[i].addReceiveStreamListener(this);
ipAddr = InetAddress.getByName(session.addr);
if( ipAddr.isMulticastAddress()) {
// local and remote address pairs are identical:
localAddr= new SessionAddress( ipAddr,
session.port,
session.ttl);
destAddr = new SessionAddress( ipAddr,
session.port,
session.ttl);
} else {
localAddr= new SessionAddress( InetAddress.getLocalHost(),
42100+2*i);
//session.port);
destAddr = new SessionAddress( ipAddr,
42050+2*i);
//session.port);
mgrs[i].initialize( localAddr);
// You can try out some other buffer size to see
// if you can get better smoothness.
BufferControl bc = (BufferControl)mgrs[i].getControl("javax.media.control.BufferControl");
if (bc != null)
bc.setBufferLength(350);
mgrs[i].addTarget(destAddr);
} catch (Exception e){
System.err.println("Cannot create the RTP Session: " + e.getMessage());
return false;
// Wait for data to arrive before moving on.
long then = System.currentTimeMillis();
long waitingPeriod = 30000; // wait for a maximum of 30 secs.
try{
synchronized (dataSync) {
while (!dataReceived &&
System.currentTimeMillis() - then < waitingPeriod) {
if (!dataReceived)
System.err.println(" - Waiting for RTP data to arrive...");
dataSync.wait(1000);
} catch (Exception e) {}
if (!dataReceived) {
System.err.println("No RTP data was received.");
close();
return false;
return true;
public boolean isDone() {
return playerWindows.size() == 0;
* Close the players and the session managers.
protected void close() {
for (int i = 0; i < playerWindows.size(); i++) {
try {
((PlayerWindow)playerWindows.elementAt(i)).close();
} catch (Exception e) {}
playerWindows.removeAllElements();
// close the RTP session.
for (int i = 0; i < mgrs.length; i++) {
if (mgrs[i] != null) {
mgrs[i].removeTargets( "Closing session from AVReceive2");
mgrs[i].dispose();
mgrs[i] = null;
PlayerWindow find(Player p) {
for (int i = 0; i < playerWindows.size(); i++) {
PlayerWindow pw = (PlayerWindow)playerWindows.elementAt(i);
if (pw.player == p)
return pw;
return null;
PlayerWindow find(ReceiveStream strm) {
for (int i = 0; i < playerWindows.size(); i++) {
PlayerWindow pw = (PlayerWindow)playerWindows.elementAt(i);
if (pw.stream == strm)
return pw;
return null;
* SessionListener.
public synchronized void update(SessionEvent evt) {
if (evt instanceof NewParticipantEvent) {
Participant p = ((NewParticipantEvent)evt).getParticipant();
System.err.println(" - A new participant had just joined: " + p.getCNAME());
* ReceiveStreamListener
public synchronized void update( ReceiveStreamEvent evt) {
RTPManager mgr = (RTPManager)evt.getSource();
Participant participant = evt.getParticipant(); // could be null.
ReceiveStream stream = evt.getReceiveStream(); // could be null.
if (evt instanceof RemotePayloadChangeEvent) {
System.err.println(" - Received an RTP PayloadChangeEvent.");
System.err.println("Sorry, cannot handle payload change.");
System.exit(0);
else if (evt instanceof NewReceiveStreamEvent) {
try {
stream = ((NewReceiveStreamEvent)evt).getReceiveStream();
DataSource ds = stream.getDataSource();
// Find out the formats.
RTPControl ctl = (RTPControl)ds.getControl("javax.media.rtp.RTPControl");
if (ctl != null){
System.err.println(" - Recevied new RTP stream: " + ctl.getFormat());
} else
System.err.println(" - Recevied new RTP stream");
if (participant == null)
System.err.println(" The sender of this stream had yet to be identified.");
else {
System.err.println(" The stream comes from: " + participant.getCNAME());
// create a player by passing datasource to the Media Manager
Player p = javax.media.Manager.createPlayer(ds);
if (p == null)
return;
p.addControllerListener(this);
p.realize();
PlayerWindow pw = new PlayerWindow(p, stream);
playerWindows.addElement(pw);
// Notify intialize() that a new stream had arrived.
synchronized (dataSync) {
dataReceived = true;
dataSync.notifyAll();
} catch (Exception e) {
System.err.println("NewReceiveStreamEvent exception " + e.getMessage());
return;
else if (evt instanceof StreamMappedEvent) {
if (stream != null && stream.getDataSource() != null) {
DataSource ds = stream.getDataSource();
// Find out the formats.
RTPControl ctl = (RTPControl)ds.getControl("javax.media.rtp.RTPControl");
System.err.println(" - The previously unidentified stream ");
if (ctl != null)
System.err.println(" " + ctl.getFormat());
System.err.println(" had now been identified as sent by: " + participant.getCNAME());
else if (evt instanceof ByeEvent) {
System.err.println(" - Got \"bye\" from: " + participant.getCNAME());
PlayerWindow pw = find(stream);
if (pw != null) {
pw.close();
playerWindows.removeElement(pw);
* ControllerListener for the Players.
public synchronized void controllerUpdate(ControllerEvent ce) {
Player p = (Player)ce.getSourceController();
if (p == null)
return;
// Get this when the internal players are realized.
if (ce instanceof RealizeCompleteEvent) {
PlayerWindow pw = find(p);
if (pw == null) {
// Some strange happened.
System.err.println("Internal error!");
System.exit(-1);
pw.initialize();
pw.setVisible(true);
p.start();
if (ce instanceof ControllerErrorEvent) {
p.removeControllerListener(this);
PlayerWindow pw = find(p);
if (pw != null) {
pw.close();
playerWindows.removeElement(pw);
System.err.println("AVReceive2 internal error: " + ce);
* A utility class to parse the session addresses.
class SessionLabel {
public String addr = null;
public int port;
public int ttl = 1;
SessionLabel(String session) throws IllegalArgumentException {
int off;
String portStr = null, ttlStr = null;
if (session != null && session.length() > 0) {
while (session.length() > 1 && session.charAt(0) == '/')
session = session.substring(1);
// Now see if there's a addr specified.
off = session.indexOf('/');
if (off == -1) {
if (!session.equals(""))
addr = session;
} else {
addr = session.substring(0, off);
session = session.substring(off + 1);
// Now see if there's a port specified
off = session.indexOf('/');
if (off == -1) {
if (!session.equals(""))
portStr = session;
} else {
portStr = session.substring(0, off);
session = session.substring(off + 1);
// Now see if there's a ttl specified
off = session.indexOf('/');
if (off == -1) {
if (!session.equals(""))
ttlStr = session;
} else {
ttlStr = session.substring(0, off);
if (addr == null)
throw new IllegalArgumentException();
if (portStr != null) {
try {
Integer integer = Integer.valueOf(portStr);
if (integer != null)
port = integer.intValue();
} catch (Throwable t) {
throw new IllegalArgumentException();
} else
throw new IllegalArgumentException();
if (ttlStr != null) {
try {
Integer integer = Integer.valueOf(ttlStr);
if (integer != null)
ttl = integer.intValue();
} catch (Throwable t) {
throw new IllegalArgumentException();
* GUI classes for the Player.
class PlayerWindow extends Frame {
Player player;
ReceiveStream stream;
PlayerWindow(Player p, ReceiveStream strm) {
player = p;
stream = strm;
public void initialize() {
add(new PlayerPanel(player));
public void close() {
player.close();
setVisible(false);
dispose();
public void addNotify() {
super.addNotify();
pack();
* GUI classes for the Player.
class PlayerPanel extends Panel {
Component vc, cc;
PlayerPanel(Player p) {
setLayout(new BorderLayout());
if ((vc = p.getVisualComponent()) != null)
add("Center", vc);
if ((cc = p.getControlPanelComponent()) != null)
add("South", cc);
public Dimension getPreferredSize() {
int w = 0, h = 0;
if (vc != null) {
Dimension size = vc.getPreferredSize();
w = size.width;
h = size.height;
if (cc != null) {
Dimension size = cc.getPreferredSize();
if (w == 0)
w = size.width;
h += size.height;
if (w < 160)
w = 160;
return new Dimension(w, h);
public static void main(String argv[]) {
if (argv.length == 0)
prUsage();
AVReceive2 avReceive = new AVReceive2(argv);
if (!avReceive.initialize()) {
System.err.println("Failed to initialize the sessions.");
System.exit(-1);
// Check to see if AVReceive2 is done.
try {
while (!avReceive.isDone())
Thread.sleep(1000);
} catch (Exception e) {}
System.err.println("Exiting AVReceive2");
static void prUsage() {
System.err.println("Usage: AVReceive2 <session> <session> ...");
System.err.println(" <session>: <address>/<port>/<ttl>");
System.exit(0);
}// end of AVReceive2
/****************************AVTransmit2.java****************************/
* @(#)AVTransmit2.java 1.4 01/03/13
* Copyright (c) 1999-2001 Sun Microsystems, Inc. All Rights Reserved.
* Sun grants you ("Licensee") a non-exclusive, royalty free, license to use,
* modify and redistribute this software in source and binary code form,
* provided that i) this copyright notice and license appear on all copies of
* the software; and ii) Licensee does not utilize the software in a manner
* which is disparaging to Sun.
* This software is provided "AS IS," without a warranty of any kind. ALL
* EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY
* IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR
* NON-INFRINGEMENT, ARE HEREBY EXCLUDED. SUN AND ITS LICENSORS SHALL NOT BE
* LIABLE FOR ANY DAMAGES SUFFERED BY LICENSEE AS A RESULT OF USING, MODIFYING
* OR DISTRIBUTING THE SOFTWARE OR ITS DERIVATIVES. IN NO EVENT WILL SUN OR ITS
* LICENSORS BE LIABLE FOR ANY LOST REVENUE, PROFIT OR DATA, OR FOR DIRECT,
* INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL OR PUNITIVE DAMAGES, HOWEVER
* CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF THE USE OF
* OR INABILITY TO USE SOFTWARE, EVEN IF SUN HAS BEEN ADVISED OF THE
* POSSIBILITY OF SUCH DAMAGES.
* This software is not designed or intended for use in on-line control of
* aircraft, air traffic, aircraft navigation or aircraft communications; or in
* the design, construction, operation or maintenance of any nuclear
* facility. Licensee represents and warrants that it will not use or
* redistribute the Software for such purposes.
import java.awt.*;
import java.io.*;
import java.net.InetAddress;
import javax.media.*;
import javax.media.protocol.*;
import javax.media.protocol.DataSource;
import javax.media.format.*;
import javax.media.control.TrackControl;
import javax.media.control.QualityControl;
import javax.media.rtp.*;
import javax.media.rtp.rtcp.*;
import com.sun.media.rtp.*;
public class AVTransmit2 {
// Input MediaLocator
// Can be a file or http or capture source
private MediaLocator locator;
private String ipAddress;
// private int portBase;
private int localPortBase;
private int remotePortBase;
private Processor processor = null;
private RTPManager rtpMgrs[];
private DataSource dataOutput = null;
public AVTransmit2(MediaLocator locator,
String ipAddress,
String localPB,
String remotePB,
Format format) {
Integer int1 = Integer.valueOf(remotePB);
if(int1 != null)
this.remotePortBase = int1.intValue();
this.locator = locator;
this.ipAddress = ipAddress;
Integer int2 = Integer.valueOf(localPB);
if (int2 != null)
this.localPortBase = int2.intValue();
* Starts the transmission. Returns null if transmission started ok.
* Otherwise it returns a string with the reason why the setup failed.
public synchronized String start() {
String result;
// Create a processor for the specified media locator
// and program it to output JPEG/RTP
result = createProcessor();
if (result != null)
return result;
// Create an RTP session to transmit the output of the
// processor to the specified IP address and port no.
result = createTransmitter();
if (result != null) {
processor.close();
processor = null;
return result;
// Start the transmission
processor.start();
return null;
* Stops the transmission if already started
public void stop() {
synchronized (this) {
if (processor != null) {
processor.stop();
processor.close();
processor = null;
for (int i = 0; i < rtpMgrs.length; i++) {
rtpMgrs[i].removeTargets( "Session ended.");
rtpMgrs[i].dispose();
private String createProcessor() {
if (locator == null)
return "Locator is null";
DataSource ds;
DataSource clone;
try {
ds = javax.media.Manager.createDataSource(locator);
} catch (Exception e) {
return "Couldn't create DataSource";
// Try to create a processor to handle the input media locator
try {
processor = javax.media.Manager.createProcessor(ds);
} catch (NoProcessorException npe) {
return "Couldn't create processor";
} catch (IOException ioe) {
return "IOException creating processor";
// Wait for it to configure
boolean result = waitForState(processor, Processor.Configured);
if (result == false)
return "Couldn't configure processor";
// Get the tracks from the processor
TrackControl [] tracks = processor.getTrackControls();
// Do we have atleast one track?
if (tracks == null || tracks.length < 1)
return "Couldn't find tracks in processor";
// Set the output content descriptor to RAW_RTP
// This will limit the supported formats reported from
// Track.getSupportedFormats to only valid RTP formats.
ContentDescriptor cd = new ContentDescriptor(ContentDescriptor.RAW_RTP);
processor.setContentDescriptor(cd);
Format supported[];
Format chosen;
boolean atLeastOneTrack = false;
// Program the tracks.
for (int i = 0; i < tracks.length; i++) {
Format format = tracks[i].getFormat();
if (tracks[i].isEnabled()) {
supported = tracks[i].getSupportedFormats();
// We've set the output content to the RAW_RTP.
// So all the supported formats should work with RTP.
// We'll just pick the first one.
if (supported.length > 0) {
if (supported[0] instanceof VideoFormat) {
// For video formats, we should double check the
// sizes since not all formats work in all sizes.
chosen = checkForVideoSizes(tracks[i].getFormat(),
supported[0]);//select the first supported format for convenice
} else
chosen = supported[0];
tracks[i].setFormat(chosen);
System.err.println("Track " + i + " is set to transmit as:");
System.err.println(" " + chosen);
atLeastOneTrack = true;
} else
tracks[i].setEnabled(false);
} else
tracks[i].setEnabled(false);
if (!atLeastOneTrack)
return "Couldn't set any of the tracks to a valid RTP format";
// Realize the processor. This will internally create a flow
// graph and attempt to create an output datasource for JPEG/RTP
// audio frames.
result = waitForState(processor, Controller.Realized);
if (result == false)
return "Couldn't realize processor";
// Set the JPEG quality to .5.
setJPEGQuality(processor, 0.5f);//no effect if not JPEG format
// Get the output data source of the processor
dataOutput = processor.getDataOutput();
return null;
* Use the RTPManager API to create sessions for each media
* track of the processor.
private String createTransmitter() {
// Cheated. Should have checked the type.
PushBufferDataSource pbds = (PushBufferDataSource)dataOutput;
PushBufferStream pbss[] = pbds.getStreams();
rtpMgrs = new RTPManager[pbss.length];
SessionAddress localAddr, destAddr;
InetAddress ipAddr;
SendStream sendStream;
int localPort;
int remotePort;
SourceDescription srcDesList[];
for (int i = 0; i < pbss.length; i++) {
try {
rtpMgrs[i] = RTPManager.newInstance();
// The local session address will be created on the
// same port as the the target port. This is necessary
// if you use AVTransmit2 in conjunction with JMStudio.
// JMStudio assumes - in a unicast session - that the
// transmitter transmits from the same port it is receiving
// on and sends RTCP Receiver Reports back to this port of
// the transmitting host.
localPort = localPortBase + 2*i;
remotePort = remotePortBase + 2*i;
ipAddr = InetAddress.getByName(ipAddress);
localAddr = new SessionAddress( InetAddress.getLocalHost(),
localPort);
destAddr = new SessionAddress( ipAddr, remotePort);
rtpMgrs[i].initialize( localAddr);
rtpMgrs[i].addTarget( destAddr);
System.err.println( "Created RTP session ("+pbss[i].getFormat().getClass() + "):"+localAddr.getControlHostAddress()
+":"+localAddr.getDataPort()+"->"+destAddr.getControlHostAddress()+":"+ destAddr.getDataPort());
sendStream = rtpMgrs[i].createSendStream(dataOutput, i);
sendStream.start();
} catch (Exception e) {
return e.getMessage();
return null;
* For JPEG and H263, we know that they only work for particular
* sizes. So we'll perform extra checking here to make sure they
* are of the right sizes.
Format checkForVideoSizes(Format original, Format supported) {
int width, height;
Dimension size = ((VideoFormat)original).getSize();
Format jpegFmt = new Format(VideoFormat.JPEG_RTP);
Format h263Fmt = new Format(VideoFormat.H263_RTP);
if (supported.matches(jpegFmt)) {
// For JPEG, make sure width and height are divisible by 8.
width = (size.width % 8 == 0 ? size.width :
(int)(size.width / 8) * 8);
height = (size.height % 8 == 0 ? size.height :
(int)(size.height / 8) * 8);
} else if (supported.matches(h263Fmt)) {
// For H.263, we only support some specific sizes.
if (size.width < 128) {
width = 128;
height = 96;
} else if (size.width < 176) {
width = 176;
height = 144;
} else {
width = 352;
height = 288;
} else {
// We don't know this particular format. We'll just
// leave it alone then.
return supported;
return (new VideoFormat(null,
new Dimension(width, height),
Format.NOT_SPECIFIED,
null,
Format.NOT_SPECIFIED)).intersects(supported);
* Setting the encoding quality to the specified value on the JPEG encoder.
* 0.5 is a good default.
void setJPEGQuality(Player p, float val) {
Control cs[] = p.getControls();
QualityControl qc = null;
VideoFormat jpegFmt = new VideoFormat(VideoFormat.JPEG);
// Loop through the controls to find the Quality control for
// the JPEG encoder.
for (int i = 0; i < cs.length; i++) {
if (cs[i] instanceof QualityControl &&
cs[i] instanceof Owned) {
Object owner = ((Owned)cs[i]).getOwner();
// Check to see if the owner is a Codec.
// Then check for the output format.
if (owner instanceof Codec) {
Format fmts[] = ((Codec)owner).getSupportedOutputFormats(null);
for (int j = 0; j < fmts.length; j++) {
if (fmts[j].matches(jpegFmt)) {
qc = (QualityControl)cs[i];
qc.setQuality(val);
System.err.println("- Setting quality to " +
val + " on " + qc);
break;
if (qc != null)
break;
* Convenience methods to handle processor's state changes.
private Integer stateLock = new Integer(0);
private boolean failed = false;
Integer getStateLock() {
return stateLock;
void setFailed() {
failed = true;
private boolean waitForState(Processor p, int state) {
p.addControllerListener(new StateListener());
failed = false;
// Call the required method on the processor
if (state == Processor.Configured) {
p.configure();
} else if (state == Processor.Realized) {
p.realize();
// Wait until we get an event that confirms the
// success of the method, or a failure event.
// See StateListener inner class
while (p.getState() < state && !failed) {
synchronized (getStateLock()) {
try {
getStateLock().wait();
} catch (InterruptedException ie) {
return false;
if (failed)
return false;
else
return true;
* Inner Classes
class StateListener implements ControllerListener {
public void controllerUpdate(ControllerEvent ce) {
// If there was an error during configure or
// realize, the processor will be closed
if (ce instanceof ControllerClosedEvent)
setFailed();
// All controller events, send a notification
// to the waiting thread in waitForState method.
if (ce instanceof ControllerEvent) {
synchronized (getStateLock()) {
getStateLock().notifyAll();
* Sample Usage for AVTransmit2 class
public static void main(String [] args) {
// We need three parameters to do the transmission
// For example,
// java AVTransmit2 file:/C:/media/test.mov 129.130.131.132 42050
if (args.length < 3) {
prUsage();
Format fmt = null;
int i = 0;
MediaLocator ml = new MediaLocator(args[i]);
// Create a audio transmit object with the specified params.
AVTransmit2 at = new AVTransmit2(ml,
args[i+1], args[i+2], args[i+3], fmt);
// Start the transmission
String result = at.start();
// result will be non-null if there was an error. The return
// value is a String describing the possible error. Print it.
if (result != null) {
System.err.println("Error : " + result);
System.exit(0);
System.err.println("Start transmission for 60 seconds...");
// Transmit for 60 seconds and then close the processor
// This is a safeguard when using a capture data source
// so that the capture device will be properly released
// before quitting.
// The right thing to do would be to have a GUI with a
// "Stop" button that would call stop on AVTransmit2
try {
Thread.currentThread().sleep(60000);
} catch (InterruptedException ie) {
// Stop the transmission
at.stop();
System.err.println("...transmission ended.");
System.exit(0);
static void prUsage() {
System.err.println("Usage: AVTransmit2 <sourceURL> <destIP> <destPortBase>");
System.err.println(" <sourceURL>: input URL or file name");
System.err.println(" <destIP>: multicast, broadcast or unicast IP address for the transmission");
System.err.println(" <destPortBase>: network port numbers for the transmission.");
System.err.println(" The first track will use the destPortBase.");
System.err.println(" The next track will use destPortBase + 2 and so on.\n");
System.exit(0);
if you have any further problems, it's my pleasure to discuss with you.
[email protected] -
Any Emulator that supports RTP or RTSP protocol
Hello Friends
As far as i know sun wireless toolkit doesnt supports RTP or RTSP protocol
does any body knows suitable emulators that support execution or code that contains RTP or RTSP protocol......
or if there exists any patches via which sun wireless toolkit can support it
AdvaitHi,
First of all there is no api for RTP present. So what you can do is record the audio, then convert it to RTP format by adding all the headers and then transmit it, At the reciever you have to rearrange the incoming packets and then play iy back. This is just a procedure and i have no idea hoe effective it is. This is the procedure iam following as even iam building my own RTP stack, so if u have any ideas can share with me. Iam ready to share mine. For audio recording just use the code present at http://developer.sonyericsson.com/site/global/techsupport/tipstrickscode/java/p_new_features_mobilemedia_api_jsr135.jsp
works fine for stream, but not for file. Tried to debug but was not successful
One more thing the JSR 135 says that we can play RTSP data just check the API for details. I have not used this format till now. So if you were successful in playing please share your code with me
All the best
Khalandar Pasha N
([email protected]) -
Hey, i wanted to install PulseAudio, but now i dont have sound at all... Maybe someone knows whats wrong.
Here are my config files:
#/etc/asound.conf start:
pcm.!default {
type pulse
ctl.!default {
type pulse
pcm.dsp0 {
type plug
slave.pcm "dmixer"
pcm.pulse {
type pulse
ctl.pulse {
type pulse
pcm.dmixer {
type dmix
ipc_key 1024
slave {
pcm "hw:0,0"
period_time 0
period_size 1024
buffer_size 8192
rate 48000 #many new cards are 48000 only
bindings {
0 0
1 1
ctl.dmixer {
type hw
card 0
#end.
#!/usr/bin/pulseaudio -nF
# This file is part of PulseAudio.
# PulseAudio is free software; you can redistribute it and/or modify it
# under the terms of the GNU Lesser General Public License as published by
# the Free Software Foundation; either version 2 of the License, or
# (at your option) any later version.
# PulseAudio is distributed in the hope that it will be useful, but
# WITHOUT ANY WARRANTY; without even the implied warranty of
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
# General Public License for more details.
# You should have received a copy of the GNU Lesser General Public License
# along with PulseAudio; if not, write to the Free Software Foundation,
# Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA.
.nofail
### Load something into the sample cache
#load-sample-lazy x11-bell /usr/share/sounds/gtk-events/activate.wav
load-sample-lazy pulse-hotplug /usr/share/sounds/startup3.wav
#load-sample-lazy pulse-coldplug /usr/share/sounds/startup3.wav
#load-sample-lazy pulse-access /usr/share/sounds/generic.wav
#.fail
### Load audio drivers statically (it's probably better to not load
### these drivers manually, but instead use module-hal-detect --
### see below -- for doing this automatically)
#load-module module-alsa-sink device=hw:0
#load-module module-alsa-source device=hw:0
#load-module module-oss device="/dev/dsp" sink_name=output source_name=input
#load-module module-oss-mmap device="/dev/dsp" sink_name=output source_name=input
#load-module module-null-sink
#load-module module-pipe-sink
### Automatically load driver modules depending on the hardware available
.ifexists /usr/lib/pulse-0.9/modules//module-hal-detect.so
load-module module-hal-detect auth-anonymous=1
.else
### Alternatively use the static hardware detection module (for systems that
### lack HAL support)
load-module module-detect
.endif
### Load several protocols
load-module module-esound-protocol-unix socket=/tmp/.esd/socket
load-module module-native-protocol-unix
### Network access (may be configured with paprefs, so leave this commented
### here if you plan to use paprefs)
#load-module module-esound-protocol-tcp
load-module module-native-protocol-tcp auth-anonymous=1
#load-module module-zeroconf-publish
### Load the RTP reciever module (also configured via paprefs, see above)
#load-module module-rtp-recv
### Load the RTP sender module (also configured via paprefs, see above)
#load-module module-null-sink sink_name=rtp format=s16be channels=2 rate=44100 description="RTP Multicast Sink"
#load-module module-rtp-send source=rtp.monitor
### Automatically restore the volume of playback streams
load-module module-volume-restore
### Automatically restore the default sink/source when changed by the user during runtime
load-module module-default-device-restore
### Automatically move streams to the default sink if the sink they are
### connected to dies, similar for sources
load-module module-rescue-streams
### Automatically suspend sinks/sources that become idle for too long
load-module module-suspend-on-idle
### Load X11 bell module
#load-module module-x11-bell sample=x11-bell
### Publish connection data in the X11 root window
.ifexists /usr/lib/pulse-0.9/modules//module-x11-publish.so
load-module module-x11-publish
.endif
### Register ourselves in the X11 session manager
# Deactivated by default, to avoid deadlock when PA is started as esd from gnome-session
# Instead we load this via /etc/xdg/autostart/ and "pactl load-module" now
# load-module module-x11-xsmp
### Load additional modules from GConf settings. This can be configured with the paprefs tool.
### Please keep in mind that the modules configured by paprefs might conflict with manually
### loaded modules.
.ifexists /usr/lib/pulse-0.9/modules//module-gconf.so
load-module module-gconf
.endif
### Make some devices default
#set-default-sink output
#set-default-source input
ok... i have a volume control now.. but trying with amarok, i dont have output... mpd also refuses to work, which i have set up for pulse audio..
Last edited by Rasi (2008-03-13 08:15:12)Well, commected those lines out and restarted Pulse... Amarok still crashes when hitting Play and mpd also refuses to work with pulse-output... Alsa Output still works fine tho...
This is what amarok gives me:
carnager@localhost $ *** PULSEAUDIO: Unable to create stream.
amarokapp: pcm_pulse.c:112: pulse_stop: Zusicherung »pcm->stream« nicht erfüllt
Last edited by Rasi (2008-03-13 19:52:13) -
Web Cam applet is not working in great consistency
Hi... My video capturing applet is not working very well.
The image stream is displayed on the web page in JPEG format with 0.5 quality. However, it crashes after a while and the it does not release the vfw resource.
I have to restart my machine in order to execute it again.
Can anyone please help?
Thanks.
CarterOk. Thanks.
Sender Applet
import javax.swing.*;
import java.io.*;
import java.util.*;
import java.awt.*;
import java.awt.event.*;
/*<applet code="myGUIApplet.class" width="300" height="300"></applet>*/
public class myGUIApplet extends JApplet implements ActionListener
private JPanel bottom=new JPanel();
private JPanel centVisual=new JPanel();
private JPanel connectionAddress=new JPanel();
private JButton capture=new JButton("Start Capturing");
private JButton stops=new JButton("Stop");
private JMenuBar menubar=new JMenuBar();
private JMenu file=new JMenu("file");
private JMenuItem fileItem1=new JMenuItem("Exit");
private JLabel serverip=new JLabel("Server IP");
private JTextField setIP=new JTextField();
public static JTextField ServerInfo=new JTextField();
private MyTransmitter mytrans;
private String ip;
public static final String DEFAULT_MULTICAST_IP="226.10.10.20";
public static final String DEFAULT_PORT="80";
public void init()
//setSize(400,400);
setLayout(new BorderLayout());
menubar.add(file);
file.add(fileItem1);
bottom.setLayout(new BorderLayout());
bottom.setBackground(Color.black);
bottom.add("West",capture);
bottom.add("East",stops);
connectionAddress.setLayout(new BorderLayout());
connectionAddress.add("North",serverip);
connectionAddress.add("South",setIP);
ServerInfo.setEditable(false);
connectionAddress.add("Center",ServerInfo);
setIP.addActionListener(this);
setIP.setText("");
capture.setBackground(Color.lightGray);
capture.addActionListener(this);
stops.addActionListener(this);
fileItem1.addActionListener(this);
add("South",bottom);
add("North",menubar);
add("Center",connectionAddress);
public void actionPerformed(ActionEvent ae){
Object source=ae.getSource();
if(source==capture){
if(setIP.getText().equals(""))
ip=DEFAULT_MULTICAST_IP;
else{
ip=setIP.getText();
if(mytrans!=null){
mytrans.stopTransmitter();
mytrans=null;
System.out.println(" - Connecting to "+ip+" port: "+DEFAULT_PORT);
ServerInfo.setText(" - Connecting to "+ip+" port: "+DEFAULT_PORT);
mytrans=new MyTransmitter(ip,DEFAULT_PORT,ServerInfo);
mytrans.start();
if(source==stops){
if(mytrans!=null)
mytrans.stopTransmitter();
System.exit(0);
if(source==fileItem1){
if(mytrans!=null)
mytrans.stopTransmitter();
System.exit(0);
public void destroy(){
if(mytrans!=null){
mytrans.stopTransmitter();
import java.awt.*;
import javax.swing.*;
import java.io.*;
import java.util.*;
import java.net.InetAddress;
import javax.media.*;
import javax.media.protocol.*;
import javax.media.protocol.DataSource;
import javax.media.format.*;
import javax.media.control.TrackControl;
import javax.media.control.QualityControl;
import javax.media.rtp.*;
import javax.media.rtp.rtcp.*;
import javax.media.rtp.*;
import java.io.InputStream;
import javax.media.rtp.RTPManager;
public class MyTransmitter extends Thread
private MediaLocator videoLocator;
private String ipAddress;
private int basePort;
private Integer stateLock=new Integer(0);
private boolean failure;
private Processor processor;
private DataSource videoDataInput,videoDataOutput;
private RTPManager rtpMgrs[];
private VideoFormat JPEG_VIDEO=new VideoFormat(VideoFormat.JPEG_RTP);
private SendStream sendStream;
private SourceDescription descriptionList[];
private JTextField infoField;
public MyTransmitter(String ips,String ports,JTextField ServerInfo){
infoField=ServerInfo;
ipAddress=ips;
Integer bPort=Integer.valueOf(ports);
if(bPort!=null)
basePort=bPort.intValue();
public void run()
initializeVideo();
if(videoLocator!=null){
createMyProcessor();
createMyManager();
// May be should put inside the if..else statements
//createMyTransmitter();
// Initailize the video
public void initializeVideo()
// Stre the devices in a vector
VideoFormat format=new VideoFormat(VideoFormat.RGB);
Vector deviceList=CaptureDeviceManager.getDeviceList(format);
CaptureDeviceInfo deviceInfo=null;
// If there is more than one device detected
if(deviceList.size()>0){
// Set the first device to device Info
// GEt the media locator of the devie
deviceInfo=(CaptureDeviceInfo)deviceList.elementAt(0);
videoLocator=deviceInfo.getLocator();
}else{
System.out.println(" --X No device found...");
infoField.setText(" --X No device found...");
public void createMyProcessor()
boolean result=false;
DataSource ds=null;
// Check if the media locator is null
if(videoLocator==null){
System.out.println(" --X No video locator..");
infoField.setText(" --X No video locator...");
System.out.println(" - Trying to create a Processor..");
infoField.setText(" - Trying to create a Processor..");
// Attempt to create DataSource from media locator
try{
ds=Manager.createDataSource(videoLocator);
}catch(Exception ex){
System.out.println(" --X Unable to create dataSource : "+ex.getMessage());
System.out.println(" - Video data source is created..");
infoField.setText(" - Video data source is created..");
// Try to create Processor from DataSource
try{
processor=Manager.createProcessor(ds);
}catch(NoProcessorException npe){
System.out.println(" --X Unable to create Processor: "+npe.getMessage());
infoField.setText(" --X Unable to create Processor: "+npe.getMessage());
catch(IOException ioe){
System.out.println(" --X IOException creating Processor..");
infoField.setText(" --X IOException creating Processor..");
// Wait for the processor to be configured
result=waitForState(processor,Processor.Configured);
if(result==false){
System.out.println(" --X Could not configure processor..");
infoField.setText(" --X Could not configure processor..");
// Set the track controls for processor
TrackControl []tracks=processor.getTrackControls();
if(tracks==null || tracks.length<1){
System.err.println(" --X No track is found..");
infoField.setText(" --X No track is found..");
// Set the content description of processor to RAW_RTP format
// This will limit the supported formats to reported from
// Track.getSupportedFormats() to valid RTP format
ContentDescriptor cdes=new ContentDescriptor(ContentDescriptor.RAW_RTP);
processor.setContentDescriptor(cdes);
Format []supported;
Format chosen=null;
boolean atLeastOneTrack=false;
for(int i=0;i<tracks.length;i++){
Format format=tracks.getFormat();
if(tracks[i].isEnabled()){
supported=tracks[i].getSupportedFormats();
// WE've set the output content to RAW_RTP.
// So, all the supporte formats should work with RAW_RTP.
// We will pick the first one.
if(supported.length>0){
if(supported[0] instanceof VideoFormat){
chosen=checkVideoSize(tracks[i].getFormat(),supported[0]);
}else
chosen=supported[0];
tracks[i].setFormat(chosen);
System.out.println(" Track "+i+" is transmitted in "+chosen+" format.. ");
infoField.setText(" Track "+i+" is transmitted in "+chosen+" format.. ");
atLeastOneTrack=true;
}else{
// If no format is suitable, track is disabled
tracks[i].setEnabled(false);
}else
tracks[i].setEnabled(false);
if(!atLeastOneTrack)
System.out.println("atLeastOneTrack: "+atLeastOneTrack);
System.out.println(" --X Could Not find track to RTP format..");
infoField.setText("atLeastOneTrack: "+atLeastOneTrack);
infoField.setText(" --X Could Not find track to RTP format..");
result=waitForState(processor,Controller.Realized);
if(result==false){
System.out.println(" --X Could NOT realize processor...");
infoField.setText(" --X Could NOT realize processor...");
// Set the JPEG Quality to value 0.5
setJPEGQuality(processor,0.5f);
// Set the output Data Source
videoDataOutput=processor.getDataOutput();
//Start the processor
processor.start();
public void setJPEGQuality(Processor p,float values)
Control []cs=p.getControls();
QualityControl qc=null;
VideoFormat JPEGFmt=new VideoFormat(VideoFormat.JPEG);
// Loop through the ocntrols to find the Quality control for the JPEG encoder
for(int i=0;i<cs.length;i++){
if(cs[i] instanceof QualityControl && cs[i] instanceof Owned){
Object owner=((Owned)cs[i]).getOwner();
// Check if the owner is the Codec
// Check the format of output as well
if(owner instanceof Codec){
Format fmts[]=((Codec)owner).getSupportedOutputFormats(null);
// Loop through the supported format and set the quality to 0.5
for(int j=0;j<fmts.length;j++){
qc=(QualityControl)cs[i];
qc.setQuality(values);
System.out.println(" - Quality is set to "+values+" on "+qc);
infoField.setText(" - Quality is set to "+values+" on "+qc);
break;
if(qc!=null)
break;
public Format checkVideoSize(Format originalFormat,Format supported)
int width,height;
Dimension size=((VideoFormat)originalFormat).getSize();
Format jpegFormat=new Format(VideoFormat.JPEG_RTP);
Format h263fmt=new Format(VideoFormat.H263_RTP);
if(supported.matches(jpegFormat)){
width=(size.width%8 == 0 ? size.width:(int)(size.width%8)*8);
height=(size.height%8 == 0 ? size.height:(int)(size.height%8)*8);
}else if(supported.matches(h263fmt)){
if(size.width<128){
width=128;
height=96;
}else if(size.width<176){
width=176;
height=144;
}else{
width=352;
height=288;
}else{
// Unknown format, just return it.
return supported;
return (new VideoFormat(null,new Dimension(width,height),Format.NOT_SPECIFIED,null,Format.NOT_SPECIFIED)).intersects(supported);
public boolean waitForState(Processor p,Integer status)
p.addControllerListener(new StateListener());
failure=false;
if(status==Processor.Configured){
p.configure();
}else if(status==Processor.Realized){
p.realize();
//Wait until an event that confirms the success of the method, or failure of an event
while(p.getState()<status && !failure){
synchronized(getStateLock()){
try{
// Wait
getStateLock().wait();
}catch(InterruptedException ie){
return false;
if(failure)
return false;
else
return true;
public Integer getStateLock(){
return stateLock;
public void setFailure(){
failure=true;
public void createMyManager()
SessionAddress destAddress;
InetAddress ipAddr;
int port;
SourceDescription srcDesList[];
PushBufferDataSource pbds=(PushBufferDataSource)videoDataOutput;
PushBufferStream pbss[]=pbds.getStreams();
rtpMgrs=new RTPManager[pbss.length];
for(int a=0;a<pbss.length;a++){
try{
// RTP Managers or RTP Manager?????
rtpMgrs[a]=RTPManager.newInstance();
port=basePort;
ipAddr=InetAddress.getByName(ipAddress);
SessionAddress localAddr=new SessionAddress(InetAddress.getLocalHost(),port+20);
destAddress=new SessionAddress(ipAddr,port,1);
Integer myipprefix=Integer.valueOf(ipAddress.substring(0,3));
if((myipprefix.intValue()>223) && (myipprefix.intValue()<240)){
rtpMgrs[a].initialize(destAddress);
}else{
rtpMgrs[a].initialize(localAddr);
rtpMgrs[a].addTarget(destAddress);
System.out.println(" Created RTP session: "+ipAddress+" "+port+" to "+destAddress);
infoField.setText(" Created RTP session: "+ipAddress+" "+port+" to "+destAddress);
if(videoDataOutput!=null){
sendStream=rtpMgrs[a].createSendStream(videoDataOutput,0);
sendStream.start();
System.out.println(" RTP stream is started..");
infoField.setText(" RTP stream is started..");
}catch(UnsupportedFormatException ex){
System.out.println(" --X Unsupported Format : "+ex);
infoField.setText(" --X Unsupported Format : "+ex);
catch(IOException ioe){
System.out.println(" --X IOException : "+ioe.getMessage());
infoField.setText(" --X IOException : "+ioe.getMessage());
catch(Exception ex){
System.out.println(" --X Unable to create RTP Manager...");
System.out.println(ex.getMessage());
infoField.setText(" --X Unable to create RTP Manager..."+ex.getMessage());
/*public void createMyTransmitter()
try{
if(videoDataOutput!=null){
sendStream=rtpMgrs[i].createSendStream(videoDataOutput,0);
sendStream.start();
}catch(UnsupportedFormatException ex){
System.out.println(" --X Unsupported Format : "+ex);
infoField.setText(" --X Unsupported Format : "+ex);
catch(IOException ioe){
System.out.println(" --X IOException : "+ioe.getMessage());
infoField.setText(" --X IOException : "+ioe.getMessage());
public void stopTransmitter(){
if(processor!=null){
processor.stop();
processor.close();
processor=null;
// Loop through RTP Managers and close all managers..
// Dispose them for garbage collection
for(int i=0;i<rtpMgrs.length;i++){
rtpmgrs[i].removeSendStream(this);
rtpMgrs[i].removeTargets("Session ended..");
rtpMgrs[i].dispose();
//rtpMgrs.removeTargets("Session ended..");
//rtpMgrs.dispose();
* StateListener class to handle Controller events
class StateListener implements ControllerListener{
public void controllerUpdate(ControllerEvent ce){
if(ce instanceof ControllerClosedEvent){
processor.close();
/* Handle all controller events and notify all
waiting thread in waitForState method */
if(ce instanceof ControllerEvent){
synchronized(getStateLock()){
getStateLock().notifyAll();
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
Client Applet
import javax.media.*;
import javax.media.protocol.*;
import javax.media.protocol.DataSource;
import javax.media.control.BufferControl;
import javax.media.control.*;
import javax.media.format.*;
import javax.media.rtp.*;
import javax.media.rtp.rtcp.*;
import javax.media.rtp.event.*;
import com.sun.media.rtp.RTPSessionMgr;
import java.awt.*;
import java.awt.event.*;
import javax.swing.*;
import java.util.*;
import java.io.*;
import java.net.*;
import java.net.URL;
import java.net.Socket;
/*<applet code="clientPlayerApplet.class" width="400" height="300">
<param name=ServerIPS value="192.168.0.9">
<param name=ServerPort value="80">
<param name=TimeToLive value="1">
<param name=archive value="clientPlayerApplet.jar">
</applet> */
public class clientPlayerApplet extends JApplet implements ControllerListener, ReceiveStreamListener,SessionListener
String sessions[]=null;
RTPManager rtpmgrs[]=null;
boolean dataReceived=false;
Object myDataSync=new Object();
private Player player;
//private String serveripadd="226.10.10.20";
//private int serverPort=2020;
//private int timeToLive=1;
private JPanel panel;
private Vector currentParticipant;
public void init()
panel=new JPanel();
setLayout(new BorderLayout());
add("Center",panel);
//String[] urls;
/*urls[0]=getParameter("ServerIPS");
urls[1]="/";
urls[2]=getParameter("ServerPort");*/
String []urls={new String(getParameter("ServerIPS")+"/"+getParameter("ServerPort")+"/"+getParameter("TimeToLive"))};
sessions=urls;
initializePlayer();
public void initializePlayer(){
try{
InetAddress ipAddr;
SessionAddress localAddr=new SessionAddress();
SessionAddress destAddr;
rtpmgrs=new RTPManager[sessions.length];
currentParticipant=new Vector();
//rtpmgrs=new RTPManager();
SessionLabel session=null;
//Open RTP session
for(int i=0;i<sessions.length;i++){
try{
session=new SessionLabel(sessions[i]);
//session=new SessionLabel(sessions);
}catch(IllegalArgumentException iae){
System.out.println(" --X Unable to parse the sesion address given");
System.out.println(" - Open RTP session for "+session.port);
rtpmgrs[i]=(RTPManager) RTPManager.newInstance();
rtpmgrs[i].addSessionListener(this);
rtpmgrs[i].addReceiveStreamListener(this);
ipAddr=InetAddress.getByName(session.addr);
if(ipAddr.isMulticastAddress()){
localAddr=new SessionAddress(ipAddr,session.port,session.ttl);
destAddr=new SessionAddress(ipAddr,session.port,session.ttl);
}else{
localAddr=new SessionAddress(InetAddress.getLocalHost(),session.port);
destAddr=new SessionAddress(ipAddr,session.port);
rtpmgrs[i].initialize(localAddr);
BufferControl bc=(BufferControl)rtpmgrs[i].getControl("javax.media.control.BufferControl");
if(bc!=null)
bc.setBufferLength(600);
rtpmgrs[i].addTarget(destAddr);
}catch(Exception ex){
System.out.println(" --X Cannot create RTP Session "+ex.getMessage());
long currentTime=System.currentTimeMillis();
long waitingDuration=10000;
try{
synchronized(myDataSync){
while(!dataReceived && (System.currentTimeMillis() - currentTime < waitingDuration)){
if(!dataReceived){
myDataSync.wait(1000);
}catch(Exception ex){
System.out.println(" --X myDataSync interrupted...");
if(!dataReceived){
System.out.println(" No RTP Stream Data is received.." );
public void destroy()
for(int i=0;i<currentParticipant.size();i++){
//if(player!=null)
((MyPlayList)currentParticipant.elementAt(i)).close();
// Loop through the RTP Managers
// -> Remove the stream listener
// -> Remove the target address
// -> Dispose the RTP Manager for garbage collection
currentParticipant.removeAllElements();
for(int i=0;i<rtpmgrs.length;i++){
if(rtpmgrs[i]!=null){
rtpmgrs[i].removeReceiveStreamListener(this);
rtpmgrs[i].removeTargets(" Closing session..");
rtpmgrs[i].dispose();
rtpmgrs[i]=null;
MyPlayList find(Player pl){
for(int i=0;i<currentParticipant.size();i++){
MyPlayList mpl=(MyPlayList)currentParticipant.elementAt(i);
if(mpl.clientPlay==pl)
return mpl;
return null;
MyPlayList find(ReceiveStream rs){
for(int i=0;i<currentParticipant.size();i++){
MyPlayList mpl=(MyPlayList)currentParticipant.elementAt(i);
if(mpl.stream==rs)
return mpl;
return null;
* ReceiveStream Listener function *
public synchronized void update(ReceiveStreamEvent rse)
RTPManager mgr=(RTPManager)rse.getSource();
ReceiveStream stream=rse.getReceiveStream();
Participant participant=rse.getParticipant();
if(rse instanceof RemotePayloadChangeEvent){
System.out.println(" -- Received Payload Change Event..");
System.out.println(" Sorry, no payload change is allowed.");
}else if(rse instanceof NewReceiveStreamEvent){
try{
// Once the new stream is detected, create the datasource
stream=((NewReceiveStreamEvent)rse).getReceiveStream();
DataSource outputDS=stream.getDataSource();
// Get RTP Controller to find the format
RTPControl rtpctl=(RTPControl)outputDS.getControl("javax.media.rtp.RTPControl");
if(rtpctl!=null){
System.out.println(" -> Received new rtP stream: "+rtpctl.getFormat());
}else
System.out.println(" -> Received new RTP stream");
if(participant!=null){
System.out.println(" -> New stream received from: "+participant.getCNAME());
}else{
System.out.println(" -> New stream detected... ");
player=Manager.createPlayer(outputDS);
if(player==null)
return;
System.out.println(" - Player is created...");
player.addControllerListener(this);
player.realize();
// Helper class to identify the player and stream
MyPlayList mpl=new MyPlayList(player,stream);
// Add the helper class object to Vector
currentParticipant.addElement(mpl);
// Notify initializePlayer() that a new stream has arrived
synchronized(myDataSync){
dataReceived=true;
myDataSync.notifyAll();
}catch(Exception ex){
System.out.println(" --X NewReceiveStream Exception: "+ex.getMessage());
return;
}else if(rse instanceof ByeEvent){
System.out.println(" - BYE packet received from "+participant.getCNAME());
MyPlayList mpls=find(stream);
if(player!=mpls){
mpls.close();
currentParticipant.removeElement(mpls);
if(mgr!=null){
mgr.removeReceiveStreamListener(this);
mgr.removeTargets(" Closing session..");
mgr.dispose();
mgr=null;
}else if(rse instanceof StreamMappedEvent){
if(stream!=null && stream.getDataSource()!=null){
DataSource myds=stream.getDataSource();
RTPControl rtpctrl=(RTPControl)myds.getControl("javax.media.rtp.RTPControl");
System.out.println(" -> The previously unidentified stream ");
if(rtpctrl!=null)
System.out.println(" "+rtpctrl.getFormat());
System.out.println(" has been identified as sent by :"+participant.getCNAME());
* Session Listener
public void update(SessionEvent sesevt)
if(sesevt instanceof NewParticipantEvent){
Participant part=((NewParticipantEvent)sesevt).getParticipant();
System.out.println(" -> A new partcipant has joined :"+part.getCNAME());
* ControllerListener for Players
public synchronized void controllerUpdate(ControllerEvent ce)
Player p=(Player)ce.getSource();
if(p==null)
return;
if(ce instanceof RealizeCompleteEvent){
MyPlayList mpls=find(p);
if(mpls!=null){
p.start();
if(p.getVisualComponent()!=null){
panel.add(player.getVisualComponent());
panel.validate();
if(ce instanceof ControllerErrorEvent){
p.removeControllerListener(this);
MyPlayList mpls=find(p);
if(mpls!=null){
// Close the player
// Remove the player helper class object from the list
p.close();
currentParticipant.removeElement(mpls);
System.out.println("Receiver internal error: "+ce);
class SessionLabel{
public String addr=null;
public int port;
public int ttl;
SessionLabel(String session) throws IllegalArgumentException
int off;
String portStr=null;
String ttlStr=null;
if(session!=null && session.length() >0){
while(session.length()>1 && session.charAt(0)=='/')
session=session.substring(1);
off=session.indexOf('/');
if(off==-1){
if(!session.equals(""))
addr=session;
}else{
addr=session.substring(0,off);
session=session.substring(off+1);
off=session.indexOf('/');
if(off==-1){
if(!session.equals(""))
portStr=session;
}else{
portStr=session.substring(0,off);
session=session.substring(off+1);
off=session.indexOf('/');
if(off==-1){
if(!session.equals(""))
ttlStr=session;
}else{
ttlStr=session.substring(0,off);
if(addr==null)
throw new IllegalArgumentException();
if(portStr!=null)
try{
Integer ints=Integer.valueOf(portStr);
if(ints!=null)
port=ints.intValue();
}catch(Throwable t){
System.out.println(" --X PortStr Error..");
throw new IllegalArgumentException();
}else
throw new IllegalArgumentException();
if(ttlStr!=null){
try{
Integer intsttl=Integer.valueOf(ttlStr);
if(intsttl!=null)
ttl=intsttl.intValue();
}catch(Throwable t){
System.out.println(" --X PortStr Error..");
throw new IllegalArgumentException();
class MyPlayList{
Player clientPlay;
ReceiveStream stream;
MyPlayList(Player p,ReceiveStream rs){
clientPlay=p;
stream=rs;
public void close()
clientPlay.close(); -
Exception in thread "RTPC Report" java.lang.NullPointerException
Hi.. I am having the above problem when ruuning my transmission program..
I run my code and it seems to be ok... There is message showing the web cam stream is being transmitted...
However, it dawn on me when i could not even receive any stream via JMStudio with the specified address. e.g. 220.10.10.20 at port 2020.
Can any one please help?
Thanks.
CArter
Following is my code...
import java.awt.*;
import java.io.*;
import java.util.*;
import java.net.InetAddress;
import javax.media.*;
import javax.media.protocol.*;
import javax.media.protocol.DataSource;
import javax.media.format.*;
import javax.media.control.TrackControl;
import javax.media.control.QualityControl;
import javax.media.rtp.*;
import javax.media.rtp.rtcp.*;
import javax.media.rtp.*;
import java.io.InputStream;
import javax.media.rtp.RTPManager;
public class MyTransmitter extends Thread
private MediaLocator videoLocator;
private String ipAddress;
private int basePort;
private Integer stateLock=new Integer(0);
private boolean failure;
private Processor processor;
private DataSource videoDataInput,videoDataOutput;
private RTPManager rtpMgrs[];
private VideoFormat JPEG_VIDEO=new VideoFormat(VideoFormat.JPEG_RTP);
private SendStream sendStream;
private SourceDescription descriptionList[];
public MyTransmitter(String ips,String ports){
ipAddress=ips;
Integer bPort=Integer.valueOf(ports);
if(bPort!=null)
basePort=bPort.intValue();
public void run()
initializeVideo();
if(videoLocator!=null){
createMyProcessor();
createMyManager();
// May be should put inside the if..else statements
//createMyTransmitter();
// Initailize the video
public void initializeVideo()
// Stre the devices in a vector
VideoFormat format=new VideoFormat(VideoFormat.RGB);
Vector deviceList=CaptureDeviceManager.getDeviceList(format);
CaptureDeviceInfo deviceInfo=null;
// If there is more than one device detected
if(deviceList.size()>0){
// Set the first device to device Info
// GEt the media locator of the devie
deviceInfo=(CaptureDeviceInfo)deviceList.elementAt(0);
videoLocator=deviceInfo.getLocator();
}else{
System.out.println(" --X No device found...");
public void createMyProcessor()
boolean result=false;
DataSource ds=null;
// Check if the media locator is null
if(videoLocator==null){
System.out.println(" --X No video locator..");
System.out.println(" - Trying to create a Processor..");
// Attempt to create DataSource from media locator
try{
ds=Manager.createDataSource(videoLocator);
}catch(Exception ex){
System.out.println(" --X Unable to create dataSource : "+ex.getMessage());
System.out.println(" - Video data source is created..");
// Try to create Processor from DataSource
try{
processor=Manager.createProcessor(ds);
}catch(NoProcessorException npe){
System.out.println(" --X Unable to create Processor: "+npe.getMessage());
catch(IOException ioe){
System.out.println(" --X IOException creating Processor..");
// Wait for the processor to be configured
result=waitForState(processor,Processor.Configured);
if(result==false)
System.out.println(" --X Could not configure processor..");
// Set the track controls for processor
TrackControl []tracks=processor.getTrackControls();
if(tracks==null || tracks.length<1){
System.err.println(" --X No track is found..");
// Set the content description of processor to RAW_RTP format
// This will limit the supported formats to reported from
// Track.getSupportedFormats() to valid RTP format
ContentDescriptor cdes=new ContentDescriptor(ContentDescriptor.RAW_RTP);
processor.setContentDescriptor(cdes);
Format []supported;
Format chosen=null;
boolean atLeastOneTrack=false;
for(int i=0;i<tracks.length;i++){
Format format=tracks.getFormat();
if(tracks[i].isEnabled()){
supported=tracks[i].getSupportedFormats();
// WE've set the output content to RAW_RTP.
// So, all the supporte formats should work with RAW_RTP.
// We will pick the first one.
if(supported.length>0){
if(supported[0] instanceof VideoFormat){
chosen=checkVideoSize(tracks[i].getFormat(),supported[0]);
}else
chosen=supported[0];
tracks[i].setFormat(chosen);
System.out.println(" Track "+i+" is transmitted in "+chosen+" format.. ");
atLeastOneTrack=true;
}else{
// If no format is suitable, track is disabled
tracks[i].setEnabled(false);
}else
tracks[i].setEnabled(false);
if(!atLeastOneTrack)
System.out.println("atLeastOneTrack: "+atLeastOneTrack);
System.out.println(" --X Could Not find track to RTP format..");
result=waitForState(processor,Controller.Realized);
if(result==false){
System.out.println(" --X Could NOT realize processor...");
// Set the JPEG Quality to value 0.5
setJPEGQuality(processor,0.5f);
// Set the output Data Source
videoDataOutput=processor.getDataOutput();
//Start the processor
processor.start();
public void setJPEGQuality(Processor p,float values)
Control []cs=p.getControls();
QualityControl qc=null;
VideoFormat JPEGFmt=new VideoFormat(VideoFormat.JPEG);
// Loop through the ocntrols to find the Quality control for the JPEG encoder
for(int i=0;i<cs.length;i++){
if(cs[i] instanceof QualityControl && cs[i] instanceof Owned){
Object owner=((Owned)cs[i]).getOwner();
// Check if the owner is the Codec
// Check the format of output as well
if(owner instanceof Codec){
Format fmts[]=((Codec)owner).getSupportedOutputFormats(null);
// Loop through the supported format and set the quality to 0.5
for(int j=0;j<fmts.length;j++){
qc=(QualityControl)cs[i];
qc.setQuality(values);
System.out.println(" - Quality is set to "+values+" on "+qc);
break;
if(qc!=null)
break;
public Format checkVideoSize(Format originalFormat,Format supported)
int width,height;
Dimension size=((VideoFormat)originalFormat).getSize();
Format jpegFormat=new Format(VideoFormat.JPEG_RTP);
Format h263fmt=new Format(VideoFormat.H263_RTP);
if(supported.matches(jpegFormat)){
width=(size.width%8 == 0 ? size.width:(int)(size.width%8)*8);
height=(size.height%8 == 0 ? size.height:(int)(size.height%8)*8);
}else if(supported.matches(h263fmt)){
if(size.width<128){
width=128;
height=96;
}else if(size.width<176){
width=176;
height=144;
}else{
width=352;
height=288;
}else{
// Unknown format, just return it.
return supported;
return (new VideoFormat(null,new Dimension(width,height),Format.NOT_SPECIFIED,null,Format.NOT_SPECIFIED)).intersects(supported);
public boolean waitForState(Processor p,Integer status)
p.addControllerListener(new StateListener());
failure=false;
if(status==Processor.Configured){
p.configure();
}else if(status==Processor.Realized){
p.realize();
//Wait until an event that confirms the success of the method, or failure of an event
while(p.getState()<status && !failure){
synchronized(getStateLock()){
try{
// Wait
getStateLock().wait();
}catch(InterruptedException ie){
return false;
if(failure)
return false;
else
return true;
public Integer getStateLock(){
return stateLock;
public void setFailure(){
failure=true;
public void createMyManager()
SessionAddress destAddress;
InetAddress ipAddr;
int port;
SourceDescription srcDesList[];
PushBufferDataSource pbds=(PushBufferDataSource)videoDataOutput;
PushBufferStream pbss[]=pbds.getStreams();
rtpMgrs=new RTPManager[pbss.length];
for(int a=0;a<pbss.length;a++){
try{
// RTP Managers or RTP Manager?????
rtpMgrs[a]=RTPManager.newInstance();
port=basePort;
ipAddr=InetAddress.getByName(ipAddress);
SessionAddress localAddr=new SessionAddress(InetAddress.getLocalHost(),port+20);
destAddress=new SessionAddress(ipAddr,port,1);
Integer myipprefix=Integer.valueOf(ipAddress.substring(0,3));
if((myipprefix.intValue()>223) && (myipprefix.intValue()<240)){
rtpMgrs[a].initialize(destAddress);
}else{
rtpMgrs[a].initialize(localAddr);
rtpMgrs[a].addTarget(destAddress);
System.out.println(" Created RTP session: "+ipAddress+" "+port+" to "+destAddress);
if(videoDataOutput!=null){
sendStream=rtpMgrs[a].createSendStream(videoDataOutput,0);
sendStream.start();
}catch(UnsupportedFormatException ex){
System.out.println(" --X Unsupported Format : "+ex);
catch(IOException ioe){
System.out.println(" --X IOException : "+ioe.getMessage());
catch(Exception ex){
System.out.println(" --X Unable to create RTP Manager...");
System.out.println(ex.getMessage());
/*public void createMyTransmitter()
try{
if(videoDataOutput!=null){
sendStream=rtpMgrs[i].createSendStream(videoDataOutput,0);
sendStream.start();
}catch(UnsupportedFormatException ex){
System.out.println(" --X Unsupported Format : "+ex);
catch(IOException ioe){
System.out.println(" --X IOException : "+ioe.getMessage());
public void stopTransmitter(){
if(processor!=null){
processor.stop();
processor.close();
processor=null;
// Loop through RTP Managers and close all managers..
// Dispose them for garbage collection
for(int i=0;i<rtpMgrs.length;i++){
rtpMgrs[i].removeTargets("Session ended..");
rtpMgrs[i].dispose();
//rtpMgrs.removeTargets("Session ended..");
//rtpMgrs.dispose();
* StateListener class to handle Controller events
class StateListener implements ControllerListener{
public void controllerUpdate(ControllerEvent ce){
if(ce instanceof ControllerClosedEvent){
processor.close();
/* Handle all controller events and notify all
waiting thread in waitForState method */
if(ce instanceof ControllerEvent){
synchronized(getStateLock()){
getStateLock().notifyAll();Ok I reviewed your code and there were a couple things which I am confused about. Firstly, it looks like you have a section of code which checks to see if the ip address preffix is within the 240-223 range, which tells me that you are trying to implement multicast addresses. However, your example ip is out of the multicast range. Also the InetAddress has an isMulticastAddress() method which can check that for you.
Those are just the first things that struck me and I'll keep going through the code. -
DO i need some extra hardware interface for receving both Audio and video
hi i m doing e-learning project. i have to capture video from webcam and voice from headphone and send to client.
but my code is working fine for either one at a time.
DO i need some extra hardware interface for receving both Audio and video. im using code AVTransmit and AVReceive found from this site only
After running TX
i give Dsound:// & vfw://0 in Media Locater only sound is received and no vedio
and when i give vfw://0 in Media Locater only live video is transmited.
im using JMF1.1.2e.
if any one know the method to run or cause of it plz reply me soon. i will be very thankfull
transmiter/server side code .first run TX on server
import java.io.*;
import java.awt.*;
import java.awt.event.*;
import java.net.*;
import java.util.*;
import javax.media.rtp.*;
import javax.swing.*;
import javax.swing.event.*;
import javax.swing.border.*;
public class Tx extends JFrame implements ActionListener, KeyListener,
MouseListener, WindowListener {
Vector targets;
JList list;
JButton startXmit;
JButton rtcp;
JButton update;
JButton expiration;
JButton statistics;
JButton addTarget;
JButton removeTarget;
JTextField tf_remote_address;
JTextField tf_remote_data_port;
JTextField tf_media_file;
JTextField tf_data_port;
TargetListModel listModel;
AVTransmitter avTransmitter;
RTCPViewer rtcpViewer;
JCheckBox cb_loop;
Config config;
public Tx() {
setTitle( "JMF/RTP Transmitter");
config= new Config();
GridBagLayout gridBagLayout= new GridBagLayout();
GridBagConstraints gbc;
JPanel p= new JPanel();
p.setLayout( gridBagLayout);
JPanel localPanel= createLocalPanel();
gbc= new GridBagConstraints();
gbc.gridx= 0;
gbc.gridy= 0;
gbc.gridwidth= 2;
gbc.anchor= GridBagConstraints.CENTER;
gbc.fill= GridBagConstraints.BOTH;
gbc.insets= new Insets( 10, 5, 0, 0);
((GridBagLayout)p.getLayout()).setConstraints( localPanel, gbc);
p.add( localPanel);
JPanel targetPanel= createTargetPanel();
gbc= new GridBagConstraints();
gbc.gridx= 1;
gbc.gridy= 1;
gbc.weightx= 1.0;
gbc.weighty= 1.0;
gbc.anchor= GridBagConstraints.CENTER;
gbc.fill= GridBagConstraints.BOTH;
gbc.insets= new Insets( 10, 5, 0, 0);
((GridBagLayout)p.getLayout()).setConstraints( targetPanel, gbc);
p.add( targetPanel);
JPanel mediaPanel= createMediaPanel();
gbc= new GridBagConstraints();
gbc.gridx= 1;
gbc.gridy= 2;
gbc.weightx= 1.0;
gbc.weighty= 1.0;
gbc.anchor= GridBagConstraints.CENTER;
gbc.fill= GridBagConstraints.BOTH;
gbc.insets= new Insets( 10, 5, 0, 0);
((GridBagLayout)p.getLayout()).setConstraints( mediaPanel, gbc);
p.add( mediaPanel);
JPanel buttonPanel= new JPanel();
rtcp= new JButton( "RTCP Monitor");
update= new JButton( "Transmission Status");
update.setEnabled( false);
rtcp.addActionListener( this);
update.addActionListener( this);
buttonPanel.add( rtcp);
buttonPanel.add( update);
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 3;
gbc.gridwidth= 2;
gbc.weightx = 1.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.CENTER;
gbc.fill = GridBagConstraints.HORIZONTAL;
gbc.insets = new Insets( 5,5,10,5);
((GridBagLayout)p.getLayout()).setConstraints( buttonPanel, gbc);
p.add( buttonPanel);
getContentPane().add( p);
list.addMouseListener( this);
addWindowListener( this);
pack();
setVisible( true);
private JPanel createMediaPanel() {
JPanel p= new JPanel();
GridBagLayout gridBagLayout= new GridBagLayout();
GridBagConstraints gbc;
p.setLayout( gridBagLayout);
JLabel label= new JLabel( "Media Locator:");
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 0;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.EAST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,10,5);
((GridBagLayout)p.getLayout()).setConstraints( label, gbc);
p.add( label);
tf_media_file= new JTextField( 35);
gbc= new GridBagConstraints();
gbc.gridx = 1;
gbc.gridy = 0;
gbc.weightx = 1.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.WEST;
gbc.fill = GridBagConstraints.HORIZONTAL;
gbc.insets = new Insets( 5,5,10,5);
((GridBagLayout)p.getLayout()).setConstraints( tf_media_file, gbc);
p.add( tf_media_file);
tf_media_file.setText( config.media_locator);
cb_loop= new JCheckBox( "loop");
startXmit= new JButton( "Start Transmission");
startXmit.setEnabled( true);
startXmit.addActionListener( this);
gbc= new GridBagConstraints();
gbc.gridx = 2;
gbc.gridy = 0;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.WEST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,10,5);
((GridBagLayout)p.getLayout()).setConstraints( cb_loop, gbc);
p.add( cb_loop);
cb_loop.setSelected( true);
cb_loop.addActionListener( this);
gbc= new GridBagConstraints();
gbc.gridx = 1;
gbc.gridy = 1;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.CENTER;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,10,5);
((GridBagLayout)p.getLayout()).setConstraints( startXmit, gbc);
p.add( startXmit);
TitledBorder titledBorder= new TitledBorder( new EtchedBorder(), "Source");
p.setBorder( titledBorder);
return p;
private JPanel createTargetPanel() {
JPanel p= new JPanel();
GridBagLayout gridBagLayout= new GridBagLayout();
GridBagConstraints gbc;
p.setLayout( gridBagLayout);
targets= new Vector();
for( int i= 0; i < config.targets.size(); i++) {
targets.addElement( config.targets.elementAt( i));
listModel= new TargetListModel( targets);
list= new JList( listModel);
list.addKeyListener( this);
list.setPrototypeCellValue( "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx");
JScrollPane scrollPane= new JScrollPane( list,
ScrollPaneConstants.VERTICAL_SCROLLBAR_AS_NEEDED,
ScrollPaneConstants.HORIZONTAL_SCROLLBAR_NEVER);
gbc= new GridBagConstraints();
gbc.gridx= 0;
gbc.gridy= 0;
gbc.weightx= 1.0;
gbc.weighty= 1.0;
gbc.anchor= GridBagConstraints.CENTER;
gbc.fill= GridBagConstraints.BOTH;
gbc.insets= new Insets( 10, 5, 0, 0);
((GridBagLayout)p.getLayout()).setConstraints( scrollPane, gbc);
p.add( scrollPane);
JPanel p1= new JPanel();
p1.setLayout( gridBagLayout);
JLabel label= new JLabel( "IP Address:");
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 0;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.EAST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p1.getLayout()).setConstraints( label, gbc);
p1.add( label);
tf_remote_address= new JTextField( 15);
gbc= new GridBagConstraints();
gbc.gridx = 1;
gbc.gridy = 0;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.WEST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p1.getLayout()).setConstraints( tf_remote_address, gbc);
p1.add( tf_remote_address);
label= new JLabel( "Data Port:");
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 1;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.EAST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p1.getLayout()).setConstraints( label, gbc);
p1.add( label);
tf_remote_data_port= new JTextField( 15);
gbc= new GridBagConstraints();
gbc.gridx = 1;
gbc.gridy = 1;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.WEST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p1.getLayout()).setConstraints( tf_remote_data_port, gbc);
p1.add( tf_remote_data_port);
JPanel p2= new JPanel();
addTarget= new JButton( "Add Target");
removeTarget= new JButton( "Remove Target");
p2.add( addTarget);
p2.add( removeTarget);
addTarget.addActionListener( this);
removeTarget.addActionListener( this);
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 2;
gbc.weightx = 1.0;
gbc.weighty = 0.0;
gbc.gridwidth= 2;
gbc.anchor = GridBagConstraints.CENTER;
gbc.fill = GridBagConstraints.HORIZONTAL;
gbc.insets = new Insets( 20,5,0,5);
((GridBagLayout)p1.getLayout()).setConstraints( p2, gbc);
p1.add( p2);
gbc= new GridBagConstraints();
gbc.gridx= 1;
gbc.gridy= 0;
gbc.weightx= 1.0;
gbc.weighty= 1.0;
gbc.anchor= GridBagConstraints.CENTER;
gbc.fill= GridBagConstraints.BOTH;
gbc.insets= new Insets( 10, 5, 0, 0);
((GridBagLayout)p.getLayout()).setConstraints( p1, gbc);
p.add( p1);
TitledBorder titledBorder= new TitledBorder( new EtchedBorder(), "Targets");
p.setBorder( titledBorder);
return p;
private JPanel createLocalPanel() {
JPanel p= new JPanel();
GridBagLayout gridBagLayout= new GridBagLayout();
GridBagConstraints gbc;
p.setLayout( gridBagLayout);
JLabel label= new JLabel( "IP Address:");
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 0;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.EAST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p.getLayout()).setConstraints( label, gbc);
p.add( label);
JTextField tf_local_host= new JTextField( 15);
gbc= new GridBagConstraints();
gbc.gridx = 1;
gbc.gridy = 0;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.WEST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p.getLayout()).setConstraints( tf_local_host, gbc);
p.add( tf_local_host);
try {
String host= InetAddress.getLocalHost().getHostAddress();
tf_local_host.setText( host);
} catch( UnknownHostException e) {
label= new JLabel( "Data Port:");
gbc= new GridBagConstraints();
gbc.gridx = 0;
gbc.gridy = 1;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.EAST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,0,5);
((GridBagLayout)p.getLayout()).setConstraints( label, gbc);
p.add( label);
tf_data_port= new JTextField( 15);
gbc= new GridBagConstraints();
gbc.gridx = 1;
gbc.gridy = 1;
gbc.weightx = 0.0;
gbc.weighty = 0.0;
gbc.anchor = GridBagConstraints.WEST;
gbc.fill = GridBagConstraints.NONE;
gbc.insets = new Insets( 5,5,10,5);
((GridBagLayout)p.getLayout()).setConstraints( tf_data_port, gbc);
p.add( tf_data_port);
tf_data_port.setText( config.local_data_port);
TitledBorder titledBorder= new TitledBorder( new EtchedBorder(), "Local Host");
p.setBorder( titledBorder);
return p;
public void actionPerformed( ActionEvent event) {
Object source= event.getSource();
if( source == addTarget) {
String ip= tf_remote_address.getText().trim();
String port= tf_remote_data_port.getText().trim();
String localPort= tf_data_port.getText().trim();
addTargetToList( localPort, ip, port);
if( avTransmitter != null) {
avTransmitter.addTarget( ip, port);
} else if( source == removeTarget) {
int index= list.getSelectedIndex();
if( index != -1) {
Target target= (Target) targets.elementAt( index);
if( avTransmitter != null) {
avTransmitter.removeTarget( target.ip, target.port);
targets.removeElement( target);
listModel.setData( targets);
} else if( source == startXmit) {
if( startXmit.getLabel().equals( "Start Transmission")) {
int data_port= new Integer( tf_data_port.getText()).intValue();
avTransmitter= new AVTransmitter( this, data_port);
avTransmitter.start( tf_media_file.getText().trim(), targets);
avTransmitter.setLooping( cb_loop.isSelected());
startXmit.setLabel( "Stop Transmission");
} else if( startXmit.getLabel().equals( "Stop Transmission")) {
avTransmitter.stop();
avTransmitter= null;
removeNonBaseTargets();
listModel.setData( targets);
startXmit.setLabel( "Start Transmission");
} else if( source == rtcp) {
if( rtcpViewer == null) {
rtcpViewer= new RTCPViewer();
} else {
rtcpViewer.setVisible( true);
rtcpViewer.toFront();
} else if( source == cb_loop) {
if( avTransmitter != null) {
avTransmitter.setLooping( cb_loop.isSelected());
private void removeNonBaseTargets() {
String localPort= tf_data_port.getText().trim();
for( int i= targets.size(); i > 0;) {
Target target= (Target) targets.elementAt( i - 1);
if( !target.localPort.equals( localPort)) {
targets.removeElement( target);
i--;
public void addTargetToList( String localPort,
String ip, String port) {
ListUpdater listUpdater= new ListUpdater( localPort, ip,
port, listModel, targets);
SwingUtilities.invokeLater( listUpdater);
public void rtcpReport( String report) {
if( rtcpViewer != null) {
rtcpViewer.report( report);
public void windowClosing( WindowEvent event) {
config.local_data_port= tf_data_port.getText().trim();
config.targets= new Vector();
for( int i= 0; i < targets.size(); i++) {
Target target= (Target) targets.elementAt( i);
if( target.localPort.equals( config.local_data_port)) {
config.addTarget( target.ip, target.port);
config.media_locator= tf_media_file.getText().trim();
config.write();
System.exit( 0);
public void windowClosed( WindowEvent event) {
public void windowDeiconified( WindowEvent event) {
public void windowIconified( WindowEvent event) {
public void windowActivated( WindowEvent event) {
public void windowDeactivated( WindowEvent event) {
public void windowOpened( WindowEvent event) {
public void keyPressed( KeyEvent event) {
public void keyReleased( KeyEvent event) {
Object source= event.getSource();
if( source == list) {
int index= list.getSelectedIndex();
public void keyTyped( KeyEvent event) {
public void mousePressed( MouseEvent e) {
public void mouseReleased( MouseEvent e) {
public void mouseEntered( MouseEvent e) {
public void mouseExited( MouseEvent e) {
public void mouseClicked( MouseEvent e) {
Object source= e.getSource();
if( source == list) {
int index= list.getSelectedIndex();
if( index != -1) {
Target target= (Target) targets.elementAt( index);
tf_remote_address.setText( target.ip);
tf_remote_data_port.setText( target.port);
int index= list.locationToIndex( e.getPoint());
public static void main( String[] args) {
new Tx();
class TargetListModel extends AbstractListModel {
private Vector options;
public TargetListModel( Vector options) {
this.options= options;
public int getSize() {
int size;
if( options == null) {
size= 0;
} else {
size= options.size();
return size;
public Object getElementAt( int index) {
String name;
if( index < getSize()) {
Target o= (Target)options.elementAt( index);
name= o.localPort + " ---> " + o.ip + ":" + o.port;
} else {
name= null;
return name;
public void setData( Vector data) {
options= data;
fireContentsChanged( this, 0, data.size());
class ListUpdater implements Runnable {
String localPort, ip, port;
TargetListModel listModel;
Vector targets;
public ListUpdater( String localPort, String ip, String port,
TargetListModel listModel, Vector targets) {
this.localPort= localPort;
this.ip= ip;
this.port= port;
this.listModel= listModel;
this.targets= targets;
public void run() {
Target target= new Target( localPort, ip, port);
if( !targetExists( localPort, ip, port)) {
targets.addElement( target);
listModel.setData( targets);
public boolean targetExists( String localPort, String ip, String port) {
boolean exists= false;
for( int i= 0; i < targets.size(); i++) {
Target target= (Target) targets.elementAt( i);
if( target.localPort.equals( localPort)
&& target.ip.equals( ip)
&& target.port.equals( port)) {
exists= true;
break;
return exists;
>>>>>>>>>>>>>>>>>
import java.awt.*;
import java.io.*;
import java.net.InetAddress;
import java.util.*;
import javax.media.*;
import javax.media.protocol.*;
import javax.media.format.*;
import javax.media.control.TrackControl;
import javax.media.control.QualityControl;
import javax.media.rtp.*;
import javax.media.rtp.event.*;
import javax.media.rtp.rtcp.*;
public class AVTransmitter implements ReceiveStreamListener, RemoteListener,
ControllerListener {
// Input MediaLocator
// Can be a file or http or capture source
private MediaLocator locator;
private String ipAddress;
private int portBase;
private Processor processor = null;
private RTPManager rtpMgrs[];
private int localPorts[];
private DataSource dataOutput = null;
private int local_data_port;
private Tx tx;
public AVTransmitter( Tx tx, int data_port) {
this.tx= tx;
local_data_port= data_port;
* Starts the transmission. Returns null if transmission started ok.
* Otherwise it returns a string with the reason why the setup failed.
public synchronized String start( String filename, Vector targets) {
String result;
locator= new MediaLocator( filename);
// Create a processor for the specified media locator
// and program it to output JPEG/RTP
result = createProcessor();
if (result != null) {
return result;
// Create an RTP session to transmit the output of the
// processor to the specified IP address and port no.
result = createTransmitter( targets);
if (result != null) {
processor.close();
processor = null;
return result;
// Start the transmission
processor.start();
return null;
* Use the RTPManager API to create sessions for each media
* track of the processor.
private String createTransmitter( Vector targets) {
// Cheated. Should have checked the type.
PushBufferDataSource pbds = (PushBufferDataSource)dataOutput;
PushBufferStream pbss[] = pbds.getStreams();
rtpMgrs = new RTPManager[pbss.length];
localPorts = new int[ pbss.length];
SessionAddress localAddr, destAddr;
InetAddress ipAddr;
SendStream sendStream;
int port;
SourceDescription srcDesList[];
for (int i = 0; i < pbss.length; i++) {
// for (int i = 0; i < 1; i++) {
try {
rtpMgrs[i] = RTPManager.newInstance();
port = local_data_port + 2*i;
localPorts[ i]= port;
localAddr = new SessionAddress( InetAddress.getLocalHost(),
port);
rtpMgrs.initialize( localAddr);
rtpMgrs[i].addReceiveStreamListener(this);
rtpMgrs[i].addRemoteListener(this);
for( int k= 0; k < targets.size(); k++) {
Target target= (Target) targets.elementAt( k);
int targetPort= new Integer( target.port).intValue();
addTarget( localPorts[ i], rtpMgrs[ i], target.ip, targetPort + 2*i);
sendStream = rtpMgrs[i].createSendStream(dataOutput, i);
sendStream.start();
} catch (Exception e) {
e.printStackTrace();
return e.getMessage();
return null;
public void addTarget( String ip, String port) {
for (int i= 0; i < rtpMgrs.length; i++) {
int targetPort= new Integer( port).intValue();
addTarget( localPorts[ i], rtpMgrs[ i], ip, targetPort + 2*i);
public void addTarget( int localPort, RTPManager mgr, String ip, int port) {
try {
SessionAddress addr= new SessionAddress( InetAddress.getByName( ip),
new Integer( port).intValue());
mgr.addTarget( addr);
tx.addTargetToList( localPort + "", ip, port + "");
} catch( Exception e) {
e.printStackTrace();
public void removeTarget( String ip, String port) {
try {
SessionAddress addr= new SessionAddress( InetAddress.getByName( ip),
new Integer( port).intValue());
for (int i= 0; i < rtpMgrs.length; i++) {
rtpMgrs[ i].removeTarget( addr, "target removed from transmitter.");
} catch( Exception e) {
e.printStackTrace();
boolean looping= true;
public void controllerUpdate( ControllerEvent ce) {
System.out.println( ce);
if( ce instanceof DurationUpdateEvent) {
Time duration= ((DurationUpdateEvent) ce).getDuration();
System.out.println( "duration: " + duration.getSeconds());
} else if( ce instanceof EndOfMediaEvent) {
System.out.println( "END OF MEDIA - looping=" + looping);
if( looping) {
processor.setMediaTime( new Time( 0));
processor.start();
public void setLooping( boolean flag) {
looping= flag;
public void update( ReceiveStreamEvent event) {
String timestamp= getTimestamp();
StringBuffer sb= new StringBuffer();
if( event instanceof InactiveReceiveStreamEvent) {
sb.append( timestamp + " Inactive Receive Stream");
} else if( event instanceof ByeEvent) {
sb.append( timestamp + " Bye");
} else {
System.out.println( "ReceiveStreamEvent: "+ event);
tx.rtcpReport( sb.toString());
public void update( RemoteEvent event) {
String timestamp= getTimestamp();
if( event instanceof ReceiverReportEvent) {
ReceiverReport rr= ((ReceiverReportEvent) event).getReport();
StringBuffer sb= new StringBuffer();
sb.append( timestamp + " RR");
if( rr != null) {
Participant participant= rr.getParticipant();
if( participant != null) {
sb.append( " from " + participant.getCNAME());
sb.append( " ssrc=" + rr.getSSRC());
} else {
sb.append( " ssrc=" + rr.getSSRC());
tx.rtcpReport( sb.toString());
} else {
System.out.println( "RemoteEvent: " + event);
private String getTimestamp() {
String timestamp;
Calendar calendar= Calendar.getInstance();
int hour= calendar.get( Calendar.HOUR_OF_DAY);
String hourStr= formatTime( hour);
int minute= calendar.get( Calendar.MINUTE);
String minuteStr= formatTime( minute);
int second= calendar.get( Calendar.SECOND);
String secondStr= formatTime( second);
timestamp= hourStr + ":" + minuteStr + ":" + secondStr;
return timestamp;
private String formatTime( int time) {
String timeStr;
if( time < 10) {
timeStr= "0" + time;
} else {
timeStr= "" + time;
return timeStr;
* Stops the transmission if already started
public void stop() {
synchronized (this) {
if (processor != null) {
processor.stop();
processor.close();
processor = null;
for (int i= 0; i < rtpMgrs.length; i++) {
rtpMgrs[ i].removeTargets( "Session ended.");
rtpMgrs[ i].dispose();
public String createProcessor() {
if (locator == null) {
return "Locator is null";
DataSource ds;
DataSource clone;
try {
ds = javax.media.Manager.createDataSource(locator);
} catch (Exception e) {
return "Couldn't create DataSource";
// Try to create a processor to handle the input media locator
try {
processor = javax.media.Manager.createProcessor(ds);
processor.addControllerListener( this);
} catch (NoProcessorException npe) {
return "Couldn't create processor";
} catch (IOException ioe) {
return "IOException creating processor";
// Wait for it to configure
boolean result = waitForState(processor, Processor.Configured);
if (result == false)
return "Couldn't configure processor";
// Get the tracks from the processor
TrackControl [] tracks = processor.getTrackControls();
// Do we have atleast one track?
if (tracks == null || tracks.length < 1)
return "Couldn't find tracks in processor";
// Set the output content descriptor to RAW_RTP
// This will limit the supported formats reported from
// Track.getSupportedFormats to only valid RTP formats.
ContentDescriptor cd = new ContentDescriptor(ContentDescriptor.RAW_RTP);
processor.setContentDescriptor(cd);
Format supported[];
Format chosen;
boolean atLeastOneTrack = false;
// Program the tracks.
for (int i = 0; i < tracks.length; i++) {
Format format = tracks[i].getFormat();
if (tracks[i].isEnabled()) {
supported = tracks[i].getSupportedFormats();
// We've set the output content to the RAW_RTP.
// So all the supported formats should work with RTP.
// We'll just pick the first one.
if (supported.length > 0) {
if (supported[0] instanceof VideoFormat) {
// For video formats, we should double check the
// sizes since not all formats work in all sizes.
chosen = checkForVideoSizes(tracks[i].getFormat(),
supported[0]);
} else
chosen = supported[0];
tracks[i].setFormat(chosen);
System.err.println("Track " + i + " is set to transmit as:");
System.err.println(" " + chosen);
atLeastOneTrack = true;
} else
tracks[i].setEnabled(false);
} else
tracks[i].setEnabled(false);
if (!atLeastOneTrack)
return "Couldn't set any of the tracks to a valid RTP format";
// Realize the processor. This will internally create a flow
// graph and attempt to create an output datasource for JPEG/RTP
// audio frames.
result = waitForState(processor, Controller.Realized);
if (result == false)
return "Couldn't realize processor";
// Set the JPEG quality to .5.
setJPEGQuality(processor, 0.5f);
// Get the output data source of the processor
dataOutput = processor.getDataOutput();
return null;
static SessionAddress destAddr1, destAddr2;
* For JPEG and H263, we know that they only work for particular
* sizes. So we'll perform extra checking here to make sure they
* are of the right sizes.
Format checkForVideoSizes(Format original, Format supported) {
int width, height;
Dimension size = ((VideoFormat)original).getSize();
Format jpegFmt = new Format(VideoFormat.JPEG_RTP);
Format h263Fmt = new Format(VideoFormat.H263_RTP);
if (supported.matches(jpegFmt)) {
// For JPEG, make sure width and height are divisible by 8.
width = (size.width % 8 == 0 ? size.width :
(int)(size.width / 8) * 8);
height = (size.height % 8 == 0 ? size.height :
(int)(size.height / 8) * 8);
} else if (supported.matches(h263Fmt)) {
// For H.263, we only support some specific sizes.
if (size.width < 128) {
width = 128;
height = 96;
} else if (size.width < 176) {
width = 176;
height = 144;
} else {
width = 352;
height = 288;
} else {
// We don't know this particular format. We'll just
// leave it alone then.
return supported;
return (new VideoFormat(null,
new Dimension(width, height),
Format.NOT_SPECIFIED,
null,
Format.NOT_SPECIFIED)).intersects(supported);
* Setting the encoding quality to the specified value on the JPEG encoder.
* 0.5 is a good default.
void setJPEGQuality(Player p, float val) {
Control cs[] = p.getControls();
QualityControl qc = null;
VideoFormat jpegFmt = new VideoFormat(VideoFormat.JPEG);
// Loop through the controls to find the Quality control for
// the JPEG encoder.
for (int i = 0; i < cs.length; i++) {
if (cs[i] instanceof QualityControl &&
cs[i] instanceof Owned) {
Object owner = ((Owned)cs[i]).getOwner();
// Check to see if the owner is a Codec.
// Then check for the output format.
if (owner instanceof Codec) {
Format fmts[] = ((Codec)owner).getSupportedOutputFormats(null);
for (int j = 0; j < fmts.length; j++) {
if (fmts[j].matches(jpegFmt)) {
qc = (QualityControl)cs[i];
qc.setQuality(val);
System.err.println("- Setting quality to " +
val + " on " + qc);
break;
if (qc != null)
break;
* Convenience methods to handle processor's state changes.
private Integer stateLock = new Integer(0);
private boolean failed = false;
Integer getStateLock() {
return stateLock;
void setFailed() {
failed = true;
private synchronized boolean waitForState(Processor p, int state) {
p.addControllerListener(new StateListener());
failed = false;
// Call the required method on the processor
if (state == Processor.Configured) {
p.configure();
} else if (state == Processor.Realized) {
p.realize();
// Wait until we get an event that confirms the
// success of the method, or a failure event.
// See StateListener inner class
while (p.getState() < state && !failed) {
synchronized (getStateLock()) {
try {
getStateLock().wait();
} catch (InterruptedException ie) {
return false;
if (failed)
return false;
else
return true;
* Inner Classes
class StateListener implements ControllerListener {
public void controllerUpdate(ControllerEvent ce) {
// If there was an error during configure or
// realizI do this all the time, I put my MBP to a 60 inch Sharp. If you have the video working do the simple thing first. Check to make sure your sound is on your TV and Mac. Then if that doesn't work go to System Prefrences and under sound go to a tab called Output and see if your TV is listed and if it is change it to that setting
Hope It Works -
Clone DataSource - view video while transmitting - EXAMPLE no answer
Thanks to me and captfoss, I create this application for all who want to understand how to clone DataSource.
Use this on SERVER side
* @(#)AVTransmit3.java 1.2 01/03/13
* Copyright (c) 1999-2001 Sun Microsystems, Inc. All Rights Reserved.
* Sun grants you ("Licensee") a non-exclusive, royalty free, license to use,
* modify and redistribute this software in source and binary code form,
* provided that i) this copyright notice and license appear on all copies of
* the software; and ii) Licensee does not utilize the software in a manner
* which is disparaging to Sun.
* This software is provided "AS IS," without a warranty of any kind. ALL
* EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY
* IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR
* NON-INFRINGEMENT, ARE HEREBY EXCLUDED. SUN AND ITS LICENSORS SHALL NOT BE
* LIABLE FOR ANY DAMAGES SUFFERED BY LICENSEE AS A RESULT OF USING, MODIFYING
* OR DISTRIBUTING THE SOFTWARE OR ITS DERIVATIVES. IN NO EVENT WILL SUN OR ITS
* LICENSORS BE LIABLE FOR ANY LOST REVENUE, PROFIT OR DATA, OR FOR DIRECT,
* INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL OR PUNITIVE DAMAGES, HOWEVER
* CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF THE USE OF
* OR INABILITY TO USE SOFTWARE, EVEN IF SUN HAS BEEN ADVISED OF THE
* POSSIBILITY OF SUCH DAMAGES.
* This software is not designed or intended for use in on-line control of
* aircraft, air traffic, aircraft navigation or aircraft communications; or in
* the design, construction, operation or maintenance of any nuclear
* facility. Licensee represents and warrants that it will not use or
* redistribute the Software for such purposes.
import java.awt.*;
import java.io.*;
import java.net.InetAddress;
import java.util.logging.Level;
import java.util.logging.Logger;
import javax.media.*;
import javax.media.protocol.*;
import javax.media.protocol.DataSource;
import javax.media.format.*;
import javax.media.control.TrackControl;
import javax.media.control.QualityControl;
import javax.media.rtp.*;
import javax.media.rtp.rtcp.*;
public class AVTransmit3 {
// Input MediaLocator
// Can be a file or http or capture source
private MediaLocator locator;
private String ipAddress;
private int portBase;
private Processor processor = null;
private RTPManager rtpMgrs[];
private DataSource dataOutput = null;
private static boolean v = false;
private static DataSource ds = null;
private static DataSource clone;
private static DataSource cloned;
private String VFORMAT = "h263/rtp";
private String AFORMAT = "mpegaudio/rtp";
public AVTransmit3(MediaLocator locator,
String ipAddress,
String pb,
Format format) {
this.locator = locator;
this.ipAddress = ipAddress;
Integer integer = Integer.valueOf(pb);
if (integer != null)
this.portBase = integer.intValue();
* Starts the transmission. Returns null if transmission started ok.
* Otherwise it returns a string with the reason why the setup failed.
public synchronized String start() {
String result;
// Create a processor for the specified media locator
// and program it to output JPEG/RTP
result = createProcessor();
if (result != null)
return result;
// Create an RTP session to transmit the output of the
// processor to the specified IP address and port no.
result = createTransmitter();
if (result != null) {
processor.close();
processor = null;
return result;
// Start the transmission
processor.start();
return null;
* Stops the transmission if already started
public void stop() {
synchronized (this) {
if (processor != null) {
processor.stop();
processor.close();
processor = null;
for (int i = 0; i < rtpMgrs.length; i++) {
rtpMgrs.removeTargets( "Session ended.");
rtpMgrs[i].dispose();
private String createProcessor() {
if (locator == null)
return "Locator is null";
try {
ds = javax.media.Manager.createDataSource(locator);
} catch (Exception e) {
return "Couldn't create DataSource";
//----------------------------------------------------Start
if(v)
/* Get a clonable version of our datasource */
ds = Manager.createCloneableDataSource(ds);
/* Make sure we got a clonable version before we try to clone it */
if (ds == null) {
System.err.println("Cannot get a clonable version of the datasource");
System.exit(0);
/* Create the clone of our original datasource */
DataSource dsClone = ((SourceCloneable)ds).createClone();
/* Make sure the clone happened successfully */
if (dsClone == null) {
System.err.println("Could not clone our datasource");
System.exit(0);
/* Create a new Clone class */
Clone cloneV = new Clone();
/* Open our clone class with our datasource clone */
if (! cloneV.open(dsClone))
System.exit(0);
//----------------------------------------------------End
// Try to create a processor to handle the input media locator
try {
processor = javax.media.Manager.createProcessor(ds);
} catch (NoProcessorException npe) {
return "Couldn't create processor";
} catch (IOException ioe) {
return "IOException creating processor";
// Wait for it to configure
boolean result = waitForState(processor, Processor.Configured);
if (result == false)
return "Couldn't configure processor";
// Get the tracks from the processor
TrackControl [] tracks = processor.getTrackControls();
// Do we have atleast one track?
if (tracks == null || tracks.length < 1)
return "Couldn't find tracks in processor";
// Set the output content descriptor to RAW_RTP
// This will limit the supported formats reported from
// Track.getSupportedFormats to only valid RTP formats.
ContentDescriptor cd = new ContentDescriptor(ContentDescriptor.RAW_RTP);
processor.setContentDescriptor(cd);
Format supported[];
Format chosen = null;
boolean atLeastOneTrack = false;
// Program the tracks.
for (int i = 0; i < tracks.length; i++)
AudioFormat aFormat = new AudioFormat(AFORMAT, 22050.00, 16, 1);
Format format = tracks[i].getFormat();
if (tracks[i].isEnabled())
supported = tracks[i].getSupportedFormats();
// We've set the output content to the RAW_RTP.
// So all the supported formats should work with RTP.
// We'll just pick the first one.
if (supported.length > 0)
for(int k = 0; k < supported.length; k++)
if ((supported[k] instanceof VideoFormat) &&
(supported[k].getEncoding().equalsIgnoreCase(VFORMAT)))
// For video formats, we should double check the
// sizes since not all formats work in all sizes.
// Choose the H263rtp
chosen = checkForVideoSizes(tracks[i].getFormat(), supported[k]);
v = true;
break;
else if ((supported[k] instanceof AudioFormat) &&
(supported[k].matches(aFormat)))
// For audio formats
// Choose the H263rtp
// chosen = supported[3];
chosen = supported[k];
v = false;
break;
tracks[i].setFormat(chosen);
System.err.println("Track " + i + " is set to transmit as:");
System.err.println(" " + chosen);
atLeastOneTrack = true;
} else
tracks[i].setEnabled(false);
} else
tracks[i].setEnabled(false);
if (!atLeastOneTrack)
return "Couldn't set any of the tracks to a valid RTP format";
// Realize the processor. This will internally create a flow
// graph and attempt to create an output datasource for JPEG/RTP
// audio frames.
result = waitForState(processor, Controller.Realized);
if (result == false)
return "Couldn't realize processor";
// Set the JPEG quality to .5.
setJPEGQuality(processor, 0.5f);
// Get the output data source of the processor
dataOutput = processor.getDataOutput();
return null;
* Use the RTPManager API to create sessions for each media
* track of the processor.
private String createTransmitter() {
// Cheated. Should have checked the type.
PushBufferDataSource pbds = (PushBufferDataSource)dataOutput;
PushBufferStream pbss[] = pbds.getStreams();
rtpMgrs = new RTPManager[pbss.length];
SendStream sendStream;
int port;
SourceDescription srcDesList[];
for (int i = 0; i < pbss.length; i++) {
try {
rtpMgrs[i] = RTPManager.newInstance();
port = portBase + 2*i;
// Initialize the RTPManager with the RTPSocketAdapter
rtpMgrs[i].initialize(new RTPSocketAdapter(
InetAddress.getByName(ipAddress),
port));
System.err.println( "Created RTP session: " + ipAddress + " " + port);
sendStream = rtpMgrs[i].createSendStream(dataOutput, i);
sendStream.start();
} catch (Exception e) {
return e.getMessage();
return null;
* For JPEG and H263, we know that they only work for particular
* sizes. So we'll perform extra checking here to make sure they
* are of the right sizes.
Format checkForVideoSizes(Format original, Format supported) {
int width, height;
Dimension size = ((VideoFormat)original).getSize();
Format jpegFmt = new Format(VideoFormat.JPEG_RTP);
Format h263Fmt = new Format(VideoFormat.H263_RTP);
if (supported.matches(jpegFmt)) {
// For JPEG, make sure width and height are divisible by 8.
width = (size.width % 8 == 0 ? size.width :
(int)(size.width / 8) * 8);
height = (size.height % 8 == 0 ? size.height :
(int)(size.height / 8) * 8);
} else if (supported.matches(h263Fmt)) {
// For H.263, we only support some specific sizes.
if (size.width < 128) {
width = 128;
height = 96;
} else if (size.width < 176) {
width = 176;
height = 144;
} else {
width = 352;
height = 288;
} else {
// We don't know this particular format. We'll just
// leave it alone then.
return supported;
return (new VideoFormat(null,
new Dimension(width, height),
Format.NOT_SPECIFIED,
null,
Format.NOT_SPECIFIED)).intersects(supported);
* Setting the encoding quality to the specified value on the JPEG encoder.
* 0.5 is a good default.
void setJPEGQuality(Player p, float val) {
Control cs[] = p.getControls();
QualityControl qc = null;
VideoFormat jpegFmt = new VideoFormat(VideoFormat.JPEG);
// Loop through the controls to find the Quality control for
// the JPEG encoder.
for (int i = 0; i < cs.length; i++) {
if (cs[i] instanceof QualityControl &&
cs[i] instanceof Owned) {
Object owner = ((Owned)cs[i]).getOwner();
// Check to see if the owner is a Codec.
// Then check for the output format.
if (owner instanceof Codec) {
Format fmts[] = ((Codec)owner).getSupportedOutputFormats(null);
for (int j = 0; j < fmts.length; j++) {
if (fmts[j].matches(jpegFmt)) {
qc = (QualityControl)cs[i];
qc.setQuality(val);
System.err.println("- Setting quality to " +
val + " on " + qc);
break;
if (qc != null)
break;
* Convenience methods to handle processor's state changes.
private Integer stateLock = new Integer(0);
private boolean failed = false;
Integer getStateLock() {
return stateLock;
void setFailed() {
failed = true;
private synchronized boolean waitForState(Processor p, int state) {
p.addControllerListener(new StateListener());
failed = false;
// Call the required method on the processor
if (state == Processor.Configured) {
p.configure();
} else if (state == Processor.Realized) {
p.realize();
// Wait until we get an event that confirms the
// success of the method, or a failure event.
// See StateListener inner class
while (p.getState() < state && !failed) {
synchronized (getStateLock()) {
try {
getStateLock().wait();
} catch (InterruptedException ie) {
return false;
if (failed)
return false;
else
return true;
* Inner Classes
class StateListener implements ControllerListener {
public void controllerUpdate(ControllerEvent ce) {
// If there was an error during configure or
// realize, the processor will be closed
if (ce instanceof ControllerClosedEvent)
setFailed();
// All controller events, send a notification
// to the waiting thread in waitForState method.
if (ce instanceof ControllerEvent) {
synchronized (getStateLock()) {
getStateLock().notifyAll();
* Sample Usage for AVTransmit3 class
public static void main(String [] args) {
// We need three parameters to do the transmission
// For example,
// java AVTransmit3 file:/C:/media/test.mov 129.130.131.132 42050
Format fmt = null;
int i = 0;
String title = "Video";
// Create a audio transmit object with the specified params.
AVTransmit3 at = new AVTransmit3(new MediaLocator("vfw://0"),
"192.168.0.3", "12345", fmt);
//View GUI
JFrameMain jfm = new JFrameMain(at);
jfm.setVisible(true);
jfm.setTitle(title);
if(title.equals("Video"))
jfm.setLocation(jfm.getX()+180, jfm.getY());
v = true;
// Start the transmission
String result = at.start();
// result will be non-null if there was an error. The return
// value is a String describing the possible error. Print it.
if (result != null) {
System.err.println("Error : " + result);
System.exit(0);
System.err.println("Start transmission...");
try {
Thread.sleep(2000);
} catch (InterruptedException ex) {
Logger.getLogger(AVTransmit3.class.getName()).log(Level.SEVERE, null, ex);
/* Clone.java
* To change this template, choose Tools | Templates
* and open the template in the editor.
import java.awt.*;
import javax.media.*;
import javax.media.protocol.DataSource;
public class Clone extends Frame implements ControllerListener {
Player p;
Object waitSync = new Object();
boolean stateTransitionOK = true;
* Given a DataSource, create a player and use that player
* as a player to playback the media.
public boolean open(DataSource ds) {
System.err.println("create player for: " + ds.getContentType());
try {
p = Manager.createPlayer(ds);
} catch (Exception e) {
System.err.println("Failed to create a player from the given DataSource: " + e);
return false;
p.addControllerListener(this);
// Realize the player.
p.prefetch();
if (!waitForState(p.Prefetched)) {
System.err.println("Failed to realize the player.");
return false;
// Display the visual & control component if there's one.
setLayout(new BorderLayout());
// Component cc;
Component vc;
if ((vc = p.getVisualComponent()) != null) {
add("Center", vc);
// if ((cc = p.getControlPanelComponent()) != null) {
// add("South", cc);
// Start the player.
p.start();
setVisible(true);
return true;
public void addNotify() {
super.addNotify();
pack();
* Block until the player has transitioned to the given state.
* Return false if the transition failed.
boolean waitForState(int state) {
synchronized (waitSync) {
try {
while (p.getState() < state && stateTransitionOK)
waitSync.wait();
} catch (Exception e) {}
return stateTransitionOK;
* Controller Listener.
public void controllerUpdate(ControllerEvent evt) {
if (evt instanceof ConfigureCompleteEvent ||
evt instanceof RealizeCompleteEvent ||
evt instanceof PrefetchCompleteEvent) {
synchronized (waitSync) {
stateTransitionOK = true;
waitSync.notifyAll();
} else if (evt instanceof ResourceUnavailableEvent) {
synchronized (waitSync) {
stateTransitionOK = false;
waitSync.notifyAll();
} else if (evt instanceof EndOfMediaEvent) {
p.close();
//System.exit(0);
} else if (evt instanceof SizeChangeEvent) {
* @(#)RTPSocketAdapter.java 1.2 01/03/13
* Copyright (c) 1999-2001 Sun Microsystems, Inc. All Rights Reserved.
* Sun grants you ("Licensee") a non-exclusive, royalty free, license to use,
* modify and redistribute this software in source and binary code form,
* provided that i) this copyright notice and license appear on all copies of
* the software; and ii) Licensee does not utilize the software in a manner
* which is disparaging to Sun.
* This software is provided "AS IS," without a warranty of any kind. ALL
* EXPRESS OR IMPLIED CONDITIONS, REPRESENTATIONS AND WARRANTIES, INCLUDING ANY
* IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR
* NON-INFRINGEMENT, ARE HEREBY EXCLUDED. SUN AND ITS LICENSORS SHALL NOT BE
* LIABLE FOR ANY DAMAGES SUFFERED BY LICENSEE AS A RESULT OF USING, MODIFYING
* OR DISTRIBUTING THE SOFTWARE OR ITS DERIVATIVES. IN NO EVENT WILL SUN OR ITS
* LICENSORS BE LIABLE FOR ANY LOST REVENUE, PROFIT OR DATA, OR FOR DIRECT,
* INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL OR PUNITIVE DAMAGES, HOWEVER
* CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF THE USE OF
* OR INABILITY TO USE SOFTWARE, EVEN IF SUN HAS BEEN ADVISED OF THE
* POSSIBILITY OF SUCH DAMAGES.
* This software is not designed or intended for use in on-line control of
* aircraft, air traffic, aircraft navigation or aircraft communications; or in
* the design, construction, operation or maintenance of any nuclear
* facility. Licensee represents and warrants that it will not use or
* redistribute the Software for such purposes.
import java.io.IOException;
import java.net.InetAddress;
import java.net.DatagramSocket;
import java.net.MulticastSocket;
import java.net.DatagramPacket;
import java.net.SocketException;
import javax.media.protocol.DataSource;
import javax.media.protocol.PushSourceStream;
import javax.media.protocol.ContentDescriptor;
import javax.media.protocol.SourceTransferHandler;
import javax.media.rtp.RTPConnector;
import javax.media.rtp.OutputDataStream;
* An implementation of RTPConnector based on UDP sockets.
public class RTPSocketAdapter implements RTPConnector {
DatagramSocket dataSock;
DatagramSocket ctrlSock;
InetAddress addr;
int port;
SockInputStream dataInStrm = null, ctrlInStrm = null;
SockOutputStream dataOutStrm = null, ctrlOutStrm = null;
public RTPSocketAdapter(InetAddress addr, int port) throws IOException {
this(addr, port, 1);
public RTPSocketAdapter(InetAddress addr, int port, int ttl) throws IOException {
try {
if (addr.isMulticastAddress()) {
dataSock = new MulticastSocket(port);
ctrlSock = new MulticastSocket(port+1);
((MulticastSocket)dataSock).joinGroup(addr);
((MulticastSocket)dataSock).setTimeToLive(ttl);
((MulticastSocket)ctrlSock).joinGroup(addr);
((MulticastSocket)ctrlSock).setTimeToLive(ttl);
} else {
dataSock = new DatagramSocket(port, InetAddress.getLocalHost());
ctrlSock = new DatagramSocket(port+1, InetAddress.getLocalHost());
} catch (SocketException e) {
throw new IOException(e.getMessage());
this.addr = addr;
this.port = port;
* Returns an input stream to receive the RTP data.
public PushSourceStream getDataInputStream() throws IOException {
if (dataInStrm == null) {
dataInStrm = new SockInputStream(dataSock, addr, port);
dataInStrm.start();
return dataInStrm;
* Returns an output stream to send the RTP data.
public OutputDataStream getDataOutputStream() throws IOException {
if (dataOutStrm == null)
dataOutStrm = new SockOutputStream(dataSock, addr, port);
return dataOutStrm;
* Returns an input stream to receive the RTCP data.
public PushSourceStream getControlInputStream() throws IOException {
if (ctrlInStrm == null) {
ctrlInStrm = new SockInputStream(ctrlSock, addr, port+1);
ctrlInStrm.start();
return ctrlInStrm;
* Returns an output stream to send the RTCP data.
public OutputDataStream getControlOutputStream() throws IOException {
if (ctrlOutStrm == null)
ctrlOutStrm = new SockOutputStream(ctrlSock, addr, port+1);
return ctrlOutStrm;
* Close all the RTP, RTCP streams.
public void close() {
if (dataInStrm != null)
dataInStrm.kill();
if (ctrlInStrm != null)
ctrlInStrm.kill();
dataSock.close();
ctrlSock.close();
* Set the receive buffer size of the RTP data channel.
* This is only a hint to the implementation. The actual implementation
* may not be able to do anything to this.
public void setReceiveBufferSize( int size) throws IOException {
dataSock.setReceiveBufferSize(size);
* Get the receive buffer size set on the RTP data channel.
* Return -1 if the receive buffer size is not applicable for
* the implementation.
public int getReceiveBufferSize() {
try {
return dataSock.getReceiveBufferSize();
} catch (Exception e) {
return -1;
* Set the send buffer size of the RTP data channel.
* This is only a hint to the implementation. The actual implementation
* may not be able to do anything to this.
public void setSendBufferSize( int size) throws IOException {
dataSock.setSendBufferSize(size);
* Get the send buffer size set on the RTP data channel.
* Return -1 if the send buffer size is not applicable for
* the implementation.
public int getSendBufferSize() {
try {
return dataSock.getSendBufferSize();
} catch (Exception e) {
return -1;
* Return the RTCP bandwidth fraction. This value is used to
* initialize the RTPManager. Check RTPManager for more detauls.
* Return -1 to use the default values.
public double getRTCPBandwidthFraction() {
return -1;
* Return the RTCP sender bandwidth fraction. This value is used to
* initialize the RTPManager. Check RTPManager for more detauls.
* Return -1 to use the default values.
public double getRTCPSenderBandwidthFraction() {
return -1;
* An inner class to implement an OutputDataStream based on UDP sockets.
class SockOutputStream implements OutputDataStream {
DatagramSocket sock;
InetAddress addr;
int port;
public SockOutputStream(DatagramSocket sock, InetAddress addr, int port) {
this.sock = sock;
this.addr = addr;
this.port = port;
public int write(byte data[], int offset, int len) {
try {
sock.send(new DatagramPacket(data, offset, len, addr, port));
} catch (Exception e) {
return -1;
return len;
* An inner class to implement an PushSourceStream based on UDP sockets.
class SockInputStream extends Thread implements PushSourceStream {
DatagramSocket sock;
InetAddress addr;
int port;
boolean done = false;
boolean dataRead = false;
SourceTransferHandler sth = null;
public SockInputStream(DatagramSocket sock, InetAddress addr, int port) {
this.sock = sock;
this.addr = addr;
this.port = port;
public int read(byte buffer[], int offset, int length) {
DatagramPacket p = new DatagramPacket(buffer, offset, length, addr, port);
try {
sock.receive(p);
} catch (IOException e) {
return -1;
synchronized (this) {
dataRead = true;
notify();
return p.getLength();
public synchronized void start() {
super.start();
if (sth != null) {
dataRead = true;
notify();
public synchronized void kill() {
done = true;
notify();
public int getMinimumTransferSize() {
return 2 * 1024; // twice the MTU size, just to be safe.
public synchronized void setTransferHandler(SourceTransferHandler sth) {
this.sth = sth;
dataRead = true;
notify();
// Not applicable.
public ContentDescriptor getContentDescriptor() {
return null;
// Not applicable.
public long getContentLength() {
return LENGTH_UNKNOWN;
// Not applicable.
public boolean endOfStream() {
return false;
// Not applicable.
public Object[] getControls() {
return new Object[0];
// Not applicable.
public Object getControl(String type) {
return null;
* Loop and notify the transfer handler of new data.
public void run() {
while (!done) {
synchronized (this) {
while (!dataRead && !done) {
try {
wait();
} catch (InterruptedException e) { }
dataRead = false;
if (sth != null && !done) {
sth.transferData(this);
* JFrameMain.java
* @author Giovanni
public class JFrameMain extends javax.swing.JFrame {
/** Creates new form JFrameMain */
public JFrameMain(AVTransmit3 avt) {
avTransmit = avt;
initComponents();
/** This method is called from within the constructor to
* initialize the form.
* WARNING: Do NOT modify this code. The content of this method is
* always regenerated by the Form Editor.
// <editor-fold defaultstate="collapsed" desc="Generated Code">
private void initComponents() {
jButtonFine = new javax.swing.JButton();
setDefaultCloseOperation(javax.swing.WindowConstants.EXIT_ON_CLOSE);
setResizable(false);
jButtonFine.setText("Fine Trasmissione");
jButtonFine.addMouseListener(new java.awt.event.MouseAdapter() {
public void mousePressed(java.awt.event.MouseEvent evt) {
jButtonFineMousePressed(evt);
javax.swing.GroupLayout layout = new javax.swing.GroupLayout(getContentPane());
getContentPane().setLayout(layout);
layout.setHorizontalGroup(
layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
.addGroup(layout.createSequentialGroup()
.addContainerGap()
.addComponent(jButtonFine, javax.swing.GroupLayout.DEFAULT_SIZE, 124, Short.MAX_VALUE)
.addContainerGap())
layout.setVerticalGroup(
layout.createParallelGroup(javax.swing.GroupLayout.Alignment.LEADING)
.addGroup(layout.createSequentialGroup()
.addContainerGap()
.addComponent(jButtonFine, javax.swing.GroupLayout.DEFAULT_SIZE, 32, Short.MAX_VALUE)
.addContainerGap())
setBounds(600, 110, 160, 90);
}// </editor-fold>
private void jButtonFineMousePressed(java.awt.event.MouseEvent evt) {
avTransmit.stop();
System.exit(0);
* @param args the command line arguments
public static void main(String args[]) {
java.awt.EventQueue.invokeLater(new Runnable() {
public void run() {
// new JFrameMain().setVisible(true);
// Variables declaration - do not modify
private javax.swing.JButton jButtonFine;
// End of variables declaration
private AVTransmit3 avTransmit = null;
It's shake and bake, and I helped...
Maybe you are looking for
-
Applet can not run in browser, but it wroks in appetviewer. Why?
I wrote a very simple applet, and it works well when I use appletviewer. But when I use browser to open the html file which contains the applet, it always gives no class found error. My browsers are IE5.0 and Netscape4.77. Hwo can I make the applet r
-
Re-directing from one 3005 to another
Over the past week we have been migrating remote offices to a new 3005. Because of routing, we had to assign new IP addresses to our 3002s. We've had a couple of job sites that were migrated that connected, but they were unable to reach 95% of intern
-
A basic question from a SQL Server convert
Hello: I am new to Oracle coming in with a SQL server background. I wanted to create a stored procedure that returns a SELECT result set. When I tried the following code: CREATE OR REPLACE PROCEDURE spTest AS BEGIN SELECT Last_Name_C || ',
-
Problem using reflection... Really urgent...
Hi all, in my current program, i'm usin reflection a lot. This is due to the fact that i automatically generate some code, compile it, and run another program which uses the generated code. The generated code contains inner classes. For example: pack
-
Jinitiator, Appletviewer - and MS IIS 4.0
I have a few questions regarding Dev2000 2.1: 1) I was able to web enable a form through Netscape Enterprise Server 3.5.1, using either Jinitiator 1.1.5.3 or the Appletviewer; however, the font size and colors of some fields on the form were altered