Simulate mouse click and do application interface test

We have a application system with GUI and I need to implement a auto-test system. After launch the application, the interface has two frames. The left is the navigation frame, it display the contents of a book; the right is for display detail text. In the right frame, there are links(just like web) to lead user to other document after user clicking.
We need a test system to check the systm. So, my basic idea is to model the human action. Create the mouse object and modeling human click and check if the link display the correct content. But, I don't how to do it.
Can anyone give me hands?
Thank you
my email: [email protected]

Hi,
first you have to know, which events can happen, second the listener-methods must be accessible.
with this premise you can do following:
- construct the event you want to use i.e for mouse
MouseEvent me=new MouseEvent(this, 1001, System.currentTimeMillis(), 0,50,50 ,1, false);- call the method which should receive this event
- wait what happens
regards

Similar Messages

Disable right mouse click and IE6 galleryimg on af:objectImage

hi,
Could anyone tell me how I can disable right mouse click and IE6 galleryimg on af:objectImage?

Hi Jagannath,
Try like this.. Double click on application -> go to parameters tab, in parameters give WDDISABLEUSERPERSONALIZATION and value 'X'. It will disable user settings, you get window when right click but no user settings available.
check this for more help...
http://help.sap.com/saphelp_nw70/helpdata/en/7b/fb57412df8091de10000000a155106/content.htm
Thanks,
Kris.

Simulate mouse clicks inLabview

Hi,
I have a standalone driver that needs to be called many times in another VI, I don't know how to simulate mouse clicks in Labview to simulate a user running this VI. (This VI has a loop inside it, so it will run until a specific key is pressed)
Thanks
Solved!
Go to Solution.

If you need to programatically run the VI use the Run VI method of VI server. If you need to simulate users pressing buttons on that VI then use user events.
Attached is an example of a main VI that calls a SubVI and sends events to it. Open the SubVI front panel but do not run it. Open the Top Level VI and run it. Pressing the OK button on the Top Level or the SubVI will increment the numeric indicator on SubVI. Same with the stop button.
=====================
LabVIEW 2012
Attachments:
Top Level VI.vi ‏14 KB
SubVI.vi ‏21 KB

Using Firefox 3.6 after a few mouse click/ keyboard input the firefox window is no more active, mouse click and keyboard input is inactive ; then I click on the taskbar and the keyboard is active again during a few click then it stops again etc.

Using Firefox 3.6 after a few mouse click/ keyboard input the firefox window is no more active, mouse click and keyboard input is inactive ;
to solve it I click on the taskbar and the keyboard is active again during a few click then it does not work any more and I click again on the task bar etc.
after several repetitions, I have to call the task manager alt+del+ctrl, then come back to the firefox window to be able to use keyboard and mouse again

Attaching the picture for the tab shape I want...

Scripting a mouse click and drag

does anyone know how to script a mouse click and drag. I tried XTools. No luck. What about Cliclick. I had tons of success with TextCommands but I dont know how to get OSAX plugin code to work. Thanks in advance.
I am trying to move a desktop clock (QuartzClock) from the center of the screen to the side.

I tried (unsuccessfully) to find a mouse move and click solution in Applescript.
My search brought me to this site: http://www.geekorgy.com/index.php/2010/06/python-mouse-click-and-move-mouse-in-a pple-mac-osx-snow-leopard-10-6-x/
The following python script will move an object from position 60.100 to 60.300
#!/usr/bin/python
import sys
import time
from Quartz.CoreGraphics import * # imports all of the top-level symbols in the module
def mouseEvent(type, posx, posy):
theEvent = CGEventCreateMouseEvent(None, type, (posx,posy), kCGMouseButtonLeft)
CGEventPost(kCGHIDEventTap, theEvent)
def mousemove(posx,posy):
mouseEvent(kCGEventMouseMoved, posx,posy);
def mouseclickdn(posx,posy):
mouseEvent(kCGEventLeftMouseDown, posx,posy);
def mouseclickup(posx,posy):
mouseEvent(kCGEventLeftMouseUp, posx,posy);
def mousedrag(posx,posy):
mouseEvent(kCGEventLeftMouseDragged, posx,posy);
ourEvent = CGEventCreate(None);
currentpos=CGEventGetLocation(ourEvent); # Save current mouse position
mouseclickdn(60, 100);
mousedrag(60, 300);
mouseclickup(60, 300);
time.sleep(1);
mousemove(int(currentpos.x),int(currentpos.y)); # Restore mouse position
See also:
http://developer.apple.com/mac/library/documentation/Carbon/Reference/QuartzEven tServicesRef/Reference/reference.html
http://developer.apple.com/graphicsimaging/pythonandquartz.html
Tony

Mouse click and drag through turntable animation

Hi all,
First - thanks for taking the time to look through and possibly helping me with this question.
I'm just getting to grips with flash cc actionscript 3.0 - so I apologise in advance to my not so technical jargon.
In the past I have used actionscript 1.0 to create an interactive html file that contains a turntable animation of a 3D model. Users can mouse click and drag to the left or right to 'spin' the model around - however what they are really doing is scrubing through the timeline which contained 360 images of it from 360 degrees. Similar ideas can be found here: Interactive Thyroidectomy
Now annoying I can't use the old code any more as I'm working in the latest flash cc actionscript 3.0
So how do I do the same thing but in actionscript 3.0?
So I've worked this bit out so far
On my main stage I have two layers - actions layer and another layer with my movie clip (movieclip_mc)
In the actions layer so far:
movieclip_mc.addEventListener(MouseEvent.MOUSE_DOWN, onMouseDown);
movieclip_mc.addEventListener(MouseEvent.MOUSE_UP, onMouseUp);
function onMouseDown(event:MouseEvent):void
movieclip_mc.addEventListener(MouseEvent.MOUSE_MOVE, onMouseMove);
//I should put something in here about mouseX - but no idea what
function onMouseUp(event:MouseEvent):void
movieclip_mc.removeEventListener(MouseEvent.MOUSE_MOVE, onMouseMove);
function onMouseMove(event:MouseEvent):void
//I have to put something in about total frames - width of movieclip_mc etc but I'm not sure how
// this is what someone else did on another forum - but I'm not sure what it means:
     var delta:int = backgroundClip.mouseX - clickedMouseX;
   var wantedFrame:uint = (clickedFrame + delta * clip.totalFrames / backgroundClip.width) % clip.totalFrames;
   while (wantedFrame < 1)
wantedFrame += clip.totalFrames;
clip.gotoAndStop(wantedFrame);
Also I think i need something in the beginning like.....:
import flash.events.MouseEvent;
import flash.display.MovieClip;
import flash.display.Sprite;
var clickedMouseX:int;
var clickedFrame:uint;
var backgroundClip:Sprite = getChildByName("background") as Sprite;
var clip:MovieClip = getChildByName("animation") as MovieClip;
clip.stop();
clip.mouseEnabled = false;
.....but I'm a bit confused about what all of it means
So I understand the principle but no idea how to actually make it work - Could anyone help explain it to me or help with the code?
Thanks so much to anyone who can offer some help
Catherine

Hi Ned,
sorry to bother you again on this subject -
the script...
function onMouseMove(event:MouseEvent): void {
movieclip.gotoAndStop(Math.round(mouseX/movieclip.width*(movieclip.totalFrames-1))+1 )
worked fine - but when you click and drag on the movie clip it didn't always get to the end of the movie and never carried on through the frames back to the beginning like i wanted it to (such as this one does Interactive Thyroidectomy)
So I went back to the older 2.0 script and played with it a bit to be :
function onMouseMove(event:MouseEvent): void {
changeDistance = movieclip.mouseX - startX;
travelDistance = startFrame + changeDistance;
if (travelDistance > movieclip.totalFrames) {
movieclip.gotoAndStop (travelDistance % movieclip.totalFrames);
} else if (travelDistance < 0) {
movieclip.gotoAndStop (movieclip.totalFrames + (travelDistance % movieclip.totalFrames));
} else {
movieclip.gotoAndStop (travelDistance);
.... which almost works but it is very stuttery to mouse over and then it has this output error..
mouseDown
ArgumentError: Error #2109: Frame label 2.3500000000000227 not found in scene 2.3500000000000227.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 3.6499999999999773 not found in scene 3.6499999999999773.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 4.949999999999989 not found in scene 4.949999999999989.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 6.25 not found in scene 6.25.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 7.600000000000023 not found in scene 7.600000000000023.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 8.899999999999977 not found in scene 8.899999999999977.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 11.5 not found in scene 11.5.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 12.850000000000023 not found in scene 12.850000000000023.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 14.149999999999977 not found in scene 14.149999999999977.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 15.449999999999989 not found in scene 15.449999999999989.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
ArgumentError: Error #2109: Frame label 16.75 not found in scene 16.75.
at flash.display::MovieClip/gotoAndStop()
at flashdoc_fla::MainTimeline/onMouseMove()
mouseUp
I've obviously put some code in the wrong place - could you help me find out what it might be?
I haven't labelled any frames odd numbers such as 15.4499999999999989 or labeled scenes than number either.
I can send you my scene if that would help?
Thanks very much for your time Ned
(p.s Or maybe if it is easier you might offer some guidance as to how i can change the action script
function onMouseMove(event:MouseEvent): void {
movieclip.gotoAndStop(Math.round(mouseX/movieclip.width*(movieclip.totalFrames-1))+1 )
to allow it to be more like Interactive Thyroidectomy

Simulate mouse click on html control

hello,
i working on a multitouch application which should load some
small html files in an html control.
but i don't have a mouse so I need to simulate the click on a
link in html etc.
what i get to work is the down event so the link changes
color but the it doesn't react on the up event.
any ideas?
thanks a lot
joerg

Insted of using an "<a href" type of link, and
highlighting it with CSS you can create a custom <div>
element, an assign to it javascript events onclick, onmousedown,
onmouseup, that would do all the wrok.
You can then fire those events from a diffrent
function/event.

Simulate mouse clicks with keyboard

Hello,
I'd like to create a little tool in JAVA that would simulate a mouseclick when I pressed a key on the keyboard.
But that should be valid even when I have any other program as active (selected).
Can that be done in Java or Java can only listen to events generated when the java application is active?
If you have working code that would be very appreciated.
Thank you in advance,
Nuno Vidal

Ok... have never done anythong with JNI before, can
you give me an insight?The way I would do it would be to write a system wide keyboard hook, (which you can't do in Java and should do in C++)into a JNI dll as smg123 said. Then you will have that method notify your java program on a key press and from your Java program you can use the Robot class to send a mouse click or since your already using a native code you could write a C++ function to do it and invoke that from your Java app.

Mighty Mouse clicking and releasing randomly

Hello,
Its difficult to describe exactly what is happening but I'll try to be specific. I am running Mac OS X (fully updated) and Parallels 6. The only major change I've made was to install Adobe CS5 creative suite to the Mac side, and the mouse issues started perhaps a week or two after that. Basically, if I select something and try to drag it, whether it be objects in a design program, folders on the desktop, or even copy in a document, the mouse will deselect and reselect at random. This has gotten progressively more irritating to the point where I dread the click and drag wholeheartedly. Some days are definitely worse than others, and there is no rhyme or reason as to when this will happen. I could be organizing the desktop, working in Adobe Indesign, or simply editing copy in Microsoft Word. It also has no qualms as far as whether I am working on the Mac or PC side. It is obnoxious on both platforms.
So far I have tried all the basics such as restarting, using compressed air to clean out the mouse, attaching a new mouse (its a usb connection), using a different usb port altogether, and using compressed air to clean out the ports before I plug the mouse in. I have also tried switching between my desk and a mouse pad in complete desperation. None of these attempts have has any affect. Can anyone offer any suggestions?

Hello and Welcome to Apple Discussions ...
Fist, here are the instructions to clean a Might Mouse: http://support.apple.com/kb/HT1537
and here: http://www.macosxhints.com/article.php?story=20060210115417864&lsrc=osxh
Second, go to System Preferences/Keyboard&Mouse/Mouse and make sure your Tracking/Scrolling and Double Clicking is set to your liking. (The System Preferences panel is located in your Applications folder)
Carolyn
Message was edited by: Carolyn Samit

Simulate Mouse Click using AppleScript

I want to simulate a mouse click using AppleScript. I used click button of window command but unfortunately it only simulates a half click in the sense that you see the button highlighted but the action is not activated. I used a command key function, where I would press a # many times to make the mouse go down. However, this is very slow. I noticed that there is a couple of additional elements that can be used with AppleScript for example XTools and Extra Suites where I can tell the mouse to go to a certain location and click. I am on a Mac OS X 10.3.9 system (I believe I am using a PowerMac as well) and would like to know if any of the two programs are compatible with this system. I would appreciate any help in how I can install the software and what directory to place the software. Thank you very much for your help.

Hi, I don't know if the latest version works in 10.3, but might try Quickeys...
http://startly.com/products/quickeys/mac/4/
Extra Suites should tell you if it works or not when installing.
For old Mac SW...
http://www.oldapps.com/mac/?ModPagespeed=noscript
I think the most modern Browser for Panther/10.3.9 is Camino...
http://caminobrowser.org/releases/1.6.9/
Or iCab 4.8...
http://www.icab.de/dl.php

How to simulate mouse click

Hello,
is it possible to simulate and control a mouse click in windows with labview 7.1. I am able to control the mouse coordinates but not right and left mouse click. Is there a available VI that can do that?
Lukas

I have answered this in the other thread where you asked this. Please don't post the same questions to multiple threads.
After looking at the VI there, it uses the PostMessage function to post a mouse down message to a specific window. You can try using MouseEvent or SendInput to simulate a general mouse click (One of them is no longer supported, I can't remember which. You can find the details in the MSDN).
Try to take over the world!

Mouse clicks and keystrokes

When I edit mouse click in mouse properties, it
doesn't always make the sound when it's checked (ticked), and
sometimes makes a mouse click sound when it's not ticked. If you
run it through again, it often responds differently. The same thing
happens with keystroke sounds, though less frequently. Is this a
common problem, is it my computer, or is there some way of fixing
this problem?

Keyboard shortcuts were often missed. For example, I tried this sequence many times.
0: (setup: text editor is scrolled to first line and cursor is at the beginning of the first line)
1: Click on text editor window to focus it.
2: press SHIFT-DownArrow to move cursor down one line and select the first line
3: press CMD-X to cut the line.
Automator never would capture those key strokes.
But today I has a break through. This sequence does work:
0: (setup: text editor is scrolled to bottom of the file and the cursor is placed below the last line.)
1: Click on text editor window to focus it.
2: press SHIFT-UpArror to move cursor up one line and select the last line.
3: press CMD-X to cut the line.
about 70% of the time this did get recorded correctly (I did maybe 3 recordings and one failed to select). Once it got recorded correctly it worked reliably.
So it seems to be able to capture some sequences but not others. Both sequences work very reliably when I type them but automator can only capture the last sequence.
Thanks for the suggestions. This tool is better than nothing but not anything I would recommend.

A script that captures the coordinates of the mouse clicks and saves them into a file

Hello,
I'm trying to create a cartoon taking a movie (I've chosen blade runner) as base. I've got the real movie and I've exported all the pictures using VirtualDUB. Now I have a lot of images to modify. I would like to modify the actors faces with the faces generated by Facegen modeller. I'm thinking how to make the whole process automatic because I have a lot of images to manage. I've chosen to use Automate BPA,because it seems the best for this matter. I'm a newbie,so this is my first attempt using Adobe Photoshop and Automate BPA. I wrote a little script. It takes a face generated with Facegen modeller and tries to put it above the original actors faces. But it doesn't work very good and I'm not really satisfied,because the process is not fully automated. To save some time I need to write a script that captures the coordinates of the mouse when I click over the faces and that saves them into a file,so that Automate BPA can read these coordinates from that file and can put the face generated with Facegen Modeller above the original face. I think that Automate BPA is not good for this matter. I think that two coordinates are enough,X and Y. They can be the coordinates of the nose,because it is always in the middle of every face. It is relevant to knows how big should be the layer of the new face,too. This is the Automate BPA code that I wrote :
<AMVARIABLE NAME="nome_foto" TYPE="TEXT"></AMVARIABLE>
<AMVARIABLE NAME="estensione_foto" TYPE="TEXT"></AMVARIABLE>
<AMSET VARIABLENAME="nome_foto">br</AMSET>
<AMSET VARIABLENAME="estensione_foto">.jpeg</AMSET>
<AMVARIABLE NAME="numero_foto" TYPE="NUMBER"></AMVARIABLE>
<AMVARIABLE NAME="coord_x" TYPE="NUMBER"></AMVARIABLE>
<AMVARIABLE NAME="coord_y" TYPE="NUMBER"></AMVARIABLE>
<AMWINDOWMINIMIZE WINDOWTITLE="Aggiungere_layer - AutoMate BPA Agent
Task Builder" />
<AMWINDOWMINIMIZE WINDOWTITLE="AutoMate BPA Server Management Console
- localhost (Administrator)" AM_ONERROR="CONTINUE" />
<AMENDPROCESS PROCESS="E:\Programmi_\Adobe Photoshop
CS5\Photoshop.exe" AM_ONERROR="CONTINUE" />
<AMRUN FILE="%"E:\Programmi_\Adobe Photoshop CS5\Photoshop.exe"%" />
<AMPAUSE ACTION="waitfor" SCALAR="15" />
<AMSENDKEY>{CTRL}o</AMSENDKEY>
<AMPAUSE ACTION="waitfor" SCALAR="1" />
<AMINPUTBOX RESULTVARIABLE="numero_foto">Inserire numero FOTO di
partenza -1</AMINPUTBOX>
<AMINCREMENTVARIABLE RESULTVARIABLE="numero_foto" />
<AMPAUSE ACTION="waitfor" SCALAR="1" />
<AMMOUSEMOVEOBJECT WINDOWTITLE="Apri" OBJECTNAME="%nome_foto &
numero_foto & estensione_foto%" OBJECTCLASS="SysListView32"
OBJECTTYPE="ListItem" CHECKOBJECTNAME="YES" CHECKOBJECTCLASS="YES"
CHECKOBJECTTYPE="YES" />
<AMMOUSECLICK CLICK="double" />
<AMPAUSE ACTION="waitfor" SCALAR="10" />
<AMSENDKEY>{CTRL}+</AMSENDKEY>
<AMPAUSE ACTION="waitfor" SCALAR="20" />
<AMSENDKEY>l</AMSENDKEY>
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="429" MOVEY="281" RELATIVETO="screen" />
<AMMOUSECLICK />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="659" MOVEY="281" RELATIVETO="screen" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSECLICK />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="659" MOVEY="546" RELATIVETO="screen" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSECLICK />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="429" MOVEY="546" RELATIVETO="screen" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSECLICK />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="429" MOVEY="281" RELATIVETO="screen" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSECLICK />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMSENDKEY>v</AMSENDKEY>
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSECLICK CLICK="hold_down" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="131" MOVEY="99" RELATIVETO="screen" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSEMOVE MOVEX="99" MOVEY="162" RELATIVETO="screen" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMMOUSECLICK CLICK="release" />
<AMPAUSE ACTION="waitfor" SCALAR="2" />
<AMINPUTBOX RESULTVARIABLE="coord_x">Inserire coordinata X</AMINPUTBOX>
<AMINPUTBOX RESULTVARIABLE="coord_y">Inserire coordinata Y</AMINPUTBOX>
<AMMOUSEMOVE MOVEX="200" MOVEY="200" RELATIVETO="screen" />
<AMMOUSECLICK CLICK="hold_down" />
<AMMOUSEMOVE MOVEX="%coord_x%" MOVEY="%coord_y%" RELATIVETO="position" />
<AMMOUSECLICK />
and this is a short video to explain better what I want to do :
http://www.flickr.com/photos/26687972@N03/5331705934/
In the last scene of the video you will see the script asking to input the X and the Y coordinates of the nose. This request is time consuming. For this reason I want to write a script that captures automatically the coordinates of the mouse clicks. The only thing to do should be click over the nose and the script should make the rest. As "c.pfaffenbichler" suggested here : http://forums.adobe.com/thread/775219, I could explore 3 ways :
1) use the Color Sampler Tool’s input with a conventional Photoshop Script.
2) use After Effects would provide a better solution.
3) Photoshop’s Animation Panel might also offer some easier way as it might be possible to load two movies (or one movie and one image) and animate the one with the rendered head in relation to the other.
Since I'm a totally newbie in graphic and animation,could you help me to explore these ways ? Thanks for your cooperation.

These are the coordinates of the contours of the face that you see on the picture. Can you explain to me how they are calculated ? The coordinates of the first colums are intuitive,but I'm not able to understand how are calculated the coordinates of the second one.
Thanks.
1 COL 2 COL (how are calculated these values ?)
307.5000 182.0000 m
312.5000 192.0000 l
321.5000 194.0000 l
330.5000 193.0000 l
335.0000 187.0000 l
337.0000 180.5000 l
340.0000 174.0000 l
338.5000 165.5000 l
336.0000 159.0000 l
331.5000 153.0000 l
324.5000 150.0000 l
317.0000 154.0000 l
312.5000 161.0000 l
309.0000 173.0000 l
307.5000 182.0000 l
Message was edited by: LaoMar

Distinguishing b/t two single mouse-click and mouse-double-click

Hi,
I am curious to find out how Forms will distinguish between two single when-mouse-click events and a single when-mouse-doubleclick event. Is it simply a timing issue or is there more involved i.e. the 'co-ordinates' of the mouse. Thanks in advance for any opinions given,
regards,
Kevin.

The difference is same as the difference of Apple and Orange.
Its depends on O/S and event management within OS kernel.
You can change the timing in Control panel of mouse double click.

Lose control of mouse clicker and keyboard

When I boot up and the desktop appears everything works fine for the first 5-10 seconds, then I find I cannot use mouse clicker or keyboard. Can still move curser, however. Does anyone have any suggestions? Thanks

Welcome to the Apple forums.
If you could post what Mac OS you are running, how much memory you have, what Hard drive you are using, that would help folks respond to your query.

Simulate mouse click and do application interface test

Similar Messages

Maybe you are looking for