Using data from a camera to move a robot arm

Hey guys,
I have a 6 motor robot arm that operates through serial commands.  The six motors are the base, elbow, shoulder, wrist, hand twist, hand grip motors.  Each motor accepts a numerical value from 500-5500 to control its position.  From reading the manual this is done through PWM I believe.  Now my problem is that i am designing a game in where one component of it requires the robot arm to pick up a chip from a position that doesn't change, and move it to a game board.  The position on that game board where the robot arm puts the chip will vary depending on the user input.
I though of just recording the values for the position of the arm in each location, but with PWM that can be slightly inaccurate because it may not go exactly back to the location when the command is set.  The square areas on the board are 2 cm x 2 cm, so a bit of precision would be nice.  My remedy was thinking of using a usb web camera to snap a picture of the board, and setup a coordinate system from that image to guide the robot to the correct location.
My question then is (1) is there an easier way to do this that I am missing? (2) If i went with this method then would I probably need 2 cameras? one for x-y plane and one for z-plane. Lastly (3) Also if i went with this method, i having trouble finding examples of using IMAQ to record the continous images, attach coordinate systems to the region of interest, then coorelate that to movement of the robot arm. 
If anyone has had any experience doing this and can lead in the right direction then that would be great and I deeply appreciate it!   

I'm not quite sure what you mean by sending serial commands and then referencing PWM. Likely, your motor controller/drive is receiving serial commands from LabVIEW and then controlling the motors with PWM signals to actual drive the movement. 
If you are having slight inaccuracy in the movement, I'm also guessing that you are not using stepper motors. The much easier option than optical feedback would be to use encoder feedback on the axes, but I understand this would be difficult if you have predefined hardware without access to adding physical encoders. Without knowing more details of your hardware, it is difficult to recommend another solution.
Regardless, the IMAQ programming would be very difficult to accurately identify and guide the robot manipulator. The simpler application I would implement if forced to use image recognition would be to re-zero the robot's position after a move by comparing images when in a "home" position. You could use a fairly simple pattern matching routine and then find the displacement from the original match. This would still take quite a bit of programming, but wouldn't be anywhere near as difficult as continuous processing.
Karl G.
Applications Engineer
ni.com/support

Similar Messages

  • I created an iMovie using pictures from my camera roll, I exported the movie to the camera roll and then deleted all of the pictures. Now I can't get the movie to play. Did deleting the pictures cause my IMovie to disappear? How can I get my movie back?

    I created an iMovie using pictures from my camera roll, I exported the movie to the camera roll and then deleted all of the pictures. Now I can't get the movie to play. Did deleting the pictures cause my IMovie to disappear? How can I get my movie back?

    Download and open this program, lets you look around your I phone as if it was a disc drive, might find em in the iphones drive.
    http://www.macroplant.com/iexplorer/

  • HT1390 Does it use data to watch a rented movie from iTunes on IPad? Is it streaming or just downloaded?

    Does it use data to watch a rented movie from iTunes on IPad? Is it streaming or just downloaded?

    You must get the movie onto your iPad somehow. If you download it while on Wi-Fi you will not use cellular data. Once the movie has been downloaded you will not use cellular data or Wi-Fi.

  • My daughter made an iMovie project using picures from her Camera Roll and then delted the pictures from her camera roll and now she can not export the project.  Does anyone know of a way to still export this project?

    My daughter made an iMovie project using picures from her Camera Roll and then delted the pictures from her camera roll and now she can not export the project.  Does anyone know of a way to still export this project?

    jkrijgsman wrote:
    Does anyone have a good workaround for burning a DVD from an iMovie project now that iDVD is no longer around?
    There's Toast.
    http://www.roxio.com/enu/products/toast/titanium/
    $79.99
    Final Cut Pro X will also burn DVDs.
    $299.99
    How large is your movie?  Is it possible that you could output it as a QuickTime file and then burn that as a data DVD?  Is uploading to YouTube an option?
    Matt

  • How to get useful data from request?

    Hello.
    I am looking for creating a management tool for a web site. All I want is that is there any ready to use API or package or open source project for retrieving user�s information? I just mean that is there any easy to use way in java to get useful data from a client (for example location, his or her system configuration and information �).
    Thanks.

    If you dump all the data from request (see the javadoc, and especially the "header methods" ) you'll see the data you can get are quite simple.
    The only thing you can try to rely on are ;
    - the IP address from the sender (when reversed to DNS, you can sometime use the tld to locate the country it comes from. Yet, you'll get many .com name, so it's not that significant. it may also give you the IAP used). Note that if the user is using a proxy, it's the proxy IP that you'll collect
    - the User-Agent header : from this, you can guess the OS and the browser used
    - the Referer header : usefull to get where your user comes from (where they found a link to your site)
    - the Cookie header : if you're using a servlet container with session id stored in cookie, you should see the Cookie header appear on the second request to your site. That helps finding out wether your user accep cookie or not (from a server point).
    Besides these, i don't think you can get any other useful data without asking your users on a form. Note that it's the client that decides to send Referer, User-Agent or Cookie headers. Those are not mandatory to the Http Protocole and some browser allow their user to fool their content (butmore than 90% of the widespread browsers don't)

  • How to use data from standard view in Web dynpro for ABAP

    Hello:
    I have to create an Abap Web Dynpro, and I must use data from a standard view in the new one. Does anybody know what do I have to do?
    Thank you and have a happy new year.

    Hi Rodrigo,
    Firstly, list the Standard component under Component Usage of the Component which you are creating in your View.
    Second, In the Custom Component, view, goto context, and try to add the node from the Standard component in to your view.
    NOTE: The second step requires a Node in component controller of the Standard Component.
    Finally, Now in your view, get the data from that and map the data.
    NOTE: To do this, I think you need to call your Standard WDA first and then only your node contains data and it will be passed.
    I hope it is helpful.
    Regards,
    Shashikanth. D

  • I am attempting to have cells use data from a selective month from the year before so that I can show actual from the prio. years each month.

    I am attempting to have cells use data from a selective month from the year before so that I can show actual from the prio. year each month. I need to create a spreedsheet using the the Acutlas from the year-to-date and from last year-to-date, but need to report each month.

    Hi Tony,
    Answering your question would be easier given a screen shot of the source table and one of what you want the summary table to look like.
    Is the data you want for each month in a single cell o the source table, or does the summary table need to collect February's data (for example) from several cells and do some math with those numbers before presenting them on the summary table?
    Regards,
    Barry

  • Filtering using data from a spreadsheet in WebI

    I need to convert a BO6.5 Full client report to a BO XI R3.1 WebI report.  The report needs to use data from an Excel spreadsheet to filter data from a universe, and in 6.5 this was achieved by creating a universe for the spreadsheet data and using 'Select Query Results' as an operand returning this data in the report conditions.  When we put this report through the conversion wizard the conversion fails.
    Are there any other techniques that can be used in WebI that would allow me to use a spreadsheet to filter / join with a query from a 'regular' universe?
    Thanks,
    Steve Clarke

    Thanks for the response! I'd be interested in writing a script for it (I've actually been researching it a bit already). I'm completely new to Javascript (and scripting) but have a fair level of experience with c/c++ so I feel it shouldn't be too bad. I'll ask here for now, just let me know if I should ask a new question on the scripting forum instead.
    I've looked at the Acrobat JavaScript API Reference (http://www.adobe.com/content/dam/Adobe/en/devnet/acrobat/pdfs/js_api_reference.pdf) a bit but am having trouble finding a way to read the spreadsheet's data in (I was planning on using a csv file). I found Doc.importTextData(), which can parse a tab delimited file and from the sounds of it fill in the forms automatically (though I would much prefer a c style file interface that lets me write the parsing logic). Every time I try to call importTextData it returns -1 though, which means "Warning: User Canceled File Select". When I call it direct from the JavaScript Debug Console I just get a -1, but when I have it execute when I save I get "NotAllowedError: Security settings prevent access to this property or method.". I did a bit of research on that and modified my script to look like:
    Autofill = app.trustedFunction(
        function ()
            app.trustedFunction(importTextData);
            app.beginPriv();
            var result = this.importTextData("test.csv", 0);
            app.endPriv();
            return result;
    I've also tried running Acrobat as an administrator, but I still get the same error. I could just not be understanding privileges correctly.
    My overall plan was:
        for each row in the spreadsheet
            - read the row in from the file
            - fill out the fields in the PDF using the read data
            - save the file with a new file name.
    If there is a better method to do this, just let me know.
    Thanks again for your time!

  • Have a combobox pre-filled using data from database

    What would be a recommended method to have a combobox
    pre-filled using data from database?

    You can load an Array with the data returned from your
    database and bind to that array as the dataProvider for the
    comboBox.
    [Bindable]
    private var myArrayDP:Array = new Array();
    //Load the array with your returned data.
    <mx:ComboBox dataProvider="{this.myArrayDP}">
    </mx:ComboBox>
    Using an ArrayCollection however is often better if you want
    changes to the dataProvider to automatically reflect in the
    ComboBox.

  • Date sync: how can I sync dates from 2 cameras

    hi
    how can I sync dates from 2 cameras. From a wedding, my camera had the correct date, the borrowed one was about 11hrs out but not exactly. I want to change all the pics from the 2nd camera to sync with the first. I've already imported.
    Many thanks

    Use "Metadata→Adjust date and time".
    Instructions in the User Manual here.  Not that the change is an offset to the time-stamp listed in the EXIF.
    Message was edited by: Kirby Krieger

  • Does my devices that are on my apple account use data from apple phone

    Will all devices on my apple account use data from my apple phone Grimm at&t.  Snapchat or face time

    Are you referring to cellular data? Is your iPad wifi + cellular? Your iPad cellular is separate from your iPhone cellular account.
    Facetime on an iPad only works on wifi.
    Can you explain your concern?
     Cheers, Tom

  • Does Facetime Use Data From You Data Plan?

    Does Facetime Use Data From You Data Plan?
    If so, what would be a good plan to use :200MB, 2 GB, or 2GB + Tethering?
    Or Does it use up minutes?

    Facetime uses wi-fi.
    "People have been dreaming about video calling for decades. iPhone 4 makes it a reality. With just a tap, you can wave hello to your kids, share a smile from across the globe, or watch your best friend laugh at your stories — iPhone 4 to iPhone 4 or to the new iPod touch over Wi-Fi."
    http://www.apple.com/iphone/features/

  • HT5569 When my daughter uses her i-phone on our wirless network at home does it use data from our data plan when she plays games or aps from her phone?

    When my daughter uses her I-phn on our home wirless network does it still use data from our data plan? Thanks.

    No. As long as she's connected to WiFi, no cellular data is being used.

  • HT201269 I used Article: HT2109 to transfer everything from my iPod touch 3g, iOS 5.1.1, to my iPod touch 5g, iOS 6.1.3. Why did data from apps did NOT move to the new device? Games are starting over rather than picking up where they were on the old devic

    I used Article: HT2109 to transfer everything from my iPod touch 3g, iOS 5.1.1, to my iPod touch 5g, iOS 6.1.3. Why did data from apps NOT move to the new device? Games are starting over rather than picking up where they were on the old device?

    - If you restored the 5G frmm the iTunes backup of the 3G were th app in the iTunes library of the computer you used? They have to be.
    - If yes then try again. When I first restored my iPad 4 from the iTunes backup of my iPad 1 app data did not transfer. I tried again and it did.

  • Fcpx via firewire No Data from Panasonic camera

    Hi,
    I have a Macbook Pro 2011 64 bit with FCPX.  My camera is Panasonic AGDVC200E DV Cam.  Connection is via Firewire DV out of camera in to firewire 800 in mac.  System profiler "sees" the Camera serial number.  FCPX "sees" the camera when I go to import media, but when I hit the import button, I get a message "no data from Camera can't import".  The camera works with all my other windows laptops & pcs, so I know it's not the DV out of the camera.  I've changed cables so it's not the cables.  I've imported from other mini dv cameras into the macbook firewire port using the same lead so  it's not the firewire in of the mac.  I've checked the settings in the camera, macbook (inso far as I know what to check).  I've plugged both camera and macbook into mains while doing all of this.  Has anyone any idea how to get my camera to work with fcpx?  (Incidently, imovie doesn't even "see" the camera, even though profiler can,  so I can't try that..  I've wrestled with this problem since I got the Macbook in 2011, I really thought I'd find a solution I even bought an express card to usb connecter & firewire express card thinking ths would work without success.  Any help appreciated.
    Snoozein

    I've no idea what the solution is, but if you haven't done it already, a longshot would be to trash the prefs with the free app below.
    It'll only take seconds and just might help.
    Many weird things happen as a result of corrupt preferences which can create a vast range of different symptoms, so whenever FCP X stops working properly in any way, trashing the preferences should be the first thing you do using this free app.
    http://www.digitalrebellion.com/prefman/
    Shut down FCP X, open PreferenceManager and in the window that appears:-
    1. Ensure that only  FCP X  is selected.
    2. Click Trash
    The job is done instantly and you can re-open FCP X.
    There is absolutely no danger in trashing preferences and you can do it as often as you like.
    The preferences are kept separately from FCP X and if there aren't any when FCP X opens it automatically creates new ones  .  .  .  instantly.

Maybe you are looking for

  • External monitor not detected - Early 2015 MBA

    I am the IT admin at my company here. Recently, one of the employees started having severe problems with his Mid-2012 MBA, which would only operate in Safe Mode. Because he needs his computer at all times, my initial "solution" was to give him a new

  • Cust Account group field status got changed

    Hi Experts, One of my colleaged has executed the program : RFXPRA05. As a result of this some of the field in Account group (YSTP)  got its status changed Say for e.g Street 2 & Street 3 where optional entry before he executed the program : RFXPRA05,

  • Javascript not working in ie.

    hi, i have a javascript function that has an ajax request. the ajax will call an on demand process which will give a xml data. then i use the javascript to process the xml data and set it as a value for my page items. its all work in firefox but not

  • Itunes crashing after update, why?

    This fault seems to have come along with the last update. I'm not interested in doing Apples' job for them, so all I need is another update to fix the last one not a lesson in computer software engineering. So please get this fixed.

  • Bad response: (405 Method Not Allowed)

    Hello, I am new with OC4J. I have deployed J2EE application with servlet based on Sun's SAAJ API. When I run it I get this error(the same code runs properly on Tomcat server): java.security.PrivilegedActionException: com.sun.xml.messaging.saaj.SOAPEx