How do you have a single test case run on multiple platforms in both a Deploy/Test build and via MTM?

I am wanting to have a scheduled nightly build execute my testcases for multiple platforms/configurations.  I have multiple VMs running in these environments but the method Microsoft provided
(without digging into customizing the build template) doesn't provide any functionality for this.  This is a basic use case for automation that I can't believe they would miss.  Has anyone run into this and found a solution.  Is it just that
you have to completely customize the template?
For a more complete use case...
I have 4 customers that have different configurations and different OS platforms on top of a generic configuration.  I want the build/deploy/test build to automatically run my 152 test
cases to at minimum those 5 environments.  I want this to run every morning at 1am and the tests should in the different environments in parallel (ie all of customer 1 tests run at the same time as customer 2 tests...). I also don't want to have to create
152 * 5 test cases since that will bloat things and cause more management/maintenance headaches.

I am wanting to have a scheduled nightly build execute my testcases for multiple platforms/configurations.  I have multiple VMs running in these environments but the method Microsoft provided
(without digging into customizing the build template) doesn't provide any functionality for this.  This is a basic use case for automation that I can't believe they would miss.  Has anyone run into this and found a solution.  Is it just that
you have to completely customize the template?
For a more complete use case...
I have 4 customers that have different configurations and different OS platforms on top of a generic configuration.  I want the build/deploy/test build to automatically run my 152 test
cases to at minimum those 5 environments.  I want this to run every morning at 1am and the tests should in the different environments in parallel (ie all of customer 1 tests run at the same time as customer 2 tests...). I also don't want to have to create
152 * 5 test cases since that will bloat things and cause more management/maintenance headaches.

Similar Messages

  • Test cases runs correctly on IDE but fails on the test runner

    Hi Guys,
    I have a test case here that works fine on my Mars IDE with RCPTT but fails when I run it via the Maven plugin on the same machine.
    The summary of the test case here is that it auto-generates some java files based on changes done to a DSL type language. You will see that there is a Generator project there that does this. Any changes to the type file will trigger the java file to be regenerated with whatever was defined in the Generator project. On the IDE it all works but when it's run via the test runner, it always fails for some reason.
    One interesting thing to note there is if that test case is run first, it does not fail. I initially suspected that the previous test case might have done something to the AUT workspace/environment but it's difficult to prove. The test case in question does have contexts to clear the workspace and to add projects as well as a context for setting the preferences. I did try removing all the contexts except for the workspace context that contains the project that it needs but the execution result is still the same. If I manually ran the same AUT (extracted somewhere else) with the generated test-runner aut workspace right after and made some changes to the type file, the java files are generated correctly.
    So the problem now is, we're not sure what the test runner is doing differently with the RCPTT IDE in this case. It would seem like the test runner is preventing the AUT from generating the files or there might be an error that prevents the generation from happening.
    I've attached the results folder from the test runner execution and the log file from the from the runner-workspace folder.
    cheers!
    Joseph

    Hi Folks,
    We've found out the cause of the problem and have found out that this is not entirely RCPTT related. Apologies for the disturbance. Marking this as a non-issue.
    cheers!
    Joseph

  • How to make sure all my automatic test case run in one session?

    Hi guys,
        I'm doing some automatic test for our products.
         Now i'm hindered by an issue(maybe,due to my wrong configuration).
         I've wrote some test method in a Coded UI Test project,and these run perfect on local machine.And i build an environment includes Builder Controller,Builder Agent,TestController and Test Agent etc, and that the test cases have been written
    in MTM already. 
          After that,i built the project,deployed the project and run the Coded UI Test on Test Agent machine,and i found it seems that he test cases run on different sessions.I have no idea how to config or set up to make sure all my test cases
    run just in one session.
        Could anyone help me,please?

    Hi dean.chen,
    >>I found it seems that he test cases run on different sessions.I have no idea how to config or set up to make sure all my test cases run just in one session.
    According to your description, could you please tell me what the different sessions are when you run the test cases in MTM?
    Why did you want to run the test cases in one sessions?
    where did you see the test cases run on different sessions?
    Could you please tell me how many test agents machine you use to run these automatic test cases in MTM?
    As far as I know that if you just use one test agent machine to run these automatic test cases in MTM, these test cases will be run one by one on the one test agent machine.
    To help you solve this issue, please tell me more detail message about this issue.
    Best Regards,
    We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
    Click
    HERE to participate the survey.

  • How do you have multiple apple id's with one itunes

    how do you have multiple apple id's with one itunes

    I have multiple IDs and use the single computer sharing itunes. By 'sharing' I mean we open the pc, open itunes and log in with our individual ID as required.
    While Im logged in I plug in  my device. I transfer my purchases from my device as per the file menu (not the check for auto downloads). I move them as required to whichever playlist I like.
    Then when my son wants to use itunes or update his device, he logs in, plugs in his device, transfers purchases from his device, puts whatever music he wants into his playlist and/or drags direct to the device regardless of who purchased it and then syncs.
    Im not sure how it works associating the pc with only one ID or all that other business- I know I don't fiddle with any of that.

  • How do you move a single album, and not the whole library, in iPhoto to an external hard drive?

    How do you move a single album, and not the whole library, in iPhoto to an external hard drive?

    File -> Export to a folder and copy it over.
    That will give you a folder with the images. There is no way to move an album outside of iPhoto. You would need to have a library containing it.
    Regards
    TD

  • How can I have a single cursor using elements 9 with Windows 7?

    Currently the cursor on my screen is 3 small boxes in place of the single arrow.  I am using Photoshop Elements 9 With Windows 7.  I have loaded the patch files currently in the Adobe system without any success.

    Thank-you that solved the issue.
    In a message dated 4/20/2014 8:57:10 P.M. Eastern Daylight Time, 
    [email protected] writes:
    Re:  How can I have a single cursor using elements 9 with Windows 7? 
    created by Barbara B. (http://forums.adobe.com/people/Barbara+B.)  in 
    Photoshop Elements - View the full  discussion
    (http://forums.adobe.com/message/6315096#6315096)

  • How do you have JList display user defined element

    How do you have JList display the element you define???
    I tried:
    list.setSelectedIndex( 1 );
    list.ensureIndexIsVisible(1);
    because I want the element at index[1] in the list to be displayed when the GUI opens. It always defaults to element [0] (1st element).
    So if I have
    String[] colors = {blue, red, yellow};
    when the GUI opens, I want "red" to appear in the JList, but blue is always displayed...

    Sorry, that must've been cut off, here it is...
    What I want it to do is open and I want "green" to be the only element showing in the JList...
    import java.awt.*;
    import java.awt.event.*;
    import javax.swing.*;
    import javax.swing.border.*;
    import java.awt.Container;
    import javax.swing.JOptionPane;
    import java.lang.Object;
    import java.awt.event.*;
    import java.awt.Component;
    import javax.swing.JOptionPane;
    import java.awt.BorderLayout;
    //import java.awt.Container;
    import java.awt.Dimension;
    import java.awt.Rectangle;
    import java.awt.event.MouseEvent;
    import java.awt.event.MouseMotionListener;
    import javax.swing.event.ListSelectionEvent;
    import javax.swing.event.ListSelectionListener;
    //import javax.media.jai.JAI;
    //import javax.media.jai.PlanarImage;
    import javax.swing.BorderFactory;
    import javax.swing.JFrame;
    import javax.swing.JLabel;
    import javax.swing.JPanel;
    import javax.swing.JComponent;
    import javax.swing.SpringLayout;
    import javax.swing.border.BevelBorder;
    * Simple applications for demonstrating the use of FormUtility
    * to hide the details of creating a form layout with
    * GridBagLayout.
    * <P>
    * Philip Isenhour - 060628 - http://javatechniques.com/
    public class correctOfficerGUI extends JFrame
            private JPanel form;
            private final JFrame f;
            //public final int lineCount = 0;
            //EASTERN NY
            public static String nameInfoString   = new String();
            String facilities[] = {     "blue",     "green", "yellow"};
        public correctOfficerGUI()
            //JFrame
            f = new JFrame("Add Officer");
            //int x = f.DoModal();
            // Make a panel to hold the demo �form", then
            // add it to the top of the frame�s content pane
            //JPanel
            form = new JPanel();
            f.getContentPane().setLayout(new BorderLayout());
            f.getContentPane().add(form, BorderLayout.NORTH);
            // Set the form panel�s layout to GridBagLayout
            // and create a FormUtility to add things to it.
            form.setLayout(new GridBagLayout());
            JPanel spacerPanel = new JPanel();
            spacerPanel.setLayout(new BorderLayout());
            final JList list = new JList(facilities);
            int index = 2;
         list.setSelectedIndex( 1 );
            list.setVisibleRowCount(1);
         list.setSelectionMode(ListSelectionModel.SINGLE_SELECTION);
         //contentpane
            form.add(new JScrollPane(list));
            JButton addButton = new JButton("Add");
            form.add(addButton);
            //addButton.add(       
         addButton.addActionListener(
              new ActionListener()
              public void actionPerformed( ActionEvent actionEvent )//valueChanged(ListSelectionEvent e)
                        //f.DoModal();
                        System.out.println("********************************************");
                        JOptionPane.showMessageDialog(null, "The Officer has been Added.");
            // Add an little padding around the form
            form.setBorder(new EmptyBorder(2, 2, 2, 2));
            f.setSize(300, 300);//230);
            f.setVisible(true);
        public static void main(String[] args)
            correctOfficerGUI test = new correctOfficerGUI();
         test.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);       
    }Message was edited by:
    poncho

  • How do you get your iPhone to stop connecting to face time while on a voice call? And it also does this when I'm on the phone with someone who doesn't have an iPhone. I look down at my phone while on a call and it says connecting to face time

    How do you get your iPhone to stop connecting to face time while on a voice call? And it also does this when I'm on the phone with someone who doesn't have an iPhone. I look down at my phone while on a call and it says connecting to face time

    How are you dialing these calls?

  • HT4993 How do you get your iPhone to stop connecting to face time while on a voice call? And it also does this when I'm on the phone with someone who doesn't have an iPhone. I look down at my phone while on a call and it says connecting to face time

    How do you get your iPhone to stop connecting to face time while on a voice call? And it also does this when I'm on the phone with someone who doesn't have an iPhone. I look down at my phone while on a call and it says connecting to face time

    How are you dialing these calls?

  • How do you have more than 1 ipod in your family and only 1 computer to be able to each have a separate account?

    HOw do you have more than 1 ipod int he family and be able to have your own itunes on 1 computer?

    Did you read the support document at the other end of the link? What additional information do you desire?
    The Apple support document How to use multiple iPods with one computer (n.b. same link as above!) suggests a number of ways for managing the media content. I use method two (Sync with selected playlists) with a slight twist. Rather than regular playlists I set the grouping field to indicate which users should receive which tracks and create smart playlists based on the content of this field.
    e.g.
    "Alice's Tracks" is "Grouping contains Alice" + "Kind contains audio"
    "Bob's Videos" is "Grouping contains Bob" + "Kind does not contain audio"
    Tracks that both Alice & Bob want on their iPods have the grouping set to "Alice/Bob"
    etc.
    I currently manage our family's five iDevices using this system, each getting a different selection to suit their tastes and the capacity of their device. An advantage of using the grouping field is that it is stored in file tags (for non-wav audio files anyway) so that it is relatively easy to recreate the playlists should the iTunes library get trashed and need rebuilding. Also useful if you move files about manually as playlist membership is preserved when you delete & re-import the tracks.
    tt2

  • How do you have Google searches appear in new tab? This was previously not a problem, but it changed and I cannot return the setting. Any ideas?

    How do you have Google searches appear in new tab? This was previously not a problem, but it changed and I cannot return the setting. Any ideas?

    I recently purchased a second hand new macbook air, although it was second hand to me the previous owner had never actually turned it on.
    Something doesn't make sense here, though I'm not saying the previous owner is lying....
    Time to send your serial # to iTS and let them see what's happening here.
    iTunes Store Support
    http://www.apple.com/emea/support/itunes/contact.html

  • How do you have a file automatically open in mail, like a Constant Contact email?

    How do you have a file automatically open in mail, like a Constant Contact email?
    Thanks,
    Lauren

    If there is a way to automatically open an attached file in a Mail item, it is not one that I would use, because I want to stay in control of my Mac!  Who is it from, whats in it and so on... To me bad idea but then the choice is yours.

  • How do you have couninous play with cover flow

    How do you have continous play with cover flow

    You don't. It plays from the track you select to the end of the album, optionally repeating.
    tt2

  • How would you have an event recur weekly? monthly? Yearly?

    How would you have an event recur weekly? monthly? Yearly? I want to be able to insert an event for a weekly occurring meeting, however.... I don't want to have to insert it for every occurrence myself.

    Hi,
    If you are using 10g, this is trivial using dbms_scheduler
    e.g.
    grant create job to user_that_runs_insert ;
    Then as the user do
    BEGIN
    dbms_scheduler.create_job(
    job_name => 'weekly_meeting',
    job_type => 'STORED_PROCEDURE',
    job_action => 'weekly_proc'
    repeat_interval => 'FREQ=WEEKLY;BYDAY=SUNDAY;BYHOUR=20;BYMINUTE=0;BYSECOND=0',
    comments => 'job runs every Sunday at 8pm',
    enabled=>true);
    END;
    Instead of weekly, you can just as easily to monthly or yearly.
    If you don't want anything to run but you just want a list of dates that is on a weekly schedule you can use dbms_scheduler.evaluate_calendar_string in a loop to figure out which dates fall on a certain pattern. Docs and an example is here
    http://download-west.oracle.com/docs/cd/B19306_01/appdev.102/b14258/d_sched.htm#i1009923
    Hope this helps,
    Ravi.

  • When it says your capacity is 6.43 GB does that mean how much memory you have used up or how much you have left

    when it says your capacity is 6.43 GB does that mean how much memory you have used up or how much you have left

    The 6.43 GB is how much storage that is available to you to use. The difference between 6.43 ansd 8 GB is taken up by the iOS.
    The Available entry show how much is unused.

Maybe you are looking for