Test executive and Test stand deployment cost

Hello,
would some NI support engineer kindly answer below questions ? i would be obliged.
we have been running customized Test executive built from Test executive toolkit. We are now making decision as to whether We should migrate to test stand or keep the existing structure? Here are some questions:
1) in case We switch to test stand, do We still need to buy runtime engine license ?
2) can we call executables in Test stand ?
3) stating from ground zero, what is the deployment cost estimate between Test stand and customized test executive scenarios, from end user point of view ?
-Ahmed

Hi Ahmed,
To answer your questions:
1) You will need to have a deployment (runtime) license for all the machines that you plan on running your application on. However, you will only need a full development license for the computer that you are actually developing the application on. You can see a full explanation of the different types of TestStand license in the document "When Should I Purchase a License for my TestStand System?"
2) In regards to calling executables, TestStand has a builtin step to call executables making it extremely easy to do. You can download an evaluation copy of TestStand here to see how easy it is to use as well as see the simple Call Executable Step.
3) In regards to price comparison between TestStand and a customized test application, this really depends on the project. Each project can have a different cost. However, you can take a look at this cost analysis to get a general idea of one example of cost comparison. This is just an example and also compares an older version of TestStand.
For more specific information about cost, please contact a sales representative at (888) 280-7645.
Thanks,
Caroline Tipton
Data Management Product Manager
National Instruments

Similar Messages

Correct idea to scale out testing environment and test service pack2 installation

Hi
I have a sharepoint 2010 farm it has one sharepoint server, one database server
In one server below services are running
Central administration service
SharePoint Server Search
User Profile Service
Microsoft SharePoint Foundation Web Application
so i want to scale out this form to
1 application server
1 web front end server
1 Search server (index server)
1 databse server
here how i scale out to this form
1)here how i move sharepoint server search service to new index server and
2) here how i move Microsoft SharePoint Foundation Web Application to new webfront end server
and in this single server some web appllications are running also how i move these to new wf server
i want to do like this because i want to test service pack 2 installation, now sharepoint version is : service pack1
my actual production environment has
2 application servers
2 webfront end servers
2 index servers
1 databae server
so this correct idea to scale out testing environment and test service pack2 installation
adil

Hi Adil,
The link below describes how to scale SharePoint Web Front-End with only web applications and the search query server out of one SharePoint server with all roles running.
http://sharepointsolutions.com/sharepoint-help/blog/2011/02/how-to-scale-out-a-sharepoint-2010-farm-from-two-tier-to-three-tier-by-adding-a-dedicated-application-server/
Now you have two SharePoint server with:
Tier 1 – SharePoint Server dedicated as a Web Front-End (WFE) with only the web application(s) and the search query service running on it
Tier 2 – SharePoint Server dedicated as an Application Server with all of the other service applications running on it, but no web applications or query service
Tier 3 – SQL Server for the databases
Then you would scale out WFE server with web applications from tier1. Now please install a new SharePoint server and join it to the existing farm and deploy it as Web Front Server. Enable the relevant services on Web Front servers per the topology picture
below, and stop the services running on the old server.
http://technet.microsoft.com/en-us/library/cc263044(v=office.14).aspx
Regards
Rebecca Tu
TechNet Community Support

Need info on BSP tags Test Suite and Test Case

Dear All,
Could any one pls send me some info on the BSP tags Test Suite and Test Case.
Thanks,
Sirisha.

Hi,
I have gone through the sample examples.. for TestSuite and test case.. but im unable to understand it. I need some documentation on the usage of these tags..
Thanks,
Sirisha.

Connectivity to Test Controllers and Test Agents in virtual machine

Hi,
I’m setting up the load test infrastructure- configured test controller and test agent on skytap virtual machine (which is windows server 2012). I have configured as below:
The load tests exist on my machine (TFS 2013) , in test settings I selected – Local execution with remote collection, tried with selecting remote execution, selected the controller, the status shows as connected to controller: ‘XXXXXXXXXXX:6901’
I have configured the test controller ( TC 2013 ) for load testing, specified logon account as – Local system, since I’m not connecting the TFS in my virtual machine I skipped the Team Project Collection part. The load test database (SQLExpress)
is connected.
The Text Agent (TA 2013) also exists on the same virtual machine and is registered with controller. The test agent is running as service , logon as – Network service
I had checked the services, admin users on my machine and virtual machine, made the firewall exceptions, tried disabling the firewall too, checked the config files for QTController and QTTest Agent(C:\Program Files (x86)\Microsoft Visual Studio 12.0\Common7\IDE)
for port 6901, I can ping my machine( IP or with DNS) to Virtual machine ( vice versa). I also tried to set the logging – verbose for all TA, TC , devenv config ( however, I could see any logs).
The machines are in same domain and port 6901 is accessible from local machine.
When I try to run my load test from my machine it gives the below error:
Error: Failed to queue test run 'LoadTests (2015-01-22 15:04:00)': A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host
has failed to respond.
I tried troubleshooting with all the online help available, could not find a solution.
Please help on this.
Dhillon_H

Hi Tina-Shi
Thank you for the response. Please see below my findings and the logs
- There were no errors while configuring TC, TA on VM , only warnings as below:
Since you have not configured lab service account, make sure a) test agent can communicate with the test controller, b) test controller and test agent can access the build drop location, and c) Microsoft Test Manager can connect to the test controller
during manual test runs. Manual steps might be needed to setup the permissions mentioned above.
-The test Agent is ready status in the Manage Test Controllers Window in the local.testsetings file.
- The load tests run successfully when I select local execution.
- I have referred the links mentioned , couldn't find the solution, also sending some content from logs I have on the VM machine where my TC, TA exist.
- Also, I’m the admin on my TFS machine and VM .
- TC configuration – as Local system , TA configuration- as network service.
VSTTAgent.log
I, 4988, 41, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTAgentService.exe, AgentService: Connecting to controller. Using AgentName: XXXXX-XXX-XXXX : Domain : DEVOP.Xxxxx-xxx-xxxx.com
V, 4988, 32, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentService: calling AgentObject.Hello
V, 4988, 32, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.WaitForDataCollectionAgentProcessToStart: waiting for agents to start.
V, 4988, 32, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.WaitForDataCollectionAgentProcessToStart: Agents started.
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.PerformActionIgnoringExceptions: Calling 'DataCollectionEnvironmentContext' on the data collection agent
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.WaitForDataCollectionAgentProcessToStart: waiting for agents to start.
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.WaitForDataCollectionAgentProcessToStart: Agents started.
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.PerformActionIgnoringExceptions: Successfully called 'DataCollectionEnvironmentContext' on the data collection agent
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.PerformActionIgnoringExceptions: Calling 'DataCollectionEnvironmentContext' on the test agent
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.PerformActionIgnoringExceptions: Successfully called 'DataCollectionEnvironmentContext' on the test agent
I, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentService: Successfully connected to controller.
V, 4988, 41, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentStatusAggregator.ControllerConnected: Connection to controller XXXXX-XXX-XXXX:6901 has been established.
V, 4988, 44, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.PerformActionIgnoringExceptions: Calling 'SetAgentDataCollectorInformation' on the controller
V, 4988, 44, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTAgentService.exe, AgentProcessManager.PerformActionIgnoringExceptions: Successfully called 'SetAgentDataCollectorInformation' on the controller
EqtTraceAgent.log
V, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, Agent XXXXX-XXX-XXXX: created Controller Event Sink
V, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentObject: starting state machine on different thread.
V, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, StateMachine(DataCollectionAgentState): SetNextState Online called
V, 568, 7, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, StateMachine(DataCollectionAgentState): In state Online. Waiting for state change...
V, 568, 7, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, StateMachine(DataCollectionAgentState): Exit wait for state change, current state is Online.
V, 568, 7, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, StateMachine(DataCollectionAgentState): Uninitialized => Online
V, 568, 7, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, StateMachine(DataCollectionAgentState): calling state handler for Online
V, 568, 7, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, StateMachine(DataCollectionAgentState): In state Online. Waiting for state change...
V, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectorWatcher: DataCollectorDiscoveryPeriod set to: 5000
V, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectorWatcher.Start: Starting to watch for changes in the data collector files.
V, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentObject: constructor is done, success.
I, 568, 1, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentProcess: Calling into AgentService to register the agent.
V, 568, 8, 2015/01/23, 12:28:31.395, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectorCache.ForceCacheUpdate: Performing data collector discovery.
I, 568, 1, 2015/01/23, 12:28:31.411, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentProcess: Successfully registered data collection agent process.
I, 568, 1, 2015/01/23, 12:28:31.411, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentProcess: waiting for shutdown notification.
V, 568, 8, 2015/01/23, 12:28:32.192, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectorCache.ForceCacheUpdate: Done performing data collector discovery.
V, 568, 10, 2015/01/23, 12:28:32.458, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentObject: Hello.
V, 568, 10, 2015/01/23, 12:28:32.458, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionEnvironmentContext: Adding Agent Process URI ipc://eqt-f0f6cfb9-454f-4e8a-c857-170546772b6e/
V, 568, 25, 2015/01/23, 12:38:33.345, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentObject: Hello.
V, 568, 25, 2015/01/23, 12:38:33.345, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionEnvironmentContext: Adding Agent Process URI ipc://eqt-f0f6cfb9-454f-4e8a-c857-170546772b6e/
V, 568, 33, 2015/01/23, 12:48:32.667, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentObject: Hello.
V, 568, 53, 2015/01/23, 12:48:32.667, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionEnvironmentContext: Adding Agent Process URI ipc://eqt-f0f6cfb9-454f-4e8a-c857-170546772b6e/
V, 568, 54, 2015/01/23, 12:58:33.943, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionAgentObject: Hello.
V, 568, 54, 2015/01/23, 12:58:33.943, XXXXX-XXX-XXXX\QTDCAgent32.exe, DataCollectionEnvironmentContext: Adding Agent Process URI ipc://eqt-f0f6cfb9-454f-4e8a-c857-170546772b6e/
EqtTraceController.log
V, 2608, 20, 2015/01/23, 13:08:10.287, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: Hello
V, 2608, 20, 2015/01/23, 13:08:11.302, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
I, 2608, 20, 2015/01/23, 13:08:11.302, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: Creating ControllerExecution for TestRun 9f0e53e4-09da-40f4-90d8-01bdaeec7365
I, 2608, 20, 2015/01/23, 13:08:11.318, XXXXX-XXX-XXXX\QTController.exe, ControllerSpooledJob: creating spooled job for test run 'LoadTests (2015-01-23 13:08:08)'
I, 2608, 20, 2015/01/23, 13:08:11.318, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: Queuing TestRun 9f0e53e4-09da-40f4-90d8-01bdaeec7365
V, 2608, 22, 2015/01/23, 13:12:54.566, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 22, 2015/01/23, 13:12:54.566, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: AgentHello from XXXXX-XXX-XXXX
V, 2608, 22, 2015/01/23, 13:12:54.566, XXXXX-XXX-XXXX\QTController.exe, Verifying the connection integrity for following number of objects: 1
V, 2608, 24, 2015/01/23, 13:17:54.596, XXXXX-XXX-XXXX\QTController.exe, Agent : NT AUTHORITY\NETWORK SERVICE
V, 2608, 24, 2015/01/23, 13:17:54.596, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 24, 2015/01/23, 13:17:54.596, XXXXX-XXX-XXXX\QTController.exe, User NT AUTHORITY\NETWORK SERVICE is in group TeamTestAgentService.
I, 2608, 24, 2015/01/23, 13:17:54.596, XXXXX-XXX-XXXX\QTController.exe, A user has successfully authenticated to obtain the ControllerObject.
V, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.ConnectAgent: Agent: XXXXX-XXX-XXXX from machine: xxxxx-xxx-xxxx.DEVOP.Xxxxx-xxx-xxxx.com trying to connect.
V, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, User NT AUTHORITY\NETWORK SERVICE is in group TeamTestAgentService.
I, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, AgentDomainTrusted : Controller Domain DEVOP.Xxxxx-xxx-xxxx.com Agent Domain DEVOP.Xxxxx-xxx-xxxx.com
I, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, AgentDomainTrusted : Same domain DEVOP.Xxxxx-xxx-xxxx.com
I, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.ConnectAgent : Ignoring the identity
V, 2608, 27, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, Successfully verified connection for agent XXXXX-XXX-XXXX
I, 2608, 23, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, AgentManager: Agent 'XXXXX-XXX-XXXX' successfully connected.
V, 2608, 23, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, Verifying the connection integrity for following number of objects: 1
V, 2608, 23, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.ConnectAgent: Agent: XXXXX-XXX-XXXX Returning.
V, 2608, 24, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 29, 2015/01/23, 13:19:13.442, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
I, 2608, 29, 2015/01/23, 13:19:13.442, XXXXX-XXX-XXXX\QTController.exe, A user has successfully authenticated to obtain the ControllerObject.
V, 2608, 28, 2015/01/23, 13:19:14.114, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: Hello
V, 2608, 28, 2015/01/23, 13:19:14.364, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
V, 2608, 28, 2015/01/23, 13:19:16.270, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
V, 2608, 28, 2015/01/23, 13:19:16.489, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
V, 2608, 32, 2015/01/23, 13:22:54.593, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 32, 2015/01/23, 13:22:54.593, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: AgentHello from XXXXX-XXX-XXXX
V, 2608, 32, 2015/01/23, 13:22:54.593, XXXXX-XXX-XXXX\QTController.exe, Verifying the connection integrity for following number of objects: 1
VSTTController.log
V, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, User NT AUTHORITY\NETWORK SERVICE is in group TeamTestAgentService.
I, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, AgentDomainTrusted : Controller Domain DEVOP.Xxxxx-xxx-xxxx.com Agent Domain DEVOP.Xxxxx-xxx-xxxx.com
I, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, AgentDomainTrusted : Same domain DEVOP.Xxxxx-xxx-xxxx.com
I, 2608, 23, 2015/01/23, 13:17:55.877, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.ConnectAgent : Ignoring the identity
V, 2608, 27, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, Successfully verified connection for agent XXXXX-XXX-XXXX
I, 2608, 23, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, AgentManager: Agent 'XXXXX-XXX-XXXX' successfully connected.
V, 2608, 23, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, Verifying the connection integrity for following number of objects: 1
V, 2608, 23, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.ConnectAgent: Agent: XXXXX-XXX-XXXX Returning.
V, 2608, 24, 2015/01/23, 13:17:55.893, XXXXX-XXX-XXXX\QTController.exe, ControllerObject.RequireAgentServiceUser: Agent: XXXXX-XXX-XXXX of environment [Default] trying to connect.
V, 2608, 29, 2015/01/23, 13:19:13.442, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
I, 2608, 29, 2015/01/23, 13:19:13.442, XXXXX-XXX-XXXX\QTController.exe, A user has successfully authenticated to obtain the ControllerObject.
V, 2608, 28, 2015/01/23, 13:19:14.114, XXXXX-XXX-XXXX\QTController.exe, ControllerObject: Hello
V, 2608, 28, 2015/01/23, 13:19:14.364, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
V, 2608, 28, 2015/01/23, 13:19:16.270, XXXXX-XXX-XXXX\QTController.exe, User XXXXX-XXX-XXXX\dhilloha is system, Admin, or controller user
V, 2608, 28, 2015/01/23, 13:19:16.489, XXXXX-XXX-XXXX\QTController.exe, User xxxxxxxx\dhilloha is system, Admin, or controller user
Thanks you for looking into this.
Dhillon_H

Can anybody explain me difference between test cases and test data

Hi All,
Can anybody explain me difference between test cases and test data.
Testing procedure for FS.
Thanks & Regards,
Smitha

Hi,
Test case is a procedure how to do the testing of particular functionality and it consists the data that to be given for testing a particular requirement of the given Functional Spec and it also consists the result whether the desired functionality is fullfilling or not.
Regards
Pratap

Test scenario and test plan

Hi All,
Can somebody explain what is a test scenario and test plan with an eg ( For eg FB 60). and what are the essential things one needs to incorporate for test scenario and a test plan
Appreciate your help.
Thanks
SM

Hi,
I am giving you the information on test plan and test scenario below. Please note that this is with reference to Solution Manager.
You create a test plan for a project in the SAP Solution Manager if you want to reuse the project structure created in the Business Blueprint for a process-oriented test. You can select all the test cases and transactions which you have assigned to the project structure, for the test plan. These test cases are performed by testers; they can call assigned transactions and run test cases in them.
Test Scenarios are nothing but the end to end business processes which are to be tested.
Hope this helps.
Rgds
Manish

Test Controller and Test Agents on Azure

Hi everyone,
I am trying to run a Test Controller and Test Agents on Azure and the controller fails when trying to register with TFS. We did set up a VPN and it seems to be working but I saw this on MSDN:
If the On-Premise machines are domain joint, you will need to add an IPSec exemption so that the bidirectional communication can succeed. This can be avoided if you can unjoin the On-premise machine from the domain and join it to a workgroup instead.
I don't know what "domain joint" means but I am wondering about the IPSec exemption. Can anybody explain what this means?
Thanks!
Randy

Hi Randy,
Do you refer to this article below?
# Hosting TestController and TestAgents on Azure
http://blogs.msdn.com/b/visualstudioalm/archive/2014/01/13/hosting-testcontroller-and-testagents-on-azure.aspx
I'm trying to involve some senior engineers into this issue and it will take some time. Your patience will be greatly appreciated.
Regards
Starain
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Using Test Plan and Test Suites as work items

Hi everybody.
I need to incorporate the new feature of TFS 2013 that let me manage Test Plans and Test Suites as work ítems to my current TFS environment. I have TFS 2013 Update 3 (12.0.30324); I guess this feature was released after the release I have.
So, my questions are:
- How can I integrate the work ítem definitions to my process template? I'm using a customized version of CMMI 12.2 and this version didn't have this elements as work ítems.
- How can I adjust the existing data of all my Team Projects in order to use this functionality?
- Is there any impact on the existing Reporting Services reports? or the new process template have incorporated the appropiated changes?
- Do I need to upgrade my TFS Server? If so, a migration process is needed?
Any help will be appreciated.
Best regards.

Hi AjdPC,
Thanks for your post.
Yes, this feature released in TFS 2013 Update 3. But as the TFS 2013 Update 4 has released too, so we suggest you upgrade your TFS to TFS 2013 Update 4.
After you upgraded to TFS 2013 Update 4, if you want use this feature in the old/upgraded team projects, you need configure features for these team project, please refer to the detailed information in this document:
https://msdn.microsoft.com/en-us/library/ff432837.aspx. For example, if one your upgraded team project created using CMMI 12.2, open this team project’s Web Access admin page, click
Configure Features>>select the CMMI 2013.4 in the
Choose a process template to continue textbox, then click Configure button.
For the custom process templates, we suggest you download the new 2013.4 versions process template from your collection after upgraded to TFS 2013 Update 4, then custom that 2013.4 process templates to instead of that old customized 12.2 process templates,
then upload the new customized process templates to your collection and create team project use them if you want.
That not impact your Reporting Services reports.
As I said, we suggest you upgrade to TFS 2013 Update 4, In-place upgrade or migrate upgrade both are ok.
Note: make the full backup for your TFS Server databases before any upgrade or migrate operation.
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Connection between the test agent and test controller randomly drops.

Hi all,
I setup a test environment with the VS2013 IDE, test controllers, and test agents all on the same domain and I am experiencing random connection drops during test runs.
I am able to get a connection started between the controller and agents, but have not been able to get a stable enough connection to run a test suite of 3000+ tests.
I have added firewall exceptions for the default ports and turned to disabling the firewall on both the controller and the agents.
I installed and configured the controller/agents with the same admin account.
This account is in the TeamTestAgentService, TeamTestControllerAdmins, and TeamTestControllerUsers groups of the controller machine.
I am using Windows Server 2012 for the controller, and Windows 8.1 for the agents.
Here are the agent logs right before failure:
V, 2228, 30, 2015/05/01, 07:04:04.481, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
V, 2228, 26, 2015/05/01, 07:04:34.264, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
V, 2228, 13, 2015/05/01, 07:05:04.469, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
V, 2228, 19, 2015/05/01, 07:05:34.284, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
V, 2228, 24, 2015/05/01, 07:06:04.395, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
V, 2228, 18, 2015/05/01, 07:06:34.428, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
V, 2228, 37, 2015/05/01, 07:07:04.398, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is up.
I, 2228, 38, 2015/05/01, 07:07:34.400, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is down. Reconnecting...
V, 2228, 38, 2015/05/01, 07:07:34.400, WIN81-AUTO1\QTAgentService.exe, AgentStatusAggregator.ControllerDisconnected: Connection to controller server2012-2:6901 has been lost.
I, 2228, 38, 2015/05/01, 07:07:34.400, WIN81-AUTO1\QTAgentService.exe, AgentService: connecting to controller using uri: tcp://server2012-2:6901/ControllerAccessManager.rem
I, 2228, 38, 2015/05/01, 07:07:34.400, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 38, 2015/05/01, 07:07:34.479, WIN81-AUTO1\QTAgentService.exe, GetControllerObject : Controller Version : 12.0
I, 2228, 38, 2015/05/01, 07:07:34.541, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 38, 2015/05/01, 07:07:34.541, WIN81-AUTO1\QTAgentService.exe, AgentService: obj is Microsoft.VisualStudio.TestTools.Controller.ControllerObject
I, 2228, 38, 2015/05/01, 07:07:35.291, WIN81-AUTO1\QTAgentService.exe, AgentService: Connecting to controller. Using AgentName: WIN81-AUTO1 : Domain :
I, 2228, 38, 2015/05/01, 07:07:35.291, WIN81-AUTO1\QTAgentService.exe, AgentService: Failed to connect to controller. System.Net.Sockets.SocketException (0x80004005): No such host is known
Server stack trace:
at System.Net.Dns.GetAddrInfo(String name)
at System.Net.Dns.InternalGetHostByName(String hostName, Boolean includeIPv6)
at System.Net.Dns.GetHostAddresses(String hostNameOrAddress)
at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket()
at System.Runtime.Remoting.Channels.RemoteConnection.GetSocket()
at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
at System.Runtime.Remoting.Channels.BinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.VisualStudio.TestTools.Controller.IControllerCallback.ConnectAgent(String agentName, String machineName, String domainName, Boolean canPerformUITesting, String configuredUserName, String agentVersion, IAgentService agentObject)
at Microsoft.VisualStudio.TestTools.Agent.AgentService.ConnectToController(Boolean shouldThrow)
I, 2228, 25, 2015/05/01, 07:08:04.340, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is down. Reconnecting...
V, 2228, 25, 2015/05/01, 07:08:04.340, WIN81-AUTO1\QTAgentService.exe, AgentStatusAggregator.ControllerDisconnected: Connection to controller server2012-2:6901 has been lost.
I, 2228, 25, 2015/05/01, 07:08:04.340, WIN81-AUTO1\QTAgentService.exe, AgentService: connecting to controller using uri: tcp://server2012-2:6901/ControllerAccessManager.rem
I, 2228, 25, 2015/05/01, 07:08:04.340, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:08:04.371, WIN81-AUTO1\QTAgentService.exe, GetControllerObject : Controller Version : 12.0
I, 2228, 25, 2015/05/01, 07:08:04.386, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:08:04.386, WIN81-AUTO1\QTAgentService.exe, AgentService: obj is Microsoft.VisualStudio.TestTools.Controller.ControllerObject
I, 2228, 25, 2015/05/01, 07:08:04.871, WIN81-AUTO1\QTAgentService.exe, AgentService: Connecting to controller. Using AgentName: WIN81-AUTO1 : Domain :
I, 2228, 25, 2015/05/01, 07:08:04.871, WIN81-AUTO1\QTAgentService.exe, AgentService: Failed to connect to controller. System.Net.Sockets.SocketException (0x80004005): No such host is known
Server stack trace:
at System.Net.Dns.GetAddrInfo(String name)
at System.Net.Dns.InternalGetHostByName(String hostName, Boolean includeIPv6)
at System.Net.Dns.GetHostAddresses(String hostNameOrAddress)
at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket()
at System.Runtime.Remoting.Channels.RemoteConnection.GetSocket()
at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
at System.Runtime.Remoting.Channels.BinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.VisualStudio.TestTools.Controller.IControllerCallback.ConnectAgent(String agentName, String machineName, String domainName, Boolean canPerformUITesting, String configuredUserName, String agentVersion, IAgentService agentObject)
at Microsoft.VisualStudio.TestTools.Agent.AgentService.ConnectToController(Boolean shouldThrow)
I, 2228, 25, 2015/05/01, 07:08:34.341, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is down. Reconnecting...
V, 2228, 25, 2015/05/01, 07:08:34.341, WIN81-AUTO1\QTAgentService.exe, AgentStatusAggregator.ControllerDisconnected: Connection to controller server2012-2:6901 has been lost.
I, 2228, 25, 2015/05/01, 07:08:34.341, WIN81-AUTO1\QTAgentService.exe, AgentService: connecting to controller using uri: tcp://server2012-2:6901/ControllerAccessManager.rem
I, 2228, 25, 2015/05/01, 07:08:34.341, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:08:34.529, WIN81-AUTO1\QTAgentService.exe, GetControllerObject : Controller Version : 12.0
I, 2228, 25, 2015/05/01, 07:08:34.529, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:08:34.529, WIN81-AUTO1\QTAgentService.exe, AgentService: obj is Microsoft.VisualStudio.TestTools.Controller.ControllerObject
I, 2228, 25, 2015/05/01, 07:08:34.638, WIN81-AUTO1\QTAgentService.exe, AgentService: Connecting to controller. Using AgentName: WIN81-AUTO1 : Domain :
I, 2228, 25, 2015/05/01, 07:08:34.638, WIN81-AUTO1\QTAgentService.exe, AgentService: Failed to connect to controller. System.Net.Sockets.SocketException (0x80004005): No such host is known
Server stack trace:
at System.Net.Dns.GetAddrInfo(String name)
at System.Net.Dns.InternalGetHostByName(String hostName, Boolean includeIPv6)
at System.Net.Dns.GetHostAddresses(String hostNameOrAddress)
at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket()
at System.Runtime.Remoting.Channels.RemoteConnection.GetSocket()
at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
at System.Runtime.Remoting.Channels.BinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.VisualStudio.TestTools.Controller.IControllerCallback.ConnectAgent(String agentName, String machineName, String domainName, Boolean canPerformUITesting, String configuredUserName, String agentVersion, IAgentService agentObject)
at Microsoft.VisualStudio.TestTools.Agent.AgentService.ConnectToController(Boolean shouldThrow)
I, 2228, 25, 2015/05/01, 07:09:04.359, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is down. Reconnecting...
V, 2228, 25, 2015/05/01, 07:09:04.359, WIN81-AUTO1\QTAgentService.exe, AgentStatusAggregator.ControllerDisconnected: Connection to controller server2012-2:6901 has been lost.
I, 2228, 25, 2015/05/01, 07:09:04.359, WIN81-AUTO1\QTAgentService.exe, AgentService: connecting to controller using uri: tcp://server2012-2:6901/ControllerAccessManager.rem
I, 2228, 25, 2015/05/01, 07:09:04.359, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:09:04.531, WIN81-AUTO1\QTAgentService.exe, GetControllerObject : Controller Version : 12.0
I, 2228, 25, 2015/05/01, 07:09:04.546, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:09:04.546, WIN81-AUTO1\QTAgentService.exe, AgentService: obj is Microsoft.VisualStudio.TestTools.Controller.ControllerObject
I, 2228, 25, 2015/05/01, 07:09:04.937, WIN81-AUTO1\QTAgentService.exe, AgentService: Connecting to controller. Using AgentName: WIN81-AUTO1 : Domain :
I, 2228, 25, 2015/05/01, 07:09:04.953, WIN81-AUTO1\QTAgentService.exe, AgentService: Failed to connect to controller. System.Net.Sockets.SocketException (0x80004005): No such host is known
Server stack trace:
at System.Net.Dns.GetAddrInfo(String name)
at System.Net.Dns.InternalGetHostByName(String hostName, Boolean includeIPv6)
at System.Net.Dns.GetHostAddresses(String hostNameOrAddress)
at System.Runtime.Remoting.Channels.RemoteConnection.CreateNewSocket()
at System.Runtime.Remoting.Channels.RemoteConnection.GetSocket()
at System.Runtime.Remoting.Channels.SocketCache.GetSocket(String machinePortAndSid, Boolean openNew)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.SendRequestWithRetry(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream)
at System.Runtime.Remoting.Channels.Tcp.TcpClientTransportSink.ProcessMessage(IMessage msg, ITransportHeaders requestHeaders, Stream requestStream, ITransportHeaders& responseHeaders, Stream& responseStream)
at System.Runtime.Remoting.Channels.BinaryClientFormatterSink.SyncProcessMessage(IMessage msg)
Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Microsoft.VisualStudio.TestTools.Controller.IControllerCallback.ConnectAgent(String agentName, String machineName, String domainName, Boolean canPerformUITesting, String configuredUserName, String agentVersion, IAgentService agentObject)
at Microsoft.VisualStudio.TestTools.Agent.AgentService.ConnectToController(Boolean shouldThrow)
I, 2228, 25, 2015/05/01, 07:09:34.376, WIN81-AUTO1\QTAgentService.exe, AgentService: Connection to controller is down. Reconnecting...
V, 2228, 25, 2015/05/01, 07:09:34.376, WIN81-AUTO1\QTAgentService.exe, AgentStatusAggregator.ControllerDisconnected: Connection to controller server2012-2:6901 has been lost.
I, 2228, 25, 2015/05/01, 07:09:34.376, WIN81-AUTO1\QTAgentService.exe, AgentService: connecting to controller using uri: tcp://server2012-2:6901/ControllerAccessManager.rem
I, 2228, 25, 2015/05/01, 07:09:34.376, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:09:34.517, WIN81-AUTO1\QTAgentService.exe, GetControllerObject : Controller Version : 12.0
I, 2228, 25, 2015/05/01, 07:09:34.517, WIN81-AUTO1\QTAgentService.exe, ExecutionUtilits.UpdateRemotingCredentials Invoked
I, 2228, 25, 2015/05/01, 07:09:34.517, WIN81-AUTO1\QTAgentService.exe, AgentService: obj is Microsoft.VisualStudio.TestTools.Controller.ControllerObject
I, 2228, 25, 2015/05/01, 07:09:35.111, WIN81-AUTO1\QTAgentService.exe, AgentService: Connecting to controller. Using AgentName: WIN81-AUTO1 : Domain :
I, 2228, 25, 2015/05/01, 07:09:35.126, WIN81-AUTO1\QTAgentService.exe, AgentService: Failed to connect to controller. System.Net.Sockets.SocketException (0x80004005): No such host is known
Thanks in advance,
Erik

Hi,
To run automated test using MTM, there is at least one lab environment with at least agent one machine.
It is easy to configure standard lab environment than SCVMM lab environment.
I suggest that you could refer to this article below to configure lab environment and do tests.
# Essential Guide for Running Automated Tests from a Test Plan
https://msdn.microsoft.com/en-us/library/ff472576%28v=vs.110%29.aspx?f=255&MSPPError=-2147217396
Regards
Starain
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Test scripts and Test cases

Hi Team,
Kindly can you let em know what is the difference between Test Scripts and Test cases with example if possible.
Regards,
Vimal

Hi Vimal,
A test case is a set of conditions or variables under which a tester will determine if a requirement or use case upon an application is partially or fully satisfied. It may take many test cases to determine that a requirement is fully satisfied.
Test cases are often incorrectly referred to as test scripts. Test scripts are lines of code used mainly in automation tools.
Test script
A test script is a short program written in a programming language used to test part of the functionality of a software system. A written set of steps that should be performed automatically can also be called a test script, however this is more correctly called a test case.
Any test that is written as a short program is regarded as an automated test. Test scripts written as a short program can either be written using a special manual functional GUI test tool or in a well-known programming language (such as C++, C#, Tcl, Expect, Java, Perl, Python, or more recently, Ruby). Automated test tools can test many areas of system functionality such as the user interface, performance of the system, the system code and the requirements.
Automated testing has the advantage over manual testing in that it is easily repeatable, and thus is favoured when doing regression testing. This however is not always the case as automated tests may be poorly written and can break during playback. Since most systems are designed with human interaction in mind, it is good practice that a human tests the system at some point.
Test Script defines the actions and pass/fail criteria. For example, if the action is "to enter a valid account number," the expected result is that the data are accepted. Entering an invalid number should yield a particular error message.
Award Points accordingly.
Regards,
Kitchlu

Coverting an application from test executive to test stand.

I have used LabWindows CVI and the "test executive" toolkit to develop production test applications. The production operators who use the programs like the look and feel of the interface.
I want to convert to Test Stand so that I can support solutions written in languages other than CVI. How do I modify the test stand user inteface so that I get an identical operator interface?

Hi Tom,
You can also convert your CVI test executive sequence files into Teststand sequence files. Under the Tools menu in the TS Sequence Editor you will find a wizard that performs the task for you. It will take the CVI callback functions and generated the equivilant TS Callback sequence calls. You may still have to make some manual changes, but you wont have to completely regenerate your original test sequences from scratch.
Regards
Ray Farmer
Regards
Ray Farmer

Retreive Test Suite and Test Results in TFS 2013

Hi
My Colleague accidentally deleted Test Suite which contains Test cases with Test results. Is there a way i can restore those?
regards,
Vinay

Hi Vinay,
Thanks for your post.
There’s no default way/feature to restore test plan/test suite, as Guilherme said, you should restore the backup to do that. And you can refer to this article:
http://www.tfswhisperer.com/post/2012/10/10/So-you-accidentally-deleted-your-MTM-Test-Plan-Now-What.
We are trying to better understand customer views on social support experience, so your participation in this interview project would be greatly appreciated if you have time. Thanks for helping make community forums a great place.
Click
HERE to participate the survey.

Test Suites and Test Plans Question

We are using the TFS 2013 and in the Team Web Access, whenever I create a Test Plan, it creates a Test Suite with the same title. If I delete the test suite, next time I select the test plan in the test section of Team Web Access it creates another
Test Suite again with the same title as the Test Plan.
Why do we have this?
Is there a way to prevent this from happening?
Am I missing something?
Thanks.
YG

Hi Yves,
I don't find any public official document about the test suite that created with a test plan, what I mentioned is an explantation about the type of test suite. And it's not affect the testing or creating test cases/test suites/plans in team web access.
To organize test cases in a teat plan, you have to create test suites under the test plan and then use test suite to include test cases. Check this
page for more information.
Best regards,

How to assign test cases to test package and test catlog?

how to assign test cases(stwb_tc) to test package(stwb_2) and test catlog(stwb_1)?

Hi
goto to transaction stwb_1 enter the text and you will a get a screen now
goto to Menu
EDIT->Nodes->insert->As subnode
on the selecting you will get the option to add a test case (stwb_tc) or a test caltalogue.
Please reward if useful..

How to execute and test servlets

I wounder if smbd can explain me what software do I need to execute my servlet program. I'd like to test my first servlet on local machine. How to do that?
thnks

Erm to be more helpful...
Tomcat is a servlet container freely downloadable from Apache. You will find it here:
http://jakarta.apache.org/tomcat/index.html
with documentation on how to use it.

Test executive and Test stand deployment cost

Similar Messages

Maybe you are looking for