Automated Regression Testing

Apologies for putting a more advanced question in a general forum but there is no Topic for QA/Testing (that I know of).
Okay, I've been tasked with finding a solution for fully automated unit, component, system, and regression testing. I realize that sounds like a tall order and can't truly be done. However, I'd like to get as close as possible to being able to test every aspect of our system and thought I'd post to the community for ideas. We have a typical multi-tiered web app. We have a web interface, business logic on the server-side, Web Services, DAO, etc. Naturally, some combination of testing needs to be performed. So I suppose that first I need to make a list of all the (general) types of testing that can be done. So far I have:
- syntax validation
- link checking
- unit testing
- record and playback (robot user for web UI)
- custom scripting (for anything I can't buy a tool for)
- performance monitoring & stress testing
- security testing
- etc.
So I guess my first question is: What other types of testing am I missing here? I honestly think I'll end up with 2-3 sets of tests that hopefully give me good testing coverage. The end goal is to have a nightly build that includes a series of tests which generate reports. So in the morning someone can open the reports and see if anything's really busted. So basically, after the build finishes, the tests should be kicked off. I'd like to use Ant for this but I suppose a cron job could be written or whatever. I'm not worried about that right now.
Anyway, I don't have very specific requirements yet but I'm thinking of breaking my work up into unit, component, and system level testing. My initial thoughts are that I'd need:
1. Unit Testing - Ant would simply kick off all the JUnit tests we have available. This would do basic class level testing and validation.
2. Component Testing - Custom Java code/scripts that would tests some specific functional area. This is open ended in my mind as I'm not that familir with the codebase yet. But an example would be "register a user" or "make a reservation".
3. System Testing - Needs to simuilate a user hitting the web interface and would invoke all tiers. So I'm guessing I need to buy some software product to fill out forms automatically and whatever else.
Can you all let me know if there's anything major I'm missing? What methodologies or tools do you recommend? Any links on good tech articles regarding this? Anything comments or feedback welcome.
Thanks in advance!

I'd recommend adding automated acceptance testing to the list of things to consider. Example:
http://fitnesse.org/
~

Similar Messages

Automated regression tests on Oracle*Forms

Hi all,
We're looking for a toolset that allows automated regression tests (record/playback) on an Oracle Forms GUI. Something like QuickTest*Pro (previously Winrunner).
Anybody having experience with this ? Thanks for sharing it.

Check tool called DataLoader
http://www.dbload.com/

Regression testing on PDF output files from Reports?

My current client is looking to do more automated regression testing of the output (content) of their reports, most of which are output from Reports6i into Adobe Acrobat PDF file format. Is anyone currently using or aware of a tool (QARun, WinRunner, etc.) that will do this? (Most of the tools can do a binary comparison of the PDF files that were output, but we need something that will look into the PDF files themselves and tell us where any differences are found in the actual content (text) of the report itself.)
Thanks in advance for any info anyone can provide!
- Bill

Dear Nick,
Just ensure a printer is configured. This can be done by typing in echo $PRINTER at the $Prompt.
If it returns null then configurea printer and i fell this should resolve your problem,
Since it did resolve my problem.
<BLOCKQUOTE><font size="1" face="Verdana, Arial">quote:</font><HR>Originally posted by Nick Mavrakis:
I am having some trouble getting pdf output in the unix environment from Reports 6i.
If I kick off a defined report file (.rep) from the command line as follows:
rwrun60 testreport.rep destype=file desformat=pdf desname=testreport.pdf userid=connection_details
I get the following errors:
REP-0004: Warning: Unable to open user preference file.
REP-3300: Fatal error in toolkit.
UI-9: This function call is out of context
If I run the command without the file output options (rwrun60 testreport.rep userid=connection_details) then the report opens up on the screen correctly. From here, if I try to generate a pdf file, I get the following error:
REP-1800: Formatter error.
The report is defined as character type, and is a simple listing of approximately 50 records from a database table. There are no graphics or any pl/sql defined in the report.
Has anyone had similar problems in trying to do this?
Any help is greatly appreciated.
Cheers
Nick<HR></BLOCKQUOTE>
null

Is Ecatt a Regression Testing Tool?

Hi,I am New to Ecatt.
Generally a Testing tool is Used For RePitative or Regression Testing.
In Sap it is not possible ans\d i have to enter the Customeror vendor etc each time i run the script.
Then How come this is called a testing Tool?
Pl Clarify,
Thanks

The Web Application Server 6.40 is part of NetWeaver 2004 and it contains CATT and the successor tool eCATT.
Note that it is no longer possible to create new automated CATT test cases in Web AS 6.40 - SAP is gradually phasing out CATT in favor of eCATT.
In eCATT, you can continue to call existing CATT test cases. There is also a migration function that allows you to convert existing CATTs into eCATT tests. If you are a SAP Professional Journal subscriber, you can read about this feature in the September/October 2003 edition.
For more information on eCATT, search "eCATT" on SDN - you'll find last year's TechEd material. Also check out http://service.sap.com/eCATT and the documentation at
http://help.sap.com/saphelp_nw04/helpdata/en/20/e81c3b84e65e7be10000000a11402f/frameset.htm
Technical questions and discussions on eCATT and other test tools are starting to catch on in the SAPGUI forum.

How to do Regression Testing in XI

Hello:
We are doing some patch upgrade for XI from SP13 to SP16 and we are planning to do some regression testing in Dev, then in QA and then in Prod. Are there any steps to take or is there any blog or PDF, links on how to do such regression testing? We have quite a lot of active interfaces.
Thanks.

Yes ,you are right.
If you upgrade new SP, first you need to check is the SP is upgraded correctly. For this you can check SP versions in ABAP stack and J2EE stack.
Next , you need to check the new features of the new SP. This you need to go manually to the atleast some adapters and you can check the features.
SM59 etc are part of Post Intsallation. So this is not required at first site. But it is better to do Readiness Check. These are consider as Regression testing for XI when you are upgrading/Moving the systems into different environment etc.
Atlast you can test end to end scneario to check the availability of Monitoring component.
These things our team has done .
Regards,
Moorthy

Regression test for Controlling area and assets

Hi,
Friends
We are up grading from version 4.7 to ECC 6.0 .In this case we have to do regression test . May i know what are the topics should be tested .Could you give me a brief explanation including the transaction codes.
Waiting for you information
Thanks in advance
Best regards
Medha

Hi
Doing a process oriented testing will be the right apprach.. i.e. Procure to Pay, Order to cash, Manufacturing scenario and month end process of variances, WIP and settlement, payments, With holding tax filings, excise returns, executing your key reports, etc
This way you can be more than sure that the up-gradation is doing its job
Ajay M

ECM - How to open Review for Regression Testing on a regular basis

Hi,
We have implemented ECM for a large corporation that wants to run weekly regression testing on the application (including Portal functionality). A problem occurs with the review period as it is set to the month of August (in table T71ADM08) however to be able to test the application we need to be able to open the review in the testing environment.
Has anyone had similar experience? We would like to avoid the need to transport changes through on a weekly basis opening and then closing the review. The best solution at the moment seems to be creating a custom program that will enable the testers to open and close a review directly in the testing environment.
Any suggestions?
Many thanks,
Kelly.

Hi
For dynamic files you can;
1. either do the DDL on the external table to point to the file with the changing name
2Copy the file to a fixed name before using the external table/maps
3. Use the preprocessor to cat/pipe these files for the external table. See the post here http://blogs.oracle.com/warehousebuilder/2009/06/file_staging_using_external_table_preprocessor.html it shows using gunzip but could simply be doing 'cat' on a bunch of files to standard output
Cheers
David

[svn:bz-4.x] 16147: Fix a few more regression tests on the 4. x branch that were failing when using Spring integration.

Revision: 16147
Revision: 16147
Author:   [email protected]
Date:     2010-05-17 06:18:38 -0700 (Mon, 17 May 2010)
Log Message:
Fix a few more regression tests on the 4.x branch that were failing when using Spring integration.
Modified Paths:
    blazeds/branches/4.x/qa/apps/qa-regress/WEB-INF/src/runtimeconfig/remoteobjects/ROMessage Destination.java
    blazeds/branches/4.x/qa/apps/qa-regress/WEB-INF/src/runtimeconfig/remoteobjects/RuntimeCo nfigurator.java
    blazeds/branches/4.x/qa/resources/webtier/flex_sdk_4/flex-config.xml

Well heres my story. I tried kde4 from extra the last 3 weeks and I like it. I have used xfce for the past 3 years, previous to that gnome. Tried kde but never really liked it. Now I am only using workspace, base, mutimedia and graphics.
Here is what I like.
1- Dolphin, awesome I have used thunar a while and it is great but I love splitview, and fish for ssh (which has been around a while I know), and the ability to mount other partitions on my hdd with a click no fstab entry or nothin'.
2-Pretty, I've used xfce with built in compositor an love the snappiness. But I like desktop grid with kde4 and flipswitch. Compiz-fusion is cool but I prefer not to use I'll take what the DE gives. Plasmoid are cool too.
3- Gwenview is nice too. Use to use gqview, but thumnails are nice.
Looking forward to or lacking
1- Keyboard shortcuts, Yes xbindkeys is there but if I have a DE I want it to do it. They just don't work now.
2- kde4 has windows specific settings, but I can't set the opacity for particular windows , doesn't work.
3- Ram of course is much higher in kde4, but maybe I'm getting old I just don't care as much.

Automated Unit Tests / TEST-INF/testrun.xml

Hello!
Regarding to the originial question here Re: Automated Unit Tests through NWDI / Purpose of testrun.xml I'll try to ask this question again:
Is it possible to run jUnit-Tests automatically during the build (cbs)?
A very promising looking file (testrun.xml) is not documented..
We're using the NWDI and CE 7.11.
Testdriven development isn't a new paradigm in the standard java development so it must be possible to do so with ce and nwdi.
Thanks in advance,
--cl

Hi Carsten
I guess that the testrun.xml allows to do exactly that you want - to run jUnit-Tests automatically during the build (CBS).
Though there is one small thing - I think that the tool which can understand the file and run the tests is SAP internal tool. So I doubt that having just pure CBS server it'll be possible to activate the automatic test execution process. It seems we need to have something more.
I also could not find any documentation regarding this on SDN. That's why I think the functionality is SAP internal.
BR, Siarhei

Automated GUI testing

Hey,
I'm developing an application using UI5 and I'm currently looking for a tool that allows me to record automated GUI test cases.
Usually we are using HP QuickTest for that purpose but it seems not to support UI5.
Can you recommend me any Software that actually does support UI5 and can create automated GUI tests?
Thanks!
Regards, Timo

Hi Timo,
this is not my main expertise, but UI5 development internally also uses QTP. Maybe with additional plug-ins.
But we are moving towards Selenium for UI tests.
qUnit mentioned above is a code-based unit-testing tool which comes from jQuery and is also heavily used. The official documentation and some of our example test pages *.qunit.html should make it easy to write your own tests. But it's not really recording UI interaction.
Regards
Andreas

Simple test suite for regression testing

Hi,
I was wondering if anyone has a simple test suite available.
I'm after these main areas:
1. arbitary script lanching (or just firing off ud32 files)
2. database comms (inserting test data, extracting final status)
3. comparison (ala diff) for regression tests.
I have knocked out a partial (i.e. not 100% finished!) one myself in perl, but was wondering what else other people have created .
i'm Looking for insparation / use what has already been done!
Thank in adavance,
Wayne

Subclass the test case itself, and have a factory method to return instances of the correct class you wish to test, or, use a protected instance variable to put it in
e.g
public class TestMyClass extends TestCase {
   public MyClass getMyClass() {
     return new MyClass();
public void testSomething() {
       MyClass myClass = getMyClass();
       assertTrue(myClass.isWorking());
public class TestSubclass extends TestMyClass {
     @Override
     public MyClass getMyClass() {
        return new Subclass(); // assume this extends MyClass
     // all the superclass test methods still get run
}or
public class TestMyClass extends TestCase {
protected MyClass myClass;
public void setup() {
    this.myClass = new MyClass();
public void testSomething() {
       assertTrue(myClass.isWorking());
public class TestSubclass extends TestMyClass {
public void setup() {
    this.myClass = new SubClass();
     // all the superclass test methods still get run
}

Wht is Regression Test?

Hi Experts,
Pls. let me clarify the Regression test? I hv seen it, after hitting the F8 of a FM and even I tried it, then I got some records in my_table of my_FM.
So, pls. let me know,
1 - Wht is Regression test?
2- When we hv to use it?
3-Other than FM, still Where can I see it?
ThanQ.

Hi Srikhar,
Have a look at this link.
http://www.thespot4sap.com/Articles/SAPImplementationRisks_11.asp
Reward if useful.
Thanks
Aneesh.

Enviroment to Regression Test

Hi,
We are configurating ChaRM in Solman 7.1 SP8.
Ours landscape initial was DES - QAS - PRE - PRD. We had tha plan to do the regression test in PRE production system.
But, we have the need of to create and to release the request in PRE production system.
We want to send to PRD only one request with all deliveries of the period.
Its is possible to execute regression test in PRE ?
Thank you for you attention.
Adriana

Hi Prakhar,
Thank you very much for your attention.
My need is to create a new request with objects lists from multiple requests. Those requests are going with status "test okay".
I don´t like send all individuals request to PRD.
To do this process, we need create and delivery a new request in PRE production enviroment.
Now, we define a new landscape with DEV-QAS-PRD and the ChaRM will control only those enviroments. The fourth enviroment was out of the logical componente.
At the moment, it problem was solved.
Best regards,
Adriana.

BW 3.1 to BI 7 Upgrade Non Regression Tests

Dear All,
I am planning a BW 3.1 upgrade to BI 7.
I need to focus on Non-regression tests. In others words, I would like to know what kind of non-regression tests I will have to do to confirm the UAT.
I am not talking here about post-upgrade activities (technical stuff). I am more focused on the current modelisation that has been upgraded (still in 3.x thought).
So far, I identified the following:
__Full Load tests__
By loading a specific month data scope - before and after upgrade - I can confirm the data load processes through the cubes and ODS.
Delta Load tests
I do not know how can I do this (how can I ensure that my R/3 will not change ...)
Queries
I can select some of them to ensure they are still working ...?
What can we have more in the non regression tests?
Thank you for your help
chris

Hi guys
Any thoughts?
Thanks,
Chris

Automated BPEL Testing

Automated BPEL Testing
(on 10.1.3.2)
I have created a set of Unit tests for our BPEL processes which deploy with no problems. From within the BPEL console they work fine.
When I try to automate the testing (ideally so we can implement continuous integration) by running the test target of JDevelopers autogenerated build scripts (the same script I use to compile and deploy the process and to deploy the test).
I have come across two problems:
Firstly if I try to run the tests from a domain other than default (a neccessity in my environment) I get a message along the lines of:
ORABPEL-02178
Process not found.
The BPEL process "XXXXXXXX", revision "1.0" has not been loaded. Either the process was not initialized properly or the process has been disabled.
Please consult your administrator regarding this error. The application server logs may provide more information regarding this error.
If I deploy and run from the default domain the ant target is successful but the generated report indicates that 0 tests were run (there are 3 tests actually deployed).
Information on the web and forums seems very sparse but possibly it has something to do with the values of bpeltest.callhandler? What other properties effect the unit test?
Regards,
John

I know this problems too and there a two bugs in metalink but not fixed yet.
1) ant task bpeltest seems to work only on default domain (see BUG 5936230)
2) no test-results under windows (on my unix box it works fine for me) (see BUG 5872799)
Regards, Harald

Automated Regression Testing

Similar Messages

Maybe you are looking for