A/B Testing Approach

Hello,
I'm trying to come up with an A/B testing approach for an AIR desktop client app. I realize that the Google Web Optimizer way is not applicable here...
Can anyone provide a suggestion in terms of approach to this? Does anyone know of any resources and tools for A/B tests in AIR apps?
Can minor changes be triggered on click by pushing from server to client? Would I need to have different builds (A & B) in order to see what UI component(s) works better?
Thanks,

Hi Linda,
A-B testing (split testing) is not natively supported in 11.5.10 or R12 of iStore.
Regards,
Bob

Similar Messages

Unit Testing approach

Hi,
We had done technical migration of value based roles to derived roles, and facing problem to design the unit testing approach for the same. can you please suggest what must unit testing approach and how to create test cases for authorizations specificaly to derived roles created from value based roles ?
goal is after testing, end users should not feel any changes done in roles approach.
Thanks.
Regards,
Swapnil
<removed_by_moderator>
Edited by: Julius Bussche on Oct 7, 2008 3:40 PM

Hi Swapnil,
The Testing of Security roles need to be taken in a two step approach
Step 1 Unit Testing in DEV
A. Prepare the test cases for each of the derived roles and ensure that your main focus is to see if you are able to execute all the tcodes that have been derived from the parent role with out authorization errors. You also need to verify if each of the derived roles are applicable to those respective Org level Values.
B. Because there will not enough data in DEV ( except In some cases where you have a refresh of fresh PROD data) it is always advisable to do the actual testing of the roles in QA. The goal here is to see if you are able to perform a dry run of all tcodes/Reports/Programs that belong to the roles.
C. You may create fewer Unit test ids as you only assign one ID with one role and once the role is tested you can assign the same ID to another role.
Step 2 Integration Testing in QA
A. Prepare the Integration Test cases for each of the Derived roles. Here most likely the testing will be performed by the end users/Business Analysts in that respective Business Process. Each test case must reflect the possible Org level Authorization Objects and Values that need to be tested.
B. As Integration testing is simulation of actual Production authorizations scenario, care must be taken when creating mulitple Integration test user ids and assigning them right roles and send the ids to the end users to perform the testing in QA.
C. The objective here is that end user must feel comfortable with the test cases and perform both Positive and Negative testing. Testing results must be caputured and documented for any further analysis.
D. In an event of any authorization errors from Integration testing, the authorization errors will be sent to the Security team along with SU53 screenshots. The roles will be corrected in DEV and transported back to QA and the testing continues.
E. Also the main objective of Integration testing would be to check if the transactions are reflecting the right amount of data when executed and any mismatch in the data will be direct implication that the Derived roles do not contain the right Org level values.
Hope this helps you to understand how testing of Security roles (Derived) is done at a high level.
Regards,
Kiran Kandepalli.
Edited by: Kiran Kandepalli on Oct 7, 2008 5:47 AM

EBS test approach

Can anyone elaborate: when performing tests in EBS testing module's functionalities that can span over months (even years) how do you test it in a short period of time? Do you change app server/db dates on the servers to speed up time or is it better to adjust APPS calendar to suit the available test period (hour=month), so for example if you have to wait for a month in real life you only wait for an hr in the test environment..?? What is the common approach?
Any help would be appreciated! thanks...

Hi;
Please follow below
ebs-demo
Where can I find EBS 11i software for practice -- looking for ebs 11.5.10
I belive it will answer your question
Regard
Helios

ChaRM: extended test approach

Hi!
We would like to extend the ChaRM test function as follows:
the appropriate Developer should have the possibility to log on on QAS-system and execute the test.
This should be done before the UC/NC has been released.
Has some one any idea how to implement this approach?
(Customizing, definition of new status of UC/NC)
Any helpful information will be very appreciated!
Holger Thomasson

If the Extended test says your drive is bad, believe it. My brother has a G5 iMac. Everything passed Extended tests when new. After a few months strange things started happening to the file system (e.g files randomly disappearing). Disk Utility showed no errors. S.M.A.R.T. verified. Hardware Quick Test passed. Hardware Extended Test showed bad mass storage. Apple suggested Erase with zero option. Still failed Extended Test. When I called them back and gave they error codes from Extended Tests they sent a new drive (Maxtor @%)GB, same as original). It passed Extended Tests and there have been no problems since then.
When you get a new computer it is a good idea to run the Hardware Extended tests, even if everything seems to be working. Then you will know that if it does show an error later, something has gone bad, and it is not just normal behaviour of the test program.

SAP Carbon Impact Testing Document

Hi,
I am currently working on SAP Carbon Impact. I am just preparing the testing documents for SAP carbon impact report. I am confused about the contents of the testing document. What should be testing criteria for a SAP cabon impact report and what will be there in the testing document. I also want to know about the test cases that can be used to test the report. please guide me through the process. If you have any document regarding this ....Please forward me.
Regards,
Vikash
Edited by: vikashkumar303 on Sep 15, 2010 10:45 AM
Edited by: vikashkumar303 on Sep 15, 2010 10:46 AM

Vikash:
I'm sorry, but your question on testing is very general. And asking to have help documents forwarded to you is, well, unhelpful.
A general "testing" approach is to establish customer metrics first. Do you want to test the validity of data submitted or collected? In other words, are you asking about testing for audit purpose, or are you asking about repeatable, scientific testing to verify carbon emissions from a specific business?
Jim Spath
SAP Mentor
SCN Moderator
etc.

Need information on open source testing tools for ADF web applications

Hi experts,
I need to investigate on new feasible open source Java testing tools for testing ADF web applications. I have tried to google a lot but getting confused.
My requirements as as under:
1. The tool must be open source.
2. It should be easy to understand and to work upon by the tester and developers.
Selenium based testing approach is already in place for testing the application but need to search for tools other than Selenium which shall prove suitable for testing ADF applications. Kindly let me know your inputs / suggestions.
Thanks a lot in advance.
Neelanand

Hi,
Have a look at JMeter http://jakarta.apache.org/jmeter/index.html
1. The tool must be open source.It is.
2. It should be easy to understand and to work upon by the tester and developers.I guess it is.
There are some specifics in configuring it for ADF, but Chris Muir wrote a nice blog about how it's done, check it out http://one-size-doesnt-fit-all.blogspot.com/2010/04/configuring-apache-jmeter-specifically.html
Pedja

SAP Testing Document

Hi Gurus,
Could you please share documents of CATS and SAP Testing.
Regards
Srinivas Reddy Mallepally

Vikash:
I'm sorry, but your question on testing is very general. And asking to have help documents forwarded to you is, well, unhelpful.
A general "testing" approach is to establish customer metrics first. Do you want to test the validity of data submitted or collected? In other words, are you asking about testing for audit purpose, or are you asking about repeatable, scientific testing to verify carbon emissions from a specific business?
Jim Spath
SAP Mentor
SCN Moderator
etc.

Testing of Workflows:Upgrade

Hi All,
We are upgrading from 4.7 to ECC 6.0.With respect to workflows, we would like to know
1. What should be the testing approach for workflows in the upgraded environment (do we test the workflow from end-end or test by bringing a workitem to logical closure which was active in 4.7 version).
2. What are the possible areas of workflow which may be affected or need to be checked due to the upgrade.
3. Any other steps / criteria that are to be considered for testing the workflows in the upgraded environment.
Please advise on these points.
Warm Regards,
Lavanya.

Hi,
Check this [Thread1|Re: Workflow Upgrade; & [Thread2|Re: Issues in Workflow before/after Upgrade;.
Regards,
Surjith

Payroll Tester

Hi Experts,
I have got a project with job description as below-
u2022 Strong test management experience with Payroll testing in SAP
u2022 Used to participate large testing teams of more than 15 members
u2022 Exposure and understanding of several payroll countries legal & compliance requirements and impact on payroll testing/execution
u2022 Global payroll testing with Quality driven characteristics such as zero tolerance to defects and adhere to agreed testing approach/strategy
u2022 Execute and monitor progress during each test cycle to ensure that the full Payroll application is tested u201Cend to endu201D and accurately validated
u2022 Provide testing status updates to CIT Test Lead
u2022 Proactively report/resolve all testing issues and risks and identify any potential gaps.
u2022 Support the adherence to rigorous exit criteria for each test phase HRS CIT is accountable for executing and sign off
u2022 Execute defects resolution and actions proactively and effectively
As I haven't worked as a tester earlier what kind of scenarios and tools should be used. I have been involed as a Functional consultant but this would be my new project. Could you please give me some detailed information on the same.
Any information with regards to the position would be appreciated.
Regards

Why do not you terminate the employee using application standard functionality.
Regards,

Authentication with UME separation of front end and back end

My webdynpro project has 2 application. One for Admin one for Rating.
Is it possible to create a java class at Webdynpro level and share it between the 2 applications?
Why the need?
Created a custom class (lets called it CommonEJB), to point to the right pages and set of UI controls after the initial login with UME. This class utilizes the IWDClientUser.getSAPUset() method to get IUser object.
If it is not possible to create a java class at Webdynpro, then this ejb will need to be deployed to the backend.
Putting it at the backend is not good as security wise, its always better to separate the authentication between front and back end.
Any ideas/solutions?
thanks

s0003358504
au-?Krup
LDAP
==============================================
Computer Associates Int'l [eTrust Directory]
Critical Path [CP Directory Server (CP DS)]
Microsoft [Windows 2000 Active Directory Server]
Microsoft [Windows 2003 Server - Active Directory]
Netscape Communications [Netscape Directory Server]
Novell [DirXML Driver for User Management]
Novell [Novell DirXML Driver for SAP HR/PA]
Novell [Novell eDirectory]
Oracle Deutschland [Oracle Internet Directory (OID)]
Siemens [DirX Directory Server]
Siemens [DirX Extranet Edition]
Sun Microsystems [Sun Java System Directory Server]
     Test Objectives
     Testing Scope
     Test Approach
     Test Environment
     Test Data
     Entry / Exit Criteria
     Risks
     Schedule and Resources
     SIT Deliverables
     Test Planning Source Documents
Well, i wish to create a java class that can separate the view areas depending on their login.
lets say you're a manager, u can see certain views. and if you're a supervisor u see another. This is achieved using the java class with information from getSAPUser() position. After retrieving the position, using the java class will programmatically assigned the appropriate views, buttons, tabs etc.
so this class need to in front end, and not back end. problem is we have 2 application.
if the class is created front end in one application can it be shared with another.

I use multiple libraries with itunes - should I create a new library for a 2nd iphone

I use multiple iTunes libraries to manage multiple devices from the same PC. I'm purchasing an iPhone 6 and currently have a library for my iPhone 4. Would I create a new library for this new device? Also, to restore all content to my new phone, Will this restore be done from the existing iPhone 4 library? Is this process documented?

I can't address specific issues regarding iPhones, but in general you can manage multiple iDevices from a single iTunes library. The test approach is to maintain one or more playlists for each iDevice you use, and configure the latter to sync only from the relevant playlists:
This article: Transfer content from an iPhone, iPad, or iPod touch to a new device - Apple Support documents Apple's guidance regarding transferring content from one iOS device to another.

Upgrade to 9.2.0.8

Hi everyone,
I have an oracle 9.2.0.1 running on AIX 5.3 ML 4 64-bit.
I am trying to upgrade it to 9.2.0.8.
Does anyone have a tested approach to this? Some kind of problem?
Thanks.

Now don't tell us that you are going to update your production system directly.
Does anyone have a tested approach to this? Some kind of problem?Do you really want to believe what other says? The best way is to configure a test box and apply the patch there and start testing your whole apps on that box. Give it some good time before putting this in production.
Daljit Singh

Problem during Upgradation from 9.2.0.6 to 9.2.0.8 in production.URGENT!

Hi ,
Let me give you some background..
we were sailing well with our 9.2.0.6 version in Sun 64 SPARC for our Data Warehouse till we hit what is called one million bug!! Segement and extent does not match!! In order to get rid of it we decided to upgrade our Production database from 9.2.0.6 to 9.2.0.8.We tested first in Stage and it was running fine all our ETL job was running without any issues.Then we tried changing some parameter as given below
Parallel_automatic_tuning set to false
parallel_max_server set to 64 from 160.
After making this change we hit a bug in stage which we resolved by applying the patch 5523799.This bug says that oracle gets hit with
ORA-600 [KCBGTCR_3] AND ORA-600 [KCBGTCR_12] WHEN DOING OWB MAPPING
But in production even with this patch applied we are unable to make select count(*). One mistake what what we did,which makes the stage and production processes different is that while making parameter changes in production we changed
parallel_max_server set to 64 from 160 keeping
Parallel_automatic_tuning set to true!!
Then we truncated a Master table with 8 million rows through a job before we realized the mistake.But now nothing is working!! Do you have any idea how to fix the issue.
If you need anymore information please let me know.
I appreciate your helping hands.
AD

First off, note that a number of folks around here intentionally avoid posts marked "urgent"-- that's generally considered impolite. Others avoid threads that are cross-posted in multiple forums. Either of those could slow down responses...
What does "unable to make select count(*)" mean? Are you getting an error in prod? Is it the same error you're getting in staging?
Normally, urgent production issues, particularly those that seem to be related to a particular Oracle bug, need to be dealt with by Oracle support. Unless someone here happens to have dealt with this very particular scenario, the best we could do would be to try to read the same Metalink notes you're probably already reading to try to come up with suggestions. In the end, though, it's likely that Oracle Support will need to be involved to figure out what the safe options are.
Also, please understand that we're all volunteers here, so certain types of issues are just outside the scope of what anyone here is likely to be able to help with. I'm more than happy to spend hours reading Metalink notes, building test systems, and testing approaches to resolve issues for a client when I understand the systems in place (and where my hours are billable). I, and most of the other folks around here, can't generally commit that sort of time for free to resolve very specific errors on production systems we don't understand. Even if we had the time, OTN isn't an ideal forum for the sort of back-and-forth that would be necessary before anyone could responsibly suggest changes to make to a production system.
Of course, someone may come along that has hit exactly the bug you've hit and happens to know of a quick and easy solution. If there is no Metalink note that is directly on point, though, I'd tend to doubt that the perfect person will come along, certainly not in the very near term.
Justin

Error trying to run "Measurement and Automation"

I recently purchased a PCI-6014 DAQ in an attempt to save time but along with many others we've exprerienced nothing but problems with it, including problems with the board itself and now with the NI-DAQ software. My most recent problem, which I've unsuccessfully tried to debug is an error message when trying to access "Measurement & Automation" as follows: "The instruction at 0X73DD8789 referenced memory at 0X04781D70. The memory could not be read. Click OK to terminate the program". Any suggestions or should I cut my loses and move on to another test approach as I'm already far behind schedule?

Hi cmm-
What type of operations are you trying to perform when you run into this error? It sounds like your NI-MAX installation may have become corrupted. I would suggest reinstalling NI-DAQmx 7.5. This driver install will install full support for your board as well as the newest version of NI-MAX to make sure that all files are up to date and uncorrupted.
You should first uninstall any versions of NI-DAQ and NI-MAX under the "National Instruments Software" section of Add/Remove Programs in the Control Panel. Have you had any luck in attempting to access the software on another machine or with other NI DAQ cards?
Please give these suggestions a try and let us know if you are still seeing problems.
Thanks-
Message Edited by Tom W. on 09-01-2005 01:36 PM
Tom W
National Instruments

SAP Query - material costs split by labour/ingredients

Hi,
Is it possible to create a SAP query to show the following;
Material / Lab unit cost / Material lab cost
I'd also like to be able to select r show 1 or 2 cost variants.
I essentially need a list of materials and their costs broken down into their constituent parts.
How can I do this please?
Thanks

Hi Commandante
You can not have WIP split in the FI GL accounts.....
However, there is a work around possble which can give you the break up in report
You need to do small tweaking to get WIP by cost component
1. Define as many LINE IDs as your cost components in OKTZ
2. For eg: If you have cost components like raw material, packing material, labor, machine cost.... then define similar LINE IDs and do the relevant configuration for WIP as per these line IDs.... Assign the specific cost elements in WIP config instead of masking....
3. Assign cost comp str in OKN0 and choose product group = Material Group.. Transport it to production
4. Run KKRV to collect the data
5. Now run the WIP reports in KKO0
When you execute your KKO0 reports, WIP would be with the same breakup as your cost components
This is a tried and tested approach!!
Regards
Ajay M

A/B Testing Approach

Similar Messages

Maybe you are looking for