Data Cleansing Terms Clarification

Folks,
Another question and thanks again to all those that have been helpful so far.
In a data flow that I am building I have both customer information and address information. I plan on running my data both through an English base data cleanse and a Canada address cleanse.
I notice that there are many options for the same output field. The difference being the generated field class. I am confused as to what is the difference between Parsed and Standardized in regards to the base data cleanse.
Also I am confused that there are extra types such as alternate or none. Also in dealing with address cleansing there are other items such as generated field category and generated field addrclass which also seem to have an impact on the data that is output from these transforms.
I would like my transforms to correct error data and also if it is possible add items such as city or province when they are missing based on the postal code which is there for example. I have gone through both the designer guide and reference guide in regards to these terms, it has left me more confused than anything.
Which way of implementing this would be the best.
Thanks in advance,
Bill
Edited by: William Grdovich on Oct 5, 2010 4:13 PM

Bill,
I notice that there are many options for the same output field. The difference being the generated field class. I am confused as to what is the difference between Parsed and Standardized in regards to the base data cleanse.
Parsed means that the address has been separated into its components (house numnber, street name, city, etc). Standardized means that the address has been parsed, and each component value has been corrected, updated or enhanced.
Also I am confused that there are extra types such as alternate or none.
An altenate type means that an alternate value is available. For example, in New York City, 6th Ave (the official name) is also known as Avenue of the Americas (the alternate name). If a field has type 'None', it means that there is only one type associated with this field.
Also in dealing with address cleansing there are other items such as generated field category and generated field addrclass which also seem to have an impact on the data that is output from these transforms.
A description of the field category columns is provided in the SAP Business Objects Data Services Reference Guide, Data Quality Fields, Global Address Cleanse fields.
I would like my transforms to correct error data and also if it is possible add items such as city or province when they are missing based on the postal code which is there for example.
Use Generated Field Class 'Best', Generated Field Category 'Component, Generated Field Addrclass 'Official'. If your selected output field has Generated Field Class 'None' then use Generated Field Category 'Standardized'.
Paul

Similar Messages

Baseline Date of terms of payment

HI,
I need some help with something, how i can enter the baseline date of term of payment manually? I see in the OBB8, that appear 4 option of baseline date, but not manually.
Is there any configuration in SD that prompts this action?
please give me your answer with detail, i new in this.
Thankz,

Hi Ryan,
in the default for baseline date - select No default.
while creating a sales order you can enter the date on which baseline date should be considered for calculating the payment terms days. this field is avaiable in Billing Tab of Sales order at Header level and Item level.
Please let me know, if you more clarifications.
thanks
rajam

Data Cleansing in CRM Web UI

Dear Experts,
I have activated Data Cleansing in CRM 7.0 and it is working.
Can anyone advise on the setting or configuration required to get the CRM Data cleansing functionality to copy communication data stored at the relationship from the Source record to the Master record.
Example:
Company A has a relationship with Contact person A - this relationship has a mobile number and email address maintained.
When merging the account of Company A (source) with a duplicate company A1(master), we need to copy the relationship (already occurs) between Contact Person A and Company A and the relationship level mobile number and email address to the master account which will be company A1 (this does not occur).
Currently the relationship level communication data is not copied.
Please provide step by step config settings to enable this. I already have the SAP Notes on Data Cleansing and have covered all WIKI's on the web. What i need are specific steps to overcome this issue.
Thanks!!!

In order to transfer communication data maitained at the Contact Person relationship level, you have to maintain the required node in transaction BUSWU02: BUP115 Contact's Work Address and BUP120 Contact's Communication Data
If data is still not transferred, SAP has released notes: 1243559, 1491950, and 1493240. to resolve. Check the relevance before implementing.
FK

How can i store data in term of a tree structure

how can i store data in term of a tree structure

What a tree is the question. If you just want a fast access, ehats about Hashtable or dictionary classes ? The data there is structured in a tree. For a simple binary tree, you can use something like
class Node {
Node(Object data){
   Node left;
   Node right;
   Object data = data;
void insert(Object data, Node parent){
int test = data.compareTo(parent.data);
if(test < 0 ){
    if(parent.left == null){
      parent.left = new Node(data);
    else{
      insert(data, parent.left);
else{
    if(parent.right == null){
      parent.right = new Node(data);
    else{
      insert(data,parent.right);
}And so build up a binary tree. The traversing methods can be found in almost any good book (pre-order, post-order, in-order), for search you have just to look at greater/smaller and descend in the tree.
The Object data can be changed to what you want for storage, String, or primitive Numbers, Vectors ...
Is that what you search for?

How to see (net due date + payment term's days) in fbl5n as a date

hi experts.
i need some informations about fbl5n fields
i can see net due date and i can see terms of payment fields in the fbl5n but if the invoice has a payment term (30 day additional etc) i want to see (net due date + payment term's extra days) . for example if the net due date is 01.06.2011 and payment term is extra 20 days , how can i see 21.06.2011 in fbl5n or any other sceens?
Edited by: Burak Akdasli on Jun 22, 2011 3:43 PM

Hi
I understand from ur question whats the billing date?
If this is ur question, you can fetch it from sales order>item>billing tab.
The logic u had mentioned is confusing be more specifc as to what scenario u are trying.
Reward if it helped
Chandru

BP_TASK Data Cleansing

Happy New Year Experts,
I have a question or three for you on Data Cleansing in the Web IC. I will explain what I have done and what I need answers to.
The setup of the Data Cleansing Cases and Account search is fine. We can search for Business Partners and Merge Now or Merge Later and then search for cases if we chose to Merge Later.
When we go into the Case to process it most of the functionality is fine. What isn't ok is this BP_TASK config .
I understand that in order to execute the 'START' button in the Case Processing screens you need to have the Task config setup. I have done this to an extent as described below:
1) Setup Number Ranges - IMG->CRM->Master Data->BP->DQA-> Maintain Number Ranges [Create line 01-0000000001-9999999999]
2) In Task (1003) add the action profile BP_TASK - IMG->CRM->Transactions->Basic Settings->Define transaction types
3) Create job CRM_BUPA_REALIGNMENT (periodic job 5-10 min)
Point 3 is what I am coming unstuck with. I cannot create a periodic job without assiging an ABAP Program to run etc. There is nothing anywhere that says 'use this program or method' when creating the job step.
Secondly, when I select the 'START' button in the Case Processing screen - after confirming the changes, the case errors with a vague message saying the case cannot be saved. However, if I actually hit the 'SAVE' button the case saves and the changes I confirmed are processed between the various accounts. So the whole process is about 95% great and 5% annoying.
Before the questions, all authorisation settings are good as well.
The questions are then:
1) What parameters are required above what I described for the periodic job?
2) Does the 'Task' transaction type need to be in the Business Transaction profile for the specific business role the Data Cleansing functionality is assigned within?
3) Once a task is created, I guess that the job will process these and that a user does not necessarily need to manual process these tasks?
4) Should I change the Action Definition and Condition at all over and above the standard setup that it is currently in?
Any help and guidance would be great - I'm afraid I have 'Wood for Trees' syndrome now
Many Thanks for any assistance.
Regards,
Mat.

Hi Gregor,
I have read your interesting blog. We have a similar kind of data cleansing activity. But when I tried to implement the same, we get a message that the Data Cleansing option is not available for the Insurance industry specific settings. Can you pls help us here ? When I analysed the same the FM 'FKK_CLEANSING_ALLOWED' has a hard coded code element as follows:
*4.71: Event 7500 does not exist yet*
IF 1 = 2.
     REFRESH: t_fbstab[].
     CALL FUNCTION 'FKK_FUNC_MODULE_DETERMINE'
       EXPORTING
          i_fbeve            = gc_event_7500
          i_only_application = gc_x
          i_applk            = applk
       TABLES
          t_fbstab           = t_fbstab[].
     LOOP AT t_fbstab INTO fbstab.
       CALL FUNCTION fbstab-funcc
          CHANGING
            c_cleansing_allowed = cleansing_allowed.
     ENDLOOP.
     IF 1 = 2.
*     für Verwendungsnachweis
       CALL FUNCTION 'FKK_SAMPLE_7500'
          CHANGING
            c_cleansing_allowed = cleansing_allowed.
     ENDIF.
ENDIF.
Our SAP version is as folows:
SAP_BASIS      620         0056 SAPKB62056             SAP Basis Component
INSURANCE     472           0010     SAPKIPIN10     INSURANCE 472 : Add-On Installation
Any help is much appreciated.
Thanks.
I Peter

Baseline date & Payment terms are not populating for Intercomany vendor

Hi,
When we post intercompany invoice & check the vendor line items in FBL1N,it is expected to have data payment terms & Baseline date from the posted Invoice.this is occuring fime with single company but this data is blank for Intercompany which is creating issues for further steps.
Anybody has faced such issue? What may be the resolution?

Hello,
Why are you directly executing these programs?
You will not expect these program to execute directly by going to SE38.
I would have configured the relevant payment methods in the country with DME structure or classical RFFO* programs, which in turn pick up the inherent programs at the time of running F110.
For example, if you need to generate BACS file for country GB, either you copy the GB_BACS to ZGB_BACS or use GB_BACS directly in FBZP settings.
Make sure that you have maintained OBPM1 / OBPM2 / OBPM3 and OBPM4 settings properly.
The system automatically gives the access to system RFFOAVIS_FPAYM. Prepare a variant against this program in F110. Relevant file gets generated to folder path mentioned in OBPM4 will get generated. The file get generated can be seen in AL11.
Hope this is informative and solves your issue.
Regards,
Ravi

Domain Names Not Appearing In Drop Down of Data Cleansing Task

For some reason, in several of my DQS data cleansing tasks, the domain names of the knowledge base I choose are not appearing. This is turn leads to an error message stating that "No domain field has been mapped to the input column...".
The task can see the DQS server and it can see the various knowledge bases on that server, but the domains are not appearing.
Has anyone else run into this issue?
Thanks!!
A. M. Robinson

I have just found the same issue.
For me, I believe it is because the domains are only used in matching rules, which the SSIS task does not support. Therefore they are not in the drop down as the SSIS DQS task cannot use them. Only map domains for data correction and you should be ok.

Due Date specific terms of payment

Hello Gurus,
How to set-up Due Date Specific Terms of payment ?
Thanks

Hi
I got the below answers in my mind.Whether it may work for you or not. i am telling you the possibilities.
1) Please explain the client about the process in SAP and try to convince them this will have risk. we are giving free hand to the sales person for selecting a imaginary date as due date.
2) if they are not agreeing for that, they have to put some manual work in that.
In OBB8 Select Default date for base line date -Posting Date.
when they want to post the invoice tell the sale person, select a random date (like customer's birthday), back calculate the days and put the months there.
3) check for any user exits available or you have to develop a custom enhancement screen for calculating the due date
You can create a substitution in FI (OB28) and use exit RGGBS000 (Form u100) to write your code
In OB28 - (use method "exit only")
Prerequisites: Company code = XXXX and Account Type = D and (Syst-Tcode = VF01 or FB70 or VF02)
Choose Field "Baseline date" and mention exit name as U100... Write ABAP code here in
or wait for until some experienced consultants response on this.
with regards
siva
Edited by: Siva Rama Krishna Yanamandra on Dec 9, 2010 4:19 AM

Information Steward 4.2.1 not installing Data Cleansing Advisor (DCA) database

Our situation is as follows:
We have a SAP BusinessObjects BI 4.1 Sp3 system on Windows Server 2012.
We are installing the following components onto a separate, new Microsoft Windows Server 2012 platform (in this order):
- Information Platform Services (IPS) 4.1 Sp3
- Data Services 4.2 Sp1 Patch 3
- BusinessObjects BI 4.1 Sp3 Client Tools (for the BOE Metadata Integrator)
- Information Steward 4.2 Sp1 Patch 3
We verified the cross compatibility between IPS, DS and IS with SAP Note 1740516.
SAP Note 1740516, as referenced in the PAM, lists the following: "BI 4.1 SP3 was officially certified with DS/IS 4.2 SP1 Patch 3".
Our repository databases are located onto a separate Microsoft SQL Server 2008 Enterprise instance and the domain "DS/IS" service account under which IPS, DS and IS are installed, and will operate the Tomcat, DS and SIA services, has full access to these databases.
All required repository databases, including the IS repository, were created at forehand.
IPS and Data Services install fine without any problems. IS also installs fine, without the "Addnode" or Metadata Integrator installation issues that I have seen with previous versions. There were no errors of any kind.
The "Information Steward" and "Data Services" nodes are available in the IPS CMC and can be accessed.
However - the EIM APS is shown as "Running with errors"!
Trouble shooting the EIM APS reveals that the Data Cleansing Advisor (DCA) Service is the culprit.
Selecting the properties of the EIM APS also shows that the DCA Service could not be started and is marked in red. All other entries seem fine.
Once the DCA Server is removed from the EIM APS, the EIM APS will return to a green "Running" status.
This seems to indicate that the DCA Service is faulty. Checking the ..\BusinessObjects Enterprise XI 4.0\Data\DCA-SA\Data directory shows further evidence of this issue, as this directory is EMTPY. The expected DCA database file and the DCA log files are not there!
We have tried a number of things:
1. Removing the DCA service from the EIM APS, restarting the SIA/IPS, adding the DCA service to the EIM APS again.
2. Uninstalling IS 4.2 Sp1 Patch 3, rebooting the server and repeating the installation again.
2. Uninstalling IS 4.2 Sp1 Patch 3, rebooting the server and repeating the installation with IS 4.2 Sp1 Patch 0 (GA release)
3. Upgrading the IS 4.2 Sp1 Patch 0 (GA release) with the IS 4.2 Sp1 Patch 3 version.
None of these have made any difference whatsoever.
I have found 1 post on SCN with the exact same problem: http://scn.sap.com/thread/3475164
Unfortunately, the listed solution of reinstalling has clearly not worked for us.
Has anybody seen this problem before? Any ideas what else we can do to resolve this issue? Our next port of call is opening a SAP support call but we really want to get IS up and running ASAP - so any suggestions would be most welcome!

Hi Erik and James,
This has been fixed in 4.2 SP2 and will be fixed in an upcoming patch for 4.2 SP 1, as well.
Below are steps you can take to work around the issue you are seeing:
1. Copy the files that are in <Install Directory>\InstallCache\im.lac.icc.cdq.cognitivedq.pjs.services.backend-4.0-core-nu\14.2.1.<your build number>\actions\plugins\14.1.2
To
<Install Directory>\SAP BusinessObjects\SAP BusinessObjects Enterprise XI 4.0\java\pjs\services\ICC.DCAService\lib
2. Restart the EIMAdaptiveProcessingServer.
Thank you,
Lynne

Cutomer master co code data payment terms

hi all,
could pls tell me what is the use of payment terms field in co code data of customer master.Only sales area data payment terms get populated in the sales order.Then why should we maintain the payment terms in co code data
thanks & regards

Hi
Master records have separate areas for Financial Accounting, Sales, and Purchasing.
You can specify different terms of payment keys in each of these areas.
When you then enter a business transaction, the application in question will use the key
specified in its area of the master record.
best regards,
Thangesh

Data archiving and data cleansing

hi experts,
Can any one tell me step by step guide for Data archiving and Data cleansing of SAP-ISU Object.
what is the difference between Data archiving and Data cleansing .
Thanx & Rgds

Data Archiving: So many objects are there you can look some of them..........
ISU_BBP IS-U Archiving: Budget Billing Plan
ISU_BCONT Business Partner Contacts (Contract A/R + A/P)
ISU_BILL IS-U Archiving: Billing Document Header
ISU_BILLZ IS-U Archiving: Billing Line Item
ISU_EABL IS-U Archiving: Meter Reading Results
ISU_EORDER IS-U Archiving: Waste Disposal Order
ISU_EUFASS Archiving of Usage Factors
ISU_FACTS Installation Facts
ISU_INSPEC IS-U Archiving: Campaigns for Inspection List
ISU_PPM Prepayment Documents
ISU_PRDOCH IS-U Archiving: Print Document Header
ISU_PRDOCL IS-U Archiving: Print Document Line Item
ISU_PROFV IS-U Archiving: EDM Profile Values
ISU_ROUTE IS-U Archiving: Waste Disposal Route
ISU_SETTLB Settlement Document
ISU_SWTDOC Archive Switch Document
Go to SARA t-code and enter the object CA_BUPA for business partner then Press F6 you will get step by step documentation. please follow the procedure for all the objects.
Regards,
Siva

Need detail information about Data Cleanse Transform.

Hi Every One,
I Need detail information about Data Cleanse Transform.
1. what is Local Cleansing Packages?
2. what are Directories and Dictioneries.
3. Data Cleanse Transform INPUT , OPTIONS, OUTPUT tabs and usage.
4. Details on Transform Input Field name in Data Cleanse INPUT tab.
5. What is PARENT_COMPONENT,FILED_NAME,FIELD_CLASS,CONTENT_TYPE in Data Cleanse OUT POT TAB.
I tried using "EnglishNorthAmericaDataCleanse" transform with NAME_OR_FIRM_LINE1. When I ran the job I got below warning message and my job was success full nut status it shown as failed.
Warning message:
"Trasform Data Cleanse is unable to retrieve cleansing packages from Cleansing Package Builder. Only local cleansing packages are available. Info: Unable to log on: Could not connect to server d184932040.sng1.attens.net:6400. Please check that the server name is correct, and that the server is running. "
Please make me understand, why did I get above message.
Thanks in Advance ...

Hello,
Cleansing package is a reference file that contains content and rules around person, firm, title, phone data and so on. Cleansing package used to be referred to as dictionaries. Directories are usually referred to address reference data or address directories. The input, output and option tabs are similar to other Data Quality transforms. For detail information on what each of the input fields and output fields are and how the options work can be found in the Data Services’ Designer Guide (http://help.sap.com/bods).
The warning message you are getting is stating that Data Services is not able to connect to the server to check to see if you have made modifications to the PERSON_FIRM cleansing package. You are not required to make any changes to the PERSON_FIRM cleansing package, but can change rules or content based on your organizational rules. If you want to make changes you will need to install SAP Information Steward. If you would like to install SAP Information Steward you can find documentation for installation on the Help Portal, http://help.sap.com/bods, along with some great Videos.
You can also find some great Data Services Product Tutorials on the SAP Community Network, at http://scn.sap.com/docs/DOC-54115.
Thank you,
Lynne Lintelman

Are there any set guidelines for customer master data cleansing.

1) I was wondering if there are any set guidelines for customer master data cleansing.
2) Part of the cleansing effort involves consolidating number of divisions etc. Any pointers to this regard?
3) Also how do we deal with open docs, billing plans etc?

The data cleansing requirement will take place, while move the data from legacy system to new target ERP / system. I.e. need to cleanse, enrich, de-duplicate, & standardize.
The existing data may not have consistent format since it is often being derived from various sources. It may contain duplicate information as well missing or incomplete information. Cleanse and normalize content to achieve accuracy, consistency and proper understanding of the data.
Also its a process of organizing the data, which will ensure enrichment of your data which are up-to-date, accurate, and complete. These processes are manual / labor intensive and require a fair bit of specialization.
If you need to have more details please feel free to interact with us as per below.
Thanks
Kumar
www deebrostech.com

Problem with universal data cleanse

I have problem with universal data cleanse.
I am using DS 3.2.x (12.2.2).
I created:
Dictionary: TEST
Classification: TEST_CL
Custom outputs: category: TEST_CAT
Dictionary Entry:
Primary: BO
Classification: TEST_CL
Gender: Unassigned
Secondary information:
When used as: TEST_CAT
Standard: Business Objects
Rule file:
DataCleanse Rule File v2.0;
TEST_CAT = TEST_CL;
action = TEST_CAT;
TEST_CAT = 1 : TEST_CAT : 1;
end_action
Data Cleanse:
Input: Multiline1
Options:
Parsing Dictionary: TEST
Rule file: .../test_rules.dat
Break On Whitespace Only: Yes
Parser Sequences Multiline1: TEST_CAT
Output:
Parent_component: TEST_CAT1
Generated_field_name: TEST_CAT and RULE_LABEL
Generated_field_class: parsed/standardized
Contenet_type: none
and EXTRA field
I wanted to replace word u201CBOu201D with the standard words u201CBusiness Objectu201D, but I have result: there is "BO" in the extra field,
there are "null" in others fields.
What am I doing wrong?
Thanks for all help!
P.S. I don't have cleansing packages installer.

There seem to be a couple of things going on here:
1. If you are using your custom dictionaries, then you have to map your input to MULTILINE1 and enable the custom parsers - just something to be aware of
2. You mentioned that you made some changes to the existing dictionary and you are not seeing any changes. To be clear, do you have different TEST and PRODUCTION environments? Or is it the same environment except that you have a local DS repository and for the dictionary you are pointing to another repository (using Dictionary --> Manage Connections)?
Having the dictionaries on a different repository should not make any difference as long as you point to them in your designer using the Dictionary --> Manage Connection option.
So I think there may be some issue with your job setup and/or dictionary values need to be looked at. You can start by adding another output field named "EXTRA" to see whether or not your data is getting parsed at all. Also, make sure the entry "CLEANME" is classified as FIRM_NAME_ALONE in the dictionary and that you are selecting the correct dictionary name in the Datacleanse Transform options.

Data Cleansing Terms Clarification

Similar Messages

Maybe you are looking for