Validation/Transformation Question ....

We need to use the abbreviations in the Name field in the Vendor master. The incoming data may be with full name but the business requirement is to use the abbreviations for example :-
INCORPORATED must be INC
ORGANIZATION must be ORG
MANUFACTURING must be MFG
HOSPITAL must be HOSP
The above are some of the examples. The requirement is to replace the full name with abbreviations where ever that is present.
How do we handle this in MDM. I noticed in the data manager there is a tab called transformation where we can specify the Table field name then the Old value and new value but donu2019t know how to execute it. Is Data Manager is the place to handle this?.
Anybody help me with this?.

Hi JP,
Yes,you are right.Datamanager is responsible to do transfomations.As you said we have to
specify the field name on which you want to create the transformation and also specify
the value to be replaced in From field and new value in the To field.
Suppose for example
Specify INCORPORATED in from field and INC in To field, then INCORPORATED is replaced
with INC.if you don't specify anything in To field, it just simply deletes the specified value
available in from field.
Token option is also availble to replace the values tokenwise.
To get more details go through below link:
Re: Transformation in matching mode in data manager
Cheers
Narendra

Similar Messages

DI Job Failed with no reason since last week : Invalid schema is specified for PASS output in the Validation Transform

Post Author: Nono44
CA Forum: Data Integration
Hi,
I have problem with DI job. That job doesn't work since friday.
The error is :
(11.7) 04-21-08 09:48:56 (E) (2588:2396) XRN-130125: |SESSION
OracleApps_GLFacts_Load|STATEMENT
<GUID::'93342049-fbd9-4942-bab2-5565e8e248bf' TRANSFORM Validation
OUTPUT(Validation_Pass,
Validation_Fail)>
Invalid schema is specified for PASS output in the Validation Transform Does anybody know what is it ?
Thanks a lot.
Arnaud

Post Author: Nono44
CA Forum: Data Integration
Hi,
I have problem with DI job. That job doesn't work since friday.
The error is :
(11.7) 04-21-08 09:48:56 (E) (2588:2396) XRN-130125: |SESSION
OracleApps_GLFacts_Load|STATEMENT
<GUID::'93342049-fbd9-4942-bab2-5565e8e248bf' TRANSFORM Validation
OUTPUT(Validation_Pass,
Validation_Fail)>
Invalid schema is specified for PASS output in the Validation Transform Does anybody know what is it ?
Thanks a lot.
Arnaud

Ways to retrieve Validation transform information for documentation

Hi All,
We have a requirement which needs to document validation rule in all validation transform of data flow in a project.
Does anyone know if there is a way which we can retrieve validation rules from DI repository? E.g. a SQL statement.
I searched the DI repo tables but no luck.
Hope someone can give me some light.
Thanks,
Bobby

In the Auto Documentation in the Management Console, you can browse all the objects in your repository and for the validation transform it will show the rules used in that transform. This is for browsing only though, the print feature does not print the details for any of the transforms, so also for the Validation transform the details (i.e. the validation rules) are not printed.
Unfortunately, today there is not an easy way to extract the validation rules via a simple query. It is a common request though that we will address in a future release (import/export of validation rules).
That being said, technically there are some options to get access to the rules. Not straightforward though...
The validation rules are part of the transform definition, which on its turn is part of the whole dataflow definition. So they are not stored as separate objects in a table somewhere, but embedded into the ATL language we use to describe the DI objects. What you could do is export the repository to an ATL file (or select from AL_LANG_TEXT table in the repo) and scan this file for the validation rules. Below is an example of how such a rule would look like, in this case the rule name is "MyRuleName" and the rule is : Query.JOB_KEY = 1.
As a side note, the part that would be easy to get via a SQL query are the run-time statistics of the validation transform. These statistics (number of records passed/failed for each validation rule) are stored in the repo tables al_qd_* and are also used by the Validation Dashboards in the management console. Keep in mind that you need to check the option to 'collect data validation statistics' in order to collect these details.
CALL TRANSFORM Validation ()
INPUT(Query)
OUTPUT(Validation_Pass ( JOB_NAME varchar(192),
JOB_KEY int,
JOB_RUNID varchar(384),
RUN_SEQ int,
PATH varchar(765),
OBJECT_NAME varchar(765),
OBJECT_TYPE varchar(765),
ROW_COUNT varchar(765),
START_TIME varchar(765),
END_TIME varchar(765),
EXECUTION_TIME varchar(765),
DATAFLOW_NAME varchar(765),
JOB_ID int ) ,
Validation_Fail ( JOB_NAME varchar(192),
JOB_KEY int,
JOB_RUNID varchar(384),
RUN_SEQ int,
PATH varchar(765),
OBJECT_NAME varchar(765),
OBJECT_TYPE varchar(765),
ROW_COUNT varchar(765),
START_TIME varchar(765),
END_TIME varchar(765),
EXECUTION_TIME varchar(765),
DATAFLOW_NAME varchar(765),
JOB_ID int,
DI_ERRORACTION varchar(1),
DI_ERRORCOLUMNS varchar(500) ) )
SET("validation_rules" = '<?xml version="1.0"; encoding="UTF-8"?>
<Rules collectStats="true" collectData="false" >
<Column name= "Query.JOB_KEY"; enableValidation="true" noValidationWhenNull="false" >
<RuleName> MyRuleName </RuleName>
<Description></Description>
<Expression uiSelection="1">
<UIValue1>=</UIValue1>
<UIValue2>1</UIValue2>
<Custom> Query.JOB_KEY = 1 </Custom>
</Expression>
<Action sendTo="0" substOnFail="false" substValue="" />
</Column>
</Rules>

Large field even after validation transform

Hi, I am working on BODS 4.0 with Oracle 11.2 as Repo. I am using validation transform to calculate the length of the string . Validation will fail if record length is greater than 60. I am sending pass records to table temp1 and send failed records table temp2. I have defined the field length to 60 in temp1.
After this when I run Job then I get error on table temp1 that record length is 65 and field is of 60. I am working with Russian data. Russian is multi byte character CYRILLIC data.
Now if SAP has field defined as varchar(60) then how can I make sure that only records with length 60 or less are send.
Even though I am checking length 60 in validation but inactual it is taking more space and can not be inserted into field of length 60.
Thanks,

Hi,
I've done the same test on BODS 3.1 ver and didn't see any error messages and Job run successfully with correct results.
I've given one field as 90 chars.
Please let me know if you need any further help . My emails is mohan.salla at telegraph.co.uk
cheers

Validation Transform In BODS

Hi All,
I'm trying to use the validation transform in BODS. The scenario is:
I have declared a variable $Product having value 'Oil','Gas','Fuel'
when I use the validation product IN ($Product) the validation fails even for the valid product entries.
But when I tried with giving the range of values directly instead of through variable like product IN ('Oil','Gas','Fuel') it works fine.
I'm in need of using it through the variable only..Any work around?? Please help....
Thanks and Regards,
Prateek

Prateek, please try this and let me know if this helps u..
Create a custom function (say Get_Match_Status) which accepts two parameters viz. the column value and the list of values (Oil, Gas and Fuel, in ur case). This should return 0 if the column value doesnt match with any of the list values. Otherwise it should return 1. Add a new column (Match_Status) to your query transformation (just before the validation transform) and call this function by passing the column 'Product' as the first argument and the variable '$Product' as the second argument - Get_Match_Status(Product,$Product). In the validation transform you can check the value of the column - Match_Status (this can be either 1 or 0)
Function body:
$Flag = 0;
while(length($In_Compare_Text )>0)
begin
     $Break_Text = word_ext( $In_Compare_Text ,1,',');
     if($Break_Text = $In_Text)
     begin
          $Flag = 1;
     end
     $In_Compare_Text = substr($In_Compare_Text ,index($In_Compare_Text,',',1)+1,length($In_Compare_Text)-index($In_Compare_Text,',',1));
end
if($Flag = 1)
begin
     return 1;
end
else
begin
     return 0;
end
Need to create two input parameters:
$In_Compare_Text   varchar   4000
$In_Text        varchar   30
Create two variables also:
$Break_Text    varchar     30
$Flag      int;
The return parameter has to be of type int
Regards,
Shine

Tuning the validation transform in Data Integrator

Hi,
We have to bring 21 million records from a table to a new table using validation transform.
We are selecting PK and putting a validation condition "Exists in a table " on it. The secondary table selected is the target table and we are taking Failed records and passing them to the target table.
So here we have a source table, we are taking failed records from validation transform having Existing in a table condition. The table selected here is the target table itself.
Its taking a lot of time.
Please pour in some suggestion to improve its performance. We have to track the changes in daily basis in this table and the source table doesn't have last updated/timstamp.

There are two possible problems here: one is that you are processing all of this data outside of the database when you should be pushing the work down to the database. If you must use the validation transform then you can try outer joining to the target table prior to the validation step. Simply add another query transform prior to the validation transform and add the target table in again as a source. Then outer join to the (source) target table (on PK) and add the target table PK to the output from the new query transform.
Then you can check the target table PK for null in your validation transform. If it's null, it doesn't exist in the target.
The other problem might be related to the database. Because you are reading and writing from the same table in this dataflow (the target table) you may be experiencing locking and/or some kind of bottleneck with the transaction logs.
To correct this, try staging the data in a different table after you run in through the validation transform and then, in a new dataflow, move the data to the target table. (you could also use a Data Transfer Transform to accomplish this).

How validation & transformation handled in ETL

Hi,
I am new to OWB (We are using Oracle 8i). I have to extract data from source, do the required validation and transformation and then finally load the data into target table.I need help on validation and transformation handled in ETL.
Illustration:
source table emp_src & target table is emp_target. I have to validate deptcd (should present in dept master). While loading i have to replace these invalid dept code with some dummy value maintained in parameter table. Insert all the correct records and errorneous records with transformations into target table.
Also, i want to store all these invalid records in error table or error file.
My question:
1. How these can be handled in ETL
2. Should i have to modify the pl-sql procedure/jobs
generated by ETL.
3. Can i have my own procedures to accomplish the above
task
4. Can i execute my procedure within the ETL generated
procedure.
Thanks,
sanjay rastogi

I will try to answer your questions:
1) You could do this using a "key lookup" on deptcd against the dept master. The key lookup returns NULL for each invalid value. You could then use an expression to replace the null values with a default.
In order to log the errors you could use a "split", which enables you to insert the erroneous data into a log table.
2) No. I have yet to come across a situation where I have had to modify the generated PL/SQL. (Doing so will cause serious issues regarding maintenance, upgrades etc.)
3) You can use your own procedure. Simply write your PL/SQL package/procedure/function and import it into your OWB transformation library.
4) Yes. Same as before, import your own procedures, and use them in mappings as Transformations or in Expressions
Hope this helps.
Roald

Transformation Question

Hi,
I have a unique question for everyone.
In one of my data load into a DSO, i need to update a target field either as override or Summation based on a input flag field.
Is this possible. I am open to writing code in any of the transformation routines.
Thanks
Niveda Sharma

Yes, you may have to write an End Routine & also read the same DSO which could cause long load times. Just evaluate and see if its worth it.
The logic would be in END Routine:
For the keys of the DSO (Result_Package) read the DSO with the same keys.
Based on the input_flag, add result_package-kf to DSO-kf, if you have to sum
else overwrite result_package-kf, if you have to overwrite.
Hope this helps

Genereting JSTL tags with an XSLT transformation question

Hi there!
I have some XML datas to display in a jsp file.
XML content is of this type:
<message>
<title>A message</title>
</message>
The most elegent way to present them is to transform XML via xslt into xhtml.
(that way I can externally change with ease the message formatting output without changing the jsp)
For that, I use the cool tag
<x:transform>
on each xml file i want to display (with x:foreEach)
The output produced for each xml file is:
<div class="message">
<h2>A message</h2>
</div>
My problem is now that I want to include custom tags in the generated content!
For exemple:
<div class="message">
<h2>A message<c:out ...></h2>
</div>
My question is:
how can I make that xslt generated tag to be executed???
Since it is the product of an xslt transformation ,I suppose it won't be executed at all...
Advices greatly appreciated! :)

I'm not sure I understand what you mean when you say "how can I make that xslt generated tag to be executed???"
You've got your XML input and the XSL-T stylesheet that will transform the XML input into an XHTML stream containing JSTL tags.
I'm assuming that you're going to ask a servlet to pass the XML input to the XSL transformer and get the XHTML output stream. Once you have that, the servlet will write the XHTML to the HTTP response output stream, where it'll be rendered by the browser.
I think the key is to make sure that you tell the browser that response type is a JSP (that's the only document type in which it makes sense to put JSTL tags). When the browser gets that JSP, it'll treat it like any other: generate .java code, compile that to a .class file, and then render.
I'm not sure about efficiency, but it sure is an elegant solution. - MOD

BODS ABAP transform question

Hi! This is a very simple question...
I've been trying to use ABAP transforms in BODS, and I'm having some difficulty with the documentation. In particular, it's not clear how exactly the extracted information from the ABAP program makes it into the BODS dataflow.
Does anyone have a clearer picture of how this is done?
Thanks,
Scott

Hi,
Are you checking for ABAP Dataflows or Custom ABAP transformations?
Regards.

Validating code question

Hello website gurus.
Nancy O. Pointed out a problem to me - that being my code is apparently not being validated as 'correct'.
Is this a problem? And if I have all my pages as templates ... are they all going to have the same code erros? Or do I have to check EVERY web page within my site?
Also, if EVERY page in the site is incorrect ... do I have to just update my template so all the codes transfer over?
Also, considering I'm totally new at this stuff, is it even possible for me to know how to correct code that is shown as invalid?
Here is a link to a validator output.
http://validator.w3.org/check?uri=http://prodigypianostudios.com/&charset=(detect+automati cally)&doctype=Inline&ss=1&group=0&No200=1&st=1&user-agent=W3C_Validator/1.1#result
Here is my site. I'm always changing the design so hopefully that won't hinder someone finding out if the code is wrong.
http://www.prodigypianostudios.com
I'm a bit confused as to if I'm using dreamweaver, how is the code wrong? Isn't the application writing it for me?
Thanks a lot for the help.
~Dustin

Dustin
It is not required for you to start a new thread, your questions would have been answered in the original post, so in the future (unless the board moderators object), just stay with your orignial post with the same problems.
dustinsanders1987 wrote:
Hello website gurus.
Nancy O. Pointed out a problem to me - that being my code is apparently not being validated as 'correct'.
Is this a problem?
Yes, is usually is, if you are trying to build a site and the foundation of proper code is not met, it is like building a house and wanting to get the roof done before the foundation....
And if I have all my pages as templates ... are they all going to have the same code erros? Or do I have to check EVERY web page within my site?
Also, if EVERY page in the site is incorrect ... do I have to just update my template so all the codes transfer over?
I hope the first sentence is just worded wrong, you create one template and then create child pages from there. If the code in the non-editable regions is not correct, then yes, you will have to correct them all. But all you need to do is correct the template and save and it should update all of the child pages.
Yes, check everypage...
Also, considering I'm totally new at this stuff, is it even possible for me to know how to correct code that is shown as invalid?
Here is a link to a validator output.
http://validator.w3.org/check?uri=http://prodigypianostudios.com/&char set=(detect+automatically)&doctype=Inline&ss=1&group=0&No200=1&st=1&us er-agent=W3C_Validator/1.1#result
The validator will help you with that, but some of it will come from you learning to read the code...it is not really that hard. You have 13 errors, which is not that bad.
First, find this line of code, on about line 2, on the next line, after this code
add <head>
<html xmlns="http://www.w3.org/1999/xhtml">
So it looks like
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
Then find this line of code,
<script src="Scripts/swfobject_modified.js" type="text/javascript"></script>
After it, add
</head>
<body>
Then at the very bottom, find this line of code

and type
</body?
</html>
And revalidate the page...
Typically dreamweaver adds all the <html><head><body> opening and closing tags, why yours is not there is unclear, in all probability you unintentionally deleted it.
See how that works out for you.
Gary

Validation General Questions

I have a couple of general questions on validation.
1) I have a text field defined as a "Required" field (it is using the form_required template). Must I also create a NOT NULL validation on this field as well? It seems that I should not have to do this. However, if I do not create this NOT NULL validation, then clicking on a Submit button while this field is empty is not generating any error message. But when I include a NOT NULL validation, then I do get an error message.
2) This question is related to the first. I tried creating a regular expression validation on my field in which I use the pattern
[[:alnum:]]{1,}[|$#&_?]+
The field should allow the user to type-in a string consisting of 1 or more alphanumeric characters (it could be a foreign language characters as well)
and 1 or more special characters like $ or #.
I thought this would also generate an error message if the user clicks the Submit button while leaving the field empty. But, again, I get no error message. Why?
Thank you in advance for any insight on this.

Thanks very much, Justin.
When I saw the regexp_like() function in your reply, I am wondering if, perhaps, you might also have some insight into how I can ckeck if a field contains non-English type characters (i.e., mult-byte characters). I already posted a question about this an hour ago but have not gotton any replies as yet. In my post I asked about using the regular expression pattern [[:alnum:]] since the docs state that this will check for mult-byte characters. And so, I thought if perhaps there is some function I might use to return a boolean TRUE if a field contains non-English characters versus a FALSE if it contains only English characters.
Any insight in this would be most appreciated.
Thanks again for your help.

XSLT Transformation Question

Hi together!
Hope anybody can help.
I have the follow XML structure :
<asx:abap xmlns:asx="http://www.sap.com/abapxml" version="1.0">¶
<asx:values>¶
<IMPORT>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>222358   1NU    480350    29102007VENDA DE MERCADORIA        30</DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>35403474</DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>35403822</DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>4480350</DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>220089</DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>3540347</DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<Y0DPL_LATAM_INV_FILE_UPLOAD>¶
<DATA>4480351 </DATA>¶
</Y0DPL_LATAM_INV_FILE_UPLOAD>¶
</IMPORT>¶
</asx:values>¶
</asx:abap>
After the XSLT Transformation i need the data in this structure :
<data>
     <invoice>
           <id>222358</id>
           <item>35403474</item>
           <item>35403822</item>
           <code>4480350</code>
     </invoice>
     <invoice>
           <id>220089</id>
           <item>35403474</item>
           <code>4480351</code>
     </invoice>
</data>
I tried to group the data with the tag "xsl:for-each-group". But i get no result.
Regards,
Anton

Hi,
no one with a good hint?
Regards,
Anton

Validation report question

What can I do about these messages? There are aboutr 60 of them. Should I do anything?
Especially the 7 errors. Is there some way to let DW make the corrections?
The page is http://righttax.org if you want to look at it.
Message In HTML 4.0, FONT is deprecated. It may become obsolete in future versions, consider using style sheets instead. 50
Error The tag:"link" is not allowed within: "td" It is only allowed within: head. 71
Error The tag:"meta" is not allowed within: "div" It is only allowed within: head. 145
Error The tag:"meta" is not allowed within: "div" It is only allowed within: head. 147
Error The tag:"style" is not allowed within: "font" It is only allowed within: head. 151
Error The tag: "font" doesn't have an attribute: "align" in currently active versions. 191
Message In HTML 4.0, FONT is deprecated. It may become obsolete in future versions, consider using style sheets instead. 191
Message In HTML 4.0, U is deprecated. 191
Error The tag: "font" doesn't have an attribute: "align" in currently active versions. 201
Error The tag: "font" doesn't have an attribute: "align" in currently active versions. 204
Thanks

Harvey - because the page is created from a template, you will need to edit the template to remove some of these errors.
In the template page:
Change this -
<link rel="stylesheet" href="http://www.google.com/cse/style/look/default.css" type="text/css" >
</td>
to this -
</td>
and this -
</style>

to this -
</style>
<link rel="stylesheet" href="http://www.google.com/cse/style/look/default.css" type="text/css" >

Change this -
      <p class="style3" align="left"><a href="petition.html">We,
the </font>undersigned</a>, respectfully
to this -
      <p class="style3" align="left"><a href="petition.html">We,
the undersigned</a>, respectfully
Then in the child page (the one you gave the code for) -
Remove the meta tags and the embedded stylesheet from the page's editable region called "EditRegion", and place it in the page's editable region called "head".
Finally, change this -
America</strong><strong>.</strong></em></font></div>
              </blockquote>
               <p align="center">
to this -
America.</strong></em></font></div>
               <p align="center">
Now the next question is - how did this page get into such sorry shape?

Validity Table Question - 0CALDAY and 0PLANT

Hi, I have an Inventory InfoCube 0IC_C03 and I noticed that the validity table has both 0CALDAY and 0PLANT checked.
I read the documentation that it's best to have just 0CALDAY.
http://help.sap.com/scenarios_bus2004/helpdata/en/42/266241fe918347e10000000a1550b0/content.htm
The document does mention a 0PLANT scenario, but I'm not quite understanding it.
1. Will it hurt to have 0CALDAY and 0PLANT?
2. What would be the consequences from a reporting perspective if I have 0PLANT in the Validity Table?
Thanks!

*copy paste from some other forum*
Validity table defines the range of the characteristic values for which the non-cumulative KF is valid.
Let us say your cube has 0calday, and it has data from 01/01/1999 to 12/31/2000. If you run a query and check (say its stock cube) stock balance per day per plant, it will calculate balances for each plant and show starting from 01/01/1999 onwards.
However, if you had a plant that became operational on 06/01/2000, you wouldn't want to see a 0 stockbalance for it starting from 01/01/1999 (or say when calculating the average, take as if stock existed from 01/01/1999) but from the date the plant actually existed ie 06/01/2000.
In this case, if your validity table had only 0calday, your report would show 0 stock for each day from 01/01/1999 to 06/01/2000 for this new plant (not a good idea), while if you defined it at plant level, you will see the report starting at 06/01/2000 while it will start from 01/01/1999 for other plants. This is what you want
see this http://forums.sdn.sap.com/thread.jspa?threadID=318570
http://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/204a99c7-b3c5-2e10-f18f-e3ddb6ec6ad3?QuickLink=index&overridelayout=true

Validation/Transformation Question ....

Similar Messages

Maybe you are looking for