Address Cleansing

Hi ,
I have an requirement to cleanse Customer and Vendor addresses. I get the data in .txt file format from legacy system. I need to create a realtime job in DQXI which transforms the .txt file into XML and does all tha validations in DQXI ,Cleanse the data and give the output back in .txt file. Could you please provide me an approach in DQXI to meet this requirement.
Your help will be highly appreciated.
Thanks,
Kumar.

Have you considered running as a batch job? One of the web methods available to your web client is runBatchDataflow()
If you must run this as a real-time job then your web client must convert the source text file to an XML string then pass that string to DQXI. You should be able to write to a target lat file.
Paul

Similar Messages

Output Language in Global Address Cleansing

Hi,
How can the DQ Global Address Transform be restricted to give all the out put field values in English text?
Even though the input text is in English, DQ transform gives the address field in Non English characters as its a Hungarian address.
Is there a way to force it to give in English only?
Many thanks,

Global Address Cleanse Transform - Enterprise Information Management - SCN Wiki
Go to this URL

Address Cleanse Question

Hello,
I am cleansing some usa and germany address data using the global address cleanse transform with usa and emea engine turned on.
Some data have only the street but missing postal and city. After it went through the transform, the global address cleanse outputs the PRIMARY_NAME1 as empty field for the USA data but it is able to output the PRIMARY_NAME1 with the street name for the germany records
Am i missing any options or is this how it works??

Hi,
Thanks for the reply.
I meant that both usa and germany address has only street and country information and without other information.
And of cos without sufficient information, global address cleanse would not be able to correct it.
The difference i am having is that, after global address cleanse, the PRIMARY_NAME1 field of the output field of the germany record is filled up as what we gave for the input However, the PRIMARY_NAME1 field of the output field of the USA record is blank.
Both records are of status info code 2000 (Unable to identify locality, region, and/or postcode information on input. )
So the question is that, if the USA engine is not able to cleanse the data, would it map the input street field onto the output PRIMARY_NAME1 field? Or would it give a blank PRIMARY_NAME1 field?

Address cleanse output to be in English instead of German.

During address cleansing, region names in the addresses being processed by BODS are coming in their local country language names. For example one german region name output is coming as "Nordrhein-Westfalen" instead of the English description "Nrth Rhine Westfalia".
I have set the script code to Latin and Output Country Language to English in the address cleanse transform. But still I am getting the same output.
Also I am using the German Address pack for the address cleanse transform mentioned above.
Any pointers to solve the issue mentioned above would be greatly be appreciated.
Thanks.

The LATIN script code tells the address engine to use the Latin character set used by English and the Western European languages. The OUTPUT_COUNTY_LANGUAGE option applies to the country field only. If you want to post the regions in English you can use a lookup table or search/replace table to convert.

Secondary Unit Designations from Data Services' Global Address Cleanse

Using Data Services' Global Address Cleanse transform and want to have multiple Secondary Unit Designations retained, parsed, standardized and returned in output data.
ie: 1 Dexter Ave Floor 10 Suite 5
Only finding "Suite 5" store in the output SECONDARY_ADDRESS field.
The 1st unit of the 2 units, "Floor 10" is being lost consistenly using the Global Address Cleanse transform (not the US Regulatory Address Cleanse transform). I want to standardize and output secondary and tertiary unit designations and numbers like Building 2 Floor 10 Suite 5 and other multi-level unit desinations such as those listed by the USPS at http://pe.usps.com/text/pub28/pub28apc_003.htm .
So is any Complex_Name and Complex_Type address line info like "Rockafellow Center", "Eastdale Mall", "Manhattan Mall", "Building 2", etc.
Same behavior for US and Canada. Multiple units or dwellings are very common on input addresses and should be retained as per USPS Cass Certification. How can this be accomplished using Data Services' Global Address Cleanse transform?

Clark,
you either need to download one of the following additional Address Directories
- Address Directory - All-World
- Address Directory - United Kingdom
for Data Services XI 3.x from the SMP. To have access to them you need a Annual Subscription to the Directories.
Niels

blank values using Global Address Cleanse Transform

Hi,
We are trying to cleanse Global Addresses using Global Address cleanse transform. (with USA and Global Engines). We are passing Locality, Region and Postal code as multiline items. In the output some of the records are not getting populated. For these records if we keep USA as defult country then the fields are getting populated. The problem is we cannot take USA as defult country because it has global addresses and for other countries also it is filling USA as country name. Why is it that without giving USA as default country the fields are not getting populated for some records?
Below are some of the sample addresses.
1)     10 INDUSTR. HWY MS6     LESTER     PA     19029
2)     PO BOX_22964     JACKSON     MS     39225
3)     306 EASTMAN     GREENWOOD     MS     38930
4)     3844 W NORTHSIDE DR     JACKSON     MS     39209
5)     259 W QIANJIANG RD     ZHEJIANG     CN     31440
Can you please suggest a way to fill the countries for these addresses? Any inputs on this will be appreciated.
regards,
Madhavi

Hi,
As Lance indicates, you set up your address cleanse (for US I would suggest using the URAC transform) and map in your input fields as normal. In the output, you will select to output postcode2 along with all the other standardized fields you want posted in the output.
Note: If an address is assignable using the CASS rules established by the USPS to the USPS referential data, the postcode2 will be populated. In cases where it is not assignable, the postcode2 can be empty or the input postcode2 data could be preserved based on a user's settings.
Thanks,
Paula

China Address Cleansing

Hi, We're using Global Address Cleanse transform in one of our ETLs. For China (Beijing, Shanghai etc.) address, its populating China as both City and Country and Beijing/Shanghai as State. Below is the output field mappings: State: REGION1_NAME_BEST_COMPONENT_DELIVERY City: Global_AddressCleanse.LOCALITY1_NAME_BEST_COMPONENT_DELIVERY The input fields are all multiline as the source system provides a set of addresss fields that could hold any address information. Any help in resolving this issues is appreciated. Many thanks, Anitha

Version used: 3.2

Global Address Cleanse Transform - (Japanese To English conversion)

Hi All,
Is there way I can provide the input to Global Address Cleanse Transaformation (Japan Engine) in uniocde (Japanese - KANA ) and get the output in english like provide input LOCALITY1 as 高島市 but get the output in english like "Takashima City".
Thanks,
Amit

Data Services XI 12.1 Technical Manuals, Designer Guide, Data Quality, Page. 555:
Caution:
The USA Regulatory Address Cleanse Transform does not accept Unicode
data. If an input record has characters outside the Latin1 code page
(character value is greater than 255), the USA Regulatory Address Cleanse
transform will not process that data. Instead, the input record is sent to the
corresponding standardized output field without any processing. No other
output fields (component, for example) will be populated for that record. If
your Unicode database has valid U.S. addresses from the Latin1 character
set, this transform processes as usual.
Best regards,
Niels

Global Address Cleansing with suggestion

Iu2019m using Global Address Cleansing with suggestion list enabled. The problem Iu2019m having is for that Canadian addresses are not populating the address related fields (i.e. primary name, number, etcu2026) until the selection process is complete. This differs from the US engines that populate the fields with each reply. Is there a way to replicate how the US engine handles suggestion replies within the Global Address Cleansing transform?
We are using Data Services v 3.2 (12.2.1.2)
Thanks for your help in advance

HI,
I am also facing the same issue with Canada address.
Did you resolved your issue?
Thanks,
Ravi

4.0 webservice does not work when Address Cleanse is used

Hello,
For my real time web service, I am unable to add any address cleansing transforms and make it work. The web service works fine as long as I do not add any address cleanse transform.
As soon as I add any address cleanse transform and try to start the service, the real time services list icon would turn yellow for more than 10 mins with the status stuck as "Service Starting"
The code in designer complies fine. The address cleanse transform works fine with batch jobs. Web services without address cleanse transforms work fine. Am not sure what the problem might be.
It'd be great if you could give some pointers on how to resolve it.
Thanks for looking.
Regards
T.

Hi Vidya,
Thanks for posting your example. You may want to remove your workspace details from the previous posting, or at least update the password on the workspace. I've taken a look at your example and initially couldn't see anything wrong with your tree query. However, when I ran your query in SQL Workshop, it only returned one row, which would explain why you were only seeing one node in your tree! I've updated your query to use a WITH clause, and the tree is now working correctly. I believe you've hit an underlying database bug where the CONNECT BY query is only returning 1 row, when in fact it should return > 1 row. By re-writing the query to use a WITH clause, you can get around the problem.
Regards,
Hilary

Using Global Variables in Data Quality Address Cleanse Transforms

I am currently developing in Data Services 12.2.
I am trying to dynamically populate the List Owner information in the option tabs of the USA Regulatory Address Cleanse by using global variables. It populates the 3553 with the variable name instead of the value assigned.
According to the Technical Manual, it is possible to use global variables in Data Quality Address Cleanse transforms:
However, you can use substitution parameters in all places where global variables are supported, for example:
Query transform WHERE clauses
Mappings
SQL transform SQL statement identifiers
Flat-file options
User-defined transforms
Address cleanse transform options
Matching thresholds
Does anyone know if it is possible to use global variables in the option tab of the Address Cleanse; if so, can you describe how it is done?
Thanks in advance,
Rick

Hi,
U can refer to the following links in help.sap.com
GlobalContainer Object
http://help.sap.com/saphelp_nw04/helpdata/en/75/8e0f8f3b0c2e4ea5f8d8f9faa9461a/content.htm
Container Object
http://help.sap.com/saphelp_nw04/helpdata/en/78/b4ea10263c404599ec6edabf59aa6c/content.htm
Also some of the RUN TIME CONSTANTS are available in your BPM. So if you are trying to retrieve those variables in your Mapping(that is used in BPM), also read the following thread.
Re: Message id in BPM
Cheers,
Siva Maranani.

Which address components country specific Address Cleanse Engine validates

Hi,
I am looking for a list of address components which are validated by a country specific Address Cleanse Engine.
Data Services Reference Guide does not go into such details.
I have a list of countries and need to identify if selected Address Cleanse Engine validates, for example, building number and unit number.
Thank You

Vlad,
The information you want is in DS Reference Guide, Data Quality Fields, Global Address Cleanse Fields, Output.
Paul

Data Services - Address Cleanse

Hi,
What dir files do I need to have to be able to run the global address cleanse for the UK?
I have the following files in my reference_data folder
ga_region_gen.dir
ga_country.dir
I am guessing I need
ga_loc12_gen.dir,
ga_loc12_gen_nogit.dir,
ga_loc34_gen.dir
Is this correct? Currently when I run the address cleanse I am getting an INFO CODE of 1030 which is country ID not found. I have set the country to be United Kingdom as a constant in the options.
Thanks

Clark,
you either need to download one of the following additional Address Directories
- Address Directory - All-World
- Address Directory - United Kingdom
for Data Services XI 3.x from the SMP. To have access to them you need a Annual Subscription to the Directories.
Niels

DQXI USA Regulatory Address Cleanse - Multiline Address Parse Drops Lines

I'm trying to standardize an address (using DQXI USA Regulatory Address Cleanse) that contain address and building/room data. The standardization process seems to drop important pieces of the address that are needed for delivery.
Input Data
FirstName: Joe
LastName: Smith
Address: One University Boulevard
AddressExt: Allison Hall 206-B
City: Somewheresville
State: MN
Zip: 55558
Cleanser Input Mapping
Address -> MultiLine1
AddressExt -> MultiLine2
City -> Locality1
State -> Region1
Zip - > PostCode1
Output
best_delivery_primary_secondary_address: 1 UNIVERSITY BLVD
No other standardized output field has the complete address.
Obviously, this is missing the necessary "Allison Hall 206-B" information.
Tried These Things
Varying the cleanser's standardization options
Mapping the input Address columns to Address_Line (which yields Allison Hall 206-B as the best_delivery_primary_secondary_address )
Adding additional cleaner component output fields to try to access additional address data ( Extra1, Extra2, Extraneous_Secondary_Address_Data, Address_Line_Remainder1 ) and the data seems to be blank for the most part.
Working with the global address cleanse, but will little luck other than passing through uncleansed address data.
Questions
Is there any way to get the address to be cleansed/standardized and maintain the valuable address data?
Perhaps will I have to stitch multiple cleansers together to get both th USA-only fault-code along with some more flexibility in the global address cleanse?
Another more reliable approach (like concatenating the address data and treating all as Multiline input data?

I'm actually using the best output fields, I think the projects came defaulted to the best settings and I haven't changed them. I did disable ELOT, DPV, RDI and LACSLINK as I don't need any of those features, but that's about all I've changed in the project.. The project is failing attemping to unregister the USA reg Address CleanseCass_UsaRegAddressCleanse_Transform.
>
Ryan Champlin wrote:
> I'm guessing that you are using the "Stadardized" output fields rather than the "Best" output fields? If you use the "Best" fields I think you'll be fine.
>
> Could you let me know if you got this working or if this works and we can go from there.
>
> Thanks,
> Ryan

Address Cleanse Fault Code

Hi,
I'm using US Regulatory address cleanse transform to clean our addresses.
Some address has return FAULT_CODE
like E412, E420, E421 etc
and STATUS_CODE : SA0000, etc
Does anyone know what these code means or if there is a look up table for this.
I've look at documentations and search the web/forum but not able to find anything.
Any help would be greatly appreciated.
Thank you,

Henry,
There are also custom functions which translate status codes into their descriptive form in an appended column. I use "CF_AddressStatusCodeDescriptionEN" frequently.
I believe that you can get a copy of this custom function if you download the BOBJ Data Services data quality blueprints from SAP Data Services Blueprints
Enjoy

Address Cleanse

Using the address cleanse transform, I have been able to isolate the address that have "PO Box" and "Stations". Now what I need is two further split this I only want the PO box number example "P O Box 777" should return only "777" . What is the best way to do this. Can the Address Cleanse transform do this as well or do I need to create myself a function?

A built-in function replace_substr() in DS will help you to get this done. Use a Query transform next to the Address Cleanse output. In the mapping tab of PO Box Column, use the below expression
replace_substr(TABLE.POBOX_COLUMN,'P O Box ','')
This will get you the rest of the string except 'P O Box ' part in the output.
Regards,
Suneer

Address Cleansing

Similar Messages

Maybe you are looking for