Searching for Duplicates records in Qualified Lookup tables

Hi SDNers,
I would like to know,
How to find out how many records having duplicate records in Qualified Look Tables.
In Free form search or Drill down Serach.. I am select the particular Qualified Look up Table. After how can I find Duplicated reocrds.
Any Solution?
Thanks
Ravi

Hi,
If you want to find the duplicates present in qualified table then, you can go to qualified table in data manager and get to know the duplicates....else if you want to find the duplicate links to a record in main table, then you can write an expression in free form search to get the value of duplicate links. but that would be specific to a link value only..e.g. Country is your no qualifier, then in free form search, you can write an expression to get how many links are for USA.
Hope this clarifies your doubt...if not, please elaborate on the requirement.
Regards,
Arafat.

Similar Messages

Insert a record in Qualified Lookup Table

Hello everyone,
I need code to insert a record in Qualified Lookup Table where the non-qualifier is a record of type Country. Other fields are qualifiers.
I tried using QualifiedLookupValue.createQualifiedLink(). However, this only helps to insert in the qualifier values, how can I insert the non-qualifier (Country) value?
Any idea?
Many thanks in advance,
Baez

Hi guys,
Maybe the answer comes late but i'm recently working on this and the API works for me to create and update qualifier values.
Suppose recordMain is the main record, fldQFT is the qualified lookup field in main table, fldQualifier is the qualifier field in QFT table.
To add qualifier value you can use:
QualifiedLookupValue qualifiedLookupValue = new QualifiedLookupValue();
int index = qualifiedLookupValue.createQualifiedLink(recordMain.getId());
qualifiedLookupValue.setQualifierFieldValue(index, fldQualifier, MdmValue);
recordMain.setFieldValue(fldQFT, qualifiedLookupValue);
To update qualifier value, use:
QualifiedLookupValue qualifiedLookupValue = (QualifiedLookupValue) recordMain.getFieldValue(fldQFT);
qualifiedLookupValue.setQualifierFieldValue(index, fldQualifier, MdmValue);
recordMain.setFieldValue(fldQFT, qualifiedLookupValue);
Regards,
James

Inserting a record in qualified looup table

Hi All,
I am using MDM 5.5 SP6. I have table structure like this.
Table name:
Representative (main table)
Fields:
     Name          Text
     Age          Integer
     Voter ID     Text
     Gender          Lookup[flat]
     PostandLocation Lookup[Qualified](Multi-valued) --> It refers qualified table 'Post_and_Location'.
Post_and_Location (Qualified table)
Fields:
     Position     Lookup[flat]
     Location     Lookup[Hierarchy](multi-valued) --> It refers hierarchy table 'Locations'
Locations (Hierarchy table)
Fields:
     State          Lookup[flat]
     District     Lookup[flat]
     City          Text
Here, I need add representative details in main table 'representative' using Java API. In webdynpro UI, I will give Name, age,voterid,gender,position, city,district, state.
Here I am struggling that how to lookup hieararchy table value in qualified lookup table(Post_and_Location). How can I achieve this?.Please help me.
I am more happy to give more information regarding this, if anybody needs.
Thanks,
Venkatesh

Hi Bharti,
Thanks for your quick reply. Here I need more explanation on, how to lookup hierarchy table(Location) record in Qualified lookup table (Post_and_Location) using java API. I need more explanation in Java API regarding this.
Because, As per our scenario, Qualified table(Post_and_Location) have a field called 'Location'(type Lookup[Hierarchy](multi-valued)). It looks up Hieararchy table(Locations).
Here, while adding new representative in main table(representative), I need to lookup qualified table(Post_and_Location) record for the field 'PostandLocation' in main table(representative). And also, I need to lookup hierarchy table(Location) record for the field 'Location' in Qualified table.
If you get confuse, please check my table structure above in this thread. If you need more info, I will provide. Please help me to achive this.
Thanks,
Venkatesh

Qualified lookup table

Hi Guys,
Can you tell me the steps to be followed for importing and syndicating qualified lookup table .
Thanks,
MS Reddy

Hi,
1. Import all the lookup tables used in Qualified table.
2. Import qualified table data along with main table data only. For more than one qualified table record you should have repeated main table record.
E.g.
Qualified Table - Price Information
Lower Bound
Purchasing Info Record ID
Purchasing Organization
Amount
Currency
First three fields are the non-qualifiers amongst which Purchasing Organization is the lookup field. So you need to first populate this field.
Now your main table record is
Supplier     Supplier Part Number     Short Description     Product ID     Service Item     Lower Bound Purchasing Info Record ID     Purchasing Organization     Currency     Amount
AGENCY01          1000               metal processing     IBG-100               False     1     5300000018     Mumbai Purchase Org     Indian Rupee     100.00
1. Map all the main table fields
2. Identify the Display fields of your Qualified table, if your qualified table has more than one Display field then map the fields with the fields marked as D in destination structure e.g. in above given table all the three non-qualifiers are the display fields then mark Lower Bound with the D   Lower Bound field, similarly map the other display fields
3. Select all the Display fields at source side, right click and select Create Compound field. This will combine your input fields and automatically map them with Qualified field.
4. Map the qualifiers
5. Select the unique fields in Matching fields tab and execute the import.
When you syndicate data containing qualified links, it will create the number of output records depending on the number of qualified links.
Regards,
Jitesh Talreja

When to use qualified lookup table?

Hi all,
I am confused with the qualified lookup table and lookup table, for the situation that a company has more than one contact person, I created a table "contact person", which has following fields: first name, last name, phone number, email address.
Questions:
1. should I set "contact person" as a lookup table or qualified lookup table?
2. if to be set as qualified lookup table, which field should be qualifier field? what is the difference between qualifier field and non-qualifier field?
your reply will be very appreciable
Bin

At times data is stored in such a way that duplication is unavoidable due to the storing mechanism and other factors. It may also happen that the data is sparse. The efficient way of storing data in such scenarios is the use of Qualified tables as it reduces the size of the main table and removes the unnecessarily created duplicates.
Check the foll links
/people/pooja.khandelwal2/blog/2006/03/29/taming-the-animal--qualified-tables
/people/avi.rokach/blog/2006/11/14/using-mdm-55-for-data-quality-analysis
MDM data modelling guide
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/5d4211fa-0301-0010-9fb1-ef1fd91719b6
How to import Qualified tables.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/abe914fa-0301-0010-7bb1-d25c2a4bb655
Also this one.
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/792f57b7-0a01-0010-f3b6-881269136a83
Please reward for the same.

Updating a qualifier value of qualified lookup table failed

Hello,
I am trying to update a qualifier value of qualified lookup table.
I have written the method attached to this email.
I am not able to modify a qualifier field, that "Installation instructions DAR Update" field of "Vendor Details" table with this method call. Is there anything I am missing or not doing correctly?
Also, I noticed that in SP6 API documentation, this line in section of ModifyRecordsCommand:
Note: Qualifier values is currently not supported by this command. This command simply ignore qualifier values passed in.
First I have used this method failed. After I saw this, I tried to use ModifyRecordCommand but no success still.
I am copying my method content here. qlv1 and qlv2 is geeting new value after setQualifierFieldValue.
It will be highly appreciated if you can help me.
                boolean isUpdated = false;
          final MdmValue mval = record.getFieldValue(qualFieldID);
          qlv = (QualifiedLookupValue) mval;
          QualifiedLinkValue[] qlinkvals = qlv.getQualifiedLinks();
          for (int j = 0; j < qlinkvals.length; j++) {
               qlinkval = qlinkvals[j];
               qrec = qlinkval.getQualifiedLookupRecord();
               tabId = qrec.getTable();
               qfields = qlinkval.getQualifierFields();
               vdrec = getTSVal(tsVals, qrec);
               for (int k = 0; k < qfields.length; k++) {
                    fieldId = qfields[k];
                    fieldValue = qlinkval.getQualifierValue(fieldId).toString();
                    mstr = mdmHandle.getSchema().getField(tabId, fieldId).getName();
                    fieldName = mstr.get(MDMBase.LANG);
                    if (!(vdrec.containsKey(fieldName)))
                         continue;
                    String curTSVal = fieldValue;
                    String darTSval = vdrec.get(fieldName);
                    // If the dar updated value has different timestamp value,
                    // then it means MDM have changed the value after we sent the
                    // last export to DAR.For this case, we won't change status flag
                    if (!(darTSval.equalsIgnoreCase(curTSVal)))
                         continue;
                    FieldId updateFieldID = tsUpdateFields.get(fieldName);
                    //test
                    FieldId iid = tsUpdateFields.get("Parts Breakdown Timestamp");
                    //test
                    try {
                         MdmValue mvalTrue = MdmValueFactory
                                   .createBooleanValue(true);
                         qlv.setQualifierFieldValue(j, updateFieldID, mvalTrue);
                         //test
                         qlv.setQualifierFieldValue(j, iid, mvalTrue);
                         String qlv1 = qlv.getQualifierFieldValue(j,updateFieldID).toString();
                         String qlv2 = qlv.getQualifierFieldValue(j,iid).toString();
                         QualifiedLinkValue qlv11 = qlv.getQualifiedLinks()[1];
                         logger.info(qlv1":"qlv2);
                         //test
                    } catch (IllegalArgumentException e) {
                         // TODO Auto-generated catch block
                         e.printStackTrace();
                    isUpdated = true;
               if (isUpdated){
                    qlv.setCompleteSet(true);
                    mdmHandle.modifyRecord(record,true);
                    mdmHandle.modifyRecord(qrec,true);
Regards

Apparently you can configure the fields that are shown in the pop-up window, but it also limits the fields that are displayed on the iView of the main table.

Check for duplicate record in SQL database before doing INSERT

Hey guys,
This is part powershell app doing a SQL insert. BUt my question really relates to the SQL insert. I need to do a check of the database PRIOR to doing the insert to check for duplicate records and if it exists then that record needs
to be overwritten. I'm not sure how to accomplish this task. My back end is a SQL 2000 Server. I'm piping the data into my insert statement from a powershell FileSystemWatcher app. In my scenario here if the file dumped into a directory starts with I it gets
written to a SQL database otherwise it gets written to an Access Table. I know silly, but thats the environment im in. haha.
Any help is appreciated.
Thanks in Advance
Rich T.
#### DEFINE WATCH FOLDERS AND DEFAULT FILE EXTENSION TO WATCH FOR ####
$cofa_folder = '\\cpsfs001\Data_pvs\TestCofA'
$bulk_folder = '\\cpsfs001\PVS\Subsidiary\Nolwood\McWood\POD'
$filter = '*.tif'
$cofa = New-Object IO.FileSystemWatcher $cofa_folder, $filter -Property @{ IncludeSubdirectories = $false; EnableRaisingEvents= $true; NotifyFilter = [IO.NotifyFilters]'FileName, LastWrite' }
$bulk = New-Object IO.FileSystemWatcher $bulk_folder, $filter -Property @{ IncludeSubdirectories = $false; EnableRaisingEvents= $true; NotifyFilter = [IO.NotifyFilters]'FileName, LastWrite' }
#### CERTIFICATE OF ANALYSIS AND PACKAGE SHIPPER PROCESSING ####
Register-ObjectEvent $cofa Created -SourceIdentifier COFA/PACKAGE -Action {
$name = $Event.SourceEventArgs.Name
$changeType = $Event.SourceEventArgs.ChangeType
$timeStamp = $Event.TimeGenerated
#### CERTIFICATE OF ANALYSIS PROCESS BEGINS ####
$test=$name.StartsWith("I")
if ($test -eq $true) {
$pos = $name.IndexOf(".")
$left=$name.substring(0,$pos)
$pos = $left.IndexOf("L")
$tempItem=$left.substring(0,$pos)
$lot = $left.Substring($pos + 1)
$item=$tempItem.Substring(1)
Write-Host "in_item_key $item in_lot_key $lot imgfilename $name in_cofa_crtdt $timestamp" -fore green
Out-File -FilePath c:\OutputLogs\CofA.csv -Append -InputObject "in_item_key $item in_lot_key $lot imgfilename $name in_cofa_crtdt $timestamp"
start-sleep -s 5
$conn = New-Object System.Data.SqlClient.SqlConnection("Data Source=PVSNTDB33; Initial Catalog=adagecopy_daily; Integrated Security=TRUE")
$conn.Open()
$insert_stmt = "INSERT INTO in_cofa_pvs (in_item_key, in_lot_key, imgfileName, in_cofa_crtdt) VALUES ('$item','$lot','$name','$timestamp')"
$cmd = $conn.CreateCommand()
$cmd.CommandText = $insert_stmt
$cmd.ExecuteNonQuery()
$conn.Close()
#### PACKAGE SHIPPER PROCESS BEGINS ####
elseif ($test -eq $false) {
$pos = $name.IndexOf(".")
$left=$name.substring(0,$pos)
$pos = $left.IndexOf("O")
$tempItem=$left.substring(0,$pos)
$order = $left.Substring($pos + 1)
$shipid=$tempItem.Substring(1)
Write-Host "so_hdr_key $order so_ship_key $shipid imgfilename $name in_cofa_crtdt $timestamp" -fore green
Out-File -FilePath c:\OutputLogs\PackageShipper.csv -Append -InputObject "so_hdr_key $order so_ship_key $shipid imgfilename $name in_cofa_crtdt $timestamp"
Rich Thompson

Hi
Since SQL Server 2000 has been out of support, I recommend you to upgrade the SQL Server 2000 to a higher version, such as SQL Server 2005 or SQL Server 2008.
According to your description, you can try the following methods to check duplicate record in SQL Server.
1. You can use
RAISERROR to check the duplicate record, if exists then RAISERROR unless insert accordingly, code block is given below:
IF EXISTS (SELECT 1 FROM TableName AS t
WHERE t.Column1 = @ Column1
AND t.Column2 = @ Column2)
BEGIN
RAISERROR(‘Duplicate records’,18,1)
END
ELSE
BEGIN
INSERT INTO TableName (Column1, Column2, Column3)
SELECT @ Column1, @ Column2, @ Column3
END
2. Also you can create UNIQUE INDEX or UNIQUE CONSTRAINT on the column of a table, when you try to INSERT a value that conflicts with the INDEX/CONSTRAINT, an exception will be thrown.
Add the unique index:
CREATE UNIQUE INDEX Unique_Index_name ON TableName(ColumnName)
Add the unique constraint:
ALTER TABLE TableName
ADD CONSTRAINT Unique_Contraint_Name
UNIQUE (ColumnName)
Thanks
Lydia Zhang

Qualified Lookup Table in Webdynpro Content Generator

I am trying to build a user interface with the webynpro component generators from the business content deployed on the portal. The problem I face is with qualified lookup tables. From the main table, there is an embedded table which contains the qualified lookup table. I can press the "edit" button to open a pop-up window which shows the details of the qualified link. Unfortunately, on MDM 7.1 SP05, the pop-up window contains a table at the top of the screen that forces the entire window to span the width of the table, which will go on quite far because I have about 20 fields in my qualified lookup table. Below I can enter the values for the individual fields, but it is difficult to use because you have to scroll all the way to the right to select drop down values. Is there a way to remove the summary table from the pop-up window for qualified lookup tables? I havent seen an option in the UI config.

Apparently you can configure the fields that are shown in the pop-up window, but it also limits the fields that are displayed on the iView of the main table.

PSE10 Crashes when searching for duplicate photos

Hello,
I recently upgraded to PSE10 and imported my catalog from a different machine (which had been running XP). Unfortunately, I ended up with a bunch of duplicate entries in the catalog, one with the path c:\users\... the other with c:\my documents\... These paths both point to the same image on the hard drive.
When I try to Search for Duplicate Photos (from Find>By Visual Searches), PSE invariably crashes. I am running PSE10 under Windows 7 (full system info at the end of this message).
Any idea why this might be happening, and is there a different way I can remove the duplicate entries in the catalog?
Thanks,
Chris
Full system info:
Elements Organizer 10.0.0.0
Core Version: 10.0 (20110914.m.17521)
Language Version: 10.0 (20110914.m.17521)
Current Catalog:
Catalog Name: My Photos
Catalog Location: C:\ProgramData\Adobe\Elements Organizer\Catalogs\My Photos\
Catalog Size: 52.3MB
Catalog Cache Size: 391.7MB
System:
Operating System Name: Windows 7
Operating System Version: 6.1
System Architecture: Intel CPU Family:6 Model:5 Stepping:2 with MMX, SSE Integer, SSE FP
Built-in Memory: 3.8GB
Free Memory: 705.3MB
Important Drivers / Plug-ins / Libraries:
Microsoft DirectX Version: 9.0
Apple QuickTime Version: Not installed
Adobe Reader Version: 10.1
Adobe Acrobat Version: Not installed
CD and DVD drives:
F: (hp DVDRAM BUS: 1 ID: 1 Firmware: GT20L)

If I understand well, what you are calling 'duplicates' are duplicate entries in the catalog, the same media being called either by its original path+filename or shortcut path+filename.
The organizer will try open two different files to compare them, but when trying to open the second 'shortcut', the file will be already blocked (in use). That could explain the failure of the comparison for similarity.
Try creating a new catalog with similar images, for instance jpegs and png copies. Does the visual search work ?
About backup and restore : If my supposition is right, that should work if you try to restore to a new custom location with keeping the file structure : the backup should create real file duplicates on different paths. If it works, finding visual duplicate should work, although this process may take a very long time.

Tell me Logic for search for duplicate words(or strings) in a large file.

Search for duplicate words (or strings) in a text file containing one word per line. For each word that occurs more than once in the flat file output should be as follows
<word> <number of occurrences> <line numbers in the file where the word occurs>
For example, if the word Hello occurs thrice in a file at lines 100, 178 and 3456 the output should read
Hello, 3, [100, 178, 3456]

Incidentally i wrote similar code some days back. You need to do some modifications to get the exact output you want, but i hope it will be of some help.
One more thing its written using JAVA5
public class Test
     private static final String COLLECTIONS_TEXT = "C:\\Documents and Settings\\amrainder\\Desktop\\Collections.txt";
     public static void main(String[] args) throws IOException
          findDuplicateWords();
     private static void findDuplicateWords() throws IOException
          Collection<String> words = new LinkedHashSet<String>();
          File file = new File(COLLECTIONS_TEXT);
          StreamTokenizer streamTokenizer = new StreamTokenizer(new FileReader(file));
          int token = streamTokenizer.nextToken();
          while(token != StreamTokenizer.TT_EOF)
               if(token == StreamTokenizer.TT_WORD)
                    words.add(streamTokenizer.sval);
               token = streamTokenizer.nextToken();
          System.out.println(words);
}Cheers,
Amrainder

Query regarding the data type for fetcing records from multiple ODS tables

hey guys;
i have a query regarding the data type for fetcing records from multiple ODS tables.
if i have 2 table with a same column name then in the datatype under parent row node i cant add 2 nodes with the same name.
can any one help with some suggestion.

Hi Mudit,
One option would be to go as mentioned by Padamja , prefxing the table name to the column name or another would be to use the AS keyoword in your SQL statement.
AS is used to rename the column name when data is being selected from your DB.
So, the query Select ename as empname from emptable will return the data with column name as empname.
Regards,
Bhavesh

Duplicate records in the same table

Hello.
I want to duplicate records in the same table, changing just two date fields and id. Id is changed with sequence.
Example:
id name start_date end_date
1 record_1 01.01.04 31.12.04
2 record_2 01.01.03 31.12.03
I want to duplicate record with the start_date year 04 and the duplicated record would change that start_date into year 05.
After duplicate it should look like:
1 record_1 01.01.04 31.12.04
2 record_2 01.01.03 31.12.03
3 record_1 01.01.05 31.12.05
How should my insert look like?
Thanks

create sequence A_SEQ
   start with 3
   nocache
insert into tableA
        (ID, name, start_date end_date)
   select
           A_SEQ.nextval
          ,NAME
          ,start_date + add_months (12)
          ,end_date   + add_months (12)
     from
           tableA
    where
           start_date >= to_date('01.01.2004','dd.mm.yyyy')
      and start_date <= to_date('01.01.2004','dd.mm.yyyy')

Can I search for duplicates in iPhoto 9.2.3?

I believe earlier versions had a "search for duplicates" function.

No, no earlier version did.
For dealing with duplicates in iPhoto check out Duplicate Annihilator or Decloner or iPhoto Duplicate Cleaner

No "search for Duplicates" found in address book

Hey, on my intel imac I've got no "search for duplicates" available to me in Address Book. It shows up in my macbook, and my lampstand powerbook. All three are running 10.4.10, Adressbook is Version 3.1.2 (321)
Also, when I sync with .Mac it doubles up all of my entries in the libraries on both computers.
Any ideas?

AB search should search notes. quit Address book and delete the file homedirectory/library/application support/address book/AddressBook-v22.abcddb. then start Address Book and see if search works correctly now. if it doesn't reindex your hard drive with spotlight. add your hard drive to spotlight's privacy pane for a few seconds and then remove it from there. wait for reindexing to finish and try AB search again.

How can I search for duplicate photos in iPhoto libraries?

How can I search for duplicate photos in iPhoto 9.5.1 library. Installed on iMac 2.7 GHz Intel Core i5, Mavericks 10.9.5.

These applications will identify and help remove duplicate photos from an iPhoto Library:
iPhoto Library Manager - $29.95
Duplicate Annihilator - $7.95 - only app able to detect duplicate thumbnail files or faces files when an iPhoto 8 or earlier library has been imported into another.
PhotoSweeper - $9.95 - This app can search by comparing the image's bitmaps or histograms thus finding duplicates with different file names and dates.
DeCloner - $19.95 - can find duplicates in iPhoto Libraries or in folders on the HD.
DupliFinder - $7 - shows which events the photos are in.
iPhoto AppleScript to Remove Duplicates - Free
PhotoDedupo - $4.99 (App Store) - this app has a "similar" search feature which is like PhotoSweeper's bitmap comparison. It found all duplicates
Duplicate Cleaner for iPhoto - free - was able to recognize the duplicated HDR and normal files from an iPhone shooting in HDR
Some users have reported that PhotoSweeper did the best in finding all of the dups in their library: iphoto has duplicated many photos, how...: Apple Support Communities.
If you have an iPhone and have it set to keep the normal photo when shooting HDR photos the two image files that are created will be duplicates in a manner of speaking (same image) but there are only twp apps that detected the iPhone HDR and normal photos as being duplicates: PhotoSweeper and Duplicate Cleaner for iPhoto. None of the other apps detected those two files as being duplicates as they look for file name as well as other attributes and the two files from the iPhone have different file names.
iPLM, however, is the best all around iPhoto utility as it can do so much more than just find duplicates. IMO it's a must have tool if using iPhoto.

Searching for Duplicates records in Qualified Lookup tables

Similar Messages

Maybe you are looking for