Delete records during import new records. Filtering / matching?

During SRM MDM Catalogue import we are making use of the Import Server component.
We defined one Port to import all supplier catalogues. In the port, we enter the Import map which is to be used for all suppliers. All suppliers deliver their catalogue in a predefined and fixed format.
The functionality we want to achieve is more or less described at help.sap.com:
http://help.sap.com/saphelp_srmmdm20/helpdata/en/30/96cbb9f3cd40b5bfc4cef178880e66/content.htm
At this moment we do not succeed in getting this done. The following example illustrates the issue:
Current catalogue
Supplier        Supplier part.no.
1000            8000
1000            8001
1000            8002
1001            8001
1001            8001
1001            8002
Supplier 1000 comes with a new file containing the current assortment.
1000     8000 has not changes
1000     8001 is changed (update)
1000     8002 no longer exist and is not part of the new file.
During record matching we have the combined matching fields Supplier and Supplier part.no.
A filter on all suppliers has the side effect that the other 4 products are deleted from the catalogue (so also 3 products from supplier 1001).
A filter on only supplier 1000 is not wanted, because we would then need an individual import map for all suppliers. The result of this would also be: as many Ports, Import Server Ready folders and Import maps as we have suppliers in the catalogue.
Wanted situation: How can we determine that entry 1000 u2013 8002 needs to be deleted? (Without help of multiple Ports, Ready folders and Import maps).
We are looking forward to be receiving your reply.

The answer is given in Patch 4.
Note 1292931. https://service.sap.com/sap/support/notes/1292931
After this patch dynamic filtering can be done. See copy text from note below.
For more info look at article on SDN Using Dynamic Record Filtering in MDM Import Manager. https://www.sdn.sap.com/irj/scn/go/portal/prtroot/docs/library/uuid/d0245870-0adf-2b10-46a8-ca9dcf8e1a4d
We have not yet implemented it but is seems to solve the problem.
Kind Regards,
Job Jansen
Extract Note 1292931:
MDM Import Manager:
Enhanced: Support for dynamic source/destination filter. Added a virtual value "[Mapped Values]" into the matching fields filter. When this value is selected, ImportManager and MDIS will substitute it with all the map values of the lookup field during record matching. This creates a generic map that supports source/destination filters that are based on map values instead of fixed values.
Edited by: Job Jansen on Mar 19, 2009 3:36 PM

Similar Messages

Change/new/delete highlighting during import process

Hi everyone,
I intend to use SAP NW MDM to consolidate master data from external sources.
During the import process, I would like to see a highlighting of all new, of all deleted and of all changed records. The reason herefore is the following: before I actually load the imported data into my MDM repository, I want to check the data. Just in case, some corupt data was loaded.
Can I do this in the MDM Import Manager?
Best regards, Daniel

hi,
Whenever an imported record is new or changed, a timestamp could be set (which is most likely set already anyway). After importing the data I could run a routine which shows me all records that have not been updated. I could then delete these records or set them as "inactive".
What do you think about this workaround? Is it feasible in MDM?
Yes this is feasible in MDM. Whenever one record is changed / updated by user, the record will be updated along with the timestamp.
you can view this in data manager.
if you want to select some records and mark them as inactive, you have to create a field.
hope this may help you,
Regards,
Srinivas

Can't delete event or import new events to ical

Hi,
My ical is hung up on an appointment I cannot delete. This is the error message I get. My ical quit working when this appointment repeatively posted for years. I tried to delete it and it won't go away nor can I import events ot appointments to ical.
How do I fix this?
Access to “eArtVolution & the IAE” in “Home” in account “[email protected]” is not permitted.
The server responded:
“403”
to operation CalDAVWriteEntityQueueableOperation.
Many thanks!
lisa

Is there anything at all related to this freeze in the Windows Event Viewer?
Are you able to add, remove, or move pages in a new document? Are you able to export a new document to .idml?
Yes, it is able!
It sounds like there may be a corrupt bit of text, or an image in the file. It may be possible to isolate a page, and then an object, using "Divide and Conquer."
Start with a copy of the file, for safety. Try to export the front half and the back half separately. If either half crashes, divide it in half aand try to export those halves. Repeat the process until you have isolated a page that crashes. Now remove half the objects from that page and try to export. If it works, put those back and remove the other half and try again. Repeat as above until you isolate an object.
Thank you, I will try!
After that i will back to you with my comments!
Thank you again, Peter!

Filemaker Pro Import New Records

I am trying to import only new records from a coom delimted file into my filemaker data base. Each time I import, all of the records get imported and not just the ones with new id numbers. This is a list of about 9000 records and it would be very time consuming to weed out all of the duplicates. Does anyone have a solution for this?
Any ideas would be welcome.
AKS

Hi Con,
As a practical scenario, your file may contain records for update as well as create action during imports process.
MDM has got a standard functionality for this as a import action which can be sent at a global level or at a record level based on the matching criteria.
The process is as below:
1. Select the source and destination
2. Do field mapping
3. Select fields for Value Matching (These fields are used to identify duplicates)
4. Based on a match type the import action can be defined as a global action.
For individual records, you can set the action in below Record Matching window.
Hope this clarifies.
Regards,
Sambhaji
If this has answered you question, kindly change the status of question to "probelm resolved" and very helpful answer.

Import New Records

Hello
I have a file to import to MDM that contains both Updates to existing records and Adding of new records.
In the Match records I see that the new records are being shipped. (as there is no match to any record in MDM)
Can anyone suggest how I can handle this situation?
We need to do both update and create on import
Regards
Con

Hi Con,
As a practical scenario, your file may contain records for update as well as create action during imports process.
MDM has got a standard functionality for this as a import action which can be sent at a global level or at a record level based on the matching criteria.
The process is as below:
1. Select the source and destination
2. Do field mapping
3. Select fields for Value Matching (These fields are used to identify duplicates)
4. Based on a match type the import action can be defined as a global action.
For individual records, you can set the action in below Record Matching window.
Hope this clarifies.
Regards,
Sambhaji
If this has answered you question, kindly change the status of question to "probelm resolved" and very helpful answer.

(Administration - Marketing - Import), you can set a parameter value "Import mode" for what to do in case of duplication as "update existing records", "Import new records". The final report of this import is presented as a text file that can be viewed in

Administration - Marketing -> Import, you can set a parameter value "Import mode" for what to do in case of duplication as "update existing records", "Import new records". The final report of this import is presented as a text file that can be viewed in Business Administration - Marketing -> Import -> Exceptions. Whatever the exception, including duplication import occurs during import and recorded in a text file. What are the fields that determine the duplicity? How I can I can change those?

You will be returned anything that is in the option's value parameter. What is displayed in the dropdown and what is put in the value attribute do NOT need to be the same, so maybe you should start there.

Can't delete master record when matching when matching detail record exist

Hi
on the rel. property:
Delete Record Behaviour = cascading
Prevent masterless Operation =yes
Automatic Query = yesCan't delete Record Master & Detail...
On delete getting error msg.
Can't delete master record when matching when matching detail record exist
am i missing something...!
Regards,
Abdetu...

First of all, remember the ripple affect of cascading deletes and updates.
Oracle database allows creating master/detail relationship between tables using foreign keys and allows cascading deletes by defining the FOREIGN KEY constraint with ON DELETE CASCADE clause.
Oracle Forms on the other hand, handle cascade delete thing internally when you set the relation properties.
Now if you have 3 tables with MASTER->DETAIL1->DETAIL2 relationship and you have a form defined with MASTER->DETAIL1 relationship only, it won't let you delete (and save) master or detail record since the third table (DETAIL2) is referencing the rows from DETAIL1 which you are trying to delete.
If DETAIL2 were present on the form, it would have deleted with relation property CASCADING. If you really want that when you delete a master record, all its details should be deleted too, then consider defining FOREIGN KEY constraints with ON DELETE CASCADE and on the form set relation property CASCADING.
And if all master/detail tables are on your form and still it is not allowing you to delete master with cascading, there must be some code preventing it. Check triggers like ON-DELETE, KEY-COMMIT etc what they are doing.

Workflow problem during import of record

Hi,
We get the following error message during import of a record using import manager:
4868 2008/05/05 15:12:44.861 Error: RC: 0x80000002
4868 2008/05/05 15:12:44.861 Error: Failed to GetJoinCheckOutRights. [Owner: WF Owner; Job Id: 10165]
Currently we run MDM 5.5 SP6 Patch 2. This worked fine before we applied patch 2.
The record is getting checked out in the start step. If I don't check out the record it's working fine.
Any ideas?
BR
Michael

Hi Michel,
In the start step of Workflow there is an option as check out records(yes,no). select yes, when record will enter into the workflow it will get check out and no user will be able to modify that record throughout the workflow cycle.I you want that the record shoukd be modyfied at some step during workflow then you have to give rights (Join CheckOut )to the user of that Particular step.For That login with the user which is the Owner of the workflow now rightclick onthe record or records and check in\out->Modify Join Permissions->either add a user or a role.This will allow that added user to Join check out and modify the Record(right clik on record ->join check out).Then that User will be able to modify the records.
Reward if Helpfull.
With Regards,
Vinay Yadav

HT204406 I recently uploaded a live recording to match. Plays when I listen in "recently added" playlist, but will not play in a new playlist "ineligible" cloud symbol appears

I recently uploaded a live recording to match and it appears (and plays) under "recently added" on the left menu. When I create a new playlist for this music it won't play and has the "ineligible" cloud symbol with slash through it. It must be in the cloud as it's playing now, but the content will not play if moved from "recently added" into a playlist. I'm puzzled. Any help?
Bit rate is 192 kbps
it is an mpeg file
Thanks in advance!

I just went back and used Tunesify to convert from mp3 to aac format and it's working now. I've added over 20K to my match library and this is the 1st time something like thas has happened.

Automatically deleting records

Hello.
Is it possible to delete a record automatically in a workflow (based on some criteria)?
Regards, Anders

Hi Anders,
We want to use MDM for our catalog (100' products/materials). In this catalog we have priceconditions (4 millions) and these priceconditions has an expired date and I want to delete records that has expired. I also have an issue when I do the import of the priceconditions. The files containes products/materials that I don't have in my catalog, thus I don't want to import these. This has become a problem, I have tried to set the MDIS unmapped handlig to fail, but this makes the importing of the priceconditions very slow. Thus I thought I could map them to NULL and then run a workflow where I could delete the unwanted records (but as you replayed earlier, an other workaround for this has to be done).
According to me, For the first half of your problem, where you want to delete the records whose price conditionds have expired.
What you can do is a Search based on Pricing Condition. That will fetch you the records which you want to delete. You will have to delete these records manually. There is no other way to delete records automatically.
For the second half of the problem, where the Import File has some new Materials/Products which you do not want to import.
You can deal with this problem by selecting a proper matching Field. And then Select the proper Default Import Action.
You will have to choose "Skip" for the new materials which do not want to Import. If you only want to update the materials which are already existing in MDM, then you will have to choose " Update All Map fields". Save both these properties in a map if your requirement is consistent.
I hope I have understood your requirement correctly.
Hope it helps.
Thanks and Regards
Nitin jain

Is there a way to delete records from MDM automatically?

Is there a way to delete records from MDM automatically?
I am able to import the data automatically through MDIS, but I have to delete the data first. Itu2019s possible to do it ?

Hi Adam,
Current scenario
USER1: call ME to delete old catalog data
ME: open the MDM & delete it manually
USER1: Transaction to extract new data file
MDIS: load the data to catalog
As per your requirement, you should save map in following way which can solve your purpose. Create a XML file which should consist of new and existing records. So in import Manager, for newly added records you need to set Default Import Action as Create and for existing records you should use or set Default Import Action as Replace and then should save in map.
So using this every-time if new record comes (not available in data manager), it will get created and for existing record (already available in Data Manager) it will replace (which means delete the existing record (old catalog data) and create a new record).
Regards,
Mandeep Saini

Best approach to delete records that are not in the source table anymore.

I have a situation where I need to remove records from dimensions that are not in the source data anymore. Right now we are not maintaing history, i.e. not using SCD but planning for the next release. If we did that it would be easy to figure the latest records. The load is nightly and records are updated and new added.
The approach that I am considering is to join the dimension tables the the sources on keys and delete what doesn't join. However, is there perhaps some function in OWB that would allow to do this automatically on import so it can be also in place for the future?
Thanks!

Bear in mind that deleting dimension records becomes problematic if you have facts attached to them. Just because this record is no longer in the active set doesn't mean that it wasn't used historically, and so have foreign key constraints on it in your database. IF this is the case, a short-term solution would be to add an expiry_date field to the dimension and update the load to set this value when the record disappears rather than to delete it.
And to do that, use the target dimension as a source table, outer join it to the actual source table on the natural key, and so your update will set expiry_date=nvl(expiry_date,sysdate) to set to sysdate if this record has not already been expired on all records where the outer join fails.
Further consideration: what do you do if the record is re-inserted into the source table? create a new dimension key? Or remove the expiry date?
But I will say that I am not a fan of deleting records in most circumstances. What do you do if you discover a calculation error and need to fix that and republish historical cubes? Without the historical data, you lose the ability to do things like that.

[DW MX 2004] DELETE RECORD

Hi,
I can't DELETE RECORD in LOCAL SERVER (MySQL Server 5.0)
and REMOTE SERVER , but INSERT AND UPDATE WORKS.
Page code is
<?php require_once('../Connections/connpuntofermo.php');
?>
<?php
session_start();
$MM_authorizedUsers = "";
$MM_donotCheckaccess = "true";
// *** Restrict Access To Page: Grant or deny access to this
page
function isAuthorized($strUsers, $strGroups, $UserName,
$UserGroup) {
// For security, start by assuming the visitor is NOT
authorized.
$isValid = False;
// When a visitor has logged into this site, the Session
variable
MM_Username set equal to their username.
// Therefore, we know that a user is NOT logged in if that
Session
variable is blank.
if (!empty($UserName)) {
// Besides being logged in, you may restrict access to only
certain
users based on an ID established when they login.
// Parse the strings into arrays.
$arrUsers = Explode(",", $strUsers);
$arrGroups = Explode(",", $strGroups);
if (in_array($UserName, $arrUsers)) {
$isValid = true;
// Or, you may restrict access to only certain users based
on their
username.
if (in_array($UserGroup, $arrGroups)) {
$isValid = true;
if (($strUsers == "") && true) {
$isValid = true;
return $isValid;
$MM_restrictGoTo = "index.php";
if (!((isset($_SESSION['MM_Username'])) &&
(isAuthorized("",$MM_authorizedUsers,
$_SESSION['MM_Username'],
$_SESSION['MM_UserGroup'])))) {
$MM_qsChar = "?";
$MM_referrer = $_SERVER['PHP_SELF'];
if (strpos($MM_restrictGoTo, "?")) $MM_qsChar = "&";
if (isset($QUERY_STRING) && strlen($QUERY_STRING)
> 0)
$MM_referrer .= "?" . $QUERY_STRING;
$MM_restrictGoTo = $MM_restrictGoTo. $MM_qsChar .
"accesscheck=" .
urlencode($MM_referrer);
header("Location: ". $MM_restrictGoTo);
exit;
?>
<?php
function GetSQLValueString($theValue, $theType,
$theDefinedValue = "",
$theNotDefinedValue = "")
$theValue = (!get_magic_quotes_gpc()) ?
addslashes($theValue) : $theValue;
switch ($theType) {
case "text":
$theValue = ($theValue != "") ? "'" . $theValue . "'" :
"NULL";
break;
case "long":
case "int":
$theValue = ($theValue != "") ? intval($theValue) : "NULL";
break;
case "double":
$theValue = ($theValue != "") ? "'" . doubleval($theValue) .
"NULL";
break;
case "date":
$theValue = ($theValue != "") ? "'" . $theValue . "'" :
"NULL";
break;
case "defined":
$theValue = ($theValue != "") ? $theDefinedValue :
$theNotDefinedValue;
break;
return $theValue;
if ((isset($_GET['ID'])) && ($_GET['ID'] != "")) {
$deleteSQL = sprintf("DELETE FROM news WHERE ID=%s",
GetSQLValueString($_GET['ID'], "int"));
mysql_select_db($database_connpuntofermo, $connpuntofermo);
$Result1 = mysql_query($deleteSQL, $connpuntofermo) or
die(mysql_error());
$deleteGoTo = "ok-cancella.php";
if (isset($_SERVER['QUERY_STRING'])) {
$deleteGoTo .= (strpos($deleteGoTo, '?')) ? "&" : "?";
$deleteGoTo .= $_SERVER['QUERY_STRING'];
header(sprintf("Location: %s", $deleteGoTo));
mysql_select_db($database_connpuntofermo, $connpuntofermo);
$query_rs_elenco = "SELECT ID, `data`, titolo FROM news ORDER
BY ID DESC";
$rs_elenco = mysql_query($query_rs_elenco, $connpuntofermo)
or
die(mysql_error());
$row_rs_elenco = mysql_fetch_assoc($rs_elenco);
$totalRows_rs_elenco = mysql_num_rows($rs_elenco);
?>
<html>
<head>

<title>amministrazione Piadineria Punto
Fermo</title>
<meta
http-equiv="Content-Type"
content="text/html; charset=iso-8859-1"><style
type="text/css">

</style>
<link href="../css/style.css" rel="stylesheet"
type="text/css">
<style type="text/css">
@import "news/domnews.css";
</style>
<script type="text/javascript"
src="news/domnews.js"></script>

</head>
<body>
<table width="100%" height="100%" border="0"
align="center" cellpadding="0"
cellspacing="0">
<tr>
<td align="center" valign="middle"><table
width="760" height="430"
border="0" align="center" cellpadding="0" cellspacing="1"
bgcolor="#A7B339">
<tr>
<td width="779" align="left" valign="middle"
bgcolor="#FFFFCC"><table width="760" height="334"
border="0" cellpadding="0"
cellspacing="0">
<tr>
<td align="center"
class="body"><strong>AMMINISTRAZIONE SITO
PUNTO FERMO </strong></td>
</tr>
<tr>
<td
height="42"
align="center" valign="top" class="body"><a
href="menu.php"
class="body">torna
a menù principale </a></td>
 </tr>
<tr>

<td align="center" valign="top"
class="body"><p>ELENCO NEWS
INSERITE</p>
<table width="505" border="0" cellpadding="5"
cellspacing="1"
bgcolor="#999999" class="body">
<tr bgcolor="#FFFFA8">
<td>ID</td>
<td width="104">DATA</td>
<td width="134">TITOLO</td>
<td width="110"> </td>
<td width="112"> </td>
</tr>
<?php do { ?>
<tr align="left" valign="top" bgcolor="#FFFFCC">
<td><?php echo $row_rs_elenco['ID'];
?></td>
<td><?php echo $row_rs_elenco['data'];
?></td>
<td><?php echo $row_rs_elenco['titolo'];
?></td>
<td><a href="mod-news.php?ID=<?php echo
$row_rs_elenco['ID']; ?>"
class="body">MODIFICA</a></td>
<td><form name="elimina1" method="post"
action="">
<input type="submit" name="Submit" value="ELIMINA">
</form></td>
</tr>
<?php } while ($row_rs_elenco =
mysql_fetch_assoc($rs_elenco)); ?>
</table>
<p> </p></td>
 </tr>
<tr>
<td> </td>
</tr>
</table></td>
</tr>
</table> </td>
</tr>
</table>
</body>
</html>
<?php
mysql_free_result($rs_elenco);
?>
Where is error?
Thanks.

MX 2004 was always a bit "gummy" on this. Instead of using the DW wizard, I downloaded a free version of Microsoft SQL Server Express Edition. I use that for all table Inserts, Updates,etc. This accesses the tables directly on the server. Nothing needs to be synced, put, gotten or whatever. Use DW for Form and UI creation and making prebuilt queries.
Hope that helps
Jerry H

Help with update,add, delete records

Hi every one,
This is a problems that I have been trying to figure out for
a little while now and I hope you all can help me out. So this is
the situation.
I am useing CFX XLS 2 Query to create a query from an excel
doc I have. Now my problem is how can I loop through and delete the
records that no longer are in the spreadsheet?
So in other words my client will be uploading a new XLS each
day, this xls will have some new data, some of the same and some
will be gone. So I need the system to check and see if the
stocknumber is there, if it is it will just update that record, now
if the record is new it will add the record but for the life of me
I can't figure out how it can delete record.
I had thought maybe doing a select where the stock numbers
dont match but that didnt work out too well :)
Thanks for any help you may be able to provide

You could consider using ValueList() to create a list of
stocknumbers from your excel query, then do something like this:
<cfset sCurrentStockNumbers =
ValueList(myQuery.stocknumber)>
<cfquery name="removeStockNumbers"
datasource="myDataSource">
DELETE from myTable
WHERE stocknumber NOT IN (<cfqueryparam
value="#sCurrentStockNumbers#" list="Yes">)
</cfquery>

What is the best approach to track deleted records

Dear all,
We have build a CMS platform which is based on SQL server 2012 tables structure hosted in Azure.
We have build on top of this some REST API method in order to access data from any type of client application.
The issues we need to solved now is what his the best way to track deleted records in order that client application gets informed through web service about deleted data from our CMS.
We were thinking of 2 path actually :
- having a kind of Ghost table for each of our real table where deleted records will be inserted into ( physical delete ). This would mean adding as many Ghost tables as we have production tables
- Adding a IsDeleted flag to each of our table which will be set to true when a record is deleted from our CMS ( logical delete ). This would means adding an IsDelete field to each of our tables, create and update all our store procedure and web services
in order to taken in account that new filter criteria to fetch our records. Quite huge job
Will there be any other approach ?
We are looking the best solution with minimum impact on our current solution
reagards
Your knowledge is enhanced by that of others.

Hello,
@Tom, based on your question
"The question would be what do you need to do with the deleted records and how long do you need to keep them?"
When records is deleted, then I simply want to delete them and informed any client application about deleted items in order to get data in Sync. I will not have any reporting on deleted data !
The only reason of tracking delete tables items, is simply to informed client application through web service sync about the data to be ignored. Client application have a caching database records for performance reason and is is require to not used data
from that local storage which has been reported as deleted by the SQL server on Aure.
Does this make sense ?
regards
Your knowledge is enhanced by that of others.

Delete records during import new records. Filtering / matching?

Similar Messages

Maybe you are looking for