Loading ODS - Data record exists in duplicate within loaded data

BI Experts,
I am attemping to load an ODS with the Unique Data Records flag turned ON. The flat file I am loading is a crosswalk with four fields, the first 3 fields are being used as Key Fields in order to make the records unique. I have had this issue before, but gave up in frustration and added an ascending number count field so simply create a unique key. This time I would like to solve the problem if possible.
The errors come back referring to two data rows that are duplicate:
Data record 1 - Request / Data package / Data record: REQU_4CNUD93Q3RCC80XFBG2CZXJ0T/000003/ 339
Data record 2 - Request / data package / data record: REQU_4CNUD93Q3RCC80XFBG2CZXJ0T/000003/ 338
And below here are the two records that the error message refers to:
3     338     3902301480     19C*     *     J1JD
3     339     3902301510     19C*     *     J1Q5
As you can see, the combination of my three Key Fields should not be creating a duplicate. (3902301480, 19C(asterisk) , (asterisk))   and (3902301510, 19C(asterisk) , (asterisk)) I replaced the *'s because they turn bold!
Is there something off with the numbering of the data records? Am I looking in the wrong place? I have examined my flat file and can not find duplicates and the records that BW say are duplicates are not, I am really having a hard time with this - any and all help greatly appreciated!!!

Thank you for the response Sabuj....
I was about to answer your questions but I wanted to try one more thing, and it actually worked. I simply moved the MOST unique Key Field to the TOP of my Key Field list. It was at the bottom before.
FYI for other people with this issue -
Apparantly the ORDER of your Key Fields is important when trying to avoid creating duplicate records.
I am using four data fields, and was using three data fields as the Key Fields. Any combination of all three would NOT have a duplicate, however when BW finds that the first two key fields match, sometimes it apparantly doesn't care about the third one which would make the row unique. By simply changing the order of my Key Fields I was able to stop getting the duplicate row errors...
Lesson - If you KNOW that your records are unique, and you are STILL getting errors for duplicates, try changing the ORDER of your key fields.

Similar Messages

How to get master data records that do not have transaction data in a query

Hi,
How to get master data records that do not have transaction data in a query output. Can we create a query or any other way to get the master data records that do not have transaction data?

Hi,
Create a multiprovider which includes transactional data target and master data info object. Make sure that identification for this master data info object is ticked on both the provider.
Create report on this multiprovider , keep the master data info object in rows , and now you should able to see all the values which are there in master data info object irrespective of transaction happened or not .
Next you may create condition showing only zero keyfigure values , ie. master data without any transaction.
Hope that helps.
Regards
Mr Kapadia

Revaluate data record at the time of loading from flat file or BI Cube

Hello Friends,
I want to revaluate a data record at time of loading using Transformation or Conversion File, based on some condition.
Like, I have a rule to identify that a record is supposed to be multiplied by -1 or not.
For example,
*if (ID(1:5) = str(00070) then(Record-1)
      ID(1:5) = str(00071) then (Record-2)
Can you please guide me how can I achieve this by using Transformation file or Conversion file?
Regards,
Vishal.

Hi Nilanjan,
Thanks for reply.
I tried the script you suggested in conversion file for Account.
But It is not working for me.
Even I tried simple multiplication and also addition in Formula column it is not working.
External   -->   *
Internal    -->    *
Formula   ---> Value * -1
Above conversion file for Account was not working for me.
then I tried
Formula --> Value + 100
It also did not work for me.
Kindly suggest if I am doing anything wrong in above file.
Thanks,
Nilanjan.

Finding duplicates within a date range. SQL help please!!

I have a table of records and I am trying to query the duplicate emails that appear within a given date range but cant figure it out.
There records that it returns are not all duplicates withing the given date range. HELP!!
Here is my query.
Thanks in advance.
SELECT cybTrans.email, cybTrans.trans_id, cybTrans.product_number, cybTrans.*
FROM cybTrans
WHERE (((cybTrans.email) In (SELECT [email] FROM [cybTrans] As Tmp GROUP BY [email] HAVING Count(*)>1 ))
AND ((cybTrans.product_number)='27')
AND ((cybTrans.appsystemtime)>'03-01-2010')
AND ((cybTrans.appsystemtime)<'03-05-2010')
ORDER BY cybTrans.email;

Yet another method...
<cfset start_date = DateFormat('01/01/2007',
'mm/dd/yyyy')>
<cfset end_date = DateFormat('09/30/2009',
'mm/dd/yyyy')>
<cfset start_year = DatePart('yyyy', start_date)>
<cfset end_year = DatePart('yyyy', end_date)>
<cfset schoolyear_start = '09/01/'>
<cfset schoolyear_end = '06/30/'>
<cfset count = 0>
<cfloop index="rec" from="#start_year#"
to="#end_year#">
<cfset tmp_start = DateFormat('#schoolyear_start##rec#',
'mm/dd/yyyy')>
<cfset tmp_end = DateFormat('#schoolyear_end##rec + 1#',
'mm/dd/yyyy')>
<cfif DateCompare(tmp_start,start_date) gt -1 and
DateCompare(tmp_end, end_date) eq -1>
<cfset count = count + 1>
</cfif>
</cfloop>
<cfoutput>
<br>There are #count# school year periods between
#start_date# and #end_date#
</cfoutput>

Loading data from existing DS to a new data target

Hi All,
I have an active Purchasing ODS 0PUR_O01.
It has 2LIS_02_ITM as data source.
Now, I want to have Purchasing Cube 0PUR_C01, which is inactive in BWD and not present in BWP.
I want this cube to have the same DS i.e 2LIS_02_ITM as data source.
How can I do this?
And before I do this I want to bring 0PUR_C01 as active in BWP. As I know I can do this by transporting it from BWD.
But I want to know what will happen if I activate it from BI content in BWP (if this is possible)?
Thanks and Best Regards

Hello,
Reg to have 2LIS_02_ITM as data source ,u have to create a update rule on 0PUR_C01with the infosource option as 2LIS_02_ITM .
and then map the fields according to your requirement.
It is always advisable to activate the Cube in BWD create a transport request through transport connection and send to BWP.
Hope this helps!
Regards
Dhanya.

Can't load Google Calendar in existing session tab - constantly loading/reloading/re-directing

Please always include:
Operating system (e.g. WinXP): Win XP Pro
Program and version you use to access Google Calendar (e.g. Internet Explorer 7 or Outlook 2003): Firefox (just updated this morning to 3.6.7 and it still isn't working)
Any Sync software you're using or have used (e.g. Google Calendar Sync): Not using
If you're using the non-Apps version of Google Calendar (accessing from google.com/calendar/render) or you're on Google Apps: non - Apps version
If you have any Labs (and which ones) or Offline enabled: I do have both labs (Skip to date, next available reschedule, Year view theme, probably others I don't remember), and Offline enabled
I think it has to do with both google and firefox. I have Google Calendar open in one of my many tabs that open during a session (when I load my last session) as well as other google products. This seems to have been only happening in the past few weeks (or last couple of firefox updates not sure if it is related)
The google calendar tab just stays on a white screen for me and loads and then reloads and then reloads. When I had the accessibility option selected in firefox to warn me when I site tries to redirect. I was able to click allow and it would load. That was annoying on other sites including opening links so I turned that off. I tried turning that back on and that doesn't seem to have helped so I turned it back off again.
I thought it might be helpful to show the web link as well. It looks like I am actually accessing the non-apps version
https://www.google.com/accounts/ServiceLogin?service=cl&passive=1209600&continue=http://www.google.com/calendar/render?tab%3Dmc&followup=http://www.google.com/calendar
At the bottom it says waiting for google.com, then switches very quickly between that and stopped, transferring in no discernible pattern.
I also tried another users suggestion and logged in to igoogle and then signed out there. That allowed me to see the login page on the calendar tab but it won't let me sign in because it is reloading/redirecting too quickly for me to get my password in.
The only way I have found it to close the existing tab that opens with the session and open it in a new tab from another google product as if I was just opening it for the first time. Then I don't have any problems. I updated my firefox today to 3.6.7 hoping that would fix the bug but it didn't so I am posting here. All of these solutions have been work around solutions and I hope that google and/or firefox can fix the issue soon.
It should be noted as well that the goggle calendar widget on the igoogle page is also having issues loading saying the following (below in italics).
"This Connection is Untrusted - You have asked Firefox to connect securely to 11.ig.gmodules.com, but we can't confirm that your connection is secure. Normally, when you try to connect securely, sites will present trusted identification to prove that you are going to the right place. However, this site's identity can't be verified.
What Should I Do?
If you usually connect to this site without problems, this error could mean that someone is trying to impersonate the site, and you shouldn't continue.
Technical Details
11.ig.gmodules.com uses an invalid security certificate.
The certificate is only valid for the following names: *.googleusercontent.com , googleusercontent.com , *.commondatastorage.googleapis.com , commondatastorage.googleapis.com , atgglstorage.com , *.atgglstorage.com , *.s.atgglstorage.com
(Error code: ssl_error_bad_cert_domain)
I Understand the Risks
If you understand what's going on, you can tell Firefox to start trusting this site's identification. Even if you trust the site, this error could mean that someone is tampering with your connection. Don't add an exception unless
you know there's a good reason why this site doesn't use trusted identification.
== URL of affected sites ==
https://www.google.com/accounts/ServiceLogin?service=cl&passive=1209600&continue=http://www.google.com/calendar/render?tab%3Dmc&followup=http://www.google.com/calendar

Welcome. These Apple Support Community forums are for users helping users and sharing solutions. Apple doesn't provide support directly through these forums. If you do need to contact Apple Support directly, you can go here http://www.apple.com/support/ and start by selecting the product or software, visit your local Apple Store, or get phone numbers from this page http://support.apple.com/en-us/HT201232

Getting duplicate data records for master data

Hi All,
When the process chain for the master data, i am getting duplicate data records and , for that selected the options in Info package level under processing 1)a update PSA and subsequentky data targets and alternateely select the option Ignore double data records. But still the load was failing and error message "Duplicate Data Records" after that rhe sehuduled the Info package then i am not getting the error message next time,
Can any one help on this to resolve the issue.
Regrasd
KK

Yes, for the first option u can write a routine ,what is ur data target--> if it is a cube, there may be a chances of duplicate records because of the additive nature.if its a ODS then u can avoid this, bec only delta is going to be updated.
Regarding the time dependant attributes, its based on the date field.we have 4 types of slowly changing dimensions.
check the following link
http://help.sap.com/bp_biv135/documentation/Multi-dimensional_modeling_EN.doc
http://www.intelligententerprise.com/info_centers/data_warehousing/showArticle.jhtml?articleID=59301280&pgno=1
http://help.sap.com/saphelp_nw04/helpdata/en/dd/f470375fbf307ee10000009b38f8cf/frameset.htm

Data records missing from 2lis_13_vditm

Hi
1.)2LIS_13_VDITM data loaded but certain billing items are missing.
2.)I figured out how to create a repair request to manually load individual records.
3.)Loading works in BWD development where not so many records exist
4.)In BWP it does not pick the individual records I select since there are too many data records existing (table to big)
Any idea how we can load the individual records which failed to load from psa to cube on that particular day without creating duplicate records in BW.even if the request are compressed.
thankyou in advance

There is an interesting thread on this discussion. check this out.
A BW puzzle for you...I'll Award POINTS!
The OSS note 739863 will give you some idea to fix your problem.
This is applicable if you are missing 20th data and getting all the Delta data after that!
If you are not getting any Delta after that, then you need to check your update methods, particularly Collective Run, if you are using the V3 Update.
Regards,
Sree
Message was edited by: Sree Damodararaj

Unique data record means you can't update a record from ECC with same key.

Unique data record means you can't update a record from ECC with same key fileds right?
Details: For example i have two requests Req1 and Req2 in DSO with unique data record setting checked. on day one Req1 has a filed quantity with value 10 in Active data table. On day two Req1 can not be overwitten from ECC with Req2 with the same key fields but different value 20 in the filed quantity because of the Unique data record settings. finally the delta load fails from ECC going to DSO because of this setting. is it right?
I think we can only use unique record setting going from DSO to cube right?
Please give me a simple scenario in which we can use this setting.
I already search the threads and will assign points only to valuable information.
Thanks in advance.
York

Hi Les,
Unique Data Records:
With the Unique Data Records indicator, you determine whether only unique data records are to be updated to the ODS object. This means that you cannot load a data record into the ODS object the key combination for which already exists in the system otherwise a termination occurs. Only use this setting when you are sure that only unique data records are to be loaded into the ODS object (for example, single documents). A typical application of this is in the loading of mass data. It improves the load performance.
Hope it Helps
Srini

Database changes between data records of PSA

Hi all,
Does anybody know a way, how to flush or commit database change between processing each data record from PSA by transfer rules?
I have some routines in transfer rules (updating attributes of master data from datasource), where I need values from exactly previously processed data record. But SELECT from /BIC/Q... table gives me no changes of these values
Command of selection is written correctly, because it gives me new values in next run of DTP process.
And little explanation, what I'm trying to achieve:
In PSA I have account, date and value and I need count, how this value changed for a concrete day and store this value to time-dependent attribute of master data. All data records with the same key (duplicate record) overwrite the result of previously one, so only last one is stored in master data.
Shortly, I need something like aggregation ADDING of routine in transfer rule detail, but able to catch duplicate records.
Thank you for any idea.
Regards, Filip

Some note about investigation process.
I tried change my data flow and made the same transfer rules from data source to ODS, if it will behave in different way.
I have found data records correctly collected (agregated) in New data of ODS, but EMPTY in active data! So I think, the something similar happend in case of updating master data, and that's why I didn't saw any agregation.
There is no need to call-out database changes, but this problem is kind od anythink else
This shoud be for a new thread, but how can keyfigures become empty after activation?? I've searched forum and found only a case, when End routines are implemented and they skip update rules, whitch are initial. This is not my case.
Nice to hear from you any ideas. Thankx for reading.
Filip

How to get the Data Record Number in BI 7.0?

Hi All,
In our requirement we need to load the Data Record Number in the DSO. I got the Request ID and Data Packet Number but not the Data Record Number.
Does anyone has any idea?

Hi......
When the data is activated in DSO, it is written to the table of active data, where it is then available for reporting. Requests are sorted by the key of the DataStore object, request ID, data package ID, or data record number.
You just load the data to the DSO.....and activate it.......it will autometically get generated.......You cannot load it from one DSO to other beacuse in this case Change log table is used........and this filed is in active table..........I think you need this fir reporting purpose.....so load it and activate the DSO......then it will be available in your active table for reporting.........because reporting is done on active table.......
Check this link :
http://help.sap.com/saphelp_nw04s/helpdata/en/a9/49453cabf4ef6fe10000000a114084/frameset.htm
Hope this helps you....
Regards,
Debjani....
Edited by: Debjani Mukherjee on Sep 16, 2008 5:22 PM
Edited by: Debjani Mukherjee on Sep 16, 2008 5:25 PM

How to check the master data records in using SE16 transaction?

Hi,
Can you please help me to check the master data records using SE16 transaction?
Loaded master data for Characteristic and want to check the records in the master data tables.
Thank you for your help!
Lakshmi

Hi!
Welcome to SDN.
you have to check the master data tables.
soo in Se16 you have to select the appropriate master data table and view the data.
following thread explains about masterdata tables
MasterData table?
regards
mohan
Message was edited by:
Mohan Krishna

Data record with time interval error

Hi,
I have come across the following error.
Data record with Time interval error and data is getting loaded into data target and no PSA in between.
thanks
kris

Hi Kris,
Could you please explain your problem little bit more. I mean what is source and target, or you using IP or DTP.
goto the details in monitor tab, you will come to know to which record yo uhave error.
If you are running IP, it is recommended to keep PSA.
Regards,
Venkatesh

MEMASSPO-Data Records to be created

Dear All,
In MEMASSPO when we select "Purchase Order Item" & execute it,We get two tabs, one for Data Records to be changed & second for Data Records to be created.
What is the use of second one?
I have a scenario wherein we want to delete all existing PO for some materials & add new material codes in same PO.
Is it possible by MEMASSPO or it requires some BDC/LSMW to created.
Thanks,
Nandan.

Hi,
You can not replace the Material nos. exists in PO by using mass transaction.
Even you can remove the material no. in Po after saving..you have to flag for deleteion and add new line item with correct material.
Thanks,
Kumar Arcot

(8I) SQL*LOADER에서 | (PIPE LINE)을 RECORD SEPARATOR로 사용하기

제품 : ORACLE SERVER
작성날짜 : 2003-10-21
===============================================================
(8I) SQL*LOADER에서 | (PIPE LINE)을 RECORD SEPARATOR로 사용하기
===============================================================
PURPOSE
Oracle8i부터는 , SQL*Loader을 사용할때 record terminator을 지정할 수 있게
되었다.
Explanation
Oracle8i 이전에는 record seperator로 default로 linefeed(carriage return,
newline 등)였다. 이전에는 VAR 또는 FIX 등의 적당한 file을 다루기 위한 옵션을
주어야 하기 때문에 복잡한 감이 있었고 flexible하지 못했다.
Oracle8i부터는 , SQL*Loader을 사용할때 record terminator을 지정할 수 있게
되었다. newline 또는 carriage return 문자를 포함하는 data 또는 special 문자를
포함하는 data를 load하고자 할때 record terminator를 hexadecimal로 지정하여 활용할 수 있다.
Example
다음의 예제는 '|' (pipe line)을 record separator로 사용한다.
record separator를 사용하기 위해서 SQL*Loader의 control file에 'infile'절에 적당한 값을 지정하여야 한다.
아래의 예는 '|' (pipe line)을 사용하기 위해서
"str X'7c0a'"을 'infile'절에 지정하였다.
--controlfile : test.ctl
load data
infile 'test.dat' "str X'7c0a'"
into table test
fields terminated by ',' optionally enclosed by '"'
(col1, col2)
--datafile: test.dat
1,this is the first line of the first record
this is the second|
2,this is the first line of the second record
this is the second|
SQL> desc test
Name Null? Type
COL1 VARCHAR2(4)
COL2 VARCHAR2(100)
$ sqlldr scott/tiger control=test.ctl log=test.log
load된 data을 보면 아래와 같이 carriage return이 들어가 있는 data가 한 column에
제대로 들어간 것을 볼 수 있다.
SQL> select * from test;
COL1
COL2
1
this is the first line of the first record
this is the second
2
this is the first line of the second record
this is the second
RELATED DOCUMENT
<Note:74719.1>

Loading ODS - Data record exists in duplicate within loaded data

Similar Messages

Maybe you are looking for