How to set from and to date correctly on an incremental ETL for grouping granuality

Hi,
I have a principle design question that is relevant for any ETL tool.
I have a three field record with Id,groupId, timeKey
For example records can be:
1,1,01012014
2,1,01012014
3,1,01022014
I need to group the records to on groupId according to increment timekey.
Select groupId
where timekey = 010102014
The groupId needs to be a primary Key
The issue is - That there will always be records that will be split by the timekey in the increment load, and then the situation can be that the groupId will get duplicate.
In this example - groupId 1 will be selected twice for two different timekeys.
So the question is - What can be a best practice for avoiding the above situation in the increment load ?

How can GroupID be a primary key. As per the displayed sample it will never be PK. As I understand its a group identifier so you're going to have same id for all records within a group. Ideally I think combination of groupid + datekey would be primary key.
And in case incremental load picks up data for multiple days you need to ensure it generates a separate groupid for each date.
Currently how is groupid generated? does it come from source or is it generated within ETL?
Please Mark This As Answer if it helps to solve the issue Visakh ---------------------------- http://visakhm.blogspot.com/ https://www.facebook.com/VmBlogs

Similar Messages

  • ALV Report how to display from and to date values in the header.

    I develoeped alv report . i want to display selection screen from and to date values in  top of page...
    any sample code pls guide me..

    You have to do many things...
    first find the selection details using the FM.
    RS_REFRESH_FROM_SELECTOPTIONS
    use the Blog to Align/populate the Header  from the selection table
    /people/community.user/blog/2007/05/07/alignment-of-data-in-top-of-page-in-alv-grid

  • There used to be a preview window in mail where you could read the message in the mail box but now its gone. It just shows me who its from and the date. I now have to click on the message twice to get it to display. How do I get the preview box back?

    There used to be a preview window in mail where you could read the message in the mail box but now its gone. It just shows me who its from and the date. I now have to click on the message twice to get it to display. How do I get the preview box back?

    There is a bug in Mail triggered by receiving a password-protected PDF as an attachment. According to reports, the bug is fixed in OS X 10.8.5.

  • How to retrieve start and end date values from sharepoint 2013

    Hi,
    How to retrieve start and end date values from new event form of calendar in SharePoint foundation2013
    Thanks
    Gowri Balaguru

    Hi Srini
    Yes i need to have parallel flow for both and in the cube where my reporting will be on monthly basis i need to read these 2 master data and get the required attributes ( considering last/first day of that month as per the requirement).......but i am just wondering this is common scenario....while there are so many threads written for populating 0employee from 0person......don't they have such requirement.....
    Thanks
    Tripple k

  • How to find when and what date my iphone was first switched on from a retailer

    how to find when and what date my iphone was first switched on from a retailer

    Depending on the Code version you are running you can look for this output . It will show when a SFP was removed and inserted.
    module-2# show port-config internal all  (This command wil differ of earlier versions of SAN OS )
    Mar 20 08:53:45 2011  00449361  fc2/20         ---   DOWN   Xcvr inserted          
    Mar 20 08:53:32 2011  00829429  fc2/20         ---   DOWN   Disable                
    Mar 20 08:53:32 2011  00826403  fc2/20         ---   DOWN   Disable                
    Mar 20 08:53:32 2011  00818936  fc2/20         ---   DOWN   Xcvr removed  

  • How to update link and import data of relocated incx file into inca file?

    Subject : <br />how to update link and import data of relocated incx file into inca file.?<br />The incx file was originally part of the inca file and it has been relocated.<br />-------------------<br /><br />Hello All,<br /><br />I am working on InDesignCS2 and InCopyCS2.<br />From indesign I am creating an assignment file as well as incopy files.(.inca and .incx file created through exporing).<br />Now indesign hardcodes the path of the incx files in inca file.So if I put the incx files in different folder then after opening the inca file in InCopy , I am getting the alert stating that " The document doesn't consists of any incopy story" and all the linked story will flag a red question mark icon.<br />So I tried to recreate and update the links.<br />Below is my code for that<br /><br />//code start*****************************<br />//creating kDataLinkHelperBoss<br />InterfacePtr<IDataLinkHelper> dataLinkHelper(static_cast<IDataLinkHelper*><br />(CreateObject2<IDataLinkHelper>(kDataLinkHelperBoss)));<br /><br />/**<br />The newFileToBeLinkedPath is the path of the incx file which is relocated.<br />And it was previously part of the inca file.<br />eg. earlier it was c:\\test.incx now it is d:\\test.incx<br />*/<br />IDFile newIDFileToBeLinked(newFileToBeLinkedPath);<br /><br />//create the datelink<br />IDataLink * dlk = dataLinkHelper->CreateDataLink(newIDFileToBeLinked);<br /><br />NameInfo name;<br />PMString type;<br />uint32 fileType;<br /><br />dlk->GetNameInfo(&name,&type,&fileType);<br /><br />//relink the story     <br />InterfacePtr<ICommand> relinkCmd(CmdUtils::CreateCommand(kRestoreLinkCmdBoss)); <br /><br />InterfacePtr<IRestoreLinkCmdData> relinkCmdData(relinkCmd, IID_IRESTORELINKCMDDATA);<br /><br />relinkCmdData->Set(database, dataLinkUID, &name, &type, fileType, IDataLink::kLinkNormal); <br /><br />ErrorCode err = CmdUtils::ProcessCommand(relinkCmd); <br /><br />//Update the link now                         <br />InterfacePtr<IUpdateLink> updateLink(dataLinkHelper, UseDefaultIID()); <br />UID newLinkUID; <br />err = updateLink->DoUpdateLink(dl, &newLinkUID, kFullUI); <br />//code end*********************<br /><br />I am able to create the proper link.But the data which is there in the incx file is not getting imported in the linked story.But if I modify the newlinked story from the inca file,the incx file will be getting update.(all its previous content will be deleted.)<br />I tried using <br />Utils<IInCopyWorkflow>()->ImportStory()<br /> ,But its import the incx file in xml format.<br /><br />What is the solution of this then?<br />Kindly help me as I am terribly stuck since last few days.<br /><br />Thanks and Regards,<br />Yopangjo

    >
    I can say that anybody with
    no experience could easily do an export/import in
    MSSQLServer 2000.
    Anybody with no experience should not mess up my Oracle Databases !

  • How to set page number & current date in sqlplus result

    how to set page number & current date in sqlplus result

    Hi,
    Use the TTITLE command. For example:
    SET     PAGESIZE     15
    TTITLE     LEFT  &_date     RIGHT  "Page:" FORMAT 999 sql.pno     SKIP 2
    SELECT     ROWNUM
    ,     ename
    FROM     scott.emp
    ;Output:
    12-Jan-2011                    Page:   1
        ROWNUM ENAME
             1 SMITH
             2 ALLEN
             3 WARD
             4 JONES
             5 MARTIN
             6 BLAKE
             7 CLARK
             8 SCOTT
             9 KING
            10 TURNER
    12-Jan-2011                    Page:   2
        ROWNUM ENAME
            11 ADAMS
            12 JAMES
            13 FORD
            14 MILLER 
    I hope this answers your question.
    If not, post a little sample data (CREATE TABLE and INSERT statements, relevant columns only), and the results you want from that data. If your question is based on commonly available tables, like those in the scott schema, then you don't have to post any sample data: just post the output.
    Explain how you get those results from that data.
    Always say what version of Oracle (and other relevant softward, SQL*Plus in this case) you're using.

  • How to set datapackage and  Idoc

    Hi
    could any body  tell me , How to set datapackage and Idoc in sap bw

    Hi Hari,
    There are 2 additional places to make these settings global:
    1) Transaction SBIW on BW for SAP Source systems:
    Data Transfer to the SAP Business Information Warehouse ->
    General Settings -->
    Maintain Control Parameters for Data Transfer
    2) Transaction SPRO on BW for non-SAP Source Systems:
    SAP Customizing Implementation Guide -->
    SAP NetWeaver -->
    SAP Business Information Warehouse -->
    Links to other systems -->
    Maintain Control Parameters for the data transfer
    Please note the paths are from a BW 3.5 system.
    Kind regards,
    Dorothy

  • How to set-up and use FAMILY Sharing

    Can someone please explain to me in detail how to set-up and use FAMILY Sharing, none of the information I have so far found in the documentation helps at all, in fact it puts you in a constant loop giving the same information over and over again
    We have quite a few devices from ipads, iphones and ipods and I need to set-up Family Sharing.
    We have our main Apple ID which is linked to our Payment method, I have now got my son a new iPad, I have created his Apple ID and set-up a link via FAMILY Sharing to our main Apple ID.
    From what I read we should be able to share our purchased Apps between family members.
    So I figured I would be able to get the Apps now via iTunes that are part of the FAMILY Sharing, however when I go into ITunes (latest version downloaded yesterday) I can only see the Home sharing menu item not FAMILY Sharing, so I cannot work out in Itunes how to get Apps that are FAMILY shared.  So ok I will try and get Apps directly via the Ipad using the App Store.  To test it is working I look for a known paid for App, I then go to download it and it is now asking me to pay for it again. 
    Can someone please explain to me in detail how FAMILY Sharing is supposed to work and how I get it to work please.
    Thanks for your help
    Greg

    Hey GregWr,
    Thanks for the question. The following resources provides some of the best information regarding Family Sharing. Included, you’ll find information on making sure the accounts are set to "Share my purchases”, as well as information on downloading Family Member purchases from the iTunes Purchased section. Please note that some applications are not shareable.
    Sharing purchased content with Family Sharing - Apple Support
    http://support.apple.com/en-us/HT201085
    Which purchased content can I share using Family Sharing - Apple Support
    http://support.apple.com/en-us/HT203046
    If you don't see your family's shared content - Apple Support
    http://support.apple.com/en-us/HT201454
    Thanks,
    Matt M.

  • How to combine sales and delivery data

    hi
    i have requirement to make a report from sales as well as deliveries. Important fields in report are sales document , material , plant , sales document type , country key , sold to party , ordered quantity , delivered quantity , price from vakon ( KBETR ), actual goods issue date.
    The required extractors are 2LIS_11_VASCL, 2LIS_11_V_SSL ,2LIS_11_VAKON.
    Problem is how to combine sales and delivery data as V_SSL has different key figures.Multicube is not the solution as dont have plant , sold to party and many other fields in V_SSL.
    Kindly suggest how to combine sales and deivery data.
    Regards,
    Monika

    I guess you do have shipping point in delivery.
    In most scenarios shipping point may not(or) may be same like order plant.
    Although they are different you can still roll up the delivery information to order level by plant since you have order # available as reference key in delivery.
    With this reference key you can convert all delivery information to order (item) level.
    I guess you can use one merge ODS with one cube (or) with 2 ODS for each at order level for validation.
    You may have to map delivery type to order type as per R3 configuration as well.
    speak with any Logistics guys for help.
    cheers
    Martin

  • How to call routine and pass data to routine in vofm

    Hi Experts,
    I need to update KBETR and KWERT values present in 'Conditions Tab' in Purchase Order (ME21N/ME22N).
    I have created a new customer tab in which we enter amount field and  percentage filed. When user enters some value in this and clicks on 'Conditions Tab', calculation has to be done and the calculated value has to be appeared across a specific condition type.as i am new to abap  i dont know how to create routine and pass data to routine in vofm from customised tab in me21n .
                                                                                                                                                                          Thank's in advance

    Hello Rajendra,
    You can get plenty of forums in SCN related to it. Follow below steps to create VOFM routine.
    Go to VOFM Transaction Code
    1. On the Menu Select required Application i.e Pricing
    2. Enter any Number in between 600 to 999 for Custom Developments.
    3. On entering Pop Screen appears ask for Access Key(We have to remember that Every New Routine needs an Access Key)
    4. Once the Access Key is received we can do modification.
    5. Enter the Routine Number ,description and insert the Access Key
    6. Now the ABAP Editor will open and required code can be copied from Standard SAP Routine and Custom Code Can be developed.
    7. Once the coding is completed we have to Activate the Routine
    8. Select the Routine and Go to Edit – Activate
    9. Ensure that Active check box is ticked upon Activation of the Routine.
    10. Double click on the routine will enter into ABAP Editor, we have to generate the Routine
    11. Go to Program and select Generate
    12.A screen pops up with the related Main Programs  and select all required main programs wherever the Routine is being called.
    13. Once the Routine is Generated and Activated, We need to configure the Routine in the config.
    ** Important SAP note: 156230.
    Check the below document too.
    http://www.scribd.com/doc/35056841/How-to-create-Requirement-Routines
    Regards,
    Thanga

  • Function Module to Delimit From and to Date in Cost Center Master Data

    Hi,
    I am using BAPI_COSTCENTER_CHANGE_MULTIPLE to change Cost Centers.
    I am finding a Problem in changing the from and to date.
    When i try to change the validity dates through standard transaction KS02
    they have a Peculiar way of splitting the dates.
    Is there any FM to split these dates?
    Regards
    Manjari

    Hi Manjari
    I think you need to be a bit more descriptive about your issue. Are you trying to say that for the same cost center, you need to have different validity periods in the CSKS table. For eg:
    KOSTL    DATBI     DATAB
    100         23.02.2011     01.02.2011
    100         31.12.9999     24.02.2011
    Let me know if i am getting you correct here.
    If this is the case, then while populating the BAPI table for cost center '100' (as in the example) you need to divide this into two different items. The data will be same for all the BAPI fields except DATAB and DATBI. Let me know if you need a code snippet for this.
    Hope this helps.
    Harsh

  • How to set default value to date type attribute.

    Hi,
    How to set default value to date type attribute.
    E.g I want to set u201C01/01/1999u201D to date attributes.
    First i want to set value and then i want to fetch the same & want to check equals.
    please suggest solution.
    Regards,
    Smita

    Hi,
    In wdinit() method u can set the date
    DateFormat df = new SimpleDateFormat("MM/dd/yyyy");
    Date today = Calendar.getInstance().getTime();
    String reportDate = df.format(today);
    wdContext.currentContextElement().setFromDate(reportDate);
    Another way you have set the this formate like that
    1. Create a Simple type under "Dictionaries->SimpleType" called DateFormat
    2. Select the type as "date"
    3. Go to the "Representation" tab and set the format as "dd/MM/yyyy" (or whatever u want, but month should be MM)
    4.Bind the context attribute to the type created now.
    Hope this helps u.
    Best Regards
    Vijay K

  • How to set upper and lower limit for service notification in SPRO

    Hello everyone,
    Good morning....!!
    I am new to SAP PM and to SCN as well.
    I have a question on Service notification user status.
    I  have notification profile configured in SAP as below:
    Status no      Status          Short text              Lower limit          Upper limit
    5                  REGD          Registered                1                          70
    10                PCKS            Pack sent                  1                          70
    20                APRC            Application received  1                        70
    etc..
    I want the statusesto be set as  navigation should only allow to go back one by one...like from APRC -->PCKS not to REGD.From PCKS -->REGD etc..not vice versa.
    Can enayone explain me to how to set lower and upper limits for these according ot the above requirement.
    for more details please check my attachment.
    Thanks in advance..!!
    Regards,
    Sudha.

    Once you change the status to previous status, just save the order. Then again open the order & try to change the user status.
    Just I made replica of your profile. I could able to change (even without saving the order).

  • Printing From and To Date on an XML Report

    I have several reports in xmlp that are generated with a select statement of date ranges. How can I put the from and to dates on the header of the reports?

    <?start:body?>
    <?end body?>
    You can find more in UserGuide5.6.2

Maybe you are looking for

  • Sender JDBC Dynamic parameter value in select query

    Hi All, I have a scnario where i have read only acess to a table and We cannot use stored procedures.. Interface is JDBC to file. Now there is one filed in the table which holdes the system date and time.Ex filed name as Sysdate. now can i use  query

  • To change the approval limit for Extended attribute PO Value limits

    Hi, We are on SRM 4.0, in PPOMA_BBP for a local purchasing organisation we want to change the approval limit let us say from 100 to 50 but the system is presenting this field as non editable( In stabdard values sub screen) In Extended attribute tab i

  • Can't open some .CR2 files in Lightroom

    Does anyone have this sort of message from LR3 when trying to import photos from a Canon 5D MII using a 16 GB Transcend UDMA 400x CF: "The files are from a camera which is not recognized by the raw format support in Lightroom". Pretty strange, since

  • Aspect Ratio in Premiere Pro CS3

    I have imported a Quicktime movie (a desktop recording of a software created using SnapZ Pro) which was recorded in SnapZ Pro with frame dimensions of 720 x 480 pixels. When I import this quicktime movie file into my Premiere Pro CS3 project, the set

  • Error trying to install fbsplash [SOLVED]

    Hello there great Arch comunity! I've installed Arch a few days ago in a virtual machine and lest night I got it to work directly on my MacBook Pro as a base OS (man that was an experience and a half) but now i've come to a roadblock I can't get thro