Data flow Design

Hi guys,
Can any one help me with the data flow design in ODI.
Thanks,
Praveen

Absolutely, but we'll need some details :)
What technologies are your sources/targets? Are you intending on performing any flow control checks, lookups, joins or filters?
Edited by: _Phil on Oct 11, 2012 12:16 PM

Similar Messages

Suggest best data flow design

<<Do not ask for or offer points>>
Hi
Right now we need to implement HR related data - the main concentration is PA, OM
Please suggest me best suitable data flow design
Note: All my datasource will not support delta
How we can handle these loads in SAP BI side - I mean to stay how to handle these loads by using DTP
Please suggest some good data flow. I will assign some good points on this
Regards
Madan Mohan
Edited by: Matt on Feb 19, 2010 7:03 AM

Hi Madan,
   You can find the data flow in metadata repository in RSA1. Goto the metadata repository-> select your datasource ->
   network display.
   DTP: You can extract both full/delta using the DTP.
   Please refer the below links also.
   Personnel Administration:
   [http://help.sap.com/saphelp_nw04/helpdata/EN/7d/eab4391de05604e10000000a114084/frameset.htm]
   Organizational Management:
   [http://help.sap.com/saphelp_nw04/helpdata/EN/2d/7739a2a6d5cc4c8d63a514599dc30f/frameset.htm]
Regards
Prasad

Oracle to SAP BI with BCS u2013 Best Data flow Design.

Hi,
We are a SAP implementation team. We are @ Blue Print stage. My client is a RETAIL Business Gaint. Client has 50 % of Transaction data and Master data in Oracle data base. Now we are moving to BI 7.0 and also has plans to use SAP-BCS.
We would like to map all the existing Oracle tables to BI. Provide any clue regarding the best Data flow (From Oracle 10G to BI 7.0).
Your quick and valuable suggestion/ links are highly appreciated.
Warm Regards,
Bab

Hi Ashok,
You have mentioned that you have a Oracle 10g system as a data inflow which perfectly sets the platform to extract the data from the Oracle system to SAP BW system.
This Can be done through the DB connect ,through where you could select the necessary tables and form them as a datasource in BI system,further creating the usual BI objects on top of the DS.
Once the Data is in BI ,we could pull the BI cube or form a replica of the cube in BCS application format to use it in the BCS environment.
Hope this helps,
Regards,
Rajesh.

Design of data-flow

Hello experts!
We want to design our data-flow in a new way and I want to know from some experts, if this is a good way of if there maybe is a better way.
At the moment we extract over the following InfoSources:
0CO_OM_WBS_1
0CO_OM_WBS_6
0CO_OM_OPA_1
0CO_OM_OPA_6
We extract from every data source in full load in up to 8 different InfoCubes. Everytime we update different attributes and selections with a lot of self written ABAP-rules and so on. All historical grown.
Now we don't want to read the data every time from DataSource into BW. So we say, we need an entry layer end update all the data from inside the BW.
We know choose an InfoCube as update-layer, because we maybe want to report on this new data befor it is update to the data targets. We also want to delete requests which could be difficult with an ODS-Object. An ODS-Object has also just 16 key-fields which could be a problem.
So know we want to design an InfoCube for every InfoSource and make data mart update to the other InfoCubes ( data targets).
What we also want is a additional layer for saving some requests sometimes. At the moment I would say, I just make a copy of the InfoCubes I want to design.
So thats it. For design of the InfoCubes I have an additional thread:
InfoCube Design
I have just around one year of BW-experience and never done this before. Maybe someone can give me some tipps or hints if this is a good way or if there is a better one.
Thanks in advance and best regards,
Peter

Hi
You want to update your Entry layer of Cubes with four Infosources
From this Datamart, your going to update second layer of Cubes which will be used for reporting.
Instead building this many cubes, you can create a historical cube which will store all the data of the past and one current cube which will have only new data just arrived.
In the historical cube, you can have all your requests and other details as your passing data only from the current cube to the historical.
From the new cube you can do current reporting only
You can build a Multicube over the historical cube and current cube to have full reporting
Regards
Ganesh N
This will make design simple and efficient instead of creating so many cubes
Regards
Ganesh N

How Make a software Design Data Flow Diagrams (DFD)..?

I want a build up software for design DFD (Data Flow Diagrams). Can you help show to me a simple script for design DFD (Data Flow Diagrams). Thanks for all..
My mail : [email protected]

-Also the problem is how to do various validations of objects(line, oval, process) and move these objects using mouse? Which all specific events are needed ?This will help you [http://java.sun.com/docs/books/tutorial/uiswing/painting/step3.html]
-Another problem is how to have mutiple windows framework in applet. By clicking on the process another level corresponding to the process(i.e. its sub-process) will open?I think JInternalFrames would do.
I general please refer to [The Swing Tutorial|http://java.sun.com/docs/books/tutorial/uiswing/], it has answers to many (all) swing related problems. Go through it.
Thanks!

Data Flow terminated due to error 120307

Hi.
I get this error when executed project.
Source system: SyBase IQ.
Target system: SAP HANA.
Part of tables copied successfully, but job terminated anyway.
I attached screenshots with Progress screen and Monitoring.
Error log is empty.
In trace log I see errors from SUBJ.
Also I have another one strange message in trace log:
Cache statistics determined that data flow <SYBASE_IQ_2_HOD_DBA_FACT_FINAL> uses 0 caches with a total size of 0 bytes, which is less than (or equal to) 3757047808 bytes available for caches in virtual memory. Data flow will use IN MEMORY cache type.

I executed this job from data services designer and get another error.
main Bufman: An error was detected on a database page. You may have a damaged index. For additional information, please check your IQ message file or run sp_iqcheckdb
Trying to find issue in goggle

Losing source-target mapping from a data flow diagram process

Hi,
When I reload a model design from an xml repository, I am losing source-target mappings from a data flow diagram process. I wonder why.
The way it goes is:
- I define a data flow diagram with information stores, processes, and flows.
- Information structures are defined from the flows and the information trickles down to processes and information stores.
- In a process, I define Source-Target Mapping by selecting a target element and then selecting the source element(s).
- I save the whole model.
- So far, the Source-Target Mapping keeps the association between target and source elements.
- If I exit from Data Modeler, the next time I reload the saved model, the Source-Target Mapping target to source elements associations are lost!?
Does anyone have the same issue or would know how to resolve it?
Thanks,
/Mario

I am still having problems getting my source to target mappings to save after I apply the fix described in this thread. Any thoughts?
From my TargetElement.xml
<?xml version = '1.0' encoding = 'UTF-8'?>
<oracle.dbtools.crest.model.design.process.TargetElement parentClass="java.lang.Object">
<property name="objectID" dataType="java.lang.String" readOnly="true" defaultValue="" xmlName="id" xmlType="attribute" getter="getObjectID" setter="setObjectID" reffered="false"/>
<property name="target" dataType="oracle.dbtools.crest.model.design.DesignObject" defaultValue="" xmlName="target" xmlType="element" getter="getTarget" setter="setTarget" reffered="true"/>
<property name="description" dataType="java.lang.String" defaultValue="" xmlName="description" xmlType="element" getter="getDescription" setter="setDescription" reffered="false"/>
<property name="name" dataType="java.lang.String" readOnly="true" defaultValue="" xmlName="name" xmlType="attribute" getter="getName" setter="setName" reffered="false"/>
<property name="transformationType" dataType="java.lang.String" defaultValue="" xmlName="transformationType" xmlType="element" getter="getTransformationType" setter="setTransformationType" reffered="false"/>
<collection name="sources" dataType="java.util.List" xmlName="sources" itemXmlName="sourceRef" getter="getSources" itemIsRef="true" refsXMLName="sourceRefs" addItem="addSource" getItemByID="getSourceByID" nativeList="true" orderTheList="true"/>
<roproperty name="sources" dataType="interface java.util.List" getter="getSources"/>
</oracle.dbtools.crest.model.design.process.TargetElement>
Process.xml:
<?xml version="1.0" encoding="UTF-8" ?>
- <oracle.dbtools.crest.model.design.process.Process parentClass="oracle.dbtools.crest.model.design.process.Transformation">
<property name="type" dataType="int" defaultValue="0" xmlName="type" xmlType="element" getter="getType" setter="setType" reffered="false" />
<property name="batchMinimumTransactions" dataType="int" defaultValue="" xmlName="batchMinimumTransactions" xmlType="element" getter="getBatchMinimumTransactions" setter="setBatchMinimumTransactions" reffered="false" />
<property name="batchTimeUnit" dataType="java.lang.String" defaultValue="" xmlName="batchTimeUnit" xmlType="element" getter="getBatchTimeUnit" setter="setBatchTimeUnit" reffered="false" />
<property name="diagram" dataType="oracle.dbtools.crest.model.design.process.DataFlowDesign" defaultValue="" xmlName="diagram" xmlType="element" getter="getDiagram" setter="setDiagram" reffered="true" />
<property name="footNote" dataType="java.lang.String" defaultValue="" xmlName="footNote" xmlType="element" getter="getFootNote" setter="setFootNote" reffered="false" />
<property name="frequencyTimeUnit" dataType="java.lang.String" defaultValue="" xmlName="frequencyTimeUnit" xmlType="element" getter="getFrequencyTimeUnit" setter="setFrequencyTimeUnit" reffered="false" />
<property name="frequencyTimes" dataType="int" defaultValue="" xmlName="frequencyTimes" xmlType="element" getter="getFrequencyTimes" setter="setFrequencyTimes" reffered="false" />
<property name="interactiveLongestResponseTime" dataType="int" defaultValue="" xmlName="interactiveLongestResponseTime" xmlType="element" getter="getInteractiveLongestResponseTime" setter="setInteractiveLongestResponseTime" reffered="false" />
<property name="interactiveResponseTimeUnit" dataType="java.lang.String" defaultValue="" xmlName="interactiveResponseTimeUnit" xmlType="element" getter="getInteractiveResponseTimeUnit" setter="setInteractiveResponseTimeUnit" reffered="false" />
<property name="mode" dataType="java.lang.String" defaultValue="" xmlName="mode" xmlType="element" getter="getMode" setter="setMode" reffered="false" />
<property name="paramsWrappersString" dataType="java.lang.String" defaultValue="" xmlName="paramsWrappersString" xmlType="element" getter="getParamsWrappersString" setter="setParamsWrappersString" reffered="false" />
<property name="priority" dataType="java.lang.String" defaultValue="" xmlName="priority" xmlType="element" getter="getPriority" setter="setPriority" reffered="false" />
<property name="transformationtask" dataType="oracle.dbtools.crest.model.design.process.TransformationTask" defaultValue="" xmlName="transformationtask" xmlType="element" getter="getTransformationTask" setter="setTransformationTask" reffered="true" />
<property name="peakPeriodsString" dataType="java.lang.String" defaultValue="" xmlName="peakPeriodsString" xmlType="element" getter="getPeakPeriodsString" setter="setPeakPeriodsString" reffered="false" />
<collection name="events" dataType="java.util.List" xmlName="events" itemXmlName="eventRef" getter="getEvents" itemIsRef="true" refsXMLName="eventRefs" removeItem="removeEvent" addItem="addEvent" getItemByID="getPartyByID" nativeList="true" orderTheList="true" />
<collection name="targetMappings" dataType="java.util.List" xmlName="targetMappings" itemXmlName="targetMapping" getter="getTargetElements" createItem="createTargetElement" removeItem="removeEvent" addItem="addTargetElement" getItemByID="getPartyByID" nativeList="true" orderTheList="true" />
<roproperty name="componentFlowsFor" dataType="interface java.util.Collection" getter="getComponentFlowsFor" />
<roproperty name="events" dataType="interface java.util.List" getter="getEvents" />
<roproperty name="flowEvents" dataType="interface java.util.List" getter="getFlowEvents" />
<roproperty name="paramMapping" dataType="oracle.dbtools.crest.model.design.DesignObject" getter="getParamMapping" />
<roproperty name="paramsWrappers" dataType="interface java.util.List" getter="getParamsWrappers" />
<roproperty name="parentprocess" dataType="oracle.dbtools.crest.model.design.process.Process" getter="getParentProcess" />
<roproperty name="parentprocessInDFD" dataType="oracle.dbtools.crest.model.design.process.Process" getter="getParentProcessInDFD" />
<roproperty name="peakperiods" dataType="[Z" getter="getPeakPeriods" />
<roproperty name="processedAttributesAndFlows" dataType="interface java.util.List" getter="getProcessedAttributesAndFlows" />
<roproperty name="processedEntitiesAndFlows" dataType="interface java.util.List" getter="getProcessedEntitiesAndFlows" />
</oracle.dbtools.crest.model.design.process.Process>

Are unique GUIDs required in the data flow task in SSIS?

Hi,
I have previously used SQL server 2008R2 to develop packages. I was told not to copy and paste packages, or create templates with tasks on the data flow because this leads to multiple packages with the same GUID, the consequence of this might be calamitous
problems at runtime when the engine can't distinguish between tasks in different packages.
My process was to create templates with Control flow tasks only, manually create the dataflow tasks and then use bids helper from codeplex to regenerate GUIDs (this regenerated the GUIDs at the control flow level only).
I am now using SQL 2012. I have looked and seen that if I copy and paste a package the GUIDs at the data flow level are also copied. So my questions are:
1) Does having the same ID in different dataflows cause problems as I was led to believe?
2) If it does has this been addressed in some way in SSIS 2012? and what is the best way of working around this given I have many similar packages to develop?
Thanks,
Dan

SSIS doesn't really lend itself well to creating templates.
SQL 2012 is much improved when it comes to copy and pasting tasks, dataflows and transformations between package designs, other than the usual issues with missing connection managers.

Data Model Design

Hi Experts,
In Current project I need to design data model and create data flow strategy for SD,MM,PP,FI modules from R/3.The client wants to use BOBJ on top of BI Info cubes/Reports.Based on KPI's given I need to do Data availability in R/3,Data extraction,Data model analysis and submit the documentation for that.Please guide me how to approach step by step so that I can go ahead with clear cut strategy.Any documentation if it is there please share with me.
Regards
Prasad

You can find ASAP methodology and accelleretors related to modelling data here
https://websmp203.sap-ag.de/roadmaps
see the "ASAP Implementation Roadmap for SAP Exchange Infrastructure" there are New roadmap content for SAP Business Intelligence.
Regards,
Sergio

Data model design in SAP BI

Hi All,
I have one requirement to design the data model for BI. How to design a dataflow in BI. I know dataflow is different from data model. Could you pls let me know hoe to design it.
Is there any model available ...so that i can refer. if not let me know clearly what is a datamodel and how to design it.
Thanks,
Jack

Example of data flow:
http://wiki.sdn.sap.com/wiki/download/attachments/44794331/a6.gif
Data model:
http://wiki.sdn.sap.com/wiki/download/attachments/36064/5.JPG

Tracing down data flow within an DB

Hello,
pls, many times I was wandering if there is an practical way of performing subject's issue. Namely,
1) if there is an App without source code, on production server and
2) corresponding DB, that is open i.e., it is possible to go through all the objects but, plethora of them
Question: upon CLICK event on the control located on the App interface, is there an practical way of how to follow data flow, entered on the interface controls, how to trace down which SP(s) have been fired out etc..etc...
DB itself is very, very complex.....
how to cope with such tasks?
thanks
bye

On production server don't use SQL Profiler due to performance impact.
Use server-side tracing with caution as well:
http://www.sqlusa.com/bestpractices/createtrace/
BOL: http://msdn.microsoft.com/en-us/library/ms175047.aspx
Kalman Toth Database & OLAP Architect
SQL Server 2014 Design & Programming
New Book / Kindle: Exam 70-461 Bootcamp: Querying Microsoft SQL Server 2012

F4 help and data flow

Hi,
I created online sale order interactive form using ABAP. In web dynpro component I maintained Display type as native. In the form Layout type as ZCI layout. In form layout I drag and drop the Value help button and Submit button form web dynpro native tab. Now buttons are working but data flow is not happening so I am not able to create sales order.
But if I use Display type as ActiveX ,form Layout as Standard, Buttons From Webdynpro activeX. In this case f4 help is not working but data flow was happening so I am able create sales order. I need f4 help and as well as I should able to create sales order.
So please help me.
Thanks & Regards,
Krishna,

Hi Mohan,
For ZCI Layout in the Designer have you inserted the WebDynpro Script. If not goto Layout Designer and in the WebDynpro Tool Bar goto Utilities->(select) Insert WebDynpro Script.
To check whether the Script is inserted or not, goto Palette->Heirarchy of Adobe Form Toolbar and in Heirarchy scroll down to Variables, in the variables you'll find one script object i.e. "containerFoundation_JS". If this is present then it will work.
If it is not inserted then use the Report FP_ZCI_UPDATE.
Regards
Pradeep Goli

SQL 2005 SP2 - Cannot open Data Flow Task in SSIS

I have just installed Service Pack 2 on my SQL 2005 Standard Edition.
However, now all my SSIS packages will not allow me to open my Data FLow Tasks. I get the following error:
TITLE: Microsoft Visual Studio
Cannot show the editor for this task.
ADDITIONAL INFORMATION:
The task returned an unsupported control editor type. (Microsoft.DataTransformationServices.Design)
If I try to create a new Data Flow task I get:
TITLE: Microsoft Visual Studio
Failed to create the task.
ADDITIONAL INFORMATION:
The designer could not be initialized. (Microsoft.DataTransformationServices.Design)
I have tried to install the latest hotfixes after this but they had no effect.
Can anybody help me???? Please?

I have had this same issue, where tasks would open fine in an SSIS package until SP2 was installed and then I get the same issue as noted above, i.e. :
TITLE: Microsoft Visual Studio
Cannot show the editor for this task.
ADDITIONAL INFORMATION:
The designer could not be initialized. (Microsoft.DataTransformationServices.Design)
If anyone has some ideas on this, it would be greatly appreciated.

Data Models and Data Flow diagrams.

Hi Gurus,
Can anybody brief me the concept of Data Models and Data Flow Diagrams and their development with illustrations. And is it a responsibility of a Technical or a Functional consultant..i.e to translate Business requirements and functional specifications into technical specifications, data flow diagrams and data models.
Your valuable answers will be rewarded.
Thanks in advance.

Hi,
Concept of Data Models
Data model or Data modelling is basically how you define or design your BW Architecture based on Business requirements. It deals with designing and creating a effcient BW architecture sticking to standard practices.
Multi-Dimensional Modeling with SAP NetWeaver BI
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/6ce7b0a4-0b01-0010-52ac-a6e813c35a84
/people/githen.ronney3/blog/2008/02/13/modeling-strategies
Modeling the Data Warehouse Layer with BI
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/3668618d-0c01-0010-1ab5-aa75c3a4dfc2
/people/gilad.weinbach2/blog/2007/02/23/a-beginners-guide-to-your-first-bi-model-in-nw2004s
Data Flow Diagrams
This show the path of data flow for each individual object in BW. How data dets loaded into that object and how it is going out of the object etc.
Right click on the data target > show data flow .
It shows all the intermdeiate layer through which data comes into that particular object.
Responsibility of a Technical or a Functional consultant
This is done genrally in the designing phase itself by a Senior Technical Consultant with the help of a Functional consultant or a Techno=Functional consultant interacting with Business.
Hope this helps.
Thanks,
JituK

Regarding data flow in SAP XI

Hello Friends,
In Landscape where XI connected to system(s), is there any way to find how the data flows through or how it is designed to connect other systems in SAP XI other than SLD
thanks

If you are looking for any specific landscape and trying to make out how the message flow, then i think you need
to get the Technical and functional specification documents and based on that you can get a clear picture of
how different interface are designed and which systems they are connecting.
Regards
Srinivas

Data flow Design

Similar Messages

Maybe you are looking for