Loading to target table from multiple source table

Hi forum,
I have some doubts regarding selecting data by joining 2 or 3 tables and populate the target table in same schema(ora 10g).The way i need to load is first extract the data and do some some transformations(like derive new value based on existing column value ,eg: arithmetic operations) and then load data to target table in same schema...
GIve me a suggestion to do the same in best possible way..since the entire activity to be finished in 3 hrs and volume in each table is 377 million , 122 million and 120 million.
Thanks ,
Aneesh A

It is Rob who spend his freetime in answering you - not "bob".
> Can u explain me the time-lines for the mentioned volume...?
You mean "you" and not "u"? This is not a MXIT forum where IM SPEAK is the norm.
As for time-lines.. it is silly to expect anyone to give you estimated run times when the hardware platform, types of disks, o/s configuration, Oracle configuration, average loads and so on are unknown.
What Rob showed you is the most optimal way to write SQL to transform data from one or more source tables and insert these results into a destination table - using direct path inserts and parallel query. The only faster method would be a CTAS - Create Table As Select as oppose to an Insert Table with select.

Similar Messages

Load into single target table frm multiple source table in single interfac

Hi
I have four source table and a single target table.
I need to move data from either of these tables into a target table , and we have to decide the source table based on user input.
Example :
Lets say there are four tables A,B,C,D and one target table T.
If user input says A
then the data from table A will move to table T
And again , if the user says table C then data from table C will move to table T.
And we have to create only one interface for achieving this in oracle Data Integrator ( ODI ).
You can take assumptions in source and target table.

Hi ,
In ODI 11g , there are new feature callled dataset. It allows to use UNION , MINUS etc.
Google it , you will get many tutorials on Dataset. check the link
http://www.rittmanmead.com/2011/06/odi-11g-new-mapping-and-interface-features-part-1/
In your case , you can provide filter conditions on your tables i.e.
Say My target table is EMPLOYEE , My source tables are EMPLOYEE and DEPARTMENT
INSERT INTO EMPLOYEE(CUSTOMER_ID , CUSTOMER_NAME) SELECT CUSTOMER_ID , CUSTOMER_NAME from employee where 'EMPLOYEE' = :EMP
UNION DEPARTMENT_ID , DEPARTMENT_NAME from departments where 'DEPARTMENT' = :EMP ;
Just pasted the Screenshots on following page : http://oracoholic.blogspot.in/ . Have a look
Edited by: user8427112 on Jan 8, 2013 11:04 AM

SLT Replication for the same table from Multiple Source Systems

Hello,
With HANA 1.0 SP03, it is now possible to connect multiple source systems to the same SLT Replication server and from there on to the same schema in SAP HANA - does this mean same table as well? Or will it be different tables?
My doubt:
Consider i am replicating the information from KNA1 from 2 Source Systems - say SourceA and SourceB.
If I have different records in SourceA.KNA1 and SourceB.KNA1, i believe the records will be added during the replication and as a result, the final table has 2 different records.
Now, if the same record appears in the KNA1 tables from both the sources, the final table should hold only 1 record.
Also, if the same Customer's record is posted in both the systems with different values, it should add the records.
How does HANA have a check in this situation?
Please throw some light on this.

Hi Vishal,
i suggest you to take a look to SAP HANA SPS03 Master Guide. There is a comparison table for the three replication technologies available (see page 25).
For Multi-System Support, there are these values:
- Trigger-Based Replication (SLT Replication): Multiple source systems to multiple SAP HANA instances (one source system can be connected to one SAP HANA schema only)
So i think that in your case you should consider BO Data Services (losing real-time analytics capabilities of course).
Regards
Leopoldo Capasso

How to Load Master Data Text from Multiple Source Systems

Situation: Loading vendor master (text) from two systems. Some of the vendor keys/number are the same and so is the description. I understand that if I was loading Attributes, I could create another attribute such a source system id and compound it to 0Vendor. However, I don't believe you can do the same when loading text.
Question: So, how can I load duplicate vendor keys and description into BW using the *_TEXT datasource so they do not overwrite?
Thanks!

Hi,
Don't doubt, it'll work!
Sys ID as compound to 0Vendor.
If you doubt about predefined structure of the *_TEXT datasource and direct infosource, then use a flexible infosource. Maybe you'll have to derive the sys ID in a routine or a formula.
Best regards,
Eugene

Merge multiple source table dates and to one target table

The requirement is to merge multiple source tables (each table has a set of start and end date) to one target table with one set of start and end date and contain the date relevant column values from each source table. Payment source tablestart dateend datepayemnt1/1/201512/31/2015301/1/201612/31/999960Position source tablestart dateend dateposition1/1/201512/31/2016101/1/201712/31/999920Target tablestart dateend datepayemntposition1/1/201512/31/201530101/1/201612/31/201660101/1/201712/31/99996020 What transformation(s) will be best to use to handle this requirement? Thanks, Lei

Thanks Karen,
that was exactly what i was hoping for.
Maybe it could be made easier/less confusing if the Mapping Workbench just made you choose a target table. But maybe this is not usefull if the table contains two foreign keys to the same table. Or maybe this should just be put somewhere in the documentation.
Regards,
Robert
Hi Donald,
fortunately i'm my own DBA so i don't have any problems ;-). However i'm certainly interested in the reasons for not having such a conditional foreign key.
However actually the foreign key isn't conditional, the condition is that either the field (using the FK) must be filled, or a free-format field. The reasoning for this is that we have a list of known towns and if the addres is local a town from that list must be chosen. If the addres is outside the country a town can just be typed in (no list).
Concerning the agrregate, all fields are always used. There are no neediness flags anywhere. The aggregate contains three fields which are mapping as direct (two fields) or a One-to-one (the FK). All 'parents' all contains these three fields.
Regards,
Robert

SQL Loader to Load Multiple Tables from Multiple Files

Hi
I wish to create a control file to load multiple tables from multiple files
viz.Emp.dat into emp table and Dept.dat into Dept table and so on
How could I do it?
Can I create a control file like this:
OPTIONS(DIRECT=TRUE,
SKIP_UNUSABLE_INDEXES=TRUE,
SKIP_INDEX_MAINTENANCE=TRUE)
UNRECOVERABLE
LOAD DATA
INFILE 'EMP.dat'
INFILE 'DEPT.dat'
INTO TABLE emp TRUNCATE
FIELDS TERMINATED BY "|" OPTIONALLY ENCLOSED BY '"'
(empno,
ename,
deptno)
INTO TABLE dept TRUNCATE
FIELDS TERMINATED BY "|" OPTIONALLY ENCLOSED BY '"'
(deptno,
dname,
dloc)
Appreciate a Quick Reply
mailto:[email protected]

Which operating system? ("Command Prompt" sounds like Windows)
UNIX/Linux: a shell script with multiple calls to sqlldr run in the background with "&" (and possibly nohup)
Windows: A batch file using "start" to launch multiple copies of sqlldr.
http://www.pctools.com/forum/showthread.php?42285-background-a-process-in-batch-%28W2K%29
http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/start.mspx?mfr=true
Edited by: Brian Bontrager on May 31, 2013 4:04 PM

Left Outer Joining multiple tables to one source table FAILS with VLD-1511

Hi all,
Is it me, or is OWB unable to handle left outer joining 1 source table to multiple other tables?
I want to load a fact table so I have 1 source table with measures. This table must be outer joined to some dimensions that have their FK in the fact table.
The SQL statement would look like this (and is perfectly valid):
select ...
from input, dim1, dim2
where input.c1 = dim1.c1(+)
and input.c2 = dim2.c2(+);
I put the where clause in the joiner operator and validate, but that gives me message VLD-1511: A table may be outer joined to at most one other table.
Even splitting this up into one outer join per joiner still gives this message.
A search and look around on the forum and on metalink shows there are related issues (like bug 3334035). Seemingly creating a view is the work-around to use.....? (ie downgrading owb to a simple gui tool) }-;
Have other people experienced this problem of not being able to outer join one input table to multiple other tables?
Thanks,
Ed

I have had some feedback from Oracle. It turns out this has to do with 2 issues. Below I have pasted the text that Support gave me:
<---------- START QUOTE ---------->
RESEARCH
=========
Bug 3437036 KEY LOOKUP DOES NOT DETECT ORA-1417 IN VALIDATE/GENERATE STEP
Unpublished Bug 4211684 FORWARD PORT OF BUG 3437036
shows:
Some more development has been completed when this bug is fixed in Paris.
The following are the details:
1. If the join condition contains a full outer join such as
tab1.c (+) = tab2.c (+) and tab2.c (+) = tab3.c
then the new validations implemented for this bug do not apply since
in OWB, full outer join triggers generation of joins in ANSI syntax.
ANSI syntax does not have the original problem the base bug of this
bug reported.
2. If the join condition does not contain any full outer join condition,
then the join is generated in Oracle join syntax, which is subject two
several restrictions. The fix to this bug check two of the restrictions.
3. The first restriction in Oracle syntax is that the outer join operator
"(+)" can only directly be attached to a column name. If you attach it
to an expression, such as the following:
(tab1.c + 1) (+) = tab2.c
Then there will be an ORA-936 error at the time of mapping deployment.
For this case, I have added a validation message VLD-1512 to error out
this situation.
4. The second restriction in Oracle syntax is that a table can only be
outer joined to exactly one other table.
For example, this is an invalid join in Oracle syntax:
tab1.c (+) = tab2.c and tab1.d (+) = tab3.d
because tab1 is left outer joined to tab2 and tab3.
But note that the following is still valid in Oracle syntax:
tab1.c (+) = tab2.c and tab1.d = tab3.d (+)
because tab1 is left outer joined to tab2 and right outer joined to tab3.
So this latter case does not violate the restriction that "same oj" to
more than 1 table is not allowed.
If same oj to more than 1 table is specified in a join condition,
VLD-1511 will be issued, and the map is made invalid.
<---------- END QUOTE ---------->
OWB does a partial validation, ie not all access paths are (can be) checked. A full check is only done by the database itself. So some scenarios (like checking whether multiple tables are outer joined the correct way) are not checked, and in this case are flagged with an error (even though it is actually a correct scenario).
Seemingly this was not flagged with an error in earlier versions of OWB, so beware, OWB behaviour may change when upgrading...
Alternative solutions are (1) using key lookups, (2) using a view with all outer joins in there, (3) using intermediate result tables between the joins.
Hope this info helps some people prevent spending too much time on a false error message,
Ed

Open Hub - Data from multiple sources to single target

Hello,
I am using Open Hub to send the data from SAP BI to Flat files. I have a requirement where I want to create a single destination from multiple sources. In other words in BI we have different tables for attributes and text. I would like to combine the data from attributes and text into a single file. For eg. I want to have material attributes and text in the same single file as output.
Is this possible in Open Hub? If yes could you please help me to understand the process.
Thanks,
KK

Hi,
1. Create the Info Spoke and activate it
2. Change it and go to transformation
3. Check the box InfoSpoke with Transf. Using BAdI
4. You are asked if you want to generate the spoke. Say yes & Simply set some texts and activate here, then return.
5. You can now change the target structure. Simply create a Z structure with all the attributs & text field in it in the SE11 and enter it here.
6. Double click on BAdI implementation & then double click again on "TRANSFORM" method of the implementation. It will take you to method
"IF_EX_OPENHUB_TRANSFORM~TRANSFORM"
7. Write a code to select & fill the text field & map other filed with the attribute fields.
Example:
ZEMPLOYEE_ATTR_STRU - Target Structure for InfoSpoke EMPLOYEE_ATTR
EMPLOYEE     /BI0/OIEMPLOYEE     NUMC     8     0     Employee
DATETO     /BI0/OIDATETO     DATS     8     0     Valid to
DATEFROM     /BI0/OIDATEFROM     DATS     8     0     Valid from
COMP_CODE     /BI0/OICOMP_CODE     CHAR     4     0     Company code
CO_MST_AR     /BI0/OICO_MST_AR     CHAR     4     0     Controlling Area of Master Cost Center
HRPOSITION     /BI0/OIHRPOSITION     NUMC     8     0     Position
MAST_CCTR     /BI0/OIMAST_CCTR     CHAR     10     0     Master Cost Center
TXTMD     RSTXTMD     CHAR     40     0     Medium description
Note: Text and attribute are in same structure.

SSIS 2012 is intermittently failing with below "Invalid date format" while importing data from a source table into a Destination table with same exact schema.

We migrated Packages from SSIS 2008 to 2012. The Package is working fine in all the environments except in one of our environment.
SSIS 2012 is intermittently failing with below error while importing data from a source table into a Destination table with same exact schema.
Error: 2014-01-28 15:52:05.19
   Code: 0x80004005
   Source: xxxxxxxx SSIS.Pipeline
   Description: Unspecified error
End Error
Error: 2014-01-28 15:52:05.19
   Code: 0xC0202009
   Source: Process xxxxxx Load TableName [48]
   Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005 Description: "Invalid date format".
End Error
Error: 2014-01-28 15:52:05.19
   Code: 0xC020901C
   Source: Process xxxxxxxx Load TableName [48]
   Description: There was an error with Load TableName.Inputs[OLE DB Destination Input].Columns[Updated] on Load TableName.Inputs[OLE DB Destination Input]. The column status returned was: "Conversion failed because the data value overflowed
the specified type.".
End Error
But when we reorder the column in "Updated" in Destination table, the package is importing data successfully.
This looks like bug to me, Any suggestion?

Hi Mohideen,
Based on my research, the issue might be related to one of the following factors:
Memory pressure. Check there is a memory challenge when the issue occurs. In addition, if the package runs in 32-bit runtime on the specific server, use the 64-bit runtime instead.
A known issue with SQL Native Client. As a workaround, use .NET data provider instead of SNAC.
Hope this helps.
Regards,
Mike Yin
If you have any feedback on our support, please click
here
Mike Yin
TechNet Community Support

Query regarding the data type for fetcing records from multiple ODS tables

hey guys;
i have a query regarding the data type for fetcing records from multiple ODS tables.
if i have 2 table with a same column name then in the datatype under parent row node i cant add 2 nodes with the same name.
can any one help with some suggestion.

Hi Mudit,
One option would be to go as mentioned by Padamja , prefxing the table name to the column name or another would be to use the AS keyoword in your SQL statement.
AS is used to rename the column name when data is being selected from your DB.
So, the query Select ename as empname from emptable will return the data with column name as empname.
Regards,
Bhavesh

Consistency check error 38011: Logical tables from multiple subject areas..

I received multiple 38011 errors when performing a consistency check after merging repositories:
For example:
Logical tables from multiple subject areas associated, OHRP and Enterprise Warehouse
(OHRP and Enterprise Warehouse refer to different business models)
I'm really not sure what this means, and Metalink and Google aren't turning up anything.
Thoughts?
-John

John,
Does it say anything about Assertion Failure? Also, this is straight up from help regarding import (through file menu) "Use this option when the objects you import are unrelated to objects already in the repository such as when the business model and physical layer objects do not exist. If an object of the same name and type exists, the import process overwrites the existing object with the new object. When you import objects from one repository into another, the repository from which you are importing must be consistent."
Sometimes Merge does bring unexpected (and unwanted results) - especially if there're presentation aliases, duplicate business models, or naming conflicts. If it's not too late, I suggest you use Import,rather than Merge, also, preferably starting with a new RPD file. This would enable you to bring items piece-by-piece and hopefully would allow you to isolate the problem.
Also, depending on the size - it's sometimes preferable to just reproduce missing part(s). I hope this is helpful.
Also, I forgot to say - the Import is deprecated and not supported. They suggest you use Project Extract and Merge. If Merge isn't working out for you and Import isn't an option - maybe you could try Project.
Edited by: wildmight on Mar 9, 2009 7:58 AM

Analyse big data in Excel? Why the dynamic tables doesn't take all the data from the source table.

Hi,
I'm doing a internship in a production line.
My job is to recover production data (input data) and test data (output data) using various types of software (excel, BusinessObject sap, etc).
To this day, I have recovered hundreds of production data, and have also organized in excel but I need to analyze and plot them.
I would like to know who can give me an idea of how I could plot as much data and analysis.
Now i trying to use dynamic charts and plot some data but I did not get acceptable answers.
How could I compare, analyze and graph for example:
Five columns of production (input) with five (5) columns tested (data output).
After graphing.
Someone can give me a technique to analyze data? ie I compare column by column?
or some other technique? as a conglomerate could analyze data?
o give you an idea of the contect, now I perform an internship in a manufacturing turbines.
My job is to analyze the input data (production) and to estimate the possible behavior of the turbines in the tests.
As I said, use dynamic tables in excel, but i have not idea why the dynamic tables doesn't take all the data from the source table.
I appreciate your advice
Thanks

You can declare as PT source whole Columns [$A:$E], without rows number.
Then You'll have all actually data.
Oskar Shon, Office System MVP - www.VBATools.pl
if Helpful; Answer when a problem solved

Create pivot table from multiple sheets

How to Create single pivot table from multiple sheets

Hello,
Debra Dahlgleish has a tutorial video on her site:
http://blog.contextures.com/archives/2010/04/16/how-to-create-an-excel-pivot-table-from-multiple-sheets/
This Office support article also covers the steps:
http://office.microsoft.com/en-001/excel-help/consolidate-multiple-worksheets-into-one-pivottable-report-HA010226585.aspx
Both the video and the article relate to Excel 2007 but the steps will be similar in current versions.
cheers, teylyn

Create one tables from 2 different tables

Hi,
How I can create one table from 2 different tables. Source tables have data and I want to include it in new table.
I try this:
create table NEW_ONE
select * from OLD_ONE
union
select * from OLD_ONE2;
But it didn't work correctly :/

I don't have any error. This syntax create table NEW_ONE, but this table have columns only from OLD_ONE table :/ There aren't any column from OLD_ONE2 :/ Any suggestions?
I don't forget about "as" in my query, only in this post.
Edited by: tutus on Sep 8, 2008 6:36 AM

Lgical table from two physical table

Hi,
I am trying to design a logical fact table from two physical table. One table has transaction data and another has accounting data. The requirement is, I need to merge the rows between these two tables, where were it matches. If the keys are not matching between these two table then also I need to bring those rows from both tables as separate rows. How can i do this? Also can i have a logical table as source for my fact table.

You'll need outer joins in your physical layer and you can drag the columns from both physical tables to a single logical table and you will see in the BMM layer it will create the two logical table sources.

Loading to target table from multiple source table

Similar Messages

Maybe you are looking for