Cdc on multiple joined source datastores

Hi gurus,
There are multiple source datastores and one target datastore in my interface.All of source datastores will be modified by ct application in future,How to enable cdc on multiple source datastores ?Is there any "thumb of rule" for cdc of multiple joined source datastores?
Source: DB2/AS400
Target: SQL SERVER 2000
Thanks
nan

Hi nan,
As i wasn't tried CDC on the source and target you specified,to give you a hint,
For achieving CDC on multiple data stores, you can use JKM Consistent mode. This will make sure that all your data stores within the particular model will be CDC'ed and PK and FK relations will be maintained.
Thanks,
G

Similar Messages

Performance Issue with Multiple Joins :-)

Hi there! I have a dilemma over using multiple joins...and I am not sure whether there is any alternative to this. Please help me out if you can..
I have a table DATA having 100 columns and 2 million records and I have another metadata table Code_Mappings. The issue is with migration of this data from upstreams to downstreams.
Columns of DATA table is
a,b,c,d,e,f,g,h.......ca.cb.cc.cd.....dz.
Code_Mappings table is
Source_code |Target code | category
The problem arises when I join the metadata table for multiple joins..
Around 75 columns out of 100 are category questions i.e I need to replace all Source codes in the data of those category columns with target codes WRT categories..
Suppose A, C,D,I,J,K,L,W,X,Z,AA,BH are country category.
My query to fetch data from DATA for column A would be
Select decode(d.A, cm.source_code,cm.target_code,d.A) from DATA D,Code_Mappings CM where cm.category like 'country' and d.A=cm.source_code;
In the similar way, I may have to join the same table for category 'country' for n no of columns if those columns have category as 'country'.
Is there a alternative to use this table once and use the decode, mapping logic multiple times on columns..? Please let me know if there is anyways I can do it so that performance is enhanced in a significant manner.
Another Issue is:
Whenever the Column value is some junk, that record doesnt get fetched. In the above query, you can see that where clause has a condition of "d.A=cm.source_code" which not only filters out these required records but also avoids cartesian product.
The basic requirement is all records should get fetched. I do not want to filter out anything.
Please help me out.
Thanks
Mahesh

1) I'm not a JD Edwards person, but I would wager that if you're to the point where you have consolidated all the schemas to a single instance that it would be possible and preferrable to consolidate everything further into a single schema. I have to believe that JD Edwards provides tools to restrict what bits a particular branch can see without requiring separate instances.
2) What data are you accessing exactly? Are you always accessing data for a particular branch? Or do you need information from every branch?
3) Is your application logging in as a single user? Or will there be 1 application user for every JD Edwards schema?
4) Are you deploying your PL/SQL into 10-20 different schemas? Or into just 1?
Whether or not you are explicitly using the schema name, Oracle will have to do a hard parse of every logically distinct SQL statement. Two SQL statements that access different tables that happen to share the same name are logically distinct, so your shared pool will end up with 10-20 copies of the "SELECT * FROM <<some table name>>" SQL statement if it is executed against every instance of <<some table name>>.
The question may be whether it is better to explicitly provide the schema name or to rely on synonyms. You generate the same number of hard parses either way, but explicit schema names may improve latch contention during parses if Oracle has to do a lot of synonym resolution. Not many people/ applications are really hurt by this latch contention, though, so it is very hard to say whether this is a legitimate concern.
Justin

Multiple Joins

Using HR demonstration schema, I am trying to understand how Oracle performs this multiple join:
select r.region_name, c.country_name, l.city, d.department_name
from departments d natural join locations l
natural join countries c natural join regions r
I ran the query using SQL Developer 2.1.1.64.45 and SQLPlus and the result I obtain is the same: 27 rows.
The documentation says that I should obtain a set of 2700 rows:
“The join between DEPARTMENTS and LOCATIONS creates an interim
result set consisting of 27 rows. These tables provide the DEPARTMENT_NAME
and CITY columns. This set is naturally joined to the COUNTRIES table. Since
the interim set does not contain the COUNTRY_ID column, a Cartesian join is
performed. The 27 interim rows are joined to the 25 rows in the COUNTRIES
table, yielding a new interim results set with 675 (27 × 25) rows and three columns: DEPARTMENT_NAME, CITY, and COUNTRY_NAME. This set is naturally joined to the REGIONS table. Once again, a Cartesian join occurs because the REGION_ID column is absent from the interim set. The final result set contains 2700 (675 × 4) rows and four columns.”
I parsed the query like it is suggested and the difference began with the second join:
select c.country_name, l.city, d.department_name
from departments d natural join locations l
natural join countries c;
I obtain a set of 27 rows instead of 675 as the documentation says (and I assume the documentation is correct).
If the result set from first Join it is fed as first term for the second join(from left to right) the result should be a Cartesian join and still my tools returns a set of 27 rows .
I verified the structure and contain of the 4 tables involved and it do match the one describe in documentation.
Why is my result different from the one provide in doc?
It is like it doesn’t matter if I select country_id column or not from first join,
somehow Oracle knows to identify the common column for the second join.

Hi,
Welcome to the forum!
user12290417 wrote:
Using HR demonstration schema, I am trying to understand how Oracle performs this multiple join:
select r.region_name, c.country_name, l.city, d.department_name
from departments d natural join locations l
natural join countries c natural join regions r
I ran the query using SQL Developer 2.1.1.64.45 and SQLPlus That's a very good idea to post the exact version number of your front end!
The version of your database can make a big difference, too. Don't just put an easy-to-miss tag, like "11g" on your message; come right out and say "I'm using Oracle 11.1.0.7.0" (or whatever it is).
and the result I obtain is the same: 27 rows.
The documentation says that I should obtain a set of 2700 rows:I get 2700 rows, using Oracle 10.2.0.1.0 Express Edition. I might be able to test it on Oracle 11 tomorrow.
“The join between DEPARTMENTS and LOCATIONS creates an interim
result set consisting of 27 rows. These tables provide the DEPARTMENT_NAME
and CITY columns. This set is naturally joined to the COUNTRIES table. Since
the interim set does not contain the COUNTRY_ID column, a Cartesian join is
performed. The 27 interim rows are joined to the 25 rows in the COUNTRIES
table, yielding a new interim results set with 675 (27 × 25) rows and three columns: DEPARTMENT_NAME, CITY, and COUNTRY_NAME. This set is naturally joined to the REGIONS table. Once again, a Cartesian join occurs because the REGION_ID column is absent from the interim set. The final result set contains 2700 (675 × 4) rows and four columns.”Can you post a link, or at least a reference, to the source of this quote? Is it describning Oracle 11 specifically?
I parsed the query like it is suggested and the difference began with the second join:
select c.country_name, l.city, d.department_name
from departments d natural join locations l
natural join countries c;
I obtain a set of 27 rows instead of 675 as the documentation says (and I assume the documentation is correct).Again, I get 675 rows, like your source.
If the result set from first Join it is fed as first term for the second join(from left to right) the result should be a Cartesian join and still my tools returns a set of 27 rows .
I verified the structure and contain of the 4 tables involved and it do match the one describe in documentation.
Why is my result different from the one provide in doc?
It is like it doesn’t matter if I select country_id column or not from first join,
somehow Oracle knows to identify the common column for the second join.Yes, the behavior you're seeing does seem to be like that.
When you explicitly give the join conditions in an ON clause, you can use any columns in any table that's been introduced up to that point. You're not limited to columns that are in the SELECT clause. The behavior you're seeing is consistent with that.
For what it's worth, the only people I've ever heard of using NATURAL JOIN are students, and even then, only if they are very diligent about following instructions. In real life, there are so many generic column names, such as QUANTITY, or MODIFY_DATE_TIME, that NATURAL JOIN is often meaningless. Also, it's a very fragile technique. If someone adds a column to a table, suddenly dozens of queries using NATURAL JOINs could start giving bad results. Most people want to write robust code, and minimize the probability of needing to re-write it.
There are lots of good places to invest your time, and lots of useful things to learn in Oracle. Spend your time learning about things that you might use, such as regular expressions, or analytic functions, or recursive sub-queries, before you spend too much time on NATURAL JOIN (or USING).

Variable Source Datastore

Hi all,
We have 3 interfaces where we perform a join between two tables.
One of the tables is common to the three interfaces and the other tables are different for the 3 interfaces but have the same columns (only the name is different).
Would it possible to have only one interface where one of the source datastore of the join is variable? and how we could do it?
Regards and thanks

Hi F Amroes,
Yes, Its possible with one interface and varable datastore ( Datastore neame should be variable )
Logic :-
Create datastore with varible name (if the table structure is same .
then use this DataStore in interface. refresh/assign the value to ur variable ( table name / datastore name)
Then call ur interface.
Also u can use the Looping concept of ODI to loop 3 times .
Please reffer my old threads in this forum for the looping logic / please reffer the below URL
http://odiexperts.com/?p=531
Regards,
Rathish A M

Easy replacement of a source datastore

Hi gurus,
Is there an easy way to replace a source datastore by another one with the same structure in an interface ?
Without having to re-do the join, filter and the mapping of target column.
Thanks for your help.
Regards

user1459647 wrote:
Thank you for your quick and precise reply.
Unfortunately, when I delete a source datastore, all the joins/filters involving this datastore disappear.It will happen if your join condition/filter is specified only on 2 tables and 1 of them is getting deleted.
And all the target mappings involving this datastore are set on "Target" instead of "Source" (not a big deal).You can chage the execution area
Is there something to change in my ODI Studio parameters ?I do not think so
I'm using ODI 11.1.1.5 and Windows 7.That should be fine .
You can explore the SYNONYM option also :)

Does OBIEE has ability to create a single cube from multiple data sources?

Hi all,
Does OBIEE has the ability to create a single cube from multiple sources and does it has the ability to join multiple cubes?
Looking forward to ur reply.

Hi
OBIEE can join multiple data sources to make a single data model, but it's not a cube in the multi-dimensional sense like Essbase or Oracle OLAP.
To be able to join datasources together they need to have a common dimension or FK relationship depending on what the source is and what you want to do with it.
Ed

Multiple xml sources - JSP

Hi to all,
Ok this is my situation. I have XML data that is coming from servlets. I need to build a JSP page that will output the XML data, but from multiple servlets. Is there anyway to do this? I have XSLT that transforms the XML data, but it has to be linked at runtime, since the servlets only outputs the data (I need a clear separation between data presentation and the data itself)
Coul somebody she some light plz...
Thanks

Well, not exactly.
Let's say I have two HTML lists in my JSP page that needs to be outputted. Each of these lists get their data from different servlets. These servlets outputs the XML data. I have this JSP page that needs to take the 2 XML outputs (from each servlets), link the XML data with their respective XSLT file (dynamically!) and render it in HTML.
So I have multiple XML sources, not just one. That is exactly what I don't want because the XML data combinaison is irrelevant. I want to be able to use this output with other pages. (So joining the 2 sources is not acceptable)
Thank you

To Find out Source datastore in ODI interfaces using SNP tables

Hi,
Could you please let me know how to find out Source datastore(s) in ODI interfaces using SNP tables ?
Regards,
Rashmik

Please use below query...Just pass the interface name..
SELECT C.TABLE_NAME AS "Target Table Name",
     A.COL_NAME AS "Target Field Name",
     Wm_Concat(G.SOURCE_DT) AS "Target Data Type",
     Wm_Concat(G.LONGC) AS "Target Data Length",
     Wm_Concat(TXT) AS "Transformation Rule",
     Wm_Concat(DISTINCT F.TABLE_NAME) AS "Source Table Name",
     Wm_Concat(D.COL_NAME) AS "Source Field Name",
     Wm_Concat(D.SOURCE_DT) AS "Source Data Type",
     Wm_Concat(D.LONGC) AS "Source Data Length"
FROM
     SNP_POP_COL A JOIN SNP_TXT_CROSSR B ON A.I_TXT_MAP=B.I_TXT
     JOIN SNP_POP C ON A.I_POP=C.I_POP
     JOIN SNP_TXT E ON A.I_TXT_MAP=E.I_TXT AND B.I_TXT=E.I_TXT
     LEFT OUTER JOIN SNP_COL D ON B.I_COL=D.I_COL
     LEFT OUTER JOIN SNP_TABLE F ON F.I_TABLE= D.I_TABLE
     LEFT JOIN SNP_COL G ON A.I_COL=G.I_COL
WHERE POP_NAME = 'XXXXXXX'
GROUP BY C.TABLE_NAME,A.COL_NAME ORDER BY 1
Edited by: KaushikPatel on Apr 18, 2013 6:52 AM

Increase performance in a multiple data source report

Post Author: ArturoFromPeru
CA Forum: General
Hi everybody.
I have a big problem, when i make a report that have multiple data sources the performance decrease considerably, i still don't know the reason. Is it true that using multiple data sources is too slow?.
I tell you a fact: I made the report connecting via "Field Definition File", and it take at least 2 minutes to show itself but it only have 170 records, and i'm very sure that the sql statements to each data source were executed very faster.
I even heard about index, but i think they only are useful when i connect directly to the database.
All my partner told me, that Cristal Report
Thanks you in advance
Regards.
Arturo

Post Author: ArturoFromPeru
CA Forum: General
Thanks you, but I explain better what i was doing.
I've made a report called "Kardex de Producto" which show the behavior of the products according to its sales, purchases.
The end result which is showed by the report is correct. I used three data source in the report, so links between each table is correct. The only problem i have is the performance because i still don't know why is too slow. In fact the sql statement is very heavy, but i think it doesn't matter to the report because when it takes the data from the database (connecting via Field Definition File) even if the very heavy sql statement returns twenty record Cristal Report must show itself very quickly. I don't want to believe that Cristal Report is very slow when it works with multiple data sources.
Do you mind if i give you my report? if not please leave me your email address.
Email: [email protected] / [email protected]
Thank you in advance
Regards
Arturo

Report Viewer and Multiple Data Sources

I know that it is possible to create a report in Crystal Reports using multiple data sources. But is it possible to use just the Free Report Viewer to view a report with Multiple Data Sources?
Our company uses Crystal Reports XI. I do not use the program myself, I am in the IT Department. I have limited knowledge of Crystal and do not do any of the report writing.
If this is possible, and if someone could help me out with what would need to be done, or point me in the right direction of a Knowledge Base or Help Topic that explains this, that would be great.
Thanks.

I believe it can but both data sources need to be set up. Ask a report designer to help you use the Designer to test this and see what is required.

Any examples of a data template using multiple data sources?

I'm looking for an example report using multiple data sources. I've seen one where they do a master/detail but I'm just looking to combine results in sorted order (sorted across all data sources). The master/detail used a bind variable to link the two defined queries, I'm thinking what I want won't have that, so I'm lost on how to make that happen. I have reports using multiple sql queries and there is a way in the data source pulldown to tell it to combine the data sources. It appears to be a more manual process with data templates, if it's even possible.
Any pointers/links would be appreciated.
Gaff

Hi Vetsrini :
That's just it. Mine is simpler than that. There is no master/detail relationship between the two queries. I have the same exact query that I run in two databases and I want to merge the results (ordered, by, say eventTime) in one report. So I think my results are going to be two separate groups (one for each data source) which I'll have to let BI merge vis XSLT or whatever it uses. That's fine for small result sets but for larger ones, it would be nice if the database did the sorting/merging.
Gaff

How to load data into an ods from multiple info sources.

hi all...
i am given a task to load data into an ods from 3 infosources ...
can someone plz give me the flow .
thank u in advance..

Hi Hara Pradhan,
You have to create 3 update rules by giving the 3 different infosources while creating each update rule. And u have to create the infopackages under each infosource. with this u can load the data to the same data target from multiple info sources.
Hope it helps!
Assign points if it helps!

Multiple joins on the same table

I'm new to SQL 2005 & C# - I'm a MySQL/PHP crossover.
I'm using s Stored Procedure and I'm trying to do multiple joins onto
one table. I have 6 fields in one table that are foreign keys of
another table:
Table1
id
PrimaryCode
SecondaryCode1
SecondaryCode2
SecondaryCode3
SecondaryCode4
SecondaryCode5
Table 2
id
Title
CommCode
The fields in table 1 (except is obviously) hold the id of a row in
Table 2. When displaying data I want to display "Title" -
"CommCode" for each item in Table 1. I got myself started by
searchig on the net and I have a stored procedure. The obvious
problem is that as it goes through the Query only the last value
remains in place - since each value before it is cleared in the
UNION. How can I do this?? Here's my Stored Procedure:
=====================================
ALTER PROCEDURE GetRegistersSpecific
@SearchTxt int
AS
SELECT
registrations.Company,registrations.Address1,registrations.Address2,registrations.City,registrations.State,registrations.Zip,registrations.ContactName,registrations.Phone,registrations.Fax,registrations.Email,registrations.Website,registrations.Feid,registrations.BusinessType,registrations.BackupWitholding,registrations.SignedName,registrations.SignedDate,
PrimaryCode AS MyID, Title, CommodityCode
FROM registrations
JOIN CommodityCodes ON PrimaryCode = CommodityCodes.id
UNION
SELECT
registrations.Company,registrations.Address1,registrations.Address2,registrations.City,registrations.State,registrations.Zip,registrations.ContactName,registrations.Phone,registrations.Fax,registrations.Email,registrations.Website,registrations.Feid,registrations.BusinessType,registrations.BackupWitholding,registrations.SignedName,registrations.SignedDate,
SecondaryCode1 AS MyID, Title, CommodityCode
FROM registrations
JOIN CommodityCodes ON SecondaryCode1 = CommodityCodes.id
UNION
SELECT
registrations.Company,registrations.Address1,registrations.Address2,registrations.City,registrations.State,registrations.Zip,registrations.ContactName,registrations.Phone,registrations.Fax,registrations.Email,registrations.Website,registrations.Feid,registrations.BusinessType,registrations.BackupWitholding,registrations.SignedName,registrations.SignedDate,
SecondaryCode2 AS MyID, Title, CommodityCode
FROM registrations
JOIN CommodityCodes ON SecondaryCode2 = CommodityCodes.id
UNION
SELECT
registrations.Company,registrations.Address1,registrations.Address2,registrations.City,registrations.State,registrations.Zip,registrations.ContactName,registrations.Phone,registrations.Fax,registrations.Email,registrations.Website,registrations.Feid,registrations.BusinessType,registrations.BackupWitholding,registrations.SignedName,registrations.SignedDate,
SecondaryCode3 AS MyID, Title, CommodityCode
FROM registrations
JOIN CommodityCodes ON SecondaryCode3 = CommodityCodes.id
UNION
SELECT
registrations.Company,registrations.Address1,registrations.Address2,registrations.City,registrations.State,registrations.Zip,registrations.ContactName,registrations.Phone,registrations.Fax,registrations.Email,registrations.Website,registrations.Feid,registrations.BusinessType,registrations.BackupWitholding,registrations.SignedName,registrations.SignedDate,
SecondaryCode4 AS MyID, Title, CommodityCode
FROM registrations
JOIN CommodityCodes ON SecondaryCode4 = CommodityCodes.id
UNION
SELECT
registrations.Company,registrations.Address1,registrations.Address2,registrations.City,registrations.State,registrations.Zip,registrations.ContactName,registrations.Phone,registrations.Fax,registrations.Email,registrations.Website,registrations.Feid,registrations.BusinessType,registrations.BackupWitholding,registrations.SignedName,registrations.SignedDate,
SecondaryCode5 AS MyID, Title, CommodityCode
FROM registrations
JOIN CommodityCodes ON SecondaryCode5 = CommodityCodes.id
WHERE registrations.ID = @SearchTxt
=====================================
Thanks

Well, I tried using UNION ALL and got the same response. I also tried doing :
Title AS SecTitle1
Title AS SecTitle2
Title AS SecTitle3
etc...
I get different values in the Output Window when I execute the query,
but as expected it only returns the first value since the script
executes all the way through before it outputs values.
Here's how I'm executing:
while (rdr.Read())
// get the results of each column
string company = (string)rdr["Company"].ToString();
string address1 = (string)rdr["Address1"].ToString();
string address2 = (string)rdr["Address2"].ToString();
string city = (string)rdr["City"].ToString();
string state = (string)rdr["State"].ToString();
string zip = (string)rdr["Zip"].ToString();
string phone = (string)rdr["Phone"].ToString();
string fax = (string)rdr["Fax"].ToString();
string email = (string)rdr["Email"].ToString();
string website = (string)rdr["Website"].ToString();
string feid = (string)rdr["Feid"].ToString();
string businessType = (string)rdr["BusinessType"].ToString();
string contactName = (string)rdr["ContactName"].ToString();
string primaryCode = (string)rdr["PrimTitle"].ToString();
string secondaryCode1 = (string)rdr["SecTitle1"].ToString();
string secondaryCode2 = (string)rdr["SecTitle2"].ToString();
string secondaryCode3 = (string)rdr["SecTitle3"].ToString();
string secondaryCode4 = (string)rdr["SecTitle4"].ToString();
string secondaryCode5 = (string)rdr["SecTitle5"].ToString();
string backUp = (string)rdr["BackupWitholding"].ToString();
string signedName = (string)rdr["SignedName"].ToString();
string signedDate = (string)rdr["SignedDate"].ToString();

How to refresh a table with multiple joins

Hi,
First at all, I'm newby in ADF, and my english is no so good, sorry for that...
I'm using JDeveloper 11g Release 2 (11.1.2.3.0). I have a table created from a view object that have multiple joins with other entities. When I insert a new row programmatically in one of the entities of the joins (not in the entitiy of the view object itself), the new row is created in the database correctly but the table don't show it. What can I do to refresh the table to see the new row created?
Thanks in advance!

You have to update the iterator the table is based on for the ui last. You do that by executing the query on the iterator again.
Timo

Multiple Data Sources In One Logical Table

I am new to OBIEE and I have came accross an issue. I appologize if this information is in the forum somewhere but I have searched and cannot find it.
My situation is that I would like to have one logical table that contains multiple data sources which have all the same columns. I already have session variables setup to differentiate the user's security through a row-wise variable for a specific column and a session variable for another column which determines the user's association to the data source in which they belong to. This security works well when the data sources are seperated in the Business Model and Mapping portion but the issue that arises is that the user's cannot share reports when the data sources are seperated in the BM&M.
I have dragged and dropped a table from the Physical model to the BM&M, I then dragged the second data source (with same meta data structure) over to the "Sources" folder in the first data source table in the BM&M. On the Content tab or each data source table I have defined the WHERE clause as such, where VALUEOF(NQ_SESSION."SCHOOL") session variable is my row-wise column filter and the VALUEOF(NQ_SESSION."GROUP") filter is my data source determinative:
sandbox."".SANDBOX.OBIEE_CROSS_ENROLLMENTS.HOME_SCHOOL = VALUEOF(NQ_SESSION."SCHOOL") AND sandbox."".SANDBOX.OBIEE_CROSS_ENROLLMENTS.DATA_SOURCE = VALUEOF(NQ_SESSION."GROUP")
Unfortunatley this only returns values in the BI Answers for the first drag and drop Pysical table in the BM&M layer and not the second Physical table drug into the "Sources" folder. I have also tried to create a new logical table and drag both tables into the "Sources" folder to no avail. I have experimented with the Fragmentation content on the "Content" tab of the seperate logical tables, checking the "This source should be combined with other sources at this level", which gives me an error in BI Answers that a column does not exist which really does.
What could I be missing? Advanced thanks to those who reply.
Thank you,
Kyle

Stijn,
Thank you for the article link. That was very helpful! It seems that I had a few things off as you do need the "This source should be combined with other sources at this level." checked. In my two table source columns for DATA_SOURCE I defined a literal ('086496' and '085597' for the other) in the Column Mapping tab. I pasted the following in the Fragmentation content, checking the "This source..." box on the Content tab:
eSIS.SANDBOX4_SCHOOLS.DATA_SOURCE = '086496'
And pasted the following into the WHERE clause, checking "Select distinct values" on the Content tab:
sandbox4."".OBIEE.NWOCA_SCHOOLS.SCHOOL_CODE = VALUEOF(NQ_SESSION."SCHOOL") AND sandbox4."".OBIEE.NWOCA_SCHOOLS.DATA_SOURCE = VALUEOF(NQ_SESSION."GROUP")
This took care of my user's security, utilizing the session variables in the WHERE clause. I am now able to generate reports that only one user can access from one data source and share that same report with another user who can only see data from the other data source.
Many thanks!!!

Cdc on multiple joined source datastores

Similar Messages

Maybe you are looking for