Extraction from Oracle
Hello Experts,
As some of might already know that I'm new to complex extractions. Hence, the question:
What are basic steps/tools needed to extract from Oracle.
and
What are the main challenges?
I would really appreciate if someone could share some experience in a general context.
Thanks
Fran
Fran
Please see this link
https://www.sdn.sap.com/irj/servlet/prt/portal/prtroot/docs/library/uuid/2f0fea94-0501-0010-829c-d6b5c2ae5e40
Also have a look at this thread which already discussed
how create a db connection between oracle and bw
Hope this helps
Thnaks
sat
Similar Messages
-
Using XML extraction from Oracle and XSLT data transformation
Hi
How can transfer data ie: Using XML extraction from Oracle and XSLT data transformation with java application?
usually i use to do querying sql, getting data from table assinging to model class then send it to UI. how can i go for XML extraction form oracle?
thanksSorry, I don't understand what exactly you want to do. And I'm under the impression that you might not know exactly what you want to do as well. Could you explain a bit more detailed what you want to achieve?
-
DATA EXTRACTION FROM ORACLE & SYBASE
Hello members...
Good day. This is my first posting in this site. I am new to Oracle and have a question regarding Data extraction from Oracle and Sybase.
My project has two applications one having Oracle as the database and the other has Sybase as the database. On the proposed production schedule, there would be a interface data update from the Oracle database to the Sybase database.
My aim is to check if the data update is in sync after the update. We plan to extract the data from the two databases (Oracle and Sybase) and compare in a Third Party tool. We have the tool to compare. Can any of you suggest a nice data extraction tool. I have to set this data extraction as a batch in the nightly batch schedule.
Thanks in advance,
Regards,
Krishna Kumar...Sybase provides the best data extraction utility called BCP. You can load and extract data. It is very user friendly. From your unix prompt if you type in BCP ? you will all the switches and
help messages you need to use. It is so simple.
Oracle dosn't have such a utility to extract data from table.
You need to write a Stored procedure and use UTF_FILE package to
extract data from table and write into a file. -
Dear Team,
I am very newer in Golden Gate. Going thru with the blog and trying to learn.
http://www.pythian.com/news/7959/oracle-goldengate-installation-part-1/
I was trying to extract from the Oracle tables at the time of extraction
it’s giving error which are:-
1. 2011-02-01 10:20:16 ERROR OGG-00685 begin time Jan 28, 2011 1:48:12 PM prior to oldest log in log history. Last SQL executed <SELECT 1 FROM dual WHERE TO_DATE(:begin_time,'YYYY-MM-DD HH24:MI:SS') < (SELECT MIN(first time) FROM v$log_history WHERE thread# = :ora_thread)>.
2. 2011-02-01 10:20:16 ERROR OGG-01668 PROCESS ABENDING.
Configuration details are available in detail in Ext1.rpt. Please provide the solution for the same.
Thanks & Regards
Pramod Gaikwad
log file details are:-
Oracle GoldenGate Capture for Oracle
Version 11.1.1.0.0 Build 078
Windows (optimized), Oracle 10 on Jul 28 2010 15:50:58
Copyright (C) 1995, 2010, Oracle and/or its affiliates. All rights reserved.
Starting at 2011-02-01 10:20:14
Operating System Version:
Microsoft Windows XP Professional, on x86
Version 5.1 (Build 2600: Service Pack 3)
Process id: 1064
Description:
** Running with the following parameters **
extract ext1
userid ggate, password ********
rmthost INFVA04159.vshodc.lntinfotech.com, mgrport 7809
rmttrail /goldenGate/dirdat
ddl include mapped objname sender.*;
table sender.*;
2011-02-01 10:20:14 INFO OGG-01635 BOUNDED RECOVERY: reset to initial or altered checkpoint.
Bounded Recovery Parameter:
Options = BRRESET
BRINTERVAL = 4HOURS
BRDIR = C:\GoldenGate
CACHEMGR virtual memory values (may have been adjusted)
CACHEBUFFERSIZE: 64K
CACHESIZE: 1G
CACHEBUFFERSIZE (soft max): 4M
CACHEPAGEOUTSIZE (normal): 4M
PROCESS VM AVAIL FROM OS (min): 1.81G
CACHESIZEMAX (strict force to disk): 1.59G
Database Version:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Prod
PL/SQL Release 10.2.0.1.0 - Production
CORE 10.2.0.1.0 Production
TNS for 32-bit Windows: Version 10.2.0.1.0 - Production
NLSRTL Version 10.2.0.1.0 - Production
Database Language and Character Set:
NLS_LANG environment variable specified has invalid format, default value will be used.
NLS_LANG environment variable not set, using default value AMERICAN_AMERICA.US7ASCII.
NLS_LANGUAGE = "AMERICAN"
NLS_TERRITORY = "AMERICA"
NLS_CHARACTERSET = "WE8MSWIN1252"
Warning: your NLS_LANG setting does not match database server language setting.
Please refer to user manual for more information.
2011-02-01 10:20:15 WARNING OGG-01423 No valid default archive log destination directory found for thread 1.
2011-02-01 10:20:15 INFO OGG-01515 Positioning to begin time Jan 28, 2011 1:48:12 PM.
Source Context :
SourceModule : [er.redo.ora.metathr]
SourceID : [er/redo/oracle/ocimetathr.c]
SourceFunction : [OCIMETATHR_get_sequence]
SourceLine : [771]
2011-02-01 10:20:16 ERROR OGG-00685 begin time Jan 28, 2011 1:48:12 PM prior to oldest log in log history. Last SQL executed <SELECT 1 FROM dual WHERE TO_DATE(:begin_time,'YYYY-MM-DD HH24:MI:SS') < (SELECT MIN(first_time) FROM v$log_history WHERE thread# = :ora_thread)>.
2011-02-01 10:20:16 ERROR OGG-01668 PROCESS ABENDING.
Edited by: user2855889 on Feb 1, 2011 1:33 AMThis is a startup bug error where certain initial log positions are not resolved at initialization.
This should happen only if the first log switching didn't occur after the db was created and before extract was started
It is bug (11839680).
It is resolved by performing a database log switch.
Other causes and solutions:
If some of the nodes in RAC are not active, OGG will hit this error when trying to find the redo logs for those inactive nodes.
The solution in this case is to exclude those inactive nodes from GG, e.g. THREADOPTIONS PROCESSTHREADS SELECT 1 -
We need to pull data like material information, purchase order information from SAP to our local oracle database. How can we connect our application to download this data direcly from SAP's oracle database to our local database. We don't want to use BAPI calls. Is there is any way to connect to SAP's oracle directly?
There are ETL tools made for this that have add-ons for SAP R3/ECC, so that extraction of data uses native SAP functionality, and then loads to Oracle tables (including using native Oracle buik load functionality).
Two tools of this nature come to mind: Informatica and Talend. Informatica has an enterprise-class ETL tool that does exactly what you're looking to do, but the cost for Informatica is quite huge. On the other end of the spectrum, Talend also performs the tasks you're looking to perform and it's an open-source tool (free to download and use - cost for support and training). -
Data extraction from Oracle database
Hello all,
I have to extract data from legacy database tables. I need to apply a lot of conditions on data extraction using SQL statements for getting only valid master data, transaction data, SAP date format etc. Unfortunately I don;t have a luxary of accessing legacy system data base table to create table views and applying select statements.
Is there anyother way round by which I can filter data on source system side w/o getting into legacy system. I mean being in BW data source side.
I am suppose to use both UD connect and DB connect to test which will workout better way of data extraction. But my question above should be same in either interface.
This is very urgent as we are in design phase.
Points will be rewarded immediately.
Thanks
Message was edited by:
Shail
Message was edited by:
ShailWell I and eveyone know that it can be done in BI.
I apologize that I did not mention it in my question.
I am looking for very specific answer, if there is any trick we can do on source system side from BI. Or where we can insert SQL statements in infopackage or data source.
Thanks -
Avoid using DB link when extracting from Oracle in OWB map
if i define a db table as a source to extract data in my OWB mappings, it will generate PLSQL code which utilises a DBlink to get access to the table.
my question is, if my source table is in the same schema as my data warehouse runtime schema, can i tell OWB to avoid using a dblink ?!Hi Duncan,
Yes you can. What you will need to do is configure the mapping, which allows you to specify physical characteristics of a mapping. So it allows you to specify where or better how to access and object in a mapping. By default it gets the database link associated with the module it is sourced from.
To change this, in the module editor highlight your mapping. Click configure, and look at "sources and targets". Open this node and find your source table (or view). Open this node and deselect the "database link".
Should your table be in a different schema but in the same instance, you can specify a schema qualifier. You can also combine schema and dblink to point to a different instance and schema. If you specify the schema be sure to specify this in the correct case. OWB double quotes to preserve case, so use upper case in the most common scenario.
Hope this helps,
Jean-Pierre -
Data extracted from Oracle ASCP and presented in OBI
Hello,
I work for a company using the Oracle APS suite and for demand management and supply planning. The ASCP (Advanced Supply Chain Planning) tool is the key tool for our end user planners.
What are the interfaces like between Oracle APS and OBI?
Are there any OBI users who have enjoyed success using OBI to present the detailed data out of ASCP? The users report that getting visibility to the data in ASCP using the out of the box ASCP functionality is very limited.
I am interested in general feedback and any suggestions on where to get more information or perhaps to read about how other companies are using APS/OBI together.
Thanks and Best Regards,
Jim ShaughnessyOne way of doing this is setup Heterogeneous Database connections
http://www.dba-oracle.com/t_heterogeneous_database_connections_sql_server.htm
I am sure there's other options out there. -
How to Extract data from Oracle DB to BW via DBConncet interface.
HI All,
Do you know how to extract data from ORACLE data base to BW, using DBConnect.
Here we are not using R/3 Business content structures.
How to do it in both source system and BW side?
How to define structures on both sides.
Please provide any documents on that.
Thanks in Advance.
Sri.Hi Srilaxmi
Have a look at these links
http://help.sap.com/saphelp_nw04/helpdata/en/58/54f9c1562d104c9465dabd816f3f24/content.htm
http://help.sap.com/saphelp_nw04/helpdata/en/a1/89786c3df35c4ea930a994e884bb4c/content.htm
http://help.sap.com/saphelp_bw30b/helpdata/en/80/1a618ae07211d2acb80000e829fbfe/content.htm
and this thread
Extract from Oracle View with DB connect
regards
KR -
How to extract data from oracle database directly in to bi7.0 (net weaver)
how to extract data from oracle database directly in to bi7.0 (net weaver)? is it something do with EDI? can anybody explain me in detail?
Thanks
YorkYou can use UDConnect to get from Oracle database in to BW
<b>Data Transfer with UD Connect -</b>
http://help.sap.com/saphelp_nw04/helpdata/en/78/ef1441a509064abee6ffd6f38278fd/content.htm
<b>Prerequisites</b>
You have installed the SAP WAS J2EE Engine with BI Java components. You can find more information on this in the SAP BW installation guide on the SAP Service Marketplace at service.sap.com/instguides.
Hope it Helps
Chetan
@CP.. -
Extracting a flat file from oracle table
I have moved the knowledge module KIM ISO SQL to FileAppend from the Metadata to my project folder.
But when I create an interface mapping the oracle table and a flat file on a different unix server, in the drop down menu , it shows only KIM SQL TO SQL and KIM Control Append.It does not show up the SQL to FileAppend knowledge module option.
What should I do to extract a flat file from oracle table?
Thanks
Hima
Overstock.comAll IKM in the Drop Down Menu are dependent of the target technology.
A question, at this interface, is your target table a file ? -
How to extract data from Oracle Table to an Oracle XMLtype field
All,
I'm very new with ODI and I'm looking for a way to implement the following scenario:
I have the Oracle table A, already mapped to Data Model A. This table has the following fields:
field X (PK)
field Y
field Z
field W
I have a table B, already mapped to Data Model B. This table has the following fields:
field X (PK)
field V (XMLType)
I want to extract the data from Table A to a XML file with the following structure:
<X> yada yada yada </X>
<Y> yada yada yada </Y>
<Z> yada yada yada </Z>
<W> yada yada yada </W>
and then insert this file into the field V of Table B. How can I do that?
TIA,
RodrigoYou can use UDConnect to get from Oracle database in to BW
<b>Data Transfer with UD Connect -</b>
http://help.sap.com/saphelp_nw04/helpdata/en/78/ef1441a509064abee6ffd6f38278fd/content.htm
<b>Prerequisites</b>
You have installed the SAP WAS J2EE Engine with BI Java components. You can find more information on this in the SAP BW installation guide on the SAP Service Marketplace at service.sap.com/instguides.
Hope it Helps
Chetan
@CP.. -
There is IMP utility which provides me data as graphical way. But i need extract data in such a way so that i could able to use in my application.
thanks,
mohanHi,
EdStevens
Actually I was using SQL Developer. Sorry for the wrong define question. Now the real problem is:
I want to read or extract data in a txt file from Oracle Dump (.dmp) file without using Oracle sqlPlus or Oracle Database.
No need to say that i am able to extract dump data using sqlPlus. But for that, there is a little burden to install oracle database
or sql Developer.
I also listen about Oracle Loader a little bit. Is it a tool for providing extraction of data from Oracle dump file.
Thanks for your previous reply,
And now waiting for your suggestion.
thanks,
mohan -
Extract of Data from Oracle in a Flat File with Column and Record seperator
I have a case where I have to extract whole data froma Oracle Table where the Columns should be seperated by |@|
and Records by ^*^.
The reason for this is My data has Space and New line in it. So My Program to recoganize each column and record I want them to be seperated by special chars.
Itried this but of no much help.
set echo off newpage 0 space 0 pagesize 0 feed off head off trimspool on;
spool on;
set colsep '|@|';
set recsepchar '^*^';
spool "T_COMPLAINT.dat";
select * from T_COMPLAINT where ROWNUM < '100' order by cptoid;
spool off;Having '@' and '*' characters in the data will not make any difference if you are using a combined column separator of '|@|' - provided any process you use subsequently can handle it.
However, the recsepchar parameter appears to be restricted to a single character which is repeated right across the page, so I don't think you could have a single iteration of '|*|' using this method:
SQL> set newpage 0 space 0 pagesize 0 feed off head off trimspool on
SQL> set recsep EACH
SQL> set recsepchar '*'
SQL> set colsep '|@|'
SQL> select * from testa;
A |@|1@ |@|22-JUN-2010
B |@|2* |@|22-JUN-2010
B |@|2* |@|22-JUN-2010
********************************************************************************Edited by: LindaA on 23-Jun-2010 08:33 -
Extract data from Oracle in excel file
Hi,
I have a requirement where in I need to extract data from Oracle in excel file and the excel worksheet name should be "Data".
for eg. excel file name "AR Data_DDMMYY" and excel worksheet name "Data"
I have used the UTL_FILE API to extract the tab delimited data which can be opened in excel but it is not exactly an excel file as the worksheet name is same as the file name.
I tried using utl_file.fcopy and frename.
Is there any way to do this using PLSQL?
select * from v$version;
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bi
PL/SQL Release 10.2.0.5.0 - Production
"CORE 10.2.0.5.0 Production"
TNS for HPUX: Version 10.2.0.5.0 - Production
NLSRTL Version 10.2.0.5.0 - ProductionSample Code:
declare
cursor c is
select * from scott.emp;
v varchar2(100);
f utl_file.file_type;
file_name varchar2(100) := 'AR Data.xls';
dir varchar2(50) := 'CESDIR191710';
--select * from dba_directories
begin
f := utl_file.fopen(dir, file_name, 'W');
v := 'EMPNO'||chr(9)||'ENAME'||chr(9)||'JOB'||chr(9)||'SAL'||chr(9)||'HIREDATE'||chr(9)||'DEPTNO';
utl_file.put_line(f, v);
for i in c
loop
v := i.empno||chr(9)||i.ename||chr(9)||i.job||chr(9)||i.sal||chr(9)||i.hiredate||chr(9)||i.deptno;
utl_file.put_line(f, v);
end loop;
utl_file.fclose(f);
--utl_file.frename(dir, file_name, dir, replace(file_name, '.xls', '_')||to_char(sysdate, 'MMDDYY')||'.xls', false);
utl_file.fcopy(dir, file_name, dir, replace(file_name, '.xls', '_')||to_char(sysdate, 'MMDDYY')||'.xls');
end;Thanks
ImranImran Soudagar wrote:
Hi,
I was able to generate the excel 2007 file with the data using the package from below link;
http://technology.amis.nl/2011/02/19/create-an-excel-file-with-plsql/
but the requirement is to generate excel 2003 file.
I tried changing the .xlsx to .xls and it gives a note while opening the file "The file you are trying to open, abc.xls, is in a different format than specified by the file extension. Verify that the file is not corrupted and is from a trusted source before opening the file. Do you want to open the file now?"Then you have three options:
1) stop using anton's package and find another one that supports the old and deprecated version of Excel 2003
2) write your own package to produce an Excel file.
3) Upgrade your version of Excel to a recent version
I tried the programs from other links on the forum but I am still getting this message. The client does not want this message to be displayed as the excel file works as an input to another system.
Can anyone help me with the issue?
Also, is it true that the programatically generated excel file is actually an xml file which is renamed to .xls and hence it shows the message while opening such files?Yes, Excel supports several different formats for it's files. By default, if you save an XLS files from Excel, it writes it out in a Microsoft proprietary binary format, which you would be hard pushed to replicate easily from PL/SQL. Excel also has the ability to save it's files as XML format, which is more readable and easier to produce programatically, whilst still allowing you to have multiple sheets, formulas and formatting included in it. That's the format that most people who need formatting and multiple sheets opt for when programatically generating their data as excel workbooks. (There's also an SLYK format that people used to use before that, but it's not as flexible)
If you want to write your own, the easiest thing to do is to start with a blank workbook in Excel, and put in your basic requirements e.g. a couple of named sheets, and some data in different formats (number, date, text etc.) and different formatting options etc. Save that file in XML format from Excel and then open up the file using notepad/wordpad to look at the structure. There'll be a whole load of redundant rubbish Microsoft put in there, but you should be able to figure out the basic structure of XML required to give you what you want.
Maybe you are looking for
-
How to resolve NullPointerException in ODI
Hi I getting following exception when I execute following ODI procedure. Please help me My scenario was to store data into temp table (where temp table is "bulk_load") Exception: java.lang.NullPointerException at com.sunopsis.dwg.dbobj.SnpSessTa
-
Requesting BASELINE_EXTENDED profile in air 3.9 or 4.0 causes error
This line of code stage.stage3Ds[0].requestContext3D( Context3DRenderMode.AUTO, Context3DProfile.BASELINE_EXTENDED ); causes error "Error #2008: Parameter profile must be one of the accepted values." if app is compiled for desktop with air sdk 3.9 or
-
Numbers displayed on header titles
Dear eminent helpers, Currently when i am trying to display this website www.esma.europa.eu, numbers are displayed next to the headers title. However, when i display on IE or Chrome, i don't have this bug, issue. This bug appeared with the installati
-
Compressor keeps crashing and quitting.
Hi, Compressor was working fine till yesterday. Now it either quits or crashed everytime, and Im not able to do anything in it. Even when I drop some small project movie, etc. It acts really really slow, gives the spinning wheel for long periods, and
-
Is there a way make Final Cut Pro X NOT open every event/project I have worked on at open?
I will admit, I am quite new to Final Cut Pro X, but have been a FCP user for years - this version is like learning to walk all over again. Everytime I open FCP X, it loads every event/project I have ever worked on, and it takes a looooong time. Is