Update/Insert records from Oracle to MySQL

Hi team, 
My application will insert/update records into Oracle database, I need to sync all of records into MySQL database.  I designed a package to load data from Oracle to MySQL, the Oracle database use OLE DB component and MySQL database use ADO.NET.
How to insert new records into MySQL? If the old record exists, we also need to replace with new record. I did some research, someone suggest to create a stage table to handle this scenario, but I have 14 tables in this case. How to handle this scenario
with high performance? 
If there is anything unclear, please let me know. 
Thank you in advance. 

Finally, I created 14 tables as same as in our MySQL database system with prefix "updated" , they are use to store the updated records from Oracle system. All of new records we add a flag, the "1" means insert a new record into the system,
and the "0" means we should updated. So, I can use the conditional split component to split all of new records. The new records insert into the target table and the updated records insert into the "updated_table". Finally, we can add a
SQL Script task to run a update script to sync all of records. 
I don't use Lookup Transformation because we must use Cache
Transform transformation in this case, the Cache connection manager to save the data to a cache file (.caw), it will hard to
trace the history data in the future.  
In addition, I recommend to use ODBC connection if somebody face the similar scenario with me, there is a bug  if we use ADO.NET to
load data from Oracle to MySQL by using SSIS. For more information, please refer the MSDN document: http://blogs.msdn.com/b/mattm/archive/2009/01/07/writing-to-a-mysql-database-from-ssis.aspx
@Arthur, thanks again for your input.  Have a nice day! :)

Similar Messages

  • How to update multiple records in Oracle ?

    Hi Guys,
    <b>I have to update multiple records from a file into Oracle Table...</b>
    I can successfully insert the multiple records into the table but can't update the multiple records into the table.
    when i am using UPDATE_INSERT only my first record of the file is getting updated in th e table..
    Please share your views with me.
    Regards,

    I solved it by making changes in the occurrence  parameter of data type ...:-)

  • Create a Database Link from Oracle to MYSQL on windows

    Hi
    I need to create a database link from oracle to mysql database on windows to fetch some records.Can anyone help me on this?

    Search for Transparent Gateways, Heterogeneous Services...
    The Oracle SQL Developer have drivers to Access, MySQL and SQL Server.

  • Insert data from oracle  to sql server

    we have running R12.1.1 .
    our company wants to deploy some CRM Application with sql server database. Continuously we have to insert data ( some fields from some tables of Order Management module ) from ORACLE -----------> SQL Server
    My Questions are :
    1. What are possible methods to insert data from ORACLE -----------------> SQL Server ?
    2. What are pros and cons of each method ?
    3. What is performance over load of each method ?
    PLease share your valuable knowledge / ideas / suggestions
    thanks

    What is a maximal latency for data changed in Oracle come into MS SQL?
    this data will be updated in CRM after 24 hours.Does it mean that data replicated from Oracle will be updated in MS SQL and should be replicated back?
    i want to know more details about these APIs etc and middle layer.what API? In MS SQL you can use Linked server and write SQLs that select from Oracle tables via that linked server and insert/update/delete into MS SQL. You can organize these SQLs into T-SQL procedures and run them in jobs.
    Also you can use MS SQL replication, snapshot or transactional, which is ugly because it places triggers on Oracle tables. I doubt that this will be approved by app vendor.
    Also you can use Oracle Streams via Transparent Gateway for MS SQL, which will be quite heavy solution.
    Also, if real-time replication is needed, you can use "middle layer" Oracle Golden Gate, which may be quite pricy for 30 tables.
    Also, if real-time replication is needed, you can use 3-rd party middle layer like DataCurrents or others.

  • Retrive last inserted  record  from database table

    Hi,
    some body inserting a record into table 'A' through some procedure/java program.i want to retrive the last inserted record from database table.records are not stored in order.Can any body help me.

    In general, unless you are storing a timestamp as part of the row or you have some sort of auditing in place, Oracle has no idea what the "first" or "last" record in a table is. Nor does it track when a row was inserted.
    - If you have the archived logs from the point in time when the row was inserted, you could use LogMiner to find the timestamp
    - If the insert happened recently (i.e. within hours), you may be able to use flashback query to get the value
    - If you're on 10g or later and the table was built with ROWDEPENDENCIES and the insert happened in the last few days and you can deal with a granularity of a few seconds and you don't need 100% accuracy, you could get the ORA_ROWSCN of the row and convert that to a timestamp.
    If this is something you contemplate needing, you need to store the data in the row or set up some sort of auditing.
    Justin

  • Update database record from email link or attachment ?

    Hello,
    Is there any way to send email from application with a link to update database record (like oracle workflow in selfservice).
    This is applied for approval process.
    Rather than the approval will log onto the application, he will click on the attachment or link then the update statement will fire.
    Is it  possible?

    You didn't add a forms version, so this is hard to guess. If you are on 10g and higher then you are using Oracle Application Server; in the installation there is the mod_plsql apache module included as well:
    http://docs.oracle.com/cd/B14099_19/web.1012/b14010/concept.htm
    so you could simply call a stored procedure via a HTTP request which updates your record. If you are on a lower version of forms you could make use of the free mod_owa module which you could configure with a plain apache installation on e.g. your database server: https://oss.oracle.com/projects/mod_owa/dist/documentation/modowa.htm
    you should implement some sort of authentication as well; both mod_owa and mod_plsql also have the facility to do so via +owa_custom+
    OWA_CUSTOM
    (see the OwaAuth directive in mod_owa for example).
    Of course you could do the very same via a custom Java Servlet; however you'd have to implement the database connection pool, the call of your stored procedure, the authentication e.g. as well which you would get for free with the apache modules.
    cheers

  • Tnsping timed out using dg4odbc from Oracle to MYSQL through ODBC

    Hi,
    I encountered problem when trying to connect from Oracle to MYSQL using dg4odbc, hope you can shed some light
    Oracle database is 11.1.0.7 on SUSE Linux 64-bit.
    Since the application which runs on MYSQL DB only offers ODBC driver on Windows platform, so I installed the 32-bit ODBC driver (from ServiceNow) on a 32-bit windows server (driver download from http://wiki.service-now.com/index.php?title=ODBC_Driver) .
    created system DSN: MYSQLDEV, The DSN connection works fine. I then installed Oracle 11.2.0.1 gateway for ODBC 32-bit on the same windows server, the following configurations were done:
    On 32-bit Windows server:
    in gatewayHome\hs\admin
    initMYSQLDEV.ora:
    # HS init parameters
    HS_FDS_CONNECT_INFO = MYSQLDEV
    HS_FDS_TRACE_LEVEL = DEBUG
    in gatewayHome\network\admin:
    listener.ora
    LISTENER =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = abcdes.sda.sdva.com)(PORT = 1521))
    SID_LIST_LISTENER=
    (SID_LIST=
    (SID_DESC=
    (SID_NAME=MYSQLDEV)
    (ORACLE_HOME=C:\product\11.2.0\tg_1)
    (PROGRAM=dg4odbc)
    ADR_BASE_LISTENER = C:\product\11.2.0\tg_1
    stop and started listener on windows server and check listener status
    C:\product\11.2.0\tg_1\bin>lsnrctl status listener
    LSNRCTL for 32-bit Windows: Version 11.2.0.1.0 - Production on 29-MAR-2012 21:42:08
    Copyright (c) 1991, 2010, Oracle. All rights reserved.
    Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=abcdes.sda.sdva.com)(PORT=1521)))
    STATUS of the LISTENER
    Alias LISTENER
    Version TNSLSNR for 32-bit Windows: Version 11.2.0.1.0 - Produ
    ction
    Start Date 29-MAR-2012 21:11:36
    Uptime 0 days 0 hr. 30 min. 32 sec
    Trace Level off
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Parameter File C:\product\11.2.0\tg_1\network\admin\listener.ora
    Listener Log File c:\product\11.2.0\tg_1\diag\tnslsnr\abcdes\list
    ener\alert\log.xml
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=abcdes.sda.sdva.com)(PORT=1521)))
    Services Summary...
    Service "MYSQLDEV" has 1 instance(s).
    Instance "MYSQLDEV", status UNKNOWN, has 1 handler(s) for this service...
    The command completed successfully
    On Linux server where Oracle DB resides.
    Added the following tns entry "jelly" on the Linux server ORACLE_HOME/network/admin:
    jelly =
    (DESCRIPTION=
    (ADDRESS=(PROTOCOL=TCP)
    (HOST=abcdes.sda.sdva.com)
    (PORT=1521))
    (CONNECT_DATA=(SID=MYSQLDEV))(HS=OK)
    tnsping from Linux server (64-bit) failed with timeout error:
    tnsping jelly
    TNS Ping Utility for Linux: Version 11.1.0.7.0 - Production on 29-MAR-2012 21:12:38
    Copyright (c) 1997, 2008, Oracle. All rights reserved.
    Used parameter files:
    Used TNSNAMES adapter to resolve the alias
    Attempting to contact (DESCRIPTION= (ADDRESS=(PROTOCOL=TCP) (HOST=abcdes.sda.sdva.com) (PORT=1521)) (CONNECT_DATA=(SID=MYSQLDEV))(HS=OK))
    TNS-12535: TNS:operation timed out
    tnsping from Windows server works fine: (added same tnsnames entry on windows server for testing purpose only)
    C:\product\11.2.0\tg_1\bin>tnsping jelly
    TNS Ping Utility for 32-bit Windows: Version 11.2.0.1.0 - Production on 29-MAR-2
    012 21:45:20
    Copyright (c) 1997, 2010, Oracle. All rights reserved.
    Used parameter files:
    C:\product\11.2.0\tg_1\network\admin\sqlnet.ora
    Used TNSNAMES adapter to resolve the alias
    Attempting to contact (DESCRIPTION= (ADDRESS=(PROTOCOL=tcp)(HOST=abcdes.sda.sdva.com)(PORT=1521)) (CONNECT_DATA=(SID=MYSQLDEV)) (HS=OK))
    OK (20 msec)
    if listener is not listening to the service, then the tnsping on the windows server should fail as well.
    I don't know why only the tnsping from Linux failed, is it due to the 32-bit ODBC uncompatibility with 64-bit oracle server? or my configuration problem?
    Of course, when I created the DB link from oracle, the connection failed with
    create database link mysqldev connect to xxxx identified by "xxxxx" using 'jelly';
    Database link created.
    select * from tab1;
    ERROR at line 1:
    ORA-28545: error diagnosed by Net8 when connecting to an agent
    Unable to retrieve text of NETWORK/NCR message 65535
    ORA-02063: preceding 2 lines from MYSQLDEV
    Thanks for your help,

    Hi Mike,
    This is part of the tnsping.trc file which contains the error. IP address is in the tnsnames entry with this tnsping.
    nsopen: opening transport...
    nttcon: entry
    nttcon: toc = 1
    nttcnp: entry
    nttcnp: creating a socket.
    nttcnp: exit
    nttcni: entry
    nttcni: Tcp conn timeout = 0 (ms)
    nttcni: trying to connect to socket 5.
    ntt2err: entry
    ntt2err: soc 5 error - operation=1, ntresnt[0]=505, ntresnt[1]=110, ntresnt[2]=0
    ntt2err: exit
    nttcni: exit
    nttcon: exit
    nserror: entry
    nserror: nsres: id=0, op=65, ns=12535, ns2=12560; nt[0]=505, nt[1]=110, nt[2]=0; ora[0]=0, ora[1]=0, ora[2]=0
    nsopen: unable to open transport
    nsiocancel: entry
    nsiofrrg: entry
    nsiofrrg: cur = 53b9f8
    nsbfr: entry
    nsbaddfl: entry
    nsbaddfl: normal exit
    nsbfr: normal exit
    nsiofrrg: exit
    nsiocancel: exit
    nsvntx_dei: entry
    nsvntx_dei: exit
    nsopenfree_nsntx: nlhthdel from mplx_ht_nsgbu, ctx=53a7e0 nsntx=53ade0
    nsiocancel: entry
    nsiofrrg: entry
    nsiofrrg: exit
    nsiocancel: exit
    nsmfr: entry
    nsmfr: 2712 bytes at 0x53ade0
    nsmfr: normal exit
    nsmfr: entry
    nsmfr: 1528 bytes at 0x53a7e0
    nsmfr: normal exit
    nsopen: error exit
    nscall: error exit
    nscall: entry
    nscall: connecting...
    nsclose: entry
    nsclose: normal exit
    nladget: entry
    nladget: exit
    nsmfr: entry
    nsmfr: 264 bytes at 0x528900
    nsmfr: normal exit
    nladtrm: entry
    nladtrm: exit
    nscall: error exit
    nlse_term_audit: entry
    nlse_term_audit: exit
    Thanks,

  • Inserting records from internal table to database table

    Hi all,
    i want to insert records from internal table to zDatabase table, can u plz guide me which statement is better in performance to insert the records.
    1) insert one by one record from internal table
    loop at itab.
    insert ztable from wa.
    endloop.
    2) insert total records at a time
    INSERT <dbtabname> CLIENT SPECIFIED FROM TABLE itab.
    or let me know if any other statement is there with high performance.
    i internal table contains nearly 40000 records.
    thanks.

    Hi,
    Insert the entire table at atime rather than a record so as to increase the performance.
    you can use INSERT <dbtabname> CLIENT SPECIFIED FROM TABLE itab.
    or
    MODIFY ZPRODUCT FROM TABLE GI_AFPO.
    Regards,
    Raj.

  • Retrieving record from oracle DB very slow..pls help

    Hi, i'm writing a VB code to retrieving records from Oracle DB Server version 8. I'm using VB Adodb to retrieve the records from various tables. Unfortunately one of the table are very slow to response, the table only contain around 204900 records. The SQL Statement to retrieve the records is a simple SQL Statement that contain WHERE clause only. Any issue that will make the retrieving time become slow? Is that a Indexing? Oracle Driver? Hardware Spec? Or any solution for me to improve the performance. Thanks!

    Well, there are a few things to consider...
    First, can you try executing your query via SQL*Plus? If there are database tuning problems, your query will be slow no matter where you run it.
    Second, are you retrieving significantly more rows in this query than in your other queries? It can take a significant amount of time to retrieve records to the client, even if it's quick to select them.
    Justin

  • Can Hyperion repository be migrated from Oracle to MySQL

    Hi Gurus,
    I was wondering if Hyperion Repository can be migrated from an existing Oracle database to MySQL database. If yes, then how? Any kind of advice is greatly appreciated.
    Regards,
    Uday

    Hi,
    First question is why you want to move from Oracle to MySQL as in newer versions of Hyperion MySQL is not supported anymore.
    There is no direct way of migrating the database you would have to look at using a 3rd party conversion tool or writing some custom code.
    Cheers
    John
    http://john-goodwin.blogspot.com/

  • Migrating Stored procedure from Oracle to Mysql

    Dear All,
    Please suggest, is ther any tool of stored procedure migration from oracle to mysql.
    I tried some tool like
    1. Intelligent Converter.
    2. Sql way
    3. Mysql Migration Toolkit.
    But procedure cannot migrate properly.
    hb venki

    Venki,
    I think you are in the wrong place, try finding a MySQL forum ;0)

  • Insert records from report program into R3 table

    Hi
    I wanted to insert records from report program into R3 table.
    here is my code
    data : itab type standard table of zemp initial size 10 with header line.
    itab-EMPNO = '012'.
    itab-ENAME = 'XXXX'.
    itab-JOB = 'XXXX'.
    APPEND itab.
    insert ztable from table itab.
    but i am getting the following error
    the type of the data base table and work area/internal table "ITAB" are no unicode-converible.
    how can I insert records from report program into R3 table
    should I have to write move corresponding
    pls guide
    thanks
    manian

    Hi,
    itab-EMPNO = '012'.
    itab-ENAME = 'XXXX'.
    itab-JOB = 'XXXX'.
    APPEND itab.
    insert ztable from table itab.
    Do one thing
    Data : itab type table of ztable with header line.
    itab-EMPNO = '012'.
    itab-ENAME = 'XXXX'.
    itab-JOB = 'XXXX'.
    APPEND itab.
    insert ztable from table itab.
    error will resolve, then try to make structure similar to ZTABLE

  • Inserting Data from Oracle to SQL Server on the Real Time Basis.

    Hi Everyone,
    I need to insert data from Oracle to SQL Server on the Real Time basis, we have to fetch data from oracle approx 20 tables, and each table has more than 30 Fields. I need to fetch data in every 15 mins.
    I have created a job using SQL SERVER Agent by writing insert queries for all the tables with conditions that no rows will be inserted which is already in SQL. note that this job is taking only 1 min to execute.
    But in this way our SQL Server getting hanged and it giving problems to other application running in the SQL SERVER.
    So i m requesting all of you that what is the best way to insert huge amount of data on the real time basis.
    Thanx in Advance.

    1) Create Linked server 
    2) insert data using openquery  and set job in sql agent
    3) run job after 15 minutes

  • How to write jsp select record from Oracle  divide per page , about 50 reco

    Dear Expert,
    How to write jsp select record from Oracle divide per page , about 50 record per page.
    Thank you very much.

    I wish I could, but there is no single sign on module available for Fusion, also, so called Fusion is yet another Word With Big Letters, behind it there is yet another OC4J ( now Oracle switched to Weblogic though) container with bunsh of Oracle apps residing in it.
    Generally speaking, neither Fusion nor Oracle Apps user database does not have any single authentication module available out of the box to integrate user database.
    It's a long sad story running straight from Oracle Apps 11.0.5.
    That's why I've created JAAS single sign on login module and used it ever since at OC4J 10.2 and onwards at OC4J 10.3
    Back to the topic: to develop Apps and test them externally using the session bean I've isted above, one need to copy certain libraries from Oracle Apps server, then add them as libraries for JDeveloper project.
    Here is the complete list:
    oracle.apps.fnd.cache
    oracle.apps.fnd.cache
    oracle.apps.fnd.common
    oracle.apps.fnd.functionSecurity
    oracle.apps.fnd.metadata
    oracle.apps.fnd.security
    oracle.apps.fnd.util
    oracle.apps.jtf.cache
    oracle.apps.jtf.security
    Edited by: Faceless on Nov 26, 2009 3:04 AM

  • Export tables and records from oracle 8i to oracle 10g

    hi,
    i had installed oracle 10g, but i want to export my tables and record from oracle 8i to oracle 10g.
    can you tell me

    Please have a look to Using Different Releases and Versions of Export in Utilities document.

Maybe you are looking for

  • Calling a WebService on a Web Dynpro Project

    Hi Experts, I'd made an EJB, then a WebService of that. I'd tested the url in a Browser, and everything works fine... I sent the values, and got the correct response. Now i'm trying to call it in a Web Dynpro. I'd imported the model, added to the con

  • Accessing Human Task Payload from ADF Task Flow

    Hi Using jDeveloper 11g TP4 SOA... The scenario is this: 1. We have created a Human Task which has parameters accountId and accountType in the payload. 2. We have then created a Task Flow based on that human task. 3. Inside the web folder with task f

  • How to determine the online user?

    hi, Im developing a project, in this project, i have a user login page, Now i want to know the number of online user who r login in this site? & i also want to know the number of viewer who are vising this site? Is there anyone who can help me? Pleas

  • Objects returned via JNDI Lookup

    All, I have had this nagging question in my head about JNDI lookups for some time now, but haven't had the time to do the proper research. The question is simple. The setup is simple as well. Suppose that we have a typical WLS setup, with WLS running

  • How is it possible that when I do have a Wifi connection, I cannot connect to Safari or Google Chrome or anything else internet-related?

    How is it possible that when I do have a Wifi connection, I cannot connect to Safari or Google Chrome or anything else internet-related? Sometimes it does all work, but after a while Wifi is still there and I am not able to go to any website whatsoev