Transfer large data between two databases via ODI

Hi, we want to transfer our 2 billion records (70gb) A database oracle server to B database oracle server via ODI LKM SQL to Oracle (SQLLDR).We use a filter like "prod_enter_date>sysdate-1" for daily records(about 200.000).It takes about 1 our.How can we transfer data faster, thanks for your advice.

OK so assuming the Oracle DB's can see each on the network other have a word with your DBA's about creating a DBLink and test out the LKM DB Link KM.
Also try Uli's amended LKM if dont want to be too intrusive on your souce system creating synonyms etc. : http://sonra.io/tag/lkm-db-links/
I have used both and they work fine.
Basically you are currently unloading a large amount of data, transfering to another location and then uploading that data with no transformation to the target environment, a DBLink LKM will transfer this data without the need to unload / upload , just the network transfer.
Another thread here : https://forums.oracle.com/message/9630782
To re-quote the that thread quoting the documentaion for that LKM : "As it says in the component description - "This module is recommended when developing interfaces between two Oracle servers."

Similar Messages

Synchronisation of data between two databases

i have two databases having tables with same fields and i would like to transfer the data from one database to the other , how do i do that? is there any link which talks about synchronisation of data between two databases?

Make the database name same in both databases and use Veritas tools for data copy.

How to transfer app data between two different game center accounts?

Hello, I really need some help.
I have looked all over the web for ways to transfer apps between two different game center accounts and different devices. Several weeks ago I started playing Campus Life on my relative's Ipad 2, therefore spending many long hours to get to this point in the game.
The problem is I just got an Iphone 5 and I really would like to transfer the data onto it, so that I would not need to start all over again.
My grandma has an account (Game Center) onto which the data has been saved and I would like to have it stored onto mine. On some forum someone said to sign into the account which has the data on both devices and to then open up the game on the new device. It worked. Then I signed out and logged in with my own account- the game started from scratch. I panicked. I went back on the other account, and the data reappeared. I have been going back and forth, the game changing as many times. I thought it would ask to back up my grandma's data on mine but I was wrong. I can not seem to save the game onto my new account, and I have even tried to back it up to Itunes and then copy it onto my phone after having signed into my own account. And I don't know how to properly use Icloud. I am a mess. I am completely lost and have found no help on the web. (All people seem to have to deal with is sharing Apple IDs with different Game Center Accounts for the kids and transferring apps from one of their devices to another.)
I am so worried I am going to mess up and will lose the whole thing completely.
I have just started another game with my own account but since I am using my grandma's, the data is erased. It's one or the other but I definitely prefer saving Campus Life. I do not like the idea of having to only pick one.
I do not know any technical terms, so if you understand or even have the slightest clue about what I am talking about, I applaud you.
This seems like mission impossible, so if anyone can help in any way, I would be really grateful.
Thanks in advance for your time and thoughts!

I meant to press on "This solved my question"... Sorry if you needed the points.
Thank-you and I will just go back and forth between the accounts.

Transfer large files between two Macs over the web

I would like to transfer a number full quality photos from a DSLR between two computers located in different states. Both machines are Macs, running Tiger. I would prefer a direct transfer method rather than breaking the files into email messages, which would be quite time consuming given the size of the files.
What is the best way to accomplish this? If the two machines were on the same local network it would be easy, but they are not so simply enable file sharing doesn't solve the problem (as far as I know). Can I enable FTP access on the host machine and access if from across the web? How would I figure out the proper address from outside the local network (assuming NAT is used on both ends). Is there a program I could use to make the process simpler (some sort of Bittorrent or DC++ program)?
Or is there a good online service that is free that allows large amounts of storage?
Thanks for the suggestions.
-Josh

You could...
...turn on port forwarding in the destination router, forwarding port 22 for ssh to the destination computer
...turn on remote login on the destination computer
...turn on file sharing on the destination computer
...open a Terminal window and type ssh -L5548:localhost:548 [email protected]
where "user" is a valid account name on the destination computer and "IP.of.dest.Computer" is the IP address assigned by the destination computer's ISP to its broadband modem. The destination computer can get this information from http://www.whatismyipaddress.com/ as BDAqua said. Then, so long as the ISP doesn't change the dynamic IP address before you actually do the transfer, you're okay. It's possible to get a free dynamic host name which circumvents this problem.
After all that, then on the source computer, you would just do a ⌘k and enter localhost:5548 and select the shared user account and login, then the remote computer will mount like an icon on the desktop of the source computer, as if it werre a local external drive. Then it's just drag-and-drop. ⌘e when done, then in terminal, type exit and then ⌘q.
I would not leave port 22 forwarded in the router any longer than I had to, unless you do a little work to harden your ssh remote login. However, even if you do nothing to harden it, it is way better as is than leaving ftp open.

Technique to pass data between two databases

I am developing a web application with an offline client.
for offline client am using embedded mysql using mysql-je http://mysql-je.sourceforge.net/
for online ie for overall application( server ) am using mysql 5.0.
i want to update data from client to server and also from server to client .
pls tell me is how i can implements this ?...
Message was edited by:
vp_anil

The other reply is about connectivity only. If you have connectivity then it isn't relevant. If you don't then you can't do anything.
So ignoring that....
>
pls tell me is how i can implements this ?...It depends on your data.
Basically you can have the following data problems
A. Add rows
B. Delete rows
C. Modify rows
You can also have two directions
1. Client to main database.
2. Client from main database.
In terms of solution.
- Decide direction.
- Add rows - use a creation time stamp. Get last update timestamp then moving anything newer.
- Delete rows. Harder than add because either you have to keep a record of deleted entries or you have to compare the entire existing set and look for holes. Once you find existing entries then delete them.
- Modify. Much harder and it depends on the data. It should also be considered whether manual verification is required. For instance can the customer address (stored in the database) be updated both on the clien and the main database? If yes then which one is right? What if the address was updated in both places and then a day later the phone number was updated? Two changes and maybe one is right in one place and one is right in the other. A replay log might help here but maybe not.

Use of SAP memory to transfer data between two different sessions.

Hello experts,
I wish to know how to use SAP memory to transfer data between two different sessions.
The scenario is that when I run a report and change a variable, the value of changed variable should be availabe to another user on another terminal.
Thanks & Regards!
Sumit

Hello,
Just to add what Max has already mentioned. IMPORT TO / EXPORT FROM DATABASE statements can be used to store data in special "cluster" tables (you can't use any DDIC table) e.g., INDX.
@OP: You can opt for Shared Memory(SHM) for this specific requirement as well. In my opinion SHM is a bit tricky to code, but it is easier to monitor. The opposite holds true for "data clusters".
You should remember SHM is app-server specific. So if you've a load balancing scenario, using SHM can cause problems.
Hope i'm clear.
BR,
Suhas
Edited by: Suhas Saha on Nov 19, 2010 4:12 PM

How can I copy large amount of data between two HD ?

Hello !
Which command could I user to copy large amount of data between two hard disk drives ?
How Lion identify the disk drives when you want to write some script, for example in Windows I sue
Robocopy D:\folder source\Files E:\folder destination
I just want to copy files and if the files/folders exist in destination the files should be overwritted.
Help please, I bougth my first MAC 4 days ago.
Thanks !

Select the files/folders on one HD and drag & drop onto the other HD. The copied ones will overwrite anything with the same names.
Since you're a newcomer to the Mac, see these:
Switching from Windows to Mac OS X,
Basic Tutorials on using a Mac,
Mac 101: Mac Essentials,
Mac OS X keyboard shortcuts,
Anatomy of a Mac,
MacTips,
Switching to Mac Superguide, and
Switching to the Mac: The Missing Manual,
Snow Leopard Edition.&
Additionally, *Texas Mac Man* recommends:
Quick Assist,
Welcome to the Switch To A Mac Guides,
Take Control E-books, and
A guide for switching to a Mac.

How to transfer files between two Macs via Firewire cable?

I heard you can transfer selected files between two Macs running Tiger. I'm not talking about setting up a new Mac w. files from an older one, if that's different? Can someone enlighten me on this or point me to a "how-to" link? Thanks.

Yes, you pretty much just drag and drop or copy and paste depending on which way you like better. It is pretty much like connecting an external hard drive. Just find the files you want and copy them over to your other computer.
This is one of my favorite features from Macs. It's very simple to do and because it's Firewire even large files transfer over very quickly.

How can i make network between two databases ?

Good Morning to all ;
Going to configure oracle 10g - ( I trying to exchange data between two different databases.
Each database is configured in different operating systems.
For ex : one database from windows XP(seperate virtual machinne)
one database from linux rhel (seperate virtual machinne)
I am waiting for some suggestions ..
Thanks ..
Edited by: 969352 on Mar 19, 2013 10:04 AM

969352 wrote:
What virtualization product are you using?*#* vmware-toolbox-cmd -v
8.1.3.9911 (build-203739)
VMWARE Product Information :
Version : 7.0.0 build - 203739
OK. You will need to make sure the ip addresses you assign to your vms are in the same subnet as the adapter create by the installation of vmware. Once you get the fundamental network setup fixed, you can treat these vms just like any machine in your data center. Forget the vm console and access them exactly like you would any remote server -- putty for the linux machine and Windows Remote Desktop for the Windows machine.
At a command prompt on the host, issue this:
c:> ipconfig -allYou will get back info on several net adapters, two of which are identified as being with vmware -- vmNet1 and vmNet8. Note the IP addresses of both. We'll need it later.
You will also need to know how you configured the network adapters on your vm's -- NAT, bridged, hostonly, ???
Note that these issues are out of scope for this forum. I don't mind helping, but I no longer have a vmware installation to reference details.
What have you actually tried to do? ( Data Transfer )I tried to exchange data from windows database to linux DB
That's pretty vague. Exactly how did you try to "exchange data"? A sql statement using a db_link? export/import? Carrier Pigeon?
>
Where are you stuck?
I don't know , how to configure ip and necessary information for windows database.
Configuring an IP address is purely an OS admin issue and is out of scope for this database forum.
Google is your friend, but only if you use it: [url http://lmgtfy.com/?q=configure+windows+ip+address]http://lmgtfy.com/?q=configure+windows+ip+address
>
That's it Edstevens .. thanks ..

Using XML to exchange data between different databases?

Hi,
Does anyone know of any case-studies or tutorial's where XML has been used to transfer data between different databases... i.e. oracle to sql server?
I basically looking into the differences between two schema's and what sort of tranformations need to take place.
Thanks in advance guys!

Hi,
Does anyone know of any case-studies or tutorial's where XML has been used to transfer data between different databases... i.e. oracle to sql server?
I basically looking into the differences between two schema's and what sort of tranformations need to take place.
Thanks in advance guys!

I want to create serial communicatios between two notebooks via Bluetooth

Hi,
I'm trying to accomplish serial communications between two laptops via a Bluetooth connection.
The two laptops are NOT Toshiba notebook, but they are both running the Toshiba Bluetooth Stack For Windows. They are also both using the default Bluetooth Manager program that is supplied by Toshiba and Dell (just rebadged?).
Basically I can set up a connection no problems, but then I send serial data from one computer and watch the receiving serial port on the other computer but nothing ever arrives.
Are there any good tutorials for this? It would be nice to have something for the Toshiba Bluetooth Manager in particular as the windows and buttons will have the names as explained in the tutorial.
Thanks in advance.
Adam

I tried it for tests purpose via a hyperterminal connection and it worked.
Maybe the description contains also some helpful information for you.
Here is it:
PC1:
Start "Bluetooth Settings->Custom Mode->Select Remote PC->Select 'Serial Port'->Accept proposed COM port (in my case COM40)->Confirm wizard windows
until setup is finished".
PC2:
Start "HyperTerminal->Select COM7"
PC1:
Start "HyperTerminal->Select COM40 (in my case. See step 1 above)"
PC1, PC2:
Enter the same Passkey if security is turned on e.g. "0000"
PC1:
Everything what you type into HyperTerminal should be visible in HyperTerminal of PC2 and vice versa.

How to ...synchronization between two databases

Hi,
I want to set up automatic synchronization between two databases. For example, database DB1 and DB2 have table t1 and t2 with the same columns. If someone updates a record in table t1, I want automatically update the record in t2 or vice-versa.
How can I make an automatic system like that?

1) What is the business goal you're trying to satisfy? Failover, reporting, replication, geographic co-location, etc. each have their own set of technologies. Explaining what you're trying to accomplish from a business perspective will help us identify which technology (or technologies) to focus on.
2) Are you synchronizing a single table? Or multiple tables? Or all the tables in a schema? Or all the tables in a database?
3) Is there a stable network connection between the boxes?
4) What version of Oracle do you have (10.2, 10.1, 9.2, 9.0.1, etc)? What edition (standard, express, enterprise, etc)?
5) How quickly after a change has been made on DB1 does the change need to reflect on DB2?
6) Am I correct in understanding that you want to be able to change the same row of data on either DB1 or DB2? So the replication needs to go in both directions?
Justin

Dates between two dates

HI everyone!
I'm trying to obtain the dates between two given dates....
example:
SimpleDateFormat sdf = new SimpleDateFormat("dd/MM/yyyy");
Date a = sdf.parse("12/10/2005");
Date b = sdf.parse("22/12/2005");My desired result its a ArrayList of all dates between that period...
I already used the GregorianCalendar adding one day in a while condition until its equals the second date but it dosn't work for large periods of time...
Can somebody help me with this task?
thanks in advance !

while(gc.getTime().compareTo(finaldate ) != 0){No, that's still fragile. You're still comparing EXACT values, instead of checking for when one equals OR EXCEEDS the other.
If you're not going to use DrLaszlo's example to use the Calendar class for a better way, then at least do this instead:
while(gc.getTime().compareTo(finaldate ) < 0){

JDBC Thin driver doesn't support writing data into remote database via database link

Dear Oracle Guru:
Please confirm: Oracle JDBC thin driver does not support writing data to remote database via database link.
The following errors occur when trying to write data into a remote database via database link through jdbc thin driver:
ORA-03106: fatal two-task communication protocol error
ORA-02063: preceding line from FDBE.PAPDSRAS1
ORA-02063: preceding 2 lines from PA
SQL statement is a prepared statement using a SQL like: insert into mytable@pa (col1,col2) values (?,?).
Thanks.
null

Thanks, Dan.
I still think it is a driver problem, because I can do similar things in a stored procedure or in PL/SQL Developer to copy records from a local database table to a remote database table via database link (insert into mytable@pa select * from mytable). The value for distributed_transactions of our database is 10.

How to share the data between two or more frames

How to share the data between two or more frames based on the database relationship in JDeveloper?

You can pass data between frames by passing it as parameters.
That is when you are invoking another frame, pass your data as arguments through the constructor to that frame .
You can also achieve this through static or public methods, but static variables as we know is not suggested which might occupy more memory space.
Regards,
Srinivasan AShwath
<BLOCKQUOTE><font size="1" face="Verdana, Arial">quote:</font><HR>Originally posted by [email protected]:
How to share the data between two or more frames based on the database relationship in JDeveloper? <HR></BLOCKQUOTE>
null

Transfer large data between two databases via ODI

Similar Messages

Maybe you are looking for