How to load a huge data file (export from mysql) to an oracle table?

I have a data file which contains 1.3G bytes table data from mysql. It's format is csv.
How can i load these data to an oracle table in java way?
I thought about using sqlldr. But it requires a oracle client which may not be permitted in my environment.
If i generate "insert " statement and use batch update the batch update will stop if it comes across an exception when executing the insert one by one. I find no "insert ingore" statement in oracle like mysql.
Is there anyone can give me a solution with high performance? It's urgent and Thanks!

hsy541 wrote:
I have a data file which contains 1.3G bytes table data from mysql. It's format is csv.
How can i load these data to an oracle table in java way?
Why must it be a Java way? The point is just to move the data.
I thought about using sqlldr. But it requires a oracle client which may not be permitted in my environment.
Why not just import the .csv file into Oracle? I'm sure there's a script or utility that will do it.
If i generate "insert " statement and use batch update the batch update will stop if it comes across an exception when executing the insert one by one. I find no "insert ingore" statement in oracle like mysql.
You want to turn off transactions? I'm not an Oracle expert, but I'd be shocked if there was something you could do in MySQL that didn't have an analog in Oracle. Find a better resource, like somebody that actually knows Oracle. Who set up that database for you? Consult with them.
Is there anyone can give me a solution with high performance? It's urgent and Thanks!Urgent to you....
%

Similar Messages

How do i send an html file exported from muse as email blast with images and live links?

My question it:
How do i send an html file exported from muse as email blast with images and live links?
I have designed a "website" in adobe muse and exported it as an html file. I am not sure how to send my .html file in an email!
Best,
Nicole

Unfortunately, the answer is, you don't. The requirements for HTML displayed in an e-mail reader are very different than those for HTML displayed in a browser. The output of Muse won't work as an HTML e-mail. You could upload the Muse site as a website and provide a link to it in an e-mail, but the HTML generated by Muse is not suitable for direct display by an e-mail program.

How to load thousands of data files?

My database is installed on windows, and I have thousands of data files that I need to load. Trying to figure out how to do it without manually editing my CTL file every time I load one data file.
Can you specifiy your control file to load directories instead of just a file?
Or can some looping script be written that makes the changes?
Thanks!
Message was edited by:
user447781

Don't list the data file in the CTL file ... use the "data=" option on the command line to pass in the data file.
A wrapper BAT file should be easy to create/generate.
D:\>sqlldr
SQL*Loader: Release 9.2.0.6.0 - Production on Mon Aug 29 13:52:54 2
Copyright (c) 1982, 2002, Oracle Corporation. All rights reserved.
Usage: SQLLDR keyword=value [,keyword=value,...]
Valid Keywords:
    userid -- ORACLE username/password
   control -- Control file name
       log -- Log file name
       bad -- Bad file name
      data -- Data file name
   discard -- Discard file name
discardmax -- Number of discards to allow          (Default all)
...

How do I use old data files with a new installation in Oracle 9i

I am in an unenviable position, with an unsupported database.
We are running Oracle 9i on Windows XP. We are upgrading soon to Oracle 11g on a newer platform, but need to get our development environment working first.
We lost a system that was running our development database without having a database export. The C drive was placed into a new system as the D drive.
I have loaded Oracle 9i on the C drive, but I have been unable to determine how to point it to the existing data files on the D drive. My search skills may be the limiting factor here...
We cannot simply load the drive as C, since the hardware is different.
What are the steps to point the new database software at the data files on the D drive? Or, how do I copy the old data files into the new Oracle Home and have them recognized properly?
Thanks for any advice.

user3930585 wrote:
I am in an unenviable position, with an unsupported database.
We are running Oracle 9i on Windows XP. We are upgrading soon to Oracle 11g on a newer platform, but need to get our development environment working first.
We lost a system that was running our development database without having a database export. The C drive was placed into a new system as the D drive.
I have loaded Oracle 9i on the C drive, but I have been unable to determine how to point it to the existing data files on the D drive. My search skills may be the limiting factor here...
We cannot simply load the drive as C, since the hardware is different.
What are the steps to point the new database software at the data files on the D drive? Or, how do I copy the old data files into the new Oracle Home and have them recognized properly?
Are you stating that you don't know how to use COPY command?
Can you recreate same directory structure on new C drive as exist on old C drive?
Can you then drag & drop copies of the files?

How can I use the data pump export from external client?

I am trying to export a bunch of table from a DB but I cant figure out how to do it.
I dont have access to a shell terminal on the server itself, I can only login using TOAD.
I am trying to use TOAD's Data Pump Export utility but I keep getting this error:
ORA-39070: Unable to open the log file.
ORA-39087: directory name D:\TEMP\ is invalid
I dont understand if its because I am setting the parameter file wrong or if the utility is trying to find that directory on the server whereas I am thinking its going to dump it to my local filesystem where that directory exists.
I'd hate to have to use SQL Loader to create ctl files for each and every table...
Here is my parameter file:
DUMPFILE="db_export.dmp"
LOGFILE="exp_db_export.log"
DIRECTORY="D:\temp\"
TABLES=ACCOUNT
CONTENT=ALL
(just trying to test it on one table so far...)
P.S. Oracle 11g
Edited by: trant on Jan 13, 2012 7:58 AM

ORA-39070: Unable to open the log file.
ORA-39087: directory name D:\TEMP\ is invalidDirectory here it should not be physical location, its a logical representation.
For that you have to create a directory from SQL level, like create directory exp_dp..
then you have to use above created directory as DIRECTORY=exp_dp
HTH

Newbie question: How to share large QT movie files exported from FCP X?

Well, I've navigated through FCP X for the first time and I now have 16 QuickTime movie files I have exported from FCP X. Each file is a song from a live band performance. The files are:
- Apple ProRes 422
- 1920 x 1080
- 24-bit
- Frame rate 29.97 fps
Now I need to share these files with the band members. They will use them for two purposes:
- Watch, as feedback on their performance. In this case, I'd like to preserve the quality as much as possible
- Put some of the movies on YouTube, where quality will be lost, of course. They may post only short clips from the songs.
These 16 .mov files total 115GB. The smallest is 6.5GB, the largest is 13.9GB.
The quality of the movies is fantastic, both video and audio. I cringe to think about degrading the quality............but I have the practical problem of how to get the files to five different band members.
I normally distribute audio files I've mixed in Pro Tools via DVD-R discs, but the files are much smaller.
What are my options for sharing the files?
Do I need to use an application like Compressor to compress the files (ugh) to get them onto multiple DVD-R's?
I would assume this is a common problem that all FCP X users deal with.

I strongly recommend you to use Compressor. It is easy to use and there a lot of presets.

HOW-TO Distinguish between file exported from Datapump and normal export

How to distinguish between the dmp file export from the data pump utility and the export utility in Oracle 10g and 11g .
Thanks,
SS

Like Werner suggested, it's never hurt to try anyway.
use imp with SHOW=Y, if it works then Original otherwise Data pump.
Once you determined one file, there's good chance that the rest are same. I don't think previous DBA will go through the trouble by mixing data pump and traditional exp/imp.

How to import a *.dmp file (exported from 10g) to 8i database?

Hi everybody!
Could anybody tell me how to import a *.dmp file (exported from 10g) to 8i database?
I have tried but it seemed to be error "wrong version".
Thanks a lot!

From 10.1.0 to 8.1.7 => Use the EXPORT 8.1.7 to export the data from the 10.1.0 database and IMPORT 8.1.7 to
import the data into the 8.1.7 database.
Metalink note 132904.1 Subject: Compatibility Matrix for Export & Import Between Different Oracle
Nicolas.

How do i move a data file from my pc to my ipad

How do I move a data file from my computer to my ipad? It is my product catalogue and it would help if it were on my ipad.

Plug the iPad into iTunes and you can use file sharing to move it into an app that supports file sharing and that document format.
see http://support.apple.com/kb/ht4094
Or, use an online storage service (iCloud, dropbox, box, google drive, sugarsync, etc) and upload the file to that. Then on the iPad, from within the app you plan to use the file with, link to that service and download the file.
The app will again have to work with that file type, and support the particular service you used.

How to load external storage html file in web view

hi all,
how to load external storage html file in web view, please help me
" ms-appdata://local/index.html" not working
veerasuthan veerakesan

It need be read as string. Then load the string by Webview.NavigateToString.
Sample as below
string htmlstring = string.Empty;
try
var htmlfile = await Windows.Storage.ApplicationData.Current.LocalFolder.OpenStreamForReadAsync("a.html");
using (System.IO.StreamReader streamReader = new System.IO.StreamReader(htmlfile))
htmlstring = streamReader.ReadToEnd();
webview.NavigateToString(htmlstring);
catch(Exception ex)
Debug.WriteLine(ex.ToString());
在現實生活中，你和誰在一起的確很重要，甚至能改變你的成長軌跡，決定你的人生成敗。和什麼樣的人在一起，就會有什麼樣的人生。和勤奮的人在一起，你不會懶惰；和積極的人在一起，你不會消沈；與智者同行，你會不同凡響；與高人為伍，你能登上巔峰。

How may load an external (html) file in swf? Anyone!!!!!

hi all,
How may load an external html file in swf? such as google.com in a movieclip.
anyone may help me.........????????

With Flash, you can't do this.
Just with FlashBuilder and Air (something like HTMLLoader , not sure now)
I mean loading in a movieclip..
Of course you can open a page to display in a browser.

How do I encrypt a data file so that only I can retrieve the info?

How do I encrypt a data file so that it cannot be read without the proper authority?
I have an application where the customer should not have access to the data I need to record for troubleshooting purposes. (there are industrial secrets I wish to protect) My plan is to record a datalog (currently I am producing a tab-delimited spreadsheet format) whenever the device is running and hide the files where they will probably not be found. But some sort of encryption or at least password protection would be better.
I've never tried to do this before, but thought it would be fairly easy. Maybe I'm just not looking in the right places.
Thanks
Solved!
Go to Solution.

Well, you could look into something like DES, Triple DES, AES, etc. There are libries floating around for these written in LabVIEW. I'm not sure about the cost though.
If you want a really simple way to protect your data, just invert all or some of the bits in each byte of your file. It is super simple and turns a nice ASCII text file into noise when read from a text file.
There are only two ways to tell somebody thanks: Kudos and Marked Solutions
Unofficial Forum Rules and Guidelines

How to design SQL server data file and log file growth

how to design SQL DB data file and log file growth- SQL server 2012
if my data file is having 10 GB sizze and log file is having 5 GB size
what should be the size in MB (not in %) of autogrowth. based on what we have to determine the ideal size of file auto growth.

It's very difficult to give a definitive answer on this. Best principal is to size your database correctly in advance so that you never have to autogrow, of course in reality that isn't always practical.
The setting you use is really dictated by the expected growth in your files. Given that the size is relatively small why not set it to 1gb on the datafile(s) and 512mb on the log file? The important thing is to monitor it on an on-going basis to see if that's
the appropriate amount.
One thing you should do is enable instant file initialization by granting the service account Perform Volume Maintenance tasks in group policy. This will allow the data files to grow quickly when required, details here:
https://technet.microsoft.com/en-us/library/ms175935%28v=sql.105%29.aspx?f=255&MSPPError=-2147217396
Also, it possible to query the default trace to find autogrowth events, if you wanted you could write an alert/sql job based on this
SELECT
[DatabaseName],
[FileName],
[SPID],
[Duration],
[StartTime],
[EndTime],
CASE [EventClass]
WHEN 92 THEN 'Data'
WHEN 93 THEN 'Log' END
FROM sys.fn_trace_gettable('c:\path\to\trace.trc', DEFAULT)
WHERE
EventClass IN (92,93)
hope that helps

How to load the exist Data Mart Request in to cube.

Hi Friends,
I have a scenario... i got DSO and one Cube , iam loading the data from DSO to Cube .
The number of records are more in the DSO and due to some clculation in the routine i need to load the data year by year(i got 2007 and 2008 year daya). I have loaded the 2007 data to the Infocube and in the DSO i can see the Data Mart Symbal against the Request Id when th load is finished successfully.
When iam trying to load the 2008 data from DSO to Cube iam getting the "0" records. I realised that the Data Mart symbal is exist in the DSO.
How to load the 2008 data in this scenario. If i delete the data mart sysbel means iam deleting the Cube request.
Can any have an idea on this.
Thaks in advance.

HI,
Things are not clear.
How is loading happening if its delta or full load through DTP or you using 3.5 flow??
In any cases if you do a full load or full repair based on the year selection it should pick the records from the source...there is nothing to do with the data mart status in the case of full loads.
Data mart status will come into picture only when you schedule the delta loads.
Do a full load based on selections on year from the DSO to the cube...no need to delete the data mart or it will bring that request again delta is scheduled...does that request in DSO contains the data for 2008 only ...if yes then you can just delete the data mart status for that and do a delta...if not then do full loads as said.
Thanks
Ajeet

How to load Matrix report data into basic table data using ODI

Hi,
How to load Matrix report data into basic table data using oracle Data Integrator ?
Requirement Description:
Following is the matrix report data:
JOB                       DEPT10                DEPT20
ANALYST                                           6000
CLERK                   1300                     1900 Need to convert it into below format:
JOB                             Dept                        Salary
ANALYST                  DEPT10
ANALYST                  DEPT20                     6000
CLERK                       DEPT10                    1300
CLERK                       DEPT20                    1900
    Thanks for your help in advance. Let me know if any further explanation is required.

Your list seems to be a little restrictive, you can do a lot more with ODI procedures.
If you create new procedure, and add a step. In the 'command on source' tab set you technology and schema as per your source database. Use the unpivot functionality as described in the link, please, rather than using 'SELECT *' use the appropriate column names and alias them for eg:
SELECT job as job,
deptsal as deptsal,
saldesc as saledesc
FROM pivoted_data
UNPIVOT (
deptsal --<-- unpivot_clause
FOR saldesc --<-- unpivot_for_clause
IN (d10_sal, d20_sal, d30_sal, d40_sal) --<-- unpivot_in_clause
Then in your 'command on target' tab set the technology and schema to your target db, then put your INSERT statement for eg:
INSERT INTO job_sales
(job,
deptsal,
saledesc
VALUES
:job,
:deptsal,
:saledesc
Therefore you are using bind variables from source to load data into target.
Obviously if the source and target table are in the same database, then you can have it all in one statement in the 'command on target' as
INSERT INTO job_sales
(job,
deptsal,
saledesc
SELECT job as job,
deptsal as deptsal,
saldesc as saledesc
FROM pivoted_data
UNPIVOT (
deptsal --<-- unpivot_clause
FOR saldesc --<-- unpivot_for_clause
IN (d10_sal, d20_sal, d30_sal, d40_sal) --<-- unpivot_in_clause
also set the log counter as 'Insert' on the tab where your INSERT statement is, so you know how many rows you insert into the table.
Hope this helps.
BUT remember that this feature only came out in Oracle 11g.

How to load a huge data file (export from mysql) to an oracle table?

Similar Messages

Maybe you are looking for