Populating Oracle DB from a CSV file

Hi All,
We are having a CSV file located in a remote machine, which can be accessed by doing SFTP.
The data in the CSV file has to be loaded into an Oracle 9i DB. All the columns are direct mappings except one. For that one column(Date field), we need to
do some processing and store it in data field.
I tried this using SQL loader. I've very little knowledge of SQL Loader, and i'm not sure whether it can read the file from remote machine(through SFTP) and do the processing before loading into Oracle DB.
I just thought to take inputs from you guys before going further - Can I achieve this using SQL Loader? Or any other tools will help?
Pls suggest.
thanks
Hanu
Edited by: user11365763 on Jul 9, 2009 10:36 PM

thanks for the reply. :)
Yes, I guess I should write a windows script to download it to local machine and use sqlldr to populate it.
Having seen Saving column mapping in file loads, I believe this sqlldr is a good way of doing this. But lemme also explore it and check whether it does the processing(date processing - conversion of format) of a field before loading the data in Oracle DB.
thank you,
Hanu
Edited by: user11365763 on Jul 9, 2009 11:01 PM

Similar Messages

I need to import data from a CSV file to an Oracle table

I need to import data from a CSV file to an Oracle table. I'd prefer to use either SQL Developer or SQL Plus code.
As an example, my target database is HH910TS2, server is ADDb0001, my dB login is em/em, the Oracle table is AE1 and the CSV file is AECSV.
Any ideas / help ?

And just for clarity, it's good to get your head around some basic concepts...
user635625 wrote:
I need to import data from a CSV file to an Oracle table. I'd prefer to use either SQL Developer or SQL Plus code.SQL Developer is a GUI front end that submits code to the database and displays the results. It does not have any code of it's own (although it may have some "commands" that are SQL Developer specific)
SQL*Plus is another front end (character based rather than GUI) that submits code to the database and displays the results. It also does not have code of it's own although there are SQL*Plus commands for use only in the SQL*Plus environment.
The "code" that you are referring to is either SQL or PL/SQL, so you shouldn't limit yourself to thinking it has to be for SQL Developer or SQL*Plus. There are many front end tools that can all deal with the same SQL and/or PL/SQL code. Focus on the SQL and/or PL/SQL side of your coding and don't concern yourself with limitations of what tool you are using. We often see people on here who don't recognise these differences and then ask why their code isn't working when they've put SQL*Plus commands inside their PL/SQL code. ;)

Need help in loading data from a csv file to a table in Oracle DB

Hi,
I am using sqlplus as a client to connect to the server.
I am trying to load data from a csv file from a client to a table in Oracle DB server.
I am trying to use the below command
" LOAD DATA INFILE 'test.csv' INTO TABLE testTable FIELDS TERMINATED BY ',' (test1,test2,testc3,testc4); "
But, I am encountered with the following error
"SP2-0042: unknown command "load data" - rest of line ignored."
Thanks in advance.
SB

Hey Frostmann,
That was a nice post....
I changed my mind to use an 'Insert into' statement from a shell script.
I created a DB table named test and I tried using the below shell script to insert a row in the table.
sqlplus test/test@test <<ENDOFSQL
INSERT INTO test VALUES('test1',123,'test2','test3');
exit
ENDOFSQL
A row is succesfully inserted into the table when I run the script manually, but it does not insert rows when a cron job is scheduled.
Could you please help me with this?
Thanks in advance.
SB

How can I import data from a csv file into databse using utl_file?

Hi,
I have two machines (os is windows and database is oracle 10g) that are not connected to each other and both are having the same database schema but data is all different.
Now on one machine, I want to take dump of all the tables into csv files. e.g. if my table name is test then the exported file is test.csv and if the table name is sample then csv file name is sample.csv and so on.
Now I want to import the data from these csv files into the tables on second machine. if I've 50 such csv files, then data should be written to 50 tables.
I am new to this. Could anyone please let me know how can I import data back into tables. i can't use sqlloader as I've to satisfy a few conditions while loading the data into tables. I am stuck and not able to proceed.
Please let me know how can I do this.
Thanks,
Shilpi

Why you want to export into .csv file.Why not export/import? What is your oracle version?
Read http://www.oracle-base.com/articles/10g/oracle-data-pump-10g.php
Regards
Biju

SQL*Loader - How to load only a few columns from a .csv file to ora table

Hi there,
Could anyone please let me know how to load few columns from a .csv
file into a oracle table using SQL*Loader.
I know how to create a .dat and .ctl file and run the sql loader.
Suppose I have a .csv file with
col1, col2, col3, col4
and I only need to load col1 and col3 into col_a and col_b respectively
in table_a?
structure of table_ a
col_a,
col_b
Please advice

Try like..it i will work..
LOAD DATA
INFILE 'test.txt'
LOAD DATA
TRUNCATE INTO TABLE T1
FIELDS TERMINATED BY ','
(col1,
col2 FILLER,
col3,
col4 FILLER
)

Need to take a value from the csv file and query in a OAF page.

Hello,
I have a requirement to take the list of employee numbers in a csv file and display its corresponding job on the page.
I have created a item 'MessageFileupload' where the user will upload the csv file containing the employee number and a Button 'Display Jobs' which will display the corresponding jobs on the page.
Any idea how to take the values from the csv file and query it?
Regards,
den123.

Hi ,
Check
http://oraclearea51.com/contribute/post-a-blog-article/csv-file-upload-for-oa-framework.html
http://www.roseindia.net/jsp/upload-insert-csv.shtml
Below code works from above blogs.
package xx.oracle.apps.pa.Lab.webui;
import java.io.BufferedReader;
import java.io.IOException;
import java.io.InputStreamReader;
// import java.io.*;
import oracle.apps.fnd.common.VersionInfo;
import oracle.apps.fnd.framework.OAApplicationModule;
import oracle.apps.fnd.framework.OAException;
import oracle.apps.fnd.framework.server.OAViewObjectImpl;
import oracle.apps.fnd.framework.webui.OAControllerImpl;
import oracle.apps.fnd.framework.webui.OAPageContext;
import oracle.apps.fnd.framework.webui.beans.OAWebBean;
import oracle.jbo.domain.BlobDomain;
import oracle.cabo.ui.data.DataObject;
import oracle.jbo.Row;
* Controller for ...
public class deptCsvUploadCO extends OAControllerImpl
public static final String RCS_ID="$Header$";
public static final boolean RCS_ID_RECORDED =
        VersionInfo.recordClassVersion(RCS_ID, "%packagename%");
   * Layout and page setup logic for a region.
   * @param pageContext the current OA page context
   * @param webBean the web bean corresponding to the region
public void processRequest(OAPageContext pageContext, OAWebBean webBean)
    super.processRequest(pageContext, webBean);
   * Procedure to handle form submissions for form elements in
   * a region.
   * @param pageContext the current OA page context
   * @param webBean the web bean corresponding to the region
public void processFormRequest(OAPageContext pageContext, OAWebBean webBean)
    super.processFormRequest(pageContext, webBean);
    // Code Addition Started for CSV upload
    OAApplicationModule am = (OAApplicationModule) pageContext.getApplicationModule(webBean);
    OAViewObjectImpl vo = (OAViewObjectImpl) am.findViewObject("deptCsvVO1");
      //if ("GoBtn".equals(pageContext.getParameter(EVENT_PARAM)))
       if (pageContext.getParameter("GoBtn") != null)
      System.out.println("Button Pressed");
          DataObject fileUploadData =(DataObject)pageContext.getNamedDataObject("FileUploadItem");
          String fileName = null;
          String contentType = null;
          Long fileSize = null;
          Integer fileType = new Integer(6);
          BlobDomain uploadedByteStream = null;
          BufferedReader in = null;
                  try
                  fileName = (String)fileUploadData.selectValue(null, "UPLOAD_FILE_NAME");
                  contentType =(String)fileUploadData.selectValue(null, "UPLOAD_FILE_MIME_TYPE");
                  uploadedByteStream = (BlobDomain)fileUploadData.selectValue(null, fileName);
                  in = new BufferedReader(new InputStreamReader(uploadedByteStream.getBinaryStream()));
                  fileSize = new Long(uploadedByteStream.getLength());
                  System.out.println("fileSize"+fileSize);
                  catch(NullPointerException ex)
                  throw new OAException("Please Select a File to Upload", OAException.ERROR);
                  try{
                  //Open the CSV file for reading
                  String lineReader="";
                  long t =0;
                  String[] linetext;
                  while (((lineReader = in.readLine()) !=null) )
                  //Split the deliminated data and
                  if (lineReader.trim().length()>0)
                  System.out.println("lineReader"+lineReader.length());
                  linetext = lineReader.split(",");
                  t++;
                  //Print the current line being
                  if (!vo.isPreparedForExecution())
                          vo.setMaxFetchSize(0);
                          vo.executeQuery();
                    System.out.println("Trimmed "+ linetext[1].replace("\"", ""));
                  Row row = vo.createRow();
                  row.setAttribute("Deptno", linetext[0].trim());
                  row.setAttribute("Dname",linetext[1].trim().replace("\"", ""));
                  row.setAttribute("Loc",linetext[2].trim().replace("\"", ""));
                  //row.setAttribute("Column4", linetext[3].trim());
                  vo.last();
                  vo.next();
                  vo.insertRow(row);
                  catch (IOException e)
                        throw new OAException(e.getMessage(),OAException.ERROR);
          //else if (pageContext.getParameter("Upload") != null)
          am.getTransaction().commit();
          throw new OAException("Uploaded SuccessFully",OAException.CONFIRMATION);
}Thanks,
Jit

Is there a way to select a certain box of elements from a csv file and read that into LabVIEW?

Hello all, I was wondering if there was a way to select only a certain "box" of elements from a .csv file in LabVIEW? I have LabVIEW 2011 and my main goal is to take two arrays and graph them against each other. I can import the .csv file just fine and separate each row and each column to be its own, but say I have an 8X8 but want to graph the middle 4X5 or something like that. Is there any way to extract an array without starting at the beginning and without ending at the end? Thank you in advance.
Solved!
Go to Solution.

Hi Szklanam,
as a CSV file is just a TXT file with a different suffix you can read a certain number of lines of that file. So you can limit the number of rows in your resultung array. To limit the number of columns you still have to use ArraySubset, so maybe it's a lot easier to read the full CSV file and pick the interesting spots with ArraySubset...
Best regards,
GerdW
CLAD, using 2009SP1 + LV2011SP1 + LV2014SP1 on WinXP+Win7+cRIO
Kudos are welcome

Reading and Sorting from a CSV file

I have an assignment to read a shopping list from a CSV file, sort the items and print or write the items to a text file. I have an idea though. I intend to use vectors to collect the items from the CSV file and then sort the list and write to a txt file. Someone tell me whether this is a right approach or suggest simpler approach. thank you.
Derry

Sounds reasonable.
Rather than Vector, though, I'd use ArrayList (a very near replacement for Vector) or possibly LinkedList or even Set or Map. (Vector is a legacy class, kept around for backward compatibility.)
http://java.sun.com/docs/books/tutorial/collections/
Make sure each element in the List corresponds to one row in the file. Those elements should be a class you define whose member variables correspond to the columns in the file. (So if the file has Last, First, Bday columns, your class would have lastName, firstName, and birthday fields.)
Make your class Comparable, or implement a Comparator, to make sorting straightforward.
http://java.sun.com/j2se/1.4.2/docs/api/java/lang/Comparable.html
http://java.sun.com/j2se/1.4.2/docs/api/java/util/Comparator.html

How can i import contacts from a csv file to "iCloud Contacts"?

How can I import contacts from a csv file to "iCloud Contacts"?

The only way I know of to import cells from a csv file is by creating a new file. But then you can select the desired cells and copy them to the other file. I just did it to be sure it works.
1. Create the new spreadsheet file via the upload command.
2. Select the cells (table) that you want to move to the other file and press command+C (copy).
3. Close the new file and open the existing file.
4. Select the top/right cell of the area to receive the copied "table" and press commant+V (paste).
I hope this is what you're trying to do!

Import data from excel/csv file in web dynpro

Hi All,
I need to populate a WD table by first importing a excel/CSV file thru web dynpro screen and then reading thru the file.Am using FileUpload element from NW04s.
How can I read/import data from excel / csv file in web dynpro table context?
Any help is appreciated.
Thanks a lot
Aakash

Hi,
Here are the basic steps needed to read data from excel spreadsheet using the Java Excel API(jExcel API).
jExcel API can read a spreadsheet from a file stored on the local file system or from some input stream, ideally the following should be the steps while reading:
Create a workbook from a file on the local file system, as illustrated in the following code fragment:
          import java.io.File;
          import java.util.Date;
          import jxl.*;
         Workbook workbook = Workbook.getWorkbook(new File("test.xls"));
On getting access to the worksheet, once can use the following code piece to access individual sheets. These are zero indexed - the first sheet being 0, the second sheet being 1, and so on. (You can also use the API to retrieve a sheet by name).
          Sheet sheet = workbook.getSheet(0);
After getting the sheet, you can retrieve the cell's contents as a string by using the convenience method getContents(). In the example code below, A1 is a text cell, B2 is numerical value and C2 is a date. The contents of these cells may be accessed as follows
Cell a1 = sheet.getCell(0,0);
Cell b2 = sheet.getCell(1,1);
Cell c2 = sheet.getCell(2,1);
String a1 = a1.getContents();
String b2 = b2.getContents();
String c2 = c2.getContents();
// perform operations on strings
However in case we need to access the cell's contents as the exact data type ie. as a numerical value or as a date, then the retrieved Cell must be cast to the correct type and the appropriate methods called. The code piece given below illustrates how JExcelApi may be used to retrieve a genuine java double and java.util.Date object from an Excel spreadsheet. For completeness the label is also cast to it's correct type. The code snippet also illustrates how to verify that cell is of the expected type - this can be useful when performing validations on the spreadsheet for presence of correct datatypes in the spreadsheet.
String a1 = null;
Double b2 = 0;
Date c2 = null;
                    Cell a1 = sheet.getCell(0,0);
                    Cell b2 = sheet.getCell(1,1);
                    Cell c2 = sheet.getCell(2,1);
                    if (a1.getType() == CellType.LABEL)
                       LabelCell lc = (LabelCell) a1;
                       stringa1 = lc.getString();
                     if (b2.getType() == CellType.NUMBER)
                       NumberCell nc = (NumberCell) b2;
                       numberb2 = nc.getValue();
                      if (c2.getType() == CellType.DATE)
                        DateCell dc = (DateCell) c2;
                        datec2 = dc.getDate();
                       // operate on dates and doubles
It is recommended to, use the close() method (as in the code piece below)   when you are done with processing all the cells.This frees up any allocated memory used when reading spreadsheets and is particularly important when reading large spreadsheets.
          // Finished - close the workbook and free up memory
          workbook.close();
The API class files are availble in the 'jxl.jar', which is available for download.
Regards
Raghu

How to import categories to my addressbook from a csv file?

Hello, I have a few contact list (csv) i want to add in my thunderbird adressbook. tought, I can' t find a way to add the categories of my contacts when i import my list of contacts from a csv files to my thunderbird adressebook. As you can see in the image, in the Edit contact window there is a section named categories, and ussually you click that section and you decide whatever the contact is a friend, a parent etc. Well I want to import that information from a csv file already made and not setup up the categories from each contact one by one. Ok thank you very much!

You need a vCard (.vcf) format, not .csv. Were these exported from Outlook?

Is there a way to find and replace prices in an Indesign document from a CSV file?

Is there a way to find and replace prices in an Indesign document from a CSV file. Currenty I have a catalog with codes and prices in tables. I need to find a way to look up the code (and new price) in the CSV file and overwrite the price in the current table with the new price. Does anyone know of a script to run this quickly?

Hi,
Try this
1) with all the images showing, got to Find -> By caption or Note
2) enter the caption you are looking for Image Description and click on OK
It should display all the ones with that caption
3) select a few images as a test
4) go to Edit -> Add caption to selected items
5) if you want to blank out the captions just check the box to replace the caption and click on ok
6) You will need to confirm the blank captions
You could use a similar procedure to change the caption to something else.
Good luck
Brian

Trying to import from different csv files into multiple JTables

This might seem like something that isn't commonly done, but I'll see if anyone has done this before anyways.
I currently have a JTable (tab #1) and it successfully reads in the data from a CSV file to populate the cells. Now, I am looking into making 3 more JTables. I can tab between the four different tables, but I can't seem to figure out how to get the data to go to the correct JTable. Tab #1 = table, Tab #2 = table2, Tab #3 = table3, Tab #4 = table4.
Thanks.
        try
            FileInputStream fileInput = new FileInputStream ("upcoming.csv");
            BufferedReader InputCSV = new BufferedReader (new InputStreamReader (fileInput));
            line = InputCSV.readLine(); //start reading into the records.
                //Create data for the table.
                //the row variable = starting row
            int row = 0;
            while(line != null)
                tmp = line.split(",");
                for (int col = 0; col < columnNames.length; ++col)
                    data[row][col] = tmp[col]; //store cells' data to the 2-dimensional array.
                row++;
                line = InputCSV.readLine();
            }//end of WHILE-statement.
        } //END of TRY-statement.
        catch(Exception e)
            System.out.println(e);
        }

I have been successful in my quest to get 4 different datasets into 4 different JTables. The previous posters suggestion to use the Table model led me to this page:
http://java.sun.com/j2se/1.5.0/docs/api/javax/swing/table/TableModel.html
        TableModel myData = new MyTableModel();
        JTable table = new JTable(myData);I had some very similar code in my program. I use the DefaultTableModel and the SortFilterModel before having 4 different JTables.
        DefaultTableModel model = new DefaultTableModel(data, columnNames);
        DefaultTableModel model2 = new DefaultTableModel(data2, columnNames);
        DefaultTableModel model3 = new DefaultTableModel(data3, columnNames);
        DefaultTableModel model4 = new DefaultTableModel(data4, columnNames);I use the code in the first post 4 times, and only change the filename and the data#.
I also have some code that counts the number of lines that will be needed.
Thanks.

How do I remove e-mail addresses from a csv file referencing a numbers doc

Greetings! I hope someone out there can help me. I'm not exactly a genius when it comes to numbers...
My Issue:
I'm attempting to sending out a large e-mail blast via software called hoolie, it seems to be working amazingly well except for the fact that I've reached our Gmail accounts daily limit which I had zero idea existed.
So about 1100 emails were sent and I still have to send about 1500 emails left to be sent. The software has no ability to resend to the failed e-mail addresses, so I'm left to my own devices...
My Goal:
I want to be able to subtract out the 1100 e-mail address from the csv file I have with all the addresses. Once I subtract out the e-mail addresses I can then resend the blast and throttle it so it takes a day or so and won't freak out google gmail...
How can I accomplish this? I have the orginal CSV file with all the names and e-mail addresses and I have a new numbers doc in which I pasted the e-mails that were succesfully sent...
Thoughts? Suggetsions?
thanks in advance!

Are you suggesting that it sent it to a random sample of the email addresses, that it did not start at the beginning and go row by row until it failed? If that is the case, you can import the CSV file into Numbers, paste your list of sent addresses in another column or another table of that document, then use COUNTIF to look for duplicates.
The best I can do is an example.Your table will no doubt be different so you'll have to rejigger the formula.
Importing your CSV file will create column B
Insert two new columns, C and D
Use Copy/Paste to copy/paste your list of sent addresses from your other document into column D
The formula in column C is =IF(COUNTIF(D,B)>0,"Was Sent","")
Once it has done its thing, sort by column C to get all the "Was Sent" rows together. Delete them. Delete column C, Delete column D. Share as a CSV.

How to batch rename from a CSV file?

Hello,
I have about 1000 photos that need to be renamed with UPC's from a CSV file. Is there a script (or easier way) to import a CSV column and add it to the file extension?
Example:
_MG_5200.CR2 would need to read 00726899281640_MG_5200.CR2

There are a number of csv to ldif options out there. If you want to drop your users into WLS, then formatting into an ldif is the easiest way to bulk load.
http://tinyurl.com/88mwxb3
-ryan

Populating Oracle DB from a CSV file

Similar Messages

Maybe you are looking for