Import from csv file into a oracle database

Hi,
like i wrote in the subject i want to import some data from a csv file
and transform it into a database.
Its a simple setup,
- FA which reads with a self defined schema from a physical path
- Receive activity which creates an instance
- transform activity
- invoke which invokes the database adapter to fill a single table
- deploy it to a application server
I cant get it done.
What i achieved is to fill the table with one set (one row of the csv file),
but the other rows are untouched.
Does somebody know where i have to look for some errors.
The Auditing tool from the app server shows no errors.
I could also provide some screenshots.
Any help would be appreciated, i am really desperate :(
Thanks in Advance
Sven Richter

Hi
1) Is the File Adapter reading the correct number of lines in the csv file?
2) If yes, after the transformation, how many lines are there in the resulting variable?
Solutions:
1) If the FA is not reading all lines, the problem for sure is the XSD you are using. The XSD must define an element which must occurs many times. You do this using a correct XSD construction with the "maxoccurs=unbounded" atribute.
2) If the problem is with the transformation activity, you shoud use "for each" xsl node, otherwise the transformation just pick one line.
[]´s
Menezes

Similar Messages

How to import from CSV file into INTERVAL DAY TO SECOND column?

Hello,
I need to import data from a csv file that has a column that stores time-intervals (e.g. 2:06:02 Hours:Minutes:Seconds) into a table column INTERVAL DAY TO SECOND.
Does any of you know what format I should apply?
I tried HH:MI:SS but it didn't work.
Any suggestion is welcomed (including changing the column type to something else that might hold time-intervals in it....).
Thanks,
Andrei

Andrei,
There is no native support for the INTERVAL datatype in the Text loading facilities of Application Express.
To work around this known limitation, I suggest either creating a temporary table or a shadow column in your existing table. You could then upload your data for the interval as a VARCHAR2 and then use SQL to convert to an appropriate interval value.
For example:
1) Create a table with:
create table foo (id number primary key, i interval day to second, shadowi varchar2(4000) )2) Using your sample data set, load this data into table FOO, loading the second column of this data into column SHADOWI
1     01:06:02
2     02:06:02
3     03:01:013) Issue the following SQL to convert the value in your shadow interval column to your actual interval column
update foo set i = to_dsinterval( '0 ' || shadowi )Note that you'll need to prepend the '0' to formulate a valid interval literal value.
Joel

How to import the data in a .xls or .xlsx file into a oracle database table

Hi,
Please tell me how to import the data in a .xls or .xlsx file into a oracle database table in Oracle 10gR2 using Oracle Warehouse Builder 10gR2.

....can we do something through Non-Oracle->ODBC?Yes, it is possible, look at this thread
[SQLServer access from AIX Warehouse builder|http://forums.oracle.com/forums/thread.jspa?messageID=2502982]
If your server (with target DB and OWB runtime) is on Windows OS this configuration will be simpler - you can use single server.
And additional link on OWB blog (with 11g transparent gateway)
[http://blogs.oracle.com/warehousebuilder/2008/01/11g_heterogeneous_agent.html]
(configuring nonoracle connection with 10g generic connectivity very similar to 11g gateway)
Also look at
http://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:4406709207206#18830681837358
Regards,
Oleg

How to import an .csv file into the database?

and can we code the program in JSP to import the.csv file into the database.

It is better to use Java class to read the CSV file and store the contents in the database.
You can use JSP to upload the CSV file to the server if you want, but don't use it to perform database operations.
JSPs are good for displaying information on the front-end, and for displaying HTML forms, there are other technologies more suitable for the middle layer, back end and the database layer.
So break you application into
1) Front end - JSPs to display input html forms and to display data retrieved from the database.
2) Middle layer - Servlets and JavaBeans to interact with JSPs. The code that reads the CSV file to parse it's contents should be a Java Class in the middle layer. It makes use of Java File I/O
3) Database layer - Connects to the database using JDBC (Java Database Connectivity), and then writes to the database with SQL insert statements.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Keeping the above concepts in mind, first build a simple JSP and get it to work,
then research on Google , for Java File I/O , discover how to read a file,
Then search on how to readh a CSV file using Java.
After researching you should be able to read the CSV file line by line and store each line inside a Collection.
Then research on Google, on how to write to the database using JDBC
Write a simple program that inserts something to a dummy table in the database.
Then, read the data stored in the Collection, and write insert statements for each records in the collection.

Loading data from .csv file into Oracle Table

Hi,
I have a requirement where I need to populate data from .csv file into oracle table.
Is there any mechanism so that i can follow the same?
Any help will be fruitful.
Thanks and regards

You can use Sql Loader or External tables for your requirement
Missed Karthick's post ...alredy there :)
Edited by: Rajneesh Kumar on Dec 4, 2008 10:54 AM

Error While Importing from EIF file into AW

Hi All,
I am facing the following error while importing from EIF file into AW using AWM as well as from sql prompt.
java.sql.SQLException: ORA-36786: (IOSEC04) File POCAW/abc.eif does not exist or cannot be accessed.
ORA-06512: at "SYS.DBMS_AW", line 42
ORA-06512: at line 1
at oracle.olap.awm.eif.eifimport.ImportDialogActionThread.doExportOrImport(ImportDialogActionThread.java:172)
at oracle.olap.awm.eif.EifDialogActionThread.doAction(EifDialogActionThread.java:58)
at oracle.olap.awm.ui.dialog.ThreadedDialogActionThread.run(ThreadedDialogActionThread.java:49)
i have already created the directory pocaw.
i have done the following steps :
CREATE OR REPLACE DIRECTORY POCAW as 'D:\Olap_POC\export';
GRANT all ON DIRECTORY POCAW to PUBLIC;
execute dbms_aw.execute ('aw create ''POC_AW''');
execute dbms_aw.execute('cda pocaw');
execute dbms_aw.execute('dtb attach POC_AW rw');
execute dbms_aw.execute('import all from eif file ''/abc.eif'' dfns update ');
any idea or thought would be appreciable.
thanks n advance
anwar

execute dbms_aw.execute('import all from eif file''/abc.eif'' dfns update ');
Maybe one of the following file names could help
(have never tried it):
''abc.eif''
''POC_AW\abc.eif''Yes,
you don't need the slash. CDA is like setting a default directory.

Import From CSV File statement runs forever, no error, does not finish

Hello,
I am trying to import a CSV file in a JAVA program, with the following statement:
IMPORT FROM CSV FILE '/debug/testdatabase/FILE.csv'
INTO "JOSEPH"."TEST_TABLE"
WITH COLUMN LIST IN FIRST ROW
RECORD DELIMITED BY '\n'
FIELD DELIMITED BY '\t' ERROR LOG '/debug/testdatabase/file.err'
THREADS 10
BATCH 10000
I have two HANA instances on different machines A and B:
Both machines run HANA version 1.00.74.00.389160 (NewDB100_REL), while the OS is
SUSE Linux Enterprise Server 11.1 on machine A and
SUSE Linux Enterprise Server 11.2 on machine B.
The statement above runs fine on machine A and the rows are imported properly from JAVA as well as when executed from HANA Studio SQL console.
If I copy the file to machine B and try the exact same statement with the same file, it does not finish (neither from JAVA nor from HANA Studio SQL console). There is no error either. It cannot be cancelled, only a HANA restart stops the statement. Also the sample file I use has only 2 rows, and memory does not seem to be a problem.
I seem to have a similar problem to the one described here, but the answers there do not help me: http://scn.sap.com/thread/3396582 I specified the record delimiter, and I used a python script to check for any strange characters that are not supposed to be there, but didn't find any.
If I copy the file to my windows PC and use the "File Menu -> Import -> SAP Hana Content -> Data from Local file" function, it imports the file correctly into B, but I need to be able to do it from JAVA.
Machine A administration view:
Machine B administration view:
If you have any idea what might cause this behavior or where I can find more information on this problem please give me a hint.

Hi Joseph,
First from the pics, the revision of your SAP HANA instance is 73 instead of 74. Since I have no identical environment, I cannot test it for you. But can you try the simplest scenario? You can create a table with only one column table try to import a CSV file with only one row.
Best regards,
Wenjun

Importing a csv file into addressbook

So I did a search & found this question has come up quite often, but with the person having a slightly different problem, so here goes.
I am trying to import a csv file into address book, when I go import -> text tile it comes up like it should do and I pick the file, if I select ok at this point, it will quite happily import all of the data no trouble (but in the wrong categories). So I make the changes to what I want ie. Phone other --> Phone (work). Then when I click ok, the button goes from blue to white but nothing happens.
When I open the csv file in textedit I can see all the values separated by commas.
Any Ideas?

I too just had this problem. To clarify all fields work and you can map them. I found that the Outlook CSV file had two problems which were tripping up the AddressBook import function. Note these were both in street address fields so I suspect the poster who said that addresses don't work may have been having that problem.
The CSV load program does not work if you have commas "," in your data. In my case this was very common for some European addresses as well as some company names. And then the second problem was if there was a carriage return or new line character in a field. This later one was a problem with the address fields. I suspect an AddressBook export to CSV might have this same issue. Specifically, when there were multiple lines to the street address, they had been entered as multiple lines in street address one, as opposed to entering them in multiple fields such as "street 1", "street 2", etc.
To solve the problem I opened the CSV file using Numbers and did a global find and replace on: commas, substituting the string --- and on the newline character "¶" (ALT+Rreturn) with *.
Note to reduce some of the remapping I also changed all of the labels with "business" in the header row of the CSV file to "work". This made it a little easier for the AddressBook import function to map fields more correctly.
After these set of changes rather than the alternating blue then white with nothing behavior it cleanly loaded all of my names. I could then search for "---" and "*" in addressbook's search field to identify all addresses which I had to clean up.
I hope that is helpful to someone else. The import function really does work. However, it is not robust enough to deal with certain oddities in one's data.

Trigger while importing from .csv file

hey
i am importing data from .csv file into a table called temp.
.csv file is having column sales. the data in that also contains some empty filed or N/A or -
sales coulmn in my table is NUMBER.
so while importing some column are not able to import.
how to write a trigger to eliminate '-' or 'N/A' or ' ' values from the sales column before inserting into the table

It might be easier if the field on temp was a varchar2 field instead?
The values entered should be loaded into this field and you can then use the trigger to test the values and convert these into numbers or nulls before inserting onto the proper data table.
Check out the TO_NUMBER() function in SQL for info on how to convert strings to numbers.
Regards
Andy

Loading data from .csv file into existing table

Hi,
I have taken a look at several threads which talk about loading data from .csv file into existing /new table. Also checked out Vikas's application regarding the same. I am trying to explain my requirement with an example.
I have a .csv file and I want the data to be loaded into an existing table. The timesheet table columns are -
timesheet_entry_id,time_worked,timesheet_date,project_key .
The csv columns are :
project,utilization,project_key,timesheet_category,employee,timesheet_date , hours_worked etc.
What I needed to know is that before the csv data is loaded into the timesheet table is there any way of validating the project key ( which is the primary key of the projects table) with the projects table . I need to perform similar validations with other columns like customer_id from customers table. Basically the loading should be done after validating if the data exists in the parent table. Has anyone done this kind of loading through the APEX utility-data load.Or is there another method of accomplishing the same.
Does Vikas's application do what the utility does ( i am assuming that the code being from 2005 the utility was not incorporated in APEX at that time). Any helpful advise is greatly appreciated.
Thanks,
Anjali

Hi Anjali,
Take a look at these threads which might outline different ways to do it -
File Browse, File Upload
Loading CSV file using external table
Loading a CSV file into a table
you can create hidden items in the page to validate previous records before insert data.
Hope this helps,
M Tajuddin
http://tajuddin.whitepagesbd.com

Importing a CSV file into AD 2012r2

Hi Guys
Just wondering if anyone can help, I am a newbie on scripting and finding it really difficult to understand how to import a csv file into AD
I have created the CSV file with the following headers, see below but I am unable to write a powershell script to import them into AD which work, I have tried multiple help guides but still cannot do it for the life of me.
Any help on this would be really appreciated
objectClass user
cn Jo bloggs
givenName jo
sn blogs
mail [email protected]
sAMAccountname j.blogs
AccountPassword Pa$$w0rd
ChangePasswordAtLogon true
PasswordNeverExpires false
ou OU=staff,DC=test,DC=com

Import-Csv C:\User.csv| %{New-ADUser -SamAccountName $_.SamAccountName `
-UserPrincipalName $_.userprinicpalname `
-Name $_.name `
-Mail = $_.mail `
-DisplayName $_.name `
-GivenName $_.GivenName `
-Path "OU=Test Users,DC=XXX,DC=XXX" `
-PasswordNeverExpires $false `
-ChangePasswordAtLogon $true `
-AccountPassword (ConvertTo-SecureString "test41;" -AsPlainText -force) `
-Enabled $True -PasswordNeverExpires $True -PassThru ` }
help New-ADUser -Examples
You can try the below sample code
Regards Chen V [MCTS SharePoint 2010]

Import a CSV-file into a new table?

hi, im trying to import a csv file into a new tabel, but i just cant make it work :-O. what are the steps to do that? im using sql developer version1.1.2.25.
thanks for helping :-)

We do not support CSV import at this stage, we only support XLS import.
Regards
Sue

Is there a way to import a .csv file into Numbers?

Can I import a .csv file into Numbers?

Yes, you can import csv (character-separated-values) into Numbers.
If the csv file is comma-separated, then in Numbers you can try File > Open and navigate to the file and open it.
If you don't get the results you want, then try this CSV to Tabs on Clipboard Automator Service (Dropbox download) instead.
To install, double-click the .workflow package and, if necessary, click 'Open Anyway' in System Preferences > Security & Privacy.
Thereafter to use:
In Finder (not Numbers) navigate to the .csv file.
Right-click on the file and choose 'CSV to Tabs on Clipboard' under Services in the contextual menu.
Follow the prompts (trying different separators if needed).
Click once in a Numbers cell.
Command-v to paste. The Numbers table will expand automatically as needed.
These steps are quicker and easier than they sound. Just a few clicks and a keyboard entry.
SG

Script to import contacts from CSV file into Address Book

Hi,
I am wondering if it would be possible to import contacts from a CSV file into a group in Address Book using applescript, and if so, if anyone is aware of a script that does this or something similar.
I have a CSV file with three columns 'First Name', 'Last Name' and 'Email Address'. I would like these to correspond with 'First', 'Last' and (Work) 'Email' in Address Book.
Ideally the script would also check to see if entries already exist for the people being imported, but this is less crucial.
Thanks in advance for any assistance,
Nick

Hi,
Test this on a very small csv file (four or five contacts) to see if it works for you. It will not de-duplicate. You don't give the name of the group, so you'll need to replace Name of group in the second line with your group name, enclosed in double quotes.
--begin script
set the_people to read (choose file with prompt "Choose your CSV file")
set the_group to "Name of group"
set old_tids to AppleScript's text item delimiters
set AppleScript's text item delimiters to ","
set par_count to (count paragraphs in the_people)
repeat with x from 1 to par_count
          set next_par to paragraph x of the_people
          set first_name to text item 1 of next_par
          set last_name to text item 2 of next_par
          set e_mail to text item 3 of next_par
          tell application "Address Book"
                    set nu_person to make new person with properties {first name:first_name, last name:last_name}
make new email at end of emails of nu_person with properties {label:"Work", value:e_mail}
                    add nu_person to group the_group
save
          end tell
end repeat
set AppleScript's text item delimiters to old_tids
--end script
Watch out for bad line breaks in the lines beginning "set nu_person..." and "make new email..."

Import a CSV file into specific cells

Hello,
I have created a simple Numbers template and I want to import a csv file with its values entering specific cells in an automated way.
I think the best way to automate this process would be an AppleScript that does the following:
Selects the csv file;
Parses the values inserting them into the the Numbers template i.e. value1 to cell B2, value2 to cell B3 etc.
Unfortunately I know very little about AppleScript, does anyone have any experience in this area that they could pass on?
My idea would be to place the csv values in an array, and loop through the array entering the values in B2, B3 etc.
Many thanks in advance!
Dougie

Here is a script doing the full job in a single call.
--{code}
--[SCRIPT csv-to-selected-cell]
Enregistrer le script en tant que Script : csv-to-selected-cell.scpt
déplacer le fichier ainsi créé dans le dossier
<VolumeDeDémarrage>:Utilisateurs:<votreCompte>:Bibliothèque:Scripts:Applications :Numbers:
Il vous faudra peut-être créer le dossier Numbers et peut-être même le dossier Applications.
Sélectionner la première cellule du bloc où vous souhaitez insérer les valeurs extraites d'un fichier CSV.
Aller au menu Scripts , choisir Numbers puis choisir “csv-to-selected-cell”
Le script demande de naviquer jusqu’au fichier CSV.
Il en lit le contenu,
remplace les séparateurs (";" ou ",") par des TABs
copie les données dans le presse-papiers
colle dans la table.
--=====
L’aide du Finder explique:
L’Utilitaire AppleScript permet d’activer le Menu des scripts :
Ouvrez l’Utilitaire AppleScript situé dans le dossier Applications/AppleScript.
Cochez la case “Afficher le menu des scripts dans la barre de menus”.
Sous 10.6.x,
aller dans le panneau “Général” du dialogue Préférences de l’Éditeur Applescript
puis cocher la case “Afficher le menu des scripts dans la barre des menus”.
--=====
Save the script as a Script: csv-to-selected-cell.scpt
Move the newly created file into the folder:
<startup Volume>:Users:<yourAccount>:Library:Scripts:Applications:Numbers:
Maybe you would have to create the folder Numbers and even the folder Applications by yourself.
Select the first cell of the block where values extracted from a CSV file must be inserted.
Go to the Scripts Menu, choose Numbers, then choose “csv-to-selected-cell”
The script urge you to navigate to the CSV file.
It read its contents,
replace the delimiters (";" or ",") by TAB chars
copy the datas in the clipboard
paste in the table.
--=====
The Finder’s Help explains:
To make the Script menu appear:
Open the AppleScript utility located in Applications/AppleScript.
Select the “Show Script Menu in menu bar” checkbox.
Under 10.6.x,
go to the General panel of AppleScript Editor’s Preferences dialog box
and check the “Show Script menu in menu bar” option.
--=====
Yvan KOENIG (VALLAURIS, France)
2012/01/18
--=====
on run
          local dName, sName, tName, rowNum1, colNum1, rowNum2, colNum2, lesValeurs
          my activateGUIscripting()
Extract parameters describing the target cell *)
          set {dName, sName, tName, rowNum1, colNum1, rowNum2, colNum2} to my get_SelParams()
Choose the source CSV file *)
choose file of type {"csv"}
Get the file’s contents *)
          set lesValeurs to read result
Grab the delimiter in use *)
          if lesValeurs contains ";" then
          else
          end if
Replace the delimiter in use by TAB *)
          my remplace(lesValeurs, result, tab)
Move the 'normalized' datas to the clipboard *)
set the clipboard to result
Reset the target cell in case something changed *)
          tell application "Numbers" to tell document dName to tell sheet sName to tell table tName
                    set selection range to range (name of cell colNum1 of row rowNum1)
          end tell
Paste matching style *)
          my raccourci("Numbers", "v", "cas")
end run
--=====
set { dName, sName, tName, rowNum1, colNum1, rowNum2, colNum2} to my get_SelParams()
tell application "Numbers" to tell document dName to tell sheet sName to tell table tName
on get_SelParams()
          local d_Name, s_Name, t_Name, row_Num1, col_Num1, row_Num2, col_Num2
          tell application "Numbers" to tell document 1
                    set d_Name to its name
                    set s_Name to ""
                    repeat with i from 1 to the count of sheets
                              tell sheet i to set maybe to the count of (tables whose selection range is not missing value)
                              if maybe is not 0 then
                                        set s_Name to name of sheet i
                                        exit repeat
                              end if -- maybe is not 0
                    end repeat
                    if s_Name is "" then
                              if my parleAnglais() then
                                        error "No sheet has a selected table embedding at least one selected cell !"
                              else
                                        error "Aucune feuille ne contient une table ayant au moins une cellule sélectionnée !"
                              end if
                    end if
                    tell sheet s_Name to tell (first table where selection range is not missing value)
                              tell selection range
                                        set {top_left, bottom_right} to {name of first cell, name of last cell}
                              end tell
                              set t_Name to its name
                              tell cell top_left to set {row_Num1, col_Num1} to {address of its row, address of its column}
                              if top_left is bottom_right then
                                        set {row_Num2, col_Num2} to {row_Num1, col_Num1}
                              else
                                        tell cell bottom_right to set {row_Num2, col_Num2} to {address of its row, address of its column}
                              end if
                    end tell -- sheet…
                    return {d_Name, s_Name, t_Name, row_Num1, col_Num1, row_Num2, col_Num2}
          end tell -- Numbers
end get_SelParams
--=====
on parleAnglais()
          local z
          try
                    tell application "Numbers" to set z to localized string "Cancel"
          on error
                    set z to "Cancel"
          end try
          return (z is not "Annuler")
end parleAnglais
--=====
on decoupe(t, d)
          local oTIDs, l
          set oTIDs to AppleScript's text item delimiters
          set AppleScript's text item delimiters to d
          set l to text items of t
          set AppleScript's text item delimiters to oTIDs
          return l
end decoupe
--=====
replaces every occurences of d1 by d2 in the text t
on remplace(t, d1, d2)
          local oTIDs, l
          set oTIDs to AppleScript's text item delimiters
          set AppleScript's text item delimiters to d1
          set l to text items of t
          set AppleScript's text item delimiters to d2
          set t to "" & l
          set AppleScript's text item delimiters to oTIDs
          return t
end remplace
--=====
on activateGUIscripting()
(* to be sure than GUI scripting will be active *)
          tell application "System Events"
                    if not (UI elements enabled) then set (UI elements enabled) to true
          end tell
end activateGUIscripting
--=====
==== Uses GUIscripting ====
This handler may be used to 'type' text, invisible characters if the third parameter is an empty string.
It may be used to 'type' keyboard raccourcis if the third parameter describe the required modifier keys.
I changed its name « shortcut » to « raccourci » to get rid of a name conflict in Smile.
on raccourci(a, t, d)
          local k
activate application a
          tell application "System Events" to tell application process a
                    set frontmost to true
                    try
                              t * 1
                              if d is "" then
key code t
                              else if d is "c" then
key code t using {command down}
                              else if d is "a" then
key code t using {option down}
                              else if d is "k" then
key code t using {control down}
                              else if d is "s" then
key code t using {shift down}
                              else if d is in {"ac", "ca"} then
key code t using {command down, option down}
                              else if d is in {"as", "sa"} then
key code t using {shift down, option down}
                              else if d is in {"sc", "cs"} then
key code t using {command down, shift down}
                              else if d is in {"kc", "ck"} then
key code t using {command down, control down}
                              else if d is in {"ks", "sk"} then
key code t using {shift down, control down}
                              else if (d contains "c") and (d contains "s") and d contains "k" then
key code t using {command down, shift down, control down}
                              else if (d contains "c") and (d contains "s") and d contains "a" then
key code t using {command down, shift down, option down}
                              end if
                    on error
                              repeat with k in t
                                        if d is "" then
keystroke (k as text)
                                        else if d is "c" then
keystroke (k as text) using {command down}
                                        else if d is "a" then
keystroke k using {option down}
                                        else if d is "k" then
keystroke (k as text) using {control down}
                                        else if d is "s" then
keystroke k using {shift down}
                                        else if d is in {"ac", "ca"} then
keystroke (k as text) using {command down, option down}
                                        else if d is in {"as", "sa"} then
keystroke (k as text) using {shift down, option down}
                                        else if d is in {"sc", "cs"} then
keystroke (k as text) using {command down, shift down}
                                        else if d is in {"kc", "ck"} then
keystroke (k as text) using {command down, control down}
                                        else if d is in {"ks", "sk"} then
keystroke (k as text) using {shift down, control down}
                                        else if (d contains "c") and (d contains "s") and d contains "k" then
keystroke (k as text) using {command down, shift down, control down}
                                        else if (d contains "c") and (d contains "s") and d contains "a" then
keystroke (k as text) using {command down, shift down, option down}
                                        end if
                              end repeat
                    end try
          end tell
end raccourci
--=====
--[/SCRIPT]
--{code}
Yvan KOENIG (VALLAURIS, France) mercredi 18 janvier 2012
iMac 21”5, i7, 2.8 GHz, 12 Gbytes, 1 Tbytes, mac OS X 10.6.8 and 10.7.2
My Box account is : http://www.box.com/s/00qnssoyeq2xvc22ra4k
My iDisk is : http://public.me.com/koenigyvan

Import from csv file into a oracle database

Similar Messages

Maybe you are looking for