Automating Export/Import of CSV Files

Thought I would ask here for any advice or suggestions because my knowledge is lacking in this area a bit.
What I need:
An automated process, whether it be 3rd party s/w or a cron job, that can export a few tables to csv's and then xfer the file to another server.
At this point i will need a process that can take that csv and automatically load it into a different oracle DB.
Any suggestions on good software to use or scripts to run would be a great start to my research. thanks

Hello,
You can simply write some sql scripts to generate csv file and you can connect from remote server to run this sql scripts and it will generate csv file on target server. What you need to do is configure your tnsnames.ora to connect to your source server from target server. Meaning from target server you should be able to sqlplus in.
#target server
$> sqlplus username/password@source_db
sqlplus > test.sqlNow you can write shell script and here is a function which you can extend and call different sql script to generate csv file.
function exesqlfile{
typeset sqlfile=$1
if [ ! -f $sqlfile ]
then
       echo "sql extraction file doesn't exist....";
       echo "Exiting..."
       exit 1;
fi
echo "
    set feedback off
    set verify off
    set heading off
    set pagesize 0
    whenever sqlerror exit 1
    whenever oserror exit 2
    @$sqlfile
    exit 0
" | sqlplus -s $username/$password@$source_db
    tbl_x_ret_code=$?
    if [ $tbl_x_ret_code -eq 0 ]
    then
         return 0;
    else
         return 1;
    fi
}Regards
OrionNet

Similar Messages

How can I use automator to import a .csv file into a an excel file

I would still like all the import settings that I get if I am using excel to do the process, i.e. going in with the text format instead of the general format. That way my dates don't change

You'll need to use Applescript in Automator.
Note: File extension cannot be CSV (Excel will assume that the file is comma separated), so add an action to copy or rename with extension TXT.
(You can rename back at end of Workflow is needed)
The Applescript Action is:
on run {input, parameters}
     repeat with f in input
          tell application "Microsoft Excel"
               open text file filename (f as string) data type delimited field info {{1, text format}} other char "|" with use other
          end tell
      end repeat
      eturn input
end run
NOTE: This is formating the 1st col to text
If you need to format the second, then you need to:
open text file filename (f as string) data type delimited field info {{1, general format}, {2, text format}} other char "|" with use other
(You'll need to list the 1st col, 2nd col, etc until you get to the col to format as text). Formats are (from the Applescript Excel Library):
[field info list] : A list contain parse information for the individual columns of data.
Formats are general format, text format, MDY format, DMY format, YMD format, MYD format, DYM format, YDM format, skip column.
Or you can skip using Automator and just use an Applescript App (this is a droplet, just drop the files on the icon, or click to choose files):
on run
     set fs to choose file with prompt "Select one or more files to open:" default location alias (the path to desktop folder as text) with multiple selections allowed
     proceed(fs)
end run
on open fs
     proceed(fs)
end open
on proceed(fs)
     repeat with f in fs
          tell application "Microsoft Excel"
               open text file filename (f as string) data type delimited field info {{1, text format}} other char "|" with use other
           end tell
      end repeat
end proceed

Import a CSV file into specific cells

Hello,
I have created a simple Numbers template and I want to import a csv file with its values entering specific cells in an automated way.
I think the best way to automate this process would be an AppleScript that does the following:
Selects the csv file;
Parses the values inserting them into the the Numbers template i.e. value1 to cell B2, value2 to cell B3 etc.
Unfortunately I know very little about AppleScript, does anyone have any experience in this area that they could pass on?
My idea would be to place the csv values in an array, and loop through the array entering the values in B2, B3 etc.
Many thanks in advance!
Dougie

Here is a script doing the full job in a single call.
--{code}
--[SCRIPT csv-to-selected-cell]
Enregistrer le script en tant que Script : csv-to-selected-cell.scpt
déplacer le fichier ainsi créé dans le dossier
<VolumeDeDémarrage>:Utilisateurs:<votreCompte>:Bibliothèque:Scripts:Applications :Numbers:
Il vous faudra peut-être créer le dossier Numbers et peut-être même le dossier Applications.
Sélectionner la première cellule du bloc où vous souhaitez insérer les valeurs extraites d'un fichier CSV.
Aller au menu Scripts , choisir Numbers puis choisir “csv-to-selected-cell”
Le script demande de naviquer jusqu’au fichier CSV.
Il en lit le contenu,
remplace les séparateurs (";" ou ",") par des TABs
copie les données dans le presse-papiers
colle dans la table.
--=====
L’aide du Finder explique:
L’Utilitaire AppleScript permet d’activer le Menu des scripts :
Ouvrez l’Utilitaire AppleScript situé dans le dossier Applications/AppleScript.
Cochez la case “Afficher le menu des scripts dans la barre de menus”.
Sous 10.6.x,
aller dans le panneau “Général” du dialogue Préférences de l’Éditeur Applescript
puis cocher la case “Afficher le menu des scripts dans la barre des menus”.
--=====
Save the script as a Script: csv-to-selected-cell.scpt
Move the newly created file into the folder:
<startup Volume>:Users:<yourAccount>:Library:Scripts:Applications:Numbers:
Maybe you would have to create the folder Numbers and even the folder Applications by yourself.
Select the first cell of the block where values extracted from a CSV file must be inserted.
Go to the Scripts Menu, choose Numbers, then choose “csv-to-selected-cell”
The script urge you to navigate to the CSV file.
It read its contents,
replace the delimiters (";" or ",") by TAB chars
copy the datas in the clipboard
paste in the table.
--=====
The Finder’s Help explains:
To make the Script menu appear:
Open the AppleScript utility located in Applications/AppleScript.
Select the “Show Script Menu in menu bar” checkbox.
Under 10.6.x,
go to the General panel of AppleScript Editor’s Preferences dialog box
and check the “Show Script menu in menu bar” option.
--=====
Yvan KOENIG (VALLAURIS, France)
2012/01/18
--=====
on run
          local dName, sName, tName, rowNum1, colNum1, rowNum2, colNum2, lesValeurs
          my activateGUIscripting()
Extract parameters describing the target cell *)
          set {dName, sName, tName, rowNum1, colNum1, rowNum2, colNum2} to my get_SelParams()
Choose the source CSV file *)
choose file of type {"csv"}
Get the file’s contents *)
          set lesValeurs to read result
Grab the delimiter in use *)
          if lesValeurs contains ";" then
          else
          end if
Replace the delimiter in use by TAB *)
          my remplace(lesValeurs, result, tab)
Move the 'normalized' datas to the clipboard *)
set the clipboard to result
Reset the target cell in case something changed *)
          tell application "Numbers" to tell document dName to tell sheet sName to tell table tName
                    set selection range to range (name of cell colNum1 of row rowNum1)
          end tell
Paste matching style *)
          my raccourci("Numbers", "v", "cas")
end run
--=====
set { dName, sName, tName, rowNum1, colNum1, rowNum2, colNum2} to my get_SelParams()
tell application "Numbers" to tell document dName to tell sheet sName to tell table tName
on get_SelParams()
          local d_Name, s_Name, t_Name, row_Num1, col_Num1, row_Num2, col_Num2
          tell application "Numbers" to tell document 1
                    set d_Name to its name
                    set s_Name to ""
                    repeat with i from 1 to the count of sheets
                              tell sheet i to set maybe to the count of (tables whose selection range is not missing value)
                              if maybe is not 0 then
                                        set s_Name to name of sheet i
                                        exit repeat
                              end if -- maybe is not 0
                    end repeat
                    if s_Name is "" then
                              if my parleAnglais() then
                                        error "No sheet has a selected table embedding at least one selected cell !"
                              else
                                        error "Aucune feuille ne contient une table ayant au moins une cellule sélectionnée !"
                              end if
                    end if
                    tell sheet s_Name to tell (first table where selection range is not missing value)
                              tell selection range
                                        set {top_left, bottom_right} to {name of first cell, name of last cell}
                              end tell
                              set t_Name to its name
                              tell cell top_left to set {row_Num1, col_Num1} to {address of its row, address of its column}
                              if top_left is bottom_right then
                                        set {row_Num2, col_Num2} to {row_Num1, col_Num1}
                              else
                                        tell cell bottom_right to set {row_Num2, col_Num2} to {address of its row, address of its column}
                              end if
                    end tell -- sheet…
                    return {d_Name, s_Name, t_Name, row_Num1, col_Num1, row_Num2, col_Num2}
          end tell -- Numbers
end get_SelParams
--=====
on parleAnglais()
          local z
          try
                    tell application "Numbers" to set z to localized string "Cancel"
          on error
                    set z to "Cancel"
          end try
          return (z is not "Annuler")
end parleAnglais
--=====
on decoupe(t, d)
          local oTIDs, l
          set oTIDs to AppleScript's text item delimiters
          set AppleScript's text item delimiters to d
          set l to text items of t
          set AppleScript's text item delimiters to oTIDs
          return l
end decoupe
--=====
replaces every occurences of d1 by d2 in the text t
on remplace(t, d1, d2)
          local oTIDs, l
          set oTIDs to AppleScript's text item delimiters
          set AppleScript's text item delimiters to d1
          set l to text items of t
          set AppleScript's text item delimiters to d2
          set t to "" & l
          set AppleScript's text item delimiters to oTIDs
          return t
end remplace
--=====
on activateGUIscripting()
(* to be sure than GUI scripting will be active *)
          tell application "System Events"
                    if not (UI elements enabled) then set (UI elements enabled) to true
          end tell
end activateGUIscripting
--=====
==== Uses GUIscripting ====
This handler may be used to 'type' text, invisible characters if the third parameter is an empty string.
It may be used to 'type' keyboard raccourcis if the third parameter describe the required modifier keys.
I changed its name « shortcut » to « raccourci » to get rid of a name conflict in Smile.
on raccourci(a, t, d)
          local k
activate application a
          tell application "System Events" to tell application process a
                    set frontmost to true
                    try
                              t * 1
                              if d is "" then
key code t
                              else if d is "c" then
key code t using {command down}
                              else if d is "a" then
key code t using {option down}
                              else if d is "k" then
key code t using {control down}
                              else if d is "s" then
key code t using {shift down}
                              else if d is in {"ac", "ca"} then
key code t using {command down, option down}
                              else if d is in {"as", "sa"} then
key code t using {shift down, option down}
                              else if d is in {"sc", "cs"} then
key code t using {command down, shift down}
                              else if d is in {"kc", "ck"} then
key code t using {command down, control down}
                              else if d is in {"ks", "sk"} then
key code t using {shift down, control down}
                              else if (d contains "c") and (d contains "s") and d contains "k" then
key code t using {command down, shift down, control down}
                              else if (d contains "c") and (d contains "s") and d contains "a" then
key code t using {command down, shift down, option down}
                              end if
                    on error
                              repeat with k in t
                                        if d is "" then
keystroke (k as text)
                                        else if d is "c" then
keystroke (k as text) using {command down}
                                        else if d is "a" then
keystroke k using {option down}
                                        else if d is "k" then
keystroke (k as text) using {control down}
                                        else if d is "s" then
keystroke k using {shift down}
                                        else if d is in {"ac", "ca"} then
keystroke (k as text) using {command down, option down}
                                        else if d is in {"as", "sa"} then
keystroke (k as text) using {shift down, option down}
                                        else if d is in {"sc", "cs"} then
keystroke (k as text) using {command down, shift down}
                                        else if d is in {"kc", "ck"} then
keystroke (k as text) using {command down, control down}
                                        else if d is in {"ks", "sk"} then
keystroke (k as text) using {shift down, control down}
                                        else if (d contains "c") and (d contains "s") and d contains "k" then
keystroke (k as text) using {command down, shift down, control down}
                                        else if (d contains "c") and (d contains "s") and d contains "a" then
keystroke (k as text) using {command down, shift down, option down}
                                        end if
                              end repeat
                    end try
          end tell
end raccourci
--=====
--[/SCRIPT]
--{code}
Yvan KOENIG (VALLAURIS, France) mercredi 18 janvier 2012
iMac 21”5, i7, 2.8 GHz, 12 Gbytes, 1 Tbytes, mac OS X 10.6.8 and 10.7.2
My Box account is : http://www.box.com/s/00qnssoyeq2xvc22ra4k
My iDisk is : http://public.me.com/koenigyvan

Importing a csv file into addressbook

So I did a search & found this question has come up quite often, but with the person having a slightly different problem, so here goes.
I am trying to import a csv file into address book, when I go import -> text tile it comes up like it should do and I pick the file, if I select ok at this point, it will quite happily import all of the data no trouble (but in the wrong categories). So I make the changes to what I want ie. Phone other --> Phone (work). Then when I click ok, the button goes from blue to white but nothing happens.
When I open the csv file in textedit I can see all the values separated by commas.
Any Ideas?

I too just had this problem. To clarify all fields work and you can map them. I found that the Outlook CSV file had two problems which were tripping up the AddressBook import function. Note these were both in street address fields so I suspect the poster who said that addresses don't work may have been having that problem.
The CSV load program does not work if you have commas "," in your data. In my case this was very common for some European addresses as well as some company names. And then the second problem was if there was a carriage return or new line character in a field. This later one was a problem with the address fields. I suspect an AddressBook export to CSV might have this same issue. Specifically, when there were multiple lines to the street address, they had been entered as multiple lines in street address one, as opposed to entering them in multiple fields such as "street 1", "street 2", etc.
To solve the problem I opened the CSV file using Numbers and did a global find and replace on: commas, substituting the string --- and on the newline character "¶" (ALT+Rreturn) with *.
Note to reduce some of the remapping I also changed all of the labels with "business" in the header row of the CSV file to "work". This made it a little easier for the AddressBook import function to map fields more correctly.
After these set of changes rather than the alternating blue then white with nothing behavior it cleanly loaded all of my names. I could then search for "---" and "*" in addressbook's search field to identify all addresses which I had to clean up.
I hope that is helpful to someone else. The import function really does work. However, it is not robust enough to deal with certain oddities in one's data.

I have 100 groups in planning for those 100 groups i want to build roles like interactive,view user,planner etc.for those how to change in export -import folder .xml file in that edit how to change user roles in that xml it will generate automatic id.h

I have 100 groups in planning for those 100 groups i want to build roles like interactive,view user,planner etc.for those how to change in export -import folder .xml file in that edit how to change user roles in that xml it will generate automatic id.how to do that in xml file ?

Thanks john for you are reply.
I had tried what you sad.I open shared service in that foundation project i had export shared service.after that in import-export file.In that role.csv,user.csv,group.csv.Like this file have.When i open user file added some users after i trying save in excel it shown messgse
I click yes and save the .csv file and import from share servie. i got error like this
am i doing right way john.or explain clearly

Is there a way to import a .csv file into Numbers?

Can I import a .csv file into Numbers?

Yes, you can import csv (character-separated-values) into Numbers.
If the csv file is comma-separated, then in Numbers you can try File > Open and navigate to the file and open it.
If you don't get the results you want, then try this CSV to Tabs on Clipboard Automator Service (Dropbox download) instead.
To install, double-click the .workflow package and, if necessary, click 'Open Anyway' in System Preferences > Security & Privacy.
Thereafter to use:
In Finder (not Numbers) navigate to the .csv file.
Right-click on the file and choose 'CSV to Tabs on Clipboard' under Services in the contextual menu.
Follow the prompts (trying different separators if needed).
Click once in a Numbers cell.
Command-v to paste. The Numbers table will expand automatically as needed.
These steps are quicker and easier than they sound. Just a few clicks and a keyboard entry.
SG

OBIEE 11g - issue when export to a csv file

Hello,
I have an issue when I try to export to a csv file a report having numeric feild, when I export and open the file in notepad the trailing zeros to the right of decimal points do not show up. When export to another formats (such as excel, pdf) the trailing zeros appears correctly. e..g, 100.00 appears as 100, 100.50 appears as 100.5.
Do you know what can be done in order to have trailing zeros to the right of decimal points to appear in a csv?
Thanks

This is a bug see below.
Bug 13083479 : EXPORT DATA TO CSV FORMAT DOES NOT DOWNLOAD EXPANDED HIERARCHICAL COLUMNS
Proposed workaround : OBIEE 11.1.1.5: Pivot Table Report Export To Csv Does Not Include Hierarchical Data [ID 1382184.1]
Mark if answered.!
Thanks,
SVS

Import From CSV File statement runs forever, no error, does not finish

Hello,
I am trying to import a CSV file in a JAVA program, with the following statement:
IMPORT FROM CSV FILE '/debug/testdatabase/FILE.csv'
INTO "JOSEPH"."TEST_TABLE"
WITH COLUMN LIST IN FIRST ROW
RECORD DELIMITED BY '\n'
FIELD DELIMITED BY '\t' ERROR LOG '/debug/testdatabase/file.err'
THREADS 10
BATCH 10000
I have two HANA instances on different machines A and B:
Both machines run HANA version 1.00.74.00.389160 (NewDB100_REL), while the OS is
SUSE Linux Enterprise Server 11.1 on machine A and
SUSE Linux Enterprise Server 11.2 on machine B.
The statement above runs fine on machine A and the rows are imported properly from JAVA as well as when executed from HANA Studio SQL console.
If I copy the file to machine B and try the exact same statement with the same file, it does not finish (neither from JAVA nor from HANA Studio SQL console). There is no error either. It cannot be cancelled, only a HANA restart stops the statement. Also the sample file I use has only 2 rows, and memory does not seem to be a problem.
I seem to have a similar problem to the one described here, but the answers there do not help me: http://scn.sap.com/thread/3396582 I specified the record delimiter, and I used a python script to check for any strange characters that are not supposed to be there, but didn't find any.
If I copy the file to my windows PC and use the "File Menu -> Import -> SAP Hana Content -> Data from Local file" function, it imports the file correctly into B, but I need to be able to do it from JAVA.
Machine A administration view:
Machine B administration view:
If you have any idea what might cause this behavior or where I can find more information on this problem please give me a hint.

Hi Joseph,
First from the pics, the revision of your SAP HANA instance is 73 instead of 74. Since I have no identical environment, I cannot test it for you. But can you try the simplest scenario? You can create a table with only one column table try to import a CSV file with only one row.
Best regards,
Wenjun

How to import a csv file without "+" being added to numbers?

I'm trying to import a csv file from my bank. Numbers automatically adds a "+" and "-" sign before all numbers. Numbers won't add the numbers with a + sign. How can I easily remove the + sign? It seems the delimiter in the csv file may be ", rather than , Thanks.

Wayne,
I don't believe that the plus sign came from Numbers. Except for a purposful application of a Custom Format, Numbers isn't going to add the plue sign. The minus sign is another issue. It's a perfectly acceptable part of the value and shouldn't cause a problem.
If the plus sign came from the CSV file, which you seem to imply isn't the case, you would have to strip it out before submitting to Numbers.
Jerry

Button to import a csv file to update an existing table

hi ALL,
I'm pretty new with apex, on a page f my application, I want to add a button to import a csv file to update an existing table.
Have you any suggestions?
thanks in advance

Hi,
an easy solutuion would be if ypu could place the CSV file on a location which your database can access.
Access the CSV via an external table (CSV file can be accessed as if it was a readonly table ).
Create a dynamic action (PL/SQL) for the button which reads the external table and adds the data to your target table.
Cheers
Bas

Problem importing a CSV file with forward slashes in a column

I have an Excel csv file of a product database (contains about 6500 products) that contains product codes with forward slahes such as 499/1, 499/3, 499/5.
These are different sizes of a product and as such have different prices etc.
When I import the file into Numbers these numbers appear as 499, 166 1/3, and 99 4/5 respectively.
What seems to be happening is that Numbers is interpreting the forward slash (/) as a divide by command and subsequently performing a calculation on that number on import and hence totally changing the value of the cell so that it is impossible to look up the price related to a product as the product code no longer exists.
Excel can import these files with no problems, why can't Numbers treat each cell as text and leave it alone on import.
Is there any way round this or do I have to revert to using Excel for the import of csv files.
Thanks
Steve

I know I'm a bit(!) late (a year) coming to this party, but there is a simple solution, that worked for me, enclose the field in double quotes, and add a single quote before the number:
Instead of
499/1,"Super Widget 3",12.34
do
"'499/1","Super Widget 3",12.34
In fact the single (unclosed) quote without double-quotes works as well:
'499/1,"Super Widget 3",12.34
I've always found it better to enclose strings with double quotes. This works on loading the file into Mac Numbers and should work with Excel too if that helps. It opens with OpenOffice 4 on the Mac too - if you select "comma" in the "Separated by" checkbox
I can't remember where I picked this info up....
Hope this helps someone, albeit late.
Andy

Import a CSV file into contacts

I am trying to import a CSV file; a comma seperated list of email addresses. When I try to import them into contacts, contacts attempts to combine the entire email list as seperate fields of a single contact. What am I doing wrong? I am trying to import just the list of email addresses so that each email address is a seperate contact. The list does not have names or addresses, just emails. Please help.

Hey IAmWallace!
I have an article here that can address this question for you and tell you how to import these email addresses:
Address Book 6.x: Import contacts
http://support.apple.com/kb/PH4648
Take care, and thanks for visiting the Apple Support Communities.
-Braden

Importing a CSV file into AD 2012r2

Hi Guys
Just wondering if anyone can help, I am a newbie on scripting and finding it really difficult to understand how to import a csv file into AD
I have created the CSV file with the following headers, see below but I am unable to write a powershell script to import them into AD which work, I have tried multiple help guides but still cannot do it for the life of me.
Any help on this would be really appreciated
objectClass user
cn Jo bloggs
givenName jo
sn blogs
mail [email protected]
sAMAccountname j.blogs
AccountPassword Pa$$w0rd
ChangePasswordAtLogon true
PasswordNeverExpires false
ou OU=staff,DC=test,DC=com

Import-Csv C:\User.csv| %{New-ADUser -SamAccountName $_.SamAccountName `
-UserPrincipalName $_.userprinicpalname `
-Name $_.name `
-Mail = $_.mail `
-DisplayName $_.name `
-GivenName $_.GivenName `
-Path "OU=Test Users,DC=XXX,DC=XXX" `
-PasswordNeverExpires $false `
-ChangePasswordAtLogon $true `
-AccountPassword (ConvertTo-SecureString "test41;" -AsPlainText -force) `
-Enabled $True -PasswordNeverExpires $True -PassThru ` }
help New-ADUser -Examples
You can try the below sample code
Regards Chen V [MCTS SharePoint 2010]

Import a CSV-file into a new table?

hi, im trying to import a csv file into a new tabel, but i just cant make it work :-O. what are the steps to do that? im using sql developer version1.1.2.25.
thanks for helping :-)

We do not support CSV import at this stage, we only support XLS import.
Regards
Sue

Importing a CSV file into a table for Fiori

Hello,
I create a fiori application with sap web ide and i need to import a csv file from my desktop and show its content into a table in my fiori application
Please could some one help me
Ameni,
Subject was edited by: Michael Appleby

Hello Jamie
Thank you ,
i try this code , i putted in my detail.view.xml this code :<l:VerticalLayout> <u:FileUploader id="fileUploader" name="myFileUpload" uploadUrl="upload/" width="400px" tooltip="Upload your file to the local server" uploadComplete="handleUploadComplete"/> <Button text="Upload File" press="handleUploadPress"/> </l:VerticalLayout>
and i put in detail.controller.js the 2 functions : handleUploadComplete and handleUploadPress
And when i run and i press in the button to load the file but it doesn't work !
Best Regards,
Ameni,

Automating Export/Import of CSV Files

Similar Messages

Maybe you are looking for