Exporting a view to a flat file
Hi all,
Running Oracle 9i on Windows.
We have a stored procedure which runs a number of packages and populates a view called v$logmnr_contents.
We woudl like to export the contents of the view to a flat file so that it can be transferred over to another
server.
What options do we have for this? I've been reading about an Oracle package called utl_file, is this the
only option? I'm looking for whichever method is the most straightforward to implement.
Thanks in advance.
Dave
Edited by: user482248 on Feb 23, 2010 12:03 PM
Hello Dave,
to dump data you can also use the SPOOL command in SQL*PLUS. The difference is that SQL*PLUS write to the client file system while utl_file writes to the server.
Regards
Marcus
Similar Messages
-
Export table data in a flat file without using FL
Hi,
I am looking for options where I can export table data into a flat file without using FL(File Layout) i.e., by using App Engine only.
Please share your experience if you did anything as this
ThanksA simple way to export any record (table/view) to an csv fiel, is to create a rowset and loop through all record fields, like below example code
Local Rowset &RS;
Local Record &Rec;
Local File &MYFILE;
Local string &FileName, &strRecName, &Line, &Seperator, &Value;
Local number &numRow, &numField;
&FileName = "c:\temp\test.csv";
&strRecName = "PSOPRDEFN";
&Seperator = ";";
&RS = CreateRowset(@("Record." | &strRecName));
&RS.Fill();
&MYFILE = GetFile(&FileName, "W", %FilePath_Absolute);
If &MYFILE.IsOpen Then
For &numRow = 1 To &RS.ActiveRowCount
&Rec = &RS(&numRow).GetRecord(@("RECORD." | &strRecName));
For &numField = 1 To &Rec.FieldCount
&Value = String(&Rec.GetField(&numField).Value);
If &numField = 1 Then
&Line = &Value;
Else
&Line = &Line | &Seperator | &Value;
End-If;
End-For;
&MYFILE.WriteLine(&Line);
End-For;
End-If;
&MYFILE.Close(); You can of course create an application class for generic calling this piece of code.
Hope it helps.
Note:
Do not come complaining to me on performance issues ;) -
Export multiple tables into one flat file
I have data in multiple tables on a processing database that I need to move up to a production database. I want to export the data into a flat file, ftp it to the production server and have another job pick up the file and process it. I am looking for
design suggestions on how to get multiple tables into one flat file using SSIS?
Thank You.Hey,
Without a bit more detail, as per Russels response, its difficult to give an exact recommendation.
Essentially, you would first add a data flow task to your control flow. Create a source per table, then direct the output of each into an union all task. The output from the union all task would then be directed to a flat file destination.
Within the union all task you can map the various input columns into the appropriate outputs.
If the sources are different, it would probably be easiest to add a derived column task in-between the source and the union all, adding columns as appropriate and setting a default value that can be easily identified later (again depending on your requirements).
Hope that helps,
Jamie -
Export HRMS data to a flat file
Hi All!
Are there any ways of exporting employee related data to a flat file without using a client app (PeopleCode or Integration Broker), that is simply generate a CSV feed from UI?You can Schedule a query and specify the output format as text. Note that when you select View Log/Trace in process monitor, you will see a file with a .csv extension. However, it will open by default in Excel, and even if you select Save instead of Open it will try to change the extension to .xls. You will have to change it back to .csv.
-
How to export data from DB to flat file with ODI?
we want to export DB2 tables to flat files.
Who can tell me how to do it with ODI?
Please give me a simple example or steps.
Thank you.There are two ways
Either use IKM Sql to File Append
(or)
OdiSqlUnload
For OdiSqlUnload you can use this technique to provide the connection parameters - http://odiexperts.com/?p=1985 -
SSIS to Export data from SQL to flat file dynamically
Hi.
I hope somebody can help me out, I have a table like this:
Date, StoreNumber, ProductCode, SalesItem, SalesAmout, Inventory
09-10-2014,10,1,10,10,30
As you can see I have a Date field and my table has information from 2014 at daily basis, What I'm trying to do is to export the information of this table to flat files, creating one file pear each date, as a result I will have about 280 files (one per date)
I do not know if it is possible or not.
Thank you.Hi Mike,
you can do it using one Execute SQL Task and a ForEach Loop variable driven.
1st the Execute SQL Task "figures out" how many iterations the loop would need. The SQL as follows would drive it:
SELECT DISTINCT [DATE] FROM MyTable;
and you get the dates placed into a package variable of type recordset for the [280] files.
And then you can operate on the recordset in the loop "shredding it" in a DFT with a source query dynamically driven by the date as "select a,b,c from mytable where date = '" + @[User::CurentDate] + "'" placing each
"date" into its own file even naming the file after the date using the current value of the package variable (ADO row concept).
See an example: http://www.sqlis.com/sqlis/post/Shredding-a-Recordset.aspx
Arthur My Blog -
Exporting table data to a flat file
Hi, I am trying to export data from a table to a text file using this:
CREATE TABLE bufurl
url, sno
ORGANIZATION EXTERNAL
TYPE oracle_datadump
DEFAULT DIRECTORY dataload
LOCATION ('external.txt')
AS
SELECT url, sno from table1 where sno > 10
but i get this error:
ERROR at line 1:
ORA-29829: implementation type does not exist
any clues what might be going on here?user652125 wrote:
Hi, I am trying to export data from a table to a text file using this:
CREATE TABLE bufurl
url, sno
ORGANIZATION EXTERNAL
TYPE oracle_datadump
DEFAULT DIRECTORY dataload
LOCATION ('external.txt')
AS
SELECT url, sno from table1 where sno > 10
but i get this error:
ERROR at line 1:
ORA-29829: implementation type does not exist
any clues what might be going on here?Well it should work if you are using 10g or above...
SQL> ed
Wrote file afiedt.buf
1 CREATE TABLE ext_emps
2 ORGANIZATION EXTERNAL
3 (TYPE oracle_datapump
4 DEFAULT DIRECTORY TEST_DIR
5 LOCATION ('emps.txt'))
6 AS
7 SELECT empno, ename
8* from emp
SQL> /
Table created.
SQL>What version of SQL*Plus are you running? -
Export SQL View to Flat File with UTF-8 Encoding
I've setup a package in SSIS to export a SQL view to a flat file and it's working fine. I now need to make that flat file UTF-8 encoded. The package executes but still shows the files as ANSI encoded.
My package consists of a Source (SQL View) -> Derived Column (casts the fields to DT_WSTR) -> Destination Flat File (Set to output UTF-8 file).
I don't get any errors to help me troubleshoot further. I'm running SQL Server 2005 SP2.Unless there is a Byte-Order-Marker (BOM - hex file prefix: EF BB BF) at the beginning of the file, and unless your data contains non-ASCII characters, I'm unsure there is a technical difference in the files, Paul.
That is, even if the file is "encoded" UTF-8, if your data is only ASCII values (decimal values 0-127, hex 00-7F), UTF-8 doesn't really serve a purpose over ANSI encoding. Now if you're looking for UTF-8 with specifically the BOM included, and your data is all standard ASCII, the Flat File Connection Manager can't do that, it seems.
What the flat file connection manager is doing correctly though, is encoding values that are over decimal 127/hex 7F in UTF-8 when the encoding of the connection manager is set to 65001 (UTF-8).
Example:
Input data built with a script component as a source (code at the bottom of this post) and with only one WSTR output column hooked to a flat file destination component:
a string containing only decimal value 225 (german Eszett character - ß)
Encoding set to ANSI 1252 looks like:
E1 0D 0A (which is the ANSI encoding of the decimal character value 225 (E1) and a CR-LF (0D 0A)
Encoding set to UTF-8 65001 looks like:
C3 A1 0D 0A (which is the UTF-8 encoding of the decimal character value 225 (C3 A1) and a CR-LF (0D 0A)
Note that for values over decimal 127, UTF-8 takes at least two bytes and up to four for the remaining values available.
So, I'm comfortable now, after sitting down and going through this, that the flat file connection manager is working correctly, unless you need a BOM.
1
Imports System
2
Imports System.Data
3
Imports System.Math
4
Imports Microsoft.SqlServer.Dts.Pipeline.Wrapper
5
Imports Microsoft.SqlServer.Dts.Runtime.Wrapper
6
7
Public Class ScriptMain
8
Inherits UserComponent
9
10
Public Overrides Sub CreateNewOutputRows()
11
Output0Buffer.AddRow()
12
Output0Buffer.col1 = ChrW(225)
13
End Sub
14
15
End Class
Phil -
How to create the Export Data and Import Data using flat file interface
Hi,
Request to let me know based on the requirement below on how to export and import data using flat file interface.....
Please provide the steps involved for the same.......
BW/BI - Recovery Process for SNP data.
For each SNP InfoProvider,
create:
1) Export Data:
1.a) Create an export data source, InfoPackage, comm structure, etc. necessary to create an ASCII fixed length flat file on the XI
ctnhsappdata\iface\SCPI063\Out folder for each SNP InfoProvider.
1.b) All fields in each InfoProvider should be exported and included in the flat file.
1.c) A process chain should be created for each InfoProvider with a start event.
1.d) If the file exists on the target drive it should be overwritten.
1.e) The exported data file name should include the InfoProvider technical name.
1.f) Include APO Planning Version, Date of Planning Run, APO Location, Calendar Year/Month, Material and BW Plant as selection criteria.
2) Import Data:
2.a) Create a flat file source system InfoPackage, comm structure, etc. necessary to import ASCII fixed length flat files from the XI
ctnhsappdata\iface\SCPI063\Out folder for each SNP InfoProvider.
2.b) All fields for each InfoProvider should be mapped and imported from the flat file.
2.c) A process chain should be created for each InfoProvider with a start event.
2.d) The file should be archived in the
ctnhsappdata\iface\SCPI063\Archive directory. Each file name should have the date appended in YYYYMMDD format. Each file should be deleted from the \Out directory after it is archived.
Thanks in advance.
TysonHere's some info on working with plists:
http://developer.apple.com/documentation/Cocoa/Conceptual/PropertyLists/Introduc tion/chapter1_section1.html
They can be edited with any text editor. Xcode provides a graphical editor for them - make sure to use the .plist extension so Xcode will recognize it. -
Problem with exporting to flat file
Hi all,
I have a dataset with many records. Each record has about 26,000 characters. I want to read the whole record into a table with a single field. So, I have a single field with CLOB datatype.
Now I want to export these records to a flat file. I tried spool on and spool off in SQL. But it prints on the first 84 or 85 characters of each record.
Can somebody tell me what is wrong ? Can somebody suggest a way to do this using expdp ?
I am working with Oracle Database 10g.
Someone please help, this has been going on since long...
Thanks a lot
sandeepThanks a lot for your reply Yoann. I tried what you've suggested and it worked.
But when the table was spooled, the record, after every 84 or 85 characters, gets printed on a new line.
Also, there is a separator "RECORD-----...." that gets printed every 8 or 10 lines. Can I also get rid of this in someway ?
Please excuse my silly questions, I'm very new to oracle.
Thanks and regards,
Sandeep -
Export records into a flat file
Hi...
I have to export some tables into a flat file. The output must be like this:
insert into table (col1, col2.....) value (one, two......)
insert into table (col1, col2.....) value (one, two......)
insert into table (col1, col2.....) value (one, two......)
how can I do that.......with PLSQL code?
Thanks
Message was edited by:
marckcosI got this package : and I got the follwing error:
4:35:19 PM Execution failed: ORA-20011: GENERATE_STMT Error in populating file. Message: ORA-00904: "CHANGE_DATATYPE": invalid identifier
What can I do?
CREATE OR REPLACE PACKAGE BODY UTILITY
IS
-- VARIABLES USED by PROCEDURE generate_stmt
-- File Related PACKAGE Variable
cmn_file_handle UTL_FILE.file_type;
PROCEDURE close_file
IS
BEGIN
UTL_FILE.FCLOSE (cmn_file_handle);
EXCEPTION
WHEN UTL_FILE.INVALID_FILEHANDLE THEN
RAISE_APPLICATION_ERROR(-20003, 'File handle was invalid');
WHEN UTL_FILE.INVALID_PATH THEN
RAISE_APPLICATION_ERROR(-20004, 'Invalid path for file');
WHEN OTHERS THEN
RAISE_APPLICATION_ERROR(-20005, 'CLOSE_FILE Error in creating file. Message: ' || SQLERRM);
END close_file;
PROCEDURE open_file (
prm_output_folder IN VARCHAR2,
prm_output_file IN VARCHAR2)
IS
BEGIN
cmn_file_handle := UTL_FILE.FOPEN (prm_output_folder, prm_output_file, 'a', 32767);
EXCEPTION
WHEN UTL_FILE.INVALID_FILEHANDLE THEN
close_file;
RAISE_APPLICATION_ERROR(-20000, 'File handle was invalid');
WHEN UTL_FILE.INVALID_PATH THEN
close_file;
RAISE_APPLICATION_ERROR(-20001, 'Invalid path for file');
WHEN OTHERS THEN
close_file;
RAISE_APPLICATION_ERROR(-20002, 'OPEN_FILE Error in creating file. Message: ' || SQLERRM);
END open_file;
FUNCTION change_datatype (
prm_value IN VARCHAR2,
prm_data_type IN VARCHAR2)
RETURN VARCHAR2
IS
BEGIN
IF prm_value IS NULL THEN
RETURN ('NULL');
END IF;
IF prm_data_type = 'C' THEN
IF INSTR(prm_value, CHR(10)) > 0 THEN
RETURN ('REPLACE(' || '''' || REPLACE (prm_value, CHR(10), CHR(977)) || '''' || ', CHR(977), CHR(10))');
END IF;
ELSIF prm_data_type = 'D' THEN
RETURN ('TO_DATE(' || '''' || prm_value || '''' || ', ' || '''' || 'DD-MON-YYYY HH24:MI:SS' || '''' || ')');
ELSIF prm_data_type = 'N' THEN
RETURN (prm_value);
END IF;
RETURN ('''' || prm_value || '''');
EXCEPTION
WHEN OTHERS THEN
RAISE_APPLICATION_ERROR(-20002, 'CHANGE_DATATYPE Error in Converting DataType. Message: ' || SQLERRM);
END change_datatype;
PROCEDURE generate_stmt (
prm_table_name IN VARCHAR2,
prm_where_clause IN VARCHAR2,
prm_output_folder IN VARCHAR2,
prm_output_file IN VARCHAR2)
IS
TYPE ref_cols IS REF CURSOR;
mmy_ref_cols ref_cols;
mmy_column_name VARCHAR2(100);
mmy_column_data_type VARCHAR2(1);
mmy_col_string VARCHAR2(32767);
mmy_query_col_string VARCHAR2(32767);
BEGIN
IF prm_table_name IS NULL OR
prm_output_folder IS NULL OR
prm_output_file IS NULL THEN
RAISE_APPLICATION_ERROR(-20012, 'Invalid Argument Passed');
END IF;
OPEN mmy_ref_cols
FOR SELECT LOWER(column_name) column_name,
DECODE (data_type, 'VARCHAR2', 'C', 'CHAR', 'C', 'LONG', 'C', 'NUMBER', 'N', 'DATE', 'D') data_type
FROM user_tab_columns
WHERE table_name = UPPER(prm_table_name)
ORDER BY column_id;
LOOP
FETCH mmy_ref_cols INTO mmy_column_name, mmy_column_data_type;
EXIT WHEN mmy_ref_cols%NOTFOUND;
mmy_col_string := mmy_col_string || mmy_column_name || ', ';
IF mmy_column_data_type = 'D' THEN
mmy_query_col_string := mmy_query_col_string || 'change_datatype(' || 'TO_CHAR(' || mmy_column_name || ', ' || '''' || 'DD-MON-YYYY HH24:MI:SS' || '''' || ')' || ', ' || '''' || mmy_column_data_type || '''' || ') || ' || '''' || ', ' || '''' || ' || ';
ELSIF mmy_column_data_type IN ('N', 'C') THEN
mmy_query_col_string := mmy_query_col_string || 'change_datatype(' || mmy_column_name || ', ' || '''' || mmy_column_data_type || '''' || ') || ' || '''' || ', ' || '''' || ' || ';
END IF;
END LOOP;
CLOSE mmy_ref_cols;
IF mmy_col_string IS NOT NULL AND
mmy_query_col_string IS NOT NULL THEN
IF NOT UTL_FILE.IS_OPEN(cmn_file_handle) THEN
open_file(prm_output_folder, prm_output_file);
END IF;
mmy_col_string := 'INSERT INTO ' || LOWER(prm_table_name) || ' (' || CHR(10) || CHR(9) || CHR(9) || mmy_col_string;
mmy_col_string := RTRIM (mmy_col_string, ', ');
mmy_col_string := mmy_col_string || ')' || CHR(10) || 'VALUES ( ' || CHR(9);
mmy_query_col_string := RTRIM (mmy_query_col_string, ' || ' ||'''' || ',' || '''' || ' || ') || ' one_pare';
OPEN mmy_ref_cols
FOR ' SELECT ' || mmy_query_col_string ||
' FROM ' || prm_table_name ||
' ' || prm_where_clause;
LOOP
FETCH mmy_ref_cols INTO mmy_query_col_string;
EXIT WHEN mmy_ref_cols%NOTFOUND;
mmy_query_col_string := mmy_query_col_string || ');';
UTL_FILE.put (cmn_file_handle, mmy_col_string);
UTL_FILE.put_line (cmn_file_handle, mmy_query_col_string);
END LOOP;
CLOSE mmy_ref_cols;
If UTL_FILE.IS_OPEN(cmn_file_handle) THEN
close_file;
END IF;
END IF;
EXCEPTION
WHEN UTL_FILE.INVALID_FILEHANDLE THEN
IF mmy_ref_cols%ISOPEN THEN
CLOSE mmy_ref_cols;
END IF;
close_file;
RAISE_APPLICATION_ERROR(-20009, 'File handle was invalid');
WHEN UTL_FILE.INVALID_PATH THEN
IF mmy_ref_cols%ISOPEN THEN
CLOSE mmy_ref_cols;
END IF;
close_file;
RAISE_APPLICATION_ERROR(-20010, 'Invalid path for file');
WHEN OTHERS THEN
IF mmy_ref_cols%ISOPEN THEN
CLOSE mmy_ref_cols;
END IF;
close_file;
RAISE_APPLICATION_ERROR(-20011, 'GENERATE_STMT Error in populating file. Message: ' || SQLERRM);
END generate_stmt;
END utility;
############################################################ -
SQL server 2012 Import and Export Wizard missing Flat File Options
When using either the 32 or 64 bit Import & Export wizard selecting data source "flat file source" no options appear, compared to excel import , sql or another data source ? tried uninstalling etc, build a VM 2008
Server works fine options appear. Any sugguestions before I rebuild my laptop ?
Stage that the Next button is optional, (usually greyed out)
TITLE: SQL Server Import and Export Wizard
The operation could not be completed.
ADDITIONAL INFORMATION:
The server name is not specified. (DTSWizard)
BUTTONS:
OK
Microsoft.SqlServer.Management.UI.WizardFrameworkErrorSRHi mtech,
When I open Import and Export Data(64-bit), I choose “flat file source”.
Maybe you could try to reinstall it.
If you have any feedback on our support, please click
here.
Thanks.
Maggie Luo
TechNet Community Support -
I am using SSIS to extract fixed width data into a flat file destination and I keep getting below error. I have tried almost everything in this forum but still no solution. can anyone help me out to solve this problem.
[Flat File Destination [220]] Error: Failed to write out column name for column "Column 2".
[SSIS.Pipeline] Error: component "Flat File Destination" (220) failed the pre-execute phase and returned error code 0xC0202095
ThanksHi Giss68,
Could you check the Advanced tab of the Flat File Connection Manager to see whether the InputColumnWidth and the OutputColumnWidth properties of the Column2 has the same value? Please refer to the following link about the same topic:
http://stackoverflow.com/questions/10292091/how-do-i-fix-failed-to-write-error-while-exporting-data-to-ragged-right-flat-fil
If it doesn’t work, please post the sample data and the advanced settings of Column2 for further analysis.
Regards,
Mike Yin
If you have any feedback on our support, please click
here
Mike Yin
TechNet Community Support -
Export the Form Data to Excel File using FILE EXPORT
One problem i am getting...
I want to export printers page to some excel file using FILE > EXPORT option.
I login into System Administrator Responsibility > printers > register...
I want to export this printers data to flat file(EXCEL File) using FILE > EXPORT in the form...
The movement I click FILE > EXPORT...a flash screen appears and disapperas...nothing will be exported...
What Might be the problem...
How can I solve this...
My FND_LOBS_CTX index is fine..it is valid and- Check the security level of the "Trusted sites" zone, make sure it is set to "Low"
- Make sure you do not have a yellow warning bar
- Make sure you are not accessing the application through dev60cgi/f60cgi
- Verify that you have sufficient space in the tablespace (Check init<SID>.ora for any errors)
- Check the export on some other modules to determine whether the issue is across all Apps or with a specific module only -
Export data to flat file with no delimiter
Hi I've 3 columns in a view that i want to export to a flat file. I don't want the flat file to contain any delimiter such as commas , tabs etc..
I am using fixed width with the following setting
Header row delimiter {CR}-{LF}
Advance Options :
InputColumnwith 125
InputColumnwith 187
InputColumnwith 7
When i preview that data it looks correct , divided up into 3 columns
However when the data is exported to the flat file i get just one long string in the flat file on the first row.
What do i need to do to get the end of line characters to be identified
Thanks In advanceColumn delimiter is here
Otherwise header row terminates a file line
Arthur
MyBlog
Twitter
Maybe you are looking for
-
How do I slightly move a link area in Acrobat Pro 9?
I can move the link rectangle using the arrow keys or using the mouse but this is not sensitive enough - one tap and its not in the right place! This link function was much more useful in the older versions! Any tips would be great...
-
Dynamic Columns in UWL from the NWBC 3.0?
Hi People Is there anyone that know how to change the UWL so it uses Dynamic Columns for Worklist . I know that it is possible to do this in the portal by changing the XML's to the UWL. But at the moment i am trying to get this to work from the NWBC
-
The external keyboard doesn't react
The external keyboard doesn't react anymore. At first only some keys, now the whole system is blocked. What can I do? Werner Schmitt
-
I'm getting a message from iPhoto stating that it is locked.
I have tried pulling up the iPhoto first aid window in order to rebuild it but the command and option key method is not allowing me to access that window. Any help out there?
-
Newbie: Soft Key Problem
Hey Environment: Flash Lite 2 ActionScript 2.0 When I run this code in the "Generic Phone" emulator, I several times presses on the soft keys on the emulator... But the words "LEFT" or "RIGHT" isn't written to the Output-window. I wonder what in my c