Getting row count of file into table column

Hi experts,
I want to insert the row count of the file into a table column for generating a summary file containing the detials of all the files generated for the day along with the row count and also for audit purpose.
My design is to create table in the summary file format & update the data's in it then using OdiSqlUnload to generate the required summary file, for this purpose I need to insert the row count of the file generated.
I tried to get the row count using the http://odiexperts.com/get-file-length-and-header-in-operator post. But passing the "lines" value into a ODI variable or inserting into a table column is not working.
Please help or suggest what can be done to achive the above scenario.
Thanks in advance.

There are a few excellent examples at :- COUNT
Cheers
John
http://john-goodwin.blogspot.com/

Similar Messages

GETTING ROW COUNTS OF ALL TABLES AT A TIME

Is there any column in any Data dictionary table which gives the row counts for particular table..
My scenario is...i need to get row counts of some 100 tables in our database...
instead of doing select count(*) for each table....is there any way i can do it?
similary How to get column counts for each table..in database .For example
Employee table has 3 columns...empid,empname,deptno....i want count(empid),
count(empname),count(deptno) ...is there any easy way for finding all column counts of each table in data base? is it possible?

Why does "select count(mgr) from emp" return null and not 13?Good question ;)
Seems that xml generation in principle can't handle »counting nulls«:
SQL> select xmltype(cursor(select null c from dual)) x from dual
X
<?xml version="1.0"?>
<ROWSET>
<ROW>
</ROW>
</ROWSET>
1 row selected.
SQL> select cursor(select count(null) c from dual) x from dual
Cur
0
1 row selected.
SQL> select xmltype(cursor(select count(null) c from dual)) x from dual
select xmltype(cursor(select count(null) c from dual)) x from dual
Error at line 1
ORA-31011: XML parsing failed
ORA-19202: Error occurred in XML processing
LPX-00229: input source is empty
Error at line 0
ORA-06512: at "SYS.XMLTYPE", line 0
ORA-06512: at line 1
but
SQL> select xmltype(cursor(select count(1) c from dual)) x from dual
X
<?xml version="1.0"?>
<ROWSET>
<ROW>
<C>1</C>
</ROW>
</ROWSET>
1 row selected.Looks like a bug to me ...

How to read/write .CSV file into CLOB column in a table of Oracle 10g

I have a requirement which is nothing but a table has two column
create table emp_data (empid number, report clob)
Here REPORT column is CLOB data type which used to load the data from the .csv file.
The requirement here is
1) How to load data from .CSV file into CLOB column along with empid using DBMS_lob utility
2) How to read report columns which should return all the columns present in the .CSV file (dynamically because every csv file may have different number of columns) along with the primariy key empid).
eg: empid report_field1 report_field2
1 x y
Any help would be appreciated.

If I understand you right, you want each row in your table to contain an emp_id and the complete text of a multi-record .csv file.
It's not clear how you relate emp_id to the appropriate file to be read. Is the emp_id stored in the csv file?
To read the file, you can use functions from [UTL_FILE|http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14258/u_file.htm#BABGGEDF] (as long as the file is in a directory accessible to the Oracle server):
declare
    lt_report_clob CLOB;
    l_max_line_length integer := 1024;   -- set as high as the longest line in your file
    l_infile UTL_FILE.file_type;
    l_buffer varchar2(1024);
    l_emp_id report_table.emp_id%type := 123; -- not clear where emp_id comes from
    l_filename varchar2(200) := 'my_file_name.csv';   -- get this from somewhere
begin
   -- open the file; we assume an Oracle directory has already been created
    l_infile := utl_file.fopen('CSV_DIRECTORY', l_filename, 'r', l_max_line_length);
    -- initialise the empty clob
    dbms_lob.createtemporary(lt_report_clob, TRUE, DBMS_LOB.session);
    loop
      begin
         utl_file.get_line(l_infile, l_buffer);
         dbms_lob.append(lt_report_clob, l_buffer);
      exception
         when no_data_found then
             exit;
      end;
    end loop;
    insert into report_table (emp_id, report)
    values (l_emp_id, lt_report_clob);
    -- free the temporary lob
    dbms_lob.freetemporary(lt_report_clob);
   -- close the file
   UTL_FILE.fclose(l_infile);
end;This simple line-by-line approach is easy to understand, and gives you an opportunity (if you want) to take each line in the file and transform it (for example, you could transform it into a nested table, or into XML). However it can be rather slow if there are many records in the csv file - the lob_append operation is not particularly efficient. I was able to improve the efficiency by caching the lines in a VARCHAR2 up to a maximum cache size, and only then appending to the LOB - see [three posts on my blog|http://preferisco.blogspot.com/search/label/lob].
There is at least one other possibility:
- you could use [DBMS_LOB.loadclobfromfile|http://download.oracle.com/docs/cd/B19306_01/appdev.102/b14258/d_lob.htm#i998978]. I've not tried this before myself, but I think the procedure is described [here in the 9i docs|http://download.oracle.com/docs/cd/B10501_01/appdev.920/a96591/adl12bfl.htm#879711]. This is likely to be faster than UTL_FILE (because it is all happening in the underlying DBMS_LOB package, possibly in a native way).
That's all for now. I haven't yet answered your question on how to report data back out of the CLOB. I would like to know how you associate employees with files; what happens if there is > 1 file per employee, etc.
HTH
Regards Nigel
Edited by: nthomas on Mar 2, 2009 11:22 AM - don't forget to fclose the file...

Putting a .pdf file into a column in an oracle table

I have created a table with one column as a blob so I can put 4800 .pdf files into that column of a table. Can anyone correct the ways I am trying to do this or let me know of a better way. I have tried several ways and have not been successful. Thanks.
Here are the two ways I have tried that haven't worked.
-- the storage table for the image file
CREATE TABLE pdm (
dname VARCHAR2(30), -- directory name
sname VARCHAR2(30), -- subdirectory name
fname VARCHAR2(30), -- file name
iblob BLOB); -- image file
-- create the procedure to load the file
CREATE OR REPLACE PROCEDURE load_file (
pdname VARCHAR2,
psname VARCHAR2,
pfname VARCHAR2) IS
src_file BFILE;
dst_file BLOB;
lgh_file BINARY_INTEGER;
BEGIN
src_file := bfilename('O:\twilliams\DD_promotion\cards\', pfname);
-- insert a NULL record to lock
INSERT INTO pdm
(dname, sname, fname, iblob)
VALUES
(pdname, psname, pfname, EMPTY_BLOB())
RETURNING iblob INTO dst_file;
-- lock record
SELECT iblob
INTO dst_file
FROM pdm
WHERE dname = pdname
AND sname = psname
AND fname = pfname
FOR UPDATE;
-- open the file
dbms_lob.fileopen(src_file, dbms_lob.file_readonly);
-- determine length
lgh_file := dbms_lob.getlength(src_file);
-- read the file
dbms_lob.loadfromfile(dst_file, src_file, lgh_file);
-- update the blob field
UPDATE pdm
SET iblob = dst_file
WHERE dname = pdname
AND sname = psname
AND fname = pfname;
-- close file
dbms_lob.fileclose(src_file);
END load_file;
This one I get an error message on this statements:(dbms_lob.LOADBLOBFROMFILE(blob_loc,bfile_loc,dbms_l ob.lobmaxsize,bfile_offset,
blob_offset) ; )
DECLARE
bfile_loc BFILE;
blob_loc BLOB;
bfile_offset NUMBER := 1;
blob_offset NUMBER := 1;
tot_len INTEGER;
BEGIN
/*-- First INSERT a row with an empty blob */
INSERT INTO blob_tab VALUES (5, EMPTY_BLOB());
COMMIT;
/*-- SELECT the blob locator FOR UPDATE */
SELECT blob_data INTO blob_loc FROM blob_tab
WHERE id = 5 FOR UPDATE;
/*- Obtain the BFILE locator */
bfile_loc := bfilename('O:\twilliams\DD_promotion\cards\','00EAL.pdf');
/*-- Open the input BFILE */
dbms_lob.fileopen(bfile_loc, dbms_lob.file_readonly);
/*-- Open the BLOB */
dbms_lob.OPEN(blob_loc, dbms_lob.lob_readwrite);
/*-- Populate the blob with the whole bfile data */
dbms_lob.LOADBLOBFROMFILE(blob_loc,bfile_loc,dbms_l ob.lobmaxsize,bfile_offset,
blob_offset) ;
/*-- Obtain length of the populated BLOB */
tot_len := DBMS_LOB.GETLENGTH(blob_loc);
/*-- Close the BLOB */
dbms_lob.close(blob_loc);
/*-- Close the BFILE */
dbms_lob.fileclose(bfile_loc);
COMMIT;
/*-- Display the length of the BLOB */
DBMS_OUTPUT.PUT_LINE('The length of the BLOB after population is: '||
TO_CHAR(tot_len));
END ;
/

CREATE TABLE test_blob (
id NUMBER(15)
, file_name VARCHAR2(1000)
, image BLOB
, timestamp DATE
CREATE OR REPLACE DIRECTORY
EXAMPLE_LOB_DIR
AS
'O:\twilliams\DD_promotion\cards\'
CREATE OR REPLACE PROCEDURE Load_BLOB_from_file_image
AS
dest_loc BLOB;
src_loc BFILE := BFILENAME('EXAMPLE_LOB_DIR', '009-1395.pdf');
BEGIN
INSERT INTO test_blob (id, file_name, image, timestamp)
VALUES (1001, '009-1395.pdf', empty_blob(), sysdate)
RETURNING image INTO dest_loc;
DBMS_LOB.OPEN(src_loc, DBMS_LOB.LOB_READONLY);
DBMS_LOB.OPEN(dest_loc, DBMS_LOB.LOB_READWRITE);
DBMS_LOB.LOADFROMFILE(
dest_lob => dest_loc
, src_lob => src_loc
, amount => DBMS_LOB.getLength(src_loc));
DBMS_LOB.CLOSE(dest_loc);
DBMS_LOB.CLOSE(src_loc);
COMMIT;
END;
I am getting this error when I exec load_blob_from_file_image.
ERROR at line 1:
ORA-00972: identifier is too long
ORA-06512: at "SYS.DBMS_LOB", line 716
ORA-06512: at "DRAWING.LOADBLOBFROMFILEIMAGE", line 15
ORA-06512: at line 1
any ideas why?

Trying to get row counts for all tables at a time

Hi,
i am trying to get row counts in database at a time with below query but i am getting error:
its giving me ora-19202 error..please advise me
select
      table_name,
      to_number(
        extractvalue(
          xmltype(dbms_xmlgen.getxml('select count(*) c from '||table_name))
          ,'/ROWSET/ROW/C')
          count
    from all_tables;

ALL_TABLES returns tables/views current user has access to. These tables/views are owned not just by current user. However your code
dbms_xmlgen.getxml('select count(*) c from '||table_name)does not specify who the owner is. You need to change it to:
dbms_xmlgen.getxml('select count(*) c from '||owner || '.' || table_name)However, it still will not work. Why? As I said, ALL_TABLES returns tables/views current user has access to. Any type of access, not just SELECT. So if current user is, for example, granted nothing but UPDATE on some table the above select will fail. You would have to filter ALL_TABLES through ALL_SYS_PRIVS, ALL_ROLE_PRIVS, ALL_TAB_PRIVS and PUBLIC to get list of tables current user can select from. For example, code below does it for tables/views owned by current user and tables/views current user is explicitly granted SELECT:
select
      t.owner,
      t.table_name,
      to_number(
        extractvalue(
          xmltype(dbms_xmlgen.getxml('select count(*) c from '||t.owner || '.' || t.table_name))
          ,'/ROWSET/ROW/C')
          count
    from all_tables t,user_tab_privs p
    where t.owner = p.owner
      and t.table_name = p.table_name
      and privilege = 'SELECT'
union all
select
      user,
      t.table_name,
      to_number(
        extractvalue(
          xmltype(dbms_xmlgen.getxml('select count(*) c from '||t.table_name))
          ,'/ROWSET/ROW/C')
          count
    from user_tables t
OWNER                          TABLE_NAME                                                          COUNT
SCOTT                          DEPT                                                                    4
U1                             QAQA                                                                    0
U1                             TBL                                                                     0
U1                             EMP                                                                     1
SQL> SY.

How to load rm file into ordAudio column?

Hello everybody,
I made many attempts trying to insert aa.mp3(3.63Mb) and bb.rm(3.58Mb) file into ORDSYS.ordAudio column respectively with the same way.
the result is: aa.mp3 was inserted successfully, but the bb.rm was not. It showed the error message: "java.sql.SQLException:ORA-01401:inserted value too large for column"
Why? How can I insert *.rm into the ordAudio column?
main code are grateful.

>
>
1.tonight, I made another trying to insert aa.mp3(3.63Mb) and bb.rm(3.58Mb) file into ORDSYS.ordAudio column respectively with the same way.
the result is: aa.mp3 was inserted successfully, but the bb.rm was not. It showed the error message: "java.sql.SQLException:ORA-01401:inserted value too large for column"
And the main code is as following:
private final static String EMPTY_AUDIO = "ordsys.ordaudio.init()"; //declare the EMPTY_AUDIO
stmt = (OraclePreparedStatement)conn.prepareStatement( //
"insert into TAB_NOAUDIT_AUDIO(NOAU_AU_SERIALNUMBER,"+
"NOAU_AU_TYPE,NOAU_AU_KEYWORD,NOAU_AU_FILENAME,"+
"NOAU_AU_MEDIA)"+
" values (?,?,?,?," + EMPTY_AUDIO +")" );
stmt.setString( 1, id );
stmt.setString( 2, filetype );
stmt.setString( 3, new String(keyword.getBytes("ISO8859-1")) );
stmt.setString( 4, new String(filename.getBytes("ISO8859-1")) );
// System.out.println("after 4th set..()!!");
stmt.executeUpdate();
stmt.close();
//load the audio media file into table
stmt=(OraclePreparedStatement)conn.prepareStatement(
"select NOAU_AU_MEDIA from TAB_NOAUDIT_AUDIO where NOAU_AU_SERIALNUMBER = ? for update" );
stmt.setString( 1, id );
rset = (OracleResultSet)stmt.executeQuery();
while(rset.next()) {
media = (OrdAudio)rset.getCustomDatum( 1, OrdAudio.getFactory());
File file = new File(filepath);
FileInputStream fStream = new FileInputStream(file);
media.loadDataFromInputStream(fStream);
// System.out.println("after aumedia.loadDataFromInputStream()!!");
fStream.close();
I don't know why the error occured?
Whether the rm file format is not recognized by ORDSYS.ordAudio or not?
How can i do next?
The error you get has nothing to do with the size of the media data. The error you are getting has to do with another field somewhere I think. The error you say has nothing to do with media data, but regular SQL.
It all depends on where the error is... Do you get the error on the media.loadDataFromInputStream(fStream);? I suspect, you are getting the error on the insert. and that id or filetype are too big for the column.
Could you tell me where the problem occurs? On the first insert? on the update?? I really can't debug with the amount of information here.
In general, for debugging problems, you need to break it down smaller to find the errror.
Pleas break down your insert to find the problem.
2.Would you mind telling me more detail step or code for copying ordAudio data from table
to another table with the same ORDSYS.ordAudio column property?
One media column to another would simply be
select sound into soundvar from oldtable where .....
insert into newtable(newsound) values (soundvar) where ...;
If from a lob....
select lob into lobvar from....
soundvar.source.localdata := lob;
soundvar.setlocal();
soundvar.setProperties();
Larry
Larry

Most efficient way to get row count with a where clause

Have not found a definitive answer on how to do this. Is there a better way to get a row count from a large table that needs to satisfy a where clause like so:
SELECT COUNT(*) FROM BigTable WHERE TypeName = 'ABC'
I have seen several posts suggesting something like
SELECT COUNT(*) FROM BigTable(NOLOCK);
and
selectOBJECT_NAME(object_id),row_count from sys.dm_db_partition_stats
whereOBJECT_NAME(object_id)='BigTable'but I need the row count that satisfies my where clause (i.e.: WHERE TypeName = 'ABC')

It needs index to improve the performance.
- create index on typename column
- create a indexed view to do the count in advance
-partition on type name (although it's unlikely) then get count from the system tables...
all those 3 solutions are about indexing.
Regards
John Huang, MVP-SQL, MCM-SQL, http://www.sqlnotes.info

Import txt files into table

Hi all,
I was created table A with A1 and A2 columns.
create table A (number A1, varchar A2).
I have file.txt from my desktop like
1,elementA
2,elementKK
3,elementMM
1000,element YIIO
How to import this file into table A with A1 have number and A2 have elements
from txt file using sql plus editor?
Thanks in advance

Hi,
Below example using External Table Feature.
create a directory on the server where your database is installed and copy your data file(text file) in that directory. In the below example Oracle directory name is "text_file" and the physical directory on the server is "D:\TEXT_FILE\". The file name of data file is "data.txt".
create directory text_file as 'D:\TEXT_FILE\';
DROP TABLE load_a;
CREATE TABLE load_a
(a1 varchar2(20),
a2 varchar2(200))
ORGANIZATION EXTERNAL
(TYPE ORACLE_LOADER
DEFAULT DIRECTORY text_file
ACCESS PARAMETERS
(FIELDS TERMINATED BY ','
LOCATION ('data.txt')
select * from load_a;
now you can use
insert into a select * from load_a;
Sachin Chauhan

Read text file into clob column

Dear Oracle users and Oracle support,
I have a text file that includes hundreds of data entries. The format is below. What I need to do is read each entry (
<DATALOAD ................</DATALOAD>) into the CLOB column as a table record. Then create a loop in the table to convert each record into XML data type. I have general idea on how to convert CLOB to XML. The difficult part to me is read the each entry in the text file to CLOB table. Please let me know what technique I should use. Any recommendation and sample code are welcome! I appreciate!
Thanks,
Bing
<DATALOAD ................</DATALOAD>
<DATALOAD ................</DATALOAD>
<DATALOAD ................</DATALOAD>
<DATALOAD ................</DATALOAD>

RBYL wrote:
Hi,
Thank you for your response. What I want to achieve is read the text file into ClOB column. There are hundreds reocords in the text file. The format is below. Each entry is '<DATALOAD (sensitive data here, use....... instead)</DATALOAD>' that needs to be read into clob table as a record. That is basically what I need to achieve.
<DATALOAD ................</DATALOAD>
<DATALOAD ................</DATALOAD>
hundreds of them here........
<DATALOAD ................</DATALOAD>
<DATALOAD ................</DATALOAD>So, is it really a text file or is it a well structured XML file?
Just reading it into a CLOB to process is not likely to be the best way.
If each line of the file is a record, then you're likely to be better using something like External Tables.
If it's a structured XML file, then it can be read using CLOB functionality into an XMLTYPE datatype and then shredded down into relational table structures.
Be more clear in what your requirements are and we can help you better.
{message:id=9360002}

Usage of sequence for uploading data into tables(column store) using CSV

How to make use of sequence when data is uploaded into table(column store) with the CSV file ?

Hi Sharada,
You may have to follow the below steps:
1) To load the data from flat file to a Staging table using IMPORT command
2) You have to call the procedure to load the data further into final Table.
a) Have a look on this procedure to load data :
SAP HANA: Generic Procedure using Arrays to Load delta data into Tables
b) See my reply on the syntax on how to use "Sequence"
Auto-Incrementor in stored procedure!
You will have to ensure that you frame your insert query in such a way to have the sequence number in the target table.
Regards,
Krishna Tangudu

Help needed badly Insert text data from xml files into tables

Hi all, I have asked to do insertion of text from a xml file into tables upon receiving using pro*c. i've done quite an amount of research on xml parser in c but there wasn't much information for mi to use for implementation...
Guys don't mind helping me to clarify few doubts of mine...
1. Where can i get the oracle xml parser libs? Is it included when i installed oracle 8i?
2. Is there any tutorials or help files for xml parser libs where i can read up?
I need the xml parser to recognise the tags, followed by recognising the text after the tags.
eg. xml format
<studentID> 0012 </studentID>
<student> john </student>
<studentID> 0013 </studentID>
<student> mary </student>
text willl be inserted into tables like this:
studentID | student
0012 | john
0013 | mary
by the way i'm using oracle 8i on HP-UX. Thanks in advance.

I can answer one of of your questions at least
1. Where can i get the oracle xml parser libs? Is it included when i installed oracle 8i?You need the XML XDK. You can use http://www.oracle.com/technology/tech/xml/xdkhome.html as your starting point. I believe the 9i version works for 8i.
I have no pro*c experience so I can't offer any other suggestions regarding how to do this in pro*c.

How to load the data from excel file into table in oracle using UTL_FI

How to load the data from excel file into table in oracle
and from table to excel file
using UTL_FILE package
Please give me some example

This is something i tried in oracle apex
http://avdeo.com/2008/05/21/uploading-excel-sheet-using-oracle-application-express-apex/
Regards,
CKLP

Getting the count of DISTINCT of several columns

How can i get the count of DISTINCT of several columns?
SQL> select count(distinct ename) from emp;
COUNT(DISTINCTENAME)
14
SQL> select count(distinct ename, job) from emp;
select count(distinct ename, job) from emp
ERROR at line 1:
ORA-00909: invalid number of arguments

Hello,
You should separate them out like this
select count(distinct ename), count(distinct job) from emp;Regards

How to get KMZ (Google Earth) files into FCPX.

What do I have to do to get Google Earth KMZ files into FCPX? Hopefully I can convert these files easily. I don't see any other file type options given by Google.
Thank You,
Craig

One simple way would be to get Google Earth displaying its videos and then use QT Player's "New Screen Recording" facility.

Query to get rows betwen x and y + table total row count

Hi,
I try get rows between e.g. 100 and 150 when I sort by some column
My query is now like this
SELECT *
FROM
(SELECT a.*,
    row_number() OVER (ORDER BY OWNER ASC) rn,
    COUNT(1) over() mrn
FROM (SELECT * FROM all_objects) a
WHERE ROWNUM BETWEEN least(100,mrn) AND 150It is not very fast if I run that kind select from big table
Any tips to optimize this query?
Regards,
Jari

Hi,
I'm so bad with SQL :(
Here is sample where I need that kind query.
http://actionet.homelinux.net/htmldb/f?p=100:504
It looks standard Apex report but it is not.
It is just test to use query to output html using htp package
I send parameter start row, max rows, column I like order by.
Now I do query for cursor
    /* Report query */
    l_sql := '
      SELECT * FROM(
        SELECT a.*, row_number() OVER (ORDER BY '
        || l_sort_col
        || ' '
        || l_sort_ord
        || ') rn, COUNT(1) over() mrn
        FROM(' || l_sql || ') a
      ) WHERE rn BETWEEN LEAST(' || l_start_row || ',mrn) AND ' || l_last_row
    ;Then I loop cursor and output html.
You can order report by click heading and there is that pagination
I did not know that I could find examples by "pagination query" =), thanks for that tip for both of you.
I know Apex have reports ,
but I need have features that Apex templates can not provide at least yet.
So I have study that generating html tables using custom package instead Apex report should be best approach to get layouts I need.
Regards,
Jari
Edited by: jarola on Jan 21, 2011 10:38 PM

Getting row count of file into table column

Similar Messages

Maybe you are looking for