Large dataset insertion into xls sheet ?

Hi to all Forum members,
Currently iam working with huge set of data and java heap problem, as long as i insert data into xls sheet coz my fetched dataset contains more than 50K rows. Therefore i thought perhaps i can spare lil bit heap space by adding few more task into database query.
(ref : http://forums.sun.com/thread.jspa?threadID=5377237)
Question : how can i insert dataset more than 50K rows into xls sheet. So far i know two methods
1 - extend java heap size on both JRE and Tomcat
2- use streams to continously transfer the data.
As far as i know first method is sounds good if an only if there is solo player. But i am allocating 128k to each application user. Therfore it cant be good choice.
2nd method, i never used and dont know whether it is a better choice. Although i have over internet read it works.
If you know any better method would you please furnish me with your kind ideas.
Thanks in advance.
Regards,
Romi

romi_ch wrote:
Question : how can i insert dataset more than 50K rows into xls sheet. So far i know two methods
Why in the name of [J. Presper Eckert|http://en.wikipedia.org/wiki/J._Presper_Eckert] would you want to do something like that?
I'm assuming that you mean Excel© Spreadsheet and not an XML Style Sheet.
Who are these super humans that can comprehend 50,000 rows (who knows how many columns) of stuff?
If for some strange reason you really want to do this, yo might try writing you data as a CSV file and then letting Excel handle the conversion. Should require very little memory as since you only have to store one row of the data at a time.
Edited by: johndjr on Mar 30, 2009 9:49 PM
Forgot the link

Similar Messages

Directly convert into Xls Sheet

Hello Friends,
i want to send the data of a table to xls sheet through form builder.is it possible?i am using forms 6i.i know hoe to convert it into .txt file through Text_io package but do not know how to do that to xls sheet.
Regards,
Sourav

hello
i still getting difficulties,,
here is the code i am using
DECLARE
APPID PLS_INTEGER;
CONVID PLS_INTEGER;
x number:=1;
dbmserrcode Varchar2(100);
dbmserrtext Varchar2(100);
BEGIN
break;
APPID := DDE.APP_BEGIN('D:\Program Files\Microsoft Office\Office10\excel.exe',dde.app_mode_normal);
CONVID := DDE.INITIATE('EXCEL','c:\system.xls');
DDE.EXECUTE(CONVID,'[Save.as("c:\test1.xls",1)]',10000);
DDE.TERMINATE(CONVID);
CONVID := DDE.INITIATE('EXCEL','c:\test1.xls');
go_block('afco6alc');
first_record;
loop
go_item('afco6alc.co6number');
for y in 1..3 loop
DDE.POKE(CONVID,'R'||x||'C'||y,ltrim(rtrim(:system.cursor_value)),DDE.CF_TEXT,1000);
next_item;
end loop;
x:=x+1;
next_record;
end loop;
DDE.EXECUTE(CONVID,'[Save()]',10000);
DDE.TERMINATE(CONVID);
DDE.APP_END(APPID);
exception
when others then
/*DDE.EXECUTE(CONVID,'[Save()]',10000);
DDE.TERMINATE(CONVID);
DDE.APP_END(APPID);
null;*/
dbmserrcode:=Dbms_Error_Code;
dbmserrtext:=Dbms_Error_Text;
message(dbmserrcode||' '||dbmserrtext);
Message(dbmserrcode||' '||dbmserrtext);
end;

I`d like to know how can i insert documents, xls/doc/pdf into iCloud and have them in my iPhone and my iPad. I just found one way, through ibooks, but i think it isn't a practical option.

I`d like to know how can i insert documents, xls/doc/pdf into iCloud and have them in my iPhone and my iPad. I just found one way, through ibooks, but i think it isn't a practical option.

Just use Drop Box instead.

Unable to insert large blob data into DB

Hi,
I have written a piece of code which serializes a java object and writes it into a blob in DB.
It works pretty fine for small objects of around 3 to 4 KB size, but I start getting trouble with larger objects.
Here's my piece of code -
private final static String QUERY_INSERT_AUDIT_DATA = "INSERT INTO " +
"KAAS_AUDIT_DATA(object_id, object_type_cd, create_by, summary_data) VALUES (?, ?, ?, ?)";
byte [] byteArray;
bos = new ByteArrayOutputStream();
oos = new ObjectOutputStream(bos);
oos.writeObject(summaryData);
oos.flush();
oos.close();
byteArray = bos.toByteArray();
bos.close();
ByteArrayInputStream bais = new ByteArrayInputStream(byteArray);
BufferedInputStream buffInputSteam = new BufferedInputStream(bais);
trace("addAuditSummary() : byteArray " + byteArray.length);
trace("addAuditSummary() : buffInputSteam.available " + buffInputSteam.available());
trace("addAuditSummary() : Calling Query to populating data");
statement = conn.prepareStatement(QUERY_INSERT_AUDIT_DATA);
statement.setString(1, objectId.toUpperCase());
statement.setInt(2, objectType);
statement.setString(3, createdBy);
statement.setBinaryStream(4, buffInputSteam, buffInputSteam.available());
statement.executeUpdate();
statement.close();
Basically, I am converting the object to BufferedInputStream to sent it to the BLOB(summary_data).
The error I get is -
][30 Nov 2007 10:38:08] [ERROR] [com.hns.iag.kaas.util.debug.DebugDAO] addAuditSummary() : SQL exception occured while adding audit summary data for Object: BUSINESS_SO_BASE_DEAL
]java.sql.SQLException: Io exception: Connection reset by peer.
at oracle.jdbc.dbaccess.DBError.throwSqlException(Ljava/lang/String;Ljava/lang/String;I)V(DBError.java:134)
at oracle.jdbc.dbaccess.DBError.throwSqlException(ILjava/lang/Object;)V(DBError.java:179)
at oracle.jdbc.dbaccess.DBError.throwSqlException(Ljava/io/IOException;)V(DBError.java:334)
at oracle.jdbc.ttc7.TTC7Protocol.handleIOException(Ljava/io/IOException;)V(TTC7Protocol.java:3675)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(BBI[B[Loracle/jdbc/dbaccess/DBType;[Loracle/jdbc/dbaccess/DBData;I[Loracle/jdbc/dbaccess/DBType;[Loracle/jdbc/dbaccess/DBData;I)V(Optimized Method)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteFetch(Loracle/jdbc/dbaccess/DBStatement;B[BLoracle/jdbc/dbaccess/DBDataSet;ILoracle/jdbc/dbaccess/DBDataSet;I)I(TTC7Protocol.java:1141)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout()V(Optimized Method)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate()I(Optimized Method)
at weblogic.jdbc.wrapper.PreparedStatement.executeUpdate()I(PreparedStatement.java:94)
at com.hns.iag.kaas.util.debug.DebugDAO.addAuditSummary(Ljava/lang/String;ILjava/lang/Object;Ljava/lang/String;)V(DebugDAO.java:794)
at com.hns.iag.kaas.servlets.sdm.action.SummaryAction.perform(Lcom/hns/iag/kaas/servlets/sdm/core/Event;Lcom/hns/iag/kaas/servlets/sdm/core/UserContext;)Ljava/lang/String;(SummaryAction.java:246)
at com.hns.iag.kaas.servlets.sdm.SDMControllerServlet.process(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V(SDMControllerServlet.java:213)
at com.hns.iag.kaas.servlets.sdm.SDMControllerServlet.doPost(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V(SDMControllerServlet.java:128)
at javax.servlet.http.HttpServlet.service(Ljavax/servlet/http/HttpServletRequest;Ljavax/servlet/http/HttpServletResponse;)V(HttpServlet.java:760)
at javax.servlet.http.HttpServlet.service(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run()Ljava/lang/Object;(ServletStubImpl.java:971)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;Lweblogic/servlet/internal/FilterChainImpl;)V(ServletStubImpl.java:402)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(Ljavax/servlet/ServletRequest;Ljavax/servlet/ServletResponse;)V(ServletStubImpl.java:305)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run()Ljava/lang/Object;(WebAppServletContext.java:6354)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(Lweblogic/security/subject/AbstractSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(AuthenticatedSubject.java:317)
at weblogic.security.service.SecurityManager.runAs(Lweblogic/security/acl/internal/AuthenticatedSubject;Lweblogic/security/acl/internal/AuthenticatedSubject;Ljava/security/PrivilegedAction;)Ljava/lang/Object;(SecurityManager.java:118)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(Lweblogic/servlet/internal/ServletRequestImpl;Lweblogic/servlet/internal/ServletResponseImpl;)V(WebAppServletContext.java:3635)
at weblogic.servlet.internal.ServletRequestImpl.execute(Lweblogic/kernel/ExecuteThread;)V(ServletRequestImpl.java:2585)
at weblogic.kernel.ExecuteThread.execute(Lweblogic/kernel/ExecuteRequest;)V(ExecuteThread.java:197)
at weblogic.kernel.ExecuteThread.run()V(ExecuteThread.java:170)
at java.lang.Thread.startThreadFromVM(Ljava/lang/Thread;)V(Unknown Source)
I would really appreciate any help.
Thanks
Saurabh

I would say, most likele BufferedInputStream.available() returns an incorrect length. available() does not return the length of the InputStream. See the javadocs for the details
Additionally: it doesn't make sense at all to wrap the ByteArrayInputStream with a BufferedInputStream, the array is in memory already, so there is no need to buffer the read access to it (you are simply adding more overhead).
Remove the BufferedInputStream (passing the bais directly to the setBinaryStream() method) and use byteArray.length to indicate the length of the data

Insert into table a large amount of records

I was trying to find a fast way to optimize a script that insert a large amount of records into a table. The initial script was like
insert into table_xxxx
select a.camp1, a.camp2, a.camp3 a.camp4, b.camp1, b.camp2, b.camp3
from table_a a, table_b b
where a.camp0 = b.camp0
The commit sentence was at the end of the insert script; so i came up with this solution
Declare
TYPE cur_CURSOR IS REF CURSOR ;
TYPE Tab_Hist IS TABLE OF table_xxxx%ROWTYPE INDEX BY BINARY_INTEGER;
g_tHist Tab_Hist;
CURSOR c_Base IS
select a.camp1, a.camp2, a.camp3 a.camp4, b.camp1, b.camp2, b.camp3
from table_a a, table_b b
where a.camp0 = b.camp0;
BEGIN
OPEN c_base;
LOOP
FETCH c_base BULK COLLECT INTO g_tHist LIMIT 1000;
EXIT WHEN g_tHist.COUNT = 0;
BEGIN
FORALL i IN g_tHist.FIRST .. g_tHist.COUNT SAVE EXCEPTIONS
INSERT INTO prov_cobr_dud VALUES g_tHist(i);
COMMIT;
EXCEPTION
WHEN NO_DATA_FOUND THEN
NULL;
END;
g_tHist.DELETE;
EXIT WHEN c_base%NOTFOUND;
END LOOP;
CLOSE c_base;
commit;
END;
If anyone could tell me another way to do the same thing i'll apreciate it a lot; i'm keen on learn more efficient ways to optimize scripts.
PD: The initial insert was inserting the table with 120,000 records (more or less)

Hello,
Wrong forum. This is the Oracle Forms forum. You should post in the SQL-PL/SQL forum.
Francois

Constantly inserting into large table with unique index... Guidance?

Hello all;
So here is my world. We have central to our data monitoring system an oracle database running Oracle Standard One (please don't laugh... I understand it is comical) licensing.
This DB is about 1.7 TB of small record data.
One table in particular (the raw incoming data, 350gb, 8 billion rows, just in the table) is fed millions of rows each day in real time by two to three main "data collectors" or what have you. Data must be available in this table "as fast as possible" once it is received.
This table has 6 columns (one varchar usually empty, a few numerics including a source id, a timestamp and a create time).
The data is collect in chronological order (increasing timestamp) 90% of the time (though sometimes the timestamp may be very old and catch up to current). The other 10% of the time the data can be out of order according to the timestamp.
This table has two indexes, unique (sourceid, timestamp), and a non unique (create time). (FYI, this used to be an IOT until we had to add the second index on create time, at which point a secondary index on create time slowed the IOT to a crawl)
About 80% of this data is removed after it ages beyond 3 months; 20% is retained as "special" long term data (customer pays for longer raw source retention). The data is removed using delete statements. This table is never (99.99% of the time) updated. The indexes are not rebuilt... ever... as a rebuild is about a 20+ hour process, and without online rebuilds since we are standard one, this is just not possible.
Now what we are observing is that the inserts into this table
- Inserts are much slower based on a "wider" cardinality of the "sourceid" of the data being inserted. What I mean is that 10,000 inserts for 10,000 sourceid (regardless of timestamp) is MUCH, MUCH slower than 10,000 inserts for a single sourceid. This makes sense to me, as I understand it that oracle must inspect more branches of the index for uniqueness, and more different physical blocks will be used to store the new index data. There are about 2 million unique sourceId across our system.
- Over time, oracle is requesting more and more ram to satisfy these inserts in a timely matter. My understanding here is that oracle is attempting to hold the leafs of these indexes perpetually buffers. Our system does have a 99% cache hit rate. However, we are seeing oracle requiring roughly 10GB extra ram per quarter to 6 months; we're at about 50gb of ram just for oracle already.
- If I emulate our production load on a brand new, empty table / indexes, performance is easily 10x to 20x faster than what I see when I do the same tests with the large production copies of data.
We have the following assumption: Partitioning this table based on good logical grouping of sourceid, and then timestamp, will help reduce the work required by oracle to verify uniqueness of data, reducing the amount of data that must be cached by oracle, and allow us to handle our "older than 3 month" at a partition level, greatly reducing table and index fragmentation.
Based on our hardware, its going to be about a million dollar hit to upgrade to Enterprise (with partitioning), plus a couple hundred thousand a year in support. Currently I think we pay a whopping 5 grand a year in support, if that, total oracle costs. This is going to be a huge pill for our company to swallow.
What I am looking for guidance / help on, should we really expect partitioning to make a difference here? I want to get that 10x performance difference back we see between a fresh empty system, and our current production system. I also want to limit oracles 10gb / quarter growing need for more buffer cache (the cardinality of sourceid does NOT grow by that much per quarter... maybe 1000s per quarter, out of 2 million).
Also, please I'd appreciate it if there were no mocking comments about using standard one up to this point :) I know it is risky and insane and maybe more than a bit silly, but we make due with what we have. And all the credit in the world to oracle that their "entry" level system has been able to handle everything we've thrown at it so far! :)
Alright all, thank you very much for listening, and I look forward to hear the opinions of the experts.

Hello,
Here is a link to a blog article that will give you the right questions and answers which apply to your case:
http://jonathanlewis.wordpress.com/?s=delete+90%25
As far as you are deleting 80% of your data (old data) based on a timestamp, then don't think at all about using the direct path insert /*+ append */ as suggested by one of the contributors to this thread. The direct path load will not re-use any free space made by the delete. You have two indexes:
(a) unique index (sourceid, timestamp)
(b) index(create time)
Your delete logic (based on arrival time) will smatch your indexes as far as you are always deleting the left hand side of the index; it means you will have what we call a right hand index - In other words, the scattering of the index key per leaf block is certainly catastrophic (there is an oracle iternal function named sys_op_lidbid that will allow you to verify this index information). There is a fairly chance that your two indexes will benefit from a coalesce as already suggested:
           ALTER INDEX indexname COALESCE;This coalesce should be investigated to be done on a regular basis (may be after each 80% delete) You seem to have several sourceid for one timestamp. If the answer is yes you should think about compressing this index
    create index indexname (sourceid, timestamp) compress;
or
    alter index indexname rebuild compress;     You will do it only once. Your index will have a smaller size and may be more efficient than it is actually. The index compression will add an extra CPU work during an insert but it might help improving the overal insert process.
Best Regards
Mohamed Houri

How to read ecel sheet and insert into oracle table

hi all,
am working on forms builder 6i. and i want , from a trigger to read from a a sheet excel file the data and insert into a table that i had aleady created.
i whrite a code that can till now open the excel file but i cant read the data to insert it into the table.
am using TEXT_IO.IS_OPEN to open the file
TEXT_IO.GET_LINE to take each line
and subst(x as variable) to read the first line , but the subsrt return nohing
any solution??

There's already a topic made on this: how to copy data from excel to oracle forms

Want to write some data into xls or cvs in defferent sheet

Hello,
     I want to write some data into xls or cvs in defferent sheet (under one xls or csv file).
     suppose i have 3 StringBuffer i want to to write one StringBuffer into one sheet1 another one in sheet2 and last one in sheet3.
     Please suggest me somthing.

First of: csv files don't have sheets. Only Excel files have that.
Second: for Excel you'll have to find a library that implements that format for you. Apache POI is one possible choice, jExcelAPI is another one.

Inserting large xml data into xmltype

Hi all,
In my project I need to insert very large XML data into xmltype column.
My table:
CREATE TABLE TransDetailstblCLOB ( id number, data_xml XMLType) XmlType data_xml STORE AS CLOB;
I am using JDBC approach to insert values. It works fine for data less than 4000 bytes when using preparedStatement.setString(1, xmlData). As I have to insert large Xml data >4000 bytes I am now using preparedStatement.setClob() methods.
My code works fine for table which has column declared as CLOB expicitly. But for TransDetailstblCLOB where the column is declared as XMLTYPE and storage option as CLOB I am getting the error : "ORA-01461: can bind a LONG value only for insert into a LONG column".
This error means that there is a mismatch between my setClob() and column. which means am I not storing in CLOB column.
I read in Oracle site that
When you create an XMLType column without any XML schema specification, a hidden CLOB column is automatically created to store the XML data. The XMLType column itself becomes a virtual column over this hidden CLOB column. It is not possible to directly access the CLOB column; however, you can set the storage characteristics for the column using the XMLType storage clause."
I dont understand its stated here that it is a hidden CLOB column then why not I use setClob()? It worked fine for pure CLOB column (another table) then Why is it giving such error for XMLTYPE table?
I am struck up with this since 3 days. Can anyone help me please?
My code snippet:
query = "INSERT INTO po_xml_tab VALUES (?,XMLType(?)) ";
          //query = "INSERT INTO test VALUES (?,?) ";
     // Get the statement Object
     pstmt =(OraclePreparedStatement) conn.prepareStatement(query);
     // pstmt = conn.prepareStatement(query);
     //xmlData="test";
//      If the temporary CLOB has not yet been created, create new
     temporaryClob = oracle.sql.CLOB.createTemporary(conn, true, CLOB.DURATION_SESSION);
     // Open the temporary CLOB in readwrite mode to enable writing
     temporaryClob.open(CLOB.MODE_READWRITE);
     log.debug("tempClob opened"+"size bef writing data"+"length "+temporaryClob.getLength()+
               "buffer size "+temporaryClob.getBufferSize()+"chunk size "+temporaryClob.getChunkSize());
     OutputStream out = temporaryClob.getAsciiOutputStream();
     InputStream in = new StringBufferInputStream(xmlData);
int length = -1;
int wrote = 0;
int chunkSize = temporaryClob.getChunkSize();
chunkSize=xmlData.length();
byte[] buf = new byte[chunkSize];
while ((length = in.read(buf)) != -1) {
out.write(buf, 0, length);
wrote += length;
temporaryClob.setBytes(buf);
log.debug("Wrote lenght"+wrote);
     // Bind this CLOB with the prepared Statement
     pstmt.setInt(1,100);
     pstmt.setStringForClob(2, xmlData);
     int i =pstmt.executeUpdate();
     if (i == 1) {
     log.debug("Record Successfully inserted!");
     }

try this, in adodb works:
declare poXML CLOB;
BEGIN
poXML := '<OIDS><OID>large text</OID></OIDS>';
UPDATE a_po_xml_tab set podoc=XMLType(poXML) WHERE poid = 102;
END;

How to insert large xml data into database tables.

Hi all,
iam new to xml. i want to insert data in xml file to my database tables.but the xml file size is very large. performance is also one of the issue. can anybody please tell me the procedure to take xml file from the server and insert into my database tables.
Thanks in advance

Unfortunately posting very generic questions like this in the forum tends not to be very productive for you, me or the other people who read the forum. It really helps everyone if you take a little time to review existing posts and their answers before starting new threads which replicate subjects that have already been discussed extensively in previous threads. This allows you to ask more sensible questions (eg, I'm using this approach and encountering this problem) rather than extremely generic questions that you can answer yourself by spending a little time reviewing existings posts or using the forum's search feature.
Also in future your might want to try being a little more specific before posting questions
Eg Define "very large". I know of customers who thing very large is 100K, and customers who think 4G is medium. I cannot tell from your post what size your files are.
What is the content of the file. Is it going to be loaded into a single record, or a a single table, or will it need to be loaded into multiple records in a single table or multiple records in multiple tables ?
Do you really need to load the data into exsiting relational tables or could your application work with relational views of the XML Content.
Finally which release of the database are you working with.
Define performance. Is it reasonable to expect to process this kind of document on this machine (Make, memory, #number of CPUs, CPU Speed, number of discs) in this period of time.
WRT to your original question. If you take a few minutes to search this forum you will find a very large number of threads with very similar titles to yours. These theads document a number of different approaches that can be used to solve this problem.
I suggest you start by looking for threads that cover topics like DBMS_XMLSTORE, XMLTable(), Relational Views of XML content, loading XML content in relational tables.

Insert large XML files into 11g

Can anyone post an example of inserting XML files into a XMLType table? I can use the following to insert files into a CLOB table without problems.
$lob = oci_new_descriptor($conn, OCI_D_LOB);
          $sql = "insert into D (DATASET_ID, XML_DATA)
values(
               dataset_id_seq.NEXTVAL,
               EMPTY_CLOB( )
          ) RETURNING XML_DATA into :the_blob";
          $stmt = oci_parse($conn, $sql);
          oci_bind_by_name($stmt, ':the_blob', $lob, -1, OCI_B_CLOB);
          oci_execute($stmt, OCI_DEFAULT);
          if ($lob->savefile($f)){
               oci_commit($conn);
               echo "Blob successfully uploaded\n";
          }else{
               echo "Couldn't upload Blob\n";
          oci_free_descriptor($lob);
          oci_free_statement($stmt);

A small example to insert xml file into oracle xml DB
//$Xml contains the xml file you want to insert into the database.
$insertXML = <<<EOF
DECLARE xml CLOB := $Xml; begin INSERT INTO purchaseorder_as_column VALUES (1,XMLType(xml)); end;
EOF;
$stid = oci_parse($c, $insertXML);
oci_execute($stid);
//retrieve the xml data from the that table
$sql = "select XMLTYPE.GetClobVal(xml_document) from purchaseorder_as_column where id=1";
$stid = oci_parse($c, $sql);
oci_execute($stid);
$res = oci_fetch_row($stid);
$xmldoc = $res[0]->load();
//Then use simple xml extensions or others as you like to deal with the XML document
$sxe = simplexml_load_string($xmldoc);
//other operations with tthe xml data
var_dump($sxe);

Converting .xls sheet into .csv sheet

Dear All,
Is there any program available which will convert an excel sheet into .csv sheet.
If anyone has worked on this then please forward me the code for the same.
Regards,
N.Jain

Hi Nishu,
Use the following code
data: fname type string value 'C:\file.csv'.
CALL FUNCTION 'GUI_DOWNLOAD'
EXPORTING
    FILENAME                      = fname.
   FILETYPE                      = 'ASC'
   WRITE_FIELD_SEPARATOR         = ','
TABLES
    DATA_TAB                      = itab
EXCEPTIONS
   FILE_WRITE_ERROR              = 1
   NO_BATCH                      = 2
   GUI_REFUSE_FILETRANSFER       = 3
   INVALID_TYPE                  = 4
   NO_AUTHORITY                  = 5
   UNKNOWN_ERROR                 = 6
   HEADER_NOT_ALLOWED            = 7
   SEPARATOR_NOT_ALLOWED         = 8
   FILESIZE_NOT_ALLOWED          = 9
   HEADER_TOO_LONG               = 10
   DP_ERROR_CREATE               = 11
   DP_ERROR_SEND                 = 12
   DP_ERROR_WRITE                = 13
   UNKNOWN_DP_ERROR              = 14
   ACCESS_DENIED                 = 15
   DP_OUT_OF_MEMORY              = 16
   DISK_FULL                     = 17
   DP_TIMEOUT                    = 18
   FILE_NOT_FOUND                = 19
   DATAPROVIDER_EXCEPTION        = 20
   CONTROL_FLUSH_ERROR           = 21
   OTHERS                        = 22
Here above declare file variable fname of type string and pass the file path. In the function module 'itab' is the internal table where you have data that needs to be exported to .csv file and make sure that you have given    WRITE_FIELD_SEPARATOR   = ',' which is comma separator.
Here I am assuming that you have taken data from excel sheet to internal table 'itab' using Santhosh posting message.
Regards,
yellappa.
Edited by: yellappa m on Feb 8, 2008 12:07 PM

Download the ALV Report output into excel sheet or notepad

Hi,
how to downlaod the alv report out into excel sheet or notepad in a proper manner. program contain large number records....
Thanks in advance!!!!
Regards,
kranthi.

Hi
Download a report to excel with format (border, color cell, etc)
Try this program...it may help you to change the font ..etc.
Code:
REPORT ZSIRI NO STANDARD PAGE HEADING.
this report demonstrates how to send some ABAP data to an
EXCEL sheet using OLE automation.
INCLUDE OLE2INCL.
handles for OLE objects
DATA: H_EXCEL TYPE OLE2_OBJECT,        " Excel object
      H_MAPL TYPE OLE2_OBJECT,         " list of workbooks
      H_MAP TYPE OLE2_OBJECT,          " workbook
      H_ZL TYPE OLE2_OBJECT,           " cell
      H_F TYPE OLE2_OBJECT.            " font
TABLES: SPFLI.
DATA H TYPE I.
table of flights
DATA: IT_SPFLI LIKE SPFLI OCCURS 10 WITH HEADER LINE.
*&   Event START-OF-SELECTION
START-OF-SELECTION.
read flights
SELECT * FROM SPFLI INTO TABLE IT_SPFLI UP TO 10 ROWS.
display header
ULINE (61).
WRITE: /     SY-VLINE NO-GAP,
          (3) 'Flg'(001) COLOR COL_HEADING NO-GAP, SY-VLINE NO-GAP,
          (4) 'Nr'(002) COLOR COL_HEADING NO-GAP, SY-VLINE NO-GAP,
          (20) 'Von'(003) COLOR COL_HEADING NO-GAP, SY-VLINE NO-GAP,
          (20) 'Nach'(004) COLOR COL_HEADING NO-GAP, SY-VLINE NO-GAP,
          (8) 'Zeit'(005) COLOR COL_HEADING NO-GAP, SY-VLINE NO-GAP.
ULINE /(61).
display flights
LOOP AT IT_SPFLI.
WRITE: / SY-VLINE NO-GAP,
           IT_SPFLI-CARRID COLOR COL_KEY NO-GAP, SY-VLINE NO-GAP,
           IT_SPFLI-CONNID COLOR COL_NORMAL NO-GAP, SY-VLINE NO-GAP,
           IT_SPFLI-CITYFROM COLOR COL_NORMAL NO-GAP, SY-VLINE NO-GAP,
           IT_SPFLI-CITYTO COLOR COL_NORMAL NO-GAP, SY-VLINE NO-GAP,
           IT_SPFLI-DEPTIME COLOR COL_NORMAL NO-GAP, SY-VLINE NO-GAP.
ENDLOOP.
ULINE /(61).
tell user what is going on
CALL FUNCTION 'SAPGUI_PROGRESS_INDICATOR'
     EXPORTING
          PERCENTAGE = 0
           TEXT       = TEXT-007
       EXCEPTIONS
            OTHERS     = 1.
start Excel
CREATE OBJECT H_EXCEL 'EXCEL.APPLICATION'.
PERFORM ERR_HDL.
SET PROPERTY OF H_EXCEL 'Visible' = 1.
CALL METHOD OF H_EXCEL 'FILESAVEAS' EXPORTING #1 = 'c:\kis_excel.xls'
PERFORM ERR_HDL.
tell user what is going on
CALL FUNCTION 'SAPGUI_PROGRESS_INDICATOR'
     EXPORTING
          PERCENTAGE = 0
           TEXT       = TEXT-008
       EXCEPTIONS
            OTHERS     = 1.
get list of workbooks, initially empty
CALL METHOD OF H_EXCEL 'Workbooks' = H_MAPL.
PERFORM ERR_HDL.
add a new workbook
CALL METHOD OF H_MAPL 'Add' = H_MAP.
PERFORM ERR_HDL.
tell user what is going on
CALL FUNCTION 'SAPGUI_PROGRESS_INDICATOR'
     EXPORTING
          PERCENTAGE = 0
           TEXT       = TEXT-009
       EXCEPTIONS
            OTHERS     = 1.
output column headings to active Excel sheet
PERFORM FILL_CELL USING 1 1 1 'Flug'(001).
PERFORM FILL_CELL USING 1 2 0 'Nr'(002).
PERFORM FILL_CELL USING 1 3 1 'Von'(003).
PERFORM FILL_CELL USING 1 4 1 'Nach'(004).
PERFORM FILL_CELL USING 1 5 1 'Zeit'(005).
LOOP AT IT_SPFLI.
copy flights to active EXCEL sheet
    H = SY-TABIX + 1.
    PERFORM FILL_CELL USING H 1 0 IT_SPFLI-CARRID.
    PERFORM FILL_CELL USING H 2 0 IT_SPFLI-CONNID.
    PERFORM FILL_CELL USING H 3 0 IT_SPFLI-CITYFROM.
    PERFORM FILL_CELL USING H 4 0 IT_SPFLI-CITYTO.
    PERFORM FILL_CELL USING H 5 0 IT_SPFLI-DEPTIME.
ENDLOOP.
changes by Kishore - start
CALL METHOD OF H_EXCEL 'Workbooks' = H_MAPL.
CALL METHOD OF H_EXCEL 'Worksheets' = H_MAPL." EXPORTING #1 = 2.
PERFORM ERR_HDL.
add a new workbook
CALL METHOD OF H_MAPL 'Add' = H_MAP EXPORTING #1 = 2.
PERFORM ERR_HDL.
tell user what is going on
SET PROPERTY OF H_MAP 'NAME' = 'COPY'.
CALL FUNCTION 'SAPGUI_PROGRESS_INDICATOR'
     EXPORTING
          PERCENTAGE = 0
           TEXT       = TEXT-009
       EXCEPTIONS
            OTHERS     = 1.
output column headings to active Excel sheet
PERFORM FILL_CELL USING 1 1 1 'Flug'(001).
PERFORM FILL_CELL USING 1 2 0 'Nr'(002).
PERFORM FILL_CELL USING 1 3 1 'Von'(003).
PERFORM FILL_CELL USING 1 4 1 'Nach'(004).
PERFORM FILL_CELL USING 1 5 1 'Zeit'(005).
LOOP AT IT_SPFLI.
copy flights to active EXCEL sheet
    H = SY-TABIX + 1.
    PERFORM FILL_CELL USING H 1 0 IT_SPFLI-CARRID.
    PERFORM FILL_CELL USING H 2 0 IT_SPFLI-CONNID.
    PERFORM FILL_CELL USING H 3 0 IT_SPFLI-CITYFROM.
    PERFORM FILL_CELL USING H 4 0 IT_SPFLI-CITYTO.
    PERFORM FILL_CELL USING H 5 0 IT_SPFLI-DEPTIME.
ENDLOOP.
changes by Kishore - end
disconnect from Excel
     CALL METHOD OF H_EXCEL 'FILESAVEAS' EXPORTING #1 = 'C:\SKV.XLS'.
FREE OBJECT H_EXCEL.
PERFORM ERR_HDL.
      FORM FILL_CELL                                                *
      sets cell at coordinates i,j to value val boldtype bold       *
FORM FILL_CELL USING I J BOLD VAL.
CALL METHOD OF H_EXCEL 'Cells' = H_ZL EXPORTING #1 = I #2 = J.
PERFORM ERR_HDL.
SET PROPERTY OF H_ZL 'Value' = VAL .
PERFORM ERR_HDL.
GET PROPERTY OF H_ZL 'Font' = H_F.
PERFORM ERR_HDL.
SET PROPERTY OF H_F 'Bold' = BOLD .
PERFORM ERR_HDL.
ENDFORM.
*&      Form ERR_HDL
      outputs OLE error if any                                       *
--> p1        text
<-- p2        text
FORM ERR_HDL.
IF SY-SUBRC <> 0.
WRITE: / 'Fehler bei OLE-Automation:'(010), SY-SUBRC.
STOP.
ENDIF.
ENDFORM.                    " ERR_HDL
Please note that this example maybe slow at filling the excel table
(perhaps four fields per second on a 900 MHz machine - almost 30 seconds
for a short example).
To get the data on properties and methods - there is a bit of smoke and mirrors
going on here; they are EXCEL properties and methods, not sap ones - so you need
to look at excel help to determine how a particular function is structured. then
build the block in sap, as shown in the example.
If you only want to transfer the data to Excel like when you transfer the data from
ALV to Excel simply use the Function Modules:
XXL_SIMPLE_API
If you want more modifications when you transfer it to Excel use:
XXL_FULL_API

ORA-01461 can bind a LONG value only for insert into a LONG

I Use ODP.net Insert and update Image files to Oralce blob columns(Oracle8i Server,ora92 client),
When the files larger than 4000 characters,It doesn't work.error:ORA-01461 can bind a LONG value only for insert into a LONG
My Vb.net code:
Dim dlg As OpenFileDialog
Dim strFileName() As String
Dim fsBLOB As System.IO.FileStream
Dim Adapter As OracleDataAdapter
Dim ds As New DataSet
Dim row As DataRow
Dim cb As OracleCommandBuilder
Dim bytes() As Byte
dlg = New OpenFileDialog
dlg.Filter = "Import File (*.*)|*.*"
Adapter = New OracleDataAdapter("select * from a_blob_contents where 1=0", Me.OraConnection)
Adapter.MissingSchemaAction = MissingSchemaAction.AddWithKey
Adapter.FillSchema(ds, SchemaType.Source, "BLOB")
cb = New OracleCommandBuilder(Adapter)
If dlg.ShowDialog() = DialogResult.OK Then
strFileName = dlg.FileNames()
Dim loopCount As Integer
For loopCount = 0 To strFileName.GetLength(0) - 1
row = ds.Tables("BLOB").NewRow()
row("BLOB_ID") = GetMaxBh("A_BLOB_CONTENTS", "BLOB_ID")
row("FILE_ID") = FileID
row("FILE_TYPE") = FileType
Dim file_name As String
file_name = strFileName(loopCount)
file_name = file_name.Substring(file_name.LastIndexOf("\") + 1, file_name.Length - file_name.LastIndexOf("\") - 1)
row("BLOB_NAME") = file_name
fsBLOB = New FileStream(strFileName(loopCount), FileMode.Open, FileAccess.Read)
ReDim bytes(fsBLOB.Length)
fsBLOB.Read(bytes, 0, System.Convert.ToInt32(fsBLOB.Length))
fsBLOB.Close()
row("blob_contents") = bytes
row("user_code") = Global.user_code
row("Operate_date") = Now
ds.Tables("BLOB").Rows.Add(row)
Next
Try
Adapter.Update(ds, "BLOB")
Catch ex As Exception
MessageBox.Show(ex.Message)
End Try
End If
I'll appreciate for anyone who can help me solve this problem.

Hi Zhenquan,
The issue is that you can not direct insert more than 4K (as you have discovered). Two methods I use in this situation are:
1) sql statement or procedure that returns a lob locator into an ODP.NET OracleBlob parameter such as:
insert into the_table (primary_key, blob_column) values (pk_value, empty_blob()) returning blob_column into :blob_parameter.
Once you have the OracleBlob you should be able to write/update the data.
2) use an anonymous pl/sql block or package that uses the dbms_lob supplied package to work with the LOB.
Here is a simple console example...
SQL> create table blob_test
2 (
3 blob_id number,
4 blob_data blob,
5 constraint blob_test_pk primary key (blob_id)
6 )
7 tablespace users;
Table created.
Sub Main()
Dim strFileName As String = "c:\temp\testimage.jpg"
Dim fsBlob As FileStream = New FileStream(strFileName, FileMode.Open)
Dim bytes(fsBlob.Length) As Byte
fsBlob.Read(bytes, 0, fsBlob.Length)
fsBlob.Close()
Dim con As OracleConnection = New OracleConnection("User Id=/; Data Source=lt8i")
con.Open()
Dim trans As OracleTransaction = con.BeginTransaction()
Dim sql As String = "insert into blob_test (blob_id, blob_data) values (1,empty_blob()) returning blob_data into :blob_parameter"
Dim blob_parameter As OracleParameter = New OracleParameter
blob_parameter.OracleDbType = OracleDbType.Blob
blob_parameter.Direction = ParameterDirection.InputOutput
Dim cmd As OracleCommand = New OracleCommand(sql, con)
cmd.Parameters.Add(blob_parameter)
cmd.ExecuteNonQuery()
Dim blob As OracleBlob = blob_parameter.Value
blob.Write(bytes, 0, bytes.Length)
sql = "update blob_test set blob_data = :blob_parameter where blob_id = 1"
cmd.CommandText = sql
blob_parameter.Value = blob
cmd.ExecuteNonQuery()
trans.Commit()
End Sub
This sample was tossed together pretty quickly, so it is not a complete, bullet-proof sample, but hopefully it will give you what you need to get started. The 'testimage.jpg' file is just over 5MB in size.
Hope that helps,
Mark
=======================================
Mark A. Williams
Oracle DBA
Author, Professional .NET Oracle Programming
http://www.apress.com/book/bookDisplay.html?bID=378

How to extract data from xml and insert into Oracle table

Hi,
I have a large xml file. which will have hundreds of the following transaction tags having column names and there values.
There is a table one of the schema with coulums "actualCostRate","billRate"....etc.
I need to extract the values of these columns and insert into the table
<Transaction actualCostRate="0" billRate="0" chargeable="1" clientID="NikuUK" chargeCode="LCOCD1" externalID="L-RESCODE_UK1-PROJ_UK_CNT_GBP-37289-8" importStatus="N" projectID="TESTPROJ" resourceID="admin" transactionDate="2002-02-12" transactionType="L" units="11" taskID="5017601" inputTypeCode="SALES" groupId="123" voucherNumber="ABCVDD" transactionClass="ABCD"/>
<Transaction actualCostRate="0" billRate="0" chargeable="1" clientID="NikuEU" chargeCode="LCOCD1" externalID="L-RESCODE_US1-PROJ_EU_STD2-37291-4" importStatus="N" projectID="TESTPROJ" resourceID="admin" transactionDate="2002-02-04" transactionType="L" units="4" taskID="5017601" inputTypeCode="SALES" groupId="124" voucherNumber="EEE222" transactionClass="DEFG"/>

Re: Insert from XML to relational table
http://www.google.ae/search?hl=ar&q=extract+data+from+xml+and+insert+into+Oracle+table+&btnG=%D8%A8%D8%AD%D8%AB+Google&meta=

Large dataset insertion into xls sheet ?

Similar Messages

Maybe you are looking for