CLOB import alternatives in ver 9/10 .

Hi,
it's common knowledge that importing tables with clob columns is pain because of row by row processing .
So I'm looking for alternatives .
Scenario is as is :
1. source DB 9.2.0.8
2. target DB 10.2.0.3
Question:
Which way to choose for optimal performance :
1. sqlldr
2. CTAS via db_link
3 what else ?
Regards
Greg

GregG wrote:
in my understanding import via imp utility is slow when clob columns are involved because there is no array processing (bulk inserts) , so it's row by row like .There is a difference between bulk inserting 1GB worth of rows as approx 1KB row each, versus loading 1GB where there are only a 100 rows with each row having a sizable CLOB data chunk.
Bulk processing is a means to increase performance - it is however not a silver bullet.
The basic concept to keep in mind that if you need to load 1GB of data, that means the process (loader) has to read 1GB of data, ship that data to Oracle, and Oracle needs to write that 1GB of data to a table. What you do not want is some imagined performance optimisation method that now requires 2GB of read I/O and 2GB of write I/O to happen in order to load that 1GB.
So if You can offload clob columns somehow, and then drop them before exp You can gain some time. Of course after that You need to bring back that columns and populate them DB way wise .And how will that make it faster? To now insert the CLOB data, the database first needs to read the existing row from disk in order to update that row with the CLOB contents. How is this faster than simply creating the entire row (with CLOB) in a single go?
The slowest database operation is I/O. Thus you want to always limit the I/O to the very absolute minimum needed in order to achieve the desired results. Multiple passes through the same data is never a good idea as it generates a lot of additional I.O.

Similar Messages

Import alternative item via DTW

Hi Experts,
I want to know how to import alternative items via DTW.

Hi Poonkodi, Sridharan
In SAP Business One 2007 there is a DI API object for AlternativeItem. Please refer to REFDI.CHM under SDK help folder.
Kind regards
Peter Juby

Trave & Expenses: Credit Card Imports - alternative app to WD Java

Hi All,
We've recently upgraded the portal from 7.0 to 7.4 and were using the Credit Card Imports WD Java application, which is not supported anymore since 7.3+ (SAP Note 1812863).
I did take a look at the help site for T&E EhP2 and its not very obvious if there's a one-one mapping between Java and ABAP WD replacements. What I'd like to know is if there's an alternative WD ABAP application for Credit Card Imports, or if there's a possibility to get the Java WD working anyhow.
Any documentation is much apprecated.
Many thanks.

http://help.sap.com/erp2005_ehp_06/helpdata/en/63/4448afbfed4563999f83e78ce6dda4/content.htm http://help.sap.com/erp_fao_addon10/helpdata/en/ef/3e2082a83a4994bed13a0b10491ca6/content.htm its all mentioned here have you activated the switches FIN_TRAVEL_1? are you you are on WD JAVA Travel?

ProcessXSL XML, XSL in clob, import include

Is it possible to perform transformation if the XML and XSL are stored as CLOB and the XSL contain xsl:include or xsl:import?
Does anybody have an example ?

Is it possible to perform transformation if the XML and XSL are stored as CLOB and the XSL contain xsl:include or xsl:import?
Does anybody have an example ?

Import Database from ver.8i to 8.05

Can I import Database from old version to new version (like from ver. 8i to 8.05)?
If it can, how ?

Yes you can do import from old version to new version without any problem. However new version to old version has some restrictions. You cannot import the export file taken in 8i into 8. In this case you have to take export using oracle 8.0 export utility.

Upgraded to '11 and it freezes during import, alternatives?

Hi, I "upgraded" to '11 and it will not open. It freezes during startup (during loading) and I am forced to force quit. This is making me nuts and has me seriously reconsidering my near thirty year commitment to Apple. I have scanned the web and while I gather it is a common problem, none of the frequent cures does anything for me. I deleted my Flip program and don't have Divx for example.
So, is it possible to get and install an older version at this point? I read some say the 2006 version was stable. Any reasonable alternatives to iMovie? I am trying to make a time lapse movie using photos taken with the iMotion app on my ipod. Also, can I get my money back from the app store?
I would love some advice or pointers to a thread if this has been covered (hoped it would be in an FAQ somewhere), thanks!
David

I would suggest that you contact Apple at the Contact Us link at the bottom right of this page.

How to import list of Alternative items in sap b1 8.82

Hi
I have a list of between 2000-4000 Alternative items that i need to import to business one 8.82. Since DTW has no template how else can import may be using excel VBA etc. Step by step procedure would be highly appreciated
Kind regards
Brian Ndunda

Hi Brian,
Please check below links.
Importing Alternative items into SAP B1
Import alternative item via DTW
Alternatives to Data Transfer Workbench in SAP B1
DTW Alternative Items - Which Template?
Hope this help
Regards::::
Atul Chakraborty

Urgent !! :-( - Problems with CLOB

Hello all,
I want to write and read in a CLOB. Every thing is OK. But I've a problem !! :-(
When I close my clob I still have an cursor (table_...) open on my data base(Oracle 8i)
Can you help me ???
This is my class witch woks with CLOB :
import java.io.*;
import java.sql.*;
import oracle.sql.CLOB;
import oracle.jdbc.driver.OracleResultSet;
import com.pia.best.anf.*;
import com.pia.best.anf.param.*;
import com.pia.best.anf.tools.*;
public class ClobRW {
* La m�thode <code>readClob</code> lis un Clob � partir d'un
* ResultSet.
* @param rs un <code>ResultSet</code> pointant vers le Clob
* @param idx un <code>int</code> indexant le Clob dans le ResultSet
* @return une <code>String</code> �gale � la valeur du Clob
public static String readClobRS(ResultSet res, int idx) {
String s = "";
try {
CLOB c = ((OracleResultSet)res).getCLOB(idx);
if (c != null && c.length() >= 2) {
int j = 1;
while (j + 1002 <= c.length() + 1) {
s += c.getSubString(j + 2, 1000); // Les deux premiers caract�res sont bidons...
j += 1002;
s += c.getSubString(j + 2, (int) (c.length() - j - 1));
catch(SQLException e) {
Parametre.alert(0, "ClobRW.readClobRS", "Probl�me lors de la lecture du ResultSet", "", e);
return s;
* La m�thode <code>readClob</code> lis un Clob.
* @param con une <code>Connection</code> ouverture sur la base de donn�es
* @param table une <code>String</code> nommant la relation o� se trouve le Clob
* @param field une <code>String</code> nommant le champ de la relation o� se trouve le Clob
* @param location une <code>String</code> d�crivant une condition pour extraire une ligne de la relation
* @return une <code>String</code> �gale � la valeur du Clob
public static String readClob(Connection con, String table, String field, String location) {
String s = "";
try {
Statement stmt = null;
ResultSet res = null;
String query = "";
try {
stmt = con.createStatement();
query = "select " + field + " from " + table + " where " + location;
res = stmt.executeQuery(query);
if (res.next()) {
s = readClobRS(res, 1);
else {
Parametre.alert(0, "ClobRW.readClobRS", "Probl�me lors de la lecture du Clob", null, null);
catch(SQLException e) {
Parametre.alert(0, "ClobRW.readClob", "Probl�me lors de la r�cup�ration du Clob", query, e);
if (res != null) res.close();
if (stmt != null) stmt.close();
catch(SQLException e) {
Parametre.alert(0, "ClobRW.readClob", "Probl�me lors de la fermeture du statement/resultset", "", e);
return s;
* La m�thode <code>writeClob</code> permet d'�crire un Clob.
* @param con une <code>Connection</code> ouverture sur la base de donn�es
* @param table une <code>String</code> nommant la relation o� se trouve le Clob
* @param field une <code>String</code> nommant le champ de la relation o� se trouve le Clob
* @param location une <code>String</code> d�crivant une condition pour extraire une ligne de la relation
* @param s une <code>String</code> �gale � la valeur du Clob
public static void writeClob(Connection con, String table, String field, String location, String s) {
try {
con.setAutoCommit(false);
Statement stmt = null;
ResultSet res = null;
String query = "";
try {
stmt = con.createStatement();
query = "update " + table + " set " + field + " =empty_clob()" + " where " + location;
stmt.executeUpdate(query);
query = "select " + field + " from " + table + " where " + location;
res = stmt.executeQuery(query);
if (res.next()) {
CLOB c = (CLOB) res.getObject(1);
try {
OutputStream as = c.getAsciiOutputStream();
if (as != null) {
DataOutputStream dos = new DataOutputStream(as);
int i = 0, j = 1000;
while (j < s.length()) {
dos.writeUTF(s.substring(i, j));
i = j;
j+= 1000;
dos.writeUTF(s.substring(i, s.length()));
dos.flush();
dos.close();
else {
Parametre.alert(0, "ClobRW.writeClob", "Impossible de r�cup�rer un stream sur le Clob", query, null);
as.close();
catch (IOException e) {
Parametre.alert(0, "ClobRW.writeClob", "Impossible de manipuler le Clob", query, e);
else {
Parametre.alert(0, "ClobRW.writeClob", "Impossible de r�cup�rer le Clob", query, null);
catch(SQLException e) {
Parametre.alert(0, "ClobRW.writeClob", "Probl�me lors de cr�ation ou r�cup�ration du Clob", query, e);
if (res != null) res.close();
if (stmt != null) stmt.close();
con.commit();
con.setAutoCommit(true);
catch(SQLException e) {
Parametre.alert(0, "ClobRW.writeClob", "Probl�me lors du passage en transactionnel", "", e);

Sounds like you have got "hold cursor" property turned on!
This will keep the cursor open after commit!
Though it should be closed when you close the resultset

How can i read a stored picture in oracle Long Raw datatype? blob or clob?

How can i read a stored picture in oracle Long Raw datatype? Like a blob or clob?....i am using jdk 1.3
This is because...i tried to read it like a blob but i obtain a exception...about Type of column no valid......but the column exist....and it contains the long raw datatype of the pictures.....this is my code:
import java.sql.*;
import java.io.*;
import java.util.*;
import oracle.jdbc.driver.*;
import java.awt.*;
import java.awt.event.*;
import javax.swing.*;
import java.io.InputStream;
import java.io.File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.OutputStream;
import java.sql.Connection;
import java.sql.Statement;
import java.sql.ResultSet;
import java.sql.DriverManager;
import oracle.sql.BLOB;
import oracle.sql.BLOB.*;
import oracle.jdbc.driver.*;
import java.sql.*;
class rec_ima1
public static void main(String h[])
Connection con = null;
Blob bl;
final ImageIcon image1;
JPanel photo;
try
Class.forName("oracle.jdbc.driver.OracleDriver").newInstance();
con= DriverManager.getConnection("jdbc:oracle:thin:@123.3.12.213:1521:db_name","user","password");
String query = "Select * from pictures where ID = '18840'";
Statement stmt = con.createStatement();
ResultSet rs = stmt.executeQuery( query );
if (!rs.next())
System.out.println("Empty Result Set");
bl = rs.getBlob(5);
if (bl == null) {
System.out.println("Null Blob");
return;
InputStream is = bl.getBinaryStream();
int imageLength = (int) bl.length();
System.out.println(imageLength);
System.out.println(bl.length());
byte[] imageData = new byte [imageLength];
is.read(imageData, 0, imageLength);
image1 = new ImageIcon(imageData);
photo = new JPanel() {
public void paint(Graphics g){
g.setColor(Color.lightGray);
g.drawImage(image1.getImage(), 0, 0, this);
} catch (Exception e) {
e.printStackTrace();
Now i tried using clob:
import java.sql.*;
import java.io.*;
import java.util.*;
import oracle.jdbc.driver.*;
import java.awt.*;
import java.awt.event.*;
import javax.swing.*;
import java.io.InputStream;
import java.io.File;
import java.io.FileInputStream;
import java.io.FileOutputStream;
import java.io.OutputStream;
import java.sql.Connection;
import java.sql.Statement;
import java.sql.ResultSet;
import java.sql.DriverManager;
import oracle.sql.CLOB;
import oracle.sql.CLOB.*;
import oracle.jdbc.driver.*;
import java.sql.CallableStatement;
class rec_ima4
public static void main(String h[])
Connection con = null;
Clob cl;
JPanel photo;
try
Class.forName("oracle.jdbc.driver.OracleDriver").newInstance();
con= DriverManager.getConnection("jdbc:oracle:thin:@123.3.12.213:1521:db_name","user","password");
con.setAutoCommit (false);
String query = "Select * from pictures where ID = '18840'";
Statement stmt = con.createStatement();
ResultSet rs = stmt.executeQuery( query );
while (rs.next()) {
oracle.sql.CLOB clob = (CLOB) rs.getObject(5); //line 47
} catch (Exception e) {
e.printStackTrace();
This is the runtime exception:
java.lang.ClassCastException: [B
at rec_ima4.main(rec_ima4.java:47)

Thanks by answering to me......
Well....i did that....but what is ImageIO?....
I declared a ImageIcon imageIO, but this give me the following:
rec_ima3.java:49: cannot resolve symbol
symbol : class BufferedImage
location: class rec_ima3
BufferedImage bi = ImageIO.read(bInput);
^
rec_ima3.java:49: cannot resolve symbol
symbol : variable ImageIO
location: class rec_ima3
BufferedImage bi = ImageIO.read(bInput);
^
What classes i have to import?.....what is ImageIO?
Thanks

Problem with Table Function in ver. 8.1.7.0

Hello,
I have a Problem using a Table Function in Oracle version 8.1.7.0:
type TTest_Object is Object
MSG_TRACKID VARCHAR2(25)
type TTest_Table is Table of TTest_Object;
function Test_Function return TTest_Table is
Result TTest_Table;
TmpObj TTest_Object := TTest_Object( null );
begin
TmpObj.MSG_TRACKID := '00001';
Result := TTest_Table( TmpObj );
return(Result);
end Test_Function;
when i do:
declare
Type TTmpRecord is Record (MSG_TRACKID varchar2(25));
Type TC is Ref Cursor Return TTmpRecord;
C1 TC;
TmpObj VarChar2(25);
TmpTable TTest_Table;
begin
TmpTable := Test_Function;
open C1 for Select * FROM TABLE(CAST(TmpTable as TTest_Table));
loop
fetch C1 into TmpObj;
exit when C1%notfound;
DBMS_OUTPUT.PUT_LINE(TmpObj);
end loop;
close C1;
end;
it works fine!
but, when i do:
"Select * From TABLE(CAST(Test_Function as TTest_Table))"
i get a: "ORA-000904: Invalid Column Name"
if i do the Select in version 8.1.7.4 it works fine...
does anyone know a work around in version 8.1.7.0?

export from a lower version to import in higher ver is ok.
Please see metalink doc 132904.1 for exp/imp compatiblty matrix.

How can I get the content of clob in oracle db?

In jsp,if I want to get the characters from CLOB column in ORACLE DataBase,what should I do?
I am waiting for the answer hurrily.Thank you!

import these two classes:
import oracle.sql.CLOB;
import oracle.jdbc.driver.OracleResultSet;To retrieve the clob, use
              ResultSet rs;
                  get the rs from database
              int i = 1; // this is the column Index in the rs
              CLOB cl = ((OracleResultSet)rs).getCLOB(i);
              int len = (int)cl.length();
              String str = cl.getSubString(1,len);

DTW Alternative Items - Which Template?

Hi Experts,
The subject says it all really. I have tried oAlternateCatNum but hit errors, and the file contained a column called 'Substitute', rather than the expected 'Match Factor'.
I cannot see any other likely candidates. Does it exist?
Thanks
Greig

Dear Greig,
Unfortunately it is not currently possible to import Alternative Items
via the DTW.
You could post your requirement in our SAP Business One Product
Development Collaboration forum by using the following thread.
/community [original link is broken]
As a workaround you can create a small addon by using DI API to add the
alternative items in the database.
Regards,
Rakesh Pati
SAP Business One Forum Team.

Alternative implementation of get_wkt()

I`m turning into a performance problem with the spatial function get_wkt(), and equivalently
to_wktgeometry(). There is no way to get around this, since I need the "string"-representation of the objects, of interesections, of concatenations and so on.
Currently, I fetch time at 100 records a second, which is definitely too slow, as I need to fetch 50.000 records and much much more.
Is there a way to get around this performance problem?
Is there a way to quickly build/get the WKT representation of objects?
This would really help me.
Thanks a lot.

Based on my last post here's some example code which I have found works quite well and may work well for large loads:
import java.io.BufferedReader;
import java.sql.Connection;
import oracle.sql.CLOB;
import java.sql.*;
import java.sql.DriverManager;
import java.sql.SQLException;
import java.io.IOException;
import oracle.jdbc.driver.OracleDriver;
import oracle.sql.STRUCT;
import oracle.spatial.util.*;
public class getWKT
public getWKT()
protected static Connection m_conn;
public static String CLOB2String(CLOB cl) throws IOException, SQLException
if (cl == null)
return "";
StringBuffer strOut = new StringBuffer();
String aux;
BufferedReader br = new BufferedReader(cl.getCharacterStream());
while ((aux=br.readLine())!=null)
strOut.append(aux);
return strOut.toString();
public static void main(String[] args) throws SQLException, IOException
getWKT wkt = new getWKT();
Statement stmt = null;
ResultSet rslt = null;
STRUCT geom = null;
Connection conn = null;
try {
DriverManager.registerDriver(new OracleDriver()) ;
m_conn = DriverManager.getConnection("jdbc:oracle:thin:@localhost:1521:orcl", "oragis", "oragis"); }
catch(SQLException e) { e.printStackTrace();}
stmt = m_conn.createStatement();
rslt = stmt.executeQuery("select geom " +
"from counties " +
"where sdo_filter (geom, sdo_geometry(2003,8307,null," +
"sdo_elem_info_array(1,1003,3)," +
"sdo_ordinate_array (-75,40,-74,41))) = 'TRUE'");
CLOB wktCLOB;
Adapters geomAdapters = new Adapters();
while (rslt.next()) {
geom = (STRUCT) rslt.getObject(1);
wktCLOB = geomAdapters.structToWkt(geom,m_conn);
System.out.println(wkt.CLOB2String(wktCLOB));
stmt.close();
rslt.close();
m_conn.close();
-Justin

JDBC CLOB error

Hi,
I face the following error, i use the oracle jdbc driver as db driver and i use the same ojdbc14.jar file as the project library, but when i try to cast the clob object return from resutlset it throw me class cast exception, i did print out the class name it shown oracle.sql.CLOB, but when i cast the object to oracle.sql.CLOB it still show me the error.
Do you have any idea what is wrong?
====================// java code
import java.sql.Clob;
import oracle.sql.CLOB;
Clob clob = null;
if ( resultSet.next() )
clob = resultSet.getClob( 1 );
logger.debug( "resultSet.getClass() is " + resultSet.getClass() );
logger.debug( "clob.getClass() is " + clob.getClass() );
logger.debug( "clob is " + clob );
logger.debug( "(clob instanceof oracle.sql.CLOB) is " + (clob instanceof oracle.sql.CLOB));
CLOB oraClob = (CLOB)clob; // this is where the class cast exception occur
====================// log file
[10/01/2005 15:51:26] b.crrs.common.CRRSParamServlet -- DEBUG -- selectUpdateStatement is [email protected]d5b222
[10/01/2005 15:51:26] b.crrs.common.CRRSParamServlet -- DEBUG -- resultSet.getClass() is class oracle.jdbc.driver.OracleResultSetImpl
[10/01/2005 15:51:26] b.crrs.common.CRRSParamServlet -- DEBUG -- clob.getClass() is class oracle.sql.CLOB
[10/01/2005 15:51:26] b.crrs.common.CRRSParamServlet -- DEBUG -- clob is oracle.sql.CLOB@1a21321
[10/01/2005 15:51:26] b.crrs.common.CRRSParamServlet -- DEBUG -- (clob instanceof oracle.sql.CLOB) is false
[10/01/2005 15:51:26] b.crrs.common.CRRSParamServlet -- DEBUG -- error
java.lang.ClassCastException

See JDBC error for CLOB

Insert CLOB into oracle under weblogic

Situation: running my servlet under weblogic, want to insert more than 4000 characters into CLOB of oracle 8.1.7
Problem: cannot be done by using code which is able to do it under tomcat
i use this code in tomcat:
import java.sql.*;
import oracle.sql.CLOB;
import oracle.jdbc.driver.OracleResultSet;
con.setAutoCommit(false);
Statement stmt = con.createStatement();
rs = stmt.executeQuery("SELECT clob_field FROM table where rid=id FOR UPDATE");
rs.next();
CLOB clob = ((OracleResultSet)rs).getCLOB(1);
Writer writer = clob.getCharacterOutputStream();
writer.write(dataString);
writer.close()l
con.commit();
con.setAutoCommit(true);
stmt.close();
after that i know that i can't use API of oracle when i'm using weblogic (e.g. oracle.sql.CLOB)
and i find this code from other user:
import weblogic.jdbc.vendor.oracle.OracleThinClob;
import java.io.*;
import java.sql.*;
PreparedStatement stmt = con.prepareStatement ( "INSERT INTO database VALUES ( ?, EMPTY_CLOB() )" );
stmt.setInt ( 1, 1 );
// inserts a new entry with an empty clob object
stmt.executeUpdate ();
if ( stmt != null )
stmt.close();
// retrieves CLOB-Object
stmt = con.prepareStatement ( "SELECT clob_field FROM database WHERE id=?" );
stmt.setInt ( 1, 1 );
ResultSet rs = stmt.executeQuery ( );
if ( rs.next() )
Clob cl = rs.getClob(1);
Writer clobWriter = ((OracleThinClob)cl).getCharacterOutputStream();
// Open the sample file as a stream for insertion into the Clob column
File testFile = new File ( "file.txt" );
FileReader testReader = new FileReader ( testFile );
// buffer to hold data to being written to the clob.
char[] cBuffer = new char[((OracleThinClob)cl).getBufferSize()];
// Read data from file, write it to clob
int iRead = 0;
while( (iRead= testReader.read(cBuffer)) != -1 )
clobWriter.write( cBuffer, 0, iRead);
testReader.close();
clobWriter.close();
if ( rs != null )
rs.close();
if ( stmt != null )
stmt.close();
// update clob-data in database
stmt = con.prepareStatement ( "UPDATE database SET clob_field = ? WHERE id = ?" );
stmt.setClob ( 1, cl );
stmt.setInt ( 2, 1 );
stmt.executeUpdate();
it throws java.lang.ClassCastException: oracle.sql.CLOB
but i haven't imported or used any API from oracle.........
please help
thanks

hi,
unfortunatly, you can't do this with welbogic6.1 because it 'manage' itself oracle librairies (weblogic.jar),
here is the way i solved the pb for BLOB :
i replaced :
BLOB blob = ((OracleResultSet)rs).getBLOB(1);
by
weblogic.jdbc.rmi.SerialOracleBlob cast1 =(weblogic.jdbc.rmi.SerialOracleBlob)rs.getBlob("myBlob");
weblogic.jdbc.rmi.internal.OracleTBlobImpl cast2 =(weblogic.jdbc.rmi.internal.OracleTBlobImpl)cast1.getTheRealBlob();
BLOB myBlob = (oracle.sql.BLOB)cast2.getTheRealBlob();
it is the same for clob (i suppose ^_^)
hope this helps !
Badr.

CLOB import alternatives in ver 9/10 .

Similar Messages

Maybe you are looking for