Slow Inserts Using IKM SQL to SQL Append

Hi all.
I'm in a big, big trouble.
I have a interface that gets that from the source and insert in the target (obvious)... but the unique way to insert into target is using SQL to SQL Append.
Unfortunately, the inserts are about 10 rows/sec. Very, very, very slow.
There are any ways to do the Agent faster than this?
Regards.
Luiz Araujo (a.k.a. Buchu_VP)

My Staging Area is different from the target area, but unfortunately I'm not able to change this 'cause my sources are accessed via DBLink and there are restrictions to it, enabling only the IP and HostName of my ODI database. My target tables are located in a third server, in the same domain as my ODI database, but there are no DBLinks between them so I have to use SQL to SQL Append.
Thanks in advance.
Luiz Araujo (a.k.a. Buchu_VP)
Edited by: Luiz Araujo (a.k.a. Buchu) on Jun 1, 2010 7:38 AM

Similar Messages

ODI - IKM SQL to File Append - Header not Generated

I'm using ODI IKM SQL to File Append to create a text file, but the header is not being generated. And the GENERATE_HEADER is set to Yes. The file is Tab delimited and the Heading (number of lines) is set to 1.
Seems to only be an issue with HFM files coming from the Unix server.
Any suggestions?
Thanks, Mike

Ok, getting the following error in step 6 - Integration - HFM_EA_Translate - Insert Column Headers
java.lang.NumberFormatException
     at java.math.BigDecimal.<init>(BigDecimal.java:459)
     at java.math.BigDecimal.<init>(BigDecimal.java:728)
     at com.sunopsis.sql.SnpsQuery.updateExecStatement(SnpsQuery.java)
     at com.sunopsis.sql.SnpsQuery.addBatch(SnpsQuery.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.execCollOrders(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTaskTrt(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSqlI.treatTaskTrt(SnpSessTaskSqlI.java)
     at com.sunopsis.dwg.dbobj.SnpSessTaskSql.treatTask(SnpSessTaskSql.java)
     at com.sunopsis.dwg.dbobj.SnpSessStep.treatSessStep(SnpSessStep.java)
     at com.sunopsis.dwg.dbobj.SnpSession.treatSession(SnpSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandSession.treatCommand(DwgCommandSession.java)
     at com.sunopsis.dwg.cmd.DwgCommandBase.execute(DwgCommandBase.java)
     at com.sunopsis.dwg.cmd.e.i(e.java)
     at com.sunopsis.dwg.cmd.h.y(h.java)
     at com.sunopsis.dwg.cmd.e.run(e.java)
     at java.lang.Thread.run(Thread.java:662)
The last two columns in the file are numeric which seems to be causing the issue. Will change formatting for the two columns (String, Numeric, etc.) to see if I can resolve the header issue.
Thanks,
Mike

SQL to SQL Append

Hi,
I have a interface to load data from tables to table into same Oracle server, the target table is truncate every time that run interface and the data is just insert (don't update), i read that can use "IKM SQL to SQL Append" to avoid extra loading phases ( like flow tables, create index, etc. ). I put source table and datastore table from the same model, select "Staging Area Diferent from Target" and select the apropiate staging. The problem is that i can select the "IKM SQL to SQL Append" in the flow tab.
Please can you help me with that ? i need this option to improve performance and space, every time that this interfaces run load aprox. 3 million of registers about 9 times with diferent conditions.
Thanks.
Juan Carlos Lopez
Startegic Account Sales Consultant
Oracle Venezuela

Hola Juan, que tal estas?
Eso es muy sencillo....
Just import (or use if it is already imported) the KM Control Append and change the option "Flow Control" to No.
Plus, let the Staging Area together at Target.
I believe that will solve your problem because will generate just one step to load the data...
If you have big problems on this, is very simple to change a KM....
Un Saludo!
Cezar Santos

Insert UK Date Into MS SQL Database

Hi All..
I'm using Dreamweaver 8.02, Classic ASP and MS SQL 2008
I'm having problems inserting a UK formatted date from my form to my database.
My form uses a standard text box for entering a date in the format of dd/mm/yyyy and inserts the a field in my db with a datatype of 'datetime', but when i submit the form, i get the error below!
This is the insert line of code:
MM_editCmd.Parameters.Append MM_editCmd.CreateParameter("param3", 135, 1, -1, MM_IIF(Request.Form("expirydate"), Request.Form("expirydate"), null)) ' adDBTimeStamp
I've tried all sorts of variations and i'm still unsure what the CONVERT function is (below)
Any advise would be great
Thanks in advance
Andy
Microsoft OLE DB Provider for SQL Server
error '80040e14'
Implicit conversion from data type nvarchar to varbinary is not allowed. Use the CONVERT function to run this query.

setFloat takes a float primitive, not a Float object.
select.setFloat( 4, theForm.getVaerdi().floatValue() );

Using a custom PL/SQL to populate the primary key in a tabular form

I want to use a Custom PL/SQL Function to populate the primary key when I insert a new record into a tabular form. I want to get the value from a hidden page Item. The code I am using for the primary key source is:
BEGIN
INSERT INTO TEAM_MEMBERS(TEAM_ID)
VALUES(:P75_TEAM_ID);
END;
When I try to insert a new record I get the following error:
Error ERR-1904 Unable to compute item default: type = Function Body computation_type= BEGIN INSERT INTO TEAM_MEMBERS(TEAM_ID) VALUES(:P75_TEAM_ID); END; .
ORA-06550: line 5, column 2: PLS-00103: Encountered the symbol ";" when expecting one of the following: begin case declare end exception exit for goto if loop mod null pragma raise return select update while with << close current delete fetch lock insert open rollback savepoint set sql execute commit forall merge pipe The symbol "exit" was substit
Any ideas what I am doing wrong?
Thanks!

Brian - Sometimes whitespace at the end of the block causes this. Be sure to trim everything after the last semicolon including tabs and newlines.
Scott

How to build dynamic query strings in the query using DB adapter 'Pure SQL'

Dear Forum,
I am building an application which will access DB to fetch some result set. The query involves retrieving data from multiple tables(nearly 10 tables). So I have created a DB adapter using 'execute pure sql' option. With this query works fine, but my inputs parameters will vary. So I need to make my query dynamic to append the query strings at runtime depending on the inputs.
For example I have 3 input variables - input1,input2 and input3 (in my request xsd) which are used in the pure sql query. Now if I get a 4th input parameter input4 in the request, I need to append this to query string as 'AND input4=[some value]' at runtime. Otherwise my query should have only 3 parameters. Please suggest how this can be achieved.
Regards,
Satya.

This is a strange requirement, depending on the columns you have and what are optional in them, one way is to have separate operations and each opeartion will have different inputs and for each operation , a different DB Adapter is called. But this way, it results in more number of operations for the service as well as more number of references in the composite. Even if you pass the column inputs to the SQL procedure, it will result in a large number of if-else cases..
Thanks,
N

Using PPR in PL/SQL generated webpages

I have a question about using PPR with web pages written in PL/SQL.
I have a dropdown menu that I want to limit by the value selected in the preceding dropdown (pick-list).
So far I have not found much information on PPR other than on OTN, and was unable to find any PL/SQL coding samples; so I guess I should ask...
- Is it possible to use PPR in a webpage generated from a stored PL/SQL procedure/package?
- If so, how do I make use of PPR in PL/SQL?
- If it is NOT possible to use PPR with PL/SQL, what other methods could I make use of other than JavaScript?
Thank you in advance,
Charlie

When I run the following script, the 2nd time the test1 procedure runs, it fails with "PLS-00905: object TEST1 is invalid", whereas test2 runs fine both times.
Feel free to try it yourself!
create table boneist_test (col1 number, col2 varchar2(10));
insert into boneist_test values (1, 'a');
commit;
create procedure test1
is
v_num number;
v_var varchar2(10);
begin
select *
into v_num, v_var
from boneist_test
where rownum = 1;
end test1;
create procedure test2
is
v_num number;
v_var varchar2(10);
begin
select col1, col2
into v_num, v_var
from boneist_test
where rownum = 1;
end test2;
begin
test1;
end;
begin
test2;
end;
alter table boneist_test add (col3 number);
begin
test1;
end;
begin
test2;
end;
drop table boneist_test;
drop procedure test1;
drop procedure test2;

Insert and update tables from SQL server to oracle database tables

Hi,
I am having problem while update data from sql server to oracle database tables.
I am doing one way insert +updates that is from SQL Server tables ==> Oracle database tables
I am using tools Sql server Integration service. I can insert data from sql server to oracle but update can't. Please help me how can I update + insert from sql server to oracle database tables easily.
Thanks in advance.

Hi,
What about using Oracle SQL Developer for migration
http://www.oracle.com/technetwork/database/migration/sqlserver-095136.html
HTH

Using select * in pl/sql

Hi,
Yesterday Karthick mentioned that using SELECT * in PL/SQL is not a good idea. But I tried by creating a table and different procedures with selecting all columns using * and specifying the columns individually. Later I altered the table and both procedures became invalid. Can some one give a simple example to demonstrate the behaviour.
At present I dont have Oracle in my PC to post what I have tried yesterday.
Cheers,
Suri

When I run the following script, the 2nd time the test1 procedure runs, it fails with "PLS-00905: object TEST1 is invalid", whereas test2 runs fine both times.
Feel free to try it yourself!
create table boneist_test (col1 number, col2 varchar2(10));
insert into boneist_test values (1, 'a');
commit;
create procedure test1
is
v_num number;
v_var varchar2(10);
begin
select *
into v_num, v_var
from boneist_test
where rownum = 1;
end test1;
create procedure test2
is
v_num number;
v_var varchar2(10);
begin
select col1, col2
into v_num, v_var
from boneist_test
where rownum = 1;
end test2;
begin
test1;
end;
begin
test2;
end;
alter table boneist_test add (col3 number);
begin
test1;
end;
begin
test2;
end;
drop table boneist_test;
drop procedure test1;
drop procedure test2;

Connecting to datasource and retrieve, insert and update data in SQL Server

hi,
i am trying to retrieve, insert and update data from SQL Server 2000 and display in JSPDynPage and is for Portal Application. I have already created datasource in visual composer. Is there any sample codes for mi to use it as reference???
Thanks
Regards,
shixuan

Hi,
See this link
https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/6209b52e-0401-0010-6a9f-d40ec3a09424
Regards,
Senthil kumar K.

How to insert chinese data into MS SQL Server 2000 through JDBC

I am trying to insert chinese data into MS SQL server 2000 using JDBC. how to do this?
can anybody help me.
thanx.

I am trying to insert chinese data into MS SQL server 2000 using JDBC. how to do this?
can anybody help me.
thanx.

How to insert data from access to sql server ?

How to insert data from access to sql server ?
Please help me
thanks

phamtrungkien wrote:
How to insert data from access to sql server by JAVA?The first four words of my last post:
masijade wrote:
JDBC with two connectionsGet a resultset from the jdbc-odbc bridge access connection, cycle through it and add batch insert commands to the jdbc connection to sql server. Give it a try and if the code has an error, then post your code ans ask a question.
The real question, though, is why you think it absolutely necessary to use Java for this.

Convert the insert statement of an MS SQL server into an oracle statement

Hi ,
The insert statement in the ms sql server is
INSERT INTO #temp EXEC Procedurename @Id OUTPUT
where table temp
CREATE TABLE #temp(
          Id varchar(10),
          FNa varchar(40),
          LNa varchar(40),
          SId varchar(20),
          Aid varchar(20),
          Did varchar(20),
          CCNa varchar(255),
          CCId int,
          ISu char(1),
          IA char(1),
          Dir char(1),
          Ema varchar(60),
          St char(2),
          DId char(3)
I converted the insert statement like this
Procedurename(Id);
LOOP
FETCH cv_1 INTO v_temp;
EXIT WHEN cv_1%NOTFOUND;
INSERT INTO TEMP VALUES v_temp;
END LOOP;
CLOSE cv_1;
But i am receiving PL/SQL: ORA-00947: not enough values
Can anyone help on this?
Thanks

1) Are you sure that you even need a temp table? Fetching all the rows from a cursor 1-by-1 and then inserting them into a temp table (I'm assuming the Oracle table TEMP is declared as a global temporary table) would seem rather unusual and most likely pointless. In Oracle, readers don't block writers, so there is generally no need to use temp tables to hold intermediate results.
2) If you do need to store a set of results into a table, it's going to be more efficient to do this in a single SQL statement rather than using a cursor. Something like
INSERT INTO my_table ( <<list of columns>> )
SELECT <<list of columns>>
    FROM <<other tables>>
   WHERE <<some conditions>>The SELECT part of the statement here is likely whatever SQL you use in declaring the cursor.
Justin

Insert data from oracle to sql server

we have running R12.1.1 .
our company wants to deploy some CRM Application with sql server database. Continuously we have to insert data ( some fields from some tables of Order Management module ) from ORACLE -----------> SQL Server
My Questions are :
1. What are possible methods to insert data from ORACLE -----------------> SQL Server ?
2. What are pros and cons of each method ?
3. What is performance over load of each method ?
PLease share your valuable knowledge / ideas / suggestions
thanks

What is a maximal latency for data changed in Oracle come into MS SQL?
this data will be updated in CRM after 24 hours.Does it mean that data replicated from Oracle will be updated in MS SQL and should be replicated back?
i want to know more details about these APIs etc and middle layer.what API? In MS SQL you can use Linked server and write SQLs that select from Oracle tables via that linked server and insert/update/delete into MS SQL. You can organize these SQLs into T-SQL procedures and run them in jobs.
Also you can use MS SQL replication, snapshot or transactional, which is ugly because it places triggers on Oracle tables. I doubt that this will be approved by app vendor.
Also you can use Oracle Streams via Transparent Gateway for MS SQL, which will be quite heavy solution.
Also, if real-time replication is needed, you can use "middle layer" Oracle Golden Gate, which may be quite pricy for 30 tables.
Also, if real-time replication is needed, you can use 3-rd party middle layer like DataCurrents or others.

Inserting Data from Oracle to SQL Server on the Real Time Basis.

Hi Everyone,
I need to insert data from Oracle to SQL Server on the Real Time basis, we have to fetch data from oracle approx 20 tables, and each table has more than 30 Fields. I need to fetch data in every 15 mins.
I have created a job using SQL SERVER Agent by writing insert queries for all the tables with conditions that no rows will be inserted which is already in SQL. note that this job is taking only 1 min to execute.
But in this way our SQL Server getting hanged and it giving problems to other application running in the SQL SERVER.
So i m requesting all of you that what is the best way to insert huge amount of data on the real time basis.
Thanx in Advance.

1) Create Linked server
2) insert data using openquery and set job in sql agent
3) run job after 15 minutes

Slow Inserts Using IKM SQL to SQL Append

Similar Messages

Maybe you are looking for