Transform activity is taking a lot of time

Hi All,
I have a process that gets data from a file and insert it into a DB.
I'm using a transformation activity between the file & DB adapters.
When tranform few records I hva eno problem. When transforming 30,000 records it takes about 25 minutes, and it's a lot.
Some one maybe knows what can be the reson???
The data is very simple(string/numbers). With another tool it takes few sec'
Thanks
Riko

Hiii Riko, I don't know the exact solution to your problem. Some of my thoughts on your issue here.
I too have production server and I must say 25 mins for 30k records is a reasonable time considering it logs the instance processes/records in the DB in background.
The transformation in SOA Suite takes a lot of time as while doing transformation it keeps the whole payload (which consists of 30K records in memory/RAM). As it is obvious that it would be transforming one record at a time, but keeping all records in memory for their processing.
If your requirement is only routing and transformation why don't you go for an ESB. I suggest that you use Oracle Service Bus for that. It doesn't keep the whole payload in memory and execution would be much faster. Still it would not be in few seconds( I dont know which tool you are testing with).
If you are going to have many transactions where you need to pass 30-50K records frequently and many a times in a day I suggest you go with Oracle Data Integrator (ODI).

Similar Messages

Background task taking a lot of time to execute

Hi,
There is a background task in my workflow which is taking a lot of time to execute.
I have tested it in dialog mode.. and it works fine.. takes just 2 mins.
Only when the task is executed from background.. it takes about 10 mins.
Is this a config problem? How do I check if it is so?

you could try activating a trace (sql) and see what the differences are,.
you could check if maybe user parameters are influencing this. Or ask your basis team if there are a lot of differences between syystem users and dialog users in terms of resource allocation.
Did you find anything different whilst debugging it?
Kind regards, Rob Dielemans

Simple select query is taking a lot of time

hi gems...
my table has 7267563 rows...and i am doing a simple select * from table;
but it is taking a lot of time nearly 25minutes but not completed...
when i did select count(1) from table then it gave the result instantly also select * from table where rownum < 10 is also fine...even when i am selecting all the records using rownum i.e. select * from table where rownum < 7267563 is also giving result instantly...
but the entire table is not getting result i.e. select * from table...also there is no lock in the table(though i know that select is nothing to do with lock)..
what may be the issue..please suggest...thanks in advance...
Edited by: user12780416 on Dec 12, 2011 11:08 PM

Hi;
Please see below thread
query takes too long ...
help in solving long run query
HOW TO: Post a SQL statement tuning request - template posting
Hope it helps
Regard
Helios

Startup taking a LOT of Time

Hi All,
We have our application on Weblogic Server 8.1 SP5 and its taking a lot of time while starting up.
What I found that these lines are the ones which are taking up majority of the time.
Kindly Suggest how we can improve on this.
####<Jun 15, 2009 4:14:59 PM GMT+05:30> <Info> <Deployer> <sunbom4> <cgServer> <main> <<WLS Kernel>> <> <BEA-149060> <Module uddi of application uddi successfully transitioned from unprepared to prepared on server cgServer.>
This line took more than 2 min.
####<Jun 15, 2009 4:16:50 PM GMT+05:30> <Info> <Deployer> <sunbom4> <cgServer> <main> <<WLS Kernel>> <> <BEA-149060> <Module MLAppCoreWL610.jar of application IntellectMM successfully transitioned from unprepared to prepared on server cgServer.>
####<Jun 15, 2009 4:18:23 PM GMT+05:30> <Info> <Deployer> <sunbom4> <cgServer> <main> <<WLS Kernel>> <> <BEA-149060> <Module OpenFXWrapperEJB.jar of application IntellectMM successfully transitioned from unprepared to prepared on server cgServer.>
The above 2 lines are taking 1.5min each.

I suggest that you take some thread dumps 10-15 secs apart during the time it's slow. The log timing alone won't tell you where the threads are spending time.

Mac taking a lot more time

My Mac is taking a lot more time to load photos from iPhone and iPad than was taking before.What can be the reason of it ?
Thanks

DO NOT INSTALL MACKEEPER or any other so called 'cleaning ' application. Please read the following user tip:
https://discussions.apple.com/docs/DOC-3036
Look for reasons in this user tip for your issues of slow operation:
https://discussions.apple.com/docs/DOC-3521
Ciao.

Select Command taking a lot of time to execute

Dear Experts,
My below SELECT command taking a lot of time to execute.
      SELECT wid
                   matl_desc
                   INTO TABLE open_wid FROM zwb_table
                   WHERE ( weight2 = 0 OR weight2 IS NULL ).
Table : zwb_table contains around 7 Lacs records. That's why taking a lot of time . I have also Indexed the table zwb_table with field WID & WEIGHT2 . (zwb_table contains only WID as Primary Key Field)
Structure of Internal Table : open_wid ->
                                         wid LIKE zwb_table-wid,
                                         matl_desc LIKE zwb_table-matl_desc,
Please suggest me how to Improve the Performance of the above Select command.
Thanks in Advance
JACK

Hi Jack,
you are having morethan 7lack records in z table. it is not good practice fetching all the records into internal table and restricting with where clause in loop statement.
I hope you already created secondary index combination of primary key.
check you select query fetching records based on index you have created in ST05.
Refer below link for your program is using index that you have created.
Re: Indexing
Regards,
Peranandam
Edited by: peranandam chinnathambi on Apr 7, 2009 8:38 AM

Can we optimize the query : It is taking a lot of time

the following query is taking a lot of time ...
Can anyone suggest to make it run faster ???
table B has 12 million records
table a has 10000 records
CREATE TABLE less_time
     PARALLEL
     NOLOGGING
     AS
     SELECT a.user_id,a.mp_id, COUNT(product_id) product _count
     FROM table a,table b
     WHERE TRUNC(a.call_time) < TRUNC(SYSDATE) - 1
     AND a.history_id = b.call_id
     AND b.product_type = 1
     AND b..product_status= 50
     AND user_id IS NOT NULL
     GROUP BY user_id,mp_id;

analyze index indx_mtx compute statistics
thanks for explaining David ...
Actually I somewhat bettered it
i made a consolidated index on table b
like create index indx_ty on table b (call_id,mp_id,user_id,b.product_type,product_status)
now the explain plan shows that the query is much much faster also i did one trick in the query
SELECT a.user_id,a.mp_id, COUNT(product_id) product _count
i changed to SELECT a.user_id,a.mp_id, COUNT(1) product _count
to enable it to do FFS
thanks anyways ....

My Ideapad N581 is taking a lot of time to start up ....Can experts help?

My laptop is taking a lot of time to start up.It just shows the Lenovo screen and stops there.What could be the problem?
Thanksin advance.

hi mamuninayak,
The system might be experiencing a boot or a POST issue.
- Remove all USB devices.
- Remove the AC adapter and battery then held down the power button for 15 sec.
Reconnect just the AC and try.
-See if BIOS can be reset.
Start hiting F2 when while powering the system on.
If succesfull in booting into BIOS. Hit F9 the F10
Try Removing the Harddrive and turn the system on, See if there will be any changes.
Hope this helps
Cheers!
Did someone help you today? Press the star on the left to thank them with a Kudo!
If you find a post helpful and it answers your question, please mark it as an "Accepted Solution"! This will help the rest of the Community with similar issues identify the verified solution and benefit from it.
Follow @LenovoForums on Twitter!

My iPad is taking a lot of time to factory reset..What should I do?

Hello,
I am currently factory resetting my iPad , but i forgot to do it using my pc , so I did it without using iTunes , I did it using the option in the iPad's settings but it is taking a lot of time , so far it has been 2 hours ... What should I do if it takes more than 5 hours or so?
Thanks in advance,

hi mamuninayak,
The system might be experiencing a boot or a POST issue.
- Remove all USB devices.
- Remove the AC adapter and battery then held down the power button for 15 sec.
Reconnect just the AC and try.
-See if BIOS can be reset.
Start hiting F2 when while powering the system on.
If succesfull in booting into BIOS. Hit F9 the F10
Try Removing the Harddrive and turn the system on, See if there will be any changes.
Hope this helps
Cheers!
Did someone help you today? Press the star on the left to thank them with a Kudo!
If you find a post helpful and it answers your question, please mark it as an "Accepted Solution"! This will help the rest of the Community with similar issues identify the verified solution and benefit from it.
Follow @LenovoForums on Twitter!

Hello i have a problem that i was making update IOS7 for my i phone 5 it's taking a lot of time about 4 hours till now, i can't use my phone know, it's appere logo i tunes only, can't do eny thing else like shutdown

Hello i have a problem that i was making update IOS7 for my i phone 5 it's taking a lot of time about 4 hours till now, i can't use my phone know, it's appere logo i tunes only, can't do eny thing else like shutdown

Hey Andrew keriakous,
Thanks for the question. It sounds like your iPhone may be in recovery-mode. To resolve this issue, see the following:
If you can't update or restore your iOS device
http://support.apple.com/kb/HT1808
Thanks,
Matt M.

My ipod was disabled and i tried to restore it, now i am downloading an apple software update which is taking a **** lot of time and ipod is still disabled.. will it be ok after the download ends? help please..!!

my ipod was disabled and i tried to restore it, now i am downloading an apple software update which is taking a **** lot of time and ipod is still disabled.. will it be ok after the download ends? help please..!!

We need to know more about your system, please download EtreCheck and run the report and please post it on your next reply. Then we can see how your system is configured, what apps are on it and look for anything obvious. We will look forward to seeing your report.

Expdp is taking a lot of time

hi,
I have a small schema in a database housing lots of users.
The expdp is taking a lot of time for this schema eventhough the old exp takes 1/10 th time.
When i switched on the trace i see its stuck at below on <SID>dw0115741.trc trace file
KUPW: 03:40:41.551: 1: DBMS_LOB.TRIM returned
KUPW: 03:40:41.551: 1: DBMS_METADATA.FETCH_XML_CLOB called
its stuck at
Starting "USER"."USER_JOB": USER/******** dumpfile=USER.dp logfile=USER.log job_name=USER_job parallel=4 exclude=grant,index,trigger,constraint,statistics,index_statistics trace=1FF0300 directory=EXPDP_BKP
Estimate in progress using BLOCKS method...
Processing object type SCHEMA_EXPORT/TABLE/TABLE_DATA
I have replaces the actual username with USER
sga_target 2147483648
sga_max_size 2634022912
streams_pool_size 0
Does any one has any suggestion?
I tried the metalink as well but didnt find anything useful
Thanks
Shipra

Pl post details of OS and database versions
Pl see is MOS Doc 453895.1 (Checklist for Slow Performance of Export Data Pump (expdp) and Import DataPump (impdp)) - "Defects 10/11" - can help
HTH
Srini

Generic Extraction : Taking a lot of time

HI Experts
I have created ZKONV a generic extracter which is a copy of KONV table. It has around 16,00,000 records .When I´m pulling the data in to ODS it is taking a lot of time. it is taking around 5+ hours to load the data. Is there anything wrong with my Datasource why it is taking so much of time.
Kindly provide some inputs
Thanks
NLN

Hi Lakshminarayana
You got to check couple of things.
First goto the source system and see, how long the extract program is running. The long time may be due to poor source system performance or huge processing at the BW system side. If the job in the source system is running for a long time, then check the source system resource. Build proper index on the mentioned table and see whether it has improved the performance. You can ask the basis people for the SQL trace and they let u know what kindof indexes u can build on the tables.
If the processing is taking more time, then u have to imrpove the start/update routine in the BW side. Please let us know, where exactly u have the problem. Then we can think of resolving it.
Sriram

Concurrent request is taking a lots of time to run

Hi,
I have one query regarding ICM.
one of the concurrent request is taking a lots of time to run. How can I solve the issue.
Is there any steps to diagnose this issue?
Please reply.
Regards,
Manish

Hi,
How we can find that particular request are taking long time?See your other thread.
Concurrent request taking long time
Concurrent request taking long time
what is "gather statistrics schema" concurent program and what it does?See (Note: 419728.1 - How To Gather Statistics On Oracle Applications 11.5.10(and above) - Concurrent Process,Temp Tables, Manually).
Regards,
Hussein

Xcelsius with BW Queries taking a lot of time to open/save/publish

I have recently designed my first Dashboard using Xcelsius 2008(5.3.0.0, Build Number 12.3.0.670) connected to BW queries(we are on 7.01 SP 5) using SAP Netweaver BW Connection. While the file size jumped from 3MB(before connecting to BW Queries) to 88 MB (after the connections to BW queries). I have 10 Bex Queries embedded in the Dashboard and every time I'm trying to open the Xcelsius file, it takes a lot of time(as long as 15 minutes) and even if I make a small change and save it, it takes another 15-20 muntes and while Publishing it to BW role it is taking another 15-20 minutes.
I'm sure we are missing something here and thus running it to this issue. Can someone throw some ideas please?

Try installing Fix Pack 3.4 on your XCelsius designer. How many rows do your queries fetch?
Regards,
Stratos
PS: 88 MB is not a normal file size. My experience is that the size of a "healthy" dashboard should be less than 1.5 MB

Transform activity is taking a lot of time

Similar Messages

Maybe you are looking for