Very long time to process big table

Hi everyone,
I have a problem with a process that computes 6 columns of a table with 260 millions of rows. At the begining the compute time was about 1.2 mins per row. wich obviously takes more than a life to finish (about 500 years).
So to improve this process naturally my first step was to partition the table. This make 64 partitions with 5 millions rows in the biggest one. My second step was to use a bulk collect with a limit of 500.000 per block, this way i have my array and next step is to compute my columns. So sadly, my first 2 columns just take 2 hours to complete for the 260 millions (Note: I need to compute all rows in the table), but the rest of columns, take 90% of total time or even more. Finally i make a bulk update with forall using the data computed on my arrays.
After all this, the compute time was reduced of 1.2 mins per row to 6 or 7 seconds per row. time wich is great, but just reduced from 500 years to 49 years.
With this scenary, my next logical step is to parallelize my query's, but if a have a degree of 8, my best shot is to take 6 years.
Now, the problem with four of six columns, is that i need to compute some values that requires make some avg and sum over data from last six months previous to the record.
So, here is my real question. ¿how i make this works?... surely i can not wait a lot of years. perhaps the company is broke before this finish.
Which is the professional way to do this real? i think out there companies have tables with lots more of rows, even billions, i have saw in others forums.
I need this, someway, somehow, this takes no more than one or two months... even less is better yet. PLEASE HELP
My DB is a 11G, running on 64bits. 32GB RAM, 6 CPU Quadcore.

ok, the objective of the process is to take all the data of six years, wich is in one table only. The table is with nologging, parallel degree 8 and partitioning. and we have to update same table (six columns) and it's values are calculated with data of the same table.
Here is the DDL of the table:
create table MV_DATA_SEC
COD_EMPRESA NUMBER(3),
PERIODO VARCHAR2(6),
ID_CLIENTE VARCHAR2(14),
TIPO_CLIENTE VARCHAR2(1),
NOMBRE VARCHAR2(80),
DIRECCION VARCHAR2(100),
NCONTRATO VARCHAR2(14),
ID_TIPO_NUMERO_CONTRATO NUMBER(1),
FCONTRATO DATE,
FTCONTRATO DATE,
ATIPICA VARCHAR2(2),
SECTOR NUMBER(1),
ID_TIPO_TARIFA NUMBER(2),
ID_TIPO_CONSUMO NUMBER(2),
ID_MEDIDOR VARCHAR2(30),
VOLTAJE NUMBER(6),
KWH NUMBER(10),
LANTERIOR NUMBER(8),
LACTUAL NUMBER(8),
CONSTANTE FLOAT,
ENERGIA NUMBER(8),
LINVIERNO NUMBER(8),
EINVIERNO NUMBER(8),
PINVIERNO NUMBER(8),
PPUNTA NUMBER(8),
DPMAXIMA NUMBER(8),
PBASE NUMBER(8),
PVERANO NUMBER(8),
DPMPUNTA NUMBER(8),
DMLPPUNTA NUMBER(8),
EICINTERNAS FLOAT,
EICEXTERNAS FLOAT,
NDOCUMENTO NUMBER(12),
FDOCUMENTO DATE,
FVENCIMIENTO DATE,
CFIJO NUMBER(10),
CENERGIA NUMBER(10),
CEINVIERNO NUMBER(10),
CPINVIERNO NUMBER(10),
CPBASE NUMBER(10),
CPVERANO NUMBER(10),
CPDMAXIMA NUMBER(10),
CDCMAXIMA NUMBER(10),
CDMPUNTA NUMBER(10),
CRFPOTENCIA NUMBER(10),
CRPTRANS NUMBER(10),
CARRIENDO NUMBER(10),
CSERVICIOS NUMBER(10),
SANTERIOR NUMBER(10),
INTERESES NUMBER(10),
DESCUENTO NUMBER(10),
IVA NUMBER(10),
TOTAL NUMBER(10),
FLANTERIOR DATE,
FLACTUAL DATE,
ID_TIPO_DOCUMENTO VARCHAR2(1),
ID_TIPO_COBRO VARCHAR2(1),
SUBPRIMARIA VARCHAR2(40),
FACTURABLE NUMBER,
FACTURABLE2 NUMBER,
COD_MEDIDOR CHAR(30),
T_LECTURA NUMBER(10),
T_ESTACION CHAR(3),
LIM_INVIERNO NUMBER(10),
E_ADIC_INVIERNO NUMBER(10),
VAL_PROV_CALCULADO NUMBER(10),
PROR_CONSUMO NUMBER(10),
POT_BASE NUMBER(10)
partition by list (PERIODO)
partition PERIODO1 values ('072006')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO2 values ('082006')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO3 values ('092006')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO4 values ('102006')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO5 values ('112006')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO6 values ('122006')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO7 values ('012007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO8 values ('022007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO9 values ('032007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO10 values ('042007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO11 values ('052007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO12 values ('062007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO13 values ('072007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO14 values ('082007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO15 values ('092007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO16 values ('102007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO17 values ('112007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO18 values ('122007')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO19 values ('012008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO20 values ('022008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO21 values ('032008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO22 values ('042008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO23 values ('052008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO24 values ('062008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO25 values ('072008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO26 values ('082008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO27 values ('092008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO28 values ('102008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO29 values ('112008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO30 values ('122008')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO31 values ('012009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO32 values ('022009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO33 values ('032009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO34 values ('042009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO35 values ('052009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO36 values ('062009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO37 values ('072009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO38 values ('082009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO39 values ('092009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO40 values ('102009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO41 values ('112009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO42 values ('122009')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO43 values ('012010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO44 values ('022010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO45 values ('032010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO46 values ('042010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO47 values ('052010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO48 values ('062010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO49 values ('072010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO50 values ('082010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO51 values ('092010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO52 values ('102010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO53 values ('112010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO54 values ('122010')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO55 values ('012011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO56 values ('022011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO57 values ('032011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO58 values ('042011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO59 values ('052011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO60 values ('062011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO61 values ('072011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO62 values ('082011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO63 values ('092011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO64 values ('102011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO65 values ('112011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
partition PERIODO66 values ('122011')
tablespace SEC_SFACTURACION_DAT
pctfree 10
initrans 1
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
-- Create/Recreate indexes
create index IDX_DATA_SEC_EMP2 on MV_DATA_SEC (COD_EMPRESA)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_FACT12 on MV_DATA_SEC (FACTURABLE)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_FACT22 on MV_DATA_SEC (FACTURABLE2)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_FDOC2 on MV_DATA_SEC (FDOCUMENTO)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_MEDI on MV_DATA_SEC (ID_MEDIDOR)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 4096M
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_PER2 on MV_DATA_SEC (PERIODO)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_SUBP2 on MV_DATA_SEC (SUBPRIMARIA)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_TCOB2 on MV_DATA_SEC (ID_TIPO_COBRO)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_TDOC2 on MV_DATA_SEC (ID_TIPO_DOCUMENTO)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
create index IDX_DATA_SEC_TTAR2 on MV_DATA_SEC (ID_TIPO_TARIFA)
tablespace SEC_SFACTURACION_IDX
pctfree 10
initrans 2
maxtrans 255
storage
initial 64K
next 1M
minextents 1
maxextents unlimited
So, first i make a bulk collect.
cursor c_baseData is
select t.lactual, t.lanterior, t.energia, t.rowid, t.periodo, t.t_lectura, t.t_estacion,
t.lim_invierno, t.e_adic_invierno, t.val_prov_calculado, t.pror_consumo, t.pot_base,
t.cod_empresa, t.id_cliente, t.flactual, t.id_medidor, t.facturable, t.id_tipo_cobro,
t.flanterior, t.id_tipo_tarifa
from mv_data_sec t
where id_tipo_documento in ('B','F');
fetch c_baseData bulk collect
into v_lactual, v_lanterior, v_energia, v_rowid, v_periodo, v_lectura, v_estacion,
v_avg_verano_ins, v_ea_invierno_ins, v_val_provisorio, v_Ecalendario, v_potencia_base,
v_cod_empresa, v_id_cliente, v_flactual, v_id_medidor, v_facturable, v_id_tipo_cobro,
v_flanterior, v_id_tipo_tarifa limit 500000;
exit when c_baseData%NOTFOUND;
And i start a LOOP, because i have to process each row. Inside the loop i have to calculate the values for the six columns. We have 2 escenarios.
First one (This one, have no problem, because is calculated with data of the same row and therefore the execution time is lower than a fraction of second);
v_lectura(idx) := case when ((v_lactual(idx)<>v_lanterior(idx)) and v_energia(idx)>0) then 1 else 0 end;
v_estacion(idx) := case when (substr( v_periodo(idx), 1,2) in ('04', '05','06','07','08','09')) then 'I' else 'V' end;
Second One (This take about 1.5 second and the other 3 values takes about same time);
select nvl(avg(facturable),0), max(flactual), max(flanterior), max(lactual), max(lanterior)
into v_facturable_ant, v_flactual_ant, v_flanterior_ant, v_lactual_ant, v_lanterior_ant
from mv_data_sec
where periodo <> v_periodo(idx)
and cod_empresa = v_cod_empresa(idx)
and id_cliente = v_id_cliente(idx)
and id_medidor = v_id_medidor_consulta
and flactual = (select max(flactual)
from mv_data_sec
where cod_empresa = v_cod_empresa(idx)
and id_cliente = id_cliente
and id_medidor = v_id_medidor_consulta
and periodo <> v_periodo(idx)
and flactual < v_flactual(idx));
if ((v_flactual(idx) = v_flanterior(idx)) and (v_flactual_ant <> v_flanterior_ant)) then
v_Ecalendario(idx) := ((v_facturable_ant / (v_flactual_ant - v_flanterior_ant)) * (extract (day from last_day (v_flactual_ant)) - extract (day from (v_flactual_ant))));
end if;
if ((v_flactual_ant = v_flanterior_ant) and (v_flactual(idx) <> v_flanterior(idx))) then
v_Ecalendario(idx) := ((v_facturable(idx)/ (v_flactual(idx) - v_flanterior(idx))) * (extract (day from (v_flactual(idx)))));
end if;
if ((v_flactual(idx) <> v_flanterior(idx)) and (v_flactual_ant <> v_flanterior_ant)) then
v_Ecalendario(idx) := ((v_facturable(idx)/ (v_flactual(idx) - v_flanterior(idx))) * (extract (day from (v_flactual(idx) )))) + ((v_facturable_ant / (v_flactual_ant - v_flanterior_ant)) * (extract (day from last_day (v_flactual_ant)) - extract (day from (v_flactual_ant))));
end if;
And finally the bulk update (time is depreciable), for example the first 2 columns.
forall r in v_rowid.FIRST .. v_rowid.LAST
update mv_data_sec c
set c.t_lectura = v_lectura(r),
c.t_estacion = v_estacion(r)
where c.rowid = v_rowid(r);

Similar Messages

IMovie taking a very long time to process anything, even open

I have 2.66ghz MacBook Pro 4GB of RAM. I figured this computer should have no problem processing and opening programs. However, when I open iMovie, it hangs for a very long time, sometimes 5 minutes. At first I thought it was just crashing but I let it go for a while and it eventually started working.
Anyone else having this issue? Is this program really so demanding that a $3000 laptop struggles to open it? Is there any fix to this?

No clue why the final processes have suddenly started to take so long. Two things I'd try: a) capture from an older tape to see if some problem with the new tape is at fault. And b) check the health of your RAM and the hard drive.
The red frame sounds a bit like a glitch we used to have in OnLocation (actually in its predecessor HDV Rack) which was caused by a partial GOP. But that was a product of HDV Rack recording from the live video stream. It turned out that HDV cameras intentionally interrupt the data stream for an instant upon starting to record--specifically to avoid recording a partial GOP to tape. So my gut says that the tape has partial GOPs at the points where you stopped/started recording.

Quicktimes taking very long time to load-Big Q appears instead.

When posting ipod (small) quicktimes to my .mac account (4 per page), the site is taking a really long time to load-a large Q appears instead of the usual Quicktime video frame for a few minutes. They eventually load, but it takes a long time. I've used this program and these files for a year without incident, and now there is this huge delay for my clients. The files aren't very big 2MB-20MB.
Maybe it's my Safari or Firefox acting up?
Here's the site if anyone is able to have a quick look and tell me if it loads quickly on their machine:
http://web.mac.com/chopperfilms/iWeb/Steve%20Gaskin/Projects%201.html
Any thoughts would be greatly appreciated. Thanks so much.

To wait for 27MB to load is too big or rather long wait for your audience/visitor. Set poster frames for all and use movie ref to load only the one the visitor chooses so they don't get the letter 'Q' and use 'fast start' so loading long or big files feels like less waiting. Were poster frames and movie refs getting done automatically by iWeb before?
I am actually getting the letter 'Q' with a question mark in it 60/40 percent of the time in a QuickTime I posted which I am trying to figure how to get rid of.

Background process taking very long time to complete.

Dear All,
Platform: HP UX
Version: 12.0.6
While time of shutting down the instance below background process taking very long time to complete.
what is below mention process? can i kill it? total 3 process i am getting while finding ps -ef|grep applpre(applepre is apps instance's owner)
applpre/apps/tech_st/10.1.3/appsutil/jdk/bin/IA64N/java -DCLIENT_PROCESSID=5457 -server -Xmx384m -XX:+UseSerialGC -Dor
Thanks in Advance,
Sandeep.

Sandeep,
Please see (Note: 567551.1 - Configuring various JVM tuning parameters for Oracle E-Business suite 11i and R12).
You can safely kill those processes from the OS.
Thanks,
Hussein

Query takes very long time and analyze table hangs

Hi
One of the oracle query taking very long time (ie more than a day) and affecting business requirment of getting the report in time.
I tried to analyze the table with compute statistics option, however it hangs/runs forever on one of the huge table?
Please let me know how to troubleshoot this issue

Hi,
What's your Oracle version?
You should use DBMS_STATS package not ANALYZE..
Regards,

CV04N takes long time to process select query on DRAT table

Hello Team,
While using CV04N to display DIR's, it takes long time to process select query on DRAT table. This query includes all the key fields. Any idea as to how to analyse this?
Thanks and best regards,
Bobby
Moderator message: please read the sticky threads of this forum, there is a lot of information on what you can do.
Edited by: Thomas Zloch on Feb 24, 2012

Be aware that XP takes approx 1gb of your RAM leaving you with 1gb for whatever else is running. MS Outlook is also a memory hog.
To check Virtual Memory Settings:
Control Panel -> System
System Properties -> Advanced Tab -> Performance Settings
Performance Options -> Adavanced Tab - Virtual Memory section
Virtual Memory -
what are
* Initial Size
* Maximum Size
In a presentation at one of the Hyperion conferences years ago, Mark Ostroff suggested that the initial be set to the same as Max. (Max is typically 2x physical RAM)
These changes may provide some improvement.

Why UPD processes execute report RSM13000 for very long time?

Hi,
When I use sm50 or sm51 to check my CRM system which version is 5.0, I found some UPD processes execute report RSM13000 for very long time. And some DIA processes are executing report SAPMSSY1 for verly long time too. They are occupy lot of processes of system. How does this happen? What's the reason and how to solve it? Thanks for your help!
Many thanks and Best regards,
Long

Please check the configurtion of your system.As per your reply it seems that the work processes are not sufficient in the system.
Hi wait time and response time ,is problem in the system.Either you have a lot of load on the system or you CPU's are over loaded.
Please check the system status from st06 and look for the cpu utilisation /memory utilisation.
SM66 to see the long running online and background jobs.
St03n - look for the workload and wait times for all transactions.
st02-may help in checking the memory paramaetrs.
Hope it will help you in resolving the issue.
Thanks
Amit

TDMS Shell - DB Export from source/sender system taking a VERY long time

We're trying to build a TDMS Receiver system using the TDMS Shell technique. We've run into a situation wherein the initial DB Export from source/sender system is taking a VERY long time.
We are on ECC 6.0, running on AIX 6.1 and DB UDB v9.7. We're executing the DB export from sapinst, per instructions. Our DB export parallelizes, then the parallel processes one by one whittle away to just one remaining, and there we find out that the export is at that point single-threaded, and exporting table BSIS.
BSIS is an FI transactional data table. We're wondering why is the DB export trying to get BSIS and its contents out??? Isn't the DB export in TDMS Shell technique only supposed to get SAP essential only config and master data, and NOT transactional data?
Our BSIS table is nearly 700 GB in size by itself. That export has been running for nearly a week now, with no end in site.
What are we doing wrong? We suspect we may have missed something, but really don't think we do. We also suspect that the EXCLUSION table in the TDMS Shell technique may be the KEY to this whole thing. It's supposed to automatically exclude very large tables, but in this case, it most certainly missed out in excluding BSIS for some reason.
Anyway, we're probably going to fire up an OSS Message with SAP Support to help us address this perplexing issue. Just thought we'd throw it out there to the board to see if anyone else somewhere has run into similar circumstances and challenges. In the meantime, any feedback and/or advice would be dearly appreciated. Cheers,

Hello
Dont be bothered by the other TPL file DDLDB6_LRG.TPL, we are only concerned with DDLDB6.TPl.
Answer following questions to help me analyze the situation -
1) What is the current size of export dump
2) Since when is the exports running
3) What is the size of the source DB? Do you have huge amount of custom developments?
4) Did you try to use table splitting?
5) Do you doubt that there may be other transaction tables (like BSIS) which have been exported completely?
6) Did you update the SAP Kernel of your source system to latest version before starting the Shell package?
7) Were the DB statistics update during the shell or were they already updated before starting Shell?
8) Is your system a distributed system i.e. Central instance and Database instance are on different application servers?

Query taking very long time

DB 11.2.0.3.4
Server HP-UX IA 11.31
One big query is taking very long time. I am giving the explain plan along with stats from tkprof. If needed will give the query also. Can sombody tell me how can we improve this.
call     count       cpu    elapsed       disk      query    current        rows
Parse        1     23.26      23.90          0         20          0           0
Execute      1   8055.11    9453.52     684215     348696   18750740     1306001
Fetch        0      0.00       0.00          0          0          0           0
total        2   8078.37    9477.42     684215     348716   18750740     1306001
Misses in library cache during parse: 1
Optimizer mode: ALL_ROWS
Parsing user id: 322 (EDW_DM)   (recursive depth: 1)
Rows     Row Source Operation
      0 LOAD TABLE CONVENTIONAL (cr=352254 pr=684215 pw=682074 time=863655932 us)
1306001   PX COORDINATOR (cr=15823 pr=682074 pw=682074 time=499947892 us)
      0    PX SEND QC (RANDOM) :TQ20004 (cr=0 pr=0 pw=0 time=0 us cost=276195 size=126736955032 card=9998182)
      0     BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0      VIEW VW_FCT_PLN_SUMM_ADL_WK_XARH317 (cr=0 pr=0 pw=0 time=0 us cost=276195 size=126736955032 card=9998182)
      0       UNION-ALL (cr=0 pr=0 pw=0 time=0 us)
      0        SORT GROUP BY (cr=0 pr=0 pw=0 time=0 us cost=9167 size=95469948 card=378849)
      0         PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=9167 size=95469948 card=378849)
      0          PX SEND HASH :TQ20003 (cr=0 pr=0 pw=0 time=0 us cost=9167 size=95469948 card=378849)
      0           SORT GROUP BY (cr=0 pr=0 pw=0 time=0 us cost=9167 size=95469948 card=378849)
      0            HASH JOIN RIGHT SEMI (cr=0 pr=0 pw=0 time=0 us cost=2714 size=95469948 card=378849)
      0             BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0              PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=26 size=16428 card=4107)
      0               PX SEND BROADCAST :TQ20000 (cr=0 pr=0 pw=0 time=0 us cost=26 size=16428 card=4107)
   4857                VIEW VW_SQ_1 (cr=47 pr=0 pw=0 time=25403 us cost=26 size=16428 card=4107)
   4857                 HASH JOIN (cr=47 pr=0 pw=0 time=23353 us cost=26 size=229992 card=4107)
   1115                  TABLE ACCESS FULL DMN_PROD (cr=11 pr=0 pw=0 time=863 us cost=6 size=13380 card=1115)
   4873                  HASH JOIN (cr=36 pr=0 pw=0 time=12991 us cost=20 size=180840 card=4110)
     55                   TABLE ACCESS FULL DMN_MKT_DEFN (cr=3 pr=0 pw=0 time=286 us cost=4 size=1980 card=55)
18235                   TABLE ACCESS FULL FCT_MKT_PROD_BRDG (cr=33 pr=0 pw=0 time=13550 us cost=15 size=145880 card=18235)
      0             HASH JOIN (cr=0 pr=0 pw=0 time=0 us cost=2686 size=93954552 card=378849)
      0              BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0               PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=111 size=403328 card=8768)
      0                PX SEND BROADCAST :TQ20001 (cr=0 pr=0 pw=0 time=0 us cost=111 size=403328 card=8768)
   8768                 NESTED LOOPS (cr=274 pr=0 pw=0 time=15077 us cost=111 size=403328 card=8768)
      1                  NESTED LOOPS (cr=5 pr=0 pw=0 time=203 us cost=5 size=28 card=1)
      1                   TABLE ACCESS FULL DMN_WK_END (cr=2 pr=0 pw=0 time=81 us cost=3 size=8 card=1)
      1                   TABLE ACCESS BY INDEX ROWID DMN_CALN (cr=3 pr=0 pw=0 time=110 us cost=2 size=20 card=1)
      1                    INDEX RANGE SCAN XNU1_DMN_CALN (cr=2 pr=0 pw=0 time=73 us cost=1 size=0 card=1)(object id 303867)
   8768                  TABLE ACCESS FULL DMN_CALN (cr=269 pr=0 pw=0 time=11719 us cost=106 size=157824 card=8768)
      0              PX BLOCK ITERATOR PARTITION: KEY KEY (cr=0 pr=0 pw=0 time=0 us cost=2573 size=76527498 card=378849)
      0               TABLE ACCESS FULL FCT_NONRET_SLS_CURR_TRANS_WKLY PARTITION: 32 32 (cr=0 pr=0 pw=0 time=0 us cost=2573 size=76527498 card=378849)
      0        BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0         PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=267028 size=2741509905 card=9619333)
      0          PX SEND ROUND-ROBIN :TQ20002 (cr=0 pr=0 pw=0 time=0 us cost=267028 size=2741509905 card=9619333)
1284599           SORT GROUP BY (cr=15497 pr=682074 pw=682074 time=3839060439 us cost=267028 size=2741509905 card=9619333)
6439189            FILTER (cr=15486 pr=0 pw=0 time=57890179 us)
8986531             PX COORDINATOR (cr=279 pr=0 pw=0 time=52453034 us)
      0              PX SEND QC (RANDOM) :TQ10001 (cr=0 pr=0 pw=0 time=0 us cost=80940 size=2741509905 card=9619333)
      0               HASH JOIN (cr=0 pr=0 pw=0 time=0 us cost=80940 size=2741509905 card=9619333)
      0                BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0                 PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=111 size=403328 card=8768)
      0                  PX SEND BROADCAST :TQ10000 (cr=0 pr=0 pw=0 time=0 us cost=111 size=403328 card=8768)
   8768                   NESTED LOOPS (cr=274 pr=0 pw=0 time=14462 us cost=111 size=403328 card=8768)
      1                    NESTED LOOPS (cr=5 pr=0 pw=0 time=345 us cost=5 size=28 card=1)
      1                     TABLE ACCESS FULL DMN_WK_END (cr=2 pr=0 pw=0 time=193 us cost=3 size=8 card=1)
      1                     TABLE ACCESS BY INDEX ROWID DMN_CALN (cr=3 pr=0 pw=0 time=136 us cost=2 size=20 card=1)
      1                      INDEX RANGE SCAN XNU1_DMN_CALN (cr=2 pr=0 pw=0 time=76 us cost=1 size=0 card=1)(object id 303867)
   8768                    TABLE ACCESS FULL DMN_CALN (cr=269 pr=0 pw=0 time=9447 us cost=106 size=157824 card=8768)
      0                PX BLOCK ITERATOR PARTITION: KEY KEY (cr=0 pr=0 pw=0 time=0 us cost=80801 size=2299020587 card=9619333)
      0                 TABLE ACCESS FULL FCT_PLN_RET_SLS_CURR_WKLY PARTITION: 30 30 (cr=0 pr=0 pw=0 time=0 us cost=80801 size=2299020587 card=9619333)
    834             NESTED LOOPS (cr=15207 pr=0 pw=0 time=990747 us)
   2269              NESTED LOOPS (cr=12938 pr=0 pw=0 time=1090852 us cost=17 size=56 card=1)
   2269               NESTED LOOPS (cr=12101 pr=0 pw=0 time=1065238 us cost=16 size=20 card=1)
    834                TABLE ACCESS BY INDEX ROWID DMN_PROD (cr=1676 pr=0 pw=0 time=37175 us cost=1 size=12 card=1)
    838                 INDEX UNIQUE SCAN XPKDIMENSION_PRODUCT (cr=838 pr=0 pw=0 time=23645 us cost=0 size=0 card=1)(object id 303870)
   2269                TABLE ACCESS FULL FCT_MKT_PROD_BRDG (cr=10425 pr=0 pw=0 time=1024973 us cost=15 size=8 card=1)
   2269               INDEX UNIQUE SCAN SYS_C0040182 (cr=837 pr=0 pw=0 time=15842 us cost=0 size=0 card=1)(object id 301873)
    834              TABLE ACCESS BY INDEX ROWID DMN_MKT_DEFN (cr=2269 pr=0 pw=0 time=16488 us cost=1 size=36 card=1)
It would be appreciated if somebody check this.
Regards,
Virendra

Below is with the index on one of the table:
call     count       cpu    elapsed       disk      query    current        rows
Parse        1     49.33      49.61          0         16          0           0
Execute      1   8374.08   10745.82     953712     473861   18818854     1306001
Fetch        0      0.00       0.00          0          0          0           0
total        2   8423.41   10795.43     953712     473877   18818854     1306001
Misses in library cache during parse: 1
Optimizer mode: ALL_ROWS
Parsing user id: 322     (recursive depth: 1)
Rows     Row Source Operation
      0 LOAD TABLE CONVENTIONAL (cr=481416 pr=953712 pw=917687 time=2156047932 us)
1306001   PX COORDINATOR (cr=131828 pr=917687 pw=917687 time=1528317728 us)
      0    PX SEND QC (RANDOM) :TQ10004 (cr=0 pr=0 pw=0 time=0 us cost=144212 size=16362383616 card=1290816)
      0     BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0      VIEW VW_FCT_PLN_SUM_ADL_WK_XRH317_1 (cr=0 pr=0 pw=0 time=0 us cost=144212 size=16362383616 card=1290816)
      0       UNION-ALL (cr=0 pr=0 pw=0 time=0 us)
      0        SORT GROUP BY (cr=0 pr=0 pw=0 time=0 us cost=9568 size=101394468 card=402359)
      0         PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=9568 size=101394468 card=402359)
      0          PX SEND HASH :TQ10003 (cr=0 pr=0 pw=0 time=0 us cost=9568 size=101394468 card=402359)
      0           SORT GROUP BY (cr=0 pr=0 pw=0 time=0 us cost=9568 size=101394468 card=402359)
      0            HASH JOIN RIGHT SEMI (cr=0 pr=0 pw=0 time=0 us cost=2714 size=101394468 card=402359)
      0             BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0              PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=26 size=16428 card=4107)
      0               PX SEND BROADCAST :TQ10000 (cr=0 pr=0 pw=0 time=0 us cost=26 size=16428 card=4107)
   4857                VIEW VW_SQ_1 (cr=47 pr=0 pw=0 time=25732 us cost=26 size=16428 card=4107)
   4857                 HASH JOIN (cr=47 pr=0 pw=0 time=23041 us cost=26 size=229992 card=4107)
   1115                  TABLE ACCESS FULL DMN_PROD (cr=11 pr=0 pw=0 time=1040 us cost=6 size=13380 card=1115)
   4873                  HASH JOIN (cr=36 pr=0 pw=0 time=12797 us cost=20 size=180840 card=4110)
     55                   TABLE ACCESS FULL DMN_MKT_DEFN (cr=3 pr=0 pw=0 time=185 us cost=4 size=1980 card=55)
18235                   TABLE ACCESS FULL FCT_MKT_PROD_BRDG (cr=33 pr=0 pw=0 time=10014 us cost=15 size=145880 card=18235)
      0             HASH JOIN (cr=0 pr=0 pw=0 time=0 us cost=2686 size=99785032 card=402359)
      0              BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0               PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=111 size=403328 card=8768)
      0                PX SEND BROADCAST :TQ10001 (cr=0 pr=0 pw=0 time=0 us cost=111 size=403328 card=8768)
   8768                 NESTED LOOPS (cr=274 pr=0 pw=0 time=13429 us cost=111 size=403328 card=8768)
      1                  NESTED LOOPS (cr=5 pr=0 pw=0 time=206 us cost=5 size=28 card=1)
      1                   TABLE ACCESS FULL DMN_WK_END (cr=2 pr=0 pw=0 time=82 us cost=3 size=8 card=1)
      1                   TABLE ACCESS BY INDEX ROWID DMN_CALN (cr=3 pr=0 pw=0 time=111 us cost=2 size=20 card=1)
      1                    INDEX RANGE SCAN XNU1_DMN_CALN (cr=2 pr=0 pw=0 time=80 us cost=1 size=0 card=1)(object id 303867)
   8768                  TABLE ACCESS FULL DMN_CALN (cr=269 pr=0 pw=0 time=9306 us cost=106 size=157824 card=8768)
      0              PX BLOCK ITERATOR PARTITION: KEY KEY (cr=0 pr=0 pw=0 time=0 us cost=2573 size=81276518 card=402359)
      0               TABLE ACCESS FULL FCT_NONRET_SLS_CURR_TRANS_WKLY PARTITION: 32 32 (cr=0 pr=0 pw=0 time=0 us cost=2573 size=81276518 card=402359)
      0        BUFFER SORT (cr=0 pr=0 pw=0 time=0 us)
      0         PX RECEIVE (cr=0 pr=0 pw=0 time=0 us cost=134645 size=256764073 card=888457)
      0          PX SEND ROUND-ROBIN :TQ10002 (cr=0 pr=0 pw=0 time=0 us cost=134645 size=256764073 card=888457)
1284599           HASH GROUP BY (cr=131502 pr=917687 pw=917687 time=1052831032 us cost=134645 size=256764073 card=888457)
6439189            HASH JOIN RIGHT SEMI (cr=131490 pr=138092 pw=138092 time=374140098 us cost=100193 size=256764073 card=888457)
   4857             VIEW VW_SQ_2 (cr=47 pr=0 pw=0 time=22869 us cost=26 size=16428 card=4107)
   4857              HASH JOIN (cr=47 pr=0 pw=0 time=21073 us cost=26 size=229992 card=4107)
   1115               TABLE ACCESS FULL DMN_PROD (cr=11 pr=0 pw=0 time=687 us cost=6 size=13380 card=1115)
   4873               HASH JOIN (cr=36 pr=0 pw=0 time=12522 us cost=20 size=180840 card=4110)
     55                TABLE ACCESS FULL DMN_MKT_DEFN (cr=3 pr=0 pw=0 time=242 us cost=4 size=1980 card=55)
18235                TABLE ACCESS FULL FCT_MKT_PROD_BRDG (cr=33 pr=0 pw=0 time=9883 us cost=15 size=145880 card=18235)
8986531             HASH JOIN (cr=131443 pr=138092 pw=138092 time=402921160 us cost=100161 size=253210245 card=888457)
   8768              TABLE ACCESS FULL DMN_CALN (cr=269 pr=0 pw=0 time=11228 us cost=106 size=157824 card=8768)
8986531              MERGE JOIN CARTESIAN (cr=131174 pr=138092 pw=138092 time=382931385 us cost=100049 size=237218019 card=888457)
      1               NESTED LOOPS (cr=5 pr=0 pw=0 time=251 us)
      1                NESTED LOOPS (cr=4 pr=0 pw=0 time=225 us cost=5 size=28 card=1)
      1                 TABLE ACCESS FULL DMN_WK_END (cr=2 pr=0 pw=0 time=127 us cost=3 size=8 card=1)
      1                 INDEX RANGE SCAN XNU1_DMN_CALN (cr=2 pr=0 pw=0 time=88 us cost=1 size=0 card=1)(object id 303867)
      1                TABLE ACCESS BY INDEX ROWID DMN_CALN (cr=1 pr=0 pw=0 time=17 us cost=2 size=20 card=1)
8986531               BUFFER SORT (cr=131169 pr=138092 pw=138092 time=378126634 us cost=100047 size=212341223 card=888457)
8986531                TABLE ACCESS BY GLOBAL INDEX ROWID FCT_PLN_RET_SLS_CURR_WKLY PARTITION: 30 30 (cr=131157 pr=0 pw=0 time=144384133 us cost=100044 size=212341223 card=888457)
9066976                 INDEX RANGE SCAN SUBSTR_FCT_RET_SLS_CUR_WLY (cr=84385 pr=0 pw=0 time=93762049 us cost=83615 size=0 card=2856894)(object id 311617)
Elapsed times include waiting on following events:
Event waited on                             Times   Max. Wait Total Waited
----------------------------------------   Waited ---------- ------------
os thread startup                               2        0.08          0.15
PX Deq: Join ACK                                4        0.00          0.00
PX Deq Credit: send blkd                      455        2.21         55.10
PX Deq: Parse Reply                             4        0.01          0.01
PX Deq: Execute Reply                      250046      247.89        439.12
asynch descriptor resize                        9        0.00          0.00
PX Deq Credit: need buffer                    549        1.54         15.84
PX qref latch                                 235        0.01          0.18
Disk file operations I/O                       42        0.00          0.00
direct path write temp                      62665        0.25        365.50
direct path read temp                       99442        0.46       1024.89
db file sequential read                     36025        0.15        186.86
latch: object queue header operation           17        0.00          0.00
latch free                                      2        0.00          0.00
log file switch (private strand flush incomplete)
                                                  1        0.07          0.07
latch: messages                                 1        0.00          0.00
log file switch completion                     14        0.08          0.79
latch: cache buffers chains                     2        0.00          0.00
latch: redo allocation                          1        0.00          0.00
PX Deq: Signal ACK RSG                          4        0.06          0.07
PX Deq: Signal ACK EXT                          4        0.00          0.01
PX Deq: Slave Session Stats                     4        0.00          0.00
enq: PS - contention                            1        0.00          0.00

ODI Planning metadata load takes very long time

Hi,
I am using ODI for Hyperion Planning metadata load.
We are facing performance issues, as the process is taking a very long time.
The process uses "LKM File to SQL" and "IKM SQL to Hyperion Planning"
The number of rows to process in the file is around 70000. The file is generated from DRM. The ODI integration process takes around 2 hours to process and load the file to Planning. Even if we add 1 new row to the file and everything else remains same in the file, the process takes that long.
So, the whole process takes around 3 hours to load to Planning for all dimensions.
I tried increasing the fetch rows to 200 in source but there is no significant increase in performance. The Heap size is set to maximum of 285 MB in odiparams.bat.
How can the performance be improved?
Can I use different LKM or change any other setting?
Thanks,
RS

Hi John,
In my current implementation, the dimension hierarchies are maintained in DRM.
So, business directly makes changes in DRM and exports the hierarchies in a text file.
I agree that loading 70000 records is odd on regular basis, but it makes it easier for business to retain control of their hierarchies and maintainance is easy in DRM.
On bulk loading to DB table and loading to Planning, I have 2 questions:
1. Do you think that "LKM SQL to SQL" [Oracle to Planning] will have significant improvement in performance over "LKM File to SQL" [File to Planning], as we are still using "Sunopsis Memory engine" as staging area?
2. I checked your blog, there you have suggested using "Sunopsis memory engine" for "LKM SQL to SQL".
Is it mandatory to use "Sunopsis emory engine" as staging area, can we use any other user defined staging area [Oracle tables]?
Cheers,
RS

Why is it that it would take a very long time [if ever] to change or adjust the tempo of a loop in the audio track when i set it to adjust regions to locators? Until now the spinning wheel of death is still very much spinning. thanks for any help. Is th

Why is it that it would take a very long time [if ever] to change or adjust the tempo of a loop in the audio track when i set it to adjust regions to locators? Until now the spinning wheel of death is still very much spinning. thanks for any help.
Is there another way to adjust tempo of loops the faster way, any other technique?

No clue why the final processes have suddenly started to take so long. Two things I'd try: a) capture from an older tape to see if some problem with the new tape is at fault. And b) check the health of your RAM and the hard drive.
The red frame sounds a bit like a glitch we used to have in OnLocation (actually in its predecessor HDV Rack) which was caused by a partial GOP. But that was a product of HDV Rack recording from the live video stream. It turned out that HDV cameras intentionally interrupt the data stream for an instant upon starting to record--specifically to avoid recording a partial GOP to tape. So my gut says that the tape has partial GOPs at the points where you stopped/started recording.

Remote client copy (SCC9) runs a very long time!

remote client copy (SCC9) runs a very long time!
how to do it quickly process?
(eg use imp and exp-oracle tool, as it can be done to understand what the SAP data has been copied and are now in a different location, for Developers)

scn001 wrote:
remote client copy (SCC9) runs a very long time!
> how to do it quickly process?
> (eg use imp and exp-oracle tool, as it can be done to understand what the SAP data has been copied and are now in a different location, for Developers)
Hi,
You can export the client, as well but it will take long time too, depended to your client size. Please note that client copy operation should be performed by standard SAP client management tools, such as client export/import or remote copy.
Ask this question to SAP support first. Technically, you can choose many ways to copy a SAP client, but as far as I know that SAP will not support you (such as errors you faced during the client export/import or the problems related by the copy operation), if you use any other 3rd party tool while for the client copy purposes.
Best regards,
Orkun Gedik
Edited by: Orkun Gedik on Jun 30, 2011 10:57 AM

Firefox takes very long time to open and often crashes for some websites

i have used firefox 3.6 with windows xp, vista and now windows 7. there is same problem i am facing at all after well usage of week. firefox takes very long time to open approx. 1 minute at first click. after refreshing computer when i click again, it becomes ready to use but meanwhile you re working firefox opens in another window perhaps for the first click. what is this please? i have reinstalled firefox but it is not fixing problem
== Troubleshooting information ==
how can firefox be ready for use at first click?

Open Activity Monitor and kill this process - rapportd.
Reinstalling OS X Without Erasing the Drive
Boot to the Recovery HD: Restart the computer and after the chime press and hold down the COMMAND and R keys until the menu screen appears. Alternatively, restart the computer and after the chime press and hold down the OPTION key until the boot manager screen appears. Select the Recovery HD and click on the downward pointing arrow button.
Reinstalling OS X Without Erasing the Drive
Repair the Hard Drive and Permissions: Upon startup select Disk Utility from the main menu. Repair the Hard Drive and Permissions as follows.
When the recovery menu appears select Disk Utility and press the Continue button. After Disk Utility loads select the Macintosh HD entry from the the left side list. Click on the First Aid tab, then click on the Repair Disk button. If Disk Utility reports any errors that have been fixed, then re-run Repair Disk until no errors are reported. If no errors are reported click on the Repair Permissions button. Wait until the operation completes, then quit Disk Utility and return to the main menu.
Reinstall OS X: Select Reinstall OS X and click on the Continue button.
Note: You will need an active Internet connection. I suggest using Ethernet if possible because it is three times faster than wireless.
Alternatively, see:
Reinstall OS X Without Erasing the Drive
Choose the version you have installed now:
OS X Yosemite- Reinstall OS X
OS X Mavericks- Reinstall OS X
OS X Mountain Lion- Reinstall OS X
OS X Lion- Reinstall Mac OS X
Note: You will need an active Internet connection. I suggest using Ethernet
if possible because it is three times faster than wireless.

Report script taking very long time to export in ASO

Hi All,
My report script is taking very long time to execute and finally a message appears as timed out.
I'm working on ASO Cubes and there are 14 dimensions for which i need to export all data for all the dimensions for only one version.
The data is very huge and the member count in each dimension is also huge, so which is making me difficult to export the data.
Any suggestions??
Thanks

Here is a link that addresses several ways to optimize your report script. I utilize report scripts for Level 0 exports in an ASO environment as well, however the majority of our dimemsions are attribute dimensions.
These are the most effective solutions we have implemented to improve our exports via report scripts:
1. Make sure your report script is written in the order of how the Report Extractor retrieves data.
2. Supressing Zero and Missing Data
3. We use the LINK command within reports for some dimensions that are really big and pull at Level 0
4. Using Symmetric reports.
5. Breakout the exports in multiple reports.
However, you may also consider some additional solutions outlined in this link:
1. The MDX optimizing commands
2. Back end system settings
http://download.oracle.com/docs/cd/E12825_01/epm.111/esb_dbag/drpoptim.htm
I hope this helps. Maybe posting your report script would also help users to provide feedback.
Thanks
Edited by: ronnie on Jul 14, 2011 9:25 AM
Edited by: ronnie on Jul 14, 2011 9:53 AM

Messages are taking a very long time to send.

Hello, I'm currently having a big problem with messages taking a very long time to actually send. The spinning wheel will stay there for hours. It only happens in one or two skype groups at a time where I can send messages normally in other groups. Does anyone have any idea how I can fix this?

I have been having this problem for the last 4 releases. I have had some take up to 8 hours to send before. I can usually fix it by signing out then restarting skype. Just restarting skype doesn't work, nor does just signing in again.

Very long time to process big table

Similar Messages

Maybe you are looking for