Ordimage performances big issue, please help

Question

Hi, we are developing a visual retrieval application based on Intermedia.
The Database is Oracle 10g (10.1.0.4)
The Database is a RAC(Real Application Cluster) running on 2 Servers
The storage is a 2TB SAN
Each server is a quad-CPU (Itanium 2, 3GHz) with 8GB of ram each, the OS is Windows 2003 Server 64-bit Edition
one table of the db contains the ordimagesignature objects, we created a tablespace for the table itself and 2 other tablespace, one for the ordsignature filter and one for the ordsignature index.
This is the creation script for the index:
CREATE INDEX APP_IMG_SIGNIDX ON APP_IMG
(SIGNATURE)
INDEXTYPE IS ORDSYS.ORDIMAGEINDEX
PARAMETERS('ORDImage_Filter_Tablespace=TPC00F,ORDImage_Index_Tablespace= TPC00I');
TPC00F and TPC00I are 1GB each.
the tablespaces TPC00F and TPC00I are stored in the SAN and are dedicated only to ordimage data.
The table contains almost 300K rows.
Running a query like this (and no other activities on the server):
SELECT a.id_img, ORDSYS.imgscore (123)
FROM app_img a, app_img b
WHERE ORDSYS.imgsimilar (a.signature, b.signature, 'color="0.20" texture="0.80"', 5, 123) = 1
AND b.id_img = 2377165
ORDER BY ORDSYS.imgscore (123) ASC;
Can take from 3 to 7 minutes, depending on the ordimage parameters I choose.
This is obviously an unacceptable time for the hardware we have. Monitoring the performances of the machine during the execution of the query, shows that the CPU is almost idle while the IO queue is almost at 90% for all the running time of the query. We also tried altering the table with the command:
alter table app_img parallel (Degree 8);
but the execution time is the same.
ANY help would be very well accepted, thank you in advance.
Best Regards, Stefano

Answer 1

Have You still problem with the performance ?
I'm facing the same performance problems, i'm just testing a small amount of images from a big database. I have loaded (only) 5500 images into table, and generated signatures for them.
i have created a ORDSYS.ORDImageIndex on the signature, and analyzed that to.
After loaded > 2000 images the performance going down, and with (only) 5500 images
i get time on queries with IMGSimilar between 20 - 30 sec. . . .
ps, the total amount of images in the database is over 5 millions, bu tonly 5500 in table img_ordimage (so far)...
Oracle version : 10g Enterprise Edition Release 10.1.0.4.0 - 64bit Production
OS : SunOS storea 5.9 Generic_118558-30 sun4u sparc SUNW,Sun-Fire-V210
the, output from tkprof:
oracle@storea 10:24 ~/admin/storedb/udump >cat tkprof.out
TKPROF: Release 10.1.0.4.0 - Production on Fri Aug 24 10:24:12 2007
Copyright (c) 1982, 2004, Oracle. All rights reserved.
Trace file: storedb_ora_27804.trc
Sort options: default
count = number of times OCI procedure was executed
cpu = cpu time in seconds executing
elapsed = elapsed time in seconds executing
disk = number of physical reads of buffers from disk
query = number of buffers gotten for consistent read
current = number of buffers gotten in current mode (usually for update)
rows = number of rows processed by the fetch or execute call
alter session set sql_trace true
call count cpu elapsed disk query current rows
Parse 0 0.00 0.00 0 0 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 0 0.00 0.00 0 0 0 0
total 1 0.00 0.00 0 0 0 0
Misses in library cache during parse: 0
Optimizer mode: ALL_ROWS
Parsing user id: 58
select metadata
from
kopm$ where name='DB_FDO'
call count cpu elapsed disk query current rows
Parse 1 0.00 0.00 0 0 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 1 0.00 0.00 0 2 0 1
total 3 0.00 0.00 0 2 0 1
Misses in library cache during parse: 0
Optimizer mode: CHOOSE
Parsing user id: SYS (recursive depth: 1)
Rows Row Source Operation
1 TABLE ACCESS BY INDEX ROWID KOPM$ (cr=2 pr=0 pw=0 time=136 us)
1 INDEX UNIQUE SCAN I_KOPM1 (cr=1 pr=0 pw=0 time=67 us)(object id 350)
select u.name, o.name, a.interface_version#
from
association$ a, user$ u, obj$ o where a.obj# = :1
and a.property = :2
and a.statstype# = o.obj# and
u.user# = o.owner#
call count cpu elapsed disk query current rows
Parse 5 0.00 0.00 0 0 0 0
Execute 5 0.00 0.00 0 0 0 0
Fetch 5 0.00 0.00 0 20 0 1
total 15 0.00 0.00 0 20 0 1
Misses in library cache during parse: 0
Optimizer mode: CHOOSE
Parsing user id: SYS (recursive depth: 1)
Rows Row Source Operation
0 NESTED LOOPS (cr=3 pr=0 pw=0 time=689 us)
0 NESTED LOOPS (cr=3 pr=0 pw=0 time=649 us)
0 TABLE ACCESS FULL ASSOCIATION$ (cr=3 pr=0 pw=0 time=645 us)
0 TABLE ACCESS BY INDEX ROWID OBJ$ (cr=0 pr=0 pw=0 time=0 us)
0 INDEX UNIQUE SCAN I_OBJ1 (cr=0 pr=0 pw=0 time=0 us)(object id 36)
0 TABLE ACCESS CLUSTER USER$ (cr=0 pr=0 pw=0 time=0 us)
0 INDEX UNIQUE SCAN I_USER# (cr=0 pr=0 pw=0 time=0 us)(object id 11)
select a.default_cpu_cost, a.default_io_cost
from
association$ a where a.obj# = :1
and a.property = :2
call count cpu elapsed disk query current rows
Parse 3 0.00 0.00 0 0 0 0
Execute 3 0.00 0.00 0 0 0 0
Fetch 3 0.00 0.00 0 9 0 0
total 9 0.00 0.00 0 9 0 0
Misses in library cache during parse: 0
Optimizer mode: CHOOSE
Parsing user id: SYS (recursive depth: 1)
Rows Row Source Operation
0 TABLE ACCESS FULL ASSOCIATION$ (cr=3 pr=0 pw=0 time=633 us)
select a.default_selectivity
from
association$ a where a.obj# = :1
and a.property = :2
call count cpu elapsed disk query current rows
Parse 1 0.00 0.00 0 0 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 1 0.00 0.00 0 3 0 0
total 3 0.00 0.00 0 3 0 0
Misses in library cache during parse: 0
Optimizer mode: CHOOSE
Parsing user id: SYS (recursive depth: 1)
Rows Row Source Operation
0 TABLE ACCESS FULL ASSOCIATION$ (cr=3 pr=0 pw=0 time=2021 us)
declare
cost sys.ODCICost := sys.ODCICost(NULL, NULL, NULL, NULL);
obj1 "ORDSYS"."ORDIMAGESIGNATURE" := "ORDSYS"."ORDIMAGESIGNATURE"(NULL);
obj2 "ORDSYS"."ORDIMAGESIGNATURE" := "ORDSYS"."ORDIMAGESIGNATURE"(NULL);
begin
:1 := "ORDSYS"."ORDIMAGEINDEXSTATS".ODCIStatsIndexCost(
sys.ODCIINDEXINFO('STORE',
'IMGORDINDEX2',
sys.ODCICOLINFOLIST(sys.ODCICOLINFO('STORE', 'IMG_ORDIMAGE', '"SIGN"', 'ORDIMAGESIGNATURE', 'ORDSYS', NULL)),
NULL,
0,
0),
NULL,
cost,
sys.ODCIQUERYINFO(2,
sys.ODCIOBJECTLIST(sys.ODCIOBJECT('IMGSCORE', 'ORDSYS'))),
sys.ODCIPREDINFO('ORDSYS',
'IMGSIMILAR',
NULL,
141),
sys.ODCIARGDESCLIST(sys.ODCIARGDESC(3, NULL, NULL, NULL, NULL, NULL, NULL), sys.ODCIARGDESC(3, NULL, NULL, NULL, NULL, NULL, NULL), sys.ODCIARGDESC(2, 'IMG_ORDIMAGE', 'STORE', '"SIGN"', NULL, NULL, NULL), sys.ODCIARGDESC(2, 'IMG_ORDIMAGE', 'STORE', '"SIGN"', NULL, NULL, NULL), sys.ODCIARGDESC(3, NULL, NULL, NULL, NULL, NULL, NULL), sys.ODCIARGDESC(3, NULL, NULL, NULL, NULL, NULL, NULL)),
:6,
:7
, obj2, :8, :9,
sys.ODCIENV(:10,:11,:12,:13));
if cost.CPUCost IS NULL then
:2 := -1;
else
:2 := cost.CPUCost;
end if;
if cost.IOCost IS NULL then
:3 := -1;
else
:3 := cost.IOCost;
end if;
if cost.NetworkCost IS NULL then
:4 := -1;
else
:4 := cost.NetworkCost;
end if;
:5 := cost.IndexCostInfo;
exception
when others then
raise;
end;
call count cpu elapsed disk query current rows
Parse 1 0.01 0.01 0 0 0 0
Execute 0 0.00 0.00 0 0 0 0
Fetch 0 0.00 0.00 0 0 0 0
total 1 0.01 0.01 0 0 0 0
Misses in library cache during parse: 1
Optimizer mode: ALL_ROWS
Parsing user id: 58 (recursive depth: 1)
SELECT IMG_CD.image_id ,ORDSYS.IMGScore(123) score
FROM IMG_CD ,img_ordimage Q, img_ordimage S
WHERE Q.image_id = 11992231 AND
ORDSYS.IMGSimilar(S.sign,Q.sign,' color="0,83",shape="0,17",location="0,26"',20,123)=1
AND S.image_id = img_cd.image_id order by score
call count cpu elapsed disk query current rows
Parse 1 0.18 0.38 0 702 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 30 11.42 19.61 2568 4049 2217 432
total 32 11.60 19.99 2568 4751 2217 432
Misses in library cache during parse: 1
Optimizer mode: ALL_ROWS
Parsing user id: 58
Rows Row Source Operation
432 SORT ORDER BY (cr=11107 pr=2568 pw=0 time=21310948 us)
432 NESTED LOOPS (cr=11107 pr=2568 pw=0 time=21156098 us)
432 NESTED LOOPS (cr=10241 pr=2568 pw=0 time=21141805 us)
1 TABLE ACCESS BY INDEX ROWID IMG_ORDIMAGE (cr=4 pr=0 pw=0 time=220 us)
1 INDEX UNIQUE SCAN IMGORDIDXID (cr=2 pr=0 pw=0 time=63 us)(object id 200937)
432 TABLE ACCESS BY INDEX ROWID IMG_ORDIMAGE (cr=10237 pr=2568 pw=0 time=21140720 us)
432 DOMAIN INDEX IMGORDINDEX2 (cr=9848 pr=2568 pw=0 time=21125137 us)
432 INDEX UNIQUE SCAN IMG_CD_PK (cr=866 pr=0 pw=0 time=11411 us)(object id 48686)
select T."SIGN".signature,T.rowid
from
STORE.IMG_ORDIMAGE T where T.rowid in (select P.orig_rowid from
STORE.IMGORDINDEX2_FT$ P WHERE A1 BETWEEN 0 AND 100 AND A2 BETWEEN 0
AND 100 AND A3 BETWEEN 0 AND 100 AND A4 BETWEEN 0 AND 100 AND A5
BETWEEN 0 AND 100 AND A6 BETWEEN 0 AND 100 AND A7 BETWEEN 0 AND 100
AND A8 BETWEEN 0 AND 100 AND A9 BETWEEN 0 AND 100 AND A10 BETWEEN 0 AND
100 AND A11 BETWEEN 0 AND 100 AND A12 BETWEEN 0 AND 100 AND A13
BETWEEN 0 AND 100 AND A14 BETWEEN 0 AND 100 AND A15 BETWEEN 0 AND 100
AND A16 BETWEEN 0 AND 100 AND A17 BETWEEN 0 AND 100 AND A18 BETWEEN 0
AND 100 AND A19 BETWEEN 0 AND 100 AND A24 BETWEEN 0 AND 100 AND A25
BETWEEN 0 AND 100 AND A26 BETWEEN 0 AND 100 AND A27 BETWEEN 0 AND 100
AND A28 BETWEEN 0 AND 100 AND A29 BETWEEN 0 AND 100 AND A30 BETWEEN 0
AND 100 AND A31 BETWEEN 0 AND 100 AND A32 BETWEEN 0 AND 100 AND A33
BETWEEN 0 AND 100 AND A34 BETWEEN 0 AND 100 AND A35 BETWEEN 0 AND 100
AND A36 BETWEEN 0 AND 100 AND A37 BETWEEN 0 AND 100 AND A38 BETWEEN 0
AND 100 AND A39 BETWEEN 0 AND 100 AND A40 BETWEEN 0 AND 100 AND A41
BETWEEN 0 AND 100 AND A42 BETWEEN 0 AND 100 AND A43 BETWEEN 0 AND 100
AND A44 BETWEEN 0 AND 100 AND A45 BETWEEN 0 AND 100 AND A46 BETWEEN 0
AND 100 AND A47 BETWEEN 0 AND 100 AND A48 BETWEEN 0 AND 100 AND A49
BETWEEN 0 AND 100 AND A50 BETWEEN 0 AND 100 AND A51 BETWEEN 0 AND 100
AND A52 BETWEEN 0 AND 100 AND A53 BETWEEN 0 AND 100 AND A54 BETWEEN 0
AND 100 AND A55 BETWEEN 0 AND 100 AND A56 BETWEEN 0 AND 100 AND A57
BETWEEN 0 AND 100 AND A58 BETWEEN 0 AND 100 AND A59 BETWEEN 0 AND 100
AND A60 BETWEEN 0 AND 100 AND A61 BETWEEN 0 AND 100 AND A62 BETWEEN 0
AND 100 AND A63 BETWEEN 0 AND 100 )
call count cpu elapsed disk query current rows
Parse 1 0.00 0.00 0 0 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 5290 0.64 1.69 0 7058 0 5289
total 5292 0.64 1.70 0 7058 0 5289
Misses in library cache during parse: 0
Optimizer mode: ALL_ROWS
Parsing user id: 58 (recursive depth: 1)
alter session set sql_trace false
call count cpu elapsed disk query current rows
Parse 1 0.00 0.00 0 0 0 0
Execute 1 0.00 0.00 0 0 0 0
Fetch 0 0.00 0.00 0 0 0 0
total 2 0.00 0.00 0 0 0 0
Misses in library cache during parse: 0
Optimizer mode: ALL_ROWS
Parsing user id: 58
OVERALL TOTALS FOR ALL NON-RECURSIVE STATEMENTS
call count cpu elapsed disk query current rows
Parse 2 0.18 0.38 0 702 0 0
Execute 3 0.00 0.00 0 0 0 0
Fetch 30 11.42 19.61 2568 4049 2217 432
total 35 11.60 19.99 2568 4751 2217 432
Misses in library cache during parse: 1
OVERALL TOTALS FOR ALL RECURSIVE STATEMENTS
call count cpu elapsed disk query current rows
Parse 12 0.01 0.01 0 0 0 0
Execute 11 0.00 0.00 0 0 0 0
Fetch 5300 0.64 1.70 0 7092 0 5291
total 5323 0.65 1.72 0 7092 0 5291
Misses in library cache during parse: 1
5 user SQL statements in session.
10 internal SQL statements in session.
15 SQL statements in session.
Trace file: storedb_ora_27804.trc
Trace file compatibility: 10.01.00
Sort options: default
1 session in tracefile.
5 user SQL statements in trace file.
10 internal SQL statements in trace file.
15 SQL statements in trace file.
9 unique SQL statements in trace file.
5535 lines in trace file.
34 elapsed seconds in trace file.
oracle@storea 10:24 ~/admin/storedb/udump >
Message was edited by:
user591430