Multi-threaded transactions for performance reasons
Hi,
I need to be able to perform a number (20 - 30) reads and updates from \ to
a huge (500 million records) Oracle database within the same transaction
context within a set time limit. In order to meet the time limit I suspect I
may need to perform a lot of the SQL operations in parallel. I'm using
weblogic version 7 and Oracle 8.1.7 on hardware with a huge number of CPUs..
a) Ideally I would like to do this using the standard EJB bean components
but can't think of a possible way of doing it. Is there any way to do this
while executing within the scope of an EJB container?
b) Assuming the answer to a is no, could I do it by invoking an RMI server
which could then set up a UserTransaction in a controlling thread and start
a number of SQL slave threads (hopefully inheriting the parent threads
transaction context). The controlling thread could then wait for the slave
threads to finish before commiting. Hopefully though the slave threads would
get the chance to perform a setRollbackOnly if anything went wrong.
c) It the answer to b above is yes would there be any problem invoking the
RMI server from within a session bean. For example would the transaction
context of the session bean affect the behaviour of the RMI server and is it
legal to create threads in the RMI server even though it is invoked from a
session bean?
Thanks for any help in advance.
Chris.
Oracle doesn't want you using threads in the Java Stored Procedures in the
database. If you read on a bit further in the Oracle doc, you come to this
passage at :
http://otn.oracle.com/docs/products/oracle9i/doc_library/release2/java.920/a96659/01_intro.htm#21254
<quote>
As a database server, Oracle9i efficiently schedules work for thousands of
users. The Oracle JVM uses the facilities of the RDBMS server to concurrently
schedule Java execution for thousands of users. Although Oracle9i supports Java
language level threads required by the Java Language Specification (JLS) and
Java Compatibility Kit (JCK), using threads within the scope of the database
will not increase your scalability. Using the embedded scalability of the
database eliminates the need for writing multithreaded Java servers. You should
use the database's facilities for scheduling users by writing single-threaded
Java applications. The database will take care of the scheduling between each
application; thus, you achieve scalability without having to manage threads. You
can still write multithreaded Java applications, but multiple Java threads will
not increase your server's performance.
</quote>
So, YMMV if you spawn your own threads in the Oracle JVM.
Bill
Gordon Twaddell wrote:
Chris,
I'm not sure this fits your problem, but you may investigate
writing a Oracle stored procedure in java. I believe its possible
to use threading inside that procedure to perform your concurrent reads /
updates.
I haven't done this personally and I forsee many hurdles (just brain
storming).
From the Oracle 8.1.6 Docs
"The JServer JVM provides a run-time environment for Java objects. It fully
supports Java data structures, method dispatch, exception handling, and
language-level threads. It also supports all the core Java class libraries
including java.lang, java.io, java.net, java.math, and java.util"
Something else to consider is Message Driven Beans (although this would
violate your same transaction context requirement) and combining the results
would be challenging.
Any of your WLS side solutions are going to be problematic, because I
believe that
there is a JDBC restriction that a transaction can only have one outstanding
SQL call.
You might get around this on the DB side by managing a pool of
sub-transactions in a stored procedure
and have your managing thread commit or rollback all sub-transactions.
Any possiblity of doing some SQL magic and combining several reads into one
or setting up a View to do this for you?
Gordon
"Chris" <[email protected]> wrote in message
news:[email protected]...
Hi,
I need to be able to perform a number (20 - 30) reads and updates from \to
a huge (500 million records) Oracle database within the same transaction
context within a set time limit. In order to meet the time limit I suspectI
may need to perform a lot of the SQL operations in parallel. I'm using
weblogic version 7 and Oracle 8.1.7 on hardware with a huge number ofCPUs..
a) Ideally I would like to do this using the standard EJB bean components
but can't think of a possible way of doing it. Is there any way to do this
while executing within the scope of an EJB container?
b) Assuming the answer to a is no, could I do it by invoking an RMIserver
which could then set up a UserTransaction in a controlling thread andstart
a number of SQL slave threads (hopefully inheriting the parent threads
transaction context). The controlling thread could then wait for the slave
threads to finish before commiting. Hopefully though the slave threadswould
get the chance to perform a setRollbackOnly if anything went wrong.
c) It the answer to b above is yes would there be any problem invoking the
RMI server from within a session bean. For example would the transaction
context of the session bean affect the behaviour of the RMI server and isit
legal to create threads in the RMI server even though it is invoked from a
session bean?
Thanks for any help in advance.
Chris.
Similar Messages
-
Question using Java API in a multi threaded application for MDX queries
Currently I’m building a web application that makes a lot of MDX calls using the Essbase Java API. Each time we run an MDX call we basically run the following code:
IEssbase ess = IEssbase.Home.create(IEssbase.JAPI_VERSION);
IEssDomain dom = ess.signOn(userName, password, false, null, "embedded");
IEssCubeView cv = cv=dom.openCubeView("view", hostName, appName, cubeName);
IEssOpMdxQuery op = cv.createIEssOpMdxQuery();
op.setQuery(false,mdx,false,IEssOpMdxQuery.EEssMemberIdentifierType.NAME);
cv.performOperation(op);
IEssMdDataSet mddata = cv.getMdDataSet();
cv.close();
My questions is, is this the correct way to use the API in multi threaded environment where many users may be hitting the application at the same time? For every request do I need to create a separate IEssbase object and sign on to an IEssDomain? Or can I use a single IEssbase and IEssDomain object for the entire application? If not should I call the IEssDomain.signOff() method after each user’s request has completed? Which of the above objects are thread safe? I’m using Essabae 9.3.1. Any insight would be really appreciated.
Thanks
DavidThanks for the input friend,
I should have mentioned that in my application all
connections to Essbase use the same user name and
password so the filtering isn’t a concern. This is my
first Java application using Essbase has a data
source, I’m used to connecting to various SQL
databases and I always use a connection pool, how is
connection pooling handled in the Essbase java API?I'm not sure what happened to it since I never used it, but there used to be something called the High Availability Services or something that was essentially a connection pool for Essbase JAPI connections, but it required an extra license.
Since you don't care about identity (everyone has full access to everything), you can create your own connection pool, but you'll have to manage your multithreading yourself. Its been this way since the beginning. The C API isn't/wasn't thread-safe either (we tried). -
Need help in fixing the query for performance reasons
hi
I have a view in which I am calling a function to return some values I wand to get rid of the function and want to some how do all in the sql. Can I use case or something similar that will help me in avoiding the use of this function. Any help in this regard will highly be appreciated.
Query
SELECT SUBSTR(f_type_px17(ap.cidn,ap.currentstatusoid, 'DESC'), 1, 255)
from
px17_appointment ap,
/*context co_ap,*/
px17_payrollagreement pa,
px17_payrollgroup pg;
FUNCTION
CREATE OR REPLACE FUNCTION f_type_px17
fv_cidn IN px17_type_client.cidn%TYPE,
fv_oid IN px17_type_client.oid%TYPE,
fv_col IN VARCHAR2 DEFAULT NULL
) RETURN VARCHAR2 AUTHID CURRENT_USER AS
v_rtn_name px17_type_client.name%TYPE := NULL ;
v_rtn_desc px17_type_client.description%TYPE := NULL ;
BEGIN
IF fv_oid IS NOT NULL THEN
BEGIN
IF UPPER(SUBSTR(fv_oid,1,3)) = 'SYS' THEN
SELECT name, description
INTO v_rtn_name, v_rtn_desc
FROM px17_sys_type
WHERE oid = fv_oid
AND ROWNUM = 1 ;
ELSE
SELECT name, description
INTO v_rtn_name, v_rtn_desc
FROM px17_type_client
WHERE oid = fv_oid
AND cidn = fv_cidn
AND ROWNUM = 1 ;
END IF ;
EXCEPTION
WHEN no_data_found THEN
v_rtn_name := NULL ;
v_rtn_desc := NULL ;
END ;
END IF ;
IF (UPPER(NVL(fv_col, '~')) = 'NAME') THEN
RETURN v_rtn_name ;
ELSIF ((UPPER(NVL(fv_col, '~')) = 'DESC')
OR (UPPER(NVL(fv_col, '~')) = 'DESCRIPTION')) THEN
RETURN v_rtn_desc ;
ELSE
RETURN (NVL(v_rtn_name, CHR(155)) || '~' || NVL(v_rtn_desc, CHR(155))) ;
END IF ;
END f_type_px17 ;
/Well following is the whole code of a view and the functions releated, This will give you the whole picture and this query is running for long time.
create or replace view PX17_CHK_VW_SUMMARY_VW
(CIDN,BATCH_NUMBER, BUSINESS_UNIT, CHECK_VOUCHER_NUMBER, CHECK_VOUCHER_CODE, CHECKVIEW_CLOCK_NUMBER,
COMPANY_CHECKVIEW_HOME_DEPT, PERIOD_END_DATE, FEDERAL_TAX, GROSS_PAY, HOME_DEPARTMENT,
HOME_DEPARTMENT_DESC, LIVED_LOCAL_TAX_CODE, LIVED_STATE_TAX_CODE, LIVED_LOCAL_TAX, LIVED_STATE_TAX,
MEDICARE_TAX, NET_PAY, DEPARTMENT_WORKED_IN, PAY_TO_COMPANY_INDICATOR, PAY_DATE,
PAYROLL_NUMBER, SCHOOL_DISTRICT_TAX, CHECKVIEW_SCHOOL_DISTRICT, SOCIAL_SECURITY_TAX, SUI_SDI_TAX,
SUI_SDI_TAX_CODE, VOID_CHECK_INDICATOR, WEEK_NUMBER, WORKED_LOCAL_TAX_CODE, WORKED_STATE_TAX_CODE,
WORKED_LOCAL_TAX, WORKED_STATE_TAX, YEAR, COMPANY_CODE, FILE_NUMBER,
FIRST_NAME, LAST_NAME, LAST_NAME_FIRST_NAME, SOCIAL_SECURITY_NUMBER, STATUS,
OVERTIME_EARNINGS, OVERTIME_HOURS, REGULAR_EARNINGS, REGULAR_HOURS, VIEWPK,
HOME_COST_NUMBER, TAX_FREQUENCY, COMPANY_COST_NUMBER, COST_NUMBER_WORKED_IN, DISTRIBUTION_NUMBER,
TOTAL_DEDUCTIONS_AMOUNT, TOTAL_HOURS_AMOUNT, TOTAL_MEMO_AMOUNT, TOTAL_OTHER_EARNINGS, TOTAL_OTHER_HOURS,
CHECK_SEQ_NO, JOINKEY, CHECK_REVERSAL_INDICATOR
as
with user_security_homedept
AS
(select /*+ INLINE */ distinct cg.cidn,co_code,asso.oid,asso.name,department_Access ,t2.column_value dep,cg.oid
from px17_cocodegroup cg ,
px17_associate asso ,
px17_securityobject so,
px17_cocodegrp_securitygrp cs,
px17_security_group sg ,
TABLE(f_str2tbl_px17(cg.department_access)) t2
where cg.USEROID = asso.OID
and cg.co_code = substr(so.name,8,3)
and upper(asso.name) = upper(sys_context('payx_r17_app_context', 'app_userid'))
and cg.oid = cs.cocodegroupoid
and cs.securitygroupoid = sg.oid
and cg.cidn = asso.cidn
and cg.cidn = so.cidn
and cg.cidn = cs.cidn
and cs.cidn = sg.cidn
order by 2,1
user_security_cost_no
AS
(select /*+ INLINE */
cg.cidn,co_code,count(distinct cd.code)cost_no,cd.code
from px17_cocodegroup cg ,
px17_associate asso ,
px17_securityobject so,
px17_cocodegrp_securitygrp cs,
px17_security_group sg ,
px17_customaccessdetail cd
where cg.USEROID = asso.OID
and cg.co_code = substr(so.name,8,3)
and upper(asso.name) = upper(sys_context('payx_r17_app_context', 'app_userid'))
and cg.oid = cs.cocodegroupoid
and cs.securitygroupoid = sg.oid
and cg.oid = cd.cocodegroupoid(+)
and cg.cidn = cd.cidn(+)
and cg.cidn = asso.cidn
and cg.cidn = so.cidn
and cg.cidn = cs.cidn
and cs.cidn = sg.cidn
group by cg.cidn,co_code,cd.code
order by 2,1
super_user_check as
(SELECT
distinct a.cidn su_cidn,1 as su_user
FROM
px17_LINK LN
, px17_userprofile up
, px17_ASSOCIATE a
, px17_pcp_user pu
WHERE
a.oid = pu.oid
AND pu.userprofileoid = up.oid
AND LN.parentoid = up.oid
AND a.active = 1
AND a.cidn=pu.cidn
AND pu.cidn=up.cidn
AND ln.cidn=up.cidn
AND upper(a.name) = upper(sys_context('payx_r17_app_context', 'app_userid'))
AND upper(up.name) = upper('Super user')
nonsuper_user_check as
SELECT distinct a.cidn s_cidn , 1 as non_user
FROM
px17_LINK LN
, px17_userprofile up
, px17_ASSOCIATE a
, px17_pcp_user pu
WHERE
a.oid = pu.oid
AND pu.userprofileoid = up.oid
AND LN.parentoid = up.oid
AND a.active = 1
AND a.cidn=pu.cidn
AND pu.cidn=up.cidn
AND ln.cidn=up.cidn
AND upper(a.name) = upper(sys_context('payx_r17_app_context', 'app_userid'))
AND LN.childoid IN ( 'SYS:5:7478')
SELECT distinct
cidn
,batch_number Batch_Number
, business_unit Business_Unit
, check_voucher_number Check_Voucher_Number
, check_voucher_code Check_Voucher_Code
, clock_number CheckView_Clock_Number
, company_code_or_dept Company_CheckView_Home_Dept
, period_end_date Period_End_Date
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, 1, (INSTR(taxes_and_rates, '~', 1, 1) -1)), CHR(155), NULL)) Federal_Tax
, gross_pay Gross_Pay
, home_department Home_Department
, home_department_descr Home_Department_Desc
, SUBSTR(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 1) +1)
, INSTR(taxes_and_rates, '~', 1, 2) - (INSTR(taxes_and_rates, '~', 1, 1) +1)), CHR(155), NULL), 1, 32) Lived_Local_Tax_Code
, SUBSTR(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 2) +1)
, INSTR(taxes_and_rates, '~', 1, 3) - (INSTR(taxes_and_rates, '~', 1, 2) +1)), CHR(155), NULL), 1, 32) Lived_State_Tax_Code
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 3) +1)
, INSTR(taxes_and_rates, '~', 1, 4) - (INSTR(taxes_and_rates, '~', 1, 3) +1)), CHR(155), NULL)) Lived_Local_Tax
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 4) +1)
, INSTR(taxes_and_rates, '~', 1, 5) - (INSTR(taxes_and_rates, '~', 1, 4) +1)), CHR(155), NULL)) Lived_State_Tax
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 5) +1)
, INSTR(taxes_and_rates, '~', 1, 6) - (INSTR(taxes_and_rates, '~', 1, 5) +1)), CHR(155), NULL)) Medicare_Tax
, net_pay Net_Pay
, department_paid Department_Worked_In
, to_pay_indicator Pay_to_Company_Indicator
, pay_date Pay_Date
, payroll_number Payroll_Number
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 6) +1)
, INSTR(taxes_and_rates, '~', 1, 7) - (INSTR(taxes_and_rates, '~', 1, 6) +1)), CHR(155), NULL)) School_District_Tax
, SUBSTR(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 7) +1)
, INSTR(taxes_and_rates, '~', 1, 8) - (INSTR(taxes_and_rates, '~', 1, 7) +1)), CHR(155), NULL), 1, 32) CheckView_School_District
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 8) +1)
, INSTR(taxes_and_rates, '~', 1, 9) - (INSTR(taxes_and_rates, '~', 1, 8) +1)), CHR(155), NULL)) Social_Security_Tax
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 9) +1)
, INSTR(taxes_and_rates, '~', 1, 10) - (INSTR(taxes_and_rates, '~', 1, 9) +1)), CHR(155), NULL)) SUI_SDI_Tax
, SUBSTR(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 10) +1)
, INSTR(taxes_and_rates, '~', 1, 11) - (INSTR(taxes_and_rates, '~', 1, 10) +1)), CHR(155), NULL), 1, 32) SUI_SDI_Tax_Code
, void_check_indicator Void_Check_Indicator
, week_number Week_Number
, SUBSTR(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 11) +1)
, INSTR(taxes_and_rates, '~', 1, 12) - (INSTR(taxes_and_rates, '~', 1, 11) +1)), CHR(155), NULL), 1, 32) Worked_Local_Tax_Code
, SUBSTR(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 12) +1)
, INSTR(taxes_and_rates, '~', 1, 13) - (INSTR(taxes_and_rates, '~', 1, 12) +1)), CHR(155), NULL), 1, 32) Worked_State_Tax_Code
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 13) +1)
, INSTR(taxes_and_rates, '~', 1, 14) - (INSTR(taxes_and_rates, '~', 1, 13) +1)), CHR(155), NULL)) Worked_Local_Tax
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 14) +1)
, INSTR(taxes_and_rates, '~', 1, 15) - (INSTR(taxes_and_rates, '~', 1, 14) +1)), CHR(155), NULL)) Worked_State_Tax
, year Year
, company_code Company_Code
, file_number File_Number
, first_name First_Name
, last_name Last_Name
, name Last_Name_First_Name
, ssn Social_Security_Number
, status Status
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 15) +1)
, INSTR(taxes_and_rates, '~', 1, 16) - (INSTR(taxes_and_rates, '~', 1, 15) +1)), CHR(155), NULL)) Overtime_Earnings
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 16) +1)
, INSTR(taxes_and_rates, '~', 1, 17) - (INSTR(taxes_and_rates, '~', 1, 16) +1)), CHR(155), NULL)) Overtime_Hours
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 17) +1)
, INSTR(taxes_and_rates, '~', 1, 18) - (INSTR(taxes_and_rates, '~', 1, 17) +1)), CHR(155), NULL)) Regular_Earnings
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 18) +1)
, INSTR(taxes_and_rates, '~', 1, 19) - (INSTR(taxes_and_rates, '~', 1, 18) +1)), CHR(155), NULL)) Regular_Hours
, (company_code || '/' || ssn || '/' || file_number || '/' || TO_CHAR(payroll_number) || '/'
|| TO_CHAR(year) || '/' || TO_CHAR(week_number) || '/' || check_voucher_number
|| '/' || to_char(check_seq_num) || '/' || TO_CHAR(distribution_number)) Viewpk
, home_costnumber_desc Home_Cost_Number
, tax_frequency Tax_Frequency
, co_chkv_home_cost_no Company_Cost_Number
, cost_no_worked_in Cost_Number_Worked_In
, distribution_number Distribution_Number
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 19) +1)
, INSTR(taxes_and_rates, '~', 1, 20) - (INSTR(taxes_and_rates, '~', 1, 19) +1)), CHR(155), NULL)) Total_Deductions_Amount
, NVL(TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 20) +1)
, INSTR(taxes_and_rates, '~', 1, 21) - (INSTR(taxes_and_rates, '~', 1, 20) +1)), CHR(155), NULL)), 0) Total_Hours_Amount
, NVL(TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 21) +1)
, INSTR(taxes_and_rates, '~', 1, 22) - (INSTR(taxes_and_rates, '~', 1, 21) +1)), CHR(155), NULL)), 0) Total_Memo_Amount
, NVL(TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 22) +1)
, INSTR(taxes_and_rates, '~', 1, 23) - (INSTR(taxes_and_rates, '~', 1, 22) +1)), CHR(155), NULL)), 0) Total_Other_Earnings
, TO_NUMBER(REPLACE(SUBSTR(taxes_and_rates, (INSTR(taxes_and_rates, '~', 1, 23) +1)), CHR(155), NULL)) Total_Other_Hours
, check_seq_num Check_Seq_No
, (NVL(company_code, '~') || CHR(155) || NVL(file_number, '~') || CHR(155) || NVL(ssn, '~') || CHR(155) || NVL(TO_CHAR(year), '~') || CHR(155)
|| NVL(TO_CHAR(week_number), '~') || CHR(155) || NVL(TO_CHAR(payroll_number), '~')
|| CHR(155) || NVL(check_voucher_number, '~') || CHR(155) || NVL(TO_CHAR(check_seq_num), '~') || CHR(155) || NVL(TO_CHAR(distribution_number), '~')) Joinkey
, chk_reverse Check_Reversal_Indicator
FROM
SELECT
ch.cidn cidn
/*BATCH NUMBER*/
, ch.batch_nb batch_number
, /*BUSINESS UNIT*/
(select asso.description
from px17_appointment ap,
px17_jobposition jp,
px17_corporation co,
px17_associate asso,
px17_payrollagreement pa,
px17_payrollgroup pg
where
ch.cidn = pg.cidn
AND ch.cidn = pa.cidn
AND pa.cidn = pg.cidn
AND pa.cidn = ap.cidn
AND em.cidn = ap.cidn
AND ap.cidn = jp.cidn
and jp.cidn = co.cidn
and co.cidn = asso.cidn
and ch.co_code=pg.co_code
and ch.file_nb=pa.file_number
and pa.cocodeoid=pg.oid
and pa.appointmentoid=ap.oid
and em.oid=ap.employmentoid
and ap.jobpositionoid=jp.oid
and jp.corporationoid=co.oid
and co.oid=asso.oid) business_unit
, /*CHECK/VOUCHER NUMBER*/
ch.check_nb check_voucher_number
, /*CHECK/VOUCHER CODE*/
SUBSTR(f_type_px17(ch.cidn,ch.chkvchcodeoid, 'NAME'), 1, 255) check_voucher_code
, /*CLOCK NUMBER*/
ch.clock_id clock_number
, /* COMPANY CODE OR DEPT*/
ch.co_code||'/'||substr(ch.home_dept_code,1,20) company_code_or_dept
, /*PERIOD END DATE*/
ch.payroll_ending_date period_end_date
, /*GROSS PAY*/
NVL(chd.gross_pay_amt,0) gross_pay
, /*HOME DEPARTMENT*/
ch.home_dept_code home_department
, /*HOME DEPARTMENT DESCRIPTION*/
(select ty.description
from px17_type ty,px17_securityobject sc
where
ch.cidn = sc.cidn
and ty.cidn in ('COMMON', ch.cidn)
and ch.home_dept_code=ty.name
and ty.category='T_CO_DEPT'
and ty.securityoid=sc.oid
and ch.co_code=substr(sc.name,8)) home_department_descr
, /*NET PAY*/
nvl(chd.net_pay_amt,0) net_pay
, /*DEPARTMENT PAID*/
-- ch.paid_in_debt_code department_paid
chd.worked_in_dept department_paid
, /*TO PAY INDICATOR*/
decode(to_char(ch.pay_to_co),'1','Y','0','N',to_char(ch.pay_to_co)) to_pay_indicator
, /*PAY DATE*/
ch.pay_date pay_date
, /*PAYROLL NUMBER*/
to_char(ch.payroll_nb) payroll_number
, /*VOID CHECK INDICATOR*/
decode(to_char(ch.void_flag),'1','Y','0','N',to_char(ch.void_flag)) void_check_indicator
, /*WEEK NUMBER*/
TO_number(ch.week) week_number
, /*YEAR*/
to_char(ch.year) year
, /*COMPANY CODE*/
ch.co_code company_code
, /*FILE NUMBER*/
LPAD(ch.file_nb,6,0) file_number
, /*FIRST NAME*/
pe.first_name first_name
, /*LAST NAME*/
pe.last_name last_name
, /*NAME*/
pe.last_name||', '||pe.first_name name
, /*SSN*/
payx_r17_principal_info.masked_ssn(pe.unique_id, ch.cidn) ssn
, /*STATUS*/
(SELECT SUBSTR(f_type_px17(ap.cidn,ap.currentstatusoid, 'DESC'), 1, 255)
from
px17_appointment ap,
/*context co_ap,*/
px17_payrollagreement pa,
px17_payrollgroup pg
where
pg.cidn=ch.cidn
and pa.cidn=ch.cidn
and ap.cidn=pa.cidn
and ap.cidn = em.cidn
and ap.employmentoid=em.oid
and ap.active=1
and ap.oid=pa.appointmentoid
and lpad(to_char(pa.file_number),6,0)=ch.file_nb
and pa.cocodeoid=pg.oid
and pg.co_code=ch.co_code) status
-- FED TAX
-- , LIVED LOCAL TAX CODE, LIVED STATE TAX CODE, LIVED LOCAL TAX, LIVED STATE TAX, MEDICARE TAX
-- , SCHOOL DISTRICT TAX, SCHOOL DISTRICT, SOCIAL SECURITY TAX, SUI SDI TAX, SUI SDI TAX CODE
-- , WORKED LOCAL TAX CODE, WORKED STATE TAX CODE, WORKED LOCAL TAX, WORKED STATE TAX
-- , OVERTIME EARNINGS, OVERTIME HOURS, REGULAR EARNINGS, REGULAR HOURS
NVL (
(SELECT
TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2982', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| NVL(MAX(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2984', ci.code, NULL), NULL)), CHR(155)) || '~'
|| NVL(MAX(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2987', DECODE(ci.code,'XX',null,ci.code), NULL), NULL)), CHR(155)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2984', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2987', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:4118', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:4114', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| NVL(MAX(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:4114', ci.code, NULL), NULL)), CHR(155)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2988', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2989', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| NVL(MAX(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2989', ci.code, NULL), NULL)), CHR(155)) || '~'
|| NVL(MAX(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2983', ci.code, NULL), NULL)), CHR(155)) || '~'
|| NVL(MAX(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2986', ci.code, NULL), NULL)), CHR(155)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2983', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3709', DECODE(ci.taxcodeoid, 'SYS:4:2986', NVL(ci.amount,0), 0), 0) ), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3713', NVL(ci.amount,0), 0)), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3727', NVL(ci.amount,0), 0)), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3715', NVL(ci.amount,0), 0)), 0)) || '~'
|| TO_CHAR(NVL(SUM(DECODE(ci.histtypeoid, 'SYS:4:3716', NVL(ci.amount,0), 0)), 0)) || '~'
-- R16 columns.
-- Total Deductions Amount === Other Deductions on UI screen.
|| TO_CHAR(NVL(SUM(DECODE(chcat.name, 'DeductionHistory'
, DECODE(NVL(ci.statutory_ded, 0), 0
, DECODE(ci.taxcodeoid, NULL
, DECODE(ci.code, NULL, 0, NVL(ci.amount,0)), 0), 0), 0)), 0)) || '~' -- "Total Deductions Amount"
|| TO_CHAR(NVL(SUM(DECODE(chcat.name, 'OvertimeHours', NVL(ci.amount,0)
, 'AdditionalHours', NVL(ci.amount,0), 'RegularHours', NVL(ci.amount,0), 0)), 0)) || '~' -- "Total Hours Amount"
|| TO_CHAR(NVL(SUM(DECODE(chcat.name, 'Memo', NVL(ci.amount,0), 0)), 0)) || '~' -- "Total Memo Amount"
|| TO_CHAR(NVL(SUM(DECODE(chcat.name, 'AdditionalEarnings', NVL(ci.amount,0), 0)), 0)) || '~' -- "Total Other Earnings"
|| TO_CHAR(NVL(SUM(DECODE(chcat.name, 'AdditionalHours', NVL(ci.amount,0), 0)), 0)) -- "Total Other Hours"
FROM
px17_checkhistoryitem ci
, px17_sys_type chcat
WHERE
ci.cidn=chd.cidn
AND ci.checkhistorydistributionoid = chd.oid
AND chcat.category = 'CheckHistoryItem'
AND chcat.oid = ci.histtypeoid
-- AND ci.histtypeoid IN ('SYS:4:3713', 'SYS:4:3727', 'SYS:4:3715', 'SYS:4:3716', 'SYS:4:3709')
), '0' || '~' || CHR(155) || '~' || CHR(155)
|| '0~0~0~0~' || CHR(155) || '~0~0~' || CHR(155) || '~' || CHR(155) || '~'
|| CHR(155) || '~0~0~0~0~0~0'
) taxes_and_rates
, ch.check_seq_num check_seq_num
, ch.home_cost_number home_costnumber_desc
, SUBSTR(f_type_px17(ch.cidn,ch.payfrequencyoid, 'NAME'), 1, 255) tax_frequency
, (ch.co_code || '/' || ch.home_cost_number) co_chkv_home_cost_no
, chd.worked_in_cost_number cost_no_worked_in
, chd.distribution_number distribution_number
, DECODE(NVL(ch.reversed_flag, 0), 1, 'Y', 'N') chk_reverse
FROM
px17_checkhistory ch
, px17_employment em
, px17_person pe
, px17_payrollgroup pg
, px17_checkhistory_dist chd
, px17_appointment ap
WHERE
ch.cidn = em.cidn
and em.cidn = pe.cidn
and pg.cidn = ch.cidn
and ch.cidn = chd.cidn
and ap.cidn(+) = em.cidn
and ch.employmentoid=em.oid
AND em.personoid=pe.oid
AND pg.co_code = ch.co_code
AND ch.active = 1
AND ch.oid = chd.checkhistoryoid
AND ap.employmentoid(+) = em.oid
AND DECODE(ap.oid, NULL, 1, NVL((SELECT 1 FROM px17_payrollagreement pa
WHERE
pa.cidn = ap.cidn
and pa.cidn = ch.cidn
and pa.cidn = pg.cidn
and pa.appointmentoid = ap.oid
AND pa.file_number = ch.file_nb
AND pa.cocodeoid = pg.oid), 0)) = 1
and ch.cidn in (select distinct s_cidn from nonsuper_user_check)
AND ( sys_context('payx_r17_app_context', 'app_role') in ('ADP', 'CSR')
or (exists (select 1 from super_user_check where su_cidn =ch.cidn))
or (ch.cidn,ch.co_code,ch.home_dept_code) in (select cidn,co_code,dep from user_security_homedept)
or (ch.cidn,ch.co_code,ch.home_cost_number) in (select cidn,co_code,code from user_security_cost_no)
or ( exists(select co_code from user_security_homedept where cidn=ch.cidn and co_code = ch.co_code and dep is null)
and exists(select co_code from user_security_cost_no where cidn=ch.cidn and co_code = ch.co_code and cost_no = 0) )
Following are the functions being called:
create or replace type myTable_17 as table of varchar2(4000);
CREATE OR REPLACE function f_str2tbl_px17( p_str in varchar2 ) return myTable_17 pipelined
as
l_str long default p_str || ',';
l_n number;
begin
loop
l_n := instr( l_str, ',' );
exit when (nvl(l_n,0) = 0);
pipe row( ltrim(rtrim(substr(l_str,1,l_n-1))) );
l_str := ltrim( substr( l_str, l_n+1 ) );
end loop;
return;
end f_str2tbl_px17;
CREATE OR REPLACE FUNCTION f_check_purge_px17
fv_cidn px17_reservedfilenumber.cidn%TYPE,
fv_file_number px17_reservedfilenumber.file_number%TYPE,
fv_cocode px17_payrollgroup.co_code%TYPE DEFAULT NULL
) RETURN NUMBER AUTHID CURRENT_USER
AS
v_val NUMBER(5) ;
BEGIN
IF fv_cocode IS NULL THEN
RETURN 0 ;
END IF ;
SELECT 1 INTO v_val
FROM px17_reservedfilenumber a,
px17_payrollgroup b
WHERE
a.cidn = fv_cidn
AND b.cidn = fv_cidn
AND a.file_number = fv_file_number
AND a.parentoid = b.oid
AND b.co_code = fv_cocode
AND ROWNUM = 1 ;
RETURN 1 ;
EXCEPTION
WHEN no_data_found THEN
RETURN 0 ;
END f_check_purge_px17 ;
CREATE OR REPLACE FUNCTION f_check_security_px17
fv_cidn IN px17_type_client.cidn%TYPE,
fv_cocode px17_cocodegroup.co_code%TYPE -- pg.cocode
, fv_home_dept px17_type_client.name%TYPE -- ap.home_dept
) RETURN NUMBER AUTHID CURRENT_USER
AS
v_val NUMBER(5) ;
v_key VARCHAR2(20) ;
v_users VARCHAR2(4000) ;
v_cocodes VARCHAR2(4000) ;
BEGIN
BEGIN
SELECT c_user_list, c_cocodes, c_run_key
INTO v_users, v_cocodes, v_key
FROM px17_t_context_vals
WHERE c_run_key = (SELECT MAX(c_run_key) FROM px17_t_context_vals)
AND ROWNUM = 1 ;
EXCEPTION
WHEN no_data_found THEN
v_cocodes := NULL ;
END ;
IF v_cocodes IS NULL THEN
RETURN 1 ;
ELSIF INSTR( (v_cocodes || ','), (fv_cocode || ',') ) = 0 THEN
RETURN 0 ;
ELSE
BEGIN
SELECT
1
INTO
v_val
FROM
px17_type_client t
, px17_securityobject s
, px17_cocodegroup c
WHERE
t.securityoid=s.oid
AND t.category='T_CO_DEPT'
AND c.useroid=(SELECT a.oid
FROM px17_associate a
WHERE a.oid = c.useroid
AND a.active=1
AND UPPER(a.name) = UPPER(v_users)
AND ROWNUM = 1)
AND SUBSTR(s.name,8,3)=c.co_code
AND (c.department_access IS NULL
OR c.department_access LIKE '%' || t.name || '%')
AND SUBSTR(s.name,8,3) = fv_cocode
AND t.name = fv_home_dept
AND ROWNUM = 1 ;
RETURN 1 ;
EXCEPTION
WHEN no_data_found THEN
BEGIN
SELECT
1
INTO
v_val
FROM
px17_cocodegroup c
, px17_associate a
WHERE
c.useroid=a.oid
AND c.department_access IS NULL
AND c.co_code = fv_cocode
AND UPPER(a.name)= UPPER(v_users)
AND a.active=1
AND ROWNUM = 1 ;
RETURN 1 ;
EXCEPTION
WHEN no_data_found THEN
RETURN 0 ;
END ;
END ;
END IF ;
RETURN 0 ;
END f_check_security_px17 ;
SELECT SUBSTR(f_type_px17(ap.cidn,ap.currentstatusoid, 'DESC'), 1, 255)
from
px17_appointment ap,
/*context co_ap,*/
px17_payrollagreement pa,
px17_payrollgroup pg
CREATE OR REPLACE FUNCTION f_type_px17
fv_cidn IN px17_type_client.cidn%TYPE,
fv_oid IN px17_type_client.oid%TYPE,
fv_col IN VARCHAR2 DEFAULT NULL
) RETURN VARCHAR2 AUTHID CURRENT_USER AS
v_rtn_name px17_type_client.name%TYPE := NULL ;
v_rtn_desc px17_type_client.description%TYPE := NULL ;
BEGIN
IF fv_oid IS NOT NULL THEN
BEGIN
IF UPPER(SUBSTR(fv_oid,1,3)) = 'SYS' THEN
SELECT name, description
INTO v_rtn_name, v_rtn_desc
FROM px17_sys_type
WHERE oid = fv_oid
AND ROWNUM = 1 ;
ELSE
SELECT name, description
INTO v_rtn_name, v_rtn_desc
FROM px17_type_client
WHERE oid = fv_oid
AND cidn = fv_cidn
AND ROWNUM = 1 ;
END IF ;
EXCEPTION
WHEN no_data_found THEN
v_rtn_name := NULL ;
v_rtn_desc := NULL ;
END ;
END IF ;
IF (UPPER(NVL(fv_col, '~')) = 'NAME') THEN
RETURN v_rtn_name ;
ELSIF ((UPPER(NVL(fv_col, '~')) = 'DESC')
OR (UPPER(NVL(fv_col, '~')) = 'DESCRIPTION')) THEN
RETURN v_rtn_desc ;
ELSE
RETURN (NVL(v_rtn_name, CHR(155)) || '~' || NVL(v_rtn_desc, CHR(155))) ;
END IF ;
END f_type_px17 ;
************************* -
Multi-thread failure - Error in assignment
Hello
I have a c++ program processor running under Windows XP with Oracle 9i. My program access to oracle by an ODBC driver version 9.2.0.4.0. It could be launched in multi-thread to increase performance. When I launch it with one thread everything is fine. When I use several threads I have problems. ODBC driver returns to me a "error in assignment ... General error" message and my updates queries failed. Under SQl server it works without problems. It seems to be a kind of deadlock. When I disable check box in my odbc driver of "enable query timeout" my program encounter a problem and freezes...
Could someone help me ?user13335017 wrote:
I have thought of the above solutions as workable, however, it is not. Some exhibited errors are:
A. "Attempt to use database while environment is closed." This error applies to 2, 3 and 4 all the way;
B. "Attempt to read / write database while database is closed." This error applies to 3 in particular;
C. "Attempt to close environment while some database is still open." This error applies to 5.
Please help me with designing a better strategy to solve the concurrent issue. Many thanks in advance.All these are expected errors. You should design the application so that you do not close an environment handle while database handles are still open, keep database handles open for as long as operations need to be performed on the underlying databases, open the database handles after opening the database handles, and close database handles before closing the environment handle.
In short, in pseudo-code, you should have something like this:
- open environment handle,
- open database handles,
- perform whatever operations are needed on the databases,
- close database handles,
- close environment handle.
You can refer to the Getting Started with Data Storage and the Getting Started with Transaction Processing guides appropriate for the API you are using, from the Berkeley DB documentation page.
Regards,
Andrei -
F.28 transaction for credit management
Hi
Any body can explain detail information on below
In F.28 transaction what is the use of
1.FI data only and 2.Recreate FI and SD data
Please explain details what will happen after executing this above.
Regardshi
If you check the Indicator: FI data only
The result is that only financial accounting data is reconstructed.
Sales documents (orders, supplies, invoices) are not taken into account.
IF you check Indicator:Recreate Fi and SD Data Only?
It will recreate both SD and FI data if you have any changes in SD and FI settings in credit management
Setting this indicator has the effect that only sales documents (orders,
deliveries, billing documents) are recreated.
Use
This indicator is only useful if you have made changes in Credit
Management that only necessitate a recreation of the FI & SD data. In this
case you should set the indicator for performance reasons.
regards -
Hi,
We are getting the following error when certain data driven subscriptions are fired off: "the query processor could not start the necessary thread resources for parallel query execution". I've read other posts that have the same error, and
the solution usually involves adjusting MaxDOP to limit the number of queries that are fired off in parallel.
Unfortunately, we cannot change this setting on our server for performance reasons (outside of data driven subscriptions, it negatively impacts our ETL processing times). We tried putting query hints like "OPTION (MAXDOP 2);" in the reports
that are causing the error, but it did not resolve the problem.
Are there any settings within Reporting Services that can be adjusted to limit the number of subscriptions that get fired off in parallel?
Any help is appreciated - thanks!Yes, that is correct. It's a painful problem, because you don't know which specific subscription failed. For example, we have a data driven subscription that sends out about 800 emails. Lately, we've been having a handful of them fail. You don't know
which ones out of the 800 failed though, even from the RS log files - all it tells you is that "the
query processor could not start the necessary thread resources for parallel query execution".
Thanks, I'll try changing <MaxQueueThreads> and will let you know if it works.
On a side note: I've noticed that it is only reports with cascading parameters (ex. where parameter 2 is dependent on the selection from parameter 1) that get this error message... -
HELP!....GUI crashes when i call a multi-threaded program from it
Hi..I have encountered a problem in my end of year project, which i cant see to solve. The problem is i am starting a multi-threaded program for a JButton on a GUI. All though this starts the other program it crashes the GUI completely how do i stop this.
this is the code i use to call the threaded program.
public void actionPerformed(ActionEvent e)
Object target=e.getSource();
String line = new String();
if( target==b1 )
try
cl = new client();
cl.startup();
catch(Exception ex){ex.printStackTrace();}
thanks MikeNo there is no exceptions being given. this is one of the reasons why i dont no what to do. i thought myself that the threaded was taking all the resources and not going back to the GUI. if this is the case is there anyway that i can call back the GUI and keep the threaded program running?
thanks
mike. -
Is rendering in Final Cut single thread or multi thread?
There seems to be this recurring message about how the new Macpros perform single-threaded tasks about the same as the previous gen of Macpros, however in multi-threaded tasks the new Pros shine.
How do I know if a task is single-threaded or multi-threaded? I do a lot of rendering video filters, generators, effects, etc. in Final Cut. Even something as (seemingly) simple as generating scrolling credits takes forever to render.
Is video rendering a multi-threaded task? Will I see time significant time savings in rendering with the new Pro machines?It's not right now but the new Mac Pros are faster in single-threaded modes anyway:
http://www.macrumors.com/2009/03/14/updated-mac-pro-benchmarks-and-video-of-inte rnals/
Turns out the initial benchmarks were incorrect. The integrated memory controller is a MASSIVE performance boost. But it is inevitable that Apple will eventually choose the multi-threaded route for Final Cut Studio anyway, even if they do not at the present. -
Joining Tracks Amplified for No reason
Not sure what I'm missing, but I'm trying to join two tracks, which I can do, however, the end result is the new single track is adjusted. It seems like it's amplified. I don't know what is forcing this amplification, what adjustment needs to be made?
What else do you want to see? VM and Real memory are not the same thing.
Real is the amount of RAM that process is currently using. VSIZE is the maximum size of virtual memory that process can get access to. That's why my total VSIZE is in excess of my total hard drive capacity. The system should be managing the active process and governing its VM access at that time. The entire VM space should not always be used or in Real memory, for performance reasons.
Add up all the Real numbers, and they don't come close to 900MB. They add up to, at most, half of that.
I just restarted my laptop. kernel_task at 61MB, iCal at 20MB, Quicksilver at 19MB, WindowServer at 17MB, and the remainder under 10MB. There are roughly the same number of processes.
My current Active memory usage? 88.76MB, with 1.22GB free.
I opened up Thunderbird, iTunes, and Safari. Now I'm at 126.12MB used.
That's my problem. I'm not out of RAM. I rarely use more than 600MB of RAM at any time. It's paging a bit, as it should. The problem is my system freezes when it gets a memory leak and pages like crazy because all of my RAM is used up by.... nothing.
I'd just like some ideas on what the likely candidates could be, and if there are perhaps some preferences I should be trashing, or other possible avenues to isolate which program or process is causing the problem.
I've steadily loaded every program I've been using since this problem started. I've been going over the tasks I normally do, but right now the problem is not occurring. There's no real way to tell when it will happen. It just does. -
Sybase: SET CHAINED command not allowed within multi-statement transaction
Hello,
I'm getting the error message "SET CHAINED command not allowed within
multi-statement transaction" for CMP Entity beans against Sybase.
The errors appear in my jdbc.log in this order:
010SM: This database does not support the initial proposed set of
capabilities, retrying.) SQLState(010SM)
JZ0EM: End of data.
JZ0SJ: Metadata accessor information was not found on this database.
Please install the required tables
as mentioned in the jConnect documentation.
010SL: Out-of-date metadata accessor information was found on this
database. Ask your database administrat
or to load the latest scripts.) SQLState(010SL)
SQLState(ZZZZZ) vendor code(226)
com.sybase.jdbc2.jdbc.SybSQLException: SET CHAINED command not allowed
within multi-statement transaction.
I'm using JConnect 5.5, WebLogic 6.1 sp3, Solaris 8, and Sybase 11.
The weird thing is, the app works on a box running 6.1 sp2 and Win2k
Prof.
Any ideas?
Thanks!
DanHi Dan,
There is a patch for this sybase problem, please contact [email protected] to
get a temp patch.
sree
"Dan Blaner" <[email protected]> wrote in message
news:[email protected]..
Hello,
I'm getting the error message "SET CHAINED command not allowed within
multi-statement transaction" for CMP Entity beans against Sybase.
The errors appear in my jdbc.log in this order:
010SM: This database does not support the initial proposed set of
capabilities, retrying.) SQLState(010SM)
JZ0EM: End of data.
JZ0SJ: Metadata accessor information was not found on this database.
Please install the required tables
as mentioned in the jConnect documentation.
010SL: Out-of-date metadata accessor information was found on this
database. Ask your database administrat
or to load the latest scripts.) SQLState(010SL)
SQLState(ZZZZZ) vendor code(226)
com.sybase.jdbc2.jdbc.SybSQLException: SET CHAINED command not allowed
within multi-statement transaction.
I'm using JConnect 5.5, WebLogic 6.1 sp3, Solaris 8, and Sybase 11.
The weird thing is, the app works on a box running 6.1 sp2 and Win2k
Prof.
Any ideas?
Thanks!
Dan -
Hi guys . . . i need so much help. i am trying to implement matrix multiplication using threads.
For some reason when iam multiplying the matrices i have the threads waiting too long.. they wait wait wait.. then do the job and then wait wait wait.
Here is the code for my thread pool class
package concurentNaive;
import java.util.*;
public class ThreadPool {
protected Thread threads[] = null;
protected EndPool endPool = new EndPool();
Collection jobs = new ArrayList(5);
public PriorityQueue<MatrixJob> pq = new PriorityQueue<MatrixJob>();
public ThreadPool(int size,PriorityQueue qu){
this.pq = qu;
threads = new worker[size];
for (int i=0;i<threads.length;i++){
threads[i] = new worker(this);
threads.start();
public synchronized void assign(Runnable r){
endPool.workerBegin();
jobs.add(r);
System.out.println(Thread.currentThread());
notify();
* Get a new work
* @return
public synchronized Runnable getAssignement(){
try {
while ( !jobs.iterator().hasNext() )
wait(1);
System.out.print(Thread.currentThread());
Runnable r = (Runnable)jobs.iterator().next();
jobs.remove(r);
return r;
} catch (Exception e) {
endPool.workerEnd();
return null;
public void complete(){
endPool.waitBegin();
endPool.waitDone();
protected void finalize(){
endPool.reset();
for (int i=0;i<threads.length;i++){
threads[i].interrupt();
endPool.workerBegin();
threads[i].destroy();
* Class for the pool component threads.The thread scans and executes tasks.
* @author Krack
class worker extends Thread{
public boolean busy;
public ThreadPool owner;
worker(ThreadPool o){
this.owner = o;
public void run(){
Runnable target = null;
do {
target = owner.getAssignement();
if (target!=null) {
target.run();
owner.endPool.workerEnd();
} while (target!=null);
and here is my thread :
ublic class TheWorker implements Runnable{
private int[] answer;
private MatrixJob myJob;
private long time1;
public TheWorker(MatrixJob job){
this.myJob = job;
time1 = System.currentTimeMillis();
public void run()
//MatrixJob theJob = this.myJob;
answer = new int[myJob.row.length];
for (int i=0;i<myJob.row.length;++i){
for (int j=0;j<myJob.cols.length;++j){
answer=0;
for (int k=0;k<myJob.cols[j].length;k++){
answer[i] += myJob.row[i]*myJob.cols[j][k];
for(int i=0;i<answer.length;i++){
System.out.print(answer[i]+" ");
} System.out.println();
public int[] getAnswer() {
return answer;
Any help is much appreciated. Thank you much.How do you know that they are waiting?
-
Multi-threaded performance server using 2 ports to two-way communication
Hi, I'm new in the forums so welcome everyone. I'm developing now an online computer game based on orginal Polish board-game, but it doesn't mean. Important is that I need to develope a high-performance multi-threaded server, which can serve... let's say few hundres of games, and a thousend of players simulateously. My server works on two ports/sockets.
First one is represented by "ServerSocketChannel clientConSsc" in my code. The main thread in my server class which invokes the method "run()" (which You can see below), registers clientConSsc with Selector and then repeatingly accepts incoming connections from clients on this socket. When connection(channel) is estabilished and clients wants to write some request to this channel, the main thread on server creates a new instance of class "RequestHandler" which extends Thread and handles this request (reads the request from channel, makes some changes on server, spreads some new messages to other clients in the same game and so on... everything on the same socket/port/channel). Then the channel/connection is closed by the server - I call such connections: "a short connections". In the same time the main thread continues the loop and is still able to accept connections from another players. That's the idea of multi-threaded server, right? :) And to this point, everything works fine, but... what if the server wants to trigger some new command, write new information to client?
Server could have tried to open a SocketChannel to client's IP address, but then the client programme would have to create and ServerSocketChannel object, bind it to some InetAddress and then... and then client becomes a server! - that breaks the idea of client-server cooperation and demands on players of my game to have routed some port on their machines. To resolve this problem I made some sort of "system" which, when some player/client is logging into my server, accepts second (this time constant, not "short") connection on the second port I mentoined on the beginning. This connection is held in variable "SocketChannel serverCon" of class "Player" - which reflects a player logged onto server. Server maintains every such connection till the client logs off. After the connection is accepted, the player whom connection it was is added to collection called "playersToRegisterToWrite". After the Selector.selectNow() is invoked (as You can see in the code below), each and every player's connection is registered in selector (with selection key - OP_WRITE and attachment pointing on owning player). In the same time client's code is trying to read some bytes from this connection and blocks on it until some bytes are written to this connection. When server wants to "tell" something to client, deliver some message/command, it creates a new instance of class which extends an abstract class called "ServerAction" (another new thread) and adds it to collection "actionsToDo". In ServerAction's method "run()" there are whole code to interact with client (e.g. send an update of players' list, an update of games' list, a chat message). Finnaly when Selector informs the server that some connection is writable (some client is waiting for commands), then server checks if there's any "actionToDo" involving this client/player. If there is, it unregisters the connection from Selector (so no other ServerAction (thread) can write on this connection) and starts the action. At the end of every "run()" method of subclass of ServerAction there's a code, which again adds the player to collection "playersToRegisterToWrite", so the player's connection can again be registered in Selector and the player can again receive informations from server - after it consumed THIS "ServerAction".
It looks to me like it should be working fine, but it's not. When I test my server and clients on the same machine (no ping/latency) everything seems to be working fine. But when it comes to play my game with somebody even on LAN or through the Internet there comes the problems. My first socket I describe (and first type of connections - short connections) works perfectly fine, so the requests triggered by client are delivered and handled properly. But the second socket is cirppling. For example: the server triggers a command refering to an update of clients logged to server' list. It is triggered by Selector so the client should be ready to read data from server, so the server sends data! And the client never receives it... Why?
It experimented a whole lot of time on SocketChannel's method "configureBlocking(boolean)", but it never helps. I think the client should always block it's listening thread on connection, contratry to server which is ment to be fast, so it should send the data through non-blocking channels. Am I right? Are there any rules refering blocking configuration of SocketChannels?
I will be grateful for every answer. To help You out I attach also drafts from run()'s methods of my classes.
Server's main method - main thread :
public void run() {
try {
selector = Selector.open();
clientConSsc.configureBlocking(false);
clientConSsc.register(selector , SelectionKey.OP_ACCEPT);
while(serverRunning) {
try {
selector.selectNow();
Iterator it;
synchronized(playersToRegisterToWrite) {
it = playersToRegisterToWrite.iterator();
while(it.hasNext()) {
Player player = (Player)it.next();
it.remove();
player.serverCon.configureBlocking(false);
player.serverCon.register(selector , SelectionKey.OP_WRITE , player);
Set keys = selector.selectedKeys() {
it = keys.iterator();
while(it.hasNext()) {
SelectionKey key = (SelectionKey)it.next();
if(key.isAcceptable()) {
it.remove();
clientCon = clientConSsc.accept();
clientCon.configureBlocking(false);
clientCon.register(selector , SelectionKey.OP_READ);
continue;
if(key.isReadable()) {
it.remove();
key.cancel();
new RequestHandler(this , (SocketChannel)key.channel()).start();
continue;
if(key.isWritable()) {
if(key.attachment() != null ) {
ServerAction action = null;
synchronized(actionsToDo) {
Iterator aIt = actionsToDo.iterator();
while(aIt.hasNext()) {
ServerAction temp = (ServerAction)aIt.next();
if(temp.getPlayer().equals((Player)key.attachment())) {
action = temp;
aIt.remove();
break;
if(action != null) {
key.channel().configureBlocking(false);
it.remove();
key.cancel();
action.start();
continue;
} catch(Exception e) {
statusArea.append(e.toString() + "\n");
e.printStackTrace();
continue;
} catch(ClosedChannelException e) {
statusArea.append(e.toString() + "\n");
} catch(IOException e) {
statusArea.append(e.toString() + "\n");
A part of server's RequestHandler's class' method run() - the method which handles requests triggered by client on first port:
public void run() {
boolean served = false;
try {
channel.configureBlocking(true);
retryCount++;
retry = false;
String command = ns.readText(channel).trim();
ns.statusArea.append("ktos przesyla komende: " + command + "\n");
if(command != null && !command.equals("ERROR")) {
String[] cmd = command.split("�");
ns.statusArea.append("komenda: " + cmd[0] + "\n");
if(cmd[0].equals("CHAT")) {
if(cmd.length != 5) {
retry();
} else {
if(cmd[2].equals("NOGAME")) { // jezeli nie ma okreslonej gry czyli rozsylamy do wszystkich
for(int i = 0 ; i < ns.loggedPlayersListItems.size() ; i++) {
Player current = (Player)ns.loggedPlayersListItems.get(i);
if(current.state == Player.CHOOSING && !current.equals(new Player(Integer.parseInt(cmd[1])))) // jezeli gracz jest w okienku wybierania gry to wysylamy mu broadcast
ns.actionsToDo.add(new SendMsg(ns , current , "CHAT�" + cmd[1] + "�" + cmd[3] + "�" + cmd[4]));
} else {
Game game = (Game)ns.gamesListItems.get(ns.gamesListItems.indexOf(new Game(Integer.parseInt(cmd[2]))));
for(int i = 0 ; i < game.players.size() ; i++) {
Player current = (Player)game.players.get(i);
if(!current.equals(new Player(Integer.parseInt(cmd[1]))))
ns.actionsToDo.add(new SendMsg(ns , current , "CHAT�" + cmd[1] + "�" + cmd[3] + "�" + cmd[4]));
served = true;
} else if(cmd[0].equals("GETGAMEINFO")) {
if(cmd.length != 3)
retry();
else {
int gameID = Integer.parseInt(cmd[2]);
ns.statusArea.append("poproszono o informacje o grze nr: " + gameID + "\n");
Game checkedGame = new Game(gameID);
if(ns.gamesListItems.contains(checkedGame)) {
Game game = (Game)ns.gamesListItems.get(ns.gamesListItems.indexOf(checkedGame));
channel.configureBlocking(true);
ObjectOutputStream oos = new ObjectOutputStream(channel.socket().getOutputStream());
oos.writeObject(game);
oos.writeObject(game.players);
oos.flush();
ns.statusArea.append("wyslano informacje o grze nr: " + gameID + "\n");
} else {
ns.statusArea.append("brak gry o nr: " + gameID + "\n");
served = true;
} catch(IOException e) {
e.printStackTrace();
if(!served) {
ns.findAndDisconnectPlayer(channel);
try {
channel.close();
} catch(IOException e) {
e.printStackTrace();
}An example of ServerAction's subclass - the class which triggers server commands to client on second port:
class UpdateLoggedPlayersList extends ServerAction {
public UpdateLoggedPlayersList(NeuroServer ns , Player player) {
super(ns , player);
public void run() {
try {
serverCon.configureBlocking(true);
ns.sendText("UPDATELOGGEDPLAYERSLIST" , serverCon);
if(ns.readText(serverCon).equals("OK")) {
ObjectOutputStream oos = new ObjectOutputStream(serverCon.socket().getOutputStream());
oos.writeObject(ns.loggedPlayersListItems);
oos.flush();
synchronized(ns.playersToRegisterToWrite) {
ns.playersToRegisterToWrite.add(player);
} catch(IOException e) {
e.printStackTrace();
}A part of client's CmdHandler's class' method run() - the method which handles commands triggered by server:
public void run() {
try {
while(works) {
String command = nc.readText(nc.serverCon);
System.out.println("Server przesyla komende: " + command + "\n");
String[] cmd = command.split("�");
if(cmd[0] != null && !cmd[0].equals("ERROR")) {
if(cmd[0].equals("CHAT")) {
if(nc.chooseGameDialog != null && nc.chooseGameDialog.isVisible()) { // jezeli na wybieraniu gry
newChatEntry(cmd[2] , null , cmd[3] , nc.chooseGameDialog.chatPane);
} else if(nc.readyDialog != null && nc.readyDialog.isVisible()) { // jesli na przygotowywaniu
Player sender = (Player)nc.actGame.players.get(nc.actGame.players.indexOf(new Player(Integer.parseInt(cmd[1]))));
newChatEntry(cmd[2] , sender.fraction , cmd[3] , nc.readyDialog.chatPane);
} else if(nc.ng != null) { // jesli w grze
Player sender = (Player)nc.actGame.players.get(nc.actGame.players.indexOf(new Player(Integer.parseInt(cmd[1]))));
newChatEntry(cmd[2] , sender.fraction , cmd[3] , nc.ng.inGameChatPane);
} else if(cmd[0].equals("UPDATELOGGEDPLAYERSLIST")) {
nc.sendText("OK" , nc.serverCon , false);
nc.serverCon.configureBlocking(true);
ObjectInputStream ois = new ObjectInputStream(nc.serverCon.socket().getInputStream());
DefaultListModel players = (DefaultListModel)ois.readObject();
nc.chooseGameDialog.updateLoggedPlayersList(players);
} catch(IndexOutOfBoundsException e) {
System.out.println(e);
} catch(IOException e) {
System.out.println(e);
} catch(ClassNotFoundException e) {
System.out.println(e);
}And two methods I used in codes above: sendText(String text , SocketChannel sc) and readText(SocketChannel sc) - they are my "utility" methods, which I use to send and receive Strings through specified SocketChannels.
boolean sendText(String text , SocketChannel sc) {
ByteBuffer bbuf = ByteBuffer.allocate(BSIZE);
boolean sendRetry;
boolean sent = false;
do {
sendRetry = false;
try {
StringBuffer cmd = new StringBuffer();
cmd.setLength(0);
if(text.length()+4 < 100)
cmd.append("0");
if(text.length()+4 < 10)
cmd.append("0");
cmd.append(Integer.toString(text.length()+4) + "�");
cmd.append(text);
cmd.append("\n");
bbuf = charset.encode(CharBuffer.wrap(cmd));
sc.write(bbuf);
bbuf.clear();
int n = sc.read(bbuf);
if(n == 1) {
bbuf.flip();
Byte re = bbuf.get();
if(re == 1) {
sendRetry = true;
} else {
sent = true;
} catch(Exception e) {
findAndDisconnectPlayer(sc);
try {
sc.close();
} catch(IOException f) {
f.printStackTrace();
return false;
} while(!sent && sendRetry);
return true;
String readText(SocketChannel sc) {
ByteBuffer bbuf = ByteBuffer.allocate(BSIZE);
int readRetryCount = -1;
boolean readRetry;
do {
readRetry = false;
readRetryCount++;
StringBuffer cmd = new StringBuffer();
cmd.setLength(0);
bbuf.clear();
try {
readLoop:
while(true) {
int n = sc.read(bbuf);
if(n > 0) {
bbuf.flip();
CharBuffer cbuf = charset.decode(bbuf);
while(cbuf.hasRemaining()) {
char c = cbuf.get();
if(c == '\r' || c == '\n') break readLoop;
cmd.append(c);
} else break;
statusArea.append(Thread.currentThread().getId() + " readText() odczytuje: " + cmd.toString() + "\n");
if(cmd.length() < 3 || Integer.parseInt(cmd.substring(0 , 3)) != cmd.length()) {
sc.write(ByteBuffer.wrap(new byte[] {1}));
readRetry = true;
} else {
sc.write(ByteBuffer.wrap(new byte[] {0})); // length OK
return cmd.toString().substring(4 , cmd.toString().length());
} catch(Exception e) {
findAndDisconnectPlayer(sc);
try {
sc.close();
} catch(IOException f) {
f.printStackTrace();
return "ERROR";
} while(readRetry && readRetryCount < 3);
findAndDisconnectPlayer(sc);
try {
sc.close();
} catch(IOException e) {
e.printStackTrace();
return "ERROR";
}Edited by: Kakalec on Jul 23, 2008 11:04 AMYou seem to be using a horrendous mixture of PrintWriters, BufferedReaders, ObjectOutputStreams, and no doubt ObjectInputStreams. You can't do that.
Some rules about this:
(a) Whenever you use a stream or reader or writer on a socket, you must allocate it once for the life of the socket, not every time you want to do an I/O.
There are many reasons for this including losing buffered data in the old stream and auto-closure of the socket on garbage-collection of the old stream.
(b) You can't mix stream types on the same socket. (i) If you're writing objects, use an ObjectOutputStream, you must read with an ObjectInputStream, and you can't read or write anything that isn't supported by the API of ObjectOutputStream. (ii) If you're writing lines, use a BufferedWriter and a BufferedReader at the other end. If you're writing characters, use a Writer and a Reader. (iii) If you're writing primitive data or UTF strings, use a DataOutputStream and a DataInputStream. (iv) If you're writing bytes, use DataOutputStream and a DataInputStream or an OutputStream and an InputStream. You can't mix (i), (ii), (iii), and (iv).
(c) Don't use PrintWriter or PrintStream over the network. They swallow exceptions that you need to know about. They are for writing to the console, or log files, where you don't really care about exceptions.
(d) Call flush() before reading.
(e) Always close the 'outermost' output stream or writer of a socket, never the input stream or the socket itself. Closing any of these closes the socket and therefore makes the other stream unusable, but only closing the output stream/writer will flush it. -
Another process (thread) is applying transactions for this client:
Has anyone seen this error
'Another process (thread) is applying transactions for this client: MNEWMAN Try again later.'
We seem to be getting a few upload transactions put into the error queue for this reason, sometimes just executing the transaction clears it, but more often the data actually looks to have been correctly posted to the server as well as appearing in the error queue, as itf two threads have picked up the same transaction, one has applied it without error and the other failed
any ideas?latest update from Oracle is to
1.Set MAX_APPLY_TRIES=5
2.Set APPLY_TRIES_DELAY=10
Done this, but waiting for sufficient activity to see if it solves the problem.
I had thought about knocking max_threads down to 1 (and might do this to try and isolate some odd performance issues), but the problem is that this would make the apply and compose process take three times as long (we use 3 threads), and that will not be acceptable for long on the live system -
Analysis for Office support multi thread?
Does Analysis for Office support multi thread/core? If so, what verison? I tried searching around this site as well as note 1466118 - Hardware & Software requirements for Analysis, edition for MS Office but was unable to find an answer.
I am on an Intel dual cpu with hyper threading turned on so it essentially looks like 4 cores. When I execute an Analysis View, I rarely see the EXCEL.EXE process go above 25% CPU utilization. I have plenty of RAM and hard drive space.
64bit Windows 7
32bit Office 2010
AAO 1.3.5.2288
ThanksI found the following info at:
Excel 2010 Performance: Performance and Limit Improvements
Large Data Sets and 64-bit Excel
The 64-bit version of Excel 2010 is not constrained to 2 GB of RAM like 32-bit applications. Therefore, 64-bit Excel 2010 enables users to create much larger workbooks. 64-bit Windows enables a larger addressable memory capacity, and 64-bit Excel is designed to take advantage of that capacity. For example, users are able to fill more of the grid with data than was possible in previous versions of Excel. As more RAM is added to the computer, Excel uses that additional memory, allows larger and larger workbooks, and scales with the amount of RAM available.
In addition, because 64-bit Excel enables larger data sets, both 32-bit and 64-bit Excel 2010 introduce improvements to common large data set tasks such as entering and filling down data, sorting, filtering, and copying and pasting data. Memory usage is also optimized to be more efficient, in both the 32-bit and 64-bit versions of Excel.
Multi-Core Processing
Additional investments were made to take advantage of multi-core processors and increase performance for routine tasks. Starting in Excel 2010, the following features use multi-core processors: saving a file, opening a file, refreshing a PivotTable (for external data sources, except OLAP and SharePoint), sorting a cell table, sorting a PivotTable, and auto-sizing a column.
For operations that involve reading and loading or writing data, such as opening a file, saving a file or refreshing data, splitting the operation into two processes increases performance speed. The first process gets the data, and the second process loads the data into the appropriate structure in memory or writes the data to a file. In this way, as soon as the first process beings reading a portion of data, the second process can immediately start loading or writing that data, while the first process continues to read the next portion of data. Previously, the first process had to finish reading all the data in a certain section before the second process could load that section of the data into memory or write the data to a file. -
New Multi-OS/CPU aware virus broke through virtualbox. For a reason.FYI
FYI (all)
Dear sir (RMS @ GNU),
my apologies. That e-mail concerned the embedding (secretly) of personal information during the make process of certain gnu software but there's a new developent and I'm extremely mad : I have been looking for ways to de-obscurify certain (gnu) Make processes. During my search I found a certain GITHUB repo that provided a way to do that. It was not "AO" but another... In reality it was a virus and/or a magic trigger that broke and destroyed All my systems in a manner of 2 hours or so.
It's a special case, methods used are not mentioned anywhere on internet. This one is multi-os aware and broke through a running virtualbox installation (I suppose via I/O hooks exploits yet unknown ). Both host and guest gets destroyed, independant of OS!
from what I have seen:
- the maker has somehow trojaned the Freedesktop.org desktop-daemon- input dbus helper software to gain and maintain root via init. Virtually everydebian based is thereby vulrenable.
- the maker has found a new way (unknown to every antivirus software) to gain Admin acces to windows system via lowlevel IO and/or abused "signed drivers" - and mmaps itselfs there to propagate..
- the virus broke through running virtualbox installations (latest installation, new installations, old VDI's) and they got all destroyed, first guest and hours or days later both host and guest installations.... also new.
- the virus injects itself on every network IF / download / and propagates on installation (triggered) within the virtualbox installation. This happens on the host too, but hours later.
- it eventually kills every document on every OS by spawning hundreds of processes to kill documents (overwrite, move, symlink)
The strange thing about this, is that GNU sources / software like the sourcecode for GLIBC and GCC was left alone! Because of that and the mentioning of GNU on that repo I contacted GNU. On my windows system there was even a special message "Thanks to Freedesktop and embedded Ruby".
The virus was obviously not meant for worldwide propagation but to target a certain audience (I suppose people like me), it's been engineered beyond belief and I triggered it somehow. In order to clean my system I tried a ISO/USB boot from AVG (linux based.) I booted from that USB and it got infected upon scanning... amazing.!!
Anyhow.. sorry to have bothered you.
Regards,
To microsoft: Windows : is trojaned via virtualbox Usb I/O and/or other lowlevel I/O trickery. Obviously new methods are used, hard to reproduce and I can only mention a few details : virtualbox breakage like this is not yet mentioned anywhere and no admin priviledges are needed to reproduce. this "virus" has no signature known to clamav/kaspersky/mssc/avg/macafee. New exploits are obviously used, unknown and/or used in a similar manner. Microsoft should investigate this on their own.
To FreeDesktop DBUS daemon: has been abused (and this darn thing is used in many debian based INIT scripts etc, in order to gain and maintain root (or worse). There was a note left on my system "thanks to freedesktop and embedded...": every Linux instance, new or old (2.6 to 3.2xxx was infected immediately). FreeDesktop: I *** your** because similar trickery is mentioned since 2009.
To certain people at Debian: thanks for not taking me seriously or even understand what you are doing. Clueless.
To Oracle: Every HOST that mounts an infected VDI, gets infected immediately upon boot. Or the other way around: upon scanning the filesystem. The scanning OS itself gets trojaned (reproduced via multiple USB installations/Gpart ISO, AVG iso) and gets destroyed . Even within virtualbox ..... the ISO grows to hunderds of gigs. Virtually. I suppose it's hooked via USB transport to gain accces over keyboard and mouse. In fact it doent matter what OS is used, the killing process is "universal" because it happens within the hooked kernelspace.
To reproduce : I cannot give much details and its hard to traceback or reconstuct the order of events but I wanted to look for a way to de-obscurify a certain gnu-make process (in particular a piece of GNU software (for ..keys) from which I suspected to embed privacy information about the user and this software is used on virtually every OS and in many software packages as building block. And I certainly found one. I guess some magic 0xUL that passed my system or action I did -triggered this OS independant chainreaction or "OSkiller" process. I should have suspected this.. well. Even github trickery was (AB)used ~/.git / gitprocesses are used for some reason because every new download got the "make" process treatment instantly. Tricks to use parts of sha1 signatures (actually the gitters identification. Some people are aware of these methods and are abusing this system, not to "watermark" but to pull off this kind of work?
The result: all my virtual Linux / Freebsd VDI/VMDK installations were completely destroyed within a manner of minutes and later the host (windows7, regular update cycle, well maintained and secured) too. It was hard to traceback and/or/try forensics because the host got infected too -- obviously no way to sandbox. (maybe I'm not clever enough). Mounting from another OS is killing that OS too. Amazing. The reason I wanted to traceback or mount a certain partition was because it contained my work on my research. I had backups (even incremental) of some instances and they all got destroyed too (unaware of the systemhooks that were luring for the magic).
Reproducable? Yes. But hard to pull off and therefore I suppose this "virus" is not meant to propagate worldwide but targetted at a certain audience. The maker(s) has/have deep profound knowledge of windows internals, virtualbox exploits,, linux exploits, methods not seen by any anti-vir software I got running. It means there's a whole bunch of multi-os exploits, application exploits, not used or mentioned anywhere, bundled in a well prepared trap for anyone who gets the magic. I still have the infected VDI's. cannot tell if they are completely destroyed because I dare not mount it in ANY way. (I tried virtually every way possible!!!!!). Forensics could do some work on the raw material.
Here's a brief list of software that must have already been trojaned / to kill the running OS's (on host/guest) of a target:
- "nonfree" linux-firmware. Certain IO/dev (dbus?) userspace layers (linux)
- linux or windows virtualbox guest addition(s): CERTAIN debian updates (* triggers the killing process). Especially the RE-make of IO kernelmods process caused a chainreaction in one case. The maker(s) did some magic there because one should assume that KERNEL code is well maintained (like Theo.d.r. does :-) )
- (gnu) remake processes of kernel mods (RT/Pre-emt) -> guest additions. I could only reproduce this a few times because my host got killed.
- github trickery....
- techniques: callbacks via IO hooks on both HID and available network devices and injects itself via sockets (because every download was infected)
- I suppose no known shellcode was used or not recognised. Every virusscanner that I got running got killed and infected upon scan, both windows and linux based, clamav and AVG mssc, macafee, kaspersky etc etc. Even a simple mount gets a host killed. Amazing.
and all of this must have been "packaged" for a special occasion? Its profoundly layered, multi-disciplined and networked (I guess there are more related triggers to this network) and this OS killer must have been ready or "waiting" for months, none of the exploits I've witnessed are mentioned on internet or have been used on seperate occasions (except for the dbus trickery: there have been rumors but no real actions by ubuntu or debian etc etc). All these multi-cpu/os/software exploits (means transports) events that happened on my systems, both metal and virtual, are not mentioned anywhere or seperately used on other occasions or else someone would have mentioned it? Even the slightest kernel breakage or trojaned kernel in this respect should gained prestige for certain w/b hat hackers. This is beyond belief. The guest/host breakage is amazing, multi-os and the killer does its work profoundly.
- so oracle can deal with this virtualbox breakage from host to guest and vice versa
- linus gets his multi-OS io / kernelspace breakage, kills of every mount or gets triggered by even mmapping.
- microsoft no idea.... no blame this should have been recognised within the security framework, but there's obviously not yet a signature known.
I don't know if I should call this a virus. It uses virus-like techniques but on so many levels happening at once. I dont think oracle or microsoft or linux / freebsd /solaris is targetted. It looks like a well contained (only propagating on the host/guest, even socks are targetted only at localhost) - trap, the killing process is very persistant and for a reason. If this was used in a network-propagating carrier virus it should raise a Major worldwide alert. I think this unknown network of suddenly revealed exploits are means to immediatly shutdown/completely kill the running system(s) of a certain audience (like me). It's like a network and eventually a killswitch, a "destroyer" which I happened to trigger while I was investigating some things concerning privacy issues (in fact building blocks for signing of public keys). This message should raise some questions.
And about that github repo. It's not AO.
Thats all folks.
0XWe would really like to debug your problem but the provided information is not sufficient and very hard to parse. A few questions:
- Which version of VirtualBox are you using?
- What host systems did you use to test, only Windows 7 or also other systems?
- Did you try to use an infected .vdi disk with a fresh installation of VirtualBox on a fresh host?
- Which guest is affected (exact version please)?
- You report that even your host will be infected (breaking through from a VirtualBox guest to a host). Did you do scan your host for viruses before you started your guest so you can be 100% sure that your host was clean before it was infected by the guest?
- When scanning the infected system with a Linux-based virus scanner: Did the scan report any problems? If so, which? And did you consider to use a virus scanner on a read-only boot medium? In the latter case it is impossible that the virus scanner gets infected.
I would appreciate if you could answer these questions, there could be more questions once I have the answers to these. But please, try to be precise and short when answering the questions.
Maybe you are looking for
-
Automatic clearing in electronic banking
Hi all, I'm working with the electronic banking program to import statements and want to clear items from sub ledger accounts automatically. From the tests I have done so far, it seems that SAP always tries to locate the business partner via the bank
-
Photosmart 6520 64bit drivers for windows xp pro
Can't turn up any drivers for my new 6520 on my older XP PRO 64 bit system... Any help out there ?
-
Need help with converting PDF files to word document.
When attempting to convert PDF files to word document, after clicking on "convert" a message "error occurred while signing in" displays. Don't know why??? I'm logged into my account and haven't been able to convert documents.
-
i have a developed a script to start the workflow mailer whenever it gets down. when i run the unix script i get the error.please help me to seolve this issue. $ ./workflow_status.sh orcl10 DEACTIVATED_USER ./workflow_status.sh[22]: syntax error at l
-
How to report that my ipod was stolen
my ipod was stolen but has a password on it can anybody help me track it with mobile me on it