Memory usage Common table Expressions

Hope view will use temporary memory while using it.. and
If I use Common table Expressions (with <datsetname> select query )
in stored procedure instead of view will it use the temp memory ?
Many thanks
Kalinga

Why would it be any different? Its still a query. It will use any memory available for sorting
(defined by sort_area_size)
and if it exceeds this it will use the temporary tablespace.
If their is more than one temporary tablespace , it will use the temporary tablespace which that user has been assigned.

Similar Messages

Create a view using common table expressions

I'm having trouble finding out if this is even possible in Oracle.
Here is what I'm trying to accomplish with my view. A subject takes a survey numerous times across numerous dates. Depending on the responses to different questions, that subject is marked as having a set disease or affliction. The view that I'm building collects the necessary answers for each survey into one place (the first common table expression), then in subsequent CTEs, I'm adding the disease classification when the responses to the needed questions match. Sometimes the requirements state that the survey can't already be positive for other diseases, meaning that I need to ultimately discount them when checking subsequent diseases (each disease is built using it's own CTE of which there are 13). I built the query which performs these tasks with no problems. It runs and gives the responses that I'm looking for.
The problem comes into play when I attempt to wrap the existing working query into a create view process. When I add CREATE OR REPLACE VIEW TESTENV.TESTVIEW AS ( and the ending ); after the query, it is giving me the error: ORA-32034: unsupported use of WITH clause.
Am I getting the error simply because I can't put CTE's into views, or is it because the syntax for putting CTEs into Views is different than a normal view build process? Also, in case it makes a difference, the version of Oracle I'm using is: Oracle 10g.
Thank you.

Here is the view that I'm trying to build:
<pre class="jive-pre">
CREATE OR REPLACE VIEW GI_DEV.PAIN_COMP AS (
WITH gatheredQuestions AS (
SELECT
s.date_of_survey_id,
a.question_1 as A_1,
a.question_5 as A_5,
a.question_6 as A_6,
a.question_7 as A_7,
a.question_8 as A_8,
a.question_9 as A_9,
a.question_10 as A_10,
a.question_12 as A_12,
a.question_13 as A_13,
a.question_14 as A_14,
a.question_15 as A_15,
a.question_16 as A_16,
b.question_1 as B_1,
b.question_4 as B_4,
b.question_5 as B_5,
b.question_6 as B_6,
b.question_7 as B_7,
b.question_8 as B_8,
b.question_9 as B_9,
b.question_11 as B_11,
b.question_12 as B_12,
b.question_13 as B_13,
b.question_14 as B_14,
b.question_15 as B_15,
b.question_16 as B_16,
b.question_16a_a as B_16a_a,
b.question_16a_b as B_16a_b,
b.question_16a_c as B_16a_c,
b.question_16a_d as B_16a_d,
b.question_16a_e as B_16a_e,
b.question_16a_f as B_16a_f,
b.question_16b as B_16b,
c.question_1 as C_1,
c.question_2 as C_2,
c.question_3 as C_3,
c.question_8 as C_8,
c.question_9 as C_9,
c.question_10 as C_10,
c.question_11 as C_11,
c.question_11a as C_11a,
c.question_11b as C_11b,
d.question_1 as D_1,
d.question_2 as D_2,
d.question_3 as D_3,
d.question_4 as D_4,
d.question_5 as D_5,
d.question_5a as D_5a,
d.question_5b as D_5b,
d.question_5c as D_5c,
d.question_6 as D_6,
d.question_6a as D_6a,
d.question_6b as D_6b,
d.question_6c as D_6c,
d.question_6d as D_6d
FROM
new_date_of_survey s
LEFT OUTER JOIN new_section_a a on a.solid_visit_a_id = s.date_of_survey_id
LEFT OUTER JOIN new_section_b b on b.solid_visit_b_id = s.date_of_survey_id
LEFT OUTER JOIN new_section_c c on c.solid_visit_c_id = s.date_of_survey_id
LEFT OUTER JOIN new_section_d d on d.solid_visit_d_id = s.date_of_survey_id
), functDyspepsia as (
SELECT
date_of_survey_id,
'Functional Dyspepsia' as pain_type
FROM gatheredQuestions g
WHERE
g.A_1 in (4, 5)
and g.A_5 in (3, 4, 5, 6)
and g.A_6 in (0, 2, 3)
and (g.A_7 in (0, 2) and g.A_8 in (0,2))
and (g.A_9 in (0, 2) and g.A_10 in (0, 2))
), IBSLower as (
SELECT
date_of_survey_id,
'IBS Lower' as pain_type
FROM gatheredQuestions g
WHERE
g.B_1 in (3, 4, 5)
and g.B_4 in (2, 3, 4, 5, 6)
and 2 <= (CASE WHEN g.B_5 in (3, 4, 5) THEN 1 ELSE 0 END) + (CASE WHEN (g.B_6 in (3, 4, 5) and g.B_7 not in (3, 4, 5)) or (g.B_6 not in (3, 4, 5) and g.B_7 in (3, 4, 5)) THEN 1 ELSE 0 END) + (CASE WHEN (g.B_8 in (3, 4, 5) and g.B_9 not in (3, 4, 5)) or (g.B_8 not in (3, 4, 5) and g.B_9 in (3, 4, 5)) THEN 1 ELSE 0 END)
), IBSUpper as (
SELECT
date_of_survey_id,
'IBS Upper' as pain_type
FROM gatheredQuestions g
WHERE
g.A_1 in (3, 4, 5)
and g.A_5 in (3, 4, 5, 6)
and 2 <= (CASE WHEN g.A_6 in (3, 4, 5) THEN 1 ELSE 0 END) + (CASE WHEN (g.A_7 in (3, 4, 5) and g.A_8 not in (3, 4, 5)) or (g.A_7 not in (3, 4, 5) and g.A_8 in (3, 4, 5)) THEN 1 ELSE 0 END) + (CASE WHEN (g.A_9 in (3, 4, 5) and g.A_10 not in (3, 4, 5)) or (g.A_9 not in (3, 4, 5) and g.A_10 in (3, 4, 5)) THEN 1 ELSE 0 END)
), abMigraine as (
SELECT
date_of_survey_id,
'Abdominal Migraine' as pain_type
FROM gatheredQuestions g
WHERE
g.B_16 in (3, 4, 5)
and 2 <= ((CASE WHEN g.B_16a_a = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.B_16a_b = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.B_16a_c = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.B_16a_d = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.B_16a_e = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.B_16a_f = 2 THEN 1 ELSE 0 END))
and g.B_16b = 2
), lowerFunctAbPainSyndrome as (
SELECT
date_of_survey_id,
'Functional Abdominal Pain Syndrome - Lower' as pain_type
FROM gatheredQuestions g
WHERE
g.B_1 in (4, 5)
and g.B_4 in (3, 4, 5, 6)
and date_of_survey_id not in (select date_of_survey_id from functDyspepsia union select date_of_survey_id from abMigraine union select date_of_survey_id from IBSLower union select date_of_survey_id from IBSUpper)
and
((g.B_15 in (2,3,4,5) and 2 > ((CASE WHEN g.B_11 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.B_12 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.B_13 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.B_14 in (2,3,4,5) THEN 1 ELSE 0 END)))
or (g.B_15 not in (2,3,4,5) and 2 <= ((CASE WHEN g.B_11 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.B_12 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.B_13 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.B_14 in (2,3,4,5) THEN 1 ELSE 0 END))))
), upperFunctAbPainSyndrome as (
SELECT
date_of_survey_id,
'Functional Abdominal Pain Syndrome - Upper' as pain_type
FROM gatheredQuestions g
WHERE
g.A_1 in (4, 5)
and g.A_5 in (3, 4, 5, 6)
and date_of_survey_id not in (select date_of_survey_id from functDyspepsia union select date_of_survey_id from abMigraine union select date_of_survey_id from IBSLower union select date_of_survey_id from IBSUpper)
and
((g.A_16 in (2,3,4,5) and 2 > ((CASE WHEN g.A_12 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.A_13 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.A_14 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.A_15 in (2,3,4,5) THEN 1 ELSE 0 END)))
or (g.A_16 not in (2,3,4,5) and 2 <= ((CASE WHEN g.A_12 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.A_13 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.A_14 in (2,3,4,5) THEN 1 ELSE 0 END) + (CASE WHEN g.A_15 in (2,3,4,5) THEN 1 ELSE 0 END))))
), lowerFunctAbPain as (
SELECT
date_of_survey_id,
'Functional Abdominal Pain - Lower' as pain_type
FROM gatheredQuestions g
WHERE
g.B_1 in (3, 4, 5)
and g.B_4 in (3, 4, 5, 6)
and date_of_survey_id not in (select date_of_survey_id from functDyspepsia union select date_of_survey_id from abMigraine union select date_of_survey_id from IBSLower union select date_of_survey_id from IBSUpper union select date_of_survey_id from upperFunctAbPainSyndrome union select date_of_survey_id from lowerFunctAbPainSyndrome)
), upperFunctAbPain as (
SELECT
date_of_survey_id,
'Functional Abdominal Pain - Upper' as pain_type
FROM gatheredQuestions g
WHERE
g.A_1 in (3, 4, 5)
and g.A_5 in (3, 4, 5, 6)
and date_of_survey_id not in (select date_of_survey_id from functDyspepsia union select date_of_survey_id from abMigraine union select date_of_survey_id from IBSLower union select date_of_survey_id from IBSUpper union select date_of_survey_id from upperFunctAbPainSyndrome union select date_of_survey_id from lowerFunctAbPainSyndrome)
), functConstipation as (
SELECT
date_of_survey_id,
'Functional Constipation' as pain_type
FROM gatheredQuestions g
WHERE
2 <= ((CASE WHEN g.C_1 in (0, 2) THEN 1 ELSE 0 END) + (CASE WHEN (g.C_2 in (2,3) and g.C_3 <> 2) or (g.C_2 not in (2, 3) and g.C_3 = 2) THEN 1 ELSE 0 END) + (CASE WHEN g.C_8 = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.C_9 in (3, 4, 5) THEN 1 ELSE 0 END) + (CASE WHEN g.C_10 = 2 THEN 1 ELSE 0 END) + (CASE WHEN g.C_11 in (4, 5, 6) THEN 1 ELSE 0 END))
and date_of_survey_id not in (select date_of_survey_id from IBSLower union select date_of_survey_id from IBSUpper)
), fecalIncontinence as (
SELECT
g.date_of_survey_id,
'Nonretentive Fecal Incontinence' as pain_type
FROM
gatheredQuestions g
left outer join new_date_of_survey s on s.date_of_survey_id = g.date_of_survey_id
left outer join new_demographics d on d.solid_demographics_id = s.demo_id
WHERE
4 <= trunc((months_between(s.survey_date, d.date_of_birth))/12)
and g.C_11 in (4, 5, 6)
and g.C_11a in (2, 3)
and g.C_11b in (3, 4, 5, 6)
and g.date_of_survey_id not in (select date_of_survey_id from functConstipation)
), aerophagia as (
SELECT
date_of_survey_id,
'Aerophagia' as pain_type
FROM gatheredQuestions g
WHERE
2 <= ((CASE WHEN (g.D_1 in (3, 4, 5) and g.D_2 not in (3, 4, 5)) or (g.D_1 not in (3, 4, 5) and g.D_2 in (3, 4, 5)) THEN 1 ELSE 0 END) + (CASE WHEN g.D_3 in (3, 4, 5) THEN 1 ELSE 0 END) + (CASE WHEN g.D_4 in (3, 4, 5) THEN 1 ELSE 0 END))
), cycVomitSyndrome as (
SELECT
date_of_survey_id,
'Cycllic Vomiting Syndrome' as pain_type
FROM gatheredQuestions g
WHERE
g.D_5 in (4, 5)
and g.D_5a in (3, 4, 5, 6)
and g.D_5b = 2
and g.D_5c = 2
), adolRumSyndrome as (
SELECT
date_of_survey_id,
'Adolescent Rumination Syndrome' as pain_type
FROM gatheredQuestions g
WHERE
g.D_6 in (4, 5)
and g.D_6a = 2
and g.D_6b = 0
and g.D_6c = 0
and g.D_6d = 0
), gatheredPains as (
+
select * from functDyspepsia
union
select * from IBSLower
union
select * from IBSUpper
union
select * from abMigraine
union
select * from lowerFunctAbPainSyndrome
union
select * from upperFunctAbPainSyndrome
union
select * from lowerFunctAbPain
union
select * from upperFunctAbPain
union
select * from functConstipation
union
select * from fecalIncontinence
union
select * from aerophagia
union
select * from cycVomitSyndrome
union
select * from adolRumSyndrome
SELECT
date_of_survey_id,
string_agg(pain_type) as PainType
FROM gatheredPains
GROUP BY date_of_survey_id
</pre>
I tried remove the leading and ending parenthesis, and ended up getting the error that it is missing the select keyword. When I take the create view step out of this, the query builds with no problem, so I know that it's not missing a select or that it isn't in the correct place.
Thank you for all your help so far.

Using Common Table Expressions in BO Universe

Hi All,
How to use Using Common Table Expressions(CTE) in BO Universe ?
i created the stored procedure and tried to use it in universe but i'm not able to.
Request you to help me out with this.
Regards,
Ravichandra K

Did you get a chance to look at this guide chapter 7?
[http://help.sap.com/businessobject/product_guides/boexir31/en/xi3-1_designer_en.pdf]
Bashir Awan

Common table expression

Hi,
In DB2, there is a concept called 'common table expressions'.
A common table expression is like a temporary view that is defined and used for the duration of an SQL statement. You can define a common table expression for the SELECT, INSERT, and CREATE VIEW statements. Each common table expression must have a unique name and be defined only once. However, you can reference a common table expression many times in the same SQL statement.
Eg :--
insert into test1 with test_view1(column2) as (select colum1 * 2 from test2) select column2 from test_view1;
Here 'test_view1' is a temporary view created with a select statement. This view has the scope only within this SQL statement. The data inserted into the table 'test1' is selected from the temporary view.
This can be achieved in Oracle by creating views and then using the INSERT .. SELECT statement. But I like to know whether any direct equivalent available for this in Oracle, something like 'INSERT .. WITH <view_name>' as in DB2.
Please advise,
Thanks,
Smitha

Er...you mean like this?
Oracle9i Enterprise Edition Release 9.2.0.6.0 - 64bit Production
JServer Release 9.2.0.6.0 - Production
SQL> INSERT INTO emp
2     WITH v_emp AS
3          (SELECT empno + 1, ename, job, mgr,
4                  hiredate, sal, comm, deptno
5           FROM   emp)
6     SELECT *
7     FROM   v_emp;
14 rows created.
SQL> No, nothing like that whatsoever.

Datatypes in a recursive common table expression

I'm trying to use a (recursive) common table expression to generate a list of dates. The following code is working fine with 11.2
WITH dates ( nr, dt ) AS (
    SELECT 1, DATE '2005-02-01'
    from dual
    UNION ALL
    SELECT d.nr + 1, DATE '2005-02-01' + 1
    FROM dates d
    WHERE d.nr < 30
SELECT dt
FROM dates;But I would like to avoid repeating the start date in the recursive part, and I tried the following:
WITH dates ( nr, dt ) AS (
    SELECT 1, DATE '2005-02-01'
    from dual
    UNION ALL
    SELECT d.nr + 1, d.dt + 1
    FROM dates d
    WHERE d.nr < 30
SELECT dt
FROM dates;But I get the following error: ORA-01790: expression must have same datatype as corresponding expression
Now from my understanding the datatype should be DATE for both parts of the UNION.
I also tried it with d.dt + interval '1' day but that produces the same error message. using to_date() instead of the ANSI date literal does not change it either.
What am I missing here?

castorp wrote:
I'm trying to use a (recursive) common table expression to generate a list of dates. The following code is working fine with 11.2
WITH dates ( nr, dt ) AS (
SELECT 1, DATE '2005-02-01'
from dual
UNION ALL
SELECT d.nr + 1, DATE '2005-02-01' + 1
FROM dates d
WHERE d.nr < 30
SELECT dt
FROM dates;But I would like to avoid repeating the start date in the recursive part, and I tried the following:
WITH dates ( nr, dt ) AS (
SELECT 1, DATE '2005-02-01'
from dual
UNION ALL
SELECT d.nr + 1, d.dt + 1
FROM dates d
WHERE d.nr < 30
SELECT dt
FROM dates;But I get the following error: ORA-01790: expression must have same datatype as corresponding expression
Now from my understanding the datatype should be DATE for both parts of the UNION.
I also tried it with d.dt + interval '1' day but that produces the same error message. using to_date() instead of the ANSI date literal does not change it either.
What am I missing here?http://www.orafaq.com/forum/mv/msg/95011/463394/102589/#msg_463394

What happens to unused common table expressions ,Does this affect in performance or ?

If I write a query with one or more common table expressions to which I
don't actually refer in the query, do they just get pruned off or do
they get executed regardless? how does it affect in performance
Prem Shah

Try below
seems when the CTE is not refer in the query then statement inside CTE is not executing at all even if it nested CTE, see for your self
Create table UserInfo
UserId int primary key,
UserName varchar(30)
GO
Create table UserInfo1
UserId int primary key,
UserName varchar(30)
GO
insert into UserInfo
select 1001,'X1' union all
select 1002,'X2' union all
select 1009 ,'X9'
GO
insert into UserInfo1
select 1001,'X1' union all
select 1002,'X2' union all
select 1009 ,'X9'
GO
SET TRANSACTION ISOLATION LEVEL SERIALIZABLE
GO
Begin tran
select * from UserInfo1 where UserId between 1001 and 1009
and UserName = 'XXXX'
--Commit
PRINT 'WITH out CTE access in select'
SET STATISTICS IO ON
;WITH CTE1 AS
(Select * From UserInfo1)
select * From UserInfo
PRINT 'WITH CTE access in select'
;WITH CTE1 AS
(Select * From UserInfo1)
select * From UserInfo a inner join CTE1 b on a.UserId=b.UserId
Stats IO
    WITH out CTE access in select
    (3 row(s) affected)
    Table 'UserInfo'. Scan count 1, logical reads 2, physical reads 0, read-ahead reads 0, lob logical reads 0, lob physical reads 0, lob read-ahead reads 0.
    (1 row(s) affected)
    WITH CTE access in select
    (3 row(s) affected)
    Table 'UserInfo1'. Scan count 0, logical reads 6, physical reads 0, read-ahead reads 0, lob logical reads 0, lob physical reads 0, lob read-ahead reads 0.
    Table 'UserInfo'. Scan count 1, logical reads 2, physical reads 0, read-ahead reads 0, lob logical reads 0, lob physical reads 0, lob read-ahead reads 0.
    (1 row(s) affected)
Thanks
Saravana Kumar C

Using Common Table Expressions (CTE) in a DSV Named Query

Hi,
I have a scenario where I need to "generate" fact data, so I'm using a CTE to generate the data. For maintainability reasons I have this CTE declared inside a view and in the DSV Named Query I just have a SELECT * FROM FactView.
This works fine as long as the recursion level falls within the default limit of 100. If it does not, I have to specify the maximum recursion level such as:
SELECT *
FROM FactView
OPTION (MAXRECURSION 0)
The problem is I can't specify the Named Query like this. As explained elsewhere my query is embeded as a subquery and the OPTION keyword cannot be used in a subquery.
Is there any other way I can specify the maximum recursion level on a Named Query?

Load your fact table data into staging table and then process fact using direct load from staging table.

Extracting Metadata using Common Table Expressions MSSQL

I have been using the below SQL query to extract subsets of the Metadata structure from several dimensions in HFM. The process works well and is simple/quick to develop and incorporate in existing processes. I am curious if anyone else has been using a similar query to extract subsets of HFM Structure directly from HFM or other approaches to extract a subset of HFM Structure.
/*     The query starts with a "Top Parent" and will return all parent/child information below that member. For this example I want all the metadata for the c1 dimension so I am using the top most parent which by default has an ID of -1. You can look up and member's id in the "APP_DIM_Item" table and use that as the "Top Parent" for the query. It is possible to correctly extract only a subset of the overall metadata for each dimension.
WITH dim (ItemID, ParentID, Level)
AS
SELECT
el.ItemID
,el.[ParentID]
,0 AS Level
FROM [<APP>CUSTOMLAYOUT] el
WHERE ParentID = -1 -- The "Top Parent" -1 will extract all metadata
          and lDimID = 1 -- Needed only for the custom dimensions.
UNION ALL
SELECT
     el.ItemID
,el.ParentID
,Level + 1 as Level
FROM [ <APP>_CUSTOM_LAYOUT] el
INNER JOIN dim AS d
ON el.ParentID = d.ItemID
where el.lDimID = 1 -- needed for the custom dimensions
/*     Once the structure is extracted to the temp dim table you can query back and
     join to the Item table to add addtional memeber details. If you leave the query as
     is you will only see the parent/child Unique ID and level informtaion.
-- Parent/Child ID Structure
SELECT * FROM dim
-- Parent/Child Label Structure
Select Dim.ItemID, Dim.ParentID, Dim.Level, Member.Label, Parent.Label
From Dim
inner JOIN <APP>CUSTOMITEM Member -- Member Detail
on Member.ItemID = dim.ItemID AND Member.lDimID = 1
inner JOIN <APP>CUSTOMITEM Parent -- Parent Detail
on Parent.ItemID = dim.ParentID AND Parent.lDimID = 1

Did you get a chance to look at this guide chapter 7?
[http://help.sap.com/businessobject/product_guides/boexir31/en/xi3-1_designer_en.pdf]
Bashir Awan

Nested tables and memory usage (ORA-04030 error)

Dear All,
I have table with approximately 5,000,000 records
and try to Bulk Collect part of it into nested table in PL/SQL, the code is bellow
Declare
     Type TcardRec Is Record(
          serno Pls_Integer,
          numberx Char(16),
          caccserno Pls_Integer
     Type TcardList Is Table Of TcardRec;
     fcardInfo TcardList;
Begin
Select c.serno, substr(c.numberx,1,16), c.caccserno
Bulk Collect Into fcardinfo
From cardx c;
End;
After reading approx. 80% it fails with error
ORA-04030: out of process memory when trying to allocate 16396 bytes (koh-kghu call ,pmucalm coll)
I 2G memory, is it realy no enough?
How can I tune memory usage for collection?
How can I estimate the maximum size of the collection the will fit into memory?
Thank you in advance for any help
Artem

Declare it as a cursor.
Open the cursor.
Use fetch bulk collect with the limit option in the loop.
In your case, you could do like:
Declare
Cursor c1 is
Select c.serno, substr(c.numberx,1,16), c.caccserno
From cardx c;
TcardList Is Table Of c1%rowtype;
fcardInfo TcardList;
Begin
Open c1;
Loop
Fetch c1 Bulk Collect Into fcardInfo Limit 10000;
Exit when c1%notfound;
-- Do some processing here.
End Loop;
Close c1;
End;
I hope this helps.

Memory usage of excel stays high after Macro is executed and excel crashes after trying to close it

Hi,
I'm trying to resolve an issue with an excel based tool. The macros retrieve data from an Oracle database and do calculations with the data. They also open and write into files in the same directory. The macros all run and finish the calculations. I can
continue to use and modify the sheet. I can also close the workbook, however excel memory usage I see in the windows Task manager stays elevated.If I close Excel it says: Excel stopped working and then it tries to recover information...
I assume something in the macro did not finish properly and memory was not released. I would like to check what is still open (connection, stream or any other object) when I close the workbook I would like to have a list of all still used memory. Is there
a possibility to do so.
Here the code I'm using, its reduced to functions which open something. Functions
get_v_tools() and get_change_tools() are same as get_client_positions().
Public conODBC As New ADODB.Connection
Public myPath As String
Sub get_positions()
Dim Src As range, dst As range
Dim lastRow As Integer
Dim myPath As String
lastRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row
Sheets("SQL_DATA").range("A2:AD" & lastRow + 1).ClearContents
Sheets("SQL_DATA").range("AG2:BE" & lastRow + 2).ClearContents
Sheets("SQL_DATA").range("AE3:AF" & lastRow + 2).ClearContents
k = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
Sheets("ToolsList").range("A2:M" & k).ClearContents
'open connection
Call open_connection
lastRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row
If lastRow < 2 Then GoTo ErrorHandling
'copy bs price check multiplications
Set Src = Sheets("SQL_DATA").range("AE2:AF2")
Set dst = Worksheets("SQL_DATA").range("AE2").Resize(lastRow - 1, Src.columns.Count)
dst.Formula = Src.Formula
On Error GoTo ErrorHandling
'new prices are calculated
newPrice_calculate (lastRow)
Calculate
myPath = ThisWorkbook.Path
'Refresh pivot table in Position Manager
Sheets("Position Manager").PivotTables("PivotTable3").ChangePivotCache ActiveWorkbook. _
PivotCaches.Create(SourceType:=xlDatabase, SourceData:= _
myPath & "\[Position_Manager_v1.0.xlsm]SQL_DATA!R1C2:R" & lastRow & "C31" _
, Version:=xlPivotTableVersion14)
ErrorHandling:
Set Src = Nothing
Set dst = Nothing
If conODBC.State <> 0 Then
conODBC.Close
End If
End Sub
Sub open_connection()
Dim sql_data, sql_data_change, sql_data_v As Variant
Dim wdth, TotalColumns, startRow As Integer
Dim rst As New ADODB.Recordset
Errorcode = 0
On Error GoTo ErrorHandling
Errorcode = 1
With conODBC
.Provider = "OraOLEDB.Oracle.1"
.ConnectionString = "Password=" & pswrd & "; Persist Security Info=True;User ID= " & UserName & "; Data Source=" & DataSource
.CursorLocation = adUseClient
.Open
.CommandTimeout = 300
End With
startRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row + 1
sql_data = get_client_positions(conODBC, rst)
wdth = UBound(sql_data, 1)
Sheets("SQL_DATA").range("A" & startRow & ":AA" & wdth + startRow - 1).Value = sql_data
'Run change tools instruments
startRow = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
sql_data_change = get_change_tools(conODBC, rst)
wdth = UBound(sql_data_change, 1)
Sheets("ToolsList").range("A" & startRow & ":M" & wdth + startRow - 1).Value _
= sql_data_change
'open SQL for V tools instruments
startRow = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
sql_data_v = get_v_tools(conODBC, rst)
wdth = UBound(sql_data_v, 1)
Sheets("ToolsList").range("A" & startRow & ":L" & startRow + wdth - 1).Value = sql_data_v
conODBC.Close
ErrorHandling:
If rst.State <> 0 Then
rst.Close
End If
Set rst = Nothing
End Sub
Private Function get_client_positions(conODBC As ADODB.Connection, rst_posi As ADODB.Recordset) As Variant
Dim sql_data As Variant
Dim objCommand As ADODB.Command
Dim sql As String
Dim records, TotalColumns As Integer
On Error GoTo ErrorHandling
Set objCommand = New ADODB.Command
sql = read_sql()
With objCommand
.ActiveConnection = conODBC 'connection for the commands
.CommandType = adCmdText
.CommandText = sql 'Sql statement from the function
.Prepared = True
.CommandTimeout = 600
End With
Set rst_posi = objCommand.Execute
TotalColumns = rst_posi.Fields.Count
records = rst_posi.RecordCount
ReDim sql_data(1 To records, 1 To TotalColumns)
If TotalColumns = 0 Or records = 0 Then GoTo ErrorHandling
If TotalColumns <> 27 Then GoTo ErrorHandling
If rst_posi.EOF Then GoTo ErrorHandling
l = 1
Do While Not rst_posi.EOF
For i = 0 To TotalColumns - 1
sql_data(l, i + 1) = rst_posi.Fields(i)
Next i
l = l + 1
rst_posi.MoveNext
Loop
ErrorHandling:
rst_posi.Close
Set rst_posi = Nothing
Set objCommand = Nothing
get_client_positions = sql_data
End Function
Private Function read_sql() As String
Dim sqlFile As String, sqlQuery, Line As String
Dim query_dt As String, client As String, account As String
Dim GRP_ID, GRP_SPLIT_ID As String
Dim fso, stream As Object
Set fso = CreateObject("Scripting.FileSystemObject")
client = Worksheets("Cover").range("C9").Value
query_dt = Sheets("Cover").range("C7").Value
GRP_ID = Sheets("Cover").range("C3").Value
GRP_SPLIT_ID = Sheets("Cover").range("C5").Value
account = Sheets("Cover").range("C11").Value
sqlFile = Sheets("Cover").range("C15").Value
Open sqlFile For Input As #1
Do Until EOF(1)
Line Input #1, Line
sqlQuery = sqlQuery & vbCrLf & Line
Loop
Close
' Replace placeholders in the SQL
sqlQuery = Replace(sqlQuery, "myClent", client)
sqlQuery = Replace(sqlQuery, "01/01/9999", query_dt)
sqlQuery = Replace(sqlQuery, "54747743", GRP_ID)
If GRP_SPLIT_ID <> "" Then
sqlQuery = Replace(sqlQuery, "7754843", GRP_SPLIT_ID)
Else
sqlQuery = Replace(sqlQuery, "AND POS.GRP_SPLIT_ID = 7754843", "")
End If
If account = "ZZ" Then
sqlQuery = Replace(sqlQuery, "AND AC.ACCNT_NAME = 'ZZ'", "")
Else
sqlQuery = Replace(sqlQuery, "ZZ", account)
End If
' Create a TextStream to check SQL Query
sql = sqlQuery
myPath = ThisWorkbook.Path
Set stream = fso.CreateTextFile(myPath & "\SQL\LastQuery.txt", True)
stream.Write sql
stream.Close
Set fso = Nothing
Set stream = Nothing
read_sql = sqlQuery
End Function

Thanks Starain,
that's what I did the last days and found that the problem is in the
newPrice_calculate (lastRow)
function. This function retrieves data (sets it as arrays) which was correctly pasted into the sheet, loops through all rows and does math/calendar calculations with cell values using an Add-In("Quantlib")
Public errorMessage as String
Sub newPrice_calculate(lastRow)
Dim Type() As Variant
Dim Id() As Variant
Dim Price() As Variant
Dim daysTo() As Variant
Dim fx() As Variant
Dim interest() As Variant
Dim ObjCalend as Variant
Dim newPrice as Variant
On Error GoTo Catch
interest = Sheets("SQL_DATA").range("V2:V" & lastRow).Value
Type = Sheets("SQL_DATA").range("L2:L" & lastRow).Value Id = Sheets("SQL_DATA").range("M2:M" & lastRow).Value Price = Sheets("SQL_DATA").range("T2:T" & lastRow).Value
daysTo = Sheets("SQL_DATA").range("K2:K" & lastRow).Value
fx = Sheets("SQL_DATA").range("U2:U" & lastRow).Value
qlError = 1
For i = 2 To lastRow
If (i, 1) = "LG" Then
'set something - nothing spectacular like
interest(i, 1) = 0
daysTo(i , 1) = 0
Else
adjTime = Sqr(daysTo(i, 1) / 365)
ObjCalend(i,1) =Application.Run("qlCalendarHolidaysList", _
"CalObj", ... , .... other input parameters)
If IsError(ObjCalend(i,1)) Then GoTo Catch
'other calendar calcs
newPrice(i,1) = Application.Run( 'quantLib calcs)
End If
Catch:
Select Case qlError
Case 1
errorMessage = errorMessage & " QuantLibXL Cal Error at: " & i & " " & vbNewLine & Err.Description
ObjCalend(i,1) (i, 1) = "N/A"
End Select
Next i
Sheets("SQL_DATA").range("AB2:AB" & lastRow).Value = newPrice
'Sheets("SQL_DATA").range("AA2:AA" & lastRow).Value = daysTo
' erase and set to nothing all arrays and objects
Erase Type
Erase id
Erase Price
Set newPrice = Nothing
Is there a possibility to clean everything in:
Private Sub Workbook_BeforeClose(Cancel As Boolean)
End Sub
Thanks in advance
Mark

Network stream fxp excess memory usage and poor performance

I'm trying to stream some datas à highspeed rate (3 channels à 1Mbytes/s) from my 9030 to my windows host. Because i don't need to use data on the rt side, i choose to forward FXP <+-,24,5> to my host throug a network stream.
To avoid data loose i choose to use a wide buffer of 6000000 with this buffer my memory usage grow from 441mo to 672Mo and my rio is unable to stream the data.
With sgl or double, memory usage is 441 to 491Mo and datas can be streamed continusly.
Anyone have encoutered this problem?

SQL Developer is java based and relies on the jvm's memory management.
I'm not aware of any memory leaks as such, but memory tends not to be returned to the system.
Queries which return large return sets tend to use a lot of memory (SQL Developer has to build a java table containing all the results for display).
You can restrict the maximum memory allocated by modifying settings in in <sqldeveloper>\ide\bin\ide.conf
The defaults are -
AddVMOption -Xmx640M
AddVMOption -Xms128M

How to analyse the main memory usage in SAP ERP systems?

Dear expert,
I'm doing a research work about analysing the main memory usage in SAP ERP systems.
I would like to find out what is load in buffers and when. That means, which process have the control of these memories and which are always performing something, tables loaded, and so on. Becuase I tried to isolate the space needed by a simple webservice call (create one material) in my test system, but even after a $SYN there are something stored in the buffers. I use a BAPI to avoid the execution of the SAPGUI and its repercussion in the system (I know the BAPI called uses resources too, but when I run this BAPI to get the statistics, it's like ST02, I get different values). Could someone help me or recommend something specific to read? Thanks a lot in advance.

Dear expert,
Thanks a lot for your answer. The point is now that I want to isolate the memory used by a webservice that I call, I mean, I would like to know how many memory is this webservice using in each buffer. And could you tell me where could I read something about the order that things happen in SAP System when a webservice is called (always memory related), that's which steps are done to store data in buffers and so on. Thanks in advance.

Sudden high memory usage, can't find cause

I did a big update yesterday, and today I've started to notice very high memory usage. I wasn't keeping track before so I can't say how much it increased, but I've never had problems before, and the slowness and lack of responsiveness have been noticeable, though I haven't ruled out other possible causes for that. Here's the output of 'free -m':
total used free shared buffers cached
Mem: 7971 7826 144 0 1 149
-/+ buffers/cache: 7674 296
Swap: 9215 458 8757
It wasn't as bad as that right after startup, though usage still seemed suspiciously high. What makes this whole thing a mystery to me is that none of my running processes seem to be using that much memory! Here's the output of 'top -b -n 1':
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1 root 20 0 32712 544 384 S 0.0 0.0 0:01.32 systemd
2 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kthreadd
3 root 20 0 0 0 0 S 0.0 0.0 0:02.48 ksoftirqd/0
5 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/0:0H
7 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/0
8 root 20 0 0 0 0 S 0.0 0.0 0:15.55 rcu_preempt
9 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_bh
10 root 20 0 0 0 0 S 0.0 0.0 0:00.00 rcu_sched
11 root rt 0 0 0 0 S 0.0 0.0 0:00.05 watchdog/0
12 root rt 0 0 0 0 S 0.0 0.0 0:00.04 watchdog/1
13 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/1
14 root 20 0 0 0 0 S 0.0 0.0 0:01.02 ksoftirqd/1
16 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/1:0H
17 root rt 0 0 0 0 S 0.0 0.0 0:00.04 watchdog/2
18 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/2
19 root 20 0 0 0 0 S 0.0 0.0 0:01.17 ksoftirqd/2
20 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kworker/2:0
21 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/2:0H
22 root rt 0 0 0 0 S 0.0 0.0 0:00.04 watchdog/3
23 root rt 0 0 0 0 S 0.0 0.0 0:00.00 migration/3
24 root 20 0 0 0 0 S 0.0 0.0 0:01.04 ksoftirqd/3
26 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/3:0H
27 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 khelper
28 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kdevtmpfs
29 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 netns
30 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 writeback
31 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 bioset
32 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kblockd
33 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 xenbus_frontend
35 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khungtaskd
36 root 20 0 0 0 0 S 0.0 0.0 0:06.75 kswapd0
37 root 25 5 0 0 0 S 0.0 0.0 0:00.00 ksmd
38 root 39 19 0 0 0 S 0.0 0.0 0:00.24 khugepaged
39 root 20 0 0 0 0 S 0.0 0.0 0:00.00 fsnotify_mark
40 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 crypto
44 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kthrotld
47 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 deferwq
49 root 20 0 0 0 0 S 0.0 0.0 0:00.21 kworker/1:1
61 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 ata_sff
63 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_0
65 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_1
68 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_2
69 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_3
70 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_4
71 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_5
76 root 20 0 0 0 0 S 0.0 0.0 0:00.00 khubd
81 root 20 0 0 0 0 S 0.0 0.0 0:00.02 kworker/3:2
93 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 firewire
94 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_6
95 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_7
96 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_8
97 root 20 0 0 0 0 S 0.0 0.0 0:00.00 scsi_eh_9
100 root 0 -20 0 0 0 S 0.0 0.0 0:01.31 kworker/0:1H
104 root 20 0 0 0 0 S 0.0 0.0 0:00.03 jbd2/sda3-8
105 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 ext4-dio-unwrit
119 root 20 0 182720 324 228 S 0.0 0.0 0:02.90 systemd-journal
130 root 20 0 32032 320 316 S 0.0 0.0 0:00.16 systemd-udevd
133 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kworker/1:2
150 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 rpciod
152 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 nfsiod
160 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/1:1H
162 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/3:1H
189 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 cfg80211
191 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 led_workqueue
216 root -51 0 0 0 0 S 0.0 0.0 0:00.00 irq/53-mei_me
220 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 kworker/2:1H
255 root 20 0 0 0 0 S 0.0 0.0 0:00.59 jbd2/sda2-8
256 root 0 -20 0 0 0 S 0.0 0.0 0:00.00 ext4-dio-unwrit
267 root 20 0 13236 340 260 S 0.0 0.0 0:00.02 crond
268 root 20 0 57644 524 232 S 0.0 0.0 0:00.07 syslog-ng
275 root 20 0 77896 2164 52 S 0.0 0.0 0:00.11 cupsd
276 root 20 0 32856 32 0 S 0.0 0.0 0:00.53 atieventsd
278 root 20 0 26120 452 448 S 0.0 0.0 0:00.00 systemd-logind
280 dbus 20 0 18040 1040 484 S 0.0 0.0 0:00.16 dbus-daemon
293 root 20 0 8156 32 28 S 0.0 0.0 0:00.04 agetty
294 root 20 0 22416 304 304 S 0.0 0.0 0:00.00 kdm
311 root 20 0 32332 52 0 S 0.0 0.0 0:00.10 wpa_supplicant
314 root 20 0 4252 44 28 S 0.0 0.0 0:02.61 acpid
363 root 20 0 233544 396 396 S 0.0 0.0 0:00.12 colord
370 root 20 0 0 0 0 S 0.0 0.0 0:00.00 firegl
371 root 20 0 0 0 0 S 0.0 0.0 0:00.00 firegl
372 root 20 0 0 0 0 S 0.0 0.0 0:00.00 firegl
379 root 20 0 8612 60 16 S 0.0 0.0 0:00.00 dhcpcd
462 redac 20 0 15212 68 0 S 0.0 0.0 0:00.37 gpg-agent
465 redac 20 0 12680 4 0 S 0.0 0.0 0:00.00 ssh-agent
504 root 20 0 229584 440 284 S 0.0 0.0 0:00.03 upowerd
507 polkitd 20 0 506832 916 700 S 0.0 0.0 0:00.09 polkitd
563 root 20 0 355656 1804 1044 S 0.0 0.0 0:01.50 udisksd
628 redac 20 0 2397180 17068 2004 S 0.0 0.2 0:04.86 mysqld
796 rtkit 21 1 168664 372 360 S 0.0 0.0 0:00.34 rtkit-daemon
873 pdnsd 20 0 172532 0 0 S 0.0 0.0 0:00.00 pdnsd
874 tor 20 0 49952 20556 2152 S 0.0 0.3 0:05.89 tor
1884 root 20 0 361452 118644 105076 S 0.0 1.5 1:21.43 X
1895 root 20 0 75048 660 656 S 0.0 0.0 0:00.00 kdm
1903 redac 20 0 13736 412 408 S 0.0 0.0 0:00.01 startkde
1912 redac 20 0 18016 324 320 S 0.0 0.0 0:00.00 dbus-launch
1913 redac 20 0 19220 1604 564 S 0.0 0.0 0:00.50 dbus-daemon
1959 redac 20 0 12680 52 48 S 0.0 0.0 0:00.00 ssh-agent
1976 root 20 0 4080 40 0 S 0.0 0.0 0:00.00 start_kdeinit
1977 redac 20 0 343772 1976 1420 S 0.0 0.0 0:00.07 kdeinit4
1978 redac 20 0 348392 2680 1824 S 0.0 0.0 0:00.04 klauncher
1980 redac 20 0 1262136 5352 3596 S 0.0 0.1 0:00.48 kded4
1991 redac 20 0 430604 4032 2840 S 0.0 0.0 0:00.11 kglobalaccel
1995 redac 20 0 694524 3020 2520 S 0.0 0.0 0:00.10 kactivitymanage
2000 redac 20 0 4216 44 44 S 0.0 0.0 0:00.00 kwrapper4
2001 redac 20 0 516344 3224 2300 S 0.0 0.0 0:00.10 ksmserver
2009 redac 20 0 422056 19640 15244 S 0.0 0.2 0:23.69 compiz
2012 redac 20 0 388168 7692 4544 S 0.0 0.1 0:01.26 emerald
2023 redac 20 0 280300 2500 2160 S 0.0 0.0 0:00.06 kuiserver
2025 redac 20 0 154132 1848 1344 S 0.0 0.0 0:00.24 akonadi_control
2027 redac 20 0 1949412 1984 1592 S 0.0 0.0 0:00.33 akonadiserver
2059 redac 20 0 346680 1408 1020 S 0.0 0.0 0:00.04 kio_http_cache_
2062 redac 20 0 769220 4932 3436 S 0.0 0.1 0:01.00 krunner
2071 redac 20 0 603092 4484 3132 S 0.0 0.1 0:00.16 kmix
2073 redac 20 0 285208 2680 2352 S 0.0 0.0 0:00.04 nepomukcontroll
2074 redac 20 0 359260 3148 2864 S 0.0 0.0 0:00.25 gtk-kde4
2077 redac 20 0 309608 2468 2220 S 0.0 0.0 0:00.05 akonadi_agent_l
2078 redac 20 0 309512 2332 2140 S 0.0 0.0 0:00.04 akonadi_agent_l
2079 redac 20 0 309496 2564 2336 S 0.0 0.0 0:00.05 akonadi_agent_l
2080 redac 20 0 309608 2476 2224 S 0.0 0.0 0:00.05 akonadi_agent_l
2081 redac 20 0 549804 3236 2480 S 0.0 0.0 0:00.13 akonadi_archive
2082 redac 20 0 303140 2480 2276 S 0.0 0.0 0:00.04 akonadi_agent_l
2083 redac 20 0 305600 2516 2300 S 0.0 0.0 0:00.05 akonadi_agent_l
2084 redac 20 0 314988 4144 3156 S 0.0 0.1 0:00.12 akonadi_imap_re
2099 redac 20 0 430912 15668 9912 S 0.0 0.2 0:09.39 yakuake
2100 redac 20 0 309676 2560 2308 S 0.0 0.0 0:00.04 akonadi_agent_l
2101 redac 20 0 339400 2860 2468 S 0.0 0.0 0:00.09 akonadi_maildis
2102 redac 20 0 549820 2828 2504 S 0.0 0.0 0:00.13 akonadi_mailfil
2103 redac 20 0 314052 2924 2508 S 0.0 0.0 0:00.09 akonadi_nepomuk
2115 redac 20 0 303056 2428 2240 S 0.0 0.0 0:00.04 akonadi_agent_l
2132 redac 20 0 2011628 14200 5716 S 0.0 0.2 0:18.21 ktorrent
2158 redac 20 0 15972 836 520 S 0.0 0.0 0:00.00 bash
2161 redac 20 0 1040928 6484 3060 S 0.0 0.1 0:00.53 knotify4
2162 redac 20 0 1962616 484928 23072 S 0.0 5.9 2:06.25 firefox
2176 redac 20 0 13732 344 340 S 0.0 0.0 0:00.00 rssowl
2178 redac 20 0 11344 404 404 S 0.0 0.0 0:00.00 RSSOwl
2193 redac 20 0 374420 2764 2516 S 0.0 0.0 0:00.06 polkit-kde-auth
2195 redac 20 0 3314212 140484 13196 S 0.0 1.7 0:24.29 java
2203 redac 9 -11 308256 2424 912 S 0.0 0.0 0:00.36 pulseaudio
2209 redac 20 0 406420 3544 2720 S 0.0 0.0 0:00.08 korgac
2233 redac 20 0 69156 420 420 S 0.0 0.0 0:00.00 gconf-helper
2235 redac 20 0 45676 836 564 S 0.0 0.0 0:00.01 gconfd-2
2236 redac 20 0 438044 4468 3128 S 0.0 0.1 0:00.13 klipper
2322 redac 20 0 193052 944 740 S 0.0 0.0 0:00.00 gvfsd
2336 redac 20 0 282112 644 644 S 0.0 0.0 0:00.00 gvfsd-fuse
2361 redac 20 0 263576 572 572 S 0.0 0.0 0:00.00 at-spi-bus-laun
2436 redac 20 0 3188512 61188 19352 S 0.0 0.7 0:16.98 plasma-desktop
2441 redac 20 0 9828 784 520 S 0.0 0.0 0:01.06 ksysguardd
2832 redac 20 0 15580 1240 784 S 0.0 0.0 0:02.93 top
2867 redac 20 0 15972 1796 1160 S 0.0 0.0 0:00.03 bash
2937 root 20 0 0 0 0 S 0.0 0.0 0:00.03 kworker/2:1
2938 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kworker/3:1
3336 root 20 0 0 0 0 S 0.0 0.0 0:00.25 kworker/u8:2
3643 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kworker/u8:1
3662 root 20 0 0 0 0 S 0.0 0.0 0:00.03 kworker/0:1
3703 root 20 0 0 0 0 S 0.0 0.0 0:00.00 kworker/0:0
3704 redac 20 0 15456 1308 992 R 0.0 0.0 0:00.00 top
32506 root 20 0 0 0 0 S 0.0 0.0 0:00.57 kworker/0:2
I wouldn't expect the '%MEM's to add up to exactly the real usage, but this isn't even close! So, what could be using up all of my memory? I have /tmp mounted to ram, but that's only a few megabytes. I really have no idea where to go from here.
The relevant portion of my pacman log is below, since I don't know how to get just a compact list of the updated packages. Most notably, the kernel was upgrades, from 3.9.9-1 to 3.10.3-1.
[2013-08-03 13:00] [PACMAN] Running 'pacman -Su'
[2013-08-03 13:00] [PACMAN] starting full system upgrade
[2013-08-03 13:38] [PACMAN] upgraded a52dec (0.7.4-6 -> 0.7.4-7)
[2013-08-03 13:38] [PACMAN] upgraded libmariadbclient (5.5.31-1 -> 5.5.32-1)
[2013-08-03 13:38] [PACMAN] upgraded mariadb-clients (5.5.31-1 -> 5.5.32-1)
[2013-08-03 13:38] [PACMAN] upgraded mariadb (5.5.31-1 -> 5.5.32-1)
[2013-08-03 13:38] [PACMAN] upgraded akonadi (1.10.0-2 -> 1.10.2-1)
[2013-08-03 13:38] [PACMAN] upgraded alsa-plugins (1.0.27-1 -> 1.0.27-2)
[2013-08-03 13:38] [PACMAN] upgraded alsa-utils (1.0.27.1-2 -> 1.0.27.2-1)
[2013-08-03 13:38] [PACMAN] upgraded x264 (20130206-1 -> 20130702-2)
[2013-08-03 13:38] [PACMAN] upgraded ffmpeg (1:1.2.1-1 -> 1:2.0-2)
[2013-08-03 13:38] [PACMAN] upgraded amarok (2.7.1-2 -> 2.7.1-3)
[2013-08-03 13:38] [PACMAN] upgraded anki (2.0.11-1 -> 2.0.12-1)
[2013-08-03 13:38] [PACMAN] upgraded apr (1.4.6-1 -> 1.4.8-1)
[2013-08-03 13:38] [PACMAN] upgraded glib2 (2.36.3-2 -> 2.36.3-3)
[2013-08-03 13:38] [ALPM] warning: /usr/lib/avahi/service-types.db installed as /usr/lib/avahi/service-types.db.pacnew
[2013-08-03 13:38] [PACMAN] upgraded avahi (0.6.31-9 -> 0.6.31-10)
[2013-08-03 13:38] [PACMAN] upgraded bison (2.7.1-1 -> 3.0-1)
[2013-08-03 13:38] [ALPM-SCRIPTLET] ---------------- I/O BUG ---------------------------------------
[2013-08-03 13:38] [ALPM-SCRIPTLET] There's a bug in fglrx found by lano1106 which generates
[2013-08-03 13:38] [ALPM-SCRIPTLET] great amount of unneeded I/O operations
[2013-08-03 13:38] [ALPM-SCRIPTLET]
[2013-08-03 13:38] [ALPM-SCRIPTLET] To activate workaround enable systemd service:
[2013-08-03 13:38] [ALPM-SCRIPTLET] systemctl enable temp-links-catalyst
[2013-08-03 13:38] [ALPM-SCRIPTLET] systemctl start temp-links-catalyst
[2013-08-03 13:38] [ALPM-SCRIPTLET]
[2013-08-03 13:38] [ALPM-SCRIPTLET] More infos:
[2013-08-03 13:38] [ALPM-SCRIPTLET] https://bbs.archlinux.org/viewtopic.php?pid=1279977#p1279977
[2013-08-03 13:38] [ALPM-SCRIPTLET] https://bbs.archlinux.org/viewtopic.php?pid=1280193#p1280193
[2013-08-03 13:38] [ALPM-SCRIPTLET] ----------------------------------------------------------------
[2013-08-03 13:38] [PACMAN] upgraded catalyst-utils (13.6-3 -> 13.8-1)
[2013-08-03 13:38] [ALPM-SCRIPTLET] + removing fglrx module from /usr/lib/modules/3.9.9-1-ARCH
[2013-08-03 13:38] [ALPM-SCRIPTLET] Building fglrx module for 3.9.9-1-ARCH kernel ...
[2013-08-03 13:38] [ALPM-SCRIPTLET] Ok.
[2013-08-03 13:38] [ALPM-SCRIPTLET] ----------------------------------------------------------------
[2013-08-03 13:38] [ALPM-SCRIPTLET] ATTENTION!
[2013-08-03 13:38] [ALPM-SCRIPTLET] ----------------------------------------------------------------
[2013-08-03 13:38] [ALPM-SCRIPTLET] To enable 'automatic re-compilation while system shutdown/reboot'
[2013-08-03 13:38] [ALPM-SCRIPTLET] testing feature run these commands as root:
[2013-08-03 13:38] [ALPM-SCRIPTLET] systemctl enable catalyst-hook
[2013-08-03 13:38] [ALPM-SCRIPTLET] systemctl start catalyst-hook
[2013-08-03 13:38] [ALPM-SCRIPTLET]
[2013-08-03 13:38] [ALPM-SCRIPTLET] More info here:
[2013-08-03 13:38] [ALPM-SCRIPTLET] https://bbs.archlinux.org/viewtopic.php?pid=1255575#p1255575
[2013-08-03 13:38] [ALPM-SCRIPTLET] ----------------------------------------------------------------
[2013-08-03 13:38] [PACMAN] upgraded catalyst-hook (13.6-3 -> 13.8-1)
[2013-08-03 13:38] [PACMAN] upgraded chromaprint (0.7-5 -> 0.7-6)
[2013-08-03 13:38] [PACMAN] upgraded nspr (4.9.6-1 -> 4.10-2)
[2013-08-03 13:38] [PACMAN] upgraded nss (3.14.3-3 -> 3.15.1-1)
[2013-08-03 13:38] [PACMAN] upgraded xdg-utils (1.1.0.git20121008-2 -> 1.1.0.git20130520-1)
[2013-08-03 13:38] [PACMAN] upgraded libgcrypt (1.5.2-1 -> 1.5.3-1)
[2013-08-03 13:38] [PACMAN] upgraded libpng (1.6.2-3 -> 1.6.3-1)
[2013-08-03 13:38] [PACMAN] upgraded xcb-proto (1.8-1 -> 1.8-2)
[2013-08-03 13:38] [PACMAN] upgraded libxcb (1.9.1-1 -> 1.9.1-2)
[2013-08-03 13:38] [PACMAN] upgraded libx11 (1.6.0-1 -> 1.6.1-1)
[2013-08-03 13:38] [PACMAN] upgraded giflib (4.2.1-3 -> 5.0.4-2)
[2013-08-03 13:38] [PACMAN] upgraded libwebp (0.3.1-2 -> 0.3.1-3)
[2013-08-03 13:38] [PACMAN] upgraded harfbuzz (0.9.18-1 -> 0.9.19-1)
[2013-08-03 13:38] [PACMAN] upgraded harfbuzz-icu (0.9.18-1 -> 0.9.19-1)
[2013-08-03 13:38] [PACMAN] upgraded chromium (28.0.1500.71-1 -> 28.0.1500.95-1)
[2013-08-03 13:38] [PACMAN] upgraded glew (1.9.0-2 -> 1.10.0-1)
[2013-08-03 13:38] [PACMAN] upgraded projectm (2.1.0-5 -> 2.1.0-6)
[2013-08-03 13:39] [PACMAN] upgraded clementine (1.1.1-8 -> 1.1.1-9)
[2013-08-03 13:39] [PACMAN] upgraded cln (1.3.2-1 -> 1.3.3-1)
[2013-08-03 13:39] [PACMAN] upgraded gstreamer (1.0.8-1 -> 1.0.9-1)
[2013-08-03 13:39] [PACMAN] upgraded gst-plugins-base-libs (1.0.8-1 -> 1.0.9-1)
[2013-08-03 13:39] [PACMAN] upgraded gst-plugins-bad (1.0.8-1 -> 1.0.9-1)
[2013-08-03 13:39] [PACMAN] upgraded clutter-gst (2.0.4-2 -> 2.0.6-1)
[2013-08-03 13:39] [PACMAN] upgraded colord (1.0.2-1 -> 1.0.2-2)
[2013-08-03 13:39] [PACMAN] upgraded cracklib (2.8.22-3 -> 2.9.0-1)
[2013-08-03 13:39] [PACMAN] upgraded dhcpcd (5.6.8-3 -> 6.0.4-1)
[2013-08-03 13:39] [PACMAN] upgraded dosfstools (3.0.20-1 -> 3.0.22-1)
[2013-08-03 13:39] [PACMAN] upgraded lib32-glew (1.9.0-1 -> 1.10.0-1)
[2013-08-03 13:39] [ALPM] warning: directory permissions differ on /opt/df_linux/
[2013-08-03 13:39] [PACMAN] upgraded dwarffortress (0.34.11-3 -> 0.34.11-4)
[2013-08-03 13:39] [PACMAN] upgraded jre7-openjdk-headless (7.u40_2.4.1-1 -> 7.u40_2.4.1-2)
[2013-08-03 13:39] [PACMAN] upgraded jre7-openjdk (7.u40_2.4.1-1 -> 7.u40_2.4.1-2)
[2013-08-03 13:39] [PACMAN] upgraded jdk7-openjdk (7.u40_2.4.1-1 -> 7.u40_2.4.1-2)
[2013-08-03 13:39] [PACMAN] upgraded eclipse (4.2.2-1 -> 4.3-1)
[2013-08-03 13:39] [PACMAN] upgraded emacs (24.3-2 -> 24.3-3)
[2013-08-03 13:39] [PACMAN] upgraded exempi (2.2.0-1 -> 2.2.1-1)
[2013-08-03 13:39] [PACMAN] upgraded fontforge (20120731_b-3 -> 20120731_b-6)
[2013-08-03 13:39] [PACMAN] upgraded fuse (2.9.2-3 -> 2.9.3-1)
[2013-08-03 13:39] [PACMAN] upgraded gegl (0.2.0-8 -> 0.2.0-9)
[2013-08-03 13:39] [PACMAN] upgraded git (1.8.3.3-1 -> 1.8.3.4-1)
[2013-08-03 13:39] [PACMAN] upgraded glib (1.2.10-9 -> 1.2.10-10)
[2013-08-03 13:39] [PACMAN] upgraded glib-perl (1.280-3 -> 1.301-1)
[2013-08-03 13:39] [PACMAN] upgraded glpk (4.48-1 -> 4.52-1)
[2013-08-03 13:39] [PACMAN] upgraded gnash-common (0.8.10-9 -> 0.8.10-10)
[2013-08-03 13:39] [PACMAN] upgraded ibus (1.5.2-2 -> 1.5.3-1)
[2013-08-03 13:39] [PACMAN] upgraded gnome-settings-daemon (3.8.3-2 -> 3.8.4-1)
[2013-08-03 13:39] [PACMAN] upgraded libqmi (1.4.0-1 -> 1.4.0-2)
[2013-08-03 13:39] [PACMAN] upgraded libmbim (1.2.0-1 -> 1.4.0-1)
[2013-08-03 13:39] [PACMAN] upgraded modemmanager (0.7.991-1 -> 1.0.0-1)
[2013-08-03 13:39] [PACMAN] upgraded gnome-control-center (3.8.3-1 -> 3.8.4.1-1)
[2013-08-03 13:39] [PACMAN] upgraded gnome-icon-theme (3.8.2-1 -> 3.8.3-1)
[2013-08-03 13:39] [PACMAN] upgraded gnutls (3.2.1-1 -> 3.2.3-1)
[2013-08-03 13:39] [PACMAN] upgraded gnome-vfs (2.24.4-6 -> 2.24.4-7)
[2013-08-03 13:39] [PACMAN] upgraded goffice (0.10.3-1 -> 0.10.4-1)
[2013-08-03 13:40] [PACMAN] upgraded gnumeric (1.12.3-1 -> 1.12.4-1)
[2013-08-03 13:40] [PACMAN] upgraded gst-plugins-base (1.0.8-1 -> 1.0.9-1)
[2013-08-03 13:40] [PACMAN] upgraded gst-plugins-good (1.0.8-1 -> 1.0.9-1)
[2013-08-03 13:40] [PACMAN] upgraded gstreamer0.10-ugly (0.10.19-5 -> 0.10.19-6)
[2013-08-03 13:40] [PACMAN] upgraded gstreamer0.10-ugly-plugins (0.10.19-5 -> 0.10.19-6)
[2013-08-03 13:40] [ALPM] warning: directory permissions differ on /var/log/hp/
[2013-08-03 13:40] [PACMAN] upgraded hplip (3.13.6-1 -> 3.13.7-1)
[2013-08-03 13:40] [PACMAN] upgraded idnkit (1.0-2 -> 1.0-3)
[2013-08-03 13:40] [PACMAN] upgraded ilmbase (2.0.0-1 -> 2.0.1-1)
[2013-08-03 13:40] [PACMAN] upgraded imlib2 (1.4.5-4 -> 1.4.5-5)
[2013-08-03 13:40] [PACMAN] upgraded iso-codes (3.43-1 -> 3.44-1)
[2013-08-03 13:40] [PACMAN] upgraded openexr (2.0.0-1 -> 2.0.1-1)
[2013-08-03 13:40] [PACMAN] upgraded media-player-info (17-1 -> 19-1)
[2013-08-03 13:40] [PACMAN] upgraded qtwebkit (2.3.1-2 -> 2.3.2-1)
[2013-08-03 13:40] [PACMAN] upgraded kdelibs (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdemultimedia-ffmpegthumbs (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-filesharing (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-kdnssd (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-kget (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-kopete (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-kppp (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-krdc (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kdenetwork-krfb (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:40] [PACMAN] upgraded kid3 (2.3-1 -> 2.3-2)
[2013-08-03 13:40] [ALPM-SCRIPTLET] ----------------------------------------------------------------
[2013-08-03 13:40] [ALPM-SCRIPTLET] lib32-catalyst-utils works with [multilib] repository
[2013-08-03 13:40] [ALPM-SCRIPTLET] ----------------------------------------------------------------
[2013-08-03 13:40] [PACMAN] upgraded lib32-catalyst-utils (13.6-1 -> 13.8-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-libx11 (1.6.0-1 -> 1.6.1-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-giflib (4.2.1-1 -> 5.0.4-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-gnutls (3.2.1-1 -> 3.2.3-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-harfbuzz (0.9.18-1 -> 0.9.19-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-libgcrypt (1.5.2-1 -> 1.5.3-1)
[2013-08-03 13:40] [PACMAN] upgraded libpciaccess (0.13.1-1 -> 0.13.2-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-libpciaccess (0.13.1-1 -> 0.13.2-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-libpng (1.6.2-1 -> 1.6.3-1)
[2013-08-03 13:40] [PACMAN] upgraded mesa (9.1.4-5 -> 9.1.6-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-mesa (9.1.4-1 -> 9.1.6-1)
[2013-08-03 13:40] [PACMAN] upgraded lib32-nspr (4.9.6-1 -> 4.10-2)
[2013-08-03 13:40] [PACMAN] upgraded lib32-nss (3.14.3-2 -> 3.15.1-1)
[2013-08-03 13:40] [PACMAN] upgraded libdatrie (0.2.5-1 -> 0.2.6-1)
[2013-08-03 13:40] [PACMAN] upgraded libgdiplus (2.10-4 -> 2.10.9-1)
[2013-08-03 13:40] [PACMAN] upgraded libthai (0.1.18-1 -> 0.1.19-1)
[2013-08-03 13:40] [PACMAN] upgraded libusbx (1.0.15-1 -> 1.0.16-1)
[2013-08-03 13:40] [PACMAN] upgraded libxfont (1.4.5-1 -> 1.4.6-1)
[2013-08-03 13:40] [PACMAN] upgraded linux-firmware (20130610-1 -> 20130725-1)
[2013-08-03 13:40] [PACMAN] upgraded mkinitcpio-busybox (1.20.2-1 -> 1.21.1-2)
[2013-08-03 13:40] [PACMAN] upgraded mkinitcpio (0.14.0-1 -> 0.15.0-1)
[2013-08-03 13:40] [ALPM-SCRIPTLET] >>> Updating module dependencies. Please wait ...
[2013-08-03 13:40] [ALPM-SCRIPTLET] >>> Generating initial ramdisk, using mkinitcpio. Please wait...
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Building image from preset: /etc/mkinitcpio.d/linux.preset: 'default'
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> -k /boot/vmlinuz-linux -c /etc/mkinitcpio.conf -g /boot/initramfs-linux.img
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Starting build: 3.10.3-1-ARCH
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [base]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [udev]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [autodetect]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'pata' is deprecated. Replace it with 'block' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [block]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'scsi' is deprecated. Replace it with 'block' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [block]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'sata' is deprecated. Replace it with 'block' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [block]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'usbinput' is deprecated. Replace it with 'keyboard' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [keyboard]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [filesystems]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [fglrx]
[2013-08-03 13:40] [ALPM-SCRIPTLET] Building fglrx module for 3.10.3-1-ARCH kernel ...
[2013-08-03 13:40] [ALPM-SCRIPTLET] Failed!!! Check out log: /var/log/catalyst-install.log
[2013-08-03 13:40] [ALPM-SCRIPTLET] - /usr/lib/modules/3.9.9-1-ARCH looks like unused, maybe remove it manualy?
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Generating module dependencies
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Creating gzip initcpio image: /boot/initramfs-linux.img
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Image generation successful
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Building image from preset: /etc/mkinitcpio.d/linux.preset: 'fallback'
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> -k /boot/vmlinuz-linux -c /etc/mkinitcpio.conf -g /boot/initramfs-linux-fallback.img -S autodetect
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Starting build: 3.10.3-1-ARCH
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [base]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [udev]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'pata' is deprecated. Replace it with 'block' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [block]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Possibly missing firmware for module: bfa
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Possibly missing firmware for module: aic94xx
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Possibly missing firmware for module: smsmdtv
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'scsi' is deprecated. Replace it with 'block' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [block]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'sata' is deprecated. Replace it with 'block' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [block]
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> WARNING: Hook 'usbinput' is deprecated. Replace it with 'keyboard' in your config
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [keyboard]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [filesystems]
[2013-08-03 13:40] [ALPM-SCRIPTLET] -> Running build hook: [fglrx]
[2013-08-03 13:40] [ALPM-SCRIPTLET] Building fglrx module for 3.10.3-1-ARCH kernel ...
[2013-08-03 13:40] [ALPM-SCRIPTLET] Failed!!! Check out log: /var/log/catalyst-install.log
[2013-08-03 13:40] [ALPM-SCRIPTLET] - /usr/lib/modules/3.9.9-1-ARCH looks like unused, maybe remove it manualy?
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Generating module dependencies
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Creating gzip initcpio image: /boot/initramfs-linux-fallback.img
[2013-08-03 13:40] [ALPM-SCRIPTLET] ==> Image generation successful
[2013-08-03 13:40] [PACMAN] upgraded linux (3.9.9-1 -> 3.10.3-1)
[2013-08-03 13:40] [PACMAN] upgraded linux-docs (3.9.9-1 -> 3.10.3-1)
[2013-08-03 13:40] [PACMAN] upgraded linux-headers (3.9.9-1 -> 3.10.3-1)
[2013-08-03 13:40] [PACMAN] upgraded lirc-utils (1:0.9.0-49 -> 1:0.9.0-52)
[2013-08-03 13:40] [PACMAN] upgraded mediastreamer (2.9.0-1 -> 2.9.0-3)
[2013-08-03 13:41] [PACMAN] upgraded meld (1.7.3-1 -> 1.7.4-1)
[2013-08-03 13:41] [PACMAN] upgraded mencoder (36285-1 -> 36285-3)
[2013-08-03 13:41] [PACMAN] upgraded mercurial (2.6.3-1 -> 2.7-1)
[2013-08-03 13:41] [PACMAN] upgraded mplayer (36285-1 -> 36285-3)
[2013-08-03 13:41] [PACMAN] upgraded nepomuk-core (4.10.5-1 -> 4.10.5-2)
[2013-08-03 13:41] [PACMAN] upgraded netctl (1.1-1 -> 1.2-1)
[2013-08-03 13:41] [PACMAN] upgraded nfs-utils (1.2.8-8 -> 1.2.8-9)
[2013-08-03 13:41] [PACMAN] upgraded pcsx2 (1.0.0-5 -> 1.0.0-6)
[2013-08-03 13:41] [PACMAN] upgraded rosegarden (13.04-1 -> 13.06-1)
[2013-08-03 13:41] [PACMAN] upgraded soundkonverter (2.0.3-1 -> 2.0.4-1)
[2013-08-03 13:41] [PACMAN] upgraded subversion (1.8.0-1 -> 1.8.1-1)
[2013-08-03 13:41] [PACMAN] upgraded syslinux (4.06-2 -> 4.07-1)
[2013-08-03 13:41] [PACMAN] upgraded telepathy-glib (0.20.2-1 -> 0.20.4-1)
[2013-08-03 13:41] [ALPM-SCRIPTLET] >>> texlive: updating the filename database...
[2013-08-03 13:41] [ALPM-SCRIPTLET] warning: kpathsea: configuration file texmf.cnf not found in these directories: /usr/bin:/usr/bin/share/texmf-local/web2c:/usr/bin/share/texmf-dist/web2c:/usr/bin/share/texmf/web2c:/usr/bin/texmf-local/web2c:/usr/bin/texmf-dist/web2c:/usr/bin/texmf/web2c:/usr:/usr/share/texmf-local/web2c:/usr/share/texmf-dist/web2c:/usr/share/texmf/web2c:/usr/texmf-local/web2c:/usr/texmf-dist/web2c:/usr/texmf/web2c://../texmf-local/web2c:/://share/texmf-local/web2c://share/texmf-dist/web2c://share/texmf/web2c://texmf-local/web2c://texmf-dist/web2c://texmf/web2c.
[2013-08-03 13:41] [ALPM-SCRIPTLET] mktexlsr: Done.
[2013-08-03 13:41] [ALPM-SCRIPTLET] recreating all formats...warning: kpathsea: configuration file texmf.cnf not found in these directories: /usr/bin:/usr/bin/share/texmf-local/web2c:/usr/bin/share/texmf-dist/web2c:/usr/bin/share/texmf/web2c:/usr/bin/texmf-local/web2c:/usr/bin/texmf-dist/web2c:/usr/bin/texmf/web2c:/usr:/usr/share/texmf-local/web2c:/usr/share/texmf-dist/web2c:/usr/share/texmf/web2c:/usr/texmf-local/web2c:/usr/texmf-dist/web2c:/usr/texmf/web2c://../texmf-local/web2c:/://share/texmf-local/web2c://share/texmf-dist/web2c://share/texmf/web2c://texmf-local/web2c://texmf-dist/web2c://texmf/web2c.
[2013-08-03 13:41] [ALPM-SCRIPTLET] warning: kpathsea: configuration file texmf.cnf not found in these directories: /usr/bin:/usr/bin/share/texmf-local/web2c:/usr/bin/share/texmf-dist/web2c:/usr/bin/share/texmf/web2c:/usr/bin/texmf-local/web2c:/usr/bin/texmf-dist/web2c:/usr/bin/texmf/web2c:/usr:/usr/share/texmf-local/web2c:/usr/share/texmf-dist/web2c:/usr/share/texmf/web2c:/usr/texmf-local/web2c:/usr/texmf-dist/web2c:/usr/texmf/web2c://../texmf-local/web2c:/://share/texmf-local/web2c://share/texmf-dist/web2c://share/texmf/web2c://texmf-local/web2c://texmf-dist/web2c://texmf/web2c.
[2013-08-03 13:41] [ALPM-SCRIPTLET] warning: kpathsea: configuration file texmf.cnf not found in these directories: /usr/bin:/usr/bin/share/texmf-local/web2c:/usr/bin/share/texmf-dist/web2c:/usr/bin/share/texmf/web2c:/usr/bin/texmf-local/web2c:/usr/bin/texmf-dist/web2c:/usr/bin/texmf/web2c:/usr:/usr/share/texmf-local/web2c:/usr/share/texmf-dist/web2c:/usr/share/texmf/web2c:/usr/texmf-local/web2c:/usr/texmf-dist/web2c:/usr/texmf/web2c://../texmf-local/web2c:/://share/texmf-local/web2c://share/texmf-dist/web2c://share/texmf/web2c://texmf-local/web2c://texmf-dist/web2c://texmf/web2c.
[2013-08-03 13:41] [ALPM-SCRIPTLET] /usr/bin/fmtutil: line 395: /texconfig/tcfmgr: No such file or directory
[2013-08-03 13:41] [ALPM-SCRIPTLET] fmtutil: config file `fmtutil.cnf' not found.
[2013-08-03 13:41] [ALPM-SCRIPTLET] done.
[2013-08-03 13:41] [ALPM-SCRIPTLET] (logs are under /var/lib/texmf/web2c/<engine>/<formatname>.log)
[2013-08-03 13:41] [PACMAN] upgraded texlive-bin (2012.0-13 -> 2013.30973-2)
[2013-08-03 13:41] [ALPM] warning: /etc/texmf/tex/generic/config/language.dat installed as /etc/texmf/tex/generic/config/language.dat.pacnew
[2013-08-03 13:41] [ALPM] warning: /etc/texmf/tex/generic/config/language.def installed as /etc/texmf/tex/generic/config/language.def.pacnew
[2013-08-03 13:41] [ALPM] warning: /etc/texmf/dvipdfmx/dvipdfmx.cfg installed as /etc/texmf/dvipdfmx/dvipdfmx.cfg.pacnew
[2013-08-03 13:41] [ALPM] warning: /etc/texmf/chktex/chktexrc installed as /etc/texmf/chktex/chktexrc.pacnew
[2013-08-03 13:41] [ALPM] warning: /etc/texmf/web2c/fmtutil.cnf installed as /etc/texmf/web2c/fmtutil.cnf.pacnew
[2013-08-03 13:41] [ALPM] warning: /etc/texmf/web2c/texmf.cnf installed as /etc/texmf/web2c/texmf.cnf.pacnew
[2013-08-03 13:41] [ALPM-SCRIPTLET] >>> texlive: saving updmap.cfg as /tmp/tmp.4WfV4vnjxi...
[2013-08-03 13:41] [ALPM-SCRIPTLET] >>> texlive: regenerating updmap.cfg (custom additions should go
[2013-08-03 13:41] [ALPM-SCRIPTLET] into /etc/texmf/web2c/updmap-local.cfg
[2013-08-03 13:41] [ALPM-SCRIPTLET] >>> texlive: updating the filename database...
[2013-08-03 13:41] [ALPM-SCRIPTLET] mktexlsr: Updating /etc/texmf/ls-R...
[2013-08-03 13:41] [ALPM-SCRIPTLET] mktexlsr: Updating /usr/share/texmf/ls-R...
[2013-08-03 13:41] [ALPM-SCRIPTLET] mktexlsr: Updating /usr/share/texmf-dist/ls-R...
[2013-08-03 13:41] [ALPM-SCRIPTLET] mktexlsr: Updating /var/lib/texmf/ls-R...
[2013-08-03 13:41] [ALPM-SCRIPTLET] mktexlsr: Done.
[2013-08-03 13:41] [ALPM-SCRIPTLET] >>> texlive: updating the fontmap files with updmap...
[2013-08-03 13:41] [ALPM-SCRIPTLET] updmap: resetting $HOME value (was /home/redac) to root's actual home (/root).
[2013-08-03 13:41] [ALPM-SCRIPTLET] done.
[2013-08-03 13:41] [ALPM-SCRIPTLET] >>> texlive: recreating all formats...
[2013-08-03 13:41] [ALPM-SCRIPTLET] /usr/bin/fmtutil: line 395: /usr/share/texmf/texconfig/tcfmgr: No such file or directory
[2013-08-03 13:41] [ALPM-SCRIPTLET] fmtutil: config file `fmtutil.cnf' not found.
[2013-08-03 13:41] [ALPM-SCRIPTLET] done.
[2013-08-03 13:41] [ALPM-SCRIPTLET] (logs are under /var/lib/texmf/web2c/<engine>/<formatname>.log)
[2013-08-03 13:41] [ALPM-SCRIPTLET] NB: To setup ConTeXt and the lua(la)tex font db,
[2013-08-03 13:41] [ALPM-SCRIPTLET] see http://wiki.archlinux.org/index.php/TeX_Live
[2013-08-03 13:41] [PACMAN] upgraded texlive-core (2012.29661-1 -> 2013.30962-2)
[2013-08-03 13:41] [PACMAN] upgraded transcode (1.1.7-9 -> 1.1.7-10)
[2013-08-03 13:41] [PACMAN] upgraded twisted (13.0.0-1 -> 13.1.0-1)
[2013-08-03 13:41] [PACMAN] upgraded videoproto (2.3.1-2 -> 2.3.2-1)
[2013-08-03 13:41] [PACMAN] upgraded virtuoso-base (6.1.6-2 -> 6.1.7-1)
[2013-08-03 13:41] [PACMAN] upgraded virtuoso (6.1.6-2 -> 6.1.7-1)
[2013-08-03 13:41] [PACMAN] installed ffmpeg-compat (1:0.10.8-4)
[2013-08-03 13:42] [PACMAN] upgraded vlc (2.0.7-2 -> 2.0.8.a-1)
[2013-08-03 13:42] [PACMAN] upgraded webkitgtk (2.0.3-1 -> 2.0.4-1)
[2013-08-03 13:42] [PACMAN] upgraded wine (1.6rc5-1 -> 1.7.0-1)
[2013-08-03 13:42] [PACMAN] upgraded xorg-iceauth (1.0.5-1 -> 1.0.6-1)
[2013-08-03 13:42] [PACMAN] upgraded youtube-dl (2013.07.17.1-1 -> 2013.07.25.2-1)

Okay, so it turns out that this was caused by the Catalyst bug described in this post. Reverting to the 13.6 version solved the problem. Lesson learned: if there's a ton of memory being used that isn't owned by a running process, start looking for bug reports involving drivers. Especially drivers known for being, well, pretty bad. Was there any method I could have used that would have told me that Catalyst was using all my ram, or is kernel-space memory usage pretty much a black box?
Last edited by Chaotechnician (2013-08-08 00:10:43)

How to monitor java memory usage in enterprise manager

I am running sqlplus to execute a sql package, which generates XML.
When processing 2000+ rows, it will give a out of memory error.
Where in enterprise manger can I see this memory usage?
Thanks.

Hello,
it depends a little on what you want to do. If you use the pure CCMS monitoring with the table ALTRAMONI you get average response time per instance and you only get new measurements once the status changes from green to yellow or red.
In order to get continuous measurements you should look into Business Process Monitoring and the different documentations under https://service.sap.com/bpm --> Media Libary --> Technical Information. E.g. the PDF Setup Guide for Application Monitoring describes this "newer" dialog performance monitor. Probably you have to click on the calendar sheet in the Media Libary to also see older documents as well. As the Business Process Monitoring integrates with BW (there is also a BI Setup Guide in the Media LIbrary) you can get trendlines there. This BW integration also integrates back with SL Reporting.
Some guidance for SL Reporting is probably given under https://service.sap.com/rkt-solman but I am not 100% sure.
Best Regards
Volker

Memory usage in Analysis Services tabular model

Hello,
I've been researching and investigating trying to understand what is consuming memory resources in a tabular model that I'm working with. Using SQL Server Management Studio, the Estimated Size of the database is reported as 7768.34 MBs. Using
Kasper de Jonge's BISM Server Memory Report, the database is reported as 15,465.13 MBs. However, a majority of the fields in the BISM Server Memory Report are empty, and so I cannot determine what is consuming the memory. The data source for this particular
workbook is $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE.
For example: I drill-down to an individual column (ColumnA) in the BISM Server Memory Report (Database > Dimensions > Table > In-Memory Table > Columns > Column) and the reported memory usage is 706.97 MBs. Underneath ColumnA,
I see a blank level with a reported memory usage of 623.59 MBs and a Segments level with a reported memory usage of 83.39 MBs. Looking at $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMN_SEGMENTS, if I SUM the USED_SIZE for ColumnA, it totals roughly 83 MBs which matches
what is reported in the BISM Server Memory Report for the segment size. How do I determine what the other 623.59 MBs is being used for? Again, this discrepancy occurs for all columns in the model and not just this one example.
Thanks!

Follow up to my original question. It appears that the blank levels (at least under the column level) the Kasper de Jonge's BISM Server Memory Report reports the dictionary size of the column. The memory usage size matches the DICTIONARY_SIZE attribute in
the $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMNS. I made a mis-assumption as to what the information $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMN_SEGMENTS was providing.
In my original post I reference one database in particular in where the Estimated Size property in the Database Properties dialog is listed as 7,768.34 MBs. and the $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE reports 15,465.13 MBs. Thoughts, comments, or opinions
on why the Estimated Size property does not match what's reported in $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE?
Thanks!

Memory usage Common table Expressions

Similar Messages

Maybe you are looking for