SQL Memory Usage
Hello
I am updating some items with the DTW. i am updating 9000 items. I have made 9 files of 1000 records, i am just updating the picturname field. When i start to upload the files the SQL Memory usage starts to grow more and more. When i try to upload the third file the memory has grown too much, and the DTW says the file update ok but it doesnt update the database. So i need to restart the SQL service (mssqlserver) and do it again. Some times it doesnt work so i need to restart the server.
Any ideas??
Jacobo
hi,
Check this information abt DI API Memory Consumption in WIKI SDK FAQ's.
https://www.sdn.sap.com/irj/scn/wiki?path=/display/b1/faq_sdk
DI API
Memory consumption
New connection mechanism in 2007 vs. classical
1. In the old method the DI API was loaded into the same process with the Add-On and was an "actual part" of it, so calls to the DI-API were very quick and direct
2. In the new method there is one common DI-API which is part of the Core B1. All the Add-Ons will use the same DI-API IF (!!!) they work in the new method. The calls to the DI-API have now to "go between" two processes. This means that they go through more processing and although it's all in the same machine and no actual communication (i.e., network traffic) is actually happening, the system's CPU and memory are "working harder".
The impact is extremely small on an individual call level, but for an Add-On that makes a large amount of calls this difference accumulates...
There is no huge additional CPU or Memory consumption. Most of the impact is on the Response Time level. Some of it is CPU consumption and some of it is Context Switch waiting.
3. This trade-off between Memory consumption and Response Time is actually another reason why R&D thought it's a good idea to leave the new method to be optional based on a decision from the developer.
Jeyakanthan
Similar Messages
-
Sql memory usage increase each time win app runs
Hi,
Sql memory usage increases each time when win app runs. Why does it work like this? Is it normal ?
I restart SQL Server 2012. Only my win app uses SQL server.
First run of winapp.
start memory usage : 211.800 KB
close memory usage: 528.136 KB
Second run of xaf app.
start memory usage : 528.136 KB
close memory usage: 996.844 KB
Third run of xaf app
start memory usage : 996.844 KB
close memory usage: 997.640 KB
Fourth run of xaf app
start memory usage : 997.640 KB
close memory usage: 1.104.864 KBHi,
Sql memory usage increases each time when win app runs. Why does it work like this? Is it normal ?
Yes, it is perfectly normal for SQL Server to acquire and hold onto large amounts of memory indefinitely. This memory improves performance by avoiding disk I/O, query plan compilation and costly memory management.
On a dedicated SQL Server you should usually let SQL Server dynamically manage memory. It will release memory if it detects memory pressure. But if you often run other applications on the server than need significant amounts of memory (e.g. IIS,
application services), you may want to set max server memory as suggested.
Dan Guzman, SQL Server MVP, http://www.dbdelta.com -
HIGH memory usage in Perf Counters but LOW by SQL components
Hi all,
Our SQL Server has the following specs:
OS: Windows Server 2008 R2 Enterprise Edition SP1+Cumulative Updates
RAM: 128GB
SQL Server: 2012, Enterprise (SP2), Core-based Licensing (64-bit)
Max Memory Setting: Limited to 123GB
I used performance counters to see memory usage by SQL Server:
SQLServer:MemoryManager:TargetServerMemory(KB)=125,952,000
SQLServer:MemoryManager:TotalServerMemory(KB)=125,634,000
SQLServer:BufferManager:PageLifeExpectancy=104,000
When I use SSMS report (Memory Consumption) and navigate to "Memory usage by components", the sum of "Allocated memory (KB)" is about 34GB and is not equal to TotalServerMemory perf counter.
Please help me to understand relation between this report and perf counters mentioned above.
Many thanks in advance.
LeilaProcess/System Counts Value
Available Physical Memory 1490161664
Available Virtual Memory 8599063212032
Available Paging File 12067610624
Working Set 128870092800
Percent of Committed Memory in WS 100
Page Faults 240261318
System physical memory high 1
System physical memory low 0
Process physical memory low 0
Process virtual memory low 0
(10 row(s) affected)
Memory Manager KB
VM Reserved 191481084
VM Committed 125669808
Locked Pages Allocated 0
Large Pages Allocated 0
Emergency Memory 1024
Emergency Memory In Use 16
Target Committed 125952008
Current Committed 125669808
Pages Allocated 44388280
Pages Reserved 1928
Pages Free 77023672
Pages In Use 16043264
Page Alloc Potential 103611136
NUMA Growth Phase 0
Last OOM Factor 0
Last OS Error 0
(16 row(s) affected)
Memory node Id = 0 KB
VM Reserved 191479484
VM Committed 62784472
Locked Pages Allocated 0
Pages Allocated 20930080
Pages Free 39219960
Target Committed 62975992
Current Committed 62784472
Foreign Committed 1118440
Away Committed 0
Taken Away Committed 0
(10 row(s) affected)
Memory node Id = 1 KB
VM Reserved 1536
VM Committed 62885316
Locked Pages Allocated 0
Pages Allocated 23458200
Pages Free 37803712
Target Committed 62975992
Current Committed 62885320
Foreign Committed 92596
Away Committed 0
Taken Away Committed 0
(10 row(s) affected)
Memory node Id = 64 KB
VM Reserved 0
VM Committed 20
Locked Pages Allocated 0
(3 row(s) affected)
MEMORYCLERK_SQLGENERAL (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 184448
(6 row(s) affected)
MEMORYCLERK_SQLGENERAL (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 464
(6 row(s) affected)
MEMORYCLERK_SQLGENERAL (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 184912
(6 row(s) affected)
MEMORYCLERK_SQLBUFFERPOOL (node 0) KB
VM Reserved 51979512
VM Committed 3382604
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 14168056
(6 row(s) affected)
MEMORYCLERK_SQLBUFFERPOOL (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 18436712
(6 row(s) affected)
MEMORYCLERK_SQLBUFFERPOOL (Total) KB
VM Reserved 51979512
VM Committed 3382604
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 32604768
(6 row(s) affected)
MEMORYCLERK_SQLQUERYEXEC (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 18056
(6 row(s) affected)
MEMORYCLERK_SQLOPTIMIZER (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 1736
(6 row(s) affected)
MEMORYCLERK_SQLUTILITIES (node 0) KB
VM Reserved 14656
VM Committed 14656
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 10256
(6 row(s) affected)
MEMORYCLERK_SQLUTILITIES (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 7952
(6 row(s) affected)
MEMORYCLERK_SQLUTILITIES (Total) KB
VM Reserved 14656
VM Committed 14656
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 18208
(6 row(s) affected)
MEMORYCLERK_SQLSTORENG (node 0) KB
VM Reserved 19712
VM Committed 19712
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 19016
(6 row(s) affected)
MEMORYCLERK_SQLSTORENG (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 12824
(6 row(s) affected)
MEMORYCLERK_SQLSTORENG (Total) KB
VM Reserved 19712
VM Committed 19712
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 31840
(6 row(s) affected)
MEMORYCLERK_SQLCONNECTIONPOOL (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 1824
(6 row(s) affected)
MEMORYCLERK_SQLCONNECTIONPOOL (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 1144
(6 row(s) affected)
MEMORYCLERK_SQLCONNECTIONPOOL (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 2968
(6 row(s) affected)
MEMORYCLERK_SQLCLR (node 0) KB
VM Reserved 12606272
VM Committed 33460
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 82736
(6 row(s) affected)
MEMORYCLERK_SQLCLRASSEMBLY (node 0) KB
VM Reserved 5096
VM Committed 5096
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 0
(6 row(s) affected)
MEMORYCLERK_SQLSERVICEBROKER (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 3088
(6 row(s) affected)
MEMORYCLERK_SQLHTTP (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 8
(6 row(s) affected)
MEMORYCLERK_SNI (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 128
(6 row(s) affected)
MEMORYCLERK_SNI (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 112
(6 row(s) affected)
MEMORYCLERK_SNI (node 64) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 16
(6 row(s) affected)
MEMORYCLERK_SNI (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 256
(6 row(s) affected)
MEMORYCLERK_FULLTEXT (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 384
(6 row(s) affected)
MEMORYCLERK_SQLXP (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 16
(6 row(s) affected)
MEMORYCLERK_BHF (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 224
(6 row(s) affected)
MEMORYCLERK_BHF (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 112
(6 row(s) affected)
MEMORYCLERK_BHF (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 336
(6 row(s) affected)
MEMORYCLERK_SQLQERESERVATIONS (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 2064
(6 row(s) affected)
MEMORYCLERK_XE_BUFFER (node 0) KB
VM Reserved 3072
VM Committed 3072
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 0
(6 row(s) affected)
MEMORYCLERK_XE_BUFFER (node 1) KB
VM Reserved 1536
VM Committed 1536
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 0
(6 row(s) affected)
MEMORYCLERK_XE_BUFFER (Total) KB
VM Reserved 4608
VM Committed 4608
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 0
(6 row(s) affected)
MEMORYCLERK_XTP (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 16
(6 row(s) affected)
MEMORYCLERK_HOST (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 320
(6 row(s) affected)
MEMORYCLERK_SOSNODE (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 87696
(6 row(s) affected)
MEMORYCLERK_SOSNODE (node 1) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 58688
(6 row(s) affected)
MEMORYCLERK_SOSNODE (node 64) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 2600
(6 row(s) affected)
MEMORYCLERK_SOSNODE (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 148984
(6 row(s) affected)
MEMORYCLERK_SOSOS (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 192
(6 row(s) affected)
MEMORYCLERK_SOSMEMMANAGER (node 0) KB
VM Reserved 265288
VM Committed 265176
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 0
(6 row(s) affected)
MEMORYCLERK_FULLTEXT_SHMEM (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 768
SM Committed 768
Pages Allocated 0
(6 row(s) affected)
MEMORYCLERK_SQLSERVICEBROKERTRANSPORT (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 320
(6 row(s) affected)
MEMORYCLERK_FSAGENT (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 24
(6 row(s) affected)
MEMORYCLERK_FILETABLE (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 72
(6 row(s) affected)
MEMORYCLERK_XE (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 6368
(6 row(s) affected)
MEMORYCLERK_SQLLOGPOOL (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
Pages Allocated 8328
(6 row(s) affected) -
SQL SERVER PHYSICAL MEMORY USAGE HIGH
HI Teams,
i am going threw one of my production high physical memory usage in SQL Server. It always
around 90%.When i reboot the server, it will initially good but end of the day it will around 95 to 98% physical memory usage.
please give the valid solutions..,
Regards,
DBAThis is an expected/normal behaviour in SQL Server box. Memory management is highly dynamic in SQL Server and will use the complete memory allocated to SQL Server. It is also important to set the MAX SERVER MEMORY for the SQL Server instance. You may not
need to worry about this unless you find any performance issues.
Please mark this reply as answer if it solved your issue or vote as helpful if it helped.
[Blog] -
SQL Server Memory Usage Peaks to 95% and its not releasing SQL 2012
We are currently running SQL 2012 64 bit, Lock Pages Enabled, 128 GB. We allocated Max Memory 112000, Min Memory to 0. We have a SQL Maintenace Job which backs up (Full Backup) of our server around 11PM at that time the SQL Server memory peaks to almost
96% even during full business hours we are constantly in the range of 56 to 60% but after 11PM within 10 minutes of the job it peaks to 95 or 96 Percentage and even after the job completes it's not releasing the memory back. I have to manually shut the sql
service and then restart at that time it comes back to normal.
Any suggestions/any help really appreciated.Here are the details Memory is at 96% I still didn't restart...Please any help appreciated...The memory detals is for 24 hours I restarted the service around 11AM before I posted my previous message..
Memory Used by SqLServer: 119329
Locked Pages Used SQLServer : 105969
Total VAS in MB : 8388607
Process Physical Memory Low : 0
Process Virtual Memory Low : 0
Max Memory set to :112000
Out of 128 Memory Last 24 hours the memory usage in %
Percent Memory Used - Total Memory is 128.0 GB
Last 24 Hours
DATE / TIME
Memory Used
19-Dec-14
11:46 PM
96.24659602
20-Dec-14
12:46 AM
96.24578349
20-Dec-14
1:46 AM
96.25146739
20-Dec-14
2:46 AM
96.24345652
20-Dec-14
3:46 AM
96.27311834
20-Dec-14
4:46 AM
96.28947067
20-Dec-14
5:46 AM
96.18931325
20-Dec-14
6:46 AM
96.09323502
20-Dec-14
7:46 AM
96.07915497
20-Dec-14
8:46 AM
96.07906977
20-Dec-14
9:46 AM
96.0784111
20-Dec-14
10:46 AM
96.07415009
20-Dec-14
11:46 AM
26.03422141
20-Dec-14
12:46 PM
33.57474359
20-Dec-14
1:46 PM
39.466561
20-Dec-14
2:46 PM
41.85940742
20-Dec-14
3:46 PM
43.89071274
20-Dec-14
4:46 PM
45.80877368
20-Dec-14
5:46 PM
46.49493281
20-Dec-14
6:46 PM
46.68486468
20-Dec-14
7:46 PM
46.69701958
20-Dec-14
8:46 PM
46.69994736
20-Dec-14
9:46 PM
57.5012455
20-Dec-14
10:46 PM
96.25695419
I verified its a sqL job and still my memory is 95%
It peaeked at 10:46PM and here are the details of the SQL job which started at 10:30
Progress: 2014-12-20 22:30:04.39
Source: Check Database Integrity Task Executing query "USE [DATASTORE] ".: 50% complete End Progress Progress: 2014-12-20 22:43:06.10
Source: Check Database Integrity Task Executing query "DBCC CHECKDB(N'DATASTORE') WITH NO_INFOMSGS ".: 100% complete End Progress
Progress: 2014-12-20 22:43:06.11 Source: Check Database Integrity Task Executing query "USE [ETL_Proc] ".: 50% complete
End Progress Progress: 2014-12-20 22:46:52.56 Source: Check Database Integrity Task Executing query "DBCC CHECKDB(N'ETL_Proc')
WITH NO_INFOMSGS ".: 100% complete End Progress Progress: 2014-12-20 22:46:52.64 Source: Back Up Database Task
Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 20% complete End Progress
Progress: 2014-12-20 22:46:52.64 Source: Back Up Database Task Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".
: 40% complete End Progress Progress: 2014-12-20 22:46:52.64
Source: Back Up Database Task Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 60% complete
End Progress Progress: 2014-12-20 22:46:52.64 Source: Back Up Database Task
Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 80% complete End Progress
Progress: 2014-12-20 22:46:52.64 Source: Back Up Database Task
Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 100% complete End Progress
Progress: 2014-12-20 22:46:55.63 Source: Back Up Database Task
Executing query "BACKUP DATABASE [ReportServer] TO DISK = N'P:\SQL...".: 100% complete
End Progress Progress: 2014-12-20 22:46:56.55 Source: Back Up Database Task
Executing query "BACKUP DATABASE [ReportServerTempDB] TO DISK = N'...".: 100% complete End Progress Progress: 2014-12-20 22:46:57.35
Source: Back Up Database Task Executing query "BACKUP DATABASE [dbamaint] TO DISK = N'P:\SQL_Bac...".: 100% complete End Progress
Progress: 2014-12-20 22:51:13.08 Source: Back Up Database Task
Executing query "BACKUP DATABASE [DATASTORE] TO DISK = N'P:\SQL_Ba...".: 100% complete End Progress
Progress: 2014-12-20 22:51:52.72 Source: Back Up Database Task
Executing query "BACKUP DATABASE [ETL_Proc] TO DISK = N'P:\SQL_Bac...".: 100% complete End Progress Progress: 2014-12-20 22:51:54.87
Source: Rebuild Index Task Executing query "USE [ReportServer] ".: 0% complete End Progress Progress:
2014-12-20 22:51:54.88 Source: Rebuild Index Task Executing query "ALT... The package executed successf... The step succeeded. -
SQL Server Memory usage is high
Hello,
One of our production SQL cluster is eating up more memory on server.
Here are the server specifications :
OS : Windows 2008 R2 Enterprise
SQL : SQL Server 2008 SP2 standard edition ( 2 node cluster )
Memory : 16 GB ( 8 Gb to SQL and rest to OS )
CPU : 8
This server is heavily used by CLR and linked server events.
I have seen the memory usage of databases , it's not using more than 7 GB and leaving 1 GB free in sql memory area ( from our Idera SQL dm
monitoring tool ). I'm suspecting CLR events are causing these spikes.
When i look at the task manager sqlserver.exe is using 15.7 Gb ( close to 16 GB )
Not sure how to see which process are using the memory.
Also we are seeing the below error messages in error log very frequently
10/27/2014 15:23:52,spid1s,Unknown,AppDomain 85 (xxxxxx) is marked for unload due to memory pressure.
I have looked at some blogs in internet, i didnt get any correct info. I have seen this is kind of bug in SQL 2005 32-bit system but we are
using 64 bit system.
http://support.microsoft.com/kb/969962
Can anyone please help me on this ?
Thanks in advanceContinuation of DBCC memorystatus output
CACHESTORE_TEMPTABLES (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 40
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_NOTIF (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 16
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_VIEWDEFINITIONS (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 16
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_XMLDBTYPE (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_XMLDBELEMENT (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_XMLDBATTRIBUTE (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_STACKFRAMES (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 0
MultiPage Allocator 8
(7 row(s) affected)
CACHESTORE_STACKFRAMES (node 64) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 0
MultiPage Allocator 8
(7 row(s) affected)
CACHESTORE_STACKFRAMES (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 0
MultiPage Allocator 16
(7 row(s) affected)
CACHESTORE_BROKERTBLACS (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 48
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_BROKERKEK (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_BROKERDSH (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_BROKERUSERCERTLOOKUP (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_BROKERRSB (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_BROKERREADONLY (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 32
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_BROKERTO (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_EVENTS (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 16
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_CLRPROC (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 40
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_SYSTEMROWSET (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 1856
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_CONVPRI (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 48
MultiPage Allocator 0
(7 row(s) affected)
CACHESTORE_FULLTEXTSTOPLIST (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 32
MultiPage Allocator 0
(7 row(s) affected)
USERSTORE_SCHEMAMGR (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 16432
MultiPage Allocator 856
(7 row(s) affected)
USERSTORE_DBMETADATA (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 5592
MultiPage Allocator 0
(7 row(s) affected)
USERSTORE_TOKENPERM (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 3856
MultiPage Allocator 3960
(7 row(s) affected)
USERSTORE_OBJPERM (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 2328
MultiPage Allocator 0
(7 row(s) affected)
USERSTORE_SXC (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 656
MultiPage Allocator 0
(7 row(s) affected)
USERSTORE_SXC (node 64) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 8
MultiPage Allocator 0
(7 row(s) affected)
USERSTORE_SXC (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 664
MultiPage Allocator 0
(7 row(s) affected)
OBJECTSTORE_LBSS (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 128
MultiPage Allocator 608
(7 row(s) affected)
OBJECTSTORE_SNI_PACKET (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 2008
MultiPage Allocator 56
(7 row(s) affected)
OBJECTSTORE_SNI_PACKET (node 64) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 0
MultiPage Allocator 56
(7 row(s) affected)
OBJECTSTORE_SNI_PACKET (Total) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 2008
MultiPage Allocator 112
(7 row(s) affected)
OBJECTSTORE_SERVICE_BROKER (node 0) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 424
MultiPage Allocator 0
(7 row(s) affected)
OBJECTSTORE_LOCK_MANAGER (node 0) KB
VM Reserved 32768
VM Committed 32768
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 4048
MultiPage Allocator 0
(7 row(s) affected)
OBJECTSTORE_LOCK_MANAGER (node 64) KB
VM Reserved 0
VM Committed 0
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 24
MultiPage Allocator 0
(7 row(s) affected)
OBJECTSTORE_LOCK_MANAGER (Total) KB
VM Reserved 32768
VM Committed 32768
Locked Pages Allocated 0
SM Reserved 0
SM Committed 0
SinglePage Allocator 4072
MultiPage Allocator 0
(7 row(s) affected)
Buffer Pool Value
Committed 1024000
Target 1024000
Database 793462
Dirty 36258
In IO 0
Latched 0
Free 171398
Stolen 59140
Reserved 0
Visible 1024000
Stolen Potential 913660
Limiting Factor 17
Last OOM Factor 0
Last OS Error 0
Page Life Expectancy 262733
(15 row(s) affected)
Process/System Counts Value
Available Physical Memory 69021696
Available Virtual Memory 8762135273472
Available Paging File 12716019712
Working Set 15196917760
Percent of Committed Memory in WS 100
Page Faults 897824874
System physical memory high 0
System physical memory low 0
Process physical memory low 0
Process virtual memory low 0
(10 row(s) affected)
Procedure Cache Value
TotalProcs 4573
TotalPages 53712
InUsePages 27
(3 row(s) affected)
Global Memory Objects Pages
Resource 412
Locks 509
XDES 219
SETLS 8
SE Dataset Allocators 16
SubpDesc Allocators 8
SE SchemaManager 1169
SE Column Metadata Cache 991
SQLCache 893
Replication 2
ServerGlobal 52
XP Global 2
SortTables 3691
(13 row(s) affected)
Query Memory Objects (internal) Value
Grants 0
Waiting 0
Available 756700
Current Max 756700
Future Max 756700
Physical Max 756700
Next Request 0
Waiting For 0
Cost 0
Timeout 0
Wait Time 0
(11 row(s) affected)
Small Query Memory Objects (internal) Value
Grants 0
Waiting 0
Available 12800
Current Max 12800
Future Max 12800
(5 row(s) affected)
Optimization Queue (internal) Value
Overall Memory 6723993600
Target Memory 5965963264
Last Notification 1
Timeout 6
Early Termination Factor 5
(5 row(s) affected)
Small Gateway (internal) Value
Configured Units 32
Available Units 32
Acquires 0
Waiters 0
Threshold Factor 380000
Threshold 380000
(6 row(s) affected)
Medium Gateway (internal) Value
Configured Units 8
Available Units 8
Acquires 0
Waiters 0
Threshold Factor 12
Threshold -1
(6 row(s) affected)
Big Gateway (internal) Value
Configured Units 1
Available Units 1
Acquires 0
Waiters 0
Threshold Factor 8
Threshold -1
(6 row(s) affected)
Memory Pool Manager Pages
Reserved Current 0
Reserved Limit 913664
(2 row(s) affected)
Memory Pool (internal) Pages
Allocations 59136
Predicted 248311
Private Target 0
Private Limit 0
Total Target 972800
Total Limit 972800
OOM Count 0
(7 row(s) affected)
MEMORYBROKER_FOR_CACHE (internal) Pages
Allocations 55358
Rate 0
Target Allocations 779847
Future Allocations 0
Overall 820800
Last Notification 1
(6 row(s) affected)
MEMORYBROKER_FOR_STEAL (internal) Pages
Allocations 3778
Rate 0
Target Allocations 728267
Future Allocations 0
Overall 820800
Last Notification 1
(6 row(s) affected)
MEMORYBROKER_FOR_RESERVE (internal) Pages
Allocations 0
Rate 0
Target Allocations 820800
Future Allocations 189175
Overall 820800
Last Notification 1
(6 row(s) affected)
DBCC execution completed. If DBCC printed error messages, contact your system administrator. -
SQL 2012 Memory usage analysis
We have this clustered SQL Server, win 2008 R2 + SQL 2012 Standard SP2,
Server RAM is 64GB, maximum memory is set at 50GB, and minimum memory is set at 10GB.
When I check memory usage, it seems
CLR takes more memory than Buffer Pool, is it normal? Or does it show memory allocation issue? Thanks a lot!
The "total server memory" and "target server memory" performance counters are both 50GB.
Please kindly see below screen shots below:Hi Vivian,
I would assume you are asking question related to SQL Server 2012 memory the whole discussion would change if it is SQL Server 2008 r2 memory
You are not drawing correct information from first query.
CLR has Reserved 6 G but ONLY committed 12 MB. And that too you are looking at virtual memory which is 6TB for SQL Server process so of course CLR can reserve there is actually no issue with it. A committed memory is actually what SQL Server is using
reserved in simple language is what SQL Server thinks it might need in near future.
As you said Target and total memory are same its good.
For both 2012 and 2008 r2 below query will give total memory utilization by SQL Server instance
select
(physical_memory_in_use_kb/1024)Memory_usedby_Sqlserver_MB,
(locked_page_allocations_kb/1024 )Locked_pages_used_Sqlserver_MB,
(total_virtual_address_space_kb/1024 )Total_VAS_in_MB,
process_physical_memory_low,
process_virtual_memory_low
from sys. dm_os_process_memory
If you want to see Breakdown of memory utilized by various clerks in 2008 r2
select
type,
(SUM(single_pages_kb)/1024) Single_page_allocator_memory,
(SUM(multi_pages_kb)/1024) multi_page_allocator_memory,
(sum(awe_allocated_kb)/1024) [AWE API memory]
from sys.dm_os_memory_clerks
group by type
order by Single_page_allocator_memory desc
For 2012
select type,
(SUM(pages_kb)/1024) as Memory_Utilized
(sum(awe_allocated_kb)/1024) as Memory Allocated by AWE API
from
sys.dm_os_memory_clerks
group by type
order by Memory_Utilized desc
Starting from 2012 Max server memory controls much more than buffer pool
Max server memory controls SQL Server memory allocation, including the buffer pool, compile memory, all caches, qe memory grants, lock manager memory, and CLR memory (basically any “clerk” as found in dm_os_memory_clerks). Memory for thread stacks, heaps,
linked server providers other than SQL Server, or any memory allocated by a “non SQL Server” DLL is not controlled by max server memory
Please mark this reply as answer if it solved your issue or vote as helpful if it helped so that other forum members can benefit from it
My Technet Wiki Article
MVP -
Memory usage of excel stays high after Macro is executed and excel crashes after trying to close it
Hi,
I'm trying to resolve an issue with an excel based tool. The macros retrieve data from an Oracle database and do calculations with the data. They also open and write into files in the same directory. The macros all run and finish the calculations. I can
continue to use and modify the sheet. I can also close the workbook, however excel memory usage I see in the windows Task manager stays elevated.If I close Excel it says: Excel stopped working and then it tries to recover information...
I assume something in the macro did not finish properly and memory was not released. I would like to check what is still open (connection, stream or any other object) when I close the workbook I would like to have a list of all still used memory. Is there
a possibility to do so.
Here the code I'm using, its reduced to functions which open something. Functions
get_v_tools() and get_change_tools() are same as get_client_positions().
Public conODBC As New ADODB.Connection
Public myPath As String
Sub get_positions()
Dim Src As range, dst As range
Dim lastRow As Integer
Dim myPath As String
lastRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row
Sheets("SQL_DATA").range("A2:AD" & lastRow + 1).ClearContents
Sheets("SQL_DATA").range("AG2:BE" & lastRow + 2).ClearContents
Sheets("SQL_DATA").range("AE3:AF" & lastRow + 2).ClearContents
k = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
Sheets("ToolsList").range("A2:M" & k).ClearContents
'open connection
Call open_connection
lastRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row
If lastRow < 2 Then GoTo ErrorHandling
'copy bs price check multiplications
Set Src = Sheets("SQL_DATA").range("AE2:AF2")
Set dst = Worksheets("SQL_DATA").range("AE2").Resize(lastRow - 1, Src.columns.Count)
dst.Formula = Src.Formula
On Error GoTo ErrorHandling
'new prices are calculated
newPrice_calculate (lastRow)
Calculate
myPath = ThisWorkbook.Path
'Refresh pivot table in Position Manager
Sheets("Position Manager").PivotTables("PivotTable3").ChangePivotCache ActiveWorkbook. _
PivotCaches.Create(SourceType:=xlDatabase, SourceData:= _
myPath & "\[Position_Manager_v1.0.xlsm]SQL_DATA!R1C2:R" & lastRow & "C31" _
, Version:=xlPivotTableVersion14)
ErrorHandling:
Set Src = Nothing
Set dst = Nothing
If conODBC.State <> 0 Then
conODBC.Close
End If
End Sub
Sub open_connection()
Dim sql_data, sql_data_change, sql_data_v As Variant
Dim wdth, TotalColumns, startRow As Integer
Dim rst As New ADODB.Recordset
Errorcode = 0
On Error GoTo ErrorHandling
Errorcode = 1
With conODBC
.Provider = "OraOLEDB.Oracle.1"
.ConnectionString = "Password=" & pswrd & "; Persist Security Info=True;User ID= " & UserName & "; Data Source=" & DataSource
.CursorLocation = adUseClient
.Open
.CommandTimeout = 300
End With
startRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row + 1
sql_data = get_client_positions(conODBC, rst)
wdth = UBound(sql_data, 1)
Sheets("SQL_DATA").range("A" & startRow & ":AA" & wdth + startRow - 1).Value = sql_data
'Run change tools instruments
startRow = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
sql_data_change = get_change_tools(conODBC, rst)
wdth = UBound(sql_data_change, 1)
Sheets("ToolsList").range("A" & startRow & ":M" & wdth + startRow - 1).Value _
= sql_data_change
'open SQL for V tools instruments
startRow = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
sql_data_v = get_v_tools(conODBC, rst)
wdth = UBound(sql_data_v, 1)
Sheets("ToolsList").range("A" & startRow & ":L" & startRow + wdth - 1).Value = sql_data_v
conODBC.Close
ErrorHandling:
If rst.State <> 0 Then
rst.Close
End If
Set rst = Nothing
End Sub
Private Function get_client_positions(conODBC As ADODB.Connection, rst_posi As ADODB.Recordset) As Variant
Dim sql_data As Variant
Dim objCommand As ADODB.Command
Dim sql As String
Dim records, TotalColumns As Integer
On Error GoTo ErrorHandling
Set objCommand = New ADODB.Command
sql = read_sql()
With objCommand
.ActiveConnection = conODBC 'connection for the commands
.CommandType = adCmdText
.CommandText = sql 'Sql statement from the function
.Prepared = True
.CommandTimeout = 600
End With
Set rst_posi = objCommand.Execute
TotalColumns = rst_posi.Fields.Count
records = rst_posi.RecordCount
ReDim sql_data(1 To records, 1 To TotalColumns)
If TotalColumns = 0 Or records = 0 Then GoTo ErrorHandling
If TotalColumns <> 27 Then GoTo ErrorHandling
If rst_posi.EOF Then GoTo ErrorHandling
l = 1
Do While Not rst_posi.EOF
For i = 0 To TotalColumns - 1
sql_data(l, i + 1) = rst_posi.Fields(i)
Next i
l = l + 1
rst_posi.MoveNext
Loop
ErrorHandling:
rst_posi.Close
Set rst_posi = Nothing
Set objCommand = Nothing
get_client_positions = sql_data
End Function
Private Function read_sql() As String
Dim sqlFile As String, sqlQuery, Line As String
Dim query_dt As String, client As String, account As String
Dim GRP_ID, GRP_SPLIT_ID As String
Dim fso, stream As Object
Set fso = CreateObject("Scripting.FileSystemObject")
client = Worksheets("Cover").range("C9").Value
query_dt = Sheets("Cover").range("C7").Value
GRP_ID = Sheets("Cover").range("C3").Value
GRP_SPLIT_ID = Sheets("Cover").range("C5").Value
account = Sheets("Cover").range("C11").Value
sqlFile = Sheets("Cover").range("C15").Value
Open sqlFile For Input As #1
Do Until EOF(1)
Line Input #1, Line
sqlQuery = sqlQuery & vbCrLf & Line
Loop
Close
' Replace placeholders in the SQL
sqlQuery = Replace(sqlQuery, "myClent", client)
sqlQuery = Replace(sqlQuery, "01/01/9999", query_dt)
sqlQuery = Replace(sqlQuery, "54747743", GRP_ID)
If GRP_SPLIT_ID <> "" Then
sqlQuery = Replace(sqlQuery, "7754843", GRP_SPLIT_ID)
Else
sqlQuery = Replace(sqlQuery, "AND POS.GRP_SPLIT_ID = 7754843", "")
End If
If account = "ZZ" Then
sqlQuery = Replace(sqlQuery, "AND AC.ACCNT_NAME = 'ZZ'", "")
Else
sqlQuery = Replace(sqlQuery, "ZZ", account)
End If
' Create a TextStream to check SQL Query
sql = sqlQuery
myPath = ThisWorkbook.Path
Set stream = fso.CreateTextFile(myPath & "\SQL\LastQuery.txt", True)
stream.Write sql
stream.Close
Set fso = Nothing
Set stream = Nothing
read_sql = sqlQuery
End FunctionThanks Starain,
that's what I did the last days and found that the problem is in the
newPrice_calculate (lastRow)
function. This function retrieves data (sets it as arrays) which was correctly pasted into the sheet, loops through all rows and does math/calendar calculations with cell values using an Add-In("Quantlib")
Public errorMessage as String
Sub newPrice_calculate(lastRow)
Dim Type() As Variant
Dim Id() As Variant
Dim Price() As Variant
Dim daysTo() As Variant
Dim fx() As Variant
Dim interest() As Variant
Dim ObjCalend as Variant
Dim newPrice as Variant
On Error GoTo Catch
interest = Sheets("SQL_DATA").range("V2:V" & lastRow).Value
Type = Sheets("SQL_DATA").range("L2:L" & lastRow).Value Id = Sheets("SQL_DATA").range("M2:M" & lastRow).Value Price = Sheets("SQL_DATA").range("T2:T" & lastRow).Value
daysTo = Sheets("SQL_DATA").range("K2:K" & lastRow).Value
fx = Sheets("SQL_DATA").range("U2:U" & lastRow).Value
qlError = 1
For i = 2 To lastRow
If (i, 1) = "LG" Then
'set something - nothing spectacular like
interest(i, 1) = 0
daysTo(i , 1) = 0
Else
adjTime = Sqr(daysTo(i, 1) / 365)
ObjCalend(i,1) =Application.Run("qlCalendarHolidaysList", _
"CalObj", ... , .... other input parameters)
If IsError(ObjCalend(i,1)) Then GoTo Catch
'other calendar calcs
newPrice(i,1) = Application.Run( 'quantLib calcs)
End If
Catch:
Select Case qlError
Case 1
errorMessage = errorMessage & " QuantLibXL Cal Error at: " & i & " " & vbNewLine & Err.Description
ObjCalend(i,1) (i, 1) = "N/A"
End Select
Next i
Sheets("SQL_DATA").range("AB2:AB" & lastRow).Value = newPrice
'Sheets("SQL_DATA").range("AA2:AA" & lastRow).Value = daysTo
' erase and set to nothing all arrays and objects
Erase Type
Erase id
Erase Price
Set newPrice = Nothing
Is there a possibility to clean everything in:
Private Sub Workbook_BeforeClose(Cancel As Boolean)
End Sub
Thanks in advance
Mark -
Memory usage problem on AIX 7.1
Hi,
We are running Oracle 11GR2 EE on AIX 7.1 and keep getting alerts on the pgchecks (memory paging).
The alerts are coming from another system monitoring tool (Hobbit), but our sys admins are telling us it is because we are overallocating memory.
In our case, we have an 8G SGA for the only database.
Then, we are running grid and ASM.
How can I check the actual (real) memory usage by individual processes of our Oracle database, our emagent (OMS agent), and for our ASM. In our case, we have 32G of Real Memory installed, and we should not be having a memory paging issue.
For the Oracle database, it is set for 8G.
NAME TYPE VALUE
lock_sga boolean FALSE
pga_aggregate_target big integer 0
pre_page_sga boolean FALSE
sga_max_size big integer 8480M
sga_target big integer 0For our ASM instance, it is set for 270M
SQL> sho sga
NAME TYPE VALUE
lock_sga boolean FALSE
pga_aggregate_target big integer 0
sga_max_size big integer 272M
sga_target big integer 0do as below (vmstat takes 2 minutes to complete)
bcm@bcm-laptop:~$ vmstat 6 20
procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
r b swpd free buff cache si so bi bo in cs us sy id wa
0 0 0 1347636 81396 1592120 0 0 264 22 382 651 8 3 84 5
0 0 0 1347664 81404 1592144 0 0 0 13 515 1028 4 1 95 0
0 0 0 1353136 81412 1592144 0 0 0 14 507 1021 3 1 95 0
0 0 0 1353012 81420 1592144 0 0 0 23 523 1033 3 1 95 0
0 0 0 1353044 81428 1592144 0 0 0 13 513 1026 3 1 96 0
0 0 0 1353044 81436 1592144 0 0 0 15 517 1045 3 2 95 0
0 0 0 1352920 81444 1592144 0 0 0 15 505 1012 3 1 96 0
1 0 0 1347448 81452 1592156 0 0 1 21 521 1038 4 2 94 0
0 0 0 1347448 81460 1592156 0 0 0 28 513 1030 3 2 95 0
0 0 0 1347448 81468 1592180 0 0 1 21 529 1053 4 1 95 0
0 0 0 1347200 81484 1592176 0 0 0 39 530 1067 3 2 95 0
1 0 0 1347200 81492 1592172 0 0 0 14 530 1058 3 1 96 0
0 0 0 1352796 81500 1592172 0 0 0 17 514 1034 3 2 95 0
0 0 0 1352796 81508 1592180 0 0 0 21 516 1049 6 1 92 0
0 0 0 1352764 81516 1592180 0 0 0 15 506 1024 2 1 95 1
0 0 0 1352252 81524 1592180 0 0 0 15 563 1090 3 2 95 0
0 0 0 1351836 81532 1592180 0 0 0 15 550 1066 4 1 94 0
0 0 0 1346768 81540 1592200 0 0 1 18 547 1111 4 2 94 0
1 0 0 1346152 81548 1592204 0 0 0 69 524 1059 3 2 94 0
0 0 0 1346472 81556 1592244 0 0 1 17 498 1012 2 1 96 0 -
Network stream fxp excess memory usage and poor performance
I'm trying to stream some datas à highspeed rate (3 channels à 1Mbytes/s) from my 9030 to my windows host. Because i don't need to use data on the rt side, i choose to forward FXP <+-,24,5> to my host throug a network stream.
To avoid data loose i choose to use a wide buffer of 6000000 with this buffer my memory usage grow from 441mo to 672Mo and my rio is unable to stream the data.
With sgl or double, memory usage is 441 to 491Mo and datas can be streamed continusly.
Anyone have encoutered this problem?SQL Developer is java based and relies on the jvm's memory management.
I'm not aware of any memory leaks as such, but memory tends not to be returned to the system.
Queries which return large return sets tend to use a lot of memory (SQL Developer has to build a java table containing all the results for display).
You can restrict the maximum memory allocated by modifying settings in in <sqldeveloper>\ide\bin\ide.conf
The defaults are -
AddVMOption -Xmx640M
AddVMOption -Xms128M -
How to monitor java memory usage in enterprise manager
I am running sqlplus to execute a sql package, which generates XML.
When processing 2000+ rows, it will give a out of memory error.
Where in enterprise manger can I see this memory usage?
Thanks.Hello,
it depends a little on what you want to do. If you use the pure CCMS monitoring with the table ALTRAMONI you get average response time per instance and you only get new measurements once the status changes from green to yellow or red.
In order to get continuous measurements you should look into Business Process Monitoring and the different documentations under https://service.sap.com/bpm --> Media Libary --> Technical Information. E.g. the PDF Setup Guide for Application Monitoring describes this "newer" dialog performance monitor. Probably you have to click on the calendar sheet in the Media Libary to also see older documents as well. As the Business Process Monitoring integrates with BW (there is also a BI Setup Guide in the Media LIbrary) you can get trendlines there. This BW integration also integrates back with SL Reporting.
Some guidance for SL Reporting is probably given under https://service.sap.com/rkt-solman but I am not 100% sure.
Best Regards
Volker -
Memory usage in Analysis Services tabular model
Hello,
I've been researching and investigating trying to understand what is consuming memory resources in a tabular model that I'm working with. Using SQL Server Management Studio, the Estimated Size of the database is reported as 7768.34 MBs. Using
Kasper de Jonge's BISM Server Memory Report, the database is reported as 15,465.13 MBs. However, a majority of the fields in the BISM Server Memory Report are empty, and so I cannot determine what is consuming the memory. The data source for this particular
workbook is $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE.
For example: I drill-down to an individual column (ColumnA) in the BISM Server Memory Report (Database > Dimensions > Table > In-Memory Table > Columns > Column) and the reported memory usage is 706.97 MBs. Underneath ColumnA,
I see a blank level with a reported memory usage of 623.59 MBs and a Segments level with a reported memory usage of 83.39 MBs. Looking at $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMN_SEGMENTS, if I SUM the USED_SIZE for ColumnA, it totals roughly 83 MBs which matches
what is reported in the BISM Server Memory Report for the segment size. How do I determine what the other 623.59 MBs is being used for? Again, this discrepancy occurs for all columns in the model and not just this one example.
Thanks!Follow up to my original question. It appears that the blank levels (at least under the column level) the Kasper de Jonge's BISM Server Memory Report reports the dictionary size of the column. The memory usage size matches the DICTIONARY_SIZE attribute in
the $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMNS. I made a mis-assumption as to what the information $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMN_SEGMENTS was providing.
In my original post I reference one database in particular in where the Estimated Size property in the Database Properties dialog is listed as 7,768.34 MBs. and the $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE reports 15,465.13 MBs. Thoughts, comments, or opinions
on why the Estimated Size property does not match what's reported in $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE?
Thanks! -
I am storing files in sql lite, but when i store large file 400+Mb system throw this exception
Error #1000: The system is out of memory.
at flash.data::SQLStatement/internalExecute()
at flash.data::SQLStatement/execute()
Please give suggestion
ThanksOne sql server box:
SYstem administrator pointed out: SQL server almost uses all memory and server memory usage almost hits 100%
How to fix this problem?
This is not a problem but normal behavior.SQL Server will use as much memory you provide to it.So its good to set proper value for max server memory setting in sp_configure.See example in below MS link . Set proper memory usage for SQL Server leaving
enough RAM (4-5 G ) for OS.This will only include memory set for buffer pool there are memory allocations outside buffer pool which is directly done by OS
http://technet.microsoft.com/en-us/library/ms178067.aspx
To read more about memory
http://social.technet.microsoft.com/wiki/contents/articles/22316.sql-server-memory-and-troubleshooting.aspx
Please mark this reply as the answer or vote as helpful, as appropriate, to make it useful for other readers -
Extproc.exe memory usage
Hello,
I'm having problems while using ODT with ODAC (11.2.0.2.1). I've done a .NET (C# using Visual Studio 2010) library to be called from PL/SQL. It works without a problem, and finish the execution closing all objects and even doing a Garbage Collection (System.GC.Collect()) just to be sure that the most memory is reclaimed.
The problem comes when I do the stress test (multiple call to the C# procedure, like 20000 times). I can see how extproc.exe (the service/process used to make external calls) start using more and more memory. Each call to the C# procedure wastes some KB of memory, and when I do the stress test, extproc.exe comes to have allocated 800 MB of RAM memory and even more...
It seems that sometimes, Oracle or the process itself makes acknowledge of the RAM used and I see it wasting only 100 MB, so it seems it has some kind of memory management capabilities, but it's not enought, as sometimes memory goes as high that my server starts loading out some process from memory and performance degrades.
Is there any way to control how much memory extproc.exe can waste, or control the behaviour of the process, or something like that?
Thanks a lot,
Luis MiguelAnubhavM wrote:
I have tested for memory leak with JProfiler, it shows that the GC gets called after some time, and there is no increase in heap size. But the memory usage of Javaw.exe keeps increasing. Is it possible that JVM is not returning memory back to OS? or some other reason for increase in memory usage?The VM isn't returning memory to the OS and it's designed to work like that. (Or at least used to be, I saw a change request on that a couple of years ago and it got many votes in the bugdatabase) -
Nested tables and memory usage (ORA-04030 error)
Dear All,
I have table with approximately 5,000,000 records
and try to Bulk Collect part of it into nested table in PL/SQL, the code is bellow
Declare
Type TcardRec Is Record(
serno Pls_Integer,
numberx Char(16),
caccserno Pls_Integer
Type TcardList Is Table Of TcardRec;
fcardInfo TcardList;
Begin
Select c.serno, substr(c.numberx,1,16), c.caccserno
Bulk Collect Into fcardinfo
From cardx c;
End;
After reading approx. 80% it fails with error
ORA-04030: out of process memory when trying to allocate 16396 bytes (koh-kghu call ,pmucalm coll)
I 2G memory, is it realy no enough?
How can I tune memory usage for collection?
How can I estimate the maximum size of the collection the will fit into memory?
Thank you in advance for any help
ArtemDeclare it as a cursor.
Open the cursor.
Use fetch bulk collect with the limit option in the loop.
In your case, you could do like:
Declare
Cursor c1 is
Select c.serno, substr(c.numberx,1,16), c.caccserno
From cardx c;
TcardList Is Table Of c1%rowtype;
fcardInfo TcardList;
Begin
Open c1;
Loop
Fetch c1 Bulk Collect Into fcardInfo Limit 10000;
Exit when c1%notfound;
-- Do some processing here.
End Loop;
Close c1;
End;
I hope this helps.
Maybe you are looking for
-
Design Patterns needed for SAP XI
Hi
-
HP Pavilion Slimline s3530f Windows Vista 64-bit IE 9
-
Have leopard but still get Cannot Submit Batche error message in Compressor
i get the "cannot submit batch unable to connect to background process" error message. Some posts attribute this to a Tiger anomaly but it has happened to me after i went to 10.4.10--though i had not used my DVDSP2 in several months. Any suggestions
-
Dreamweaver CC startup issue persists, even after trying 2 proposed fixes
Hi all, I have a windows 7 pro 64bit machine. About a week ago I got a screen about a trial, even though I have a purchased and installed an official version. I may have pushed the wrong button. Since then DW CC quits/stops/crashes right after startu
-
Can i use my iphone sim card in an ipad
Can i remove my sim card which has an unlimited data plan to use in an ipad