SQL Memory Usage

Hello
I am updating some items with the DTW. i am updating 9000 items. I have made 9 files of 1000 records, i am just updating the picturname field. When i start to upload the files the SQL Memory usage starts to grow more and more. When i try to upload the third file the memory has grown too much, and the DTW says the file update ok but it doesnt update the database. So i need to restart the SQL service (mssqlserver) and do it again. Some times it doesnt work so i need to restart the server.
Any ideas??
Jacobo

hi,
Check this information abt DI API Memory Consumption in WIKI SDK FAQ's.
https://www.sdn.sap.com/irj/scn/wiki?path=/display/b1/faq_sdk
DI API
Memory consumption
New connection mechanism in 2007 vs. classical
1. In the old method the DI API was loaded into the same process with the Add-On and was an "actual part" of it, so calls to the DI-API were very quick and direct
2. In the new method there is one common DI-API which is part of the Core B1. All the Add-Ons will use the same DI-API IF (!!!) they work in the new method. The calls to the DI-API have now to "go between" two processes. This means that they go through more processing and although it's all in the same machine and no actual communication (i.e., network traffic) is actually happening, the system's CPU and memory are "working harder".
The impact is extremely small on an individual call level, but for an Add-On that makes a large amount of calls this difference accumulates...
There is no huge additional CPU or Memory consumption. Most of the impact is on the Response Time level. Some of it is CPU consumption and some of it is Context Switch waiting.
3. This trade-off between Memory consumption and Response Time is actually another reason why R&D thought it's a good idea to leave the new method to be optional based on a decision from the developer.
Jeyakanthan

Similar Messages

  • Sql memory usage increase each time win app runs

    Hi,
    Sql memory usage increases each time when win app runs. Why does it work like this? Is it normal ?
    I restart SQL Server 2012. Only my win app uses SQL server.
    First run of winapp.
    start memory usage : 211.800 KB
    close memory usage: 528.136 KB
    Second run of xaf app.
    start memory usage : 528.136 KB
    close memory usage: 996.844 KB
    Third run of xaf app
    start memory usage : 996.844 KB
    close memory usage: 997.640 KB
    Fourth run of xaf app
    start memory usage : 997.640 KB
    close memory usage: 1.104.864 KB

    Hi,
    Sql memory usage increases each time when win app runs. Why does it work like this? Is it normal ?
    Yes, it is perfectly normal for SQL Server to acquire and hold onto large amounts of memory indefinitely.  This memory improves performance by avoiding disk I/O, query plan compilation and costly memory management. 
    On a dedicated SQL Server you should usually let SQL Server dynamically manage memory.  It will release memory if it detects memory pressure.  But if you often run other applications on the server than need significant amounts of memory (e.g. IIS,
    application services), you may want to set max server memory as suggested.
    Dan Guzman, SQL Server MVP, http://www.dbdelta.com

  • HIGH memory usage in Perf Counters but LOW by SQL components

    Hi all,
    Our SQL Server has the following specs:
    OS: Windows Server 2008 R2 Enterprise Edition SP1+Cumulative Updates
    RAM: 128GB
    SQL Server: 2012, Enterprise (SP2), Core-based Licensing (64-bit)
    Max Memory Setting: Limited to 123GB
    I used performance counters to see memory usage by SQL Server:
    SQLServer:MemoryManager:TargetServerMemory(KB)=125,952,000
    SQLServer:MemoryManager:TotalServerMemory(KB)=125,634,000
    SQLServer:BufferManager:PageLifeExpectancy=104,000
    When I use SSMS report (Memory Consumption) and navigate to "Memory usage by components", the sum of "Allocated memory (KB)" is about 34GB and is not equal to TotalServerMemory perf counter. 
    Please help me to understand relation between this report and perf counters mentioned above. 
    Many thanks in advance.
    Leila

    Process/System Counts                    Value
    Available Physical Memory                1490161664
    Available Virtual Memory                 8599063212032
    Available Paging File                    12067610624
    Working Set                              128870092800
    Percent of Committed Memory in WS        100
    Page Faults                              240261318
    System physical memory high              1
    System physical memory low               0
    Process physical memory low              0
    Process virtual memory low               0
    (10 row(s) affected)
    Memory Manager                           KB
    VM Reserved                              191481084
    VM Committed                             125669808
    Locked Pages Allocated                   0
    Large Pages Allocated                    0
    Emergency Memory                         1024
    Emergency Memory In Use                  16
    Target Committed                         125952008
    Current Committed                        125669808
    Pages Allocated                          44388280
    Pages Reserved                           1928
    Pages Free                               77023672
    Pages In Use                             16043264
    Page Alloc Potential                     103611136
    NUMA Growth Phase                        0
    Last OOM Factor                          0
    Last OS Error                            0
    (16 row(s) affected)
    Memory node Id = 0                       KB
    VM Reserved                              191479484
    VM Committed                             62784472
    Locked Pages Allocated                   0
    Pages Allocated                          20930080
    Pages Free                               39219960
    Target Committed                         62975992
    Current Committed                        62784472
    Foreign Committed                        1118440
    Away Committed                           0
    Taken Away Committed                     0
    (10 row(s) affected)
    Memory node Id = 1                       KB
    VM Reserved                              1536
    VM Committed                             62885316
    Locked Pages Allocated                   0
    Pages Allocated                          23458200
    Pages Free                               37803712
    Target Committed                         62975992
    Current Committed                        62885320
    Foreign Committed                        92596
    Away Committed                           0
    Taken Away Committed                     0
    (10 row(s) affected)
    Memory node Id = 64                      KB
    VM Reserved                              0
    VM Committed                             20
    Locked Pages Allocated                   0
    (3 row(s) affected)
    MEMORYCLERK_SQLGENERAL (node 0)          KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          184448
    (6 row(s) affected)
    MEMORYCLERK_SQLGENERAL (node 1)          KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          464
    (6 row(s) affected)
    MEMORYCLERK_SQLGENERAL (Total)           KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          184912
    (6 row(s) affected)
    MEMORYCLERK_SQLBUFFERPOOL (node 0)       KB
    VM Reserved                              51979512
    VM Committed                             3382604
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          14168056
    (6 row(s) affected)
    MEMORYCLERK_SQLBUFFERPOOL (node 1)       KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          18436712
    (6 row(s) affected)
    MEMORYCLERK_SQLBUFFERPOOL (Total)        KB
    VM Reserved                              51979512
    VM Committed                             3382604
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          32604768
    (6 row(s) affected)
    MEMORYCLERK_SQLQUERYEXEC (node 0)        KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          18056
    (6 row(s) affected)
    MEMORYCLERK_SQLOPTIMIZER (node 0)        KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          1736
    (6 row(s) affected)
    MEMORYCLERK_SQLUTILITIES (node 0)        KB
    VM Reserved                              14656
    VM Committed                             14656
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          10256
    (6 row(s) affected)
    MEMORYCLERK_SQLUTILITIES (node 1)        KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          7952
    (6 row(s) affected)
    MEMORYCLERK_SQLUTILITIES (Total)         KB
    VM Reserved                              14656
    VM Committed                             14656
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          18208
    (6 row(s) affected)
    MEMORYCLERK_SQLSTORENG (node 0)          KB
    VM Reserved                              19712
    VM Committed                             19712
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          19016
    (6 row(s) affected)
    MEMORYCLERK_SQLSTORENG (node 1)          KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          12824
    (6 row(s) affected)
    MEMORYCLERK_SQLSTORENG (Total)           KB
    VM Reserved                              19712
    VM Committed                             19712
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          31840
    (6 row(s) affected)
    MEMORYCLERK_SQLCONNECTIONPOOL (node 0)   KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          1824
    (6 row(s) affected)
    MEMORYCLERK_SQLCONNECTIONPOOL (node 1)   KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          1144
    (6 row(s) affected)
    MEMORYCLERK_SQLCONNECTIONPOOL (Total)    KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          2968
    (6 row(s) affected)
    MEMORYCLERK_SQLCLR (node 0)              KB
    VM Reserved                              12606272
    VM Committed                             33460
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          82736
    (6 row(s) affected)
    MEMORYCLERK_SQLCLRASSEMBLY (node 0)      KB
    VM Reserved                              5096
    VM Committed                             5096
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          0
    (6 row(s) affected)
    MEMORYCLERK_SQLSERVICEBROKER (node 0)    KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          3088
    (6 row(s) affected)
    MEMORYCLERK_SQLHTTP (node 1)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          8
    (6 row(s) affected)
    MEMORYCLERK_SNI (node 0)                 KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          128
    (6 row(s) affected)
    MEMORYCLERK_SNI (node 1)                 KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          112
    (6 row(s) affected)
    MEMORYCLERK_SNI (node 64)                KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          16
    (6 row(s) affected)
    MEMORYCLERK_SNI (Total)                  KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          256
    (6 row(s) affected)
    MEMORYCLERK_FULLTEXT (node 0)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          384
    (6 row(s) affected)
    MEMORYCLERK_SQLXP (node 0)               KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          16
    (6 row(s) affected)
    MEMORYCLERK_BHF (node 0)                 KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          224
    (6 row(s) affected)
    MEMORYCLERK_BHF (node 1)                 KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          112
    (6 row(s) affected)
    MEMORYCLERK_BHF (Total)                  KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          336
    (6 row(s) affected)
    MEMORYCLERK_SQLQERESERVATIONS (node 0)   KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          2064
    (6 row(s) affected)
    MEMORYCLERK_XE_BUFFER (node 0)           KB
    VM Reserved                              3072
    VM Committed                             3072
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          0
    (6 row(s) affected)
    MEMORYCLERK_XE_BUFFER (node 1)           KB
    VM Reserved                              1536
    VM Committed                             1536
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          0
    (6 row(s) affected)
    MEMORYCLERK_XE_BUFFER (Total)            KB
    VM Reserved                              4608
    VM Committed                             4608
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          0
    (6 row(s) affected)
    MEMORYCLERK_XTP (node 0)                 KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          16
    (6 row(s) affected)
    MEMORYCLERK_HOST (node 1)                KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          320
    (6 row(s) affected)
    MEMORYCLERK_SOSNODE (node 0)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          87696
    (6 row(s) affected)
    MEMORYCLERK_SOSNODE (node 1)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          58688
    (6 row(s) affected)
    MEMORYCLERK_SOSNODE (node 64)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          2600
    (6 row(s) affected)
    MEMORYCLERK_SOSNODE (Total)              KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          148984
    (6 row(s) affected)
    MEMORYCLERK_SOSOS (node 0)               KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          192
    (6 row(s) affected)
    MEMORYCLERK_SOSMEMMANAGER (node 0)       KB
    VM Reserved                              265288
    VM Committed                             265176
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          0
    (6 row(s) affected)
    MEMORYCLERK_FULLTEXT_SHMEM (node 0)      KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              768
    SM Committed                             768
    Pages Allocated                          0
    (6 row(s) affected)
    MEMORYCLERK_SQLSERVICEBROKERTRANSPORT (node 0) KB
    VM Reserved                                    0
    VM Committed                                   0
    Locked Pages Allocated                         0
    SM Reserved                                    0
    SM Committed                                   0
    Pages Allocated                                320
    (6 row(s) affected)
    MEMORYCLERK_FSAGENT (node 0)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          24
    (6 row(s) affected)
    MEMORYCLERK_FILETABLE (node 0)           KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          72
    (6 row(s) affected)
    MEMORYCLERK_XE (node 0)                  KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          6368
    (6 row(s) affected)
    MEMORYCLERK_SQLLOGPOOL (node 0)          KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    Pages Allocated                          8328
    (6 row(s) affected)

  • SQL SERVER PHYSICAL MEMORY USAGE HIGH

    HI Teams,
    i am  going threw one of my production high physical memory usage in SQL Server. It always
    around 90%.When i reboot the server, it will initially good but end of the day it will around 95 to 98% physical memory usage.
    please give the valid solutions..,
    Regards,
    DBA 

    This is an expected/normal behaviour in SQL Server box. Memory management is highly dynamic in SQL Server and will use the complete memory allocated to SQL Server. It is also important to set the MAX SERVER MEMORY for the SQL Server instance. You may not
    need to worry about this unless you find any performance issues.
    Please mark this reply as answer if it solved your issue or vote as helpful if it helped.
     [Blog]

  • SQL Server Memory Usage Peaks to 95% and its not releasing SQL 2012

    We are currently running SQL 2012  64 bit, Lock Pages Enabled, 128 GB. We allocated Max Memory 112000, Min Memory to 0. We have a SQL Maintenace Job which backs up (Full Backup) of our server around 11PM at that time the SQL Server memory peaks to almost
    96% even during full business hours we are constantly in the range of 56 to 60% but after 11PM within 10 minutes of the job it peaks to 95 or 96 Percentage and even after the job completes it's not releasing the memory back. I have to manually shut the sql
    service and then restart at that time it comes back to normal.
    Any suggestions/any help really appreciated.

    Here are the details Memory is at 96% I still didn't restart...Please any help appreciated...The memory detals is for 24 hours  I restarted the service around 11AM before I posted my previous message..
    Memory Used by SqLServer: 119329
    Locked Pages Used SQLServer : 105969
    Total VAS in MB : 8388607
    Process Physical Memory Low : 0
    Process Virtual Memory Low : 0
    Max Memory set to :112000
    Out of 128 Memory Last 24 hours the memory usage in %
    Percent Memory Used - Total Memory is 128.0 GB
    Last 24 Hours
    DATE / TIME
    Memory Used
    19-Dec-14
    11:46 PM
    96.24659602
    20-Dec-14
    12:46 AM
    96.24578349
    20-Dec-14
    1:46 AM
    96.25146739
    20-Dec-14
    2:46 AM
    96.24345652
    20-Dec-14
    3:46 AM
    96.27311834
    20-Dec-14
    4:46 AM
    96.28947067
    20-Dec-14
    5:46 AM
    96.18931325
    20-Dec-14
    6:46 AM
    96.09323502
    20-Dec-14
    7:46 AM
    96.07915497
    20-Dec-14
    8:46 AM
    96.07906977
    20-Dec-14
    9:46 AM
    96.0784111
    20-Dec-14
    10:46 AM
    96.07415009
    20-Dec-14
    11:46 AM
    26.03422141
    20-Dec-14
    12:46 PM
    33.57474359
    20-Dec-14
    1:46 PM
    39.466561
    20-Dec-14
    2:46 PM
    41.85940742
    20-Dec-14
    3:46 PM
    43.89071274
    20-Dec-14
    4:46 PM
    45.80877368
    20-Dec-14
    5:46 PM
    46.49493281
    20-Dec-14
    6:46 PM
    46.68486468
    20-Dec-14
    7:46 PM
    46.69701958
    20-Dec-14
    8:46 PM
    46.69994736
    20-Dec-14
    9:46 PM
    57.5012455
    20-Dec-14
    10:46 PM
    96.25695419
    I verified its a sqL job and still my memory is 95%
    It peaeked at 10:46PM and here are the details of the SQL job which started at 10:30 
    Progress: 2014-12-20 22:30:04.39 
          Source: Check Database Integrity Task      Executing query "USE [DATASTORE]  ".: 50% complete  End Progress  Progress: 2014-12-20 22:43:06.10 
          Source: Check Database Integrity Task      Executing query "DBCC CHECKDB(N'DATASTORE')  WITH NO_INFOMSGS  ".: 100% complete  End Progress
        Progress: 2014-12-20 22:43:06.11     Source: Check Database Integrity Task      Executing query "USE [ETL_Proc]  ".: 50% complete 
     End Progress  Progress: 2014-12-20 22:46:52.56     Source: Check Database Integrity Task      Executing query "DBCC CHECKDB(N'ETL_Proc') 
      WITH NO_INFOMSGS  ".: 100% complete  End Progress  Progress: 2014-12-20 22:46:52.64     Source: Back Up Database Task
            Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 20% complete  End Progress  
    Progress: 2014-12-20 22:46:52.64     Source: Back Up Database Task      Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".
    : 40% complete  End Progress  Progress: 2014-12-20 22:46:52.64   
      Source: Back Up Database Task      Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 60% complete 
       End Progress  Progress: 2014-12-20 22:46:52.64     Source: Back Up Database Task    
     Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 80% complete  End Progress  
     Progress: 2014-12-20 22:46:52.64     Source: Back Up Database Task      
     Executing query "EXECUTE master.dbo.xp_create_subdir N'P:\SQL_Backu...".: 100% complete  End Progress 
      Progress: 2014-12-20 22:46:55.63     Source: Back Up Database Task    
        Executing query "BACKUP DATABASE [ReportServer] TO  DISK = N'P:\SQL...".: 100% complete  
    End Progress  Progress: 2014-12-20 22:46:56.55     Source: Back Up Database Task    
      Executing query "BACKUP DATABASE [ReportServerTempDB] TO  DISK = N'...".: 100% complete  End Progress  Progress: 2014-12-20 22:46:57.35  
         Source: Back Up Database Task      Executing query "BACKUP DATABASE [dbamaint] TO  DISK = N'P:\SQL_Bac...".: 100% complete  End Progress 
      Progress: 2014-12-20 22:51:13.08     Source: Back Up Database Task   
         Executing query "BACKUP DATABASE [DATASTORE] TO  DISK = N'P:\SQL_Ba...".: 100% complete  End Progress
       Progress: 2014-12-20 22:51:52.72     Source: Back Up Database Task     
    Executing query "BACKUP DATABASE [ETL_Proc] TO  DISK = N'P:\SQL_Bac...".: 100% complete  End Progress  Progress: 2014-12-20 22:51:54.87 
        Source: Rebuild Index Task      Executing query "USE [ReportServer]  ".: 0% complete  End Progress  Progress:
     2014-12-20 22:51:54.88     Source: Rebuild Index Task      Executing query "ALT...  The package executed successf...  The step succeeded.

  • SQL Server Memory usage is high

    Hello,
    One of our production SQL cluster is eating up more memory on server.
    Here are the server specifications :
    OS : Windows 2008 R2 Enterprise
    SQL : SQL Server 2008 SP2 standard edition ( 2 node cluster )
    Memory : 16 GB ( 8 Gb to SQL and rest to OS )
    CPU : 8
    This server is heavily used by CLR and linked server events.
    I have seen the memory usage of databases , it's not using more than 7 GB and leaving 1 GB free in sql memory area ( from our Idera SQL dm
    monitoring tool ). I'm suspecting CLR events are causing these spikes.
    When i look at the task manager sqlserver.exe is using 15.7 Gb ( close to 16 GB )
    Not sure how to see which process are using the memory. 
    Also we are seeing the below error messages in error log very frequently
    10/27/2014 15:23:52,spid1s,Unknown,AppDomain 85 (xxxxxx) is marked for unload due to memory pressure.
    I have looked at some blogs in internet, i didnt get any correct info. I have seen this is kind of bug in SQL 2005 32-bit system but we are
    using 64 bit system.
    http://support.microsoft.com/kb/969962
    Can anyone please help me on this ?
    Thanks in advance

    Continuation of DBCC memorystatus output
    CACHESTORE_TEMPTABLES (node 0)           KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     40
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_NOTIF (node 0)                KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     16
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_VIEWDEFINITIONS (node 0)      KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     16
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_XMLDBTYPE (node 0)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_XMLDBELEMENT (node 0)         KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_XMLDBATTRIBUTE (node 0)       KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_STACKFRAMES (node 0)          KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     0
    MultiPage Allocator                      8
    (7 row(s) affected)
    CACHESTORE_STACKFRAMES (node 64)         KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     0
    MultiPage Allocator                      8
    (7 row(s) affected)
    CACHESTORE_STACKFRAMES (Total)           KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     0
    MultiPage Allocator                      16
    (7 row(s) affected)
    CACHESTORE_BROKERTBLACS (node 0)         KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     48
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_BROKERKEK (node 0)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_BROKERDSH (node 0)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_BROKERUSERCERTLOOKUP (node 0) KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_BROKERRSB (node 0)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_BROKERREADONLY (node 0)       KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     32
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_BROKERTO (node 0)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_EVENTS (node 0)               KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     16
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_CLRPROC (node 0)              KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     40
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_SYSTEMROWSET (node 0)         KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     1856
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_CONVPRI (node 0)              KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     48
    MultiPage Allocator                      0
    (7 row(s) affected)
    CACHESTORE_FULLTEXTSTOPLIST (node 0)     KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     32
    MultiPage Allocator                      0
    (7 row(s) affected)
    USERSTORE_SCHEMAMGR (node 0)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     16432
    MultiPage Allocator                      856
    (7 row(s) affected)
    USERSTORE_DBMETADATA (node 0)            KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     5592
    MultiPage Allocator                      0
    (7 row(s) affected)
    USERSTORE_TOKENPERM (node 0)             KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     3856
    MultiPage Allocator                      3960
    (7 row(s) affected)
    USERSTORE_OBJPERM (node 0)               KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     2328
    MultiPage Allocator                      0
    (7 row(s) affected)
    USERSTORE_SXC (node 0)                   KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     656
    MultiPage Allocator                      0
    (7 row(s) affected)
    USERSTORE_SXC (node 64)                  KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     8
    MultiPage Allocator                      0
    (7 row(s) affected)
    USERSTORE_SXC (Total)                    KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     664
    MultiPage Allocator                      0
    (7 row(s) affected)
    OBJECTSTORE_LBSS (node 0)                KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     128
    MultiPage Allocator                      608
    (7 row(s) affected)
    OBJECTSTORE_SNI_PACKET (node 0)          KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     2008
    MultiPage Allocator                      56
    (7 row(s) affected)
    OBJECTSTORE_SNI_PACKET (node 64)         KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     0
    MultiPage Allocator                      56
    (7 row(s) affected)
    OBJECTSTORE_SNI_PACKET (Total)           KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     2008
    MultiPage Allocator                      112
    (7 row(s) affected)
    OBJECTSTORE_SERVICE_BROKER (node 0)      KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     424
    MultiPage Allocator                      0
    (7 row(s) affected)
    OBJECTSTORE_LOCK_MANAGER (node 0)        KB
    VM Reserved                              32768
    VM Committed                             32768
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     4048
    MultiPage Allocator                      0
    (7 row(s) affected)
    OBJECTSTORE_LOCK_MANAGER (node 64)       KB
    VM Reserved                              0
    VM Committed                             0
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     24
    MultiPage Allocator                      0
    (7 row(s) affected)
    OBJECTSTORE_LOCK_MANAGER (Total)         KB
    VM Reserved                              32768
    VM Committed                             32768
    Locked Pages Allocated                   0
    SM Reserved                              0
    SM Committed                             0
    SinglePage Allocator                     4072
    MultiPage Allocator                      0
    (7 row(s) affected)
    Buffer Pool                              Value
    Committed                                1024000
    Target                                   1024000
    Database                                 793462
    Dirty                                    36258
    In IO                                    0
    Latched                                  0
    Free                                     171398
    Stolen                                   59140
    Reserved                                 0
    Visible                                  1024000
    Stolen Potential                         913660
    Limiting Factor                          17
    Last OOM Factor                          0
    Last OS Error                            0
    Page Life Expectancy                     262733
    (15 row(s) affected)
    Process/System Counts                    Value
    Available Physical Memory                69021696
    Available Virtual Memory                 8762135273472
    Available Paging File                    12716019712
    Working Set                              15196917760
    Percent of Committed Memory in WS        100
    Page Faults                              897824874
    System physical memory high              0
    System physical memory low               0
    Process physical memory low              0
    Process virtual memory low               0
    (10 row(s) affected)
    Procedure Cache                          Value
    TotalProcs                               4573
    TotalPages                               53712
    InUsePages                               27
    (3 row(s) affected)
    Global Memory Objects                    Pages
    Resource                                 412
    Locks                                    509
    XDES                                     219
    SETLS                                    8
    SE Dataset Allocators                    16
    SubpDesc Allocators                      8
    SE SchemaManager                         1169
    SE Column Metadata Cache                 991
    SQLCache                                 893
    Replication                              2
    ServerGlobal                             52
    XP Global                                2
    SortTables                               3691
    (13 row(s) affected)
    Query Memory Objects (internal)          Value
    Grants                                   0
    Waiting                                  0
    Available                                756700
    Current Max                              756700
    Future Max                               756700
    Physical Max                             756700
    Next Request                             0
    Waiting For                              0
    Cost                                     0
    Timeout                                  0
    Wait Time                                0
    (11 row(s) affected)
    Small Query Memory Objects (internal)    Value
    Grants                                   0
    Waiting                                  0
    Available                                12800
    Current Max                              12800
    Future Max                               12800
    (5 row(s) affected)
    Optimization Queue (internal)            Value
    Overall Memory                           6723993600
    Target Memory                            5965963264
    Last Notification                        1
    Timeout                                  6
    Early Termination Factor                 5
    (5 row(s) affected)
    Small Gateway (internal)                 Value
    Configured Units                         32
    Available Units                          32
    Acquires                                 0
    Waiters                                  0
    Threshold Factor                         380000
    Threshold                                380000
    (6 row(s) affected)
    Medium Gateway (internal)                Value
    Configured Units                         8
    Available Units                          8
    Acquires                                 0
    Waiters                                  0
    Threshold Factor                         12
    Threshold                                -1
    (6 row(s) affected)
    Big Gateway (internal)                   Value
    Configured Units                         1
    Available Units                          1
    Acquires                                 0
    Waiters                                  0
    Threshold Factor                         8
    Threshold                                -1
    (6 row(s) affected)
    Memory Pool Manager                      Pages
    Reserved Current                         0
    Reserved Limit                           913664
    (2 row(s) affected)
    Memory Pool (internal)                   Pages
    Allocations                              59136
    Predicted                                248311
    Private Target                           0
    Private Limit                            0
    Total Target                             972800
    Total Limit                              972800
    OOM Count                                0
    (7 row(s) affected)
    MEMORYBROKER_FOR_CACHE (internal)        Pages
    Allocations                              55358
    Rate                                     0
    Target Allocations                       779847
    Future Allocations                       0
    Overall                                  820800
    Last Notification                        1
    (6 row(s) affected)
    MEMORYBROKER_FOR_STEAL (internal)        Pages
    Allocations                              3778
    Rate                                     0
    Target Allocations                       728267
    Future Allocations                       0
    Overall                                  820800
    Last Notification                        1
    (6 row(s) affected)
    MEMORYBROKER_FOR_RESERVE (internal)      Pages
    Allocations                              0
    Rate                                     0
    Target Allocations                       820800
    Future Allocations                       189175
    Overall                                  820800
    Last Notification                        1
    (6 row(s) affected)
    DBCC execution completed. If DBCC printed error messages, contact your system administrator.

  • SQL 2012 Memory usage analysis

    We have this clustered SQL Server, win 2008 R2 + SQL 2012 Standard SP2,
    Server RAM is 64GB, maximum memory is set at 50GB, and minimum memory is set at 10GB.
    When I check memory usage, it seems
    CLR takes more memory than Buffer Pool, is it normal? Or does it show memory allocation issue? Thanks a lot!
    The "total server memory" and "target server memory" performance counters are both 50GB.
    Please kindly see below screen shots below:

    Hi Vivian,
    I would assume you are asking question related to SQL Server 2012 memory the whole discussion would change if it is SQL Server 2008 r2 memory
    You are not drawing correct information from first query.
    CLR has Reserved 6 G but ONLY committed 12 MB. And that too you are looking at virtual memory which is 6TB for SQL Server process so of course CLR can reserve there is actually no issue with it. A committed memory is actually what SQL Server is using
    reserved in simple language is what SQL Server thinks it might need in near future.
    As you said Target and total memory are same its good.
    For both 2012 and 2008 r2 below query will give total memory utilization by SQL Server instance
    select
    (physical_memory_in_use_kb/1024)Memory_usedby_Sqlserver_MB,
    (locked_page_allocations_kb/1024 )Locked_pages_used_Sqlserver_MB,
    (total_virtual_address_space_kb/1024 )Total_VAS_in_MB,
    process_physical_memory_low,
    process_virtual_memory_low
    from sys. dm_os_process_memory
    If you want to see Breakdown of memory utilized by various clerks in 2008 r2
    select
    type,
    (SUM(single_pages_kb)/1024) Single_page_allocator_memory,
    (SUM(multi_pages_kb)/1024) multi_page_allocator_memory,
    (sum(awe_allocated_kb)/1024) [AWE API memory]
    from sys.dm_os_memory_clerks
    group by type
    order by Single_page_allocator_memory desc
    For 2012
    select type,
    (SUM(pages_kb)/1024) as Memory_Utilized
    (sum(awe_allocated_kb)/1024) as Memory Allocated by AWE API
    from
    sys.dm_os_memory_clerks
    group by type
    order by Memory_Utilized desc
    Starting from 2012 Max server memory controls much more than buffer pool
    Max server memory controls SQL Server memory allocation, including the buffer pool, compile memory, all caches, qe memory grants, lock manager memory, and CLR memory (basically any “clerk” as found in dm_os_memory_clerks). Memory for thread stacks, heaps,
    linked server providers other than SQL Server, or any memory allocated by a “non SQL Server” DLL is not controlled by max server memory
    Please mark this reply as answer if it solved your issue or vote as helpful if it helped so that other forum members can benefit from it
    My Technet Wiki Article
    MVP

  • Memory usage of excel stays high after Macro is executed and excel crashes after trying to close it

    Hi,
    I'm trying to resolve an issue with an excel based tool. The macros retrieve data from an Oracle database and do calculations with the data. They also open and write into files in the same directory. The macros all run and finish the calculations. I can
    continue to use and modify the sheet. I can also close the workbook, however excel memory usage I see in the windows Task manager stays elevated.If I  close Excel it says: Excel stopped working and then it tries to recover information...
    I assume something in the macro did not finish properly and memory was not released. I would like to check what is still open (connection, stream or any other object) when I close the workbook I would like to have a list of all still used memory. Is there
    a possibility to do so.
    Here the code I'm using, its reduced to functions which open something. Functions   
    get_v_tools() and get_change_tools() are same as get_client_positions().
    Public conODBC As New ADODB.Connection
    Public myPath As String
    Sub get_positions()
    Dim Src As range, dst As range
    Dim lastRow As Integer
    Dim myPath As String
    lastRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row
    Sheets("SQL_DATA").range("A2:AD" & lastRow + 1).ClearContents
    Sheets("SQL_DATA").range("AG2:BE" & lastRow + 2).ClearContents
    Sheets("SQL_DATA").range("AE3:AF" & lastRow + 2).ClearContents
    k = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
    Sheets("ToolsList").range("A2:M" & k).ClearContents
    'open connection
    Call open_connection
    lastRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row
    If lastRow < 2 Then GoTo ErrorHandling
    'copy bs price check multiplications
    Set Src = Sheets("SQL_DATA").range("AE2:AF2")
    Set dst = Worksheets("SQL_DATA").range("AE2").Resize(lastRow - 1, Src.columns.Count)
    dst.Formula = Src.Formula
    On Error GoTo ErrorHandling
    'new prices are calculated
    newPrice_calculate (lastRow)
    Calculate
    myPath = ThisWorkbook.Path
    'Refresh pivot table in Position Manager
    Sheets("Position Manager").PivotTables("PivotTable3").ChangePivotCache ActiveWorkbook. _
    PivotCaches.Create(SourceType:=xlDatabase, SourceData:= _
    myPath & "\[Position_Manager_v1.0.xlsm]SQL_DATA!R1C2:R" & lastRow & "C31" _
    , Version:=xlPivotTableVersion14)
    ErrorHandling:
    Set Src = Nothing
    Set dst = Nothing
    If conODBC.State <> 0 Then
    conODBC.Close
    End If
    End Sub
    Sub open_connection()
    Dim sql_data, sql_data_change, sql_data_v As Variant
    Dim wdth, TotalColumns, startRow As Integer
    Dim rst As New ADODB.Recordset
    Errorcode = 0
    On Error GoTo ErrorHandling
    Errorcode = 1
    With conODBC
    .Provider = "OraOLEDB.Oracle.1"
    .ConnectionString = "Password=" & pswrd & "; Persist Security Info=True;User ID= " & UserName & "; Data Source=" & DataSource
    .CursorLocation = adUseClient
    .Open
    .CommandTimeout = 300
    End With
    startRow = Sheets("SQL_DATA").Cells(Sheets("SQL_DATA").rows.Count, "A").End(xlUp).Row + 1
    sql_data = get_client_positions(conODBC, rst)
    wdth = UBound(sql_data, 1)
    Sheets("SQL_DATA").range("A" & startRow & ":AA" & wdth + startRow - 1).Value = sql_data
    'Run change tools instruments
    startRow = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
    sql_data_change = get_change_tools(conODBC, rst)
    wdth = UBound(sql_data_change, 1)
    Sheets("ToolsList").range("A" & startRow & ":M" & wdth + startRow - 1).Value _
    = sql_data_change
    'open SQL for V tools instruments
    startRow = Sheets("ToolsList").Cells(Sheets("ToolsList").rows.Count, "A").End(xlUp).Row + 1
    sql_data_v = get_v_tools(conODBC, rst)
    wdth = UBound(sql_data_v, 1)
    Sheets("ToolsList").range("A" & startRow & ":L" & startRow + wdth - 1).Value = sql_data_v
    conODBC.Close
    ErrorHandling:
    If rst.State <> 0 Then
    rst.Close
    End If
    Set rst = Nothing
    End Sub
    Private Function get_client_positions(conODBC As ADODB.Connection, rst_posi As ADODB.Recordset) As Variant
    Dim sql_data As Variant
    Dim objCommand As ADODB.Command
    Dim sql As String
    Dim records, TotalColumns As Integer
    On Error GoTo ErrorHandling
    Set objCommand = New ADODB.Command
    sql = read_sql()
    With objCommand
    .ActiveConnection = conODBC 'connection for the commands
    .CommandType = adCmdText
    .CommandText = sql 'Sql statement from the function
    .Prepared = True
    .CommandTimeout = 600
    End With
    Set rst_posi = objCommand.Execute
    TotalColumns = rst_posi.Fields.Count
    records = rst_posi.RecordCount
    ReDim sql_data(1 To records, 1 To TotalColumns)
    If TotalColumns = 0 Or records = 0 Then GoTo ErrorHandling
    If TotalColumns <> 27 Then GoTo ErrorHandling
    If rst_posi.EOF Then GoTo ErrorHandling
    l = 1
    Do While Not rst_posi.EOF
    For i = 0 To TotalColumns - 1
    sql_data(l, i + 1) = rst_posi.Fields(i)
    Next i
    l = l + 1
    rst_posi.MoveNext
    Loop
    ErrorHandling:
    rst_posi.Close
    Set rst_posi = Nothing
    Set objCommand = Nothing
    get_client_positions = sql_data
    End Function
    Private Function read_sql() As String
    Dim sqlFile As String, sqlQuery, Line As String
    Dim query_dt As String, client As String, account As String
    Dim GRP_ID, GRP_SPLIT_ID As String
    Dim fso, stream As Object
    Set fso = CreateObject("Scripting.FileSystemObject")
    client = Worksheets("Cover").range("C9").Value
    query_dt = Sheets("Cover").range("C7").Value
    GRP_ID = Sheets("Cover").range("C3").Value
    GRP_SPLIT_ID = Sheets("Cover").range("C5").Value
    account = Sheets("Cover").range("C11").Value
    sqlFile = Sheets("Cover").range("C15").Value
    Open sqlFile For Input As #1
    Do Until EOF(1)
    Line Input #1, Line
    sqlQuery = sqlQuery & vbCrLf & Line
    Loop
    Close
    ' Replace placeholders in the SQL
    sqlQuery = Replace(sqlQuery, "myClent", client)
    sqlQuery = Replace(sqlQuery, "01/01/9999", query_dt)
    sqlQuery = Replace(sqlQuery, "54747743", GRP_ID)
    If GRP_SPLIT_ID <> "" Then
    sqlQuery = Replace(sqlQuery, "7754843", GRP_SPLIT_ID)
    Else
    sqlQuery = Replace(sqlQuery, "AND POS.GRP_SPLIT_ID = 7754843", "")
    End If
    If account = "ZZ" Then
    sqlQuery = Replace(sqlQuery, "AND AC.ACCNT_NAME = 'ZZ'", "")
    Else
    sqlQuery = Replace(sqlQuery, "ZZ", account)
    End If
    ' Create a TextStream to check SQL Query
    sql = sqlQuery
    myPath = ThisWorkbook.Path
    Set stream = fso.CreateTextFile(myPath & "\SQL\LastQuery.txt", True)
    stream.Write sql
    stream.Close
    Set fso = Nothing
    Set stream = Nothing
    read_sql = sqlQuery
    End Function

    Thanks Starain,
    that's what I did the last days and found that the problem is in the
    newPrice_calculate (lastRow)
    function. This function retrieves data (sets it as arrays) which was correctly pasted into the sheet, loops through all rows and does math/calendar calculations with cell values using an Add-In("Quantlib")
    Public errorMessage as String
    Sub newPrice_calculate(lastRow)
    Dim Type() As Variant
    Dim Id() As Variant
    Dim Price() As Variant
    Dim daysTo() As Variant
    Dim fx() As Variant
    Dim interest() As Variant
    Dim ObjCalend as Variant
    Dim newPrice as Variant
    On Error GoTo Catch
    interest = Sheets("SQL_DATA").range("V2:V" & lastRow).Value
    Type = Sheets("SQL_DATA").range("L2:L" & lastRow).Value Id = Sheets("SQL_DATA").range("M2:M" & lastRow).Value Price = Sheets("SQL_DATA").range("T2:T" & lastRow).Value
    daysTo = Sheets("SQL_DATA").range("K2:K" & lastRow).Value
    fx = Sheets("SQL_DATA").range("U2:U" & lastRow).Value
    qlError = 1
    For i = 2 To lastRow
    If (i, 1) = "LG" Then
    'set something - nothing spectacular like
    interest(i, 1) = 0
    daysTo(i , 1) = 0
    Else
    adjTime = Sqr(daysTo(i, 1) / 365)
    ObjCalend(i,1) =Application.Run("qlCalendarHolidaysList", _
    "CalObj", ... , .... other input parameters)
    If IsError(ObjCalend(i,1)) Then GoTo Catch
    'other calendar calcs
    newPrice(i,1) = Application.Run( 'quantLib calcs)
    End If
    Catch:
    Select Case qlError
    Case 1
    errorMessage = errorMessage & " QuantLibXL Cal Error at: " & i & " " & vbNewLine & Err.Description
    ObjCalend(i,1) (i, 1) = "N/A"
    End Select
    Next i
    Sheets("SQL_DATA").range("AB2:AB" & lastRow).Value = newPrice
    'Sheets("SQL_DATA").range("AA2:AA" & lastRow).Value = daysTo
    ' erase and set to nothing all arrays and objects
    Erase Type
    Erase id
    Erase Price
    Set newPrice = Nothing
    Is there a possibility to clean everything in:
    Private Sub Workbook_BeforeClose(Cancel As Boolean)
    End Sub
    Thanks in advance
    Mark

  • Memory usage problem on AIX 7.1

    Hi,
    We are running Oracle 11GR2 EE on AIX 7.1 and keep getting alerts on the pgchecks (memory paging).
    The alerts are coming from another system monitoring tool (Hobbit), but our sys admins are telling us it is because we are overallocating memory.
    In our case, we have an 8G SGA for the only database.
    Then, we are running grid and ASM.
    How can I check the actual (real) memory usage by individual processes of our Oracle database, our emagent (OMS agent), and for our ASM. In our case, we have 32G of Real Memory installed, and we should not be having a memory paging issue.
    For the Oracle database, it is set for 8G.
    NAME                                 TYPE        VALUE
    lock_sga                             boolean     FALSE
    pga_aggregate_target                 big integer 0
    pre_page_sga                         boolean     FALSE
    sga_max_size                         big integer 8480M
    sga_target                           big integer 0For our ASM instance, it is set for 270M
    SQL> sho sga
    NAME                                 TYPE        VALUE
    lock_sga                             boolean     FALSE
    pga_aggregate_target                 big integer 0
    sga_max_size                         big integer 272M
    sga_target                           big integer 0

    do as below (vmstat takes 2 minutes to complete)
    bcm@bcm-laptop:~$ vmstat 6 20
    procs -----------memory---------- ---swap-- -----io---- -system-- ----cpu----
    r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us sy id wa
    0  0      0 1347636  81396 1592120    0    0   264    22  382  651  8  3 84  5
    0  0      0 1347664  81404 1592144    0    0     0    13  515 1028  4  1 95  0
    0  0      0 1353136  81412 1592144    0    0     0    14  507 1021  3  1 95  0
    0  0      0 1353012  81420 1592144    0    0     0    23  523 1033  3  1 95  0
    0  0      0 1353044  81428 1592144    0    0     0    13  513 1026  3  1 96  0
    0  0      0 1353044  81436 1592144    0    0     0    15  517 1045  3  2 95  0
    0  0      0 1352920  81444 1592144    0    0     0    15  505 1012  3  1 96  0
    1  0      0 1347448  81452 1592156    0    0     1    21  521 1038  4  2 94  0
    0  0      0 1347448  81460 1592156    0    0     0    28  513 1030  3  2 95  0
    0  0      0 1347448  81468 1592180    0    0     1    21  529 1053  4  1 95  0
    0  0      0 1347200  81484 1592176    0    0     0    39  530 1067  3  2 95  0
    1  0      0 1347200  81492 1592172    0    0     0    14  530 1058  3  1 96  0
    0  0      0 1352796  81500 1592172    0    0     0    17  514 1034  3  2 95  0
    0  0      0 1352796  81508 1592180    0    0     0    21  516 1049  6  1 92  0
    0  0      0 1352764  81516 1592180    0    0     0    15  506 1024  2  1 95  1
    0  0      0 1352252  81524 1592180    0    0     0    15  563 1090  3  2 95  0
    0  0      0 1351836  81532 1592180    0    0     0    15  550 1066  4  1 94  0
    0  0      0 1346768  81540 1592200    0    0     1    18  547 1111  4  2 94  0
    1  0      0 1346152  81548 1592204    0    0     0    69  524 1059  3  2 94  0
    0  0      0 1346472  81556 1592244    0    0     1    17  498 1012  2  1 96  0

  • Network stream fxp excess memory usage and poor performance

    I'm trying to stream some datas à highspeed rate (3 channels à 1Mbytes/s) from my 9030 to my windows host. Because i don't need to use data on the rt side, i choose to forward FXP <+-,24,5> to my host throug a network stream.
    To avoid data loose i choose to use a wide buffer of 6000000 with this buffer my memory usage grow from 441mo to 672Mo and my rio is unable to stream the data. 
    With sgl or double, memory usage is 441 to 491Mo and datas can be streamed continusly.
    Anyone have encoutered this problem?

    SQL Developer is java based and relies on the jvm's memory management.
    I'm not aware of any memory leaks as such, but memory tends not to be returned to the system.
    Queries which return large return sets tend to use a lot of memory (SQL Developer has to build a java table containing all the results for display).
    You can restrict the maximum memory allocated by modifying settings in in <sqldeveloper>\ide\bin\ide.conf
    The defaults are -
    AddVMOption -Xmx640M
    AddVMOption -Xms128M

  • How to monitor java memory usage in enterprise manager

    I am running sqlplus to execute a sql package, which generates XML.
    When processing 2000+ rows, it will give a out of memory error.
    Where in enterprise manger can I see this memory usage?
    Thanks.

    Hello,
    it depends a little on what you want to do. If you use the pure CCMS monitoring with the table ALTRAMONI you get average response time per instance and you only get new measurements once the status changes from green to yellow or red.
    In order to get continuous measurements you should look into Business Process Monitoring and the different documentations under https://service.sap.com/bpm --> Media Libary --> Technical Information. E.g. the PDF Setup Guide for Application Monitoring describes this "newer" dialog performance monitor. Probably you have to click on the calendar sheet in the Media Libary to also see older documents as well. As the Business Process Monitoring integrates with BW (there is also a BI Setup Guide in the Media LIbrary) you can get trendlines there. This BW integration also integrates back with SL Reporting.
    Some guidance for SL Reporting is probably given under https://service.sap.com/rkt-solman but I am not 100% sure.
    Best Regards
    Volker

  • Memory usage in Analysis Services tabular model

    Hello,
    I've been researching and investigating trying to understand what is consuming memory resources in a tabular model that I'm working with. Using SQL Server Management Studio, the Estimated Size of the database is reported as 7768.34 MBs. Using
    Kasper de Jonge's BISM Server Memory Report, the database is reported as 15,465.13 MBs. However, a majority of the fields in the BISM Server Memory Report are empty, and so I cannot determine what is consuming the memory. The data source for this particular
    workbook is $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE.
    For example: I drill-down to an individual column (ColumnA) in the BISM Server Memory Report (Database > Dimensions > Table > In-Memory Table > Columns > Column) and the reported memory usage is 706.97 MBs. Underneath ColumnA,
    I see a blank level with a reported memory usage of 623.59 MBs and a Segments level with a reported memory usage of 83.39 MBs. Looking at $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMN_SEGMENTS, if I SUM the USED_SIZE for ColumnA, it totals roughly 83 MBs which matches
    what is reported in the BISM Server Memory Report for the segment size. How do I determine what the other 623.59 MBs is being used for? Again, this discrepancy occurs for all columns in the model and not just this one example.
    Thanks!

    Follow up to my original question. It appears that the blank levels (at least under the column level) the Kasper de Jonge's BISM Server Memory Report reports the dictionary size of the column. The memory usage size matches the DICTIONARY_SIZE attribute in
    the $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMNS. I made a mis-assumption as to what the information $SYSTEM.DISCOVER_STORAGE_TABLE_COLUMN_SEGMENTS was providing.
    In my original post I reference one database in particular in where the Estimated Size property in the Database Properties dialog is listed as 7,768.34 MBs. and the $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE reports 15,465.13 MBs. Thoughts, comments, or opinions
    on why the Estimated Size property does not match what's reported in $SYSTEM.DISCOVER_OBJECT_MEMORY_USAGE?
    Thanks!

  • SQL Memory issue

    I am storing files in sql lite, but when i store large file 400+Mb system throw this exception
    Error #1000: The system is out of memory.
        at flash.data::SQLStatement/internalExecute()
        at flash.data::SQLStatement/execute()
    Please give suggestion
    Thanks

    One sql server box:
    SYstem administrator pointed out: SQL server almost uses all memory and server memory usage almost hits 100%
    How to fix this problem?
    This is not a problem but normal behavior.SQL Server will use as much memory you provide to it.So its good to set proper value for max server memory setting in sp_configure.See example in below MS link . Set proper  memory usage for SQL Server leaving
    enough RAM (4-5 G ) for OS.This will only include memory set for buffer pool there are memory allocations outside buffer pool which is directly done by OS
    http://technet.microsoft.com/en-us/library/ms178067.aspx
    To read more about memory
    http://social.technet.microsoft.com/wiki/contents/articles/22316.sql-server-memory-and-troubleshooting.aspx
    Please mark this reply as the answer or vote as helpful, as appropriate, to make it useful for other readers

  • Extproc.exe memory usage

    Hello,
    I'm having problems while using ODT with ODAC (11.2.0.2.1). I've done a .NET (C# using Visual Studio 2010) library to be called from PL/SQL. It works without a problem, and finish the execution closing all objects and even doing a Garbage Collection (System.GC.Collect()) just to be sure that the most memory is reclaimed.
    The problem comes when I do the stress test (multiple call to the C# procedure, like 20000 times). I can see how extproc.exe (the service/process used to make external calls) start using more and more memory. Each call to the C# procedure wastes some KB of memory, and when I do the stress test, extproc.exe comes to have allocated 800 MB of RAM memory and even more...
    It seems that sometimes, Oracle or the process itself makes acknowledge of the RAM used and I see it wasting only 100 MB, so it seems it has some kind of memory management capabilities, but it's not enought, as sometimes memory goes as high that my server starts loading out some process from memory and performance degrades.
    Is there any way to control how much memory extproc.exe can waste, or control the behaviour of the process, or something like that?
    Thanks a lot,
    Luis Miguel

    AnubhavM wrote:
    I have tested for memory leak with JProfiler, it shows that the GC gets called after some time, and there is no increase in heap size. But the memory usage of Javaw.exe keeps increasing. Is it possible that JVM is not returning memory back to OS? or some other reason for increase in memory usage?The VM isn't returning memory to the OS and it's designed to work like that. (Or at least used to be, I saw a change request on that a couple of years ago and it got many votes in the bugdatabase)

  • Nested tables and memory usage (ORA-04030 error)

    Dear All,
    I have table with approximately 5,000,000 records
    and try to Bulk Collect part of it into nested table in PL/SQL, the code is bellow
    Declare
         Type TcardRec Is Record(
              serno Pls_Integer,
              numberx Char(16),
              caccserno Pls_Integer
         Type TcardList Is Table Of TcardRec;
         fcardInfo TcardList;
    Begin
    Select c.serno, substr(c.numberx,1,16), c.caccserno
    Bulk Collect Into fcardinfo
    From cardx c;
    End;
    After reading approx. 80% it fails with error
    ORA-04030: out of process memory when trying to allocate 16396 bytes (koh-kghu call ,pmucalm coll)
    I 2G memory, is it realy no enough?
    How can I tune memory usage for collection?
    How can I estimate the maximum size of the collection the will fit into memory?
    Thank you in advance for any help
    Artem

    Declare it as a cursor.
    Open the cursor.
    Use fetch bulk collect with the limit option in the loop.
    In your case, you could do like:
    Declare
    Cursor c1 is
    Select c.serno, substr(c.numberx,1,16), c.caccserno
    From cardx c;
    TcardList Is Table Of c1%rowtype;
    fcardInfo TcardList;
    Begin
    Open c1;
    Loop
    Fetch c1 Bulk Collect Into fcardInfo Limit 10000;
    Exit when c1%notfound;
    -- Do some processing here.
    End Loop;
    Close c1;
    End;
    I hope this helps.

Maybe you are looking for