ICMP Timeout Alarm due to TCP Protocol Memory Allocation Failure ?

Hello Experts ,
>> Device uptime suggests there was no reboot
ABCSwitch uptime is 28 weeks, 13 hours, 50 minutes
System returned to ROM by power-on
System restarted at 13:09:45 UTC Mon Aug 5 2013
System image file is "flash:c2950-i6k2l2q4-mz.121-22.EA12.bin"
>> But observed logs mentioning Memory Allocation Failure for TCP Protocol Process ( Process ID 43) due to Memory Fragmentation
003943: Feb 18 02:14:27.393 UTC: %SYS-2-MALLOCFAIL: Memory allocation of 36000 bytes failed from 0x801E876C, alignment 0
Pool: Processor Free: 120384 Cause: Memory fragmentation
Alternate Pool: I/O Free: 682800 Cause: Memory fragmentation
-Process= "TCP Protocols", ipl= 0, pid= 43
-Traceback= 801C422C 801C9ED0 801C5264 801E8774 801E4CDC 801D9A8C 8022E324 8022E4BC
003944: Feb 18 02:14:27.397 UTC: %SYS-2-CFORKMEM: Process creation of TCP Command failed (no memory).
-Process= "TCP Protocols", ipl= 0, pid= 43
-Traceback= 801E4D54 801D9A8C 8022E324 8022E4BC
According to Cisco documentation for Troubleshooting Memory issues on Cisco IOS 12.1 (http://www.cisco.com/c/en/us/support/docs/ios-nx-os-software/ios-software-releases-121-mainline/6507-mallocfail.html#tshoot4 ), which suggests the TCP Protocols Process could not be started due to Memory being fragmented
Memory Fragmentation Problem or Bug
This situation means that a process has consumed a large amount of processor memory and then released most or all of it, leaving fragments of memory still allocated either by this process, or by other processes that allocated memory during the problem. If the same event occurs several times, the memory may fragment into very small blocks, to the point where all processes requiring a larger block of memory cannot get the amount of memory that they need. This may affect router operation to the extent that you cannot connect to the router and get a prompt if the memory is badly fragmented.
This problem is characterized by a low value in the "Largest" column (under 20,000 bytes) of the show memory command, but a sufficient value in the "Freed" column (1MB or more), or some other wide disparity between the two columns. This may happen when the router gets very low on memory, since there is no defragmentation routine in the IOS.
If you suspect memory fragmentation, shut down some interfaces. This may free the fragmented blocks. If this works, the memory is behaving normally, and all you have to do is add more memory. If shutting down interfaces doesn't help, it may be a bug. The best course of action is to contact your Cisco support representative with the information you have collected.
>>Further TCP -3- FORKFAIL logs were seen
003945: Feb 18 02:14:27.401 UTC: %TCP-3-FORKFAIL: Failed to start a process to negotiate options.
-Traceback= 8022E33C 8022E4BC
003946: Feb 18 02:14:27.585 UTC: %TCP-3-FORKFAIL: Failed to start a process to negotiate options.
-Traceback= 8022E33C 8022E4BC
003947: Feb 18 02:14:27.761 UTC: %TCP-3-FORKFAIL: Failed to start a process to negotiate options.
-Traceback= 8022E33C 8022E4BC
003948: Feb 18 02:14:27.929 UTC: %TCP-3-FORKFAIL: Failed to start a process to negotiate options.
-Traceback= 8022E33C 8022E4BC
003949: Feb 18 02:14:29.149 UTC: %TCP-3-FORKFAIL: Failed to start a process to negotiate options.
-Traceback= 8022E33C 8022E4BC
According to Error Explanation from Cisco Documentation (http://www.cisco.com/c/en/us/td/docs/ios/12_2sx/system/messages/122sxsms/sm2sx09.html#wp1022051)
suggests the TCP handles from a client could not be created or initialized
Error Message %TCP-3-FORKFAIL: Failed to start a process to negotiate options.
Explanation The system failed to create a process to handle requests from a client. This condition could be caused by insufficient memory.
Recommended Action Reduce other system activity to ease memory demands.
But I am still not sure about the exact root cause is as
1.The GET/GETNEXT / GET BULK messages from SNMP Manager (Here, IBM Tivoli Netcool ) uses default SNMP Port 161 which is
UDP and not TCP
2. If its ICMP Polling failure from IBM Tivoli Netcool , ICMP is Protocol Number 1 in Internet Layer of TCP/IP Protocol Suite and TCP is Protocol Number 6 in the Transport Layer of TCP/IP Protocol Suite .
So I am still not sure how TCP Protocol Process Failure could have caused ICMP Timeout . Please help !
Could you please help me on what TCP Protocol Process handles in a Cisco Switch ?
Regards,
Anup

Similar Messages

Dynamic memory allocation failure

Dear reader,
We sometimes have a problem where our windows 2012 r2 RDS virtual servers, that reside on windows 2012r2 hyper-v hosts, loose their dynamic memory and only have their startup memory left to work with. Users start complaining that things are very slow etc.
If I check several screens (RDS Broker load balancing, hyper-v manager, cluster manager and the vm's task manager) it's clear that the vm only has its startup memory allocated. I'm not sure if this happens instantly or immidiatly after the nightly reboot.
To resolve the problem we have to call all users on the vm where it happens and ask them to logoff (if they are even able to), and then we reboot the machine.
I have checked the logs from the machine where the VM resides on and the logs from the vm itself. But I cannot find anything. We also have alot of windows 2008r2 vm's with dynamivc memory, but none of those have ever had this problem.
Searched the internet, but so far it seems we are only.
Can anyone give me a lead to troubleshoot this?
Best regards,
Ruud Boersma
MCITP Enterprise administrator

Hi all,
I'm going to be "one of those people" who revives dead posts for something that is relevant but obviously not fixed... sorry in advance!
We have the exact same situation, a bunch of RDSH guests with Dynamic memory turned on (60+ of them). every day between 1-8 of them will fail to allocate Dynamic memory and will be stuck on their startup RAM amount. This really hurts our users at peak
times.
I have engaged our TAM and have raised a case with PSS, Usual story "your the only one with this problem". Which obviously isn't true.
So, we have tons of free RAM on the hosts, 600GB+ on most of them, the issue affects RDSH hosts at random, across multiple hosts and clusters.
The screen shots attached are of one of our hosts from this morning. it has 8GB startup, 8GB minimum, 32GB Maximum RAM configured, with a 23% buffer. the host has 752GB RAM FREE. Notice how the perf counter "Hyper-V Dynamic Memory Integration Service"
is reporting "0", it should be reporting "32768". also under task manager on the VM we are missing "Maximum memory" which should be just below "Hardware reserved" in the bottom right hand corner.
Looks like the balloon driver is being delayed at boot time, we are going to XPerf all the servers in the hope that we can catch the critter. It's an unusual problem.
We only have Acrobat PDF viewer, word viewer, excel viewer and two custom dot.NET applications installed on the guests. Some of the servers are also just dumb RDSH hosts, with not connection broker configured, using an F5 loadbalancer for load distribution
and session management. All guests are 2012R2 patched up to March 2015, integration Services are installed and up to date (its an enlightened OS remember).

Memory Allocation problem when using JNI

For a Project we need to interface Labwindows-CVI/ Teststand with an application written in Java. we are using JNI. The code uses JNI_CreateJavaVM to start a JVM to run the Java interface code. The code did run for some time , but now ( without any obvious change nor on the CVI side neither on the Java side) JNI_CreateJavaVM fails with -4 error code, that means that the start of the JVM failed due to memory allocation failure. First investigation showed, that even if Windows Task Manager shows about 600M free physical memory, you can allocate in CVI only about 250M as a single block at the time we are calling JNI_CreateJavaVM. That might be a little bit to less as we need to pass -Xmx192m to the JVM to run our code. Unfortunately just increasing the physical memory of that machine from 1.5G to 2G doesn't change anything. The free memory showed by Task Manager increases, but the allocatable memory block size does not. Are the any trick to optimize CVI/Teststand for that use case ? Or maybe known problems with JNI ?
Solved!
Go to Solution.

hi,
have you tried other functions to allocate memory?
the -Xmx command only sets the maximum heap size. You can try to use -Xms. This command sets the initial Java heap size.

TS3694 Why is my i-tunes freezing up and is accompanied by a message "Saying Itunes can't save anything due to lack of memory and my system is equiped with 16gb?

I Have always used Itunes for my music and for reasons beyond me Itunes has been freezing up and lately it has bringing a mate that reseambles a normal Windows error message but it's telling me that Itunes has to close and the program can't save anything due to lack of memory ? So I updated the program to Version 10.6 last night and while downloading songs and album artwork Today it froze up an brought his mate the message back. And Yet my Laptop is as tooled up as well as a bovver boy on his way to a riot With 16gb of ddr3 plus 2 x Nvidia Gtx 580m's In Sli. So by rights any type of multimedia should run as smooth as silk and i never thought i would have a program make use of 16gb of ram all by itself. So if anybody has been through it an come out on top instead of passing Itunes over for another program and can give any advice or a hint would be much Appreciated... Thanks to Anybody listening....

Becasue something got corrupted on the iPod. It happens sometimes. Just restore the iPod to factory settings/new iPod and then try restoring from your backup.

I am using my iPhone 5 to take pictures and have started a blog with pictures. I am not able to do the update on my phone due to lack of memory.

I am using my iPhone 5 to take pictures and have started a blog with pictures. I am not able to do the update on my phone due to lack of memory. I wanted to know how much difference this will make to my pictures.
If anyone had suggestions on how to maximize picture quality n use without the update, I'd appreciate it
<Link Edited By Host>

If the lack of space on your phone is due to pictures, you may want to consider transferring some (or all) to a computer and deleting them from the phone. That is a good practice even if you have space on the phone. Instructions: http://support.apple.com/kb/ht4083

Printing error due to out of memory condition...

hi i got this problem of "printing error due to out of memory condition" and i cannot save it as a pdf file too. How to solve this prob? i using cs3 and acro 9.. pls help me... got a proj due and cannot afford to waste too much time...

I've also seen this error message for the first time today "printing error due to out of memory condition" - I have 2GB of RAM, 300Gb+ free on my hard drive and have closed all other programs that were using some memory, however have had no problems printing to pdf ever before in Indesign... is there a solution to this problem?

Error due to out of memory condition

Hi,
system: Windows XP, 2 GM RAM, Indesign CS3
I placed two files in Indesign: the first is .ai (1.1 MB, probably exported form a CAD program), the second is .psd (53 MB). When I try to print to .ps file, Indesign displays the message: "Export error: error due to out of memory condition". If I: 1. export to PDF, everything is OK, 2. rasterize .ai in Photoshop, then import the resulting .psd to Indesign, print to .ps file is OK.
Does somebody has an answer to my problem?

My gues is "mistakes" was referred to simply not outputting as intended by the designer. I had output issues when going directly to PDF and had to also continue the old way of doing thinkgs by outputting to .ps then distill to PDF. The "mistakes" that occured for me were nearly unnoticed. The publication was a 128+4 product catalog that had a header at the top of each page. I never had any problems outputting in the past. At the time, I just had updated to CS3 (XP Pro SP3 Dual Core 4 gigs ram). I was advised that outputting directly to PDF had been durastically improved. I output my files without "mistakes" or errors, or so I thought. After proofing, I didn't realize that all of the drop shadows for the header headline were not applied. The problem though, wasn't that they were applied to all headers, just beginning at page 60 or so, halfway through. After getting the finished publication back, I didn't notice it for a few months. After noticing it, I investigated. Several troubleshooting hours later (after forum posts and other expert help), I/we concluded that it was simply a program deficiency. During my trouble shooting, I looked at several areas mainly focusing on the transparency settings. I output the document several times. I finally exported each page separately and found that that was the only way that I could output every page to include the dropshadow in each header page (past page 60 or so).
I have been past that issue for a while now. Now I am on Win 7, Quad core, 6 gigs of ram, and don't have the outputting problem that I used to. Now I occasionally get this "Error due to out of memory condition" which is BS because my hardware specs are beyond reasonable for what I typically create in my workflow. Most of the time, my memory is only at about half of its capacity when I get this error. Not when I have a PS open with a large multipage file that I am working on. My out of memory error happens during file output or just when performing ordinary layout functions in InDesign.
When on my personal computer (Aluminum iMac 2.4 Core2 duo, 4 gigs of ram, 512 video, CS4 & CS5) I have neither of the above issues.

2960X 15.02(EX5) %AAA-3-ACCT_LOW_MEM_UID_FAIL:AAA unable to create UID for incoming calls due to insufficient processor memory.

Deployed four 2960X switches in a stack. All okay for about one month then tried to web browse for the first time via firefox which partially displayed the page. I assumed this was a browser error. So tried Chrome then IE which both failed. Chrome was a bad display and IE fails to connect.
After this, I could not telnet or ssh. Plugged into the console and immediately started receiving:
%AAA-3-ACCT_LOW_MEM_UID_FAIL: AAA unable to create UID for incoming calls due to insufficient processor memory
%% Low on memory; try again later
I am unable to log in. I have a TAC case logged but the first step to try is a reboot which will be difficult until I can get a maintenance window. When I do get a maintenance window, I would also like to deploy a fix such as a different version of code or a work-around cofig command. I don't mind disabling HTTP.
Any suggestions?

I am currently working with TAC
The switches failed about 18 hours later and had to be rebooted to get back up. Now that I have console/telnet access, I can see the memory being depleted mostly by the Auth Manager process at about the same rate as free memory is dropping.
SW13#sho proc mem sort | i Auth Manager
191   0 177721332   95004616   34757416          0          0 Auth Manager
SW13#sho proc mem sort | i Auth Manager
191   0 177754888   95025696   34759780          0          0 Auth Manager
SW13#sho proc mem sort | i Auth Manager
191   0 177774316   95037928   34761056          0          0 Auth Manager
SW13#sho proc mem sort | i Auth Manager
191   0 177799720   95053940   34762888          0          0 Auth Manager
SW13#sho proc mem sort | i Auth Manager
191   0 177824976   95069732   34764696          0          0 Auth Manager
SW13#
SW13#
SW13#sho proc mem sort | i Processor
Processor Pool Total: 442796836 Used: 103448576 Free: 339348260
SW13#sho proc mem sort | i Processor
Processor Pool Total: 442796836 Used: 103454416 Free: 339342420
SW13#sho proc mem sort | i Processor
Processor Pool Total: 442796836 Used: 103455860 Free: 339340976
SW13#sho proc mem sort | i Processor
Processor Pool Total: 442796836 Used: 103459236 Free: 339337600
SW13#sho proc mem sort | i Processor
Processor Pool Total: 442796836 Used: 103461040 Free: 339335796

I am trying to get Adam 5000 TCP/IP with the 5018, 5056SO modules to talk throu TCP protocol

Hi,
I am trying to get Adam 5000 TCP/IP with the 5018, 5056SO modules to talk throu TCP protocol. Please, is any body that has functional example or advice?
Thank you
Irik

Hi Irik,
I do not have any experience with these devices. Would it be possible to post their datasheets this will give me a better idea of their functionality. Thanks!
Steven C

The save failed due to out of memory or disk space?

What does this mean? I have a paper to right as well as other task that I must complete. This popped up while I was trying to save a file through Microsoft word.

Google "The save failed due to out of memory or disk space? Mac"
http://ask.metafilter.com/214916/Bring-back-the-doc
http://texmylife.blogspot.com/2012/06/save-failed-due-to-out-of-memory-or.html
There are more google matches, so if these do not help, then you might try the google search. Also this appears to be a Word issue, so maybe the Microsoft forums would be a good place to explore

When trying to download an app, a message pops up and says "cannot download due to not enough memory". I have checked there seems to be enough memory on pc and ipod?

when trying to download an app, a message pops up and says "cannot download due to not enough memory". I have checked there seems to be enough memory on pc and ipod?

I followed the advice of another user, cleared my payment information and re-entered my credit card info and this took care of it, I was immediately able to download new purchases. Apparently they called and got this info from someone at Apple, there is some sort of "bug". worked for me...hope it helps you out too!!

App cannot be loaded due to insuffiecient local memory

My Ipad 2 has 3GB free space and I want to install a 1.5GB app (which was installed already some time ago).
I cannot load and install it due to "insufficient local memory" (this is my translation since I am German).
What can I do?

You have to delete content. If you sync with iTunes - unsync some of your content - transfer any movies or videos back into iTunes via File>Transfer Purchases and do not sync them back to the iPad.
You can also delete local content in Settings>General>Usage>Storage - you can delete apps (which deletes the app data as well) and videos in there.
If you backup with iCloud - perform a backup before you start deleting apps.

I use my mac book to dj. however, i tend to get the beach ball alot. is this due to lack of memory or is it something else. ive been thinking about getting more memory but i am not sure what the issue is

I use my mac book to dj. however, i tend to get the beach ball alot. is this due to lack of memory or is it something else. ive been thinking about getting more memory but i am not sure what the issue is...i would like some advice before i go and buy more memory if it is not needed... i also do not keep my music on my lap top

Okay, so we've eliminated the lack of space since you have plenty.
See the screenshot from my Mac here:
Page ins and page outs - post those (or just post the same type of screenshot). If you have a lot of those, that means that your machine needs to keep swapping RAM around to make the best of what is available which can result in slow responses.
Also post the total amount of RAM you have (in my case, I have 12 GB)
You free RAM of 221 MB is very, very low - I'm guessing you only have a total of 2 GB. If that is the case, I would absolutely max out the machine (if you don't know how much RAM you can put in, post your model number here so we can help with that).

ITunes takes 90 seconds to load due to TCP Reconnects

iTunes takes about 90 seconds to load on my Windows 7 machine - a VERY fast machine with 6GB RAM and SSD drive where all other apps run very fast. Scanning the internet, I found many instances of extremely slow loading, but none of the suggestions were helpful. So, I used Process Monitor to see what the f*ck iTunes is doing...
It turns out that iTunes is hanging due to TCP Reconnects. It appears to be scanning TCP ports in the range of 61432 to 61503, trying each one twice, and each attempt takes 500 ms to time-out, causing a total of a 71 second hang during startup. As appears to be typical for this very poorly behaved software, all of this occurs before any UI has been drawn - not even a splash screen - making things all the more confusing for the poor user, who is left wondering why the heck the program doesn't appear to have launched.
I realize that this is probably not occurring for all users, meaning that there is something different about the installation/config on my particular machine that is triggering this problem. Still, that is no excuse for such ridiculous behavior, especially for such a widely used application.
Any help with this problem would be much appreciated. Although, I'm not really interested in the obligatory shotgun approaches of things like doing full uninstall/re-install of iTunes and/or Windows 7, etc. So, thank you for not asking me to do things that are likely to be a huge waste of my valuable time. If you want me to capture and post details about my machine, I'll do that - even though it's highly obvious that this is an ugly software problem in iTunes that needs to be fixed.

FYI, the TCP Reconnects are shown as MachineName:61xxx -> MachineName:5354, and the result of the API call is SUCCESS. I'm just assuming they're timing out since the API calls are 500 ms apart. I have no idea what this API is doing exactly, or why it seems to be scanning a range of ports but with each connection then apparently going to port 5354. Very strange. There are no other API calls in between the TCP Reconnect. Picture is attached:
calls.

Does anyone have Experience talking to a WAGO Ethernet Fieldbus copler using the Open modbus/TCP protocol and LabView ?

I have an Ethernet Fieldbus Copler of WAGO which supports the OpenModbus/TCP Protocoll, and I want to talk to it over LabView. Does anyone know how to do this or even has example VI's or Librarys ?

Wago and National Instruments have worked together to test and develop an application note showing the use of the National Instruments Modbus driver with LabVIEW and the Wago Ethernet Coupler. I have attached the preliminary applications note (which is in final technical review here at NI). You can purchase the National Instruments Modbus driver by ordering the Industrial Automation Servers, part 777616-01. The USA price is $995. It should save you quite a bit of time in working with the Wago device and any other industrial controller or modbus device you might work with in the future.
Preston Johnson
Business Development Manager
Preston Johnson
Principal Sales Engineer
Condition Monitoring Systems
Vibration Analyst III - www.vibinst.org, www.mobiusinstitute.com
National Instruments
[email protected]
www.ni.com/mcm
www.ni.com/soundandvibration
www.ni.com/biganalogdata
512-683-5444
Attachments:
wago_overview.doc ‏171 KB

ICMP Timeout Alarm due to TCP Protocol Memory Allocation Failure ?

Similar Messages

Maybe you are looking for