Strange out of order packet issue

Not sure if this is the proper place to ask this or not, but I have an odd issue with a VM (really multiple VMs but they all do the same thing). The VMs run RHEL 6.5 and spool a print job to a printer at the far end of a WAN connection. The printer doesn't handle out of order packets correctly and ultimately just waits for the OS to decide it should resend things and restart. This causes major delays in the print job. The app was migrated from a RHEL5.10 physical system to the VM where the problem started. The printer vendor has admitted a problem in the way they handle out of order packets but isn't fixing it in the printer(s) we have. When the app was on RHEL5/physical system the problem did not occur. At least, it wasn't severe enough for us to look really deep into. The application team wants to move back to RHEL5/physical until the problem is resolved but I am reluctant to do that because it effectively means they won't migrate into a VM for another 1-2 years.
I think a previously existing problem is being made worse by the VMware layer, but don't know what I can do about it. We run the Nexus 1000V with LACP back to redundant Nexus 7000's before the connection routes to the WAN circuit. I have been told the problem can be reproduced without going thru the WAN, and we have tried using the VSS on a separate pair of cables, but it didn't help. Can anyone think of anything that I can check or tweak to make things easier for my end users? I really don't want to move back to physical. It makes so many processes 10x more difficult.
We are running ESXi 5.5u2 with vSphere 5.5u2 on IBM 3850m3 servers. They aren't memory, CPU, or disk constrained at all as far as anyone can tell, and the network from the box isn't saturated or that busy at all.
Thanks.
Tom

Thanks. I had seen something on that earlier but hadn't looked into it. I made the change on one of our problem children, so we'll see what happens now.
Is that persistent across reboots or is there some file I need to change as well?
Tom

Similar Messages

Out of order packets via LWAPP?

I am capturing packets on a wireless client ftp'ing a file from a server. It's showing that there are a lot of out of order packets. Although, the file received is fine, I'm worried that it'll affect voice packets later on. I'm using Wism with Lightweight APs. I tested using autonomous AP to tranfer the file from the same server--> No problems. Any ideas why this is? Is it some thing I mis-configure on the WLC?
Thanks
Binh Dinh

Good mornning.
We have many application similar to the case you have explained.
Our links use satelite connection and the delayare between: 600 msec to 1000 msec.
Delays over 1000 msec generates delay and connectivitiy problems with tcp applications.
What is the delay between your endpoints ?
Do you have access to internet router ? so can you tell us if there are packets drops in the interfaces ?
Waiting your answer.

TCP out of order packets

Hi,
We are getting TCP out of error packets while sending requests to outside. Though we can access the internet and also connectivity is fine. But some of the application is not working due to this error, specially TCP based application as on the remote side they are not accepting two requests from our network. That means two requests are going from our network with each of the request sent to outside network.
We have 4-5 vlans and intervlan routing is configured. Could somebody pls. let me know the reason of this and how can I solve this problem?
Thanks,
Pawan

Good mornning.
We have many application similar to the case you have explained.
Our links use satelite connection and the delayare between: 600 msec to 1000 msec.
Delays over 1000 msec generates delay and connectivitiy problems with tcp applications.
What is the delay between your endpoints ?
Do you have access to internet router ? so can you tell us if there are packets drops in the interfaces ?
Waiting your answer.

Help with TCP out-of-order packets Wireshark capture

Hello everyone, we have a bit of an odd issue. Can you take a look at the attached capture file and tell me what's broken? Please change the file extension from .txt to .pcapng and open with Wireshark.
We have a major issue where clients cannot retrieve data from the server at 10.10.7.27.
Server is behind the firewall at 172.18.123.4 which is configured to NAT the traffic coming through.
Please advise.

It's actually from anywhere. The DNS resolves the website address to a global address. So regardless of the source (inside or out), you hit the firewall and get routed to 10.10.7.0 network. The firewall's LAN interface shares the same VLAN as the DMVPN head-end router's LAN interface. From the DMVPN head-end router, it goes over the DMVPN cloud (i.e. back over the internet) to our office in Florida where this site is being hosted.
The capture I grabbed was by SPAN port between the two LAN interfaces showing transactions between the firewall's LAN interface and the server's IP address on the 10.10.7.0 subnet.
Site uses HTTPS and we have other servers in the same subnet (10.10.7.0) that are accessible in the same manner. I did SPAN the ports for another webserver and did see a lot of TCP OOO and re-transmissions however not as bad as this one.
I do have a theory, please feel free to correct me. Request comes in on the WAN interface, gets NATed by the firewall and sent to the DMVPN router, router encrypts the packet and places it on the wire, once the remote DMVPN peer receives the packet, it decrypts it and then sends it out it's DMZ interface connected to another application firewall. This firewall checks the packet and then sends it to the web server hosting the content. The process is reversed for reply traffic. On top of all this, the content is served over HTTPS therefore more encryption/decryption. This seems like too much handling of the packet to me? When the source computer sends a request, it simply times out or spends too much time within our own network causing the source to resend the request?

TCP out-of-order at IPS

Dear All,
We have a setup the IPS 4510 working inline mode with strict inspection turn on. we have detected some latency issue accessing the internal website. So we did some capture at the IPS interface. We found that there's a lot of out-of-order packet and DUP ACK detected by IPS which causing the normalizer engine buffer full and could not handle anymore request. As a work around we put the IPS in asymmetric mode where it turn off the IPS normalizer engine.
I need some opinion on possibilities why the Out of order and DUP ACK happen.
We are seeing quite a lot of Out-of-order, DUP ACK and TCP zero window in TCP stream that we captured.
The topology is quite straight forward:
Internet ----WAN ROUTER ----- IPS4510 ----- ASA ----- Web server
There's no redundancy or load balance for the ASA or WANROUTER.
Im hoping for some opinion and idea on how to tackle this issue.
Thank you very much

Hi
bumping out an old thread since the issue still on going.
I already discussed with TAC regarding the issue and 2 option that she gave
+ asymmetric mode (Which we rejected as permanent solution)
+ Event action filter
I'm currently looking at this solution and plan to implement it in the IPS.
I need to consider a few things and also suggestion
+ The signature engine involve is Normalizer engine (specifically sig 1330)
+ is it possible to customize this signature or should we just go for Event action filter?
need opinion and pro and cons of this.
Thanks a bunch

ACE Dup ACK and TCP Out-of-order

Hi,
I have a pair of FT ACE 4710 offloading https traffic to a couple of webservers. We are seeing very high network utilisation when I capture the client facing port of the active ACE. There appears to alot of duplicate ACKs and TCP out-of-order packets (as shown by wireshark). Does anyone know if this is a problem with the ACE or "normal"
Thanks

I've seen some similar behaviour with the ACE Module and Apache webservers. To mitigate this I've configured the following which seems to work.
On the ACE Module
parameter-map type http ALL-HEADERS
persistence-rebalance
parameter-map type connection TCP-OPTIONS
set tcp syn-retry 5
tcp-options timestamp allow
policy-map multi-match test-policy
class http-vip
    loadbalance vip inservice
    loadbalance policy http-test-pm
    loadbalance vip icmp-reply active
    appl-parameter http advanced-options ALL-HEADERS
    connection advanced-options TCP-OPTIONS
On Apache here are the two test results with keepalive on and off
httpd.conf
KeepAlive Off
MaxKeepAliveRequests 1024
KeepAliveTimeout 30
MK-ACE01/001# show serverfarm MK-FARM-sf
serverfarm     : MK-FARM-sf, type: HOST
total rservers : 8
                                                ----------connections-----------
       real                  weight state        current    total      failures
   ---+---------------------+------+------------+----------+----------+---------
   rserver: MK-HOST10
       10.10.1.10:0          8      OPERATIONAL 321        510863     16442
   rserver: MK-HOST11
       10.10.1.11:0          8      OPERATIONAL 304        512718     16276
   rserver: MK-HOST12
       10.10.1.12:0          8      OPERATIONAL 286        524207     17257
   rserver: MK-HOST13
       10.10.1.13:0          8      OPERATIONAL 291        516987     16626
   rserver: MK-HOST14
       10.10.1.14:0          8      OPERATIONAL 291        513016     16594
   rserver: MK-HOST15
       10.10.1.15:0          8      OPERATIONAL 311        510177     16434
   rserver: MK-HOST16
       10.10.1.16:0          8      OPERATIONAL 345        516340     16708
   rserver: MK-HOST17
       10.10.1.17:0          8      OPERATIONAL 282        513046     16418
httpd.conf
KeepAlive On
MaxKeepAliveRequests 1024
KeepAliveTimeout 30
MK-ACE01/001# show serverfarm MK-FARM-sf
serverfarm     : MK-FARM-sf, type: HOST
total rservers : 8
                                                ----------connections-----------
       real                  weight state        current    total      failures
   ---+---------------------+------+------------+----------+----------+---------
   rserver: MK-HOST10
       10.10.1.10:0          8      OPERATIONAL 0          553        0
   rserver: MK-HOST11
       10.10.1.11:0          8      OPERATIONAL 0          551        0
   rserver: MK-HOST12
       10.10.1.12:0          8      OPERATIONAL 0          552        0
   rserver: MK-HOST13
       10.10.1.13:0          8      OPERATIONAL 0          555        0
   rserver: MK-HOST14
       10.10.1.14:0          8      OPERATIONAL 0          554        0
   rserver: MK-HOST15
       10.10.1.15:0          8      OPERATIONAL 0          551        0
   rserver: MK-HOST16
       10.10.1.16:0          8      OPERATIONAL 0          550        0
   rserver: MK-HOST17
       10.10.1.17:0          8      OPERATIONAL 0          550        0
This seems to of reduced the large number or re-transmits and dup-acks.

Out-of-order-writing and fsync issues ...

I am facing a fairly interesting problem on my Sun box.
The problem is: My customer has reported that PostgreSQL loses a file on TRUNCATE.
The scenario is:
BEGIN;
TRUNCATE table;
COMMIT;
When the system is killed during this transaction it can happen that the system tables will still see the table while the file on disk is already killed.
However, this is impossible because the table is actually killed by PostgreSQL AFTER the COMMIT.
Internally it does:
BEGIN;
modify system tables;
COMMIT (including fsync)
remove table on disk.
The problem now is: How than this happen? The only thing which comes to my mind is that the I/O system is doing out-of-order writing. My second theory is that fsync is doing something terribly wrong. More evidence: This happens not too frequently and ONLY on Solaris (We have tested that).
Can anybody provide me information about the I/O behaviour of the kernel respektively information about what fsync might do wrong?
Help is very much appreciated.
Best regards,
Hans

Hi there! @BlueSkies84 thanks for posting your concerns. I’m sorry to hear about all the problems with your phone.
Since we are looking at multiple issues that cannot be controlled via the phone settings, I’d recommend you back your phone up and perform a factory reset. For steps on this please visit us at www.att.com/devicehowto/ and select the make and model of your phone. On the left column you’ll find steps to back up the phone under backup and restore and reset steps under troubleshooting and reset device.
Hope this helps!
Charise

Mavericks, Photo Booth issues -- photos out of order

I recently updated to Mavericks, and since then all of my photos have been out of order in Photo Booth. I have been able to reorganise them according to date created in the root folder, but not in Photo Booth itself.
Any ideas?

Same issue here as well. Photobooth is sorting by file name. New images created have a long file name includng the date and time. Earlier photos are named photo1.jpg...Anybody know a good file re-namer?

Texts out of order; phone overheating; speaker issues

Hi, I am having four problems with my Galaxy S5 and wondered if anyone knew a solution: (1) My text messages come out of order. This has happened since I got the phone, which is on network time. (2) My text messages are delayed - both sending and receiving. They get to others late and they come to me late. (3) My phone frequently gets extremely hot and the battery drains rapidly. From 95% to 15% in an hour or two. (4) When I am talking on the phone, the phone randomly switches to speakerphone so the person I am talking to comes out of the speaker. The speaker button, however, is not activated. Many thanks for any help!

Hi there! @BlueSkies84 thanks for posting your concerns. I’m sorry to hear about all the problems with your phone.
Since we are looking at multiple issues that cannot be controlled via the phone settings, I’d recommend you back your phone up and perform a factory reset. For steps on this please visit us at www.att.com/devicehowto/ and select the make and model of your phone. On the left column you’ll find steps to back up the phone under backup and restore and reset steps under troubleshooting and reset device.
Hope this helps!
Charise

Songs out of order?

I recently imported several CDs to my iTunes library, and for some reason, some of the songs are appearing out of order. I have read the discussions regarding this on the message board (probably not all, but four or so?), and it doesn't seem to be the same reason everyone else is encountering. A few notes detail the problem:
- There's one album where the track list is: 10, 1, 2, 3, 4, 5, ... 9, 11, 12 (in order except Track 10), and a few others with the same issue (albiet different track number out of order)
- The album in question is only by one artist. I have group-changed the artist, album and album artist fields to the same value for all tracks. So it's not a guest-artist issue.
- I have marked the album as a compilation, to no effect. This worked great on many multi-artist albums, but didn't help here.
- All tracks of the CD are marked as being within one CD (there isn't the horizontal line that desigates different albums).
- The tracks appear in order when I sort by Artist; however, this breaks up the compilations elsewhere in the library, so I really want to use Album by Artist.
- Changing the view format to adjust options did not help either, and this seems strange enough that I'm surprised it helped for someone else in the past.
- Closing and reloading iTunes also had no effect.
Any thoughts on how to make them appear in order in the Album by Artist view?

maybe i missed something here. But heres my $0.02
you cannot change the order in the library it is true, except by sort.
you can change the order in playlists by simple drag 'n' drop.
So if this makes sense to you then you can ignore the order in the library (no more reimporting). You can then just set up a playlist and order them by column sort OR just drag and drop them into the order you want.
hope that helps

Input related random inputs and out of order events

Hi My wife has a Mac Air 4,2
It has been flawless and in good working order, with minimal applications.
All was well until 20th Sept. Immediatly after a system update to 10.7.4 the trackpad began to show strange drag and click problems .. as if the touch pad had become hypersensitive.
This resulted in unable to click, unable to move , drag select always activated.
I managed with alot of patience to disable all the optional trackpad settings for point & click, Scroll & zoom and More Gestures.... but where did more gestures come from ... is that new?
anyway ... the problem was partially solved, the track pad is now usable but still has issues.
so i moved on to physical and noticed that the edges were dirty and the surface i cleaned with a screen wipe and clicked and blew on the trackpad to free any scum trapped on the edges.
I noticed that some of the surface is very polished and, those areas are marginly more senitive than the rougher areas.
a week on I just logged in to another profile and got hit with the same issues ... and a new one ... keyboard input after rebooting: where is it! i had to wait 5 mins for input to come online.
This got me thinking. The problem is not 100% the trackpad, its the signal processing for realtime inputs from the keyboard and trackpad. either there has been a kernal tweak or the driver for the devices is sending too much data resulting in buffering issues. or more likly some kind of out of order buffer processing that is FUBAR'd.
SO i check for an update: 10.7.5 securty update ... installed ... reboot ... at least I get keyboard input this time ... but the trackpad is still misbehaving... what should i do next:
a) Is there a frimware update for the trackpad?
b) Can I disable the new trackpad functionality completely... I dont actually want or need it
c) Wait for the apple team to make further fixes to the kernel and drivers for touch input.
d) go get an apple engineer to do something with the trackpad.... I have 2 weeks left of warrenty.

thats too bad. do you have a question you would like to ask

My texts are being sent out of order

Hello I just got my galaxy s4 and whenever I text my boyfriend (who has another carrier) and its a long text it would be out of order. The last 2 sentences would get to him first then the beginning of the conversation will show up last....
Anyway to fix this? He has virgin mobile if that helps....

That's a strange issue 1631705, but we'll be happy to figure this out. Does this only happen with your boyfriend? Have you tried long messages to other people? If it is only happening with him, it may be the way Virgin mobile process enhanced messages (over 160 characters).
MarquiaF_VZW
Follow us on twitter @VZWSupport

Video and audio not sync when i play all forms of video. from music videos, to tv shows. but they play perfect on my iPod. and tv shows display out of order on iPod, but in correct order on iTunes/computer. I even ran a virus check just to make sure.

audio and video do not syncronize. all forms of videos. music videos to tv shows. what do i need to do the syncronize them again
they are in sync on iPod, but not on computer.
another issue that might be from the same cause is, the order of episodes of the tv shows i have downloaded, they appear in order on computer, but on iPod they show out of order.
any tips on how to fix this would very much help.
thank you.

Welcome to Apple Discussions!
An old version of iTunes will cause this and mess up the videos on your iPod. Always make sure you always use an up-to-date version of iTunes.
Make sure all the software on your computer is up to date...
iTunes
iPod Updater
Updating iPod's Software
You will then need to restore the iPod and then let iTunes update your iPod and put your music, videos, etc. back onto your iPod...
Restore the iPod
btabz

Camera roll pictures are out of order after upgrading to iOS 8.1

It's nice that iOS 8.1 brings camera roll back. However, pictures are out of chronological order. I'm using iPhone 5s. I upgraded iOS from 8.0.2 to 8.1, and noticed this issue.

That's weird cause my videos are all interspersed with everything else like they used to be, which unfortunately means it's inconsistently screwing up too. My pics start with 2007 (first year i got an iphone) then run up to about 2014 vaguely in order, then back to 2013 where everything's all out of order, then down to 2012 again (also out of order), then 2011, 2010, 2009 etc like it's running backwards to 2007. Then once it hits 2007 again, it jumps to this past july.
SO aggravating!

Chapter marker thumbnails getting duplicated, out of order (FCPX 10.1.4)

Group - I use FCPX to compile home movies of my kids, the pets, etc. I use footage from a Canon HD camcorder and an iPhone 6+. I import them into FCPX, trim, transition, maybe throw in some music, and usually put in 40 or so stills (JPEGS) at the end for a slide show.
The project I'm working on now is around 2.5h long after editing and transitions. I put chapter markers at the beginning of each scene, and then drag the pin to set a custom chapter marker thumbnail.
The issue - no matter what I do, I can't seem to get ALL of the thumbnails sorted properly. Meaning, I get one or two out of order, and numerous ones duplicate. I've rebooted, trashed prefs (opt-com start), copied all the clips into a new project and re-rendered, and even deleted them all and manually applied them all again. There are roughly 36 or 37 chapters in this project. I tend to get a different result each time, but with the same general problem.
Sadly, iMovie worked pretty flawlessly for me, but I thought I'd enjoy the added capabilities of FCPX. The rendering time for this movie on a one year old iMac with 24GB RAM is around 7 hours at 720p, so as you can imagine, it's not been a fun project. I've attached a screenshot of the issue on my AppleTV for reference. I've seen a lot of history with this problem, though many threads proclaimed it 'solved'. I'd disagree. Anyone have any thoughts on what I am doing wrong, or is this just more stellar quality control from Apple?
PS - Are there any recommended alternatives to FCPX? I'm noticing I use fewer and fewer Apple-branded apps, I'm starting to see a pattern here.... :^(

Russ H wrote:
…. Later I'll take a look.
Discs are not my top-priority here, but I remember this rules (for iDVD):
The Rules of Chapter Markers:
*Make sure no chapter markers are within two seconds of the start or end of the timeline.
*Make sure no chapter markers are within a transition.
*Make sure no chapter markers are within two seconds of the end of a transition.
*Make sure you do not have the "Share selected Clips" option checked when preparing to share to iDVD
maybe, these rules were not by limitations of software, but by 'standard'?
If you test it, try to what happens when you 'violate' these rules ...........

Strange out of order packet issue

Similar Messages

Maybe you are looking for