MSexchangeAB/nspi rpc requests average latency very high
Exchange 2010 SP2 RU3 mostly with one SP3 RU8 v2 Hub/CAS server. All client access is being routed to the SP3 RU8 v2 CAS server. I've noticed that the MSExchangeAB/nspi rpc requests average latency counter grows to extremely high numbers like
14K. When that happens, Outlook clients start to show performance issues and lock ups. Then I restart the Address Book service on the CAS server, and it is back to normal for a while and then will eventually grow again and do the same thing.
Is there anything I need to look at specifically to see what's going on. I think this has been going on for quite some time, like a year, but I haven't been able to narrow it down very well until now.
Any suggestions would be appreciated.
Thanks,
Andrew
In addition to moving processing of incoming Outlook Mailbox connections to the Client Access server, in Exchange 2010, directory access
is also handled by the Client Access server.
when an Outlook client makes a request of the Client Access server, it results in one of two possible actions.
If the user's mailbox is on an Exchange 2010 Mailbox server, then either the request is handled by a Client Access server in the current Active Directory site, or if the user’s mailbox is in
a different Active Directory site, the request is proxied to the destination Active Directory site.
If the user's mailbox is on a legacy Exchange Mailbox server, the directory request is referred to the user's Mailbox server. Legacy Mailbox servers can't communicate directly with Exchange
2010 Client Access servers for directory information.
You might have to check the health and replication across DC's in all sites. seems like there might be a possibility of latency from/to a GC which is being used by Outlook
for Referral.
https://technet.microsoft.com/en-us/library/ee332346(v=exchg.141).aspx
https://technet.microsoft.com/en-us/library/ee332317(v=exchg.141).aspx
http://blogs.technet.com/b/exchange/archive/2010/05/20/3409978.aspx
*** VOTE IF HELPFUL / MARK ANSWER IF ANSWER ***
Pavan Maganti ~ ( Exchange | 2003/2007/2010/E15(2013)) ~~ Please remember to click “Vote As Helpful" if it really helps and "Mark as Answer” if it answers your question, “Unmark as Answer” if a marked post does not actually answer your
question. ~~ This Information is provided is "AS IS" and confers NO Rights!!
Similar Messages
-
DPC Latency very high in Games sound and game freezes
5DPC Latency very high in Games sound and game freezes?hello, i am new her. I am german, sry for my Bad englisch. i do my best that you unterstand me...
my problem is very well known in the internet, but i did not find a solution until now...
My Computer:
E6300 @ 3 ghz
Mainboard: Abit Fatalty FP-IN9 with nForce650i-SLI Chipset
4 Gig DDR2 Ram
Win 7 64bit
Soundblaster is a X-fi Titanium PCIe
when i am in windows, look a film on youtube or on my harddisk the DPC Latency is always " green " and i have no freezes in sound or computer
But when i start a Computergame like Starcraft the freezes come, and also the DPC Latency goes red.
http://www.picfront.org/d/7Ngg
I thought the problem is the old Daniel_K 2.0 support pack driver which i installed 6 month ago. I formated my computer todey.
Installed Windows, installed Ati display driver, than installed orginal Creative driver : 2.7.0008 (26. Juli 200). And then i started Starcraft 2 direct but i did not help. Because of that i think i must be a hardware problem...
cyathe Wlan-card was it. How can i solve the problem that i can use my wlan without this freeze problems ?
-
I've been searching for months, i haven't found a solution. I have a dell 14r, and i've got very high dpc latency, i've disabled Intel speed step, i don't know if it was the cause, but helped a little, but a still have some high DPC.
here's the DPC Conclusion
CONCLUSION
Your system seems to have difficulty handling real-time audio and other tasks. You may experience drop outs, clicks or pops due to buffer underruns. One problem may be related to power management, disable CPU throttling settings in Control Panel and BIOS setup.
Check for BIOS updates.
LatencyMon has been analyzing your system for 0:00:50 (h:mm:ss) on all processors.
SYSTEM INFORMATION
Computer name: ALEF
OS version: Windows 8 , 6.2, build: 9200 (x64)
Hardware: Inspiron 5437, Dell Inc., 01PN4H
CPU: GenuineIntel Intel(R) Core(TM) i5-4200U CPU @ 1.60GHz
Logical processors: 4
Processor groups: 1
RAM: 6048 MB total
CPU SPEED
Reported CPU speed: 1596,0 MHz
Measured CPU speed: 180,0 MHz (approx.)
Note: reported execution times may be calculated based on a fixed reported CPU speed. Disable variable speed settings like Intel Speed Step and AMD Cool N Quiet in the BIOS setup for more accurate results.
WARNING: the CPU speed that was measured is only a fraction of the CPU speed reported. Your CPUs may be throttled back due to variable speed settings and thermal issues. It is suggested that you run a utility which reports your actual CPU frequency and temperature.
MEASURED INTERRUPT TO USER PROCESS LATENCIES
The interrupt to process latency reflects the measured interval that a usermode process needed to respond to a hardware request from the moment the interrupt service routine started execution. This includes the scheduling and execution of a DPC routine, the
signaling of an event and the waking up of a usermode thread from an idle wait state in response to that event.
Highest measured interrupt to process latency (µs): 1572,913052
Average measured interrupt to process latency (µs): 22,366048
Highest measured interrupt to DPC latency (µs): 1565,856753
Average measured interrupt to DPC latency (µs): 11,824275
REPORTED ISRs
Interrupt service routines are routines installed by the OS and device drivers that execute in response to a hardware interrupt signal.
Highest ISR routine execution time (µs): 364,749373
Driver with highest ISR routine execution time: ndis.sys - NDIS (Especificação de Interface de Driver de Rede), Microsoft Corporation
Highest reported total ISR routine time (%): 0,106754
Driver with highest ISR total time: ndis.sys - NDIS (Especificação de Interface de Driver de Rede), Microsoft Corporation
Total time spent in ISRs (%) 0,133510
ISR count (execution time <250 µs): 21131
ISR count (execution time 250-500 µs): 0
ISR count (execution time 500-999 µs): 3
ISR count (execution time 1000-1999 µs): 0
ISR count (execution time 2000-3999 µs): 0
ISR count (execution time >=4000 µs): 0
REPORTED DPCs
DPC routines are part of the interrupt servicing dispatch mechanism and disable the possibility for a process to utilize the CPU while it is interrupted until the DPC has finished execution.
Highest DPC routine execution time (µs): 747,735589
Driver with highest DPC routine execution time: ndis.sys - NDIS (Especificação de Interface de Driver de Rede), Microsoft Corporation
Highest reported total DPC routine time (%): 0,297310
Driver with highest DPC total execution time: ndis.sys - NDIS (Especificação de Interface de Driver de Rede), Microsoft Corporation
Total time spent in DPCs (%) 0,652473
DPC count (execution time <250 µs): 263660
DPC count (execution time 250-500 µs): 0
DPC count (execution time 500-999 µs): 253
DPC count (execution time 1000-1999 µs): 0
DPC count (execution time 2000-3999 µs): 0
DPC count (execution time >=4000 µs): 0
REPORTED HARD PAGEFAULTS
Hard pagefaults are events that get triggered by making use of virtual memory that is not resident in RAM but backed by a memory mapped file on disk. The process of resolving the hard pagefault requires reading in the memory from disk while the process is interrupted
and blocked from execution.
NOTE: some processes were hit by hard pagefaults. If these were programs producing audio, they are likely to interrupt the audio stream resulting in dropouts, clicks and pops. Check the Processes tab to see which programs were hit.
Process with highest pagefault count: explorer.exe
Total number of hard pagefaults 1115
Hard pagefault count of hardest hit process: 493
Highest hard pagefault resolution time (µs): 12225544,827694
Total time spent in hard pagefaults (%): 247,355044
Number of processes hit: 22
PER CPU DATA
CPU 0 Interrupt cycle time (s): 0,761402
CPU 0 ISR highest execution time (µs): 331,166667
CPU 0 ISR total execution time (s): 0,090588
CPU 0 ISR count: 7756
CPU 0 DPC highest execution time (µs): 678,561404
CPU 0 DPC total execution time (s): 0,432507
CPU 0 DPC count: 129558
CPU 1 Interrupt cycle time (s): 1,093584
CPU 1 ISR highest execution time (µs): 364,749373
CPU 1 ISR total execution time (s): 0,177768
CPU 1 ISR count: 13378
CPU 1 DPC highest execution time (µs): 650,636591
CPU 1 DPC total execution time (s): 0,566066
CPU 1 DPC count: 21399
CPU 2 Interrupt cycle time (s): 1,091097
CPU 2 ISR highest execution time (µs): 0,0
CPU 2 ISR total execution time (s): 0,0
CPU 2 ISR count: 0
CPU 2 DPC highest execution time (µs): 747,735589
CPU 2 DPC total execution time (s): 0,292306
CPU 2 DPC count: 112231
CPU 3 Interrupt cycle time (s): 0,461547
CPU 3 ISR highest execution time (µs): 0,0
CPU 3 ISR total execution time (s): 0,0
CPU 3 ISR count: 0
CPU 3 DPC highest execution time (µs): 338,436090
CPU 3 DPC total execution time (s): 0,020591
CPU 3 DPC count: 725Hi,
Please refer to the article below:
http://blog.tune-up.com/windows-insights/title-poor-jerky-performance-fixing-unacceptably-high-dpc-latency-issues/
Andy Altmann
TechNet Community Support -
Very high latency in fetching static files
Problem : Really high latency in fetching static files upon first request.
Environment : Weblogic V8.1 App Server and Web Server running using jdk1.4.2_13
Mem Setting: -Xmx2048M -XX:MaxPermSize=1024M
Situaton: Restart the weblogic server, fetch a static file using " wget hostname:port/script.js". Comes back in around 100 ms for us. Then from browser we request "http://hostname:portname/Logon.do". Then again we do " wget hostname:port/script.js" and now it comes back in 400 ms. The above times are in our TEST environment. In PROD it is really worse 1300ms for one file !!!
Tests:
Wrote a servlet to handle all static file (CSS,js,gif,jpeg etc) and all requests would go through this servlet. Did not solve the problem, latency is still high.
Wrote a test servlet to load about 1000 classes explicitly (Class.forName) and then fetched the static file with out accessing Logon.do from browser. Latency was high after loading classes. This lead to conclusion that it is number of classes we are loading which is causing the problem.
Ran application under JProfiler, Took a heap dump right after starting server. About 1300 classes loaded. Took a heap dump after fetching Logon.do. About 2100 classes loaded.
Question :
1) Isn't 1300 too high for just the server to start? (there are some classes loaded because of our references in ejb's)
2) We use prototype factory to instantiate classes. All the interface and implementation definitions are specified in config file and it seems to load all the classes. May be we can change this. But what confuses me is that the response time was okay when we had 1300 classes loaded how come it became so bad when there were 2100 classes ?
If any body is using these same set of technologies, what is the average number of classes loaded on initial start up?
I am running out of options to test?There's no way from what you posted that you could draw a conclusion that you are infected.
I totally missed that tracert, but from a ping response time, it looks healthy.
The packet loss, could easily cause your problem.
Does it consistently loose packets there ? Cause I've pinged it from here and got no loss.
Also remember that in this case, ping is also the time it takes the blizzard servers to response to your network message, so it could be local to blizzard, and ping might not detect that.
Have you tried a netstat -p tcp -b command too see whats active on your PC ? That could point you towards something local. -
Latency is very high when SELECT statements are running for LONG
We are a simple DOWN STREAM streams replication environment ( Archive log is shipped from source , CAPTURE & APPLY are running on destination DB).
Whenever there is a long running SELECT statement on TARGET the latency become very high.
SGA_MAX_SIZE = 8GB
STREAMS_POOL_SIZE=2GB
APPLY parallelism = 4
How can resolve this issue?Is the log file shipped but not acknowledge? -- NO
Is the log file not shipped? -- It is shipped
Is the log file acknowledged by not applied? -- Yes...But Apply process was not stopped. it may be slow or waiting for something?
It is 10g Environment. I will run AWR.. But what should i look for in AWR? -
Very high latency on my MBP 3,1 (mid 2007) with airport extreme card 0x168C
Hi
I wanted to let you know that i filled a bug report concerning a problem involving a MacBookPro3,1 and my airport extreme card (AirPort Extreme (0x168C, 0x87) Firmware Version 1.4.16.2)
If you've got any feedback, please feel free to share it with me.
Here's the bug report:
Hello
I'm experiencing very high latency on my MBP when connected using Wi-Fi in my living room and I believe this is a software bug.
This is the trace of my ping test to my router (5m from me):
macbookpro:~ laurent$ ping 192.168.0.254
PING 192.168.0.254 (192.168.0.254): 56 data bytes
64 bytes from 192.168.0.254: icmp_seq=0 ttl=64 time=1536.229 ms
64 bytes from 192.168.0.254: icmp_seq=1 ttl=64 time=536.642 ms
64 bytes from 192.168.0.254: icmp_seq=1 ttl=64 time=3444.466 ms (DUP!)
64 bytes from 192.168.0.254: icmp_seq=2 ttl=64 time=2547.260 ms
64 bytes from 192.168.0.254: icmp_seq=3 ttl=64 time=2671.552 ms
64 bytes from 192.168.0.254: icmp_seq=4 ttl=64 time=1671.272 ms
64 bytes from 192.168.0.254: icmp_seq=5 ttl=64 time=2619.991 ms
64 bytes from 192.168.0.254: icmp_seq=6 ttl=64 time=1619.350 ms
64 bytes from 192.168.0.254: icmp_seq=7 ttl=64 time=2362.474 ms
64 bytes from 192.168.0.254: icmp_seq=8 ttl=64 time=1362.662 ms
64 bytes from 192.168.0.254: icmp_seq=9 ttl=64 time=363.461 ms
64 bytes from 192.168.0.254: icmp_seq=10 ttl=64 time=1407.557 ms
64 bytes from 192.168.0.254: icmp_seq=11 ttl=64 time=1020.437 ms
64 bytes from 192.168.0.254: icmp_seq=12 ttl=64 time=119.570 ms
^C
--- 192.168.0.254 ping statistics ---
14 packets transmitted, 13 packets received, +1 duplicates, 7% packet loss
round-trip min/avg/max/stddev = 119.570/1663.066/3444.466/937.468 ms
These are the details of my network when alt clicking on the network icon:
ca:69:50:37:c7:b2
Channel: 5
RSSI: -54
Transmit Rate: 54
I'm using Channel 5 where my router is the only device available (checked with iStumbler and KissMac).
I compared these results with another computer sitting at the same place:
This is the trace of my ping test to my router using a PC laptop:
C:\Documents and Settings\Laurent>ping -t 192.168.0.254
Envoi d'une requête 'ping' sur 192.168.0.254 avec 32 octets de données :
Réponse de 192.168.0.254 : octets=32 temps=2 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=2 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=3 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=4 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=3 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=4 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=2 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=3 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=3 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=6 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=4 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=8 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=4 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=4 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=4 ms TTL=64
Réponse de 192.168.0.254 : octets=32 temps=1 ms TTL=64
Statistiques Ping pour 192.168.0.254:
Paquets : envoyés = 16, reçus = 16, perdus = 0 (perte 0%),
Durée approximative des boucles en millisecondes :
Minimum = 1ms, Maximum = 8ms, Moyenne = 3ms
(PC: Win XP SP3 with Linksys Wi-Fi card)
Obviously, my Mac has very high latency where my PC works as expected.
I tried resetting the PRAM, but i didn't affect my results.
I tried updating Airport with the latest AirPort Client Update (http://support.apple.com/downloads/AirPortClient_Update_for_MacBook_and_MacBookPro), but my hardware wasn't eligible for that update (Mid 2007 MacBookPro).
I believe this isn't a hardware bug because i get acceptable ping results when next to my router or in other rooms of my flat.
Can you help me with that bug ?
Regards,
Laurent
Hardware Overview:
Model Name: MacBook Pro
Model Identifier: MacBookPro3,1
Processor Name: Intel Core 2 Duo
Processor Speed: 2.2 GHz
Number Of Processors: 1
Total Number Of Cores: 2
L2 Cache: 4 MB
Memory: 2 GB
Bus Speed: 800 MHz
Boot ROM Version: MBP31.0070.B07
SMC Version (system): 1.16f11
Serial Number (system): W874551DX91
Hardware UUID: 00000000-0000-1000-8000-001B63B19195
Sudden Motion Sensor:
State: Enabled
AirPort:
Type: AirPort
Hardware: AirPort
BSD Device Name: en1
IPv4 Addresses: 192.168.0.2
IPv4:
Addresses: 192.168.0.2
Configuration Method: DHCP
Interface Name: en1
NetworkSignature: IPv4.Router=192.168.0.254;IPv4.RouterHardwareAddress=00:07:cb:3e:04:ef
Router: 192.168.0.254
Subnet Masks: 255.255.255.0
DNS:
Server Addresses: 212.27.40.241, 212.27.40.240
DHCP Server Responses:
Domain Name Servers: 212.27.40.241,212.27.40.240
Lease Duration (seconds): 0
DHCP Message Type: 0x05
Routers: 192.168.0.254
Server Identifier: 192.168.0.254
Subnet Mask: 255.255.255.0
Proxies:
Exceptions List: *.local, 169.254/16
FTP Passive Mode: Yes
Ethernet:
MAC Address: 00:1e:52:72:05:2c
Media Options:
Media Subtype: Auto Select
AirPort Card Information:
Wireless Card Type: AirPort Extreme (0x168C, 0x87)
Wireless Card Locale: Worldwide
Wireless Card Firmware Version: 1.4.16.2
Current Wireless Network: kalamar
Wireless Channel: 5Ok, I must have jinxed myself.
High latency with my Negear WPN824v3. As previously mentioned, the other wireless computers connect fine. Latency remains regardless of the power connected or not.
Please advise.
PING 192.168.0.1 (192.168.0.1): 56 data bytes
64 bytes from 192.168.0.1: icmp_seq=0 ttl=64 time=11.607 ms
64 bytes from 192.168.0.1: icmp_seq=2 ttl=64 time=7280.106 ms
64 bytes from 192.168.0.1: icmp_seq=3 ttl=64 time=9209.019 ms
64 bytes from 192.168.0.1: icmp_seq=4 ttl=64 time=8237.475 ms
64 bytes from 192.168.0.1: icmp_seq=5 ttl=64 time=7262.603 ms
64 bytes from 192.168.0.1: icmp_seq=8 ttl=64 time=4313.763 ms
64 bytes from 192.168.0.1: icmp_seq=9 ttl=64 time=3336.361 ms
64 bytes from 192.168.0.1: icmp_seq=10 ttl=64 time=2339.579 ms
64 bytes from 192.168.0.1: icmp_seq=11 ttl=64 time=1344.110 ms
64 bytes from 192.168.0.1: icmp_seq=12 ttl=64 time=345.132 ms
64 bytes from 192.168.0.1: icmp_seq=13 ttl=64 time=1191.119 ms
64 bytes from 192.168.0.1: icmp_seq=14 ttl=64 time=3969.730 ms
64 bytes from 192.168.0.1: icmp_seq=15 ttl=64 time=3992.111 ms
64 bytes from 192.168.0.1: icmp_seq=16 ttl=64 time=3692.648 ms
64 bytes from 192.168.0.1: icmp_seq=17 ttl=64 time=2927.634 ms
64 bytes from 192.168.0.1: icmp_seq=18 ttl=64 time=2130.216 ms
64 bytes from 192.168.0.1: icmp_seq=19 ttl=64 time=1437.424 ms
64 bytes from 192.168.0.1: icmp_seq=20 ttl=64 time=2385.203 ms
64 bytes from 192.168.0.1: icmp_seq=21 ttl=64 time=1393.622 ms
64 bytes from 192.168.0.1: icmp_seq=22 ttl=64 time=396.783 ms
64 bytes from 192.168.0.1: icmp_seq=23 ttl=64 time=1.295 ms
64 bytes from 192.168.0.1: icmp_seq=24 ttl=64 time=115.793 ms
64 bytes from 192.168.0.1: icmp_seq=25 ttl=64 time=3.137 ms
64 bytes from 192.168.0.1: icmp_seq=26 ttl=64 time=10.240 ms
64 bytes from 192.168.0.1: icmp_seq=27 ttl=64 time=2.709 ms
64 bytes from 192.168.0.1: icmp_seq=28 ttl=64 time=9.958 ms
64 bytes from 192.168.0.1: icmp_seq=29 ttl=64 time=1818.371 ms
64 bytes from 192.168.0.1: icmp_seq=30 ttl=64 time=1470.613 ms
64 bytes from 192.168.0.1: icmp_seq=31 ttl=64 time=472.520 ms
64 bytes from 192.168.0.1: icmp_seq=32 ttl=64 time=2255.417 ms
64 bytes from 192.168.0.1: icmp_seq=33 ttl=64 time=18198.039 ms
64 bytes from 192.168.0.1: icmp_seq=34 ttl=64 time=23288.761 ms
64 bytes from 192.168.0.1: icmp_seq=35 ttl=64 time=25150.840 ms
64 bytes from 192.168.0.1: icmp_seq=36 ttl=64 time=26813.832 ms
^C
--- 192.168.0.1 ping statistics ---
63 packets transmitted, 34 packets received, 46% packet loss
round-trip min/avg/max/stddev = 1.295/4906.111/26813.832/7241.136 ms -
Very high "load average" in top
Hi,
our OES11SP1 two-server-cluster (fully patched) shows a very high "load
average" (>50, up to 110) in top in some circumstances. There are no
problems in normal operation, but administrator actions like shutdown or
cluster migrate might trigger the problem.
For example when I enter 'halt', then there is the following line in
/var/log/messages:
Sep 12 20:27:18 srv1 shutdown[14675]: shutting down for system halt
more than 20 minutes later:
Sep 12 20:51:19 srv1 init: Switching to runlevel: 0
Within thes 20 minutes nothing happens, but "average load" goes up to at
least 50, with ndsd at top. Access to storage related tools and commands is
not possible, for example 'nss /pool' hangs without any output.
This happens on nearly every shutdown, but from time to time it doesn't. The
same will sometimes be triggered by a cluster migrate.
This only happens with our OES11SP1 cluster, it does not happen with OES11
and OES2SP3; the only other difference I'm aware of: Novell CIFS is only
running on the OES11SP1 cluster.
Any ideas?
Thanks,
MirkoSorry for the delay, it seems it's a bad habit of me to ask questions
immediately before holidays...
Yes, these servers have replicas, all of them... Cache size is set to 195328
KB, which is about twice the DIB size. IIRC this was a recommendation I read
somewhere at Novell. But I'll check that information again.
Thanks,
Mirko
kjhurni wrote:
>
> Mirko Guldner;2283539 Wrote:
>> top shows ndsd on top - but it's there in normal operation too, so I
>> don't
>> know if this means something.. (?) And it's not always the CPU which is
>> at
>> 100% - I have an example screenshot with: load average 50.20, 51.61,
>> 41.0
>> 3.2%us, 1.0%sy, 0.0%ni, 77.0%id 18%wa 0.0%hi 0.3%si 0.0%st. But this is
>> only
>> an example - this differs.
>>
>> Thanks,
>> Mirko
>>
>> kjhurni wrote:
>>
>> >
>> > Mirko Guldner;2283448 Wrote:
>> >> Hi,
>> >>
>> >> our OES11SP1 two-server-cluster (fully patched) shows a very high
>> "load
>> >> average" (>50, up to 110) in top in some circumstances. There are no
>> >> problems in normal operation, but administrator actions like
>> shutdown
>> >> or
>> >> cluster migrate might trigger the problem.
>> >>
>> >> For example when I enter 'halt', then there is the following line in
>> >> /var/log/messages:
>> >>
>> >> Sep 12 20:27:18 srv1 shutdown[14675]: shutting down for system halt
>> >>
>> >> more than 20 minutes later:
>> >>
>> >> Sep 12 20:51:19 srv1 init: Switching to runlevel: 0
>> >>
>> >> Within thes 20 minutes nothing happens, but "average load" goes up
>> to
>> >> at
>> >> least 50, with ndsd at top. Access to storage related tools and
>> commands
>> >> is
>> >> not possible, for example 'nss /pool' hangs without any output.
>> >>
>> >> This happens on nearly every shutdown, but from time to time it
>> doesn't.
>> >> The
>> >> same will sometimes be triggered by a cluster migrate.
>> >>
>> >> This only happens with our OES11SP1 cluster, it does not happen with
>> >> OES11
>> >> and OES2SP3; the only other difference I'm aware of: Novell CIFS is
>> >> only
>> >> running on the OES11SP1 cluster.
>> >>
>> >> Any ideas?
>> >>
>> >> Thanks,
>> >> Mirko
>> >
>> > Which process(es) does top show as being the culprit?
>> >
>> > In the past (on OES2 SP3) we had issues with CIFS causing ncp to
>> cause
>> > high utilization, but that was fixed a while ago.
>> >
>> > --Kevin
>> >
>> >
>
> I have seen ncp issues cause high ndsd utilization, but we've not yet
> upgraded our cluster or DS servers to OES11 yet (waiting for new
> hardware to go in place first).
>
> Out of curiosity, are the servers with high utilization also replica
> servers? For some reason, during one of our upgrades on a replica
> server (we have a server that contains all R/W copies of everything),
> the cache size got set down really low and that caused all sorts of
> issues.
>
> Maybe one of my collegues will wander by and offer additional insight,
> as this may be eDir related and/or NCP related. Not sure if triggering
> a core manually would help (but you'd have to send that to Novell and
> open an SR to get it read).
>
> IF you suspect CIFS, do you have the ability to temporarily shut off
> CIFS for like a few days to see if that's the culprit?
>
> -
Good Evening,
For 4-5 weeks, I have been getting very high pings (>1500ms) this occurs randomly throughout the day and night.
I have reported a fault and have been told this is normal for peak times.... however they will request a switch over to Fast Path from Interleave.
Now I'm no Rocket scientist but >1500ms ping in an area with only 200 houses on my exchange IS NOT normal, nor is it even remotely acceptable that i'm told it is!!
Having browsed the web with this IP (my 1st hop) "217.47.106.122", I find many others with EXACTLY the same issue.
Please can someone confirm there is an issue with the above address..
My Area Code is 01851 (Isle of Lewis).
I am aware there is ongoing work to install infinity on Lewis this summer, yet I haven't been informed of any dissruptions.
If I was a betting man I'd say many user's have been rerouted and now as a result is being overloaded.. an oversight no doubt.
Please either confirm this is or at the very least "may" be the case..
Regards
DanLooking good!
Tracing route to bbc.co.uk [212.58.246.103]
over a maximum of 30 hops:
1 1 ms 1 ms <1 ms BTHomeHub.home [192.168.1.254]
2 1385 ms 1426 ms 1419 ms 217.47.106.122
3 783 ms 796 ms 847 ms 217.47.106.193
4 1024 ms 1004 ms 1069 ms 213.1.69.78
5 1162 ms 1212 ms 1255 ms 31.55.165.102
6 1356 ms 1359 ms 973 ms 31.55.165.75
7 834 ms 847 ms 906 ms 31.55.165.107
8 1001 ms 1029 ms 1077 ms 109.159.250.52
9 1218 ms 1278 ms 1222 ms core1-te0-13-0-17.ealing.ukcore.bt.net [109.159.250.42]
10 1092 ms 703 ms 626 ms peer2-xe0-0-0.telehouse.ukcore.bt.net [109.159.254.102]
11 644 ms 738 ms 708 ms 194.74.65.42
12 * * * Request timed out.
13 1204 ms 1183 ms 1291 ms ae0.er01.cwwtf.bbc.co.uk [132.185.254.93]
14 1228 ms * 690 ms 132.185.255.165
15 888 ms 904 ms 909 ms fmt-vip132.cwwtf.bbc.co.uk [212.58.246.103]
Trace complete. -
Over the last few months my Mac has developed a worrying habit.
Within the first few minutes of starting it up (perhaps on average about 50% of the time) it will completely lock up. This may happen at the Log In screen (if I start up the Mac & then leave it for a while) or during normal use.
Often the first symptom is a very high pitched (but quiet) whining noise that seems to come from the loud speaker on the front of the Mac. The pointer may freeze at this point, or it may still be moveable for 5 or 10 seconds before it freezes. It sometimes turns into the spinning beach ball during this. Once locked up the only way I can restart the Mac is to hold down the power button on the front for a few seconds to completely reboot the machine.
Once the Mac has restarted, it usually behaves normally, almost always for the rest of the day. The initial lock up & resulting restart only normally seem to happen the first time I use the Mac that day.
The only peripherals attached to the Mac (apart from the display, keyboard & mouse) are an ADSL modem, a USB printer and a pair of Apple Pro speakers, and this setup hasn't changed since long before the problems started, so I'm confident that I can discount the peripherals causing problems. I doubt that unplugging the speakers, for example, would have any effect.
I've run Disc Utility, OnyX and DiscWarrior without anything major cropping up. My instincts (I've been troubleshooting Mac problems for 16 years) tell me that I have a fundamental hardware problem, possibly with one of the 4 RAM DIMMs installed.
The RAM configuration is shown in the attached screen grab.
I'm considering removing one DIMM, running with 1.5GB of RAM rather than 2GB for a while, and repeating with a different DIMM removed each time until I can hopefully isolate the dodgy DIMM.
Do people feel this is a sensible approach, or should I try something else first?
Many thanks.Sometimes visual inpection will show bulging tops/sides., my guess is if it is it's most likely in the PSU.
Possible cheap fix, You can convert an ATX PSU for use on a G4...
http://atxg4.com/mdd.html
http://atxg4.com/ -
Which perspectives I should consider about Av Rd(ms) is very high just for
db version: 11.1.7
os: RH linux 5.5
I was seeing i/o stats from AWR generated for one hour, and all the value of Av Rd(ms) for files i/o stats are under around 10, however except for one file, the Av Rd(ms) just for one data file is very high(38325.25), even Av Rd(ms) of the others data files which are on same mount point with that one file are also normal, so I think this should be caused by application, however I can not find out clue.
so could you please give me some perspectives to be considered and to be researched? thanks so much!RLUO wrote:
db version: 11.1.7
os: RH linux 5.5
I was seeing i/o stats from AWR generated for one hour, and all the value of Av Rd(ms) for files i/o stats are under around 10, however except for one file, the Av Rd(ms) just for one data file is very high(38325.25), even Av Rd(ms) of the others data files which are on same mount point with that one file are also normal, so I think this should be caused by application, however I can not find out clue.
so could you please give me some perspectives to be considered and to be researched? thanks so much!Look at the v$event_histogram report for anything to to with file reads. It's possible that you will find that a single read request got an extremely high time - I've seen odd glitches occasionall, with a single block read taking (apparently) several weeks to complete - and that you can ignore the side effects .
Regards
Jonathan Lewis -
XML select query causing very high CPU usage.
Hi All,
In our Oracle 10.2.0.4 Two node RAC we are facing very high CPU usage....and all of the top CPU consuming processes are executing this below sql...also these statements are waiting for some gc wiat events as shown below.
SELECT B.PACKET_ID FROM CM_PACKET_ALT_KEY B, CM_ALT_KEY_TYPE C, TABLE(XMLSEQUENCE ( EXTRACT (:B1 , '/AlternateKeys/AlternateKey') )) T
WHERE B.ALT_KEY_TYPE_ID = C.ALT_KEY_TYPE_ID AND C.ALT_KEY_TYPE_NAME = EXTRACTVALUE (VALUE (T), '/AlternateKey/@keyType')
AND B.ALT_KEY_VALUE = EXTRACTVALUE (VALUE (T), '/AlternateKey')
AND NVL (B.CHILD_BROKER_CODE, '6209870F57C254D6E04400306E4A78B0') =
NVL (EXTRACTVALUE (VALUE (T), '/AlternateKey/@broker'), '6209870F57C254D6E04400306E4A78B0')
SQL> select sid,event,state from gv$session where state='WAITING' and event not like '%SQL*Net%';
SID EVENT STATE
66 jobq slave wait WAITING
124 gc buffer busy WAITING
143 gc buffer busy WAITING
147 db file sequential read WAITING
222 Streams AQ: qmn slave idle wait WAITING
266 gc buffer busy WAITING
280 gc buffer busy WAITING
314 gc cr request WAITING
317 gc buffer busy WAITING
392 gc buffer busy WAITING
428 gc buffer busy WAITING
471 gc buffer busy WAITING
518 Streams AQ: waiting for time management or cleanup tasks WAITING
524 Streams AQ: qmn coordinator idle wait WAITING
527 rdbms ipc message WAITING
528 rdbms ipc message WAITING
532 rdbms ipc message WAITING
537 rdbms ipc message WAITING
538 rdbms ipc message WAITING
539 rdbms ipc message WAITING
540 rdbms ipc message WAITING
541 smon timer WAITING
542 rdbms ipc message WAITING
543 rdbms ipc message WAITING
544 rdbms ipc message WAITING
545 rdbms ipc message WAITING
546 rdbms ipc message WAITING
547 gcs remote message WAITING
548 gcs remote message WAITING
549 gcs remote message WAITING
550 gcs remote message WAITING
551 ges remote message WAITING
552 rdbms ipc message WAITING
553 rdbms ipc message WAITING
554 DIAG idle wait WAITING
555 pmon timer WAITING
79 jobq slave wait WAITING
117 gc buffer busy WAITING
163 PX Deq: Execute Reply WAITING
205 db file parallel read WAITING
247 gc current request WAITING
279 jobq slave wait WAITING
319 LNS ASYNC end of log WAITING
343 jobq slave wait WAITING
348 direct path read WAITING
372 db file scattered read WAITING
475 jobq slave wait WAITING
494 gc cr request WAITING
516 Streams AQ: qmn slave idle wait WAITING
518 Streams AQ: waiting for time management or cleanup tasks WAITING
523 Streams AQ: qmn coordinator idle wait WAITING
528 rdbms ipc message WAITING
529 rdbms ipc message WAITING
530 Streams AQ: waiting for messages in the queue WAITING
532 rdbms ipc message WAITING
537 rdbms ipc message WAITING
538 rdbms ipc message WAITING
539 rdbms ipc message WAITING
540 rdbms ipc message WAITING
541 smon timer WAITING
542 rdbms ipc message WAITING
543 rdbms ipc message WAITING
544 rdbms ipc message WAITING
545 rdbms ipc message WAITING
546 rdbms ipc message WAITING
547 gcs remote message WAITING
548 gcs remote message WAITING
549 gcs remote message WAITING
550 gcs remote message WAITING
551 ges remote message WAITING
552 rdbms ipc message WAITING
553 rdbms ipc message WAITING
554 DIAG idle wait WAITING
555 pmon timer WAITINGI am not at all able to understand what this SQL is...i think its related to some XML datatype.
Also not able to generate execution plan for this sql using explain plan- getting error(ORA-00932: inconsistent datatypes: expected - got -)
Please help me in this issue...
How can i generate execution plan?
Does this type of XML based query will cause high GC wiat events and buffer busy wait events?
How can i tune this query?
How can i find that this is the only query causing High CPU usage?
Our servers are having 64 GB RAM and 16 CPU's..
OS is Solaris 5.10 with UDP as protocol for interconnect..
-YasserI found some more xml queries as shown below.
SELECT XMLELEMENT("Resource", XMLATTRIBUTES(RAWTOHEX(RMR.RESOURCE_ID) AS "resourceID", RMO.OWNER_CODE AS "ownerCode", RMR.MIME_TYPE AS "mimeType",RMR.FILE_SIZE AS "fileSize", RMR.RESOURCE_STATUS AS "status"), (SELECT XMLAGG(XMLELEMENT("ResourceLocation", XMLATTRIBUTES(RAWTOHEX(RMRP.REPOSITORY_ID) AS "repositoryID", RAWTOHEX(DIRECTORY_ID) AS "directoryID", RESOURCE_STATE AS "state", RMRO.RETRIEVAL_SEQ AS "sequence"), XMLFOREST(FULL_PATH AS "RemotePath"))ORDER BY RMRO.RETRIEVAL_SEQ) FROM RM_RESOURCE_PATH RMRP, RM_RETRIEVAL_ORDER RMRO, RM_LOCATION RML WHERE RMRP.RESOURCE_ID = RMR.RESOURCE_ID AND RMRP.REPOSITORY_ID = RMRO.REPOSITORY_ID AND RMRO.LOCATION_ID = RML.LOCATION_ID AND RML.LOCATION_CODE = :B2 ) AS "Locations") FROM RM_RESOURCE RMR, RM_OWNER RMO WHERE RMR.OWNER_ID = RMO.OWNER_ID AND RMR.RESOURCE_ID = HEXTORAW(:B1 )
SELECT XMLELEMENT ( "Resources", XMLAGG(XMLELEMENT ( "Resource", XMLATTRIBUTES (B.RESOURCE_ID AS "id"), XMLELEMENT ("ContentType", C.CONTENT_TYPE_CODE), XMLELEMENT ("TextExtractStatus", B.TEXT_EXTRACTED_STATUS), XMLELEMENT ("MimeType", B.MIME_TYPE), XMLELEMENT ("NumberPages", TO_CHAR (B.NUM_PAGES)), XMLELEMENT ("FileSize", TO_CHAR (B.FILE_SIZE)), XMLELEMENT ("Status", B.STATUS), XMLELEMENT ("ContentFormat", D.CONTENT_FORMAT_CODE), G.ALTKEY )) ) FROM CM_PACKET A, CM_RESOURCE B, CM_REF_CONTENT_TYPE C, CM_REF_CONTENT_FORMAT D, ( SELECT XMLELEMENT ( "AlternateKeys", XMLAGG(XMLELEMENT ( "AlternateKey", XMLATTRIBUTES ( H.ALT_KEY_TYPE_NAME AS "keyType", E.CHILD_BROKER_CODE AS "broker", E.VERSION AS "version" ), E.ALT_KEY_VALUE )) ) ALTKEY, E.RESOURCE_ID RES_ID FROM CM_RESOURCE_ALT_KEY E, CM_RESOURCE F, CM_ALT_KEY_TYPE H WHERE E.RESOURCE_ID = F.RESOURCE_ID(+) AND F.PACKET_ID = HEXTORAW (:B1 ) AN
D E.ALT_KEY_TYPE_ID = H.ALT_KEY_TYPE_ID GROUP BY E.RESOURCE_ID) G WHERE A.PACKET_ID = HEXTORAW (:B1
SELECT XMLELEMENT ("Tagging", XMLAGG (GROUPEDCAT)) FROM ( SELECT XMLELEMENT ( "TaggingCategory", XMLATTRIBUTES (CATEGORY1 AS "categoryType"), XMLAGG (LISTVALUES) ) GROUPEDCAT FROM (SELECT EXTRACTVALUE ( VALUE (T), '/TaggingCategory/@categoryType' ) CATEGORY1, XMLCONCAT(EXTRACT ( VALUE (T), '/TaggingCategory/TaggingValue' )) LISTVALUES FROM TABLE(XMLSEQUENCE(EXTRACT ( :B1 , '/Tagging/TaggingCategory' ))) T) GROUP BY CATEGORY1)
SELECT XMLCONCAT ( :B2 , DI_CONTENT_PKG.GET_ENUM_TAGGING_FN (:B1 ) ) FROM DUAL
SELECT XMLCONCAT (:B2 , :B1 ) FROM DUAL
SELECT * FROM EQ_RAW_TAG_ERROR A WHERE TAG_LIST_ID = :B2 AND EXTRACTVALUE (A.RAW_TAG_XML, '/TaggingValues/TaggingValue/Value' ) = :B1 AND A.STATUS = '
NR'
SELECT RAWTOHEX (S.PACKET_ID) AS PACKET_ID, PS.PACKET_STATUS_DESC, S.LAST_UPDATE AS LAST_UPDATE, S.USER_ID, S.USER_COMMENT, MAX (T.ALT_KEY_VALUE) AS ALTKEY, 'Y' AS IS_PACKET FROM EQ_PACKET S, CM_PACKET_ALT_KEY T, CM_REF_PACKET_STATUS PS WHERE S.STATUS_ID = PS.PACKET_STATUS_ID AND S.PACKET_ID = T.PACKET_ID AND NOT EXISTS (SELECT 1 FROM CM_RESOURCE RES WHERE RES.PACKET_ID = S.PACKET_ID AND EXISTS (SELECT 1 FROM CM_REF_CONTENT_FORMAT CF WHERE CF.CONTENT_FORMAT_ID = RES.CONTENT_FORMAT AND CF.CONTENT_FORMAT_CODE = 'I_FILE')) GROUP BY RAWTOHEX (S.PACKET_ID), PS.PACKET_STATUS_DESC, S.LAST_UPDATE, S.USER_ID, S.USER_COMMENT UNION SELECT RAWTOHEX (A.FATAL_ERROR_ID) AS PACKET_ID, C.PACKET_STATUS_DESC, A.OCCURRENCE_DATE AS LAST_UPDATE, '' AS USER_ID, '' AS USER_COMMENT, RAWTOHEX (A.FATAL_ERROR_ID) AS ALTKEY, 'N' AS IS_PACKET FROM EQ_FATAL_ERROR A, EQ_ERROR_MSG B, CM_REF_PACKET_STATUS C, EQ_SEVERITYD WHERE A.PACKET_ID IS NULL AND A.STATUS = 'NR' AND A.ERROR_MSG_ID = B.ERROR_MSG_ID AND B.SEVERITY_I
SELECT /*+ INDEX(e) INDEX(a) INDEX(c)*/ XMLAGG(XMLELEMENT ( "TaggingCategory", XMLATTRIBUTES ( G.TAG_CATEGORY_CODE AS "categoryType" ), XMLELEMENT ("TaggingValue", XMLATTRIBUTES (C.IS_PRIMARY AS "primary", H.ORIGIN_CODE AS "origin"), XMLAGG(XMLELEMENT ( "Value", XMLATTRIBUTES ( F.TAG_LIST_CODE AS "listType" ), E.TAG_VALUE )) ) )) FROM TABLE (CAST (:B1 AS T_TAG_MAP_HIERARCHY_TAB)) A, TABLE (CAST (:B2 AS T_ENUM_TAG_TAB)) C, REM_TAG_VALUE E, REM_TAG_LIST F, REM_TAG_CATEGORY G, CM_ORIGIN H WHERE E.TAG_VALUE_ID = C.TAG_VALUE_ID AND F.TAG_LIST_ID = E.TAG_LIST_ID AND G.TAGGING_CATEGORY_ID = F.TAGGING_CATEGORY_ID AND H.ORIGIN_ID = C.ORIGIN_ID AND C.ENUM_TAG_ID = A.MAPPED_ENUM_TAG_ID GROUP BY C.IS_PRIMARY, H.ORIGIN_CODE, G.TAG_CATEGORY_CODE START WITH A.MAPPED_ENUM_TAG_ID = HEXTORAW (:B3 ) CONNECT BY PRIOR A.MAPPED_ENUM_TAG_ID = A.ENUM_TAG_ID
SELECT /*+ INDEX(e) */ XMLAGG(XMLELEMENT ( "TaggingCategory", XMLATTRIBUTES ( G.TAG_CATEGORY_CODE AS "categoryType" ), XMLELEMENT ( "TaggingValue", XMLATTRIBUTES (C.IS_PRIMARY AS "primary", H.ORIGIN_CODE AS "origin"), XMLAGG(XMLCONCAT ( XMLELEMENT ( "Value", XMLATTRIBUTES ( F.TAG_LIST_CODE AS "listType" ), E.TAG_VALUE ), CASE WHEN LEVEL = 1 THEN :B4 ELSE NULL END )) ) )) FROM TABLE (CAST (:B1 AS T_TAG_MAP_HIERARCHY_TAB)) A, TABLE (CAST (:B2 AS T_ENUM_TAG_TAB)) C, REM_TAG_VALUE E, REM_TAG_LIST F, REM_TAG_CATEGORY G, CM_ORIGIN H WHERE E.TAG_VALUE_ID = C.TAG_VALUE_ID AND F.TAG_LIST_ID = E.TAG_LIST_ID AND G.TAGGING_CATEGORY_ID = F.TAGGING_CATEGORY_ID AND H.ORIGIN_ID = C.ORIGIN_ID AND C.ENUM_TAG_ID = A.MAPPED_ENUM_TAG_ID GROUP BY G.TAG_CATEGORY_CODE, C.IS_PRIMARY, H.ORIGIN_CODE START WITH A.MAPPED_ENUM_TAG_ID = HEXTORAW (:B3 ) CONNECT BY PRIOR A.MAPPED_ENUM_TAG_ID = A.ENUM_TAG_IDBy observing above sql queries i found some hints forcing for index usage..
I think xml schema is created already...and its progressing as you stated above. Please correct if i am wrong.
I found all these sql from AWR report and all of these are very high resource consuming queries.
And i am really sorry if i am irritating you by asking all stupid questions related to xml.
-Yasser
Edited by: YasserRACDBA on Nov 17, 2009 3:39 PM
Did syntax allignment. -
Very very high FEC Errors.
Hi all.
I have very very high FEC errors. I got 4294967263 errors in 5 minutes! It seems far too high.
My Broadband connection keeps dropping out too. I have changed all the filters and cabling. Don't know what else to try.
Thanks in advance.Here you go ......
Connection information
Line state
Connected
Connection time
0 days, 0:11:52
Downstream
11,483 Kbps
Upstream
1,183 Kbps
ADSL settings
VPI/VCI
0/38
Type
PPPoA
Modulation
ITU-T G.992.5
Latency type
Interleaved
Noise margin (Down/Up)
9.1 dB / 5.6 dB
Line attenuation (Down/Up)
31.0 dB / 18.0 dB
Output power (Down/Up)
0.0 dBm / 12.5 dBm
Loss of Framing (Local)
0
Loss of Signal (Local)
0
Loss of Power (Local)
0
FEC Errors (Down/Up)
295 / 4294967263
CRC Errors (Down/Up)
3 / N/A
HEC Errors (Down/Up)
N/A / 0
Error Seconds (Local)
1
Hide Details -
Loadrunner cannot decode some of the recorded Gwt Rpc request bodies
I have recorded a GWT application and also could regeneate the script. But some of the Gwt Rpc requests were not decoded by saying this "Failed to create web_convert_from_formatted step. Decoded data is empty or has invalid tags" But how can I find what are the invalid tags here. An example full request with having problems is this.
web_custom_request("dataService_98",
"URL=http://192.168.1.167:7373/reservationCentral/reservationcentral/dataService",
"Method=POST",
"Resource=0",
"RecContentType=application/json",
"Referer=http://192.168.1.167:7373/reservationCentral/",
"Snapshot=t120.inf",
"Mode=HTML",
"EncType=text/x-gwt-rpc; charset=UTF-8",
"Body=7|0|25|http://192.168.1.167:7373/reservationCentral/reservationcentral/|0EF6245E352394C4BB722ECF8159F0EC|it... SAVED|FIT|STD|RCL|DIRECT|UK|E-mail|C|Silva|"
"it.codegen.tbx.gwt.central.data.CGWebTimestamp/3979480346|NONE|USD|$|FIT:-3330525478508942879|1|2|3|4|2|5|6|0|7|8|0|-1|P__________|9|0|0|0|-1|0|0|9685|10|11|9|10|2014|NHHmLkiFinh|0|1000|12|13|14|0|15|-1|0|BAMQ|9|9|16|17|18|9|0|0|0|0|0|11|9|10|2014|0|19|9|0|A|11|9|10|2014|0|0|0|20|21|9|17|918|48|10|16|2014|0|9|0|0|100|22|0|P__________|0|0|11|9|10|2014|23|24|0|P__________|25|13|1|30000|50000|1|0|0|",
LAST);
any advice or workaround would be highly appriciated. Thanks in advance.In the default php.ini is set open_basedir which limits work with php only to few directories (and directories bellow them). There is set /srv/http, /home,/tmp and /usr/share/pear by default.
To allow your vhost you should add /data/www or set empty value. -
Very high ASYNC_NETWORK_IO
Hi There; I’m an ‘Accidental DBA’ with a problem (is there any other kind?).
We seem to be getting very high ASYNC_NETWORK_IO; with a WaitCount of around 20 million hits per 24 hour period (total wait time around 9 hours in that same period).
I’ve spent a lot of time researching this wait and as I understand it ASYNC_NETWORK_IO is most often caused by the application not consuming data fast enough; so we had a programmer work through the code and resolve all locations where we are using a IQueryable
in a for next loop and converting them immediately into arrays (Linq To SQL).
This seems to have made no difference.
I would like to set up an extended event trace to find which queries are generating this particular wait, but at an average of over 200 hits per second I’m concerned about performance impact such a trace might have.
I’m looking for suggestions as to how to move forward in resolving this issue.
My first question is, am I correct in thinking that the number of these waits that we are getting is excessively high?
Assuming that is the case how can I go about tracing the offending queries without hammering the system?
If (as I suspect) it is not individual queries that are causing the issue, what else should I be looking for?
Thanks in advance
Paul.Hi chaps
Thanks for the help.
We have about 100 concurrent users and they are always complaining about the application being slow, so the application is definitely not performing well.
Using activity monitor the cpu is normally at 20-60% and there are usually no more than 0-4 waiting tasks and a few hundred batch req/sec.
The only thing that stands out is the very high ASYNC_NETWORK_IO, in terms of both wait time & wait count.
Raju, thank you for the link, I have read that blog post before in my research: the server is using only about 2.5% of the available bandwidth (1gb). Our network admin assures me that the network is set-up correctly. while it is possible that there are a
few badly written queries most of them are quite lean. Almost all of our processes use Linq to SQL, there are no bulk dataloads
You also said:
>I’ve spent a lot of time researching this wait and as I understand it ASYNC_NETWORK_IO
>is most often caused by the application not consuming data fast enough; so we had a
>programmer work through the code and resolve all locations where we are using a IQueryable
>in a for next loop and converting them immediately into arrays (Linq To SQL).
I'm not familiar with what kind of SQL that generates.
I asked about a design issue of too much data before, if you are using a low-level interface then the opposite is a question as well, even for modest amounts of data if you somehow use server-side cursors, or otherwise end up sending SQL commands for
just one row at a time, then you can get slow response and high asynch waits. I'm also not sure what you mean by having the programmer "resolve" these locations.
David also asks a good question whether there are just a couple of waits that throw off the totals. A similar but more design-oriented question is whether your app has some little widget that is always tickling SQL Server for an update, 100 users issuing
a one-line query once a second, to fill some tiny counter on the user screen, can have this same kind of effect.
Finally on the perceived app slowness *again* I would ask about design issues, I've seen apps that were very cleverly doing async, background data loads on ten hidden panels while the user gazed at their data. This was very heavily loading the system
for basically no good reason, but it wasn't SQL Server's fault.
Josh -
Very High processing time in STAD
Hi
I have a problem in my NW04 BI system.
Users are occasionally experiencing high responsetimes while using the HTTP interface to work with BI reports.
If I display the statistical records STAD I can see that while using the SAPMHTTP program the "processing time" and therefor "Total time in workprocs" are very high but other times in the record are very low. CPU time is very low. Below is the detailed analysis.
CPU time 94 ms
RFC+CPIC time 0 ms
Total time in workprocs 481.566 ms
Response time 481.566 ms
Wait for work process 0 ms
Processing time 481.093 ms
Load time 1 ms
Generating time 0 ms
Roll (in+wait) time 0 ms
Database request time 226 ms
Enqueue time 0 ms
DB procedure call time 246 ms
Number Roll ins 1
Roll outs 1
Enqueues 8
Load time Program 1 ms
Screen 0 ms
CUA interf. 0 ms
Roll time Out 0 ms
In 0 ms
Wait 0 ms
Frontend No.roundtrips 0
GUI time 0 ms
Net time 0 ms
No. of DB procedure calls 1
Can anyone tell me what is going on in the system or how I can go further to analyze this. You might assume that this is a CPU bottleneck but it is not, I am using 4 x 64bit processors and 12Gb memory with load of 5-10% when this problem occurs.
Best Regards
Sindriwhy should the database be a problem, it is
> Database request time 226 ms
Go to the details (double click) of the line with problems. In the details you should have a button 'http' in the action line. There you can chewck the http details which should tell you where the time was spend.
As always, repeat your measurements a few times to see whether the behaviour is reproducible.
Siegfried
Maybe you are looking for
-
I had to restore from backup to a new hard drive, and only have part of my Adobe Photoshop installation. Is there a way to find the serial number in these files so that I can reinstall the full version? I have only part of the documentation so this
-
Connecting Imac to X Serve remotely
I want to be able to start working from home and wish to be able to access the work server from my Imac and have no idea how to go about it...... any advice as to the easiest way would be much appreciated
-
Score: Bars per line...
Only one line in my score need to have 5 bars instead of 4. How to do that? Thanks a lot
-
Adobe Flash Player stop working...
For some reason Adode Flash Player recently stop working. I uninstalled and reinstalled Flash player 4 times however to no avail. I have the latest version (14.0.0.176) on my PC (Windows 64bit). I've noticed that others have also had a problems with
-
My Pavilion DV6T does not playback bass anymore or send it out through the headphone jack. Everything else is properly wired, tried a few different devices, but it is just the laptop not playing bass. Gets used for a lot of music, so I really appr