Hi Andy, Is the lag/pause random or consistent. Ie. At 60 users logged in, will you always see a lag selecting a cell in Excel? What are your Redirector\Current Commands sitting at, as the value below is missing? I would also be checking %Page File Usage and Memory:Pages/Second counter. There could be a process paging big time. Known issues could be AV realtime scanning, Print Drivers, SMB V1.0 tuning. Carl posted a heap of relevant hotfixes a couple of months ago. http://support.microsoft.com/kb/983533 http://support.microsoft.com/kb/2028453 http://support.microsoft.com/kb/2028484 http://support.microsoft.com/kb/2059743 http://support.microsoft.com/kb/2065362 http://support.microsoft.com/kb/2213578 http://support.microsoft.com/kb/2231728 http://support.microsoft.com/kb/2251177 http://support.microsoft.com/kb/2261826 http://support.microsoft.com/kb/2272153 http://support.microsoft.com/kb/2281477 http://support.microsoft.com/kb/2300745 http://support.microsoft.com/kb/2414013 http://support.microsoft.com/kb/2444213 http://support.microsoft.com/kb/949538 http://support.microsoft.com/kb/955365 http://support.microsoft.com/kb/956438 http://support.microsoft.com/kb/958089 http://support.microsoft.com/kb/958596 http://support.microsoft.com/kb/960568 http://support.microsoft.com/kb/967113 http://support.microsoft.com/kb/967933 http://support.microsoft.com/kb/968074 http://support.microsoft.com/kb/968358 http://support.microsoft.com/kb/968930 http://support.microsoft.com/kb/968967 http://support.microsoft.com/kb/968995 http://support.microsoft.com/kb/969290 http://support.microsoft.com/kb/969837 http://support.microsoft.com/kb/969851 http://support.microsoft.com/kb/969940 http://support.microsoft.com/kb/969972 http://support.microsoft.com/kb/970603 http://support.microsoft.com/kb/970689 http://support.microsoft.com/kb/970840 http://support.microsoft.com/kb/970910 http://support.microsoft.com/kb/970911 http://support.microsoft.com/kb/970964 http://support.microsoft.com/kb/971253 http://support.microsoft.com/kb/971271 http://support.microsoft.com/kb/971338 http://support.microsoft.com/kb/971347 http://support.microsoft.com/kb/971370 http://support.microsoft.com/kb/971427 http://support.microsoft.com/kb/971438 http://support.microsoft.com/kb/971589 http://support.microsoft.com/kb/972495 http://support.microsoft.com/kb/972596 http://support.microsoft.com/kb/972600 http://support.microsoft.com/kb/972904 http://support.microsoft.com/kb/973062 http://support.microsoft.com/kb/973521 http://support.microsoft.com/kb/973554 http://support.microsoft.com/kb/973744 http://support.microsoft.com/kb/974103 http://support.microsoft.com/kb/974195 http://support.microsoft.com/kb/974266 http://support.microsoft.com/kb/974825 http://support.microsoft.com/kb/975848 http://support.microsoft.com/kb/976036 http://support.microsoft.com/kb/976038 http://support.microsoft.com/kb/976110 http://support.microsoft.com/kb/976520 http://support.microsoft.com/kb/976538 http://support.microsoft.com/kb/976674 http://support.microsoft.com/kb/977225 http://support.microsoft.com/kb/977263 http://support.microsoft.com/kb/977269 http://support.microsoft.com/kb/977389 http://support.microsoft.com/kb/977401 http://support.microsoft.com/kb/977541 http://support.microsoft.com/kb/977585 http://support.microsoft.com/kb/977611 http://support.microsoft.com/kb/977675 http://support.microsoft.com/kb/977686 http://support.microsoft.com/kb/978042 http://support.microsoft.com/kb/978829 http://support.microsoft.com/kb/978927 http://support.microsoft.com/kb/979241 http://support.microsoft.com/kb/979425 http://support.microsoft.com/kb/979548 http://support.microsoft.com/kb/979557 http://support.microsoft.com/kb/980248 http://support.microsoft.com/kb/980356 http://support.microsoft.com/kb/980380 http://support.microsoft.com/kb/980568 http://support.microsoft.com/kb/980663 http://support.microsoft.com/kb/980945 http://support.microsoft.com/kb/981062 http://support.microsoft.com/kb/981369 http://support.microsoft.com/kb/981462 http://support.microsoft.com/kb/981500 http://support.microsoft.com/kb/981704 http://support.microsoft.com/kb/981891 http://support.microsoft.com/kb/981964 http://support.microsoft.com/kb/982051 http://support.microsoft.com/kb/982303 http://support.microsoft.com/kb/982334 http://support.microsoft.com/kb/982416 http://support.microsoft.com/kb/982606 http://support.microsoft.com/kb/982931 http://support.microsoft.com/kb/983237 http://support.microsoft.com/kb/983385 http://support.microsoft.com/kb/983458 http://support.microsoft.com/kb/983533 Cheers, Jeremy. From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of Andy Friar Sent: Thursday, 6 January 2011 11:10 PM To: thin@xxxxxxxxxxxxx Subject: [THIN] XenApp 5 - 2008 x64 Slow I'm have a problem with the following Windows 2008 SP2 Enterprise x64 XenApp 5 Enterprise R01 Boxes are Dell blade 8 core + HT 49Gb RAM Local manadatory profiles with full Appsense suite utilising EM + Personalisation service. Desktop / My Documents / Favourites redirected to a Netapp Filer running CIFS. The more users that come onto the box the slower the machine gets. @ 0-45 users the box is responsive, logon times are good but it still has this apparent lag when accessing local apps @ 50 the lag is getting worse sometimes freezes but always comes back. @ 60 logon times are substantial, just selecting a cell in excel can take 30+ seconds. Performance counters seem fine 14% processor time 25k context switches / sec no massive jumps 0 Processor queue length 99% disk idle 0 disk queue length 15-20k threads 0 Redirector\Current Commands The only large one is system calls / sec which can be anywhere from 80k to 1.5m, I've cut down the apps but system calls are still high. To me the server feels as if it has no cpu left, but given the resources free it looks more like an i/o problem, I've tuned the smb with the following [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanserver\Parameter s] "MaxWorkItems"=dword:00002000 "MaxMpxCt"=dword:00000800 (subsequently has been changed to match the Netapp) "MaxRawWorkItems"=dword:00000200 "MaxFreeConnections"=dword:00000064 "MinFreeConnections"=dword:00000020 [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanworkstation\Para meters] "MaxCmds"=dword:00000800 [HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Session Manager\Configuration Manager] "RegistryLazyFlushInterval"=dword:0000003C The NetApp filer has had cifs.max_mpx set to 1124 so I've subsequently changed the citrix servers to match this number rather than the 2048 previously. It's running around 30%cpu 2000 io/sec 98% cache hit. Any suggestions on where else I might look into what is causing the bottleneck? Thanks Andy