[THIN] Re: XenApp 5 - 2008 x64 Slow

  • From: Andy Friar <Andy.Friar@xxxxxxxxxxx>
  • To: "thin@xxxxxxxxxxxxx" <thin@xxxxxxxxxxxxx>
  • Date: Thu, 6 Jan 2011 16:50:45 +0000

Thanks James,

I'll disable PM in the short term and do some further checks

Rgds

Andy

From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of 
James Scanlon
Sent: 06 January 2011 16:40
To: thin@xxxxxxxxxxxxx
Subject: [THIN] Re: XenApp 5 - 2008 x64 Slow

We narrowed it down to a combination of Appsense Performance Manager and 
Environment Manager
With PM disabled the server is snappy, quick, and as we would expect (though EM 
adds around 10-15 seconds to the logon as per the rules we have defined)

We are in the process of discussing with Appsense and other support avenues as 
to where the exact issue lies
As far as we are concerned however the crisis is averted, all production 
systems have PM disabled, all servers are getting over 70 users without missing 
a beat
Individual load tests push the servers to 100 users (so far) without 
issue...(re enabling PM and the server is game over at 45-50 users)

James :)


________________________________
From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of 
Landin, Mark
Sent: 06 January 2011 15:42
To: thin@xxxxxxxxxxxxx
Subject: [THIN] Re: XenApp 5 - 2008 x64 Slow
James Scanlon just had a very similar, if not exactly the same, problem with 
his systems and he finally fingered Appsense as the culprit. I suggest 
reviewing the list archives for his messages in the November / December 
timeframe for details. I'll copy his final response on 12/13:

"We have troubleshooted this to APPSENSE. When all three products (AM, EM And 
PM are enabled) the server doubles users logons from 14s to around 30, and 
progressivly gets worse until the server completely crashes around 45 users.
Stopping any of the three services of appsense relieves the issue.
Stopping appsense completely sees the server behave as we would expect sub 
15second logons, for over 100 users, instant launching of programs.
Further investigation continues and will update the list when we have more 
info...
Thanks to all for your input.

J
"

You may wish to experiment with disabling Appsense in your environment to see 
if it's the culprit in your case.



________________________________
From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of 
Andy Friar
Sent: Thursday, January 06, 2011 9:10 AM
To: thin@xxxxxxxxxxxxx
Subject: [THIN] XenApp 5 - 2008 x64 Slow

I'm have a problem with the following Windows 2008 SP2 Enterprise x64
XenApp 5 Enterprise R01

Boxes are Dell blade 8 core + HT  49Gb RAM
Local manadatory profiles with full Appsense suite utilising EM + 
Personalisation service.
Desktop / My Documents / Favourites redirected to a Netapp Filer running CIFS.

The more users that come onto the box the slower the machine gets.

@ 0-45 users the box is responsive, logon times are good but it still has this 
apparent lag when accessing local apps
@ 50 the lag is getting worse sometimes freezes but always comes back.
@ 60 logon times are substantial, just selecting a cell in excel can take 30+ 
seconds.

Performance counters seem fine

14% processor time
25k context switches / sec no massive jumps
0 Processor queue length
99% disk idle
0 disk queue length
15-20k threads
0 Redirector\Current Commands

The only large one is system calls / sec which can be anywhere from 80k to 
1.5m, I've cut down the apps but system calls are still high.

To me the server feels as if it has no cpu left, but given the resources free 
it looks more like an i/o problem, I've tuned the smb with the following

[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanserver\Parameters]
"MaxWorkItems"=dword:00002000
"MaxMpxCt"=dword:00000800                                 (subsequently has 
been changed to match the Netapp)
"MaxRawWorkItems"=dword:00000200
"MaxFreeConnections"=dword:00000064
"MinFreeConnections"=dword:00000020

[HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanworkstation\Parameters]
"MaxCmds"=dword:00000800

[HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Session 
Manager\Configuration Manager]
"RegistryLazyFlushInterval"=dword:0000003C


The NetApp filer has had cifs.max_mpx set to 1124 so I've subsequently changed 
the citrix servers to match this number rather than the 2048 previously.
It's running around 30%cpu 2000 io/sec 98% cache hit.

Any suggestions on where else I might look into what is causing the bottleneck?

Thanks

Andy



________________________________
This message and any attachments may be a confidential attorney-client 
communication or otherwise be privileged and confidential. If you are not the 
intended recipient, any review, distribution or copying of this transmittal is 
prohibited. If you have received this transmittal in error, please reply by 
e-mail and delete this message and all attachments

______________________________________



C. Hoare & Co. is authorised and regulated by the Financial Services Authority 
with registration no. 122093. The FSA's address is 25, The North Colonnade, 
Canary Wharf, London E14 5HS.

Registered in England no. 240822. Registered office 37 Fleet St, London, EC4P 
4DQ



Confidentiality Disclaimer:

This message and attachments are confidential and may be privileged, and are 
sent for the personal attention of the addressee(s). If you are not the 
intended addressee, any use, disclosure or copying of this document is 
unauthorised. Information transmitted by email may be intercepted, lost, 
destroyed, corrupted or delayed and as a result, C. Hoare & Co. do not accept 
responsibility for any errors or omissions in the contents of this message. If 
you would like to confirm the contents of this email, please request a hard 
copy version.



If the contents of this message are of a personal nature, the email will have 
been sent in a personal capacity and not on behalf of C. Hoare & Co.



Monitoring/Viruses:

C. Hoare & Co. may monitor all incoming and outgoing emails in line with 
current legislation. Although emails are screened for viruses, C. Hoare & Co. 
cannot guarantee that any transmissions will be virus free.

________________________________________


Other related posts: