Did you guys see this? http://virtualizationjedi.com/2011/01/11/installing-appsense-on-a-provisione d-xenapp-server/ Joe From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of James Scanlon Sent: Friday, January 07, 2011 2:05 AM To: thin@xxxxxxxxxxxxx Subject: [THIN] Re: XenApp 5 - 2008 x64 Slow ah the irony :) _____ From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of Christopher Wilson Sent: 06 January 2011 21:35 To: thin@xxxxxxxxxxxxx Subject: [THIN] Re: XenApp 5 - 2008 x64 Slow Wow, that's a big deal since AppSense is supposed to add like 30% more capacity. I've starting seeing slowness now that my new farm is more heavily loaded. I'll have to give this a look as well. On Thu, Jan 6, 2011 at 10:50 AM, Andy Friar <Andy.Friar@xxxxxxxxxxx> wrote: Thanks James, I'll disable PM in the short term and do some further checks Rgds Andy From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of James Scanlon Sent: 06 January 2011 16:40 To: thin@xxxxxxxxxxxxx Subject: [THIN] Re: XenApp 5 - 2008 x64 Slow We narrowed it down to a combination of Appsense Performance Manager and Environment Manager With PM disabled the server is snappy, quick, and as we would expect (though EM adds around 10-15 seconds to the logon as per the rules we have defined) We are in the process of discussing with Appsense and other support avenues as to where the exact issue lies As far as we are concerned however the crisis is averted, all production systems have PM disabled, all servers are getting over 70 users without missing a beat Individual load tests push the servers to 100 users (so far) without issue...(re enabling PM and the server is game over at 45-50 users) James :) _____ From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of Landin, Mark Sent: 06 January 2011 15:42 To: thin@xxxxxxxxxxxxx Subject: [THIN] Re: XenApp 5 - 2008 x64 Slow James Scanlon just had a very similar, if not exactly the same, problem with his systems and he finally fingered Appsense as the culprit. I suggest reviewing the list archives for his messages in the November / December timeframe for details. I'll copy his final response on 12/13: "We have troubleshooted this to APPSENSE. When all three products (AM, EM And PM are enabled) the server doubles users logons from 14s to around 30, and progressivly gets worse until the server completely crashes around 45 users. Stopping any of the three services of appsense relieves the issue. Stopping appsense completely sees the server behave as we would expect sub 15second logons, for over 100 users, instant launching of programs. Further investigation continues and will update the list when we have more info... Thanks to all for your input. J " You may wish to experiment with disabling Appsense in your environment to see if it's the culprit in your case. _____ From: thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] On Behalf Of Andy Friar Sent: Thursday, January 06, 2011 9:10 AM To: thin@xxxxxxxxxxxxx Subject: [THIN] XenApp 5 - 2008 x64 Slow I'm have a problem with the following Windows 2008 SP2 Enterprise x64 XenApp 5 Enterprise R01 Boxes are Dell blade 8 core + HT 49Gb RAM Local manadatory profiles with full Appsense suite utilising EM + Personalisation service. Desktop / My Documents / Favourites redirected to a Netapp Filer running CIFS. The more users that come onto the box the slower the machine gets. @ 0-45 users the box is responsive, logon times are good but it still has this apparent lag when accessing local apps @ 50 the lag is getting worse sometimes freezes but always comes back. @ 60 logon times are substantial, just selecting a cell in excel can take 30+ seconds. Performance counters seem fine 14% processor time 25k context switches / sec no massive jumps 0 Processor queue length 99% disk idle 0 disk queue length 15-20k threads 0 Redirector\Current Commands The only large one is system calls / sec which can be anywhere from 80k to 1.5m, I've cut down the apps but system calls are still high. To me the server feels as if it has no cpu left, but given the resources free it looks more like an i/o problem, I've tuned the smb with the following [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanserver\Parameter s] "MaxWorkItems"=dword:00002000 "MaxMpxCt"=dword:00000800 (subsequently has been changed to match the Netapp) "MaxRawWorkItems"=dword:00000200 "MaxFreeConnections"=dword:00000064 "MinFreeConnections"=dword:00000020 [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanworkstation\Para meters] "MaxCmds"=dword:00000800 [HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Session Manager\Configuration Manager] "RegistryLazyFlushInterval"=dword:0000003C The NetApp filer has had cifs.max_mpx set to 1124 so I've subsequently changed the citrix servers to match this number rather than the 2048 previously. It's running around 30%cpu 2000 io/sec 98% cache hit. Any suggestions on where else I might look into what is causing the bottleneck? Thanks Andy _____ This message and any attachments may be a confidential attorney-client communication or otherwise be privileged and confidential. If you are not the intended recipient, any review, distribution or copying of this transmittal is prohibited. If you have received this transmittal in error, please reply by e-mail and delete this message and all attachments ______________________________________ C. Hoare & Co. is authorised and regulated by the Financial Services Authority with registration no. 122093. The FSA's address is 25, The North Colonnade, Canary Wharf, London E14 5HS. Registered in England no. 240822. Registered office 37 Fleet St, London, EC4P 4DQ Confidentiality Disclaimer: This message and attachments are confidential and may be privileged, and are sent for the personal attention of the addressee(s). If you are not the intended addressee, any use, disclosure or copying of this document is unauthorised. Information transmitted by email may be intercepted, lost, destroyed, corrupted or delayed and as a result, C. Hoare & Co. do not accept responsibility for any errors or omissions in the contents of this message. If you would like to confirm the contents of this email, please request a hard copy version. If the contents of this message are of a personal nature, the email will have been sent in a personal capacity and not on behalf of C. Hoare & Co. Monitoring/Viruses: C. Hoare & Co. may monitor all incoming and outgoing emails in line with current legislation. Although emails are screened for viruses, C. Hoare & Co. cannot guarantee that any transmissions will be virus free. ________________________________________