Wow, that's a big deal since AppSense is supposed to add like 30% more capacity. I've starting seeing slowness now that my new farm is more heavily loaded. I'll have to give this a look as well. On Thu, Jan 6, 2011 at 10:50 AM, Andy Friar <Andy.Friar@xxxxxxxxxxx> wrote: > Thanks James, > > > > I’ll disable PM in the short term and do some further checks > > > > Rgds > > > > Andy > > > > *From:* thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] *On > Behalf Of *James Scanlon > *Sent:* 06 January 2011 16:40 > > *To:* thin@xxxxxxxxxxxxx > *Subject:* [THIN] Re: XenApp 5 - 2008 x64 Slow > > > > We narrowed it down to a combination of Appsense *Performance Manager* and > *Environment Manager* > > With PM disabled the server is snappy, quick, and as we would expect > (though EM adds around 10-15 seconds to the logon as per the rules we have > defined) > > > > We are in the process of discussing with Appsense and other support avenues > as to where the exact issue lies > > As far as we are concerned however the crisis is averted, all production > systems have PM disabled, all servers are getting over 70 users without > missing a beat > > Individual load tests push the servers to 100 users (so far) without > issue...(re enabling PM and the server is game over at 45-50 users) > > > > James :) > > > > > ------------------------------ > > *From:* thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] *On > Behalf Of *Landin, Mark > *Sent:* 06 January 2011 15:42 > *To:* thin@xxxxxxxxxxxxx > *Subject:* [THIN] Re: XenApp 5 - 2008 x64 Slow > > James Scanlon just had a very similar, if not exactly the same, problem > with his systems and he finally fingered Appsense as the culprit. I suggest > reviewing the list archives for his messages in the November / December > timeframe for details. I’ll copy his final response on 12/13: > > > > “We have troubleshooted this to APPSENSE. When all three products (AM, EM > And PM are enabled) the server doubles users logons from 14s to around 30, > and progressivly gets worse until the server completely crashes around 45 > users. > > Stopping any of the three services of appsense relieves the issue. > > Stopping appsense completely sees the server behave as we would expect sub > 15second logons, for over 100 users, instant launching of programs. > > Further investigation continues and will update the list when we have more > info... > > Thanks to all for your input. > > > > J > > “ > > > > You may wish to experiment with disabling Appsense in your environment to > see if it’s the culprit in your case. > > > > > > > ------------------------------ > > *From:* thin-bounce@xxxxxxxxxxxxx [mailto:thin-bounce@xxxxxxxxxxxxx] *On > Behalf Of *Andy Friar > *Sent:* Thursday, January 06, 2011 9:10 AM > *To:* thin@xxxxxxxxxxxxx > *Subject:* [THIN] XenApp 5 - 2008 x64 Slow > > > > I’m have a problem with the following Windows 2008 SP2 Enterprise x64 > > XenApp 5 Enterprise R01 > > > > Boxes are Dell blade 8 core + HT 49Gb RAM > > Local manadatory profiles with full Appsense suite utilising EM + > Personalisation service. > > Desktop / My Documents / Favourites redirected to a Netapp Filer running > CIFS. > > > > The more users that come onto the box the slower the machine gets. > > > > @ 0-45 users the box is responsive, logon times are good but it still has > this apparent lag when accessing local apps > > @ 50 the lag is getting worse sometimes freezes but always comes back. > > @ 60 logon times are substantial, just selecting a cell in excel can take > 30+ seconds. > > > > Performance counters seem fine > > > > 14% processor time > > 25k context switches / sec no massive jumps > > 0 Processor queue length > > 99% disk idle > > 0 disk queue length > > 15-20k threads > > 0 Redirector\Current Commands > > > > The only large one is system calls / sec which can be anywhere from 80k to > 1.5m, I’ve cut down the apps but system calls are still high. > > > > To me the server feels as if it has no cpu left, but given the resources > free it looks more like an i/o problem, I’ve tuned the smb with the > following > > > > > [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanserver\Parameters] > > "MaxWorkItems"=dword:00002000 > > "MaxMpxCt"=dword:00000800 (subsequently has > been changed to match the Netapp) > > "MaxRawWorkItems"=dword:00000200 > > "MaxFreeConnections"=dword:00000064 > > "MinFreeConnections"=dword:00000020 > > > > > [HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Lanmanworkstation\Parameters] > > "MaxCmds"=dword:00000800 > > > > [HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Session > Manager\Configuration Manager] > > "RegistryLazyFlushInterval"=dword:0000003C > > > > > > The NetApp filer has had cifs.max_mpx set to 1124 so I’ve subsequently > changed the citrix servers to match this number rather than the 2048 > previously. > > It’s running around 30%cpu 2000 io/sec 98% cache hit. > > > > Any suggestions on where else I might look into what is causing the > bottleneck? > > > > Thanks > > > > Andy > > > > > > > ------------------------------ > > This message and any attachments may be a confidential attorney-client > communication or otherwise be privileged and confidential. If you are not > the intended recipient, any review, distribution or copying of this > transmittal is prohibited. If you have received this transmittal in error, > please reply by e-mail and delete this message and all attachments > > *______________________________________* > > > > C. Hoare & Co. is authorised and regulated by the Financial Services > Authority with registration no. 122093. The FSA’s address is 25, The North > Colonnade, Canary Wharf, London E14 5HS. > > Registered in England no. 240822. Registered office 37 Fleet St, London, > EC4P 4DQ > > > > Confidentiality Disclaimer: > > This message and attachments are confidential and may be privileged, and > are sent for the personal attention of the addressee(s). If you are not the > intended addressee, any use, disclosure or copying of this document is > unauthorised. Information transmitted by email may be intercepted, lost, > destroyed, corrupted or delayed and as a result, C. Hoare & Co. do not > accept responsibility for any errors or omissions in the contents of this > message. If you would like to confirm the contents of this email, please > request a hard copy version. > > > > If the contents of this message are of a personal nature, the email will > have been sent in a personal capacity and not on behalf of C. Hoare & Co. > > > > Monitoring/Viruses: > > C. Hoare & Co. may monitor all incoming and outgoing emails in line with > current legislation. Although emails are screened for viruses, C. Hoare & > Co. cannot guarantee that any transmissions will be virus free. > > *__**______________________________________* > > * * >