[windows2000] Re: large number of files in folder, slow lan acces s

From: Aaron Dokey <adokey@xxxxxxxxxxxx>
To: "'windows2000@xxxxxxxxxxxxx'" <windows2000@xxxxxxxxxxxxx>
Date: Wed, 9 Oct 2002 08:37:49 -0400
Could this be a limit of the PCI bus in the machine that you have the HBA's
in for testing?  Is the PCI bus 133Mb/sec or 133MB/sec?  I can't remember...
But, if it's Mb then maybe that's part of the bottleneck?

-Aaron

-----------------------
Aaron Dokey - MIS
Reid Tool Supply
2265 Black Creek Rd.
Muskegon, MI   49444 
(231) 777-3951
(231) 767-3772 (Direct)
-----------------------

-----Original Message-----
From: FBohnsack@xxxxxxx [mailto:FBohnsack@xxxxxxx]
Sent: Wednesday, October 09, 2002 2:05 AM
To: windows2000@xxxxxxxxxxxxx
Subject: [windows2000] Re: large number of files in folder, slow lan
acces s







I found no sources stating that there is a 12 MB/sec limitation nor any=

useful sources explaining why there is a limit like that. I have seen i=
t in
a SAN environment involving a HDS Lightning system and now in a SAN wit=
h an
ESS 800. No RAID controllers involved, the redundancy is built inside t=
he
storage systems, the server does not see it. This is the limit when mak=
ing
a backup of a partition/volume. It also doesn't matter whether you use =
more
than one stream per partition/volume or not, it doesn't increase
throughput. This is different in UNIX environments (e.g. Solaris) where=
 you
can increase throughput by using several streams per volume (UFS or Ver=
itas
FS alike).

Check out this benchmark test, where fileserver thorughput was measured=
 (in
comparison to the backup scenario above):

http://www.etestinglabs.com/main/reports/novell_vs_ms2000.pdf

The result of these tests also comes down to 12 MB/sec per
partition/volume. Why you don't get more throughput when all the involv=
ed
hardware is just bored I cannot explain.

We are currently performing tests in the above mentioned ESS 800
environment. If you are interested I can give a short summary of our
results afterwards.

Cheers

Frank


"Joe Shonk" <JShonk@xxxxxxxxxxxxxx>
Sent by: windows2000-bounce@xxxxxxxxxxxxx
08.10.2002 10:53 MST
Please respond to windows2000

To: <windows2000@xxxxxxxxxxxxx>
cc:
bcc:
Subject: [windows2000] Re: large number of files in folder, slow lan ac=
cess


By adding more memory, you increase the I/O Cache... =A0 A few things c=
an =3D
be done to improve NTFS:

Configure File Allocation Size
Increase File Caching Memory
Disable Last Access Update
Disable 8.3 Name Creation
Optimized NTFS Cluster Size
Increase the MFT Zone Reservation

Other things that can be done:
Defrag the Volume
Turn off Virus Scan for the directory
Use a RAID controller w/ 64-128 meg cache
Use a RAID controller w/ a Battery Backup and enable Write Cache when =3D=

Protected
Migrate to a RAID 10 Volume (also known as Raid 0+1)
Use a larger Block Size for the Raid Volume (64k-128k)

There are also a few other tweaks that I do... =A0I'm not quite sure wh=
ere =3D
you got 12MB/sec limitation from. =A0The only way to have a ceiling of =
=3D
12MB/sec is if the OS is coded to throttle data to/from the I/O =3D
subsystems. =A0But one of the ideas with a RAID controller is the I/O =3D=

processing is offloaded from the CPU to the Controller.

Joe

-----Original Message-----
From: FBohnsack@xxxxxxx [mailto:FBohnsack@xxxxxxx]
Sent: Monday, October 07, 2002 11:37 PM
To: windows2000@xxxxxxxxxxxxx
Subject: [windows2000] Re: large number of files in folder, slow lan
acces s







I would first check if there is a memory bottleneck before adding =3D
memor=3D3D
y. I
have seen the same problems on W2k when creating large numbers of =3D
files=3D3D
and
folders in the same structure. So this may be no solution either. I =3D=

don=3D3D
't
think this is a hardware problem, I would expect the CPU and memory to =
=3D
=3D3D
be
only marginally utilized. NTFS has its limits and this seems to be one =
=3D
=3D3D
of
them. It's also not possible to get more than 12 MB/sec. throughput =3D=

fro=3D3D
m
one NTFS filesystem (=3D3D3Dpartition/volume) regardless of the hardwar=
e
underneath. So to sum it up, I don't think there is much you can do. =3D=

Yo=3D3D
u
could make a test with W2k to see if there is a difference. But make a =
=3D
=3D3D
test
before actually migrating. NTFS is not the best filesystem out there, =3D=

i=3D3D
t's
just the only available for NT/W2k.

Cheers

Frank


Joe Shonk <JShonk@xxxxxxxxxxxxxx>
Sent by: windows2000-bounce@xxxxxxxxxxxxx
07.10.2002 08:12 MST
Please respond to windows2000

To: "'windows2000@xxxxxxxxxxxxx'" <windows2000@xxxxxxxxxxxxx>
cc:
bcc:
Subject: [windows2000] Re: large number of files in folder, slow lan =3D=

ac=3D3D
cess


Add more memory, upgrade to W2k and turn on the index service.

Joe

-----Original Message-----
From: Richard Hopper [mailto:Richard.Hopper@xxxxxxxxxxxxx]
Sent: Monday, October 07, 2002 7:51 AM
To: 'windows2000@xxxxxxxxxxxxx'
Subject: [windows2000] large number of files in folder, slow lan =3D
access=3D3D




Hi,
I have a NT4 server which has a few folders with a fairly large
number of files. 4000, or 12000 say. =3D3DA0Most of the files are fairl=
y =3D
sm=3D3D
all <
16K. =3D3DA0 Browsing through these folders is painfully slow. =3D3DA0T=
he =3D
serve=3D3D
r is not
heavily loaded by any means. =3D3DA0Is there anything I can do to impro=
ve =3D
t=3D3D
his.
The server is a 333Mhz PII with 256meg of ram. with over 180 megs of =3D=

ra=3D3D
m
available.


Cheers


Richard




<font size=3D3D3D1 face=3D3D3D'Arial, Helvetica, sans-serif' =3D
color=3D3D3D000000>Any=3D3D
opinions
expressed in this email are those of the individual and not =3D
necessarily=3D3D
the
Company. =3D3DA0This email and any files transmitted with it, including=
 =3D
rep=3D3D
lies
and forwarded copies (which may contain alterations) subsequently
transmitted from the Company, are confidential and solely for the use =3D=

o=3D3D
f
the
intended recipient(s).

It may contain material protected by attorney-client privilege. If you =
=3D
=3D3D
are
not the intended recipient or the person responsible for delivering to =
=3D
=3D3D
the
intended recipient, be advised that you have received this email in =3D=

err=3D3D
or
and that any use is strictly prohibited.

If you have received this email in error please notify the Network
Administrator by telephone on +44 (0)1536 207000 or via email to
postmaster@xxxxxxxxxxxxx including a copy of this message. =3D3DA0Pleas=
e =3D
th=3D3D
en
delete this email and destroy any copies of it.</font>


=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D=
3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D=3D
3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D
=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D
To Unsubscribe, set digest or vacation
mode or view archives use the below link.

http://thethin.net/win2000list.cfm



=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D=
3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D=3D
3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D
=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D=3D3D3D
To Unsubscribe, set digest or vacation
mode or view archives use the below link.

http://thethin.net/win2000list.cfm
[IMAGE]

=3D3D



=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D=
3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D
=3D
=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D
To Unsubscribe, set digest or vacation
mode or view archives use the below link.

http://thethin.net/win2000list.cfm

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
To Unsubscribe, set digest or vacation
mode or view archives use the below link.

http://thethin.net/win2000list.cfm
[IMAGE]

=



==================================
To Unsubscribe, set digest or vacation
mode or view archives use the below link.

http://thethin.net/win2000list.cfm

==================================
To Unsubscribe, set digest or vacation
mode or view archives use the below link.

http://thethin.net/win2000list.cfm
[windows2000] Re: large number of files in folder, slow lan acces s

Other related posts:
