[arachne] Re: Slow download speed in Arachne (was Re: new record set...)

Arachne at FreeLists---The Arachne Fan Club!

On Thu, 23 Apr 2009 10:01:04 +0000, Udo Kuhnt wrote:

> Hi Glenn,

>> New record highspeed set with Arachne v1.95

>> Check the bytes/sec in the lower-left of this new screen-cap.....

> these figures would be more spectacular if they were reliably
> reproducible everywhere. So far, however, they seem to be the
> exception rather than the rule. I have yet to see Arachne use more
> than approximately 40% of my DSL bandwidth even with a 32 KB buffer,
> whereas other DOS Internet applications achieve a much higher
> throughput.

> BTW, I have not found a similar buffer assignment in the source code
> of WGET or CURL, so I must assume that these applications reach their
> high download speeds with the standard buffer size.

> I suspect that the reason why Arachne benefits from a larger buffer
> might be that it is too busy with other things when it should rather
> be reading data from the buffer. So increasing the buffer size is
> perhaps the wrong way to fix this problem; the right way would
> probably be to reduce the time that Arachne needs to detect and
> process incoming data in the buffer.

Hi Udo,

I'll bet if we put our heads together we can figure-out
what's going wrong here.

In my setup, L: is a 100meg RamDisk and Arachne runs 100% on there.

Please try this as a 1st test.
Setup a 100meg RamDisk, and make your Arachne cache dir there.

Here's one possible method.....

XMSDSK.EXE 100000 L: /c1

md L:\cache

-- in arachne.cfg ---
CachePath L:\cache\
_______________________________

If you see a drastic improvement in speed with your cache
on RamDisk instead of on HDD......

That will point to the problem being disk write activity slowing you down.

-- 
 http://www.glennmcc.org/
                  Arachne at FreeLists                  
-- Arachne, The Premier GPL Web Browser/Suite for DOS --

Other related posts: