[noCensorship] Re: Testing proxies from Freerk's list

  • From: wayne <wayne@xxxxxxxxxxxxx>
  • To: nocensorship@xxxxxxxxxxxxx, proxytools-users@xxxxxxxxxxxx
  • Date: 28 Dec 2003 18:43:03 -0000

> From: Denis Green <rainman@xxxxxxxxxxxx>
> To: nocensorship@xxxxxxxxxxxxx
> Subject: [noCensorship] Testing proxies from Freerk's list

> Dear Wayne 

Many of the questions below are answered from the documentation 
in proxyTools:
1) most programs can be run with a 'help' option, like this:
perl statProxy.pl -h
2) most programs have documentation embedded in the source code. 
One way to get that is this:
perldoc statProxy.pl
3) double-click 'readme.html' in the proxyTools directory to see 
the web page docs for all the tools.
> 
> >>>> Next time around is it possible to check for anonymity and add
> >>>> a few anon proxies as well ??
> >>>> Thanks in adv
> >>>> DG
> >
> >>
> >>Do it youself. 
> >>Get statProxy from proxyTools (sig) and do this:
> >>perl statProxy.pl -t 13 -l proxyList.txt
> >>to test a list from Freerk.
> 
> 
> I tried the anon test using Freerk's list
> 
> Here are the results 
> 
> | C:\some directory>perl statProxy.pl -t 13 -l proxyList.txt
> | defined(@array) is deprecated at C:some directory/DNS.pm line 137.
> |         (Maybe you should just omit the defined()?)

Akk! That's still there? You must have an old version of perl, I 
think. I had some code to get rid of that, but recently I've 
removed it. 
It's not a proxyTools problem, and it causes no harm.

> | I'm assuming this IP address is aaa.bbb.ccc.ddd
> | Loading proxies...
> | Extracting proxy strings, expanding address/portranges,safeing,
> | skipping ports, validating, resolving, deduping...
> | 739 proxies to test (after processing)
> | ctrl-c to see results so far; double-ctrl-c to abort
> | 
> 
> after this some proxy numbers start appearing at the end of the
> screen
> 
> 1/ But I get a feeling that the whole process is pretty slow !!
> (a greedy user asking for too much ?!)
> 
> Is there a way I could know what is realistic - i.e. should it
> finish 700 + proxies in 10 minutes or 4 hours or what. Assume
> I'm using a Lan connection with slow speeds - almost as slow as
> dial up. Can U please assume 30 - 40 kbps speed and give me a
> time frame when this test -t 13 should complete ?

Your best option is to make a smaller file and measure that.

To be honest, I haven't used a dialup for these tests for a long 
time now.
On a capped 40KB/sec line, SP will do all 20 tests on each proxy 
in under a second. There's a 20 second timeout after cessation of 
activity though, so if you test just one proxy, it will take (on 
average) 21 secs. The time per proxy is decreased if you 
are running less tests per proxy. You are running only one, but 
test 13 is slower than most, and depends mainly on the speed of 
the proxy you're testing. In fact, it looks like it's taking over 
1/2 sec per proxy on my system (not a very fast system)! 
There's also a Windows limitation to consider. Windows gets weird 
whenever you try to open too many simultaneous socket connections, 
so SP waits for them to die away at times. That's dependent on 
your type of Windows. Mine is a server, so there may be an 
advantage there.

I remember adding an option for low bandwidth connections:
perl statProxy.pl -t 13 -m -l proxyList.txt
but IIRC it only helps with the large downloads involved in 
test 0 (the basic proxy function test). If I were you, I would 
like to see test 0 results anyway - change the test parameter to 
0:13. That will give you a way to get rid of dead proxies before 
spending time on the slower anon tests. Even in Freerk's excellent 
lists about 30% will be dead by the time you test them.

I should have mentioned that a personal firewall might interfere 
with these tests. Test 13 involves getting the proxy under test 
to connect back to you as if you are a web site. I don't think 
that would increase the overall time though, since all the 
tests are done in parallel. Err on second thought it might if your 
Windows version is old, or limited, and the number of open sockets 
gets high. See comment below.

> 2/ Further *where* should I look for the results, If I abort the
> operation after say half and hour? 
> 
> Is there a file (name ) that I should pick up the results from? 

It should tell you where the results have been copied.

Be careful how you abort.
One ctrl-c will just screen print the results so far and continue 
the tests, 2 ctrl-c's (before the end of the above screen print) 
will cause abort with file write, 3 or more (before the end of the 
screen print) will abort with no screen print (if they were 
quick enough) and no file write.
The ctrl-c counter is reset at the end of that screen print.

On a very slow computer, three ctrl-c's are more likely to cause 
an abort without writing the file (or even displaying on the 
screen) as you can see.

> 3/ Cntrl + C does not display anything other than the last
> appearing proxy number on the screen. Does it mean none of the
> proxies passed the test ?

Hmm .. it probably means you have a slow computer and it was too 
busy in the o/s network stack to listen to signals back in the perl 
code. Try that '-m' option. 

> 
> 4/ Will a Cntrl + C stop the process (to display the results). If 
> so how do I restart. (Cntrl + double C aborts the process. I've
> aborted couple of timese before wirting to you )

See above.

> 5/ Can I open multiple command promts in Win 2000 and will that 
> kill this testing window

Yes. No.

> >>Or, from the pretested database, do this:
> >>perl extractHosts.pl - isEnabled doesNotPassIPAddressThrough
> >>(recommend you get the latest hosts.zip for this though)
> 
> 
> If I use the pretested database, and do an extract where are the 
> proxies extraceted to ?

The '-' says to write them to the screen. Put a filename there if 
you want the results in a file. Use tee.pl if you want both at the same 
time.

> & If possible
> -----------------
> I have to use the proxies on my browser and so 
> wish to list them by speed (in addition to anon - not 
> passing IP through )

SP doesn't do it. 
Unix or Cygwin systems have a sort tool. No doubt there are some 
for MS Windows too.
I do it by using my trusty text editor (TextPad) on the result 
file. The latencies are all starting in the same column, so 
they're easy to sort. Note that you *must* do test 0 to get the speed.

The real answer lies in the 'todo' list for sortProxy.pl, but I never 
got a round tuit.

> Thanks in adv
> DG

--
Turing email: wayne at nym.alias.nest
(remove the obvious extra 's')
http://proxytools.sourceforge.net/

===8>============== noCensorship community ===============
List's webpage: //www.freelists.org/webpage/nocensorship
List's archive: //www.freelists.org/archives/nocensorship
To unsubscribe: nocensorship-request@xxxxxxxxxxxxx with 'unsubscribe' in the 
SUBJECT field.
Moderator's email: nocensorship-moderators@xxxxxxxxxxxxx
===8>============== noCensorship community ===============


Other related posts: