Re: A possible programming challenge

http://en.wikipedia.org/wiki/Hadoop

On 7/8/2010 10:03 PM, Jamal Mazrui wrote:
Thanks for your response, Andreas. No, I am not familiar with that technology. Please elaborate with links, if possible.

Jamal


On 7/8/2010 9:43 PM, Andreas Stefik wrote:
Jamal,

Are you familiar with Hadoop? That's the solution here that
immediately comes to mind, as it would allow you to scale pretty
efficiently for a gargantuan task like this. Basically, Hadoop is an
implementation of Google's Map-Reduce, so far as I understand it.

Stefik

On Thu, Jul 8, 2010 at 8:37 PM, Jamal Mazrui<empower@xxxxxxxxx>  wrote:
For years, I have had an interest in developing a free, open source, web crawler and download manager that makes it convenient to launch a search for
files to download from the web, with various parameters accounting for
factors such as depth of links, file types to retrieve, domains and
directories to explore, etc. I think that a highly usable app for screen
reader users would offer significant benefit to our community because,
historically, ready access to the printed word has been an ongoing obstacle for us, yet today, efficient access to the electronic word can give us an
equal footing or competititve advantage.

I have already thought much about the programming issues in this area, but have had trouble deciding on a design and development stack of technologies. It occurs to me to invite any others who might be interested in engaging in
this endeavor.  I think we would use some kind of open source license,
though that could be debated.  Hopefully, alternative approaches,
contributed by multiple programmers, would help us all develop our
knowledge.

I can say more about my current thoughts on the matter if enough people
express interest.  Anyone, however, should feel free to comment on the
topic.

Jamal

__________
View the list's information and change your settings at
http://www.freelists.org/list/programmingblind


__________
View the list's information and change your settings at
http://www.freelists.org/list/programmingblind


__________
View the list's information and change your settings at http://www.freelists.org/list/programmingblind


__________
View the list's information and change your settings at http://www.freelists.org/list/programmingblind

Other related posts: