Re: A possible programming challenge
- From: Andreas Stefik <stefika@xxxxxxxxx>
- To: programmingblind@xxxxxxxxxxxxx
- Date: Thu, 8 Jul 2010 20:43:58 -0500
Jamal,
Are you familiar with Hadoop? That's the solution here that
immediately comes to mind, as it would allow you to scale pretty
efficiently for a gargantuan task like this. Basically, Hadoop is an
implementation of Google's Map-Reduce, so far as I understand it.
Stefik
On Thu, Jul 8, 2010 at 8:37 PM, Jamal Mazrui <empower@xxxxxxxxx> wrote:
> For years, I have had an interest in developing a free, open source, web
> crawler and download manager that makes it convenient to launch a search for
> files to download from the web, with various parameters accounting for
> factors such as depth of links, file types to retrieve, domains and
> directories to explore, etc. I think that a highly usable app for screen
> reader users would offer significant benefit to our community because,
> historically, ready access to the printed word has been an ongoing obstacle
> for us, yet today, efficient access to the electronic word can give us an
> equal footing or competititve advantage.
>
> I have already thought much about the programming issues in this area, but
> have had trouble deciding on a design and development stack of technologies.
> It occurs to me to invite any others who might be interested in engaging in
> this endeavor. I think we would use some kind of open source license,
> though that could be debated. Hopefully, alternative approaches,
> contributed by multiple programmers, would help us all develop our
> knowledge.
>
> I can say more about my current thoughts on the matter if enough people
> express interest. Anyone, however, should feel free to comment on the
> topic.
>
> Jamal
>
> __________
> View the list's information and change your settings at
> //www.freelists.org/list/programmingblind
>
>
__________
View the list's information and change your settings at
//www.freelists.org/list/programmingblind
Other related posts:
