[contestms-dev] Re: ES parallelization proposal
- From: Martin Mares <mj@xxxxxx>
- To: contestms-dev@xxxxxxxxxxxxx
- Date: Tue, 16 May 2017 18:01:48 +0200
Hi!
Feel free to take a look and comment!
At the first sight, it looks weirdly complicated to me...
I will try to come up with something better, but I will ask
a couple of (possibly silly) questions first:
- Is it useful to keep queued testcases in the DB individually?
Wouldn't it be easier to keep one entry per submission in the DB
and expand it to testcases only in ES's memory?
- Is it possible to keep the whole queue in ES's memory and just
poll the DB for new entries periodically? Even at the IOI, the
total number of submissions is low enough to allow caching
everything in memory.
- Do we know what is really the bottleneck? Is it the DB,
or perhaps CPU?
- For what throughput of the ES we aim? Is 100 workers * 10 jobs
per worker per second good enough?
Martin
Other related posts:
