[Clusterusers] request for CPU time

[Jaime Davila]

HMMM. Interesting. One consequence of that is that the system ends up 
penalizing tasks that have been parallelized, since those are going to 
be seen by tractor as a bunch of small tasks, as opposed to a single big 
one. I've spent several months turning the breve evaluation of a genetic 
population into something that spreads the evaluation of separate 
individuals across the cluster, and I'm planning on writing up how I did 
it. I would be glad to share whatever I learned from that process with 
others, which will probably apply even outside of breve, if they want to 
parallelize.

On 06/27/2013 02:23 PM, Wm. Josiah Erikson wrote:
> The issue right now is that many of Tom's Digital Multiplier processes 
> seem to be taking around 9 days to finish, so once they've grabbed a 
> slot, they hold on to it for a very long time, which effectively means 
> that nobody else can use the cluster while they are running, since we 
> don't have any kicking-people-out algorithm, and everybody else's jobs 
> finish in more like 20 minutes.
> The solution, of course, is to change the "tom" tag to only use every 
> other slot or something like that, or only run two processes per 
> machine or something... but then they'll take even longer to finish.
> Discussing tomorrow at the meeting seems like a good plan.
>     -Josiah
>
>
> On 6/27/13 2:19 PM, Lee Spector wrote:
>> Hi Jaime,
>>
>> Fine with me personally but I'll check with my lab group to see what 
>> everyone's expected needs are. I'm also not sure exactly how to 
>> implement the idea if people do want to run some other things... 
>> maybe by having you use a subset of machines that everyone else 
>> excludes?
>>
>>   -Lee
>>
>> On Jun 27, 2013, at 2:14 PM, Jaime Davila wrote:
>>
>>> Greetings everyone,
>>>
>>> I wanted to check to see if it was possible for me to grab some more 
>>> CPU cycles out of the cluster for a week or so. I just placed a new 
>>> algorithm on my account, and have it run it, but it's fairly 
>>> different from what I was doing before, and I would rather detect 
>>> quickly if I need to tweak or change things, as opposed to having to 
>>> wait a week to realize I need to make a 10 minute change.
>>>
>>> Last time that the system load diminished some, I noticed that my 
>>> processes run at their top speed if the number of CPUs loaded to 
>>> their maximum drops to about 75%, as opposed to the 97% where they 
>>> are now. Maybe things will be that way this time around, maybe not? 
>>> In either case, my grabbing more cpu cycles right now would be 
>>> extremely useful.
>>>
>>> Thoughts?
>>>
>>> Thanks a lot,
>>>
>>> Jaime
>>>
>>> -- 
>>> ******************************************************
>>> Jaime J. Dávila
>>> Associate Professor of Computer Science
>>> Hampshire College
>>> jdavila at hampshire dot edu
>>> http://helios.hampshire.edu/jdavila
>>> *******************************************************
>>>
>>> _______________________________________________
>>> Clusterusers mailing list
>>> Clusterusers at lists.hampshire.edu
>>> https://lists.hampshire.edu/mailman/listinfo/clusterusers
>> -- 
>> Lee Spector, Professor of Computer Science
>> Cognitive Science, Hampshire College
>> 893 West Street, Amherst, MA 01002-3359
>> lspector at hampshire.edu, http://hampshire.edu/lspector/
>> Phone: 413-559-5352, Fax: 413-559-5438
>>
>> _______________________________________________
>> Clusterusers mailing list
>> Clusterusers at lists.hampshire.edu
>> https://lists.hampshire.edu/mailman/listinfo/clusterusers
>

-- 
******************************************************
Jaime J. Dávila
Associate Professor of Computer Science
Hampshire College
jdavila at hampshire dot edu
http://helios.hampshire.edu/jdavila
*******************************************************