[Clusterusers] long running renders

[Lee Spector]

It's possible that my recent behavior has had some impact too -- for the last week or so I've been doing some big long runs on 4 nodes (1-1, 1-2, 1-17, and 1-18) outside of tractor. I didn't nimby the nodes, and I saw other things running on them at various times, but at present it looks like nothing else is getting allocated to them except one run of Tom's on 1-18. I may scale this back after examining progress tomorrow. 

 -Lee

> On Jun 12, 2015, at 11:12 PM, Bassam Kurdali <bassam at urchn.org> wrote:
> 
> We can hold off changing anything for now - I really feel something has to be wrong with the files to get such long rendertimes, but I don't have experience with maxwell. I'd never use it if that was 'normal'.
> I'm going to try to get some free nodes from renderstreet - I just emailed them (they typically offer free rendering to open movie projects) and perhaps I'll try quarnot as well though I don't have a relationship with the latter. If it works out we won't need to use the farm as much - I'm trying a render on it right now and it doesn't seem too too terrible; we're getting about 45 mins to an hour per frame on this particular file at about 14 nodes concurrent. At this rate our shot should finish in 4 days, I would probably have expected a day or less in the old days, but it is hard to compare since it has been a while.
> 
> I'm probably going to pause this particular render - based on the settings, it looks like it is optimized for gpu- and prioritize another shot from another artist. He's going to do preview quality render, so I'm hoping we can get a turnaround of a day, if that works out it is acceptable. 
> cheers
> Bassam
> 
> 
> On Fri, 2015-06-12 at 22:16 -0400, Thomas Helmuth wrote:
>> Yes, those long renders have been going for a few weeks I think. But, at a max of 40 launches, they haven't interfered too much with what I'm doing -- I can still get 80+ GP runs launched at once, which is good since I'm finishing up some experiments for my dissertation. If there's any change, the one that would help me the most is moving them to only (or primarily) use the ash nodes, since I can't use those myself. But, I don't consider them to be a problem, unless someone else needs to get some heavy use soon.
>> 
>> Tom
>> 
>> On Fri, Jun 12, 2015 at 10:11 PM, Chris Perry <perry at hampshire.edu <mailto:perry at hampshire.edu>> wrote:
>>> 
>>> Jordan seems to have spooled with a time limit of 2160, which yes is 36 hours per frame max though many seem to be finishing with fewer than that.
>>> 
>>> If this is hogging the farm too much, I think we could and should limit the Maxwell launches. Right now we’re at 40. I could lower it to 20 or so which will still give Jordan cycles but not at the expense of others needing to render.
>>> 
>>> LMK what you all think. If I can’t deal with this before I leave town (tomorrow), Josiah can definitely change the limit too.
>>> 
>>> - chris
>>> 
>>> 
>>> On Jun 12, 2015, at 9:21 PM, Bassam Kurdali <bassam at urchn.org <mailto:bassam at urchn.org>> wrote:
>>> 
>>> > I've noticed there are some renders on the farm that are taking a day a
>>> > frame (or more) running on 40 or so nodes - is there something wrong
>>> > with the farm or with these renders? They seem to be maxwell jobs.
>>> >
>>> > There's a few hundred frames left, so they would finish a few months
>>> > from now - assuming no-one else renders in that time frame.
>>> > Cheers
>>> > Bassam
>>> > _______________________________________________
>>> > Clusterusers mailing list
>>> > Clusterusers at lists.hampshire.edu <mailto:Clusterusers at lists.hampshire.edu>
>>> > https://lists.hampshire.edu/mailman/listinfo/clusterusers <https://lists.hampshire.edu/mailman/listinfo/clusterusers>
>>> 
>>> _______________________________________________
>>> Clusterusers mailing list
>>> Clusterusers at lists.hampshire.edu <mailto:Clusterusers at lists.hampshire.edu>
>>> https://lists.hampshire.edu/mailman/listinfo/clusterusers <https://lists.hampshire.edu/mailman/listinfo/clusterusers>
>>> 
>> 
> _______________________________________________
> Clusterusers mailing list
> Clusterusers at lists.hampshire.edu
> https://lists.hampshire.edu/mailman/listinfo/clusterusers

--
Lee Spector, Professor of Computer Science
Director, Institute for Computational Intelligence
Cognitive Science, Hampshire College
893 West Street, Amherst, MA 01002-3359
lspector at hampshire.edu, http://hampshire.edu/lspector/
Phone: 413-559-5352, Fax: 413-559-5438

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.hampshire.edu/pipermail/clusterusers/attachments/20150612/ea104d8c/attachment-0001.html>