RR behavior with husk
Francois Lord
I'm still trying to understand how RR behaves sometimes.
I launched a big render while nothing else was rendering in the farm. It was 795 frames, taking between 25 to 40 minutes per frame to render, sequence divide was set to 1-1 (one frame per machine).
RR launched the render on all available clients. Some misconfigured clients failed at the beginning but then around 200 clients continued rendering at a steady pace for 2 hours. During that time, many frames were aborted because artists logged on clients during working hours. Then the number of active clients started declining over the course of 40 minutes to eventually reach zero clients on the job. At that point, RR realized some frames were not rendered, so it launched those frames on over 100 clients. Then the number of clients declined again and finally 2 clients were activated for the last 2 frames remaining.
There was no other job in the farm. It was the only one. This render could have completed in 2.5 hours but it took 4.5 hours instead. This happens all the time with the Houdini husk renders (Karma and Arnold). When the number of clients started declining, I looked at the "Show send job to client decision" and it said there were no frames left to render, when clearly there were many frames left to render.
Why is it behaving like that? Why is it not retrying aborted frames immediately?
F
Francois Lord
We can also see on the Job Log that all aborted frames have been restarted at the same time, at 15:58. But there were many clients available before that time.
F
--
If you reply, the message is send to the user group which is sufficient and desired.
("Reply All" might send the message twice to the last author which is not required.
Replying "in private" prevents other users to see the answers and might not be seen by the single receiver if he has email rules in place.
If you want to talk to us in private, please use support (at) RoyalRender instead)
---
You received this message because you are subscribed to the Google Groups "Royal Render Knights Tavern" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rrKnights+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/rrKnights/eebf27f4-c248-4103-b318-86f1a471fdaa%40gmail.com.
RR, Schoenberger
Hi
Usually RR should re-render the frames directly.
I just tested to delete a finished frames of a job that is currently rendering and it was picked up after the next job check.
I know that there had been issues in the past if the aborted frames had a file size (which means it existed for the rrServer)
but an image file loader failed and deleted the frames (post-script Sequence Check)
So the issue seems to be that it states “and it said there were no frames left to render, when clearly there were many frames left to render.”
I have to take a look at the jobs frame table at the time it happens.
When you see this case the next time, pleaae select the job (or multiple) in rrControl.
Then execute "Export debug info - selected job(s)" via the menu "Debug".
Please upload via www.RoyalRender.de/upload_r.php
regards,
Holger Schönberger
Craftsman and Keeper of the Royal Render Flame
Please use the rrKnights Tavern
or our support system for new questions.
Francois Lord
I launched the same job again.
Frame 1034 was aborted after 15% completion. Here is what it looks like on disk.
RR has begun freeing clients and this frame is still not rendering. I'm using RR 9.1.21.
F
--
If you reply, the message is send to the user group which is sufficient and desired.
("Reply All" might send the message twice to the last author which is not required.
Replying "in private" prevents other users to see the answers and might not be seen by the single receiver if he has email rules in place.
If you want to talk to us in private, please use support (at) RoyalRender instead)
---
You received this message because you are subscribed to the Google Groups "Royal Render Knights Tavern" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rrKnights+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/rrKnights/001001dc5ac5%248bad4d80%24a307e880%24%40RoyalRender.de.
Francois Lord
I sent the job debug data to sup...@royalrender.de.
To view this discussion visit https://groups.google.com/d/msgid/rrKnights/fb27edd4-c8e0-4d3a-8b46-3bebc3821e73%40gmail.com.
Royal Render Knights Tavern
I have seen it, but there is not enough time left to analyse the files today.
RR, Schoenberger
There seems to be an issue with the cleanup of the 112 bytes placeholder files.
I can see that the aborted render logs state that the placeholder file was found after the render process closed.
But no delete.
It will be investigated.
Do you know why the Setting “Local Render Out” was deactivated?
This would solve the issue.
Francois Lord
We deactivate the local render out for 2 reasons.
The first one is because when rendering with Arnold, we set the tile order to "top". This allows Nuke to load the _part files that are created during rendering. In turn, this allows users to preview all currently rendering images.
The second reason is because we really want to figure out a way to use the checkpointing feature of both Arnold and Karma. There is nothing more frustrating than waiting for the last frames of a render and seeing one being restarted because someone logged in on a client.
Thanks for checking into this.
F
--
If you reply, the message is send to the user group which is sufficient and desired.
("Reply All" might send the message twice to the last author which is not required.
Replying "in private" prevents other users to see the answers and might not be seen by the single receiver if he has email rules in place.
If you want to talk to us in private, please use support (at) RoyalRender instead)
---
You received this message because you are subscribed to the Google Groups "Royal Render Knights Tavern" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rrKnights+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/rrKnights/000801dc5d53%24a5c56c80%24f1504580%24%40RoyalRender.de.