Redshift crashing on specific frames

[Tony Bexley]

Using RR 8.4.03

I'm getting a crash when I render frame 202 of my scene, but only on the redshift render nodes. If I open c4d locally and render it's fine. I submitted the scene to the redshift support and apparently it renders ok for them too with command line.  I

I get the following royal render error for R272-R880

R272| CRITICAL: Stop [genesis\ge_container.h(341)]

 and it crashes around block 20/60 when get an error n the redshift logs that says:

    Block 20/60 (2,2) rendered by GPU 0 in 27067ms
11:03:15   4713MB ERROR:        
======================================================================================================
ASSERT FAILED

File RayTracer_PackUnpack.cpp
Line 992

The SSS sample count computed in these kernels (969119) does not match the count passed in by the shaders (969120)
======================================================================================================
 

Is there a way to get the BIN file from the redshift crash? I added  A40__Redshift_StdA__inhouse.inc but it gives me the log and not the BIN file from a crash. 

Thank you!

-Tony

[Tony Bexley]

Here's some of the job log

R873| CRITICAL: Stop [genesis\ge_container.h(341)]
R874| CRITICAL: Stop [genesis\ge_container.h(341)]
R875| CRITICAL: Stop [genesis\ge_container.h(341)]
R876| CRITICAL: Stop [genesis\ge_container.h(341)]
R877| CRITICAL: Stop [genesis\ge_container.h(341)]
R878| CRITICAL: Stop [genesis\ge_container.h(341)]
R879| CRITICAL: Stop [genesis\ge_container.h(341)]
R880| CRITICAL: Stop [genesis\ge_container.h(341)]
R881| Rendering frame 202 at <Tue Dec  6 10:54:11 2022>
R882|  
R883| >"C:\Program Files\rrService\lc64\rrCheckexitcode.exe" -536870911 0 1 202  
R884| ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
R885| ++  Dec 06. 11:03.28  Render executable closed    ++++++++++++++++++++++++++++++++++++++++++++++++++++
R886| ++  Royal Render checks the return code of the executable or the OS    +++++++++++++++++++++++++++++++
R887| ++  Executable returned -536870911 (0xe0000001) as exit code for frame 202 (jobthread 1).    +++++++++
R888| ++  Error COULD be:   ERROR code -536870911. (No system message found)    ++++++++++++++++++++++++++++
R889| ++  => Executable crashed    +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
R890| ++   8.3.05    +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
R891| ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++  
R892| >"\\ROYALRENDER2\RoyalRender\bin\win64\rrKillWait" 1 QTGUIAGENT true  
R893| ||rrKillWait||  wait 0.2s for QTGUIAGENT.EXE. thisProcessGroup.
R894| ||rrKillWait|| found parent process ... (ID 8544   CMD.EXE)
R895|  
R896|  +++++++++++++++++++++++++ All commandlines executed +++++++++++++++++++++++++++++++++++
R897|  +++++ Renderking  rrClient  8.4.02    rrVer8.4.02      Support expires 18.Dec
R898|  +++++ 11:03:28.66
R899|  +++++  Job ID: {F+A }
R900|  +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
R901|  
R902|  
R903|  
R904|  
R905| Current time:Dec 06. 11:03.31
R906| Total processing time: 00:10.54 h:m.s
R907| Max memory usage: 5.5GB (of 63GB installed, total system usage at same time: 14.0GB.   Dec 06. 11:01.39)
R908| Max CPU usage: 69%   19.3 of 28 cores    (total system usage at same time: 0.0.   Dec 06. 10:53.42)
R909| Max GPU usage:99%  1.0 GPUs (of 1 GPUs assigned to this thread.  Max system GPU usage at same time: 2.0/2. Dec 06. 11:00.13)
R910| Max GPU memory usage: 21.6GB (of 2GB installed. Dec 06. 10:56.39)
R911| .
R912| ************************* LOCAL RENDER INFORMATION *************************
R913| Total render files found:     0
R914| Files successful copied:      0
R915| Files broken/not copied:      0
R916| Total render files found (main pass only):     0
R917|  FrNr mCXRFV:    FSize  CopySpeed      Filename    ('mCXRFV' legend:  m=main  C=copied   R=successfully read   X=Exr cropped   F=image verify fail   V=rrViewer cache created)
R918| ************************* CLIENT REPORTS DURING THIS RENDER *************************
R919| Frame pre-processing time: 00.46 m.s
R920|  
R921| Error found in this log file (361): WARNING: Error loading file:///C:/RR_localdata/renderer_plugins/cinema 4d/win_x64/26/INSYDIUM/INSYDIUM.xdl64: symbol 'g_maxon' is missing. [win_dll.cpp(396)] [general.cpp(485)]
R922| Error found in this log file (1119): ++  Error COULD be:   ERROR code -536870911. (No system message found)    ++++++++++++++++++++++++++++
R923| Error found in sep(arate)  log file (94): <div class="ERROR vistoggle"><a href="javascript: toggleVisibilityByClass('ERROR')">hide ERROR</a></div><div class="ERROR vistoggle" style="display:none;"><a href="javascript: toggleVisibilityByClass('ERROR')">show ERROR</a></div>
R924| Error found in sep(arate)  log file (543): <div class="ERROR line"><div>11:03:15   4713MB ERROR:        </div><div><b><font color="white"><span style="background-color: red">======================================================================================================
R925|  
R926| **** Warning: No new frame found! ****
R927| Error: Job crashed
R928|  
R929| 

[RR, Schoenberger]

Hi

 

To get the .bin file, please enable  ‘Debug Capture’ option in the Redshift ‘System’ tab.

Then select the rrJob in rrControl, tab Settings.  Verify that Local Render Out is disabled.

 

Login at a client and let the client get the frame.
Once it got the job (rrClient tray icon green), abort it.

 

Open folder C:\RR_LocalData\ and start the file C_.....bat.

Open the folder  C:\RR_LocalData\Temp\A\Redshift\Log\Log.Latest.0\

The log file html and bin files should be saved into that folder.

 

 

regards,
Holger Schönberger

 

Please use the rrKnights Tavern
or our support system for new questions.

[Tony Bexley]

Hey Holger,

I tried that process and it still didn't give me a bin from the redshift crash.  Was looking in 'C:\RR_localdata\temp\A\Redshift\Log\Log.Latest.0' and the log file is there I already have given to the redshift devs w/ the same error as before but no bin file

Any thoughts?

[RR, Schoenberger]

Hi

 

Did Redshift/MAXON provide some more information where the .bin file is saved?
Beside „Enable the bin in render settings„ and „ist located beside the log file“.

 

Note that RR set the env var REDSHIFT_LOCALDATAPATH to specify the log folder location.

( Which results in REDSHIFT_LOCALDATAPATH\Log\Log.Latest.0 )

 

 

 

PS: 
Note that it is possible to enable Windows crash dump files (rrWorkstationInstaller menu).

I do not know if they work as I do not know what dump settings Redshift changes, but perhaps it helps.