Indeed this error indicates that a NaN value was encountered. Most frequently this error is caused when dividing by zero, so I'd have a look at your equations for that aspect, and ensure that your generated systems wouldn't cause those. I think an overflow is less likely to generate it.
If you have a very wide range of parameter values (really small ones, and really big ones), you'd be more likely to get errors about the maximal number of steps being insufficient.
Feel free to send me a model, and i could have a look as to why this is the case there.
best
Frank