[scalding]: checking for NaN values

10 views
Skip to first unread message

SK

unread,
Apr 16, 2014, 5:38:34 PM4/16/14
to cascadi...@googlegroups.com
I have a dataset containing a field with Double values. Some of these values are NaN. This dataset was generated by another scalding program.
 I tried to filter out the rows with NaN values using filter('val){val:Double => val != NaN). However, the compiler does not recognize NaN. I also tried comparing against  "NaN", but the compiler complains about comparing a Double with a String. What is the right way to compare with NaN values in scalding?

thanks

Ian O'Connell

unread,
Apr 16, 2014, 5:39:06 PM4/16/14
to cascadi...@googlegroups.com
.isNan ? 


--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at http://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/ff7e036d-5dfd-45f0-90bb-4909a8148e13%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Oscar Boykin

unread,
Apr 16, 2014, 5:50:38 PM4/16/14
to cascadi...@googlegroups.com
Reply all
Reply to author
Forward
0 new messages