Parsing from Scala Repl

[Jeremy Davis]

Hello,

I was just trying out the Scala REPL, and ran in to an issue while parsing a file.

I tracked the issue down to csv(default) vs tsv.

I can't quite manage to track back from the scala parse method to (where I assume) I will be able to set the separator char.

-JD

java.util.IllegalFormatConversionException: d != java.lang.Double

at java.util.Formatter$FormatSpecifier.failConversion(Formatter.java:4302)

at java.util.Formatter$FormatSpecifier.printInteger(Formatter.java:2793)

at java.util.Formatter$FormatSpecifier.print(Formatter.java:2747)

at java.util.Formatter.format(Formatter.java:2520)

at java.util.Formatter.format(Formatter.java:2455)

at java.lang.String.format(String.java:2925)

at water.fvec.Frame.toString(Frame.java:457)

at water.api.dsl.Utils$$anonfun$head$1.apply(Utils.scala:62)

at water.api.dsl.Utils$$anonfun$head$1.apply(Utils.scala:62)

at scala.collection.immutable.NumericRange.foreach(NumericRange.scala:74)

at water.api.dsl.Utils$.head(Utils.scala:62)

at water.api.dsl.DFrame.toString(H2ODsl.scala:174)

at scala.runtime.ScalaRunTime$.scala$runtime$ScalaRunTime$$inner$1(ScalaRunTime.scala:324)

at scala.runtime.ScalaRunTime$.stringOf(ScalaRunTime.scala:329)

at scala.runtime.ScalaRunTime$.replStringOf(ScalaRunTime.scala:337)

at .<init>(<console>:10)

at .<clinit>(<console>)

at $print(<console>)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:483)

at scala.tools.nsc.interpreter.IMain$ReadEvalPrint.call(IMain.scala:734)

at scala.tools.nsc.interpreter.IMain$Request.loadAndRun(IMain.scala:983)

at scala.tools.nsc.interpreter.IMain.loadAndRunReq$1(IMain.scala:573)

at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:604)

at scala.tools.nsc.interpreter.IMain.interpret(IMain.scala:568)

at scala.tools.nsc.interpreter.ILoop.reallyInterpret$1(ILoop.scala:756)

at scala.tools.nsc.interpreter.ILoop.interpretStartingWith(ILoop.scala:801)

at scala.tools.nsc.interpreter.ILoop.command(ILoop.scala:713)

at scala.tools.nsc.interpreter.ILoop.processLine$1(ILoop.scala:577)

at scala.tools.nsc.interpreter.ILoop.innerLoop$1(ILoop.scala:584)

at scala.tools.nsc.interpreter.ILoop.loop(ILoop.scala:587)

at scala.tools.nsc.interpreter.ILoop$$anonfun$process$1.apply$mcZ$sp(ILoop.scala:878)

at scala.tools.nsc.interpreter.ILoop$$anonfun$process$1.apply(ILoop.scala:833)

at scala.tools.nsc.interpreter.ILoop$$anonfun$process$1.apply(ILoop.scala:833)

at scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135)

at scala.tools.nsc.interpreter.ILoop.process(ILoop.scala:833)

at water.api.dsl.ShalalaRepl$.launchRepl(ShalalaRepl.scala:47)

at water.api.dsl.ShalalaRepl$.userMain(ShalalaRepl.scala:31)

at water.api.dsl.ShalalaRepl.userMain(ShalalaRepl.scala)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:483)

at water.Boot.run(Boot.java:304)

at water.Boot.boot2(Boot.java:280)

at water.Boot.main(Boot.java:136)

at water.Boot.main(Boot.java:126)

at water.api.dsl.ShalalaRepl$.main(ShalalaRepl.scala:26)

at water.api.dsl.ShalalaRepl.main(ShalalaRepl.scala)

[Sri]

Hi Jeremy,

Apologies for the delay responding. We got slammed today on a couple of fronts and did not get around to reproduce this yet.

From your comment it seems like this happens with any tsv file?

Thanks,
Sri

--
You received this message because you are subscribed to the Google Groups "H2O Users - h2ostream" group.
To unsubscribe from this group and stop receiving emails from it, send an email to h2ostream+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Jeremy Davis]

I had assumed so, but trying to repro with a very simple .tsv of course works.

I'm happy to post a sample somewhere.

[mic...@0xdata.com]

Hi Jeremy,

please apologize my delayed response.

May you share a sample here, or in dropbox. 

It would help me to solve the issue.

Thank you for trying Shalala and giving us feedback!

michal

[mic...@0xdata.com]

Hi Jeremy,

one more update:

  - it seems that dataset was parsed correctly, but the exception was thrown during printing dataset 

to a console. Now i am tracking bug in our console pretty printer.

Michal

[Jeremy Davis]

The dataset is part of a hadoop run. The one file is on the order of 100Mb uncompressed and 1000 columns. Also not something I can share publicly. We will have to set up a private exchange.

-JD

[mic...@0xdata.com]

Hi Jeremy,

oki, can we switch to private e-mail conversation and share the data via Dropbox?

Thank you,

Michal

[mic...@0xdata.com]

Hi Jeremy,

the bug is already fixed in master repository - see https://0xdata.atlassian.net/browse/PUB-200

Let me know if you have any other questions or issues.

Thank you!

michal