a question about lingual FlowExample

65 views
Skip to first unread message

Mike Ma

unread,
Nov 6, 2013, 3:47:26 AM11/6/13
to lingua...@googlegroups.com
I download the code from https://github.com/Cascading/lingual/tree/wip-1.0/lingual-examples
and configure the enviroment in eclipse.

But when I run it, it throw the exception
could not build flow from assembly: [format: tcsv not available from provider]

Anyone could help me?
Thanks a lot!

Andre Kelpe

unread,
Nov 6, 2013, 7:15:04 AM11/6/13
to lingua...@googlegroups.com
Hi Mike,

can you paste the entire stacktrace? I tried to reproduce the problem,
but it works for me. Can you list all the steps you did?

Thanks!

- André
> --
> You received this message because you are subscribed to the Google Groups
> "Lingual User" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to lingual-user...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.



--
André Kelpe
an...@concurrentinc.com
http://concurrentinc.com

Mike Ma

unread,
Nov 10, 2013, 8:06:56 PM11/10/13
to lingua...@googlegroups.com

I download the src from github and create a new java project for "lingual-examples".

and add cascading and hadoop jar into the project.

Then I run the "FlowExample.java". It throws the exception..."format: tcsv not available from provider"





在 2013年11月6日星期三UTC+8下午4时47分26秒,Mike Ma写道:

Andre Kelpe

unread,
Nov 11, 2013, 6:29:06 AM11/11/13
to lingua...@googlegroups.com
Hi Mike,

I am afraid that I will only be able to help you, if you send me the entire stacktracke of the program.

- André


--
You received this message because you are subscribed to the Google Groups "Lingual User" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lingual-user...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Mike Ma

unread,
Nov 11, 2013, 7:42:51 PM11/11/13
to lingua...@googlegroups.com
The following part is what printed in console of eclipse.
Thanks for your help!

2013-11-12 08:40:36,990 INFO  [main] platform.PlatformBrokerFactory (PlatformBrokerFactory.java:addPlatform(135)) - installing platform: local
2013-11-12 08:40:37,170 INFO  [main] service.FileCatalogService (FileCatalogService.java:openSchemaCatalog(82)) - reading catalog from: C:\Users\guoma\workspaceCascadingGuide\CascadingLingual\.lingual\catalog
2013-11-12 08:40:37,171 INFO  [main] service.FileCatalogService (FileCatalogService.java:openSchemaCatalog(88)) - catalog not found at: C:\Users\guoma\workspaceCascadingGuide\CascadingLingual\.lingual\catalog
2013-11-12 08:40:37,704 INFO  [main] tap.TapSchema (TapSchema.java:addTapTableFor(125)) - adding table on schema: example, table: employee, fields: 'EMPID', 'NAME' | int, String, identifier: src/main/resources/data/example/employee.tcsv
2013-11-12 08:40:37,721 INFO  [main] tap.TapSchema (TapSchema.java:addTapTableFor(125)) - adding table on schema: example, table: sales_fact_1997, fields: 'CUST_ID', 'PROD_ID' | int, int, identifier: src/main/resources/data/example/sales_fact_1997.tcsv
2013-11-12 08:40:37,723 INFO  [main] tap.TapSchema (TapSchema.java:addTapTableFor(125)) - adding table on schema: null, table: results, fields: UNKNOWN, identifier: build/test/output/flow/results.tcsv
2013-11-12 08:40:39,553 WARN  [main] local.LocalPlatformBroker (LocalPlatformBroker.java:getTempPath(207)) - neither TEMPDIR or TMPDIR is set, using '/tmp' as the temporary data path
2013-11-12 08:40:39,557 INFO  [main] catalog.SchemaDef (SchemaDef.java:findAllFormatProperties(360)) - no provider set for format: tcsv, in schema: null
Exception in thread "main" cascading.flow.planner.PlannerException: could not build flow from assembly: [format: tcsv not available from provider]
at cascading.flow.planner.FlowPlanner.handleExceptionDuringPlanning(FlowPlanner.java:576)
at cascading.flow.local.planner.LocalPlanner.buildFlow(LocalPlanner.java:108)
at cascading.flow.local.planner.LocalPlanner.buildFlow(LocalPlanner.java:40)
at cascading.flow.FlowConnector.connect(FlowConnector.java:459)
at main.java.cascading.lingual.examples.foodmart.FlowExample.run(FlowExample.java:69)
at main.java.cascading.lingual.examples.foodmart.FlowExample.main(FlowExample.java:40)
Caused by: java.lang.IllegalStateException: format: tcsv not available from provider
at cascading.lingual.catalog.SchemaDef.findAllFormatProperties(SchemaDef.java:363)
at cascading.lingual.catalog.SchemaDef.getFormatProperty(SchemaDef.java:324)
at cascading.lingual.catalog.FormatProperties.findExtensionFor(FormatProperties.java:38)
at cascading.lingual.optiq.enumerable.CascadingFlowRunnerEnumerable.createResultResource(CascadingFlowRunnerEnumerable.java:299)
at cascading.lingual.optiq.enumerable.CascadingFlowRunnerEnumerable.createEnumerator(CascadingFlowRunnerEnumerable.java:182)
at cascading.lingual.optiq.enumerable.CascadingFlowRunnerEnumerable.enumerator(CascadingFlowRunnerEnumerable.java:132)
at net.hydromatic.optiq.jdbc.OptiqPrepare$PrepareResult.enumerator(OptiqPrepare.java:203)
at cascading.lingual.flow.SQLPlanner.resolveTails(SQLPlanner.java:115)
at cascading.flow.planner.FlowPlanner.resolveAssemblyPlanners(FlowPlanner.java:150)
at cascading.flow.planner.FlowPlanner.resolveTails(FlowPlanner.java:137)
at cascading.flow.local.planner.LocalPlanner.buildFlow(LocalPlanner.java:81)
... 4 more

在 2013年11月11日星期一UTC+8下午7时29分06秒,Andre Kelpe写道:

Mike Ma

unread,
Nov 12, 2013, 1:28:15 AM11/12/13
to lingua...@googlegroups.com
Hi André,
    I downloaded the jar from maven. Now "FlowExample.java" works  for me. Amazing...
    But "JdbcExample.java" still doesn`t work for me.
    
    the following is stacktrack, how to resolve it?
    Thanks!
     
    13/11/12 14:14:36 INFO jdbc.LingualConnection: using platform: local
    13/11/12 14:14:36 INFO jdbc.LingualConnection: using default schema
    13/11/12 14:14:36 INFO platform.PlatformBrokerFactory: installing platform: local
    13/11/12 14:14:36 INFO service.FileCatalogService: reading catalog from: C:\Users\guoma\workspaceCascadingGuide\LingualMaven\.lingual\catalog
    13/11/12 14:14:36 INFO service.FileCatalogService: catalog not found at: C:\Users\guoma\workspaceCascadingGuide\LingualMaven\.lingual\catalog
    13/11/12 14:14:36 ERROR platform.PlatformBroker: error starting connection
java.lang.IllegalArgumentException: Illegal character in opaque part at index 2: C:\Users\guoma\workspaceCascadingGuide\LingualMaven\src\main\resources\data\example
at java.net.URI.create(URI.java:859)
at cascading.lingual.platform.PlatformBroker.createSchemaNameFrom(PlatformBroker.java:628)
at cascading.lingual.catalog.SchemaCatalogManager.createSchemaDefAndTableDefsFor(SchemaCatalogManager.java:238)
at cascading.lingual.catalog.SchemaCatalogManager.createSchemaDefAndTableDefsFor(SchemaCatalogManager.java:223)
at cascading.lingual.platform.PlatformBroker.loadTransientSchemas(PlatformBroker.java:672)
at cascading.lingual.platform.PlatformBroker.loadCatalogManager(PlatformBroker.java:389)
at cascading.lingual.platform.PlatformBroker.getCatalogManager(PlatformBroker.java:270)
at cascading.lingual.platform.PlatformBroker.startConnection(PlatformBroker.java:174)
at cascading.lingual.jdbc.LingualConnection.initialize(LingualConnection.java:128)
at cascading.lingual.jdbc.LingualConnection.<init>(LingualConnection.java:80)
at SC.<init>(Unknown Source)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at cascading.lingual.jdbc.JaninoFactory.create(JaninoFactory.java:148)
at cascading.lingual.jdbc.JaninoFactory.createConnection(JaninoFactory.java:45)
at cascading.lingual.jdbc.Driver.connect(Driver.java:172)
at java.sql.DriverManager.getConnection(DriverManager.java:571)
at java.sql.DriverManager.getConnection(DriverManager.java:233)
at lingual.LingualMaven.JdbcExample.run(JdbcExample.java:17)
at lingual.LingualMaven.JdbcExample.main(JdbcExample.java:11)
Caused by: java.net.URISyntaxException: Illegal character in opaque part at index 2: C:\Users\guoma\workspaceCascadingGuide\LingualMaven\src\main\resources\data\example
at java.net.URI$Parser.fail(URI.java:2829)
at java.net.URI$Parser.checkChars(URI.java:3002)
at java.net.URI$Parser.parse(URI.java:3039)
at java.net.URI.<init>(URI.java:595)
at java.net.URI.create(URI.java:857)
... 21 more
13/11/12 14:14:36 ERROR jdbc.LingualConnection: connection failed: java.lang.IllegalArgumentException: Illegal character in opaque part at index 2: C:\Users\guoma\workspaceCascadingGuide\LingualMaven\src\main\resources\data\example (provider Cascading [local Concurrent, Inc.] error code 0).
13/11/12 14:14:36 ERROR jdbc.LingualConnection: connection URL: 
13/11/12 14:14:36 ERROR jdbc.LingualConnection: read catalog from: C:\Users\guoma\workspaceCascadingGuide\LingualMaven\.lingual\catalog




在 2013年11月11日星期一UTC+8下午7时29分06秒,Andre Kelpe写道:

Andre Kelpe

unread,
Nov 12, 2013, 11:19:25 AM11/12/13
to lingua...@googlegroups.com
Hi,

this looks like a bug caused by the fact that windows path-names contain colons and the JDBC driver is not  handling this properly. We will have to investigate this.

- André

Joe Posner

unread,
Nov 12, 2013, 4:40:35 PM11/12/13
to lingua...@googlegroups.com
This should be fixed in the wip version that just went live. See https://github.com/Cascading/lingual/issues/9

Mike Ma

unread,
Nov 13, 2013, 7:58:54 PM11/13/13
to lingua...@googlegroups.com
Got it and thanks, Andre!

在 2013年11月13日星期三UTC+8上午5时40分35秒,Joe Posner写道:
Reply all
Reply to author
Forward
0 new messages