[scalding] name the steps

[Hagai Attias]

Hi,

How is it possible to supply a meaningful name to the mr steps, instead of the default name of step_num/num_of_steps .

I'm using the Typed API with scalding 0.13.1.

Thanks,

Hagai.

[Ken Krugler]

Hi Hagai,

I don’t know the best way to do this with Scalding, sorry.

We do have a nameFlowStep method in the cascading.utils project.

Typically we call this via FlowUtils.nameFlowSteps.

— Ken

--
You received this message because you are subscribed to the Google Groups "cascading-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to cascading-use...@googlegroups.com.
To post to this group, send email to cascadi...@googlegroups.com.
Visit this group at https://groups.google.com/group/cascading-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/cascading-user/acaf4303-87a0-44a1-a29c-86d87ac2fca6%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--------------------------

Ken Krugler

+1 530-210-6378

http://www.scaleunlimited.com

custom big data solutions & training

Hadoop, Cascading, Cassandra & Solr

[td...@foursquare.com]

In more recent versions of Scalding, call .withDescription on a TypedPipe.

[Hagai Attias]

Which version are you using? I upgraded to 0.15.0 but still don't have that method on a TypedPipe

[Thomas Dyas]

0.15.1-RC13

> --
> You received this message because you are subscribed to a topic in the
> Google Groups "cascading-user" group.
> To unsubscribe from this topic, visit
> https://groups.google.com/d/topic/cascading-user/M73WBgI30Lw/unsubscribe.
> To unsubscribe from this group and all its topics, send an email to

> cascading-use...@googlegroups.com.
> To post to this group, send email to cascadi...@googlegroups.com.
> Visit this group at https://groups.google.com/group/cascading-user.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/cascading-user/60dbb92e-3554-4ced-aa54-811c06cb3441%40googlegroups.com.

[Hagai Attias]

Thanks. So where should the description appear? in Driven I still see the steps as numbers.

[Thomas Dyas]

I've never used Driven, so I don't know.

> https://groups.google.com/d/msgid/cascading-user/117909c9-a8d9-46d1-abd3-bdacdcd06233%40googlegroups.com.

[Bob Taylor]

In case you want to try it.

http://www.driven.io/choose-trial/

http://showcase.driven.io/index.html#/login

[Hagai Attias]

Thanks Thomas, so where should the steps description appear after I used .withDescription?

Also, is it possible to control the steps numbering ? I see an incnosistent numbering between different executions.