Subject: Gobblin As Service Question.
Hey Guys,
I have spend some time looking at the gobblin service code, I did also start the gobblin as service but could not get it working fully yet.
I can check from the code that GobblinServiceManager being the bootstrap class for the gobblin service, it creates the following Catalogs
- Topology Catalog.
- Flow Catalog.
- Template Catalog.
From the naming conventions it seems that the template catalog might be storing the job templates, I guess the gobblin job templates need to be defined at location defined at gobblin.service.templateCatalogs.fullyQualifiedPath property.
I am yet not able to make from the code how the end user will make the explicit calls to the Gobblin service node? I am not sure if we can invoke jobs explicitly using rest endpoint or we need to rely on the scheduling, the jobs defined in the template will be triggered automatically using the flow controllers in the gobblin cluster.
The use case that I am trying is to make the explicit job calls via the REST interface, I have these questions
1) How can we configure the specific rest port for gobblin service?
2) How can we trigger the specific jobs via the rest endpoint as defined in 1?
3) What will be the impact of adding more gobblin service nodes, it seems the nodes will get added to the topology and then the user can trigger a job from any of the nodes in the rest endpoint? What value do we get by adding more nodes to the cluster?
Regards,
Vicky