Re: run cluster with tagged peers

19 views
Skip to first unread message

Mike Drogalis

unread,
Dec 13, 2017, 11:11:41 AM12/13/17
to Евгений Соловьев, Onyx
Do your peers run with a peer configuration denoting that they have the appropriate tags to run tasks in your job?

On Wed, Dec 13, 2017 at 1:30 AM, Евгений Соловьев <elizave...@gmail.com> wrote:
I have next conf:

catalog
[{...
:onyx/name :in
:onyx/type :input
:onyx/required-tags [:http]
...}

{...
:onyx/name :printer
:onyx/type :function
;; without tags
...}

{...
:onyx/name :out
:onyx/type :output
:onyx/required-tags [:store]
...}]

peer-config
{ ...
:onyx.peer/tags [:http :store]
:onyx.peer/job-scheduler :onyx.job-scheduler/balanced
...
}

my-group (onyx.api/start-peer-group peer-config)
v-peers (onyx.api/start-peers 5 my-group)

submission (onyx.api/submit-job peer-config
{:catalog catalog
:workflow (onyx.api/map-set-workflow->workflow
{:in #{:printer}
:printer #{:out}})
:lifecycles []
:task-scheduler :onyx.task-scheduler/balanced
:metadata {:job-id :job-id}})


when run job, i recieve error like:

[onyx.log.commands.submit-job:91] - Job ID :job-id has been submitted with tenancy ID :cluster-test-id, but received no virtual peers to start its execution.
                     
Tasks each require at least one peer to be started, and may require more if :onyx/n-peers or :onyx/min-peers is set.
                     
If you were expecting your job to start now, either start more virtual peers or choose a different job scheduler, or wait for existing jobs to finish.

Why job can't starts?

--
You received this message because you are subscribed to the Google Groups "Onyx" group.
To unsubscribe from this group and stop receiving emails from it, send an email to onyx-user+unsubscribe@googlegroups.com.
To post to this group, send email to onyx...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/edccc276-4746-4f3e-88de-b6f2a7351338%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages