Onyx Template Structure

91 views

Skip to first unread message

Punit Naik

unread,

Mar 10, 2016, 2:04:36 AM3/10/16

to Onyx

The program structure generated by onyx-app is very confusing to me. I want to write a very basic program like a wordcount or something. Could anyone please provide me the most basic (working) program structure so that I can start off? Then I can create a more sophisticated structure based on my needs which will be built on top of this basic structure.

Mike Drogalis

unread,

Mar 10, 2016, 10:09:40 AM3/10/16

to Punit Naik, Onyx

Hi Punit,

Beyond the Onyx application template, there is:

- onyx-starter

- onyx-examples

- learn-onyx

Onyx is relatively disassembled out of the box, leaving a lot of power in your hands to put things together as you please. onyx-starter is probably your best bet if you're looking for the easiest ready-to-run example.

On Wed, Mar 9, 2016 at 11:04 PM, Punit Naik <naik.p...@gmail.com> wrote:

The program structure generated by onyx-app is very confusing to me. I want to write a very basic program like a wordcount or something. Could anyone please provide me the most basic (working) program structure so that I can start off? Then I can create a more sophisticated structure based on my needs which will be built on top of this basic structure.

--
You received this message because you are subscribed to the Google Groups "Onyx" group.
To unsubscribe from this group and stop receiving emails from it, send an email to onyx-user+...@googlegroups.com.
To post to this group, send email to onyx...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/3d3f5b6a-8a2f-474a-a7fe-abbb893238aa%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Punit Naik

unread,

Mar 11, 2016, 6:36:57 AM3/11/16

to Onyx, naik.p...@gmail.com

Hi Mike

I cloned the 'onyx-starter' repo and then modified it to run a wordcount job. But when I ran it I got this errro:

16-Mar-11 17:03:32 punit-HP-15-Notebook-PC ERROR [onyx.api] - 
                                 clojure.core/eval                          core.clj: 3081
                                               ...                                        
                                    user/eval22369  form-init1996063950130676016.clj:    1
onyx-starter.launcher.submit-sample-job/submit-job             submit_sample_job.clj:   29
                               onyx.api/submit-job                           api.clj:  141
                               onyx.api/submit-job                           api.clj:  143
                            onyx.api/submit-job/fn                           api.clj:  144
               onyx.static.validation/validate-job                    validation.clj:  185
           onyx.static.validation/validate-catalog                    validation.clj:   83
        onyx.static.validation/validate-catalog/fn                    validation.clj:   90
                              clojure.core/ex-info                          core.clj: 4593
clojure.lang.ExceptionInfo: Task :count-words failed validation. Error: {{:cause "Unsupported combination of task-map keys.", :key :onyx/flux-policy, :documentation {:type :keyword, :choices [:kill :continue :recover], :tags [:aggregation :grouping :windows], :restrictions ["`:onyx/min-peers` or `:onyx/n-peers` must also be defined for this catalog entry. If `:recover` is used, then `:onyx/max-peers` or `:onyx/n-peers`` must also be defined. "], :optionally-allowed-when ["`:onyx/type` is set to `:function` or `:output`" "`:onyx/group-by-key` or `:onyx/group-by-fn` is set."], :added "0.8.0"}} invalid-key}
    data: {:explanation {{:cause "Unsupported combination of task-map keys.", :key :onyx/flux-policy, :documentation {:type :keyword, :choices [:kill :continue :recover], :tags [:aggregation :grouping :windows], :restrictions ["`:onyx/min-peers` or `:onyx/n-peers` must also be defined for this catalog entry. If `:recover` is used, then `:onyx/max-peers` or `:onyx/n-peers`` must also be defined. "], :optionally-allowed-when ["`:onyx/type` is set to `:function` or `:output`" "`:onyx/group-by-key` or `:onyx/group-by-fn` is set."], :added "0.8.0"}} invalid-key}}

ExceptionInfo Task :count-words failed validation. Error: {{:cause "Unsupported combination of task-map keys.", :key :onyx/flux-policy, :documentation {:type :keyword, :choices [:kill :continue :recover], :tags [:aggregation :grouping :windows], :restrictions ["`:onyx/min-peers` or `:onyx/n-peers` must also be defined for this catalog entry. If `:recover` is used, then `:onyx/max-peers` or `:onyx/n-peers`` must also be defined. "], :optionally-allowed-when ["`:onyx/type` is set to `:function` or `:output`" "`:onyx/group-by-key` or `:onyx/group-by-fn` is set."], :added "0.8.0"}} invalid-key}  clojure.core/ex-info (core.clj:4593)

What must be the problem?

Lucas Bradstreet

unread,

Mar 11, 2016, 9:09:18 AM3/11/16

to Punit Naik, Onyx

Hi Punit,

Could you please try reading the error that was thrown, starting with:

clojure.core/ex-info core.clj: 4593

clojure.lang.ExceptionInfo:

And let me know what is unclear about it? I think the error message gives a pretty good explanation, and also prints some relevant documentation for ease of use.

Thanks,

Lucas

To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/d3c4bbdb-739a-45e6-84e1-573045cdf52b%40googlegroups.com.

Punit Naik

unread,

Mar 11, 2016, 9:20:41 AM3/11/16

to Onyx

Hi Lucas

Yes the error stacktrace has properly defined the error's cause but then I have the correct combination of task-map keys. Still it is shoeing that error.

Mike Drogalis

unread,

Mar 11, 2016, 9:55:48 AM3/11/16

to Punit Naik, Onyx

Can you please show your catalog?

On Fri, Mar 11, 2016 at 6:20 AM, Punit Naik <naik.p...@gmail.com> wrote:

Hi Lucas

Yes the error stacktrace has properly defined the error's cause but then I have the correct combination of task-map keys. Still it is shoeing that error.

--
You received this message because you are subscribed to the Google Groups "Onyx" group.
To unsubscribe from this group and stop receiving emails from it, send an email to onyx-user+...@googlegroups.com.
To post to this group, send email to onyx...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/29128762-abfd-41c0-8c75-3cc706d39e7b%40googlegroups.com.

Punit Naik

unread,

Mar 14, 2016, 1:11:28 AM3/14/16

to Onyx, naik.p...@gmail.com

Hi Mike

I so sorry to say that I had a typo above the key ':onyx/flux-policy'. So it considered all the subsequent lines as erroneous. I feel like an idiot.

Anyways, I corrected my mistake and then I ran the program again. Now I got 'Uncaught exception throw inside task lifecycle.'

Please help.

Lucas Bradstreet

unread,

Mar 14, 2016, 1:19:50 AM3/14/16

to Punit Naik, Onyx

Hi Punit,

You will receive better assistance if you can provide more information with your questions e.g. the full exception thrown. So far you haven't been providing enough information each time time you ask a question, making it very hard to give you help. I think if you read the full exception it should give you a better idea of where to look.

Please feel free to come into the channel on the Clojurians slack or gitter too.

Lucas

To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/bd072f52-68f0-4536-9121-6a7765c66ad7%40googlegroups.com.

Punit Naik

unread,

Mar 14, 2016, 11:34:32 PM3/14/16

to Onyx, naik.p...@gmail.com

Okay I am sorry. Here is the full stacktrace.

16-Mar-15 09:01:03 punit-HP-15-Notebook-PC INFO [onyx.static.logging-configuration] - Starting Logging Configuration
16-Mar-15 09:01:03 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper server
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.static.logging-configuration] - Starting Logging Configuration
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Peer Group
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer d33fb0be-7cb0-44f2-aea5-2e31c781f395
16-Mar-15 09:01:05 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer 820dc104-0724-4d07-83a3-8d7191f12833
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer c7f27e99-1be6-4981-a295-6e7a609429f5
16-Mar-15 09:01:06 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer 8abcb7bc-937d-40f2-9e21-839267b58d68
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer 1ab6be1c-68ca-4b29-9840-80643dad6155
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer 3e8f2c44-90d2-4e07-95ba-088acdcf6783
16-Mar-15 09:01:07 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer ae33b97c-0619-4ee8-8203-3b2d4c919210
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.messaging.acking-daemon] - Starting Acking Daemon
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.messaging.aeron] - Starting Aeron Messenger
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.peer.virtual-peer] - Starting Virtual Peer f3631470-3b71-4201-bad5-de39ae00884c
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Starting ZooKeeper client connection. If Onyx hangs here it may indicate a difficulty connecting to ZooKeeper.
16-Mar-15 09:01:08 punit-HP-15-Notebook-PC INFO [onyx.log.zookeeper] - Stopping ZooKeeper client connection
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [f3631470-3b71-4201-bad5-de39ae00884c] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :in
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Starting Messenger Buffer
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [1ab6be1c-68ca-4b29-9840-80643dad6155] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :count-words
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [c7f27e99-1be6-4981-a295-6e7a609429f5] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :count-words
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [3e8f2c44-90d2-4e07-95ba-088acdcf6783] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :split-by-spaces
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [d33fb0be-7cb0-44f2-aea5-2e31c781f395] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :out
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [ae33b97c-0619-4ee8-8203-3b2d4c919210] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :split-by-spaces
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [8abcb7bc-937d-40f2-9e21-839267b58d68] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :split-by-spaces
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [820dc104-0724-4d07-83a3-8d7191f12833] Warming up Task LifeCycle for job f5197fca-8ffe-4b8e-a1a6-fe7181f41278, task :count-words
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [8abcb7bc-937d-40f2-9e21-839267b58d68] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [1ab6be1c-68ca-4b29-9840-80643dad6155] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [820dc104-0724-4d07-83a3-8d7191f12833] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [c7f27e99-1be6-4981-a295-6e7a609429f5] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [ae33b97c-0619-4ee8-8203-3b2d4c919210] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [3e8f2c44-90d2-4e07-95ba-088acdcf6783] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [ae33b97c-0619-4ee8-8203-3b2d4c919210] Not enough virtual peers have warmed up to start the task yet, backing off and trying again...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [8abcb7bc-937d-40f2-9e21-839267b58d68] Not enough virtual peers have warmed up to start the task yet, backing off and trying again...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [f3631470-3b71-4201-bad5-de39ae00884c] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [f3631470-3b71-4201-bad5-de39ae00884c] Not enough virtual peers have warmed up to start the task yet, backing off and trying again...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [3e8f2c44-90d2-4e07-95ba-088acdcf6783] Not enough virtual peers have warmed up to start the task yet, backing off and trying again...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [d33fb0be-7cb0-44f2-aea5-2e31c781f395] Peer chose not to start the task yet. Backing off and retrying...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [d33fb0be-7cb0-44f2-aea5-2e31c781f395] Not enough virtual peers have warmed up to start the task yet, backing off and trying again...
16-Mar-15 09:01:09 punit-HP-15-Notebook-PC WARN [onyx.peer.task-lifecycle] - Uncaught exception throw inside task lifecycle.
                                                    [37mjava.lang.Thread.run [m   [32m            Thread.java:  745 [m
                      [37mjava.util.concurrent.ThreadPoolExecutor$Worker.run [m   [32mThreadPoolExecutor.java:  617 [m
                       [37mjava.util.concurrent.ThreadPoolExecutor.runWorker [m   [32mThreadPoolExecutor.java: 1142 [m
                                     [37mjava.util.concurrent.FutureTask.run [m   [32m        FutureTask.java:  266 [m
                                                                     [37m... [m   [32m                              [m
                                     [33mclojure.core/binding-conveyor-fn/ [1;33mfn [m   [32m               core.clj: 1916 [m
                         [33monyx.log.commands.common/start-new-lifecycle/ [1;33mfn [m   [32m             common.clj:  146 [m
                                              [33monyx.system.OnyxTask/ [1;33mstart [m   [32m             system.clj:  143 [m
                                           [33monyx.system/ [1;33mrethrow-component [m   [32m             system.clj:   60 [m
                                                 [33monyx.system.OnyxTask/ [1;33mfn [m   [32m             system.clj:  144 [m
                                 [33mcom.stuartsierra.component/ [1;33mstart-system [m   [32m          component.clj:  162 [m
                                                                     [37m... [m   [32m                              [m
                                [33mcom.stuartsierra.component/ [1;33mupdate-system [m   [32m          component.clj:  134 [m
                                                     [33mclojure.core/ [1;33mreduce [m   [32m               core.clj: 6518 [m
                                                                     [37m... [m   [32m                              [m
                             [33mcom.stuartsierra.component/update-system/ [1;33mfn [m   [32m          component.clj:  138 [m
                                   [33mcom.stuartsierra.component/ [1;33mtry-action [m   [32m          component.clj:  116 [m
                                                      [33mclojure.core/ [1;33mapply [m   [32m               core.clj:  632 [m
                                                                     [37m... [m   [32m                              [m
                                 [33mcom.stuartsierra.component/eval749/fn/ [1;33mG [m   [32m          component.clj:    4 [m
                                 [33mcom.stuartsierra.component/eval749/fn/ [1;33mG [m   [32m          component.clj:    4 [m
                            [33monyx.peer.task-lifecycle.TaskLifeCycle/ [1;33mstart [m   [32m     task_lifecycle.clj:  553 [m
                                    [33monyx.peer.task-lifecycle/ [1;33mresolve-log [m   [32m     task_lifecycle.clj:  451 [m
                                                                     [37m... [m   [32m                              [m
                                  [33monyx.state.log.bookkeeper/eval17310/ [1;33mfn [m   [32m         bookkeeper.clj:  179 [m
                                    [33monyx.state.log.bookkeeper/ [1;33mbookkeeper [m   [32m         bookkeeper.clj:   41 [m
                                    [33monyx.state.log.bookkeeper/ [1;33mbookkeeper [m   [32m         bookkeeper.clj:   46 [m
                          [37morg.apache.bookkeeper.client.BookKeeper.<init> [m   [32m        BookKeeper.java:  221 [m
                       [37morg.apache.bookkeeper.client.BookieWatcher.<init> [m   [32m     BookieWatcher.java:   85 [m
 [37morg.apache.bookkeeper.client.BookieWatcher$ReadOnlyBookieWatcher.<init> [m   [32m     BookieWatcher.java:  264 [m
                                   [37morg.apache.zookeeper.ZooKeeper.create [m   [32m         ZooKeeper.java:  783 [m
                             [37morg.apache.zookeeper.KeeperException.create [m   [32m   KeeperException.java:   51 [m
                             [37morg.apache.zookeeper.KeeperException.create [m   [32m   KeeperException.java:  111 [m
 [1;31morg.apache.zookeeper.KeeperException$NoNodeException [m:  [3mKeeperErrorCode = NoNode for /onyx/04fb3058-e979-49f3-b1e1-3cb78b98e22f/ledgers/available/readonly [m
     [1mcode [m: -101
     [1mpath [m: "/onyx/04fb3058-e979-49f3-b1e1-3cb78b98e22f/ledgers/available/readonly"

16-Mar-15 09:01:09 punit-HP-15-Notebook-PC WARN [onyx.peer.task-lifecycle] - Uncaught exception throw inside task lifecycle.
                                                    [37mjava.lang.Thread.run [m   [32m            Thread.java:  745 [m
                      [37mjava.util.concurrent.ThreadPoolExecutor$Worker.run [m   [32mThreadPoolExecutor.java:  617 [m
                       [37mjava.util.concurrent.ThreadPoolExecutor.runWorker [m   [32mThreadPoolExecutor.java: 1142 [m
                                     [37mjava.util.concurrent.FutureTask.run [m   [32m        FutureTask.java:  266 [m
                                                                     [37m... [m   [32m                              [m
                                     [33mclojure.core/binding-conveyor-fn/ [1;33mfn [m   [32m               core.clj: 1916 [m
                         [33monyx.log.commands.common/start-new-lifecycle/ [1;33mfn [m   [32m             common.clj:  146 [m
                                              [33monyx.system.OnyxTask/ [1;33mstart [m   [32m             system.clj:  143 [m
                                           [33monyx.system/ [1;33mrethrow-component [m   [32m             system.clj:   60 [m
                                                 [33monyx.system.OnyxTask/ [1;33mfn [m   [32m             system.clj:  144 [m
                                 [33mcom.stuartsierra.component/ [1;33mstart-system [m   [32m          component.clj:  162 [m
                                                                     [37m... [m   [32m                              [m
                                [33mcom.stuartsierra.component/ [1;33mupdate-system [m   [32m          component.clj:  134 [m
                                                     [33mclojure.core/ [1;33mreduce [m   [32m               core.clj: 6518 [m
                                                                     [37m... [m   [32m                              [m
                             [33mcom.stuartsierra.component/update-system/ [1;33mfn [m   [32m          component.clj:  138 [m
                                   [33mcom.stuartsierra.component/ [1;33mtry-action [m   [32m          component.clj:  116 [m
                                                      [33mclojure.core/ [1;33mapply [m   [32m               core.clj:  632 [m
                                                                     [37m... [m   [32m                              [m
                                 [33mcom.stuartsierra.component/eval749/fn/ [1;33mG [m   [32m          component.clj:    4 [m
                                 [33mcom.stuartsierra.component/eval749/fn/ [1;33mG [m   [32m          component.clj:    4 [m
                            [33monyx.peer.task-lifecycle.TaskLifeCycle/ [1;33mstart [m   [32m     task_lifecycle.clj:  553 [m
                                    [33monyx.peer.task-lifecycle/ [1;33mresolve-log [m   [32m     task_lifecycle.clj:  451 [m
                                                                     [37m... [m   [32m                              [m
                                  [33monyx.state.log.bookkeeper/eval17310/ [1;33mfn [m   [32m         bookkeeper.clj:  179 [m
                                    [33monyx.state.log.bookkeeper/ [1;33mbookkeeper [m   [32m         bookkeeper.clj:   41 [m
                                    [33monyx.state.log.bookkeeper/ [1;33mbookkeeper [m   [32m         bookkeeper.clj:   46 [m
                          [37morg.apache.bookkeeper.client.BookKeeper.<init> [m   [32m        BookKeeper.java:  221 [m
                       [37morg.apache.bookkeeper.client.BookieWatcher.<init> [m   [32m     BookieWatcher.java:   85 [m
 [37morg.apache.bookkeeper.client.BookieWatcher$ReadOnlyBookieWatcher.<init> [m   [32m     BookieWatcher.java:  264 [m
                                   [37morg.apache.zookeeper.ZooKeeper.create [m   [32m         ZooKeeper.java:  783 [m
                             [37morg.apache.zookeeper.KeeperException.create [m   [32m   KeeperException.java:   51 [m
                             [37morg.apache.zookeeper.KeeperException.create [m   [32m   KeeperException.java:  111 [m
 [1;31morg.apache.zookeeper.KeeperException$NoNodeException [m:  [3mKeeperErrorCode = NoNode for /onyx/04fb3058-e979-49f3-b1e1-3cb78b98e22f/ledgers/available/readonly [m
     [1mcode [m: -101
     [1mpath [m: "/onyx/04fb3058-e979-49f3-b1e1-3cb78b98e22f/ledgers/available/readonly"

16-Mar-15 09:01:09 punit-HP-15-Notebook-PC WARN [onyx.peer.task-lifecycle] - Uncaught exception throw inside task lifecycle.
                                                    [37mjava.lang.Thread.run [m   [32m            Thread.java:  745 [m
                      [37mjava.util.concurrent.ThreadPoolExecutor$Worker.run [m   [32mThreadPoolExecutor.java:  617 [m
                       [37mjava.util.concurrent.ThreadPoolExecutor.runWorker [m   [32mThreadPoolExecutor.java: 1142 [m
                                     [37mjava.util.concurrent.FutureTask.run [m   [32m        FutureTask.java:  266 [m
                                                                     [37m... [m   [32m                              [m
                                     [33mclojure.core/binding-conveyor-fn/ [1;33mfn [m   [32m               core.clj: 1916 [m
                         [33monyx.log.commands.common/start-new-lifecycle/ [1;33mfn [m   [32m             common.clj:  146 [m
                                              [33monyx.system.OnyxTask/ [1;33mstart [m   [32m             system.clj:  143 [m
                                           [33monyx.system/ [1;33mrethrow-component [m   [32m             system.clj:   60 [m
                                                 [33monyx.system.OnyxTask/ [1;33mfn [m   [32m             system.clj:  144 [m
                                 [33mcom.stuartsierra.component/ [1;33mstart-system [m   [32m          component.clj:  162 [m
                                                                     [37m... [m   [32m                              [m
                                [33mcom.stuartsierra.component/ [1;33mupdate-system [m   [32m          component.clj:  134 [m
                                                     [33mclojure.core/ [1;33mreduce [m   [32m               core.clj: 6518 [m
                                                                     [37m... [m   [32m                              [m
                             [33mcom.stuartsierra.component/update-system/ [1;33mfn [m   [32m          component.clj:  138 [m
                                   [33mcom.stuartsierra.component/ [1;33mtry-action [m   [32m          component.clj:  116 [m
                                                      [33mclojure.core/ [1;33mapply [m   [32m               core.clj:  632 [m
                                                                     [37m... [m   [32m                              [m
                                 [33mcom.stuartsierra.component/eval749/fn/ [1;33mG [m   [32m          component.clj:    4 [m
                                 [33mcom.stuartsierra.component/eval749/fn/ [1;33mG [m   [32m          component.clj:    4 [m
                            [33monyx.peer.task-lifecycle.TaskLifeCycle/ [1;33mstart [m   [32m     task_lifecycle.clj:  553 [m
                                    [33monyx.peer.task-lifecycle/ [1;33mresolve-log [m   [32m     task_lifecycle.clj:  451 [m
                                                                     [37m... [m   [32m                              [m
                                  [33monyx.state.log.bookkeeper/eval17310/ [1;33mfn [m   [32m         bookkeeper.clj:  179 [m
                                    [33monyx.state.log.bookkeeper/ [1;33mbookkeeper [m   [32m         bookkeeper.clj:   41 [m
                                    [33monyx.state.log.bookkeeper/ [1;33mbookkeeper [m   [32m         bookkeeper.clj:   46 [m
                          [37morg.apache.bookkeeper.client.BookKeeper.<init> [m   [32m        BookKeeper.java:  221 [m
                       [37morg.apache.bookkeeper.client.BookieWatcher.<init> [m   [32m     BookieWatcher.java:   85 [m
 [37morg.apache.bookkeeper.client.BookieWatcher$ReadOnlyBookieWatcher.<init> [m   [32m     BookieWatcher.java:  264 [m
                                   [37morg.apache.zookeeper.ZooKeeper.create [m   [32m         ZooKeeper.java:  783 [m
                             [37morg.apache.zookeeper.KeeperException.create [m   [32m   KeeperException.java:   51 [m
                             [37morg.apache.zookeeper.KeeperException.create [m   [32m   KeeperException.java:  111 [m
 [1;31morg.apache.zookeeper.KeeperException$NoNodeException [m:  [3mKeeperErrorCode = NoNode for /onyx/04fb3058-e979-49f3-b1e1-3cb78b98e22f/ledgers/available/readonly [m
     [1mcode [m: -101
     [1mpath [m: "/onyx/04fb3058-e979-49f3-b1e1-3cb78b98e22f/ledgers/available/readonly"

16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [c7f27e99-1be6-4981-a295-6e7a609429f5] Stopping Task LifeCycle, failed to initialize task set up.
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [1ab6be1c-68ca-4b29-9840-80643dad6155] Stopping Task LifeCycle, failed to initialize task set up.
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [820dc104-0724-4d07-83a3-8d7191f12833] Stopping Task LifeCycle, failed to initialize task set up.
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [ae33b97c-0619-4ee8-8203-3b2d4c919210] Enough peers are active, starting the task
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [8abcb7bc-937d-40f2-9e21-839267b58d68] Enough peers are active, starting the task
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [f3631470-3b71-4201-bad5-de39ae00884c] Enough peers are active, starting the task
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [3e8f2c44-90d2-4e07-95ba-088acdcf6783] Enough peers are active, starting the task
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [8abcb7bc-937d-40f2-9e21-839267b58d68] Stopping Task LifeCycle for :split-by-spaces
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [d33fb0be-7cb0-44f2-aea5-2e31c781f395] Enough peers are active, starting the task
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [d33fb0be-7cb0-44f2-aea5-2e31c781f395] Stopping Task LifeCycle for :out
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [f3631470-3b71-4201-bad5-de39ae00884c] Stopping Task LifeCycle for :in
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [3e8f2c44-90d2-4e07-95ba-088acdcf6783] Stopping Task LifeCycle for :split-by-spaces
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.peer.task-lifecycle] - [ae33b97c-0619-4ee8-8203-3b2d4c919210] Stopping Task LifeCycle for :split-by-spaces
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.plugin.core-async] - core.async input plugin stopping. Retry count: 0
16-Mar-15 09:01:10 punit-HP-15-Notebook-PC INFO [onyx.messaging.messenger-buffer] - Stopping Messenger Buffer

I have also attached my project's source code tarball below.

onyx-starter.tar.gz

Mike Drogalis

unread,

Mar 15, 2016, 1:38:06 PM3/15/16

to Punit Naik, Onyx

Punit, it looks like BookKeeper isn't running.

To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/f7bba45a-7ba6-4361-b6e5-d6d834badc17%40googlegroups.com.

Lucas Bradstreet

unread,

Mar 15, 2016, 1:45:32 PM3/15/16

to Mike Drogalis, Punit Naik, Onyx

You can do so via configuring the environment config.

To view this discussion on the web visit https://groups.google.com/d/msgid/onyx-user/CALbiitqsJ9T33-GNWf%2BfCSwcrzbwfkyHviEdSNOsW_3Y-g7BWg%40mail.gmail.com.

Punit Naik

unread,

Mar 16, 2016, 12:50:07 AM3/16/16

to Onyx, madru...@gmail.com, naik.p...@gmail.com

Hi Mike, Lucas

I want to inform you that I directly modified the 'onyx-starter' repo for doing a wordcount. By default the 'onyx-starter' repo does not have BookKeeper?

...

Lucas Bradstreet

unread,

Mar 16, 2016, 8:30:25 AM3/16/16

to Punit Naik, Onyx, Mike Drogalis

Hi Punit,

That is right. You'll need to change your env-config to start one up.
Please review the cheat sheet for the appropriate config option
www.onyxplatform.org/docs/cheat-sheet/latest

> --
> You received this message because you are subscribed to the Google Groups
> "Onyx" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to onyx-user+...@googlegroups.com.
> To post to this group, send email to onyx...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/onyx-user/047d102a-2b79-45a8-ba2e-34febf8bca72%40googlegroups.com.

Reply all

Reply to author

Forward

0 new messages