Elasticsearch and DynamoDB errors with EDDA

131 views
Skip to first unread message

John Jelinek

unread,
May 14, 2015, 1:59:32 PM5/14/15
to edda-...@googlegroups.com
I'm getting a lot of errors running EDDA in AWS.

```
2015-05-14 16:21:06.763 - INFO  - [DynamoDB.scala:95] [initState]  dynamo read lapse: 605ms
2015-05-14 16:21:06.765 - INFO  - [DynamoDB.scala:95] [initState]  dynamo read lapse: 688ms
2015-05-14 16:21:06.767 - ERROR - [DynamoDB.scala:99] [initState]  Dynamo record for name not found
...
2015-05-14 16:21:07.964 - ERROR - [Collection.scala:492] [initState] [Collection aws.volumes] failed to load
org.elasticsearch.indices.IndexMissingException: [aws_volumes_live] missing
        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)
        at org.elasticsearch.cluster.metadata.MetaData.concreteIndices(MetaData.java:519)
        at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.<init>(TransportSearchTypeAction.java:109)
...
2015-05-14 16:21:07.964 - ERROR - [Collection.scala:492] [initState] [Collection aws.images] failed to load
org.elasticsearch.indices.IndexMissingException: [aws_images_live] missing
        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)
...
2015-05-14 16:21:07.992 - ERROR - [Utils.scala:115] caught retryable exception:org.elasticsearch.indices.IndexMissingException: [aws_images_live] missing
org.elasticsearch.indices.IndexMissingException: [aws_images_live] missing
        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)
...
2015-05-14 16:21:07.964 - ERROR - [Collection.scala:492] [initState] [Collection view.simpleQueues] failed to load
org.elasticsearch.indices.IndexMissingException: [view_simplequeues_live] missing
        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)
...
2015-05-14 16:21:07.983 - ERROR - [Collection.scala:492] [initState] [Collection aws.hostedZones] failed to load
org.elasticsearch.indices.IndexMissingException: [aws_hostedzones_live] missing
        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)
...
2015-05-14 16:21:07.983 - ERROR - [Collection.scala:492] [initState] [Collection aws.databases] failed to load
org.elasticsearch.indices.IndexMissingException: [aws_databases_live] missing
        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)
...
```

How should I troubleshoot these problems?

It seem elasticsearch is receiving data:
```
[2015-05-14 16:18:41,101][INFO ][node                     ] [Hugh Jones] version[0.90.3], pid[1], build[5c38d60/2013-08-06T13:18:31Z]
[2015-05-14 16:18:41,101][INFO ][node                     ] [Hugh Jones] initializing ...
[2015-05-14 16:18:41,107][INFO ][plugins                  ] [Hugh Jones] loaded [], sites []
[2015-05-14 16:18:43,136][INFO ][node                     ] [Hugh Jones] initialized
[2015-05-14 16:18:43,137][INFO ][node                     ] [Hugh Jones] starting ...
[2015-05-14 16:18:43,212][INFO ][transport                ] [Hugh Jones] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/172.17.0.1:9300]}
[2015-05-14 16:18:46,274][INFO ][cluster.service          ] [Hugh Jones] new_master [Hugh Jones][PdZ8VIosS4Ow4dyvWB1CYg][inet[/172.17.0.1:9300]], reason: zen-disco-join (elected_as_master)
[2015-05-14 16:18:46,300][INFO ][discovery                ] [Hugh Jones] elasticsearch/PdZ8VIosS4Ow4dyvWB1CYg
[2015-05-14 16:18:46,333][INFO ][http                     ] [Hugh Jones] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/172.17.0.1:9200]}
[2015-05-14 16:18:46,334][INFO ][node                     ] [Hugh Jones] started
[2015-05-14 16:18:46,432][INFO ][gateway                  ] [Hugh Jones] recovered [0] indices into cluster_state
[2015-05-14 16:21:08,178][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] creating index, cause [api], shards [5]/[0], mappings [_default_]
[2015-05-14 16:21:08,709][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamgroups]
[2015-05-14 16:21:08,724][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_loadbalancers]
[2015-05-14 16:21:08,738][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_images]
[2015-05-14 16:21:08,746][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_hostedzones]
[2015-05-14 16:21:09,850][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_cacheclusters]
[2015-05-14 16:21:10,095][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_buckets]
[2015-05-14 16:21:10,446][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [view_loadbalancerinstances]
[2015-05-14 16:21:10,649][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_scalingpolicies]
[2015-05-14 16:21:10,845][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_snapshots]
[2015-05-14 16:21:11,098][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_autoscalinggroups]
[2015-05-14 16:21:11,362][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_instances]
[2015-05-14 16:21:11,658][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_volumes]
[2015-05-14 16:21:11,917][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamusers]
[2015-05-14 16:21:12,177][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_addresses]
[2015-05-14 16:21:12,449][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamvirtualmfadevices]
[2015-05-14 16:21:12,820][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [view_simplequeues]
[2015-05-14 16:21:12,993][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamroles]
[2015-05-14 16:21:13,226][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_databases]
[2015-05-14 16:21:13,468][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [view_instances]
[2015-05-14 16:21:13,732][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_alarms]
[2015-05-14 16:21:14,015][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_tags]
[2015-05-14 16:21:14,299][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_stacks]
[2015-05-14 16:21:14,584][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_reservedinstances]
[2015-05-14 16:21:14,828][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [group_autoscalinggroups]
[2015-05-14 16:21:15,122][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_subnets]
[2015-05-14 16:21:15,435][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_hostedrecords]
[2015-05-14 16:21:15,719][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_launchconfigurations]
[2015-05-14 16:21:16,005][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_securitygroups]
```

Any thoughts?

Ivan Alfredo Zenteno Aguilar

unread,
May 27, 2015, 11:23:19 AM5/27/15
to edda-...@googlegroups.com
 Hi John,

I'm trying to use DynamoDB but when I try to startup in Tomcat I got the next error:

May 27, 2015 3:04:45 PM org.apache.catalina.core.StandardContext loadOnStartup
SEVERE
: Servlet [Edda Server] in web application [/edda-2.1] threw load() exception
java
.lang.ClassNotFoundException: com.neflix.edda.aws.DynamoDBElector
 at org
.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
 at org
.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
 at com
.netflix.edda.basic.BasicServer.init(BasicServer.scala:49)
 at javax
.servlet.GenericServlet.init(GenericServlet.java:158)
 at org
.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1284)
 at org
.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1197)
 at org
.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1087)
 at org
.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:5266)
 at org
.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5554)
 at org
.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
 at org
.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901)
 at org
.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
 at org
.apache.catalina.core.StandardHost.addChild(StandardHost.java:652)
 at org
.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1095)
 at org
.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1930)
 at java
.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java
.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java
.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java
.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java
.lang.Thread.run(Thread.java:745)

But the scala file for that Class already exist, so I'm not sure what means that error.

com/netflix/edda/aws/DynamoDBElector.scala

Best regards

Cory Bennett

unread,
May 27, 2015, 1:25:33 PM5/27/15
to Ivan Alfredo Zenteno Aguilar, edda-...@googlegroups.com
There is a typo:
com.neflix.edda.aws.DynamoDBElector

neflix => netflix

This typo is probably in your edda.properties config file

-Cory

--
You received this message because you are subscribed to the Google Groups "Edda Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to edda-users+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Ivan Zenteno

unread,
May 27, 2015, 2:03:42 PM5/27/15
to edda-...@googlegroups.com, ivan.z...@infapen.com
noway!! I don't noted, thanks a lot
Reply all
Reply to author
Forward
0 new messages