Elasticsearch and DynamoDB errors with EDDA

[John Jelinek]

I'm getting a lot of errors running EDDA in AWS.

```

2015-05-14 16:21:06.763 - INFO  - [DynamoDB.scala:95] [initState]  dynamo read lapse: 605ms

2015-05-14 16:21:06.765 - INFO  - [DynamoDB.scala:95] [initState]  dynamo read lapse: 688ms

2015-05-14 16:21:06.767 - ERROR - [DynamoDB.scala:99] [initState]  Dynamo record for name not found

...

2015-05-14 16:21:07.964 - ERROR - [Collection.scala:492] [initState] [Collection aws.volumes] failed to load

org.elasticsearch.indices.IndexMissingException: [aws_volumes_live] missing

        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)

        at org.elasticsearch.cluster.metadata.MetaData.concreteIndices(MetaData.java:519)

        at org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.<init>(TransportSearchTypeAction.java:109)

...

2015-05-14 16:21:07.964 - ERROR - [Collection.scala:492] [initState] [Collection aws.images] failed to load

org.elasticsearch.indices.IndexMissingException: [aws_images_live] missing

        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)

...

2015-05-14 16:21:07.992 - ERROR - [Utils.scala:115] caught retryable exception:org.elasticsearch.indices.IndexMissingException: [aws_images_live] missing

org.elasticsearch.indices.IndexMissingException: [aws_images_live] missing

        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)

...

2015-05-14 16:21:07.964 - ERROR - [Collection.scala:492] [initState] [Collection view.simpleQueues] failed to load

org.elasticsearch.indices.IndexMissingException: [view_simplequeues_live] missing

        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)

...

2015-05-14 16:21:07.983 - ERROR - [Collection.scala:492] [initState] [Collection aws.hostedZones] failed to load

org.elasticsearch.indices.IndexMissingException: [aws_hostedzones_live] missing

        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)

...

2015-05-14 16:21:07.983 - ERROR - [Collection.scala:492] [initState] [Collection aws.databases] failed to load

org.elasticsearch.indices.IndexMissingException: [aws_databases_live] missing

        at org.elasticsearch.cluster.metadata.MetaData.convertFromWildcards(MetaData.java:608)

...

```

How should I troubleshoot these problems?

It seem elasticsearch is receiving data:

```

[2015-05-14 16:18:41,101][INFO ][node                     ] [Hugh Jones] version[0.90.3], pid[1], build[5c38d60/2013-08-06T13:18:31Z]

[2015-05-14 16:18:41,101][INFO ][node                     ] [Hugh Jones] initializing ...

[2015-05-14 16:18:41,107][INFO ][plugins                  ] [Hugh Jones] loaded [], sites []

[2015-05-14 16:18:43,136][INFO ][node                     ] [Hugh Jones] initialized

[2015-05-14 16:18:43,137][INFO ][node                     ] [Hugh Jones] starting ...

[2015-05-14 16:18:43,212][INFO ][transport                ] [Hugh Jones] bound_address {inet[/0:0:0:0:0:0:0:0:9300]}, publish_address {inet[/172.17.0.1:9300]}

[2015-05-14 16:18:46,274][INFO ][cluster.service          ] [Hugh Jones] new_master [Hugh Jones][PdZ8VIosS4Ow4dyvWB1CYg][inet[/172.17.0.1:9300]], reason: zen-disco-join (elected_as_master)

[2015-05-14 16:18:46,300][INFO ][discovery                ] [Hugh Jones] elasticsearch/PdZ8VIosS4Ow4dyvWB1CYg

[2015-05-14 16:18:46,333][INFO ][http                     ] [Hugh Jones] bound_address {inet[/0:0:0:0:0:0:0:0:9200]}, publish_address {inet[/172.17.0.1:9200]}

[2015-05-14 16:18:46,334][INFO ][node                     ] [Hugh Jones] started

[2015-05-14 16:18:46,432][INFO ][gateway                  ] [Hugh Jones] recovered [0] indices into cluster_state

[2015-05-14 16:21:08,178][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] creating index, cause [api], shards [5]/[0], mappings [_default_]

[2015-05-14 16:21:08,709][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamgroups]

[2015-05-14 16:21:08,724][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_loadbalancers]

[2015-05-14 16:21:08,738][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_images]

[2015-05-14 16:21:08,746][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_hostedzones]

[2015-05-14 16:21:09,850][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_cacheclusters]

[2015-05-14 16:21:10,095][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_buckets]

[2015-05-14 16:21:10,446][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [view_loadbalancerinstances]

[2015-05-14 16:21:10,649][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_scalingpolicies]

[2015-05-14 16:21:10,845][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_snapshots]

[2015-05-14 16:21:11,098][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_autoscalinggroups]

[2015-05-14 16:21:11,362][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_instances]

[2015-05-14 16:21:11,658][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_volumes]

[2015-05-14 16:21:11,917][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamusers]

[2015-05-14 16:21:12,177][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_addresses]

[2015-05-14 16:21:12,449][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamvirtualmfadevices]

[2015-05-14 16:21:12,820][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [view_simplequeues]

[2015-05-14 16:21:12,993][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_iamroles]

[2015-05-14 16:21:13,226][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_databases]

[2015-05-14 16:21:13,468][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [view_instances]

[2015-05-14 16:21:13,732][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_alarms]

[2015-05-14 16:21:14,015][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_tags]

[2015-05-14 16:21:14,299][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_stacks]

[2015-05-14 16:21:14,584][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_reservedinstances]

[2015-05-14 16:21:14,828][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [group_autoscalinggroups]

[2015-05-14 16:21:15,122][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_subnets]

[2015-05-14 16:21:15,435][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_hostedrecords]

[2015-05-14 16:21:15,719][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_launchconfigurations]

[2015-05-14 16:21:16,005][INFO ][cluster.metadata         ] [Hugh Jones] [edda_1] create_mapping [aws_securitygroups]

```

Any thoughts?

[Ivan Alfredo Zenteno Aguilar]

 Hi John,

I'm trying to use DynamoDB but when I try to startup in Tomcat I got the next error:

May 27, 2015 3:04:45 PM org.apache.catalina.core.StandardContext loadOnStartup
SEVERE: Servlet [Edda Server] in web application [/edda-2.1] threw load() exception
java.lang.ClassNotFoundException: com.neflix.edda.aws.DynamoDBElector
 at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1720)
 at org.apache.catalina.loader.WebappClassLoader.loadClass(WebappClassLoader.java:1571)
 at com.netflix.edda.basic.BasicServer.init(BasicServer.scala:49)
 at javax.servlet.GenericServlet.init(GenericServlet.java:158)
 at org.apache.catalina.core.StandardWrapper.initServlet(StandardWrapper.java:1284)
 at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1197)
 at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:1087)
 at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:5266)
 at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5554)
 at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
 at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:901)
 at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
 at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:652)
 at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1095)
 at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1930)
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
 at java.util.concurrent.FutureTask.run(FutureTask.java:262)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
 at java.lang.Thread.run(Thread.java:745)

But the scala file for that Class already exist, so I'm not sure what means that error.

com/netflix/edda/aws/DynamoDBElector.scala

Best regards

[Cory Bennett]

There is a typo:
com.neflix.edda.aws.DynamoDBElector

neflix => netflix

This typo is probably in your edda.properties config file

-Cory

--
You received this message because you are subscribed to the Google Groups "Edda Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to edda-users+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Ivan Zenteno]

noway!! I don't noted, thanks a lot