Caused by: java.net.ConnectException: Connection refused to s3 after upgrading to 0.7.3

363 views
Skip to first unread message

David Montgomery

unread,
Jul 1, 2015, 1:35:41 AM7/1/15
to druid-de...@googlegroups.com
Why is the below occurring?

Here is my realtime.config

druid.host=<%=@ipaddress%>:<%=@druid_port%>
druid.service=realtime
druid.port=<%=@druid_port%>
druid.zk.service.host=<%=@zookeeper%>
druid.extensions.coordinates=["io.druid.extensions:druid-kafka-eight:<%=@version%>","io.druid.extensions:druid-s3-extensions:<%=@version%>"]
# These configs are only required for real hand off
druid.db.connector.connectURI=jdbc\:mysql\://<%=@mysql_host%>\:3306/<%=@mysql_database%>
druid.db.connector.user=<%=@mysql_username%>
druid.db.connector.password=<%=@mysql_password%>
druid.processing.buffer.sizeBytes=100000000
druid.processing.numThreads=1
druid.monitoring.monitors=["io.druid.segment.realtime.RealtimeMetricsMonitor"]
druid.s3.secretKey=<%=@AWS_SECRET_ACCESS_KEY%>
druid.s3.accessKey=<%=@AWS_ACCESS_KEY_ID%>
druid.storage.type=s3
druid.storage.bucket=<%=@s3bucket%>
druid.storage.baseKey=<%=@s3basekey%>
druid.realtime.specFile=/var/realtime.spec




basePersist/datasource-topic-pixel/2015-07-01T04:39:00.000Z_2015-07-01T04:40:00.000Z/merged/version.bin] with size[4].  Total size so far[4,316]
2015-07-01T05:07:00,187 INFO [datasource-topic-pixel-2015-07-01T04:39:00.000Z-persist-n-merge] com.metamx.common.CompressionUtils - Adding file[/tmp/realtime/basePersist/datasource-topic-pixel/2015-07-01T04:39:00.000Z_2015-07-01T04:40:00.000Z/merged/meta.smoosh] with size[133].  Total size so far[4,320]
2015-07-01T05:07:00,194 INFO [datasource-topic-pixel-2015-07-01T04:39:00.000Z-persist-n-merge] io.druid.storage.s3.S3DataSegmentPusher - Pushing S3Object [key=development-realtime/v1/datasource-topic-pixel/2015-07-01T04:39:00.000Z_2015-07-01T04:40:00.000Z/2015-07-01T04:39:00.000Z/0/index.zip, bucket=druiddevelopment, lastModified=null, dataInputStream=null, Metadata={x-amz-acl=bucket-owner-full-control, Content-Length=1924, Content-MD5=rlwVrLOJld0BKypKzjYe9Q==, md5-hash=ae5c15acb38995dd012b2a4ace361ef5, x-amz-content-sha256=457a953796031fb8fddd2e5ef46e252e15d9ef503bb045885a328df53372a1ba, Content-Type=application/zip}].
2015-07-01T05:07:00,371 INFO [datasource-topic-pixel-2015-07-01T04:39:00.000Z-persist-n-merge] io.druid.storage.s3.S3DataSegmentPusher - Pushing S3Object [key=development-realtime/v1/datasource-topic-pixel/2015-07-01T04:39:00.000Z_2015-07-01T04:40:00.000Z/2015-07-01T04:39:00.000Z/0/descriptor.json, bucket=druiddevelopment, lastModified=null, dataInputStream=null, Metadata={x-amz-acl=bucket-owner-full-control, Content-Length=401, Content-MD5=h929wLFyl0HhBoQ/Rw29lg==, md5-hash=87ddbdc0b1729741e106843f470dbd96, x-amz-content-sha256=d0009707954af88ea2fd9221762d0cd63f20f8a111767917eccf47a77d2eb5fc, Content-Type=application/octet-stream}]
2015-07-01T05:07:00,567 INFO [datasource-topic-pixel-2015-07-01T04:39:00.000Z-persist-n-merge] io.druid.storage.s3.S3DataSegmentPusher - Deleting zipped index File[/tmp/druid1149496137036794507index.zip]
2015-07-01T05:07:00,569 INFO [datasource-topic-pixel-2015-07-01T04:39:00.000Z-persist-n-merge] io.druid.storage.s3.S3DataSegmentPusher - Deleting descriptor file[/tmp/druid6588380000841589884descriptor.json]
2015-07-01T05:07:00,571 ERROR [datasource-topic-pixel-2015-07-01T04:39:00.000Z-persist-n-merge] io.druid.metadata.SQLMetadataSegmentPublisher - Exception inserting into DB
org.skife.jdbi.v2.exceptions.UnableToObtainConnectionException: java.sql.SQLException: Cannot create PoolableConnectionFactory (java.net.ConnectException : Error connecting to server localhost on port 1,527 with message Connection refused.)
    at org.skife.jdbi.v2.DBI.open(DBI.java:210) ~[jdbi-2.32.jar:?]
    at org.skife.jdbi.v2.DBI.withHandle(DBI.java:257) ~[jdbi-2.32.jar:?]
    at io.druid.metadata.SQLMetadataSegmentPublisher.publishSegment(SQLMetadataSegmentPublisher.java:67) [druid-server-0.7.3.jar:0.7.3]
    at io.druid.segment.realtime.plumber.RealtimePlumber$4.doRun(RealtimePlumber.java:461) [druid-server-0.7.3.jar:0.7.3]
    at io.druid.common.guava.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:40) [druid-common-0.7.3.jar:0.7.3]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [?:1.7.0_75]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [?:1.7.0_75]
    at java.lang.Thread.run(Thread.java:745) [?:1.7.0_75]
Caused by: java.sql.SQLException: Cannot create PoolableConnectionFactory (java.net.ConnectException : Error connecting to server localhost on port 1,527 with message Connection refused.)
    at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:2152) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:1903) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:1413) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.skife.jdbi.v2.DataSourceConnectionFactory.openConnection(DataSourceConnectionFactory.java:36) ~[jdbi-2.32.jar:?]
    at org.skife.jdbi.v2.DBI.open(DBI.java:192) ~[jdbi-2.32.jar:?]
    ... 7 more
Caused by: java.sql.SQLNonTransientConnectionException: java.net.ConnectException : Error connecting to server localhost on port 1,527 with message Connection refused.
    at org.apache.derby.client.am.SQLExceptionFactory.getSQLException(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.am.SqlException.getSQLException(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:39) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:205) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:2162) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:2148) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:1903) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:1413) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.skife.jdbi.v2.DataSourceConnectionFactory.openConnection(DataSourceConnectionFactory.java:36) ~[jdbi-2.32.jar:?]
    at org.skife.jdbi.v2.DBI.open(DBI.java:192) ~[jdbi-2.32.jar:?]
    ... 7 more
Caused by: org.apache.derby.client.am.DisconnectException: java.net.ConnectException : Error connecting to server localhost on port 1,527 with message Connection refused.
    at org.apache.derby.client.net.NetAgent.<init>(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.am.ClientConnection.<init>(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.NetConnection.<init>(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:39) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:205) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:2162) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:2148) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:1903) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:1413) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.skife.jdbi.v2.DataSourceConnectionFactory.openConnection(DataSourceConnectionFactory.java:36) ~[jdbi-2.32.jar:?]
    at org.skife.jdbi.v2.DBI.open(DBI.java:192) ~[jdbi-2.32.jar:?]
    ... 7 more
Caused by: java.net.ConnectException: Connection refused
    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.7.0_75]
    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) ~[?:1.7.0_75]
    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) ~[?:1.7.0_75]
    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) ~[?:1.7.0_75]
    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.7.0_75]
    at java.net.Socket.connect(Socket.java:579) ~[?:1.7.0_75]
    at java.net.Socket.connect(Socket.java:528) ~[?:1.7.0_75]
    at java.net.Socket.<init>(Socket.java:425) ~[?:1.7.0_75]
    at java.net.Socket.<init>(Socket.java:208) ~[?:1.7.0_75]
    at javax.net.DefaultSocketFactory.createSocket(SocketFactory.java:271) ~[?:1.7.0_75]
    at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.OpenSocketAction.run(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at java.security.AccessController.doPrivileged(Native Method) ~[?:1.7.0_75]
    at org.apache.derby.client.net.NetAgent.<init>(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.NetConnection.newAgent_(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.am.ClientConnection.<init>(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.NetConnection.<init>(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.client.net.ClientJDBCObjectFactoryImpl.newNetConnection(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.derby.jdbc.ClientDriver.connect(Unknown Source) ~[derbyclient-10.11.1.1.jar:?]
    at org.apache.commons.dbcp2.DriverConnectionFactory.createConnection(DriverConnectionFactory.java:39) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:205) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.validateConnectionFactory(BasicDataSource.java:2162) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:2148) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.createDataSource(BasicDataSource.java:1903) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.apache.commons.dbcp2.BasicDataSource.getConnection(BasicDataSource.java:1413) ~[commons-dbcp2-2.0.1.jar:2.0.1]
    at org.skife.jdbi.v2.DataSourceConnectionFactory.openConnection(DataSourceConnectionFactory.java:36) ~[jdbi-2.32.jar:?]
    at org.skife.jdbi.v2.DBI.open(DBI.java:192) ~[jdbi-2.32.jar:?]
 

Himanshu

unread,
Jul 1, 2015, 9:27:54 AM7/1/15
to druid-de...@googlegroups.com
I see
druid.db.connector.connectURI=jdbc\:mysql\://<%=@mysql_host%>\:3306/<%=@mysql_database%>
druid.db.connector.user=<%=@mysql_username%>
druid.db.connector.password=<%=@mysql_password%>

that suggests, you are upgrading from version 0.6 . Please see release notes for 0.7.x releases (https://github.com/druid-io/druid/releases). Now, for the specific problem..

"Druid now defaults to embedding Apache Derby, which was chosen mainly for testability purposes. However, we do not recommend using Derby in production. For anything other than testing, please use MySQL or PostgreSQL metadata storage.

Configuration parameters for metadata storage were renamed from druid.db to druid.metadata.storage and an additional druid.metadata.storage.type=<mysql|postgresql> is required to use anything other than Derby.

The convertProps tool can assis you in convertng all 0.6.x properties to 0.7 properties."


-- Himanshu


--
You received this message because you are subscribed to the Google Groups "Druid Development" group.
To unsubscribe from this group and stop receiving emails from it, send an email to druid-developm...@googlegroups.com.
To post to this group, send email to druid-de...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/druid-development/CACF%2B8rqaeGoVMWZK1Vt_a_oMOSi-5w2DvM9s8Q8UEiZin9jPFA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages