(URGENT) UATBC Down | Motech team help required
Akanksha Tikku
Dear Motech team,
We are using MOTECH deployment for TB project in India. The application has not been working since morning and upon analysing the issue, there seems to be a connection issue with Motech database. Could you please direct us to the right team to troubleshoot this issue further?
Regards
Akanksha
From: vipul...@accenture.com [mailto:vipul...@accenture.com]
Sent: Thursday, December 22, 2016 1:06 PM
To: Akanksha Tikku <akanksh...@in.ey.com>
Cc: ashok.v...@accenture.com; d.g...@accenture.com; Rahul....@gatesfoundation.org
Subject: UATBC Down | Motech team help required
Hi Akanksha,
Application is not able to connect to database. We have checked all the configuration and network communication between both the servers all are good.
On server startup Motech try to create connection with database and throwing “Connection Lync Failure”. We need Motech team help here to diagnose the issue.
Please check with Motech team if we can get into the call to analyze it further.
Thanks,
Vipul Garg
From: Gowri, D.
Sent: Thursday, December 22, 2016 11:50 AM
To: dtog...@rntcp.org;
dtog...@rntcp.org; dtog...@rntcp.org;
pankajn...@gmail.com;
pat...@rntcp.org; tha...@rntcp.org;
dtom...@rntcp.org; dtom...@rntcp.org;
bharas...@rntcp.org;
dapk...@rntcp.org; svij...@path.org;
vjon...@path.org;
rch...@path.org; spa...@path.org;
ni...@worldhealthpartners.com; ri...@worldhealthpartners.com;
nag...@worldhealthpartners.com;
puneet...@gatesfoundation.org;
Rahul....@gatesfoundation.org;
sameer...@gatesfoundation.org;
vivek....@vertexgroup.co.in;
ganesh....@vertexgroup.co.in;
sushan...@vertexgroup.co.in; Rajeesh R Menon <Rajees...@in.ey.com>;
mitu.ray...@in.ey.com;
akanksh...@in.ey.com; Abhishek Arun <Abhish...@in.ey.com>
Cc: Agarwal, Ankur B. <ankur.b...@accenture.com>; Garg, Vipul <vipul...@accenture.com>; UATBC.Support <UATBC....@accenture.com>;
Veldurti, Ashok <ashok.v...@accenture.com>
Subject: Re: UATBC Downtime Notification - Dec 4, 2016
Dear All,
We are still working on this issue with Sify team. We will keep you posted.
Thanks,
Gowri
UATBC Support
From: Gowri, D.
Sent: 22 December 2016 09:53:49
To: dtog...@rntcp.org;
dtog...@rntcp.org; dtog...@rntcp.org;
pankajn...@gmail.com;
pat...@rntcp.org; tha...@rntcp.org;
dtom...@rntcp.org; dtom...@rntcp.org;
bharas...@rntcp.org;
dapk...@rntcp.org; svij...@path.org;
vjon...@path.org;
rch...@path.org; spa...@path.org;
ni...@worldhealthpartners.com; ri...@worldhealthpartners.com;
nag...@worldhealthpartners.com;
puneet...@gatesfoundation.org;
Rahul....@gatesfoundation.org;
sameer...@gatesfoundation.org;
vivek....@vertexgroup.co.in;
ganesh....@vertexgroup.co.in;
sushan...@vertexgroup.co.in; Rajeesh R Menon;
mitu.ray...@in.ey.com;
akanksh...@in.ey.com; Abhishek Arun
Cc: Agarwal, Ankur B.; Garg, Vipul; UATBC.Support; Veldurti, Ashok
Subject: Re: UATBC Downtime Notification - Dec 4, 2016
Dear All,
UATBC Application is down and we are facing issues in bringing up UATBC Server.
We are looking into this issue on priority. Will keep you updated.
Thanks,
Gowri
UATBC Support
From: Gowri, D.
Sent: 02 December 2016 21:14:06
To: dtog...@rntcp.org;
dtog...@rntcp.org; dtog...@rntcp.org;
pankajn...@gmail.com;
pat...@rntcp.org; tha...@rntcp.org;
dtom...@rntcp.org; dtom...@rntcp.org;
bharas...@rntcp.org;
dapk...@rntcp.org; svij...@path.org;
vjon...@path.org;
rch...@path.org; spa...@path.org;
ni...@worldhealthpartners.com; ri...@worldhealthpartners.com;
nag...@worldhealthpartners.com;
puneet...@gatesfoundation.org;
Rahul....@gatesfoundation.org;
sameer...@gatesfoundation.org;
vivek....@vertexgroup.co.in;
ganesh....@vertexgroup.co.in;
sushan...@vertexgroup.co.in; Rajeesh R Menon;
mitu.ray...@in.ey.com;
akanksh...@in.ey.com; Abhishek Arun
Cc: Agarwal, Ankur B.; Garg, Vipul; UATBC.Support; Veldurti, Ashok
Subject: UATBC Downtime Notification - Dec 4, 2016
Dear All,
Please be informed that UATBC Application will not be available from 2:30 AM to 7:30 AM on Sunday, 4th Dec 2016.
This downtime is to fix multi-path issue in Server at Sify side.
Kindly get back to us if any other information is required.
Thanks,
Gowri
UATBC Support
This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by
you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of
internal compliance with Accenture policy.
______________________________________________________________________________________
www.accenture.com
The information contained in this communication is intended solely for the use of the individual or entity to whom it is addressed and others authorized to receive it. It may contain confidential or legally privileged information. If you are not the intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. If you have received this communication in error, please notify us immediately by responding to this email and then delete it from your system. The firm is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt.
Kamil Madej
because Sheel Shah is out of the office, please write direct to me. I will need more details :
1. what MOTECH version do you use ?
2. the issue reproduction steps
3. stacktrace with error from logs
Best Regards
Kamil Madej
vipul...@accenture.com
Hi Motech Team,
We are using Motech 0.24.1 version for UATBC application while bringing up the tomcat 7 server we are getting below exception, please check the attached log for more details.
Error 1:
ERROR ContextLoaderListener - Application context refresh failed (MotechOsgiConfigurableApplicationContext(bundle=org.motechproject.motech-platform-dataservices, config=osgibundle:/META-INF/spring/*.xml))
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'flyway' defined in URL [bundle://96.0:1/META-INF/motech/mdsContext.xml]: Invocation of init method failed; nested exception is com.googlecode.flyway.core.api.FlywayException: Unable to obtain Jdbc connection from DataSource
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.initializeBean(AbstractAutowireCapableBeanFactory.java:1455)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:294)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:225)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:284)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:193)
at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:567)
at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:913)
at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.access$1600(AbstractDelegatedExecutionApplicationContext.java:60)
at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext$4.run(AbstractDelegatedExecutionApplicationContext.java:325)
at org.eclipse.gemini.blueprint.util.internal.PrivilegedUtils.executeWithCustomTCCL(PrivilegedUtils.java:85)
at org.eclipse.gemini.blueprint.context.support.AbstractDelegatedExecutionApplicationContext.completeRefresh(AbstractDelegatedExecutionApplicationContext.java:290)
at org.eclipse.gemini.blueprint.extender.internal.dependencies.startup.DependencyWaiterApplicationContextExecutor$CompleteRefreshTask.run(DependencyWaiterApplicationContextExecutor.java:137)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.googlecode.flyway.core.api.FlywayException: Unable to obtain Jdbc connection from DataSource
at com.googlecode.flyway.core.util.jdbc.JdbcUtils.openConnection(JdbcUtils.java:56)
Error 2.
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.)
at org.datanucleus.store.rdbms.datasource.dbcp.BasicDataSource.createPoolableConnectionFactory(BasicDataSource.java:1553)
at org.datanucleus.store.rdbms.datasource.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1392)
at org.datanucleus.store.rdbms.datasource.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1048)
at com.googlecode.flyway.core.util.jdbc.JdbcUtils.openConnection(JdbcUtils.java:50)
... 25 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
Application was working fine since yesterday night. Today morning we have restarted the server but it’s not comes up. Its start throwing above exception.
As par the exception application facing issue while creating database connection so
1. From the standalone java program we are successfully establish the connection with database.
2. SIFY team confirmed that mysql port is accessible.
Please let me know if more information required.
Thanks,
Vipul Garg
Rahul Mullick
Jon/Cory, copying you to see who can support on Motech platform issue now with Grameen out of the way. This is on the UATBC project.
Cory Zue
vipul...@accenture.com
Hi Cory,
Please see my response inline.
Thanks,
Vipul Garg
From: Cory Zue [mailto:cz...@dimagi.com]
Sent: Thursday, December 22, 2016 6:39 PM
To: Rahul Mullick <Rahul....@gatesfoundation.org>; motec...@dimagi.com
Cc: Garg, Vipul <vipul...@accenture.com>; akanksh...@in.ey.com; motec...@googlegroups.com; Jonathan Jackson <jjac...@dimagi.com>; Gowri, D. <d.g...@accenture.com>; Veldurti, Ashok <ashok.v...@accenture.com>; Stella <sl...@dimagi.com>
Subject: Re: (URGENT) UATBC Down | Motech team help required
Hi Vipul,
I'm looping in a few other team members on our side who may be able to help with this.
Here are a few quick troubleshooting questions in the meantime to help them get started:
When you accessed the database from the standalone Java program was that on the same server as the one you are having issues? Or on a different machine?
<Vipul> From the same machine where we have tomcat sever installed.
When you accessed the database manually, what commands/queries were you able to make?
<Vipul> We tried to execute Select query.
Have you been able to verify that the module that is causing issues has the proper connection string configured? Have you inspected that connection string and tried the same to access the database manually from a standalone java program?
<Vipul>yes we tired, and from the standalone program we are able to run select query.
thanks,
Cory
On Thu, Dec 22, 2016 at 2:56 PM, Rahul Mullick <Rahul....@gatesfoundation.org> wrote:
From: vipul...@accenture.com [mailto:vipul...@accenture.com]
Sent: Thursday, December 22, 2016 5:59 PM
Kamil Madej
the real error is :
Caused by: java.net.ConnectException: Connection refused
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
at java.net.Socket.connect(Socket.java:579)
at java.net.Socket.connect(Socket.java:528)
at java.net.Socket.<init>(Socket.java:425)
at java.net.Socket.<init>(Socket.java:241)
at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:259)
at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:307)
I was able to reproduce the issue providing wrong port. After reading previous email, I assume that you have already done it. However please ensure that in bootstrap.properties file ($HOME/.motech/config) you have valid url and port in 'sql.url' property. You can also remove manually this file and restart tomcat server. If MOTECH doesn't find the file, the bootstrap window will appear and you can try to provide valid properties once again.
Best Regards
Kamil Madej
From: vipul...@accenture.com [mailto:vipul.garg@accenture.com]
ashok.v...@accenture.com
Hi All
The application is working now. We will share the investigation details tomorrow.