Site downtime

[Stephen Chan]

CoralNet appears to have been unresponsive for much of the past 12 hours. It looks like rebooting some things should help get it back on track, so I'm doing that now.

[Stephen Chan]

Should be back up now.

[Thomas Julius]

Hi Stephen,

the site still appears to be down — Thanks for looking into it!

[Diego Curtarello]

Hi everyone,

yes I can confirm, the site is still not working. Thanks for looking into it anyway!

[Stephen Chan]

Looks like it's been on-and-off. The site is currently up, but had been down for another several hours. I'll look deeper into the server logs to figure out what it will take to prevent this.

[beth sarginson]

Hi, the site is not working again :( 

[Stephen Chan]

I'm working on a couple of optimizations, and aiming to have them ready around the middle of this week.

[Lillian Langford]

Thank you so much for all your work on this, Stephen! Just a quick question, are there certain hours that the site would usually be non-functional/slow? We have an analysis-heavy week in our lab and we're trying to plan our schedule around the time(s) that CN is up and running. 

[Stephen Chan]

Hi Lillian,

Unfortunately the slowness seems to be present for most hours of the day. If anything, the four hours from 20:00 - 00:00 UTC have seen slightly fewer issues; but again, no guarantees.

[Diego Curtarello]

Hi Stephen,

first of all, thank you for all your work on this issue. I have a question, do you think the website will be up in the next days? Just to know because I still have a lot of picture to analyze for my project and the deadline is coming fast. Thank you so much again!

[Stephen Chan]

Hi Diego,

Hopefully tonight I can roll out the two optimizations I currently have in mind, then we will see if they help. It is possible that they will not be enough though, in which case further optimizations may take more days to figure out.

[Lillian Langford]

Thank you! Indeed this seems to be the time that's working better than others for us. We appreciate all your hard work. 

[Stephen Chan]

I'm planning to start a stretch of downtime in an hour or so, to apply the optimizations I've been working on. It's an update that involves some long database processes, and my estimate is somewhere between 8-12 hours. Once that manages to finish, then we will see if the optimizations help. Thanks for your patience.

[Stephen Chan]

The site is technically up and running again now, but soon became overloaded again. It may just need time to restabilize after the updates, or it may need more work. I'll keep looking into it.

[Diego Curtarello]

Goodmorning!

I checked the website and at the moment is still running, hopefully is not going down anymore! Thank you very much for your worl, Stephen!

[Paulina Roque]

Hi Everyone

Is the website down again? I’ve been trying to log in and upload pictures, but the website does not want to load at all. My group has been having this issue for the past two days. Thank you for your help! 

[Stephen Chan]

Looks like the site's been mostly unresponsive for 20 of the past 24 hours. I'll keep working on it.

[Andi Muh. Agung Pratama. A.R]

Dear Stephen,

Over the past few days, we have been trying to complete our analysis, but we are encountering an issue. After clicking “Save,” the confirmation appears, but when we reload the project, the changes are not retained.

Could you please confirm if the system is currently under maintenance? If so, it would be helpful to know how long this is expected to continue so we can adjust our analysis schedule accordingly.

Thank you for your support.

[Stephen Chan]

Hi Andi,

The site isn't currently under maintenance.

Do you mean the Save button on the annotation tool? And if so, by the confirmation do you mean the words "ALL DONE"?

[Dhevin Fernando]

Dear Stephen,

Just wanted to check if CoralNet is down again? I was able to work on my source yesterday and was still able to access it about 45 minutes ago but now the page isn't loading anymore. Just want to check if there's a scheduled time for the site to be up and running again? Sorry if this is something that has been asked repeatedly! 

Thanking you for your help.

[Stephen Chan]

Hi Dhevin,

CoralNet is not currently under planned maintenance. It has been going unresponsive at unpredictable times due to the ongoing issues.

[Andi Muh. Agung Pratama. A.R]

Hi Stephen,

The “Save” button on the annotation tool appears and shows “ALL DONE,” but the changes are not actually saved. The frame remains orange, whereas it usually turns green after the analysis is completed and successfully saved.

Cheers, AG

[Stephen Chan]

As a general update: it looks like the site has been a little more stable in the past day and a half. Still, I am working on a few optimizations that will probably be ready to roll out during the weekend.

AG: So far I haven't been able to replicate this annotation status issue. Maybe you could let me know the source you are working on, as well as a few specific images in the source that exhibited this issue, and I can take a closer look. If it's a private source, you can message me privately with "Reply to author".

[Jamie Hayes]

Dear Stephen,

I am just wondering if Coralnet is down again? I am currently not able to log onto any pages and am greeted by "504 Gateway Time-out nginx"

Thank you

[Stephen Chan]

Hi Jamie,

The site was indeed unresponsive for a few hours, including when you posted here. At the moment it's back to being fine. But, it seems the issues will probably come back unless more improvements are made.

I'm still working on the next round of optimizations, and will follow up here when they are ready.

[Zach Ferris]

Hi all,

Thanks, Stephen, for addressing the recent downtimes.

Yesterday, the site worked well in the morning but was down in the afternoon. This same pattern occurred today as well. The error message is "504 Gateway Time-out".

Thanks,

Zach