Server status

From EtherWiki
Revision as of 14:02, 15 July 2009 by Sstrader (talk | contribs)
Jump to: navigation, search

2009.07

Yesterday at around 18:00 EST, the Lunarpages servers and hosting went down, so all Ether sites went down too. They had an issue with their San Diego datacenter but were back up in a couple of hours.

--Sstrader 07:02, 15 July 2009 (PDT)

2009.05

The issue appears to have been caused by an incomplete code deployment; by midday, it was resolved. I'll keep an eye on any possible relapse.

--Sstrader 21:00, 21 May 2009 (PDT)

Updates to RadioWave's time zones processing code aren't playing well on the host's server. A fix should be available in the next day or so.

--Sstrader 21:34, 20 May 2009 (PDT)

2009.03

After the time change for daylight savings, several issues appeared in RadioWave:

  • Setting your account time zone to EST5EDT does not reflect the hour change (appears an hour behind). This is probably due to the web hosting servers missing the Timezone Updater. This is being researched.
  • Several stations chose this time to update thier schedule format and so their events are not getting imported into the RadioWave database. This should be fixed soon.

--Sstrader 07:15, 11 March 2009 (PDT)

Updates to the issues above:

  • The time zone issue resolved itself after a few weeks, so this is probably an unpatched JRE.
  • Schedule parser updated to accommodate new formats of the public broadcasting stations (KALW, WABE, WCLK, WFCR, WHQR, WXXI-FM) hosted at http://www.publicbroadcasting.net.

--Sstrader 07:12, 8 April 2009 (PDT)

2008.06

Getting NoClassDefFoundError exception on RadioWave JSP pages:

500 Servlet Exception
java.lang.NoClassDefFoundError
    at _RadioWave__jsp._jspService(/RadioWave.jsp:19)
    at com.caucho.jsp.JavaPage.service(JavaPage.java:75)
    at com.caucho.jsp.Page.subservice(Page.java:506)
    at com.caucho.server.http.FilterChainPage.doFilter(FilterChainPage.java:182)
    at com.caucho.server.http.Invocation.service(Invocation.java:315)
    at com.caucho.server.http.CacheInvocation.service(CacheInvocation.java:135)
    at com.caucho.server.http.RunnerRequest.handleRequest(RunnerRequest.java:346)
    at com.caucho.server.http.RunnerRequest.handleConnection(RunnerRequest.java:274)
    at com.caucho.server.TcpConnection.run(TcpConnection.java:139)
    at java.lang.Thread.run(Thread.java:595)

Resin 2.1.13 (built Thu Apr 1 10:57:42 PST 2004)

Working for EventNett. Different from the PermGen space exception.

Ticket #821813 opened at Lunarpages.

--Sstrader 07:27, 4 June 2008 (PDT)

Back online after several emails and phone calls. Still haven't received a message saying that they fixed the problem.

--Sstrader 20:30, 4 June 2008 (PDT)

2008.05

JSPs being served as raw text. Put in support ticket with Lunarpages.

--Sstrader 07:33, 17 May 2008 (PDT)

The issue was fixed after a couple of hours.

--Sstrader 07:21, 19 May 2008 (PDT)

2008.01

Code releases are causing periodic errors reporting "500 Servlet Exception". This is probably the Resin error first encounter in October of last year.

--Sstrader 06:03, 24 January 2008 (PST)

2007.11

Same cycle of down/contact host/back up. Still working on it...

--Sstrader 15:27, 5 November 2007 (PST)

After contacting Lunarpages, and being down most of yesterday, the server seems to be staying up today.

--Sstrader 09:16, 2 November 2007 (PDT)

There has been several periods of hour-long downtime over the past week (11:25, 1 November 2007 (PDT)). Checking with Lunarpages...

--Sstrader 11:25, 1 November 2007 (PDT)

2007.10

For around an hour up until 3:30 PM EST today, Resin was reporting an OutOfMemory error (more infor from Caucho here). This will generally appear when new code is uploaded, but happened unexpectedly today. Will monitor.

--Sstrader 12:34, 11 October 2007 (PDT)

2007.09

Response from Lunarpages:

We apologize for any inconveniences caused. Please be aware that when you reply to your ticket before we have answered it, it will be sent to the bottom of the ticket queue again and this will delay our reply.
We don't want you to be unhappy with the service but if there is any action on the server that is causing a significant degradation of services and affects all users adversely, we have to take a pro-active action. Your account was utilizing excessive MySQL resources, causing issues on the server. That's why your MySQL access was disabled without prior warning.
If you require a higher usage then allowed on shared servers you might want to try a VPS or Dedicated hosting plan.

--Sstrader 09:13, 19 September 2007 (PDT)

Back up. I had 9 extra database connections and so Lunarpages disabled my database user. Here's my second response to them after I updated the database caching code:

I've updated the code and am monitoring connections.
Secondary question: Why would you basically disable my web sites, inform me of it after the fact, and then not even reply to my requests 2 hours after the fact? I began working on this as soon as I received your email and worked quickly to resolve it. Why wasn't I returned the courtesy of a prompt response to my (simple) questions? I'm paying money and you're offering a service.
I'm not trying to be sarcastic. If for some reason I'm expecting too much, please clarify, but I really think you could have at least: given me something like a 2-hour warning (my 9 extra, inactive connection should not have degraded your server), and responded to my questions (after all, that speeds up the fix).
Thank you.

I'll post their response here when I receive it (or, if they get angry and bump me, on a new host).

--Sstrader 10:31, 13 September 2007 (PDT)

Both EventNett and RadioWave are currently having issues with database access. This should be resolved in a few hours.

--Sstrader 07:26, 13 September 2007 (PDT)

2007.06

Response from Lunarpages on last week's outage:

Our Muphrid server had experienced some issues this morning. The issues have been resolved now and all services have been restored. We apologize for the inconvenience.

--Sstrader 12:18, 25 June 2007 (PDT)

Both sites were down for a few hours today possibly due to disk space limits. No response yet from Lunarpages, but both sites are back up now.

--Sstrader 12:09, 22 June 2007 (PDT)

Redeployed EventNett and it's back up. Not sure what happened but every call to my code returned java.lang.NoClassDefFoundError as if WEB-INF/classes got dropped from the classpath.

--Sstrader 16:39, 7 June 2007 (PDT)

EventNett has been down since around 2:00 PM EST today, 7 June 2007. I've contacted the hosting service and they report no problems with the server. RadioWave is still up. I will be researching the problem this evening.

--Sstrader 13:22, 7 June 2007 (PDT)