Back to overview
Downtime

CSL Service Outage

May 27 at 12:37am EDT
Affected services
Ion
Director
Director Sites
WWW
Webapps
Webmail
Tin
Othello
WWW
Remote Access Servers
JupyterHub

Resolved
May 29 at 05:42pm EDT

The incident has been resolved.

Updated
May 29 at 05:42pm EDT

Director sites are now up.

Updated
May 29 at 02:18pm EDT

Over the weekend, CSL storage servers experienced issues while rebalancing due to high storage usage. This caused many CSL services to go down.

Sysadmins have been working to restore services. Most services, including Ion, mail and JupyterHub (cluster) are up. The Director management interface is up, but some Director sites are experiencing downtime.

We have made backend storage changes to Ion to guarantee its uptime. Ion will be reliable through the end of the school year. At this time, we are unable to guarantee the availability of other CSL services.

Thank you for your patience as we work to resolve this incident.

Updated
May 29 at 02:06pm EDT

Director Sites went down.

Updated
May 29 at 01:53pm EDT

Director Sites recovered.

Updated
May 29 at 01:31pm EDT

Ion recovered.

Updated
May 29 at 01:24pm EDT

Director Sites went down.

Updated
May 29 at 01:23pm EDT

Tin recovered.

Updated
May 29 at 01:18pm EDT

Tin went down.

Updated
May 29 at 12:56pm EDT

Director Sites recovered.

Updated
May 29 at 12:49pm EDT

Director recovered.

Updated
May 29 at 12:47pm EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 29 at 11:50am EDT

Director went down.

Updated
May 29 at 11:34am EDT

Director recovered.

Updated
May 29 at 11:29am EDT

Director Sites went down.

Updated
May 29 at 11:25am EDT

Director went down.

Updated
May 29 at 11:23am EDT

Director Sites recovered.

Updated
May 29 at 10:53am EDT

WWW, WWW, and JupyterHub went down.

Updated
May 29 at 10:38am EDT

Tin recovered.

Updated
May 29 at 10:27am EDT

Director Sites went down.

Updated
May 29 at 10:02am EDT

Director Sites recovered.

Updated
May 29 at 09:59am EDT

Tin went down.

Updated
May 29 at 09:47am EDT

Director Sites went down.

Updated
May 29 at 09:38am EDT

Director Sites recovered.

Updated
May 29 at 09:32am EDT

Director Sites went down.

Updated
May 29 at 08:55am EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 29 at 08:46am EDT

WWW, WWW, and JupyterHub went down.

Updated
May 29 at 07:26am EDT

Director Sites recovered.

Updated
May 29 at 06:56am EDT

Director Sites went down.

Updated
May 29 at 05:49am EDT

Director Sites recovered.

Updated
May 29 at 05:44am EDT

Director Sites went down.

Updated
May 29 at 04:55am EDT

Director Sites recovered.

Updated
May 29 at 04:47am EDT

Director Sites went down.

Updated
May 29 at 04:06am EDT

Webapps and Othello recovered.

Updated
May 29 at 03:57am EDT

Webapps and Othello went down.

Updated
May 29 at 03:01am EDT

Tin recovered.

Updated
May 29 at 02:27am EDT

Webapps and Othello recovered.

Updated
May 29 at 02:25am EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 29 at 02:20am EDT

WWW, Tin, WWW, and 1 other resource went down.

Updated
May 29 at 02:18am EDT

Webapps and Othello went down.

Updated
May 29 at 02:12am EDT

Director recovered.

Updated
May 29 at 02:07am EDT

Director went down.

Updated
May 29 at 01:58am EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 29 at 01:43am EDT

WWW, WWW, and JupyterHub went down.

Updated
May 29 at 01:34am EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 29 at 01:28am EDT

WWW, WWW, and JupyterHub went down.

Updated
May 29 at 01:10am EDT

Tin recovered.

Updated
May 29 at 01:02am EDT

Tin went down.

Updated
May 28 at 11:09pm EDT

Director recovered.

Updated
May 28 at 11:04pm EDT

Director went down.

Updated
May 28 at 09:52pm EDT

Director Sites recovered.

Updated
May 28 at 08:14pm EDT

Director Sites went down.

Updated
May 28 at 07:22pm EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 28 at 07:04pm EDT

WWW, WWW, and JupyterHub went down.

Updated
May 28 at 05:33pm EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 28 at 05:31pm EDT

Tin recovered.

Updated
May 28 at 05:30pm EDT

Director recovered.

Updated
May 28 at 05:28pm EDT

Director Sites recovered.

Updated
May 28 at 05:22pm EDT

Tin went down.

Updated
May 28 at 03:13pm EDT

WWW, WWW, and JupyterHub went down.

Updated
May 28 at 01:54pm EDT

Director went down.

Updated
May 28 at 01:39pm EDT

Director recovered.

Updated
May 28 at 01:24pm EDT

Director went down.

Updated
May 28 at 01:18pm EDT

Director recovered.

Updated
May 28 at 01:12pm EDT

Director went down.

Updated
May 28 at 01:03pm EDT

Director recovered.

Updated
May 28 at 01:00pm EDT

Director went down.

Updated
May 28 at 12:52pm EDT

Director Sites went down.

Updated
May 28 at 12:42pm EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 28 at 12:37pm EDT

WWW, WWW, and JupyterHub went down.

Updated
May 28 at 12:31pm EDT

Director Sites recovered.

Updated
May 28 at 12:27pm EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 28 at 12:24pm EDT

Tin recovered.

Updated
May 28 at 12:24pm EDT

Director recovered.

Updated
May 28 at 11:41am EDT

Director Sites went down.

Updated
May 28 at 11:34am EDT

Director Sites recovered.

Updated
May 28 at 10:41am EDT

Webapps and Othello recovered.

Updated
May 28 at 12:35am EDT

Webapps and Othello went down.

Updated
May 27 at 06:42pm EDT

Director Sites went down.

Updated
May 27 at 06:36pm EDT

Director Sites recovered.

Updated
May 27 at 06:20pm EDT

Director went down.

Updated
May 27 at 06:16pm EDT

Director Sites went down.

Updated
May 27 at 06:02pm EDT

Director recovered.

Updated
May 27 at 05:33pm EDT

Director Sites recovered.

Updated
May 27 at 04:54pm EDT

Director Sites went down.

Updated
May 27 at 04:48pm EDT

Director Sites recovered.

Updated
May 27 at 04:43pm EDT

Director Sites went down.

Updated
May 27 at 04:08pm EDT

WWW, WWW, and JupyterHub went down.

Updated
May 27 at 04:02pm EDT

WWW, WWW, and JupyterHub recovered.

Updated
May 27 at 03:45pm EDT

WWW, WWW, and JupyterHub went down.

Updated
May 27 at 03:36pm EDT

Director went down.

Updated
May 27 at 03:09pm EDT

Tin went down.

Updated
May 27 at 03:03pm EDT

WWW, Tin, WWW, and 1 other resource recovered.

Updated
May 27 at 02:51pm EDT

Tin went down.

Updated
May 27 at 02:48pm EDT

WWW, WWW, and JupyterHub went down.

Updated
May 27 at 02:43pm EDT

Ion went down.

Updated
May 27 at 01:03am EDT

Director Sites recovered.

Updated
May 27 at 01:02am EDT

Tin recovered.

Updated
May 27 at 01:01am EDT

Director and Remote Access Servers recovered.

Updated
May 27 at 01:01am EDT

Webapps and Othello recovered.

Updated
May 27 at 01:00am EDT

DNS Nameservers recovered.

Updated
May 27 at 12:59am EDT

Webmail recovered.

Updated
May 27 at 12:49am EDT

Ion recovered.

Updated
May 27 at 12:42am EDT

Webmail went down.

Updated
May 27 at 12:41am EDT

Director went down.

Updated
May 27 at 12:41am EDT

Ion went down.

Updated
May 27 at 12:41am EDT

Remote Access Servers and DNS Nameservers went down.

Updated
May 27 at 12:40am EDT

Webapps and Othello went down.

Updated
May 27 at 12:39am EDT

Director Sites went down.

Updated
May 27 at 12:39am EDT

Tin went down.

Created
May 27 at 12:37am EDT

Ceph went down.