CSL Service Outage
Resolved
May 29, 2023 at 9:42pm UTC
The incident has been resolved.
Affected services
Director Sites
Updated
May 29, 2023 at 9:42pm UTC
Director sites are now up.
Affected services
Director Sites
Updated
May 29, 2023 at 6:18pm UTC
Over the weekend, CSL storage servers experienced issues while rebalancing due to high storage usage. This caused many CSL services to go down.
Sysadmins have been working to restore services. Most services, including Ion, mail and JupyterHub (cluster) are up. The Director management interface is up, but some Director sites are experiencing downtime.
We have made backend storage changes to Ion to guarantee its uptime. Ion will be reliable through the end of the school year. At this time, we are unable to guarantee the availability of other CSL services.
Thank you for your patience as we work to resolve this incident.
Affected services
Director Sites
Updated
May 29, 2023 at 6:06pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 5:53pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 5:31pm UTC
Ion recovered.
Affected services
Ion
Updated
May 29, 2023 at 5:24pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 5:23pm UTC
Tin recovered.
Affected services
Tin
Updated
May 29, 2023 at 5:18pm UTC
Tin went down.
Affected services
Tin
Updated
May 29, 2023 at 4:56pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 4:49pm UTC
Director recovered.
Affected services
Director
Updated
May 29, 2023 at 4:47pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 3:50pm UTC
Director went down.
Affected services
Director
Updated
May 29, 2023 at 3:34pm UTC
Director recovered.
Affected services
Director
Updated
May 29, 2023 at 3:29pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 3:25pm UTC
Director went down.
Affected services
Director
Updated
May 29, 2023 at 3:23pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 2:53pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 2:38pm UTC
Tin recovered.
Affected services
Tin
Updated
May 29, 2023 at 2:27pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 2:02pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 1:59pm UTC
Tin went down.
Affected services
Tin
Updated
May 29, 2023 at 1:47pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 1:38pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 1:32pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 12:55pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 12:46pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 11:26am UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 10:56am UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 9:49am UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 9:44am UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 8:55am UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 8:47am UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 29, 2023 at 8:06am UTC
Webapps and Othello recovered.
Affected services
Webapps
Othello
Updated
May 29, 2023 at 7:57am UTC
Webapps and Othello went down.
Affected services
Webapps
Othello
Updated
May 29, 2023 at 7:01am UTC
Tin recovered.
Affected services
Tin
Updated
May 29, 2023 at 6:27am UTC
Webapps and Othello recovered.
Affected services
Webapps
Othello
Updated
May 29, 2023 at 6:25am UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 6:20am UTC
WWW, Tin, WWW, and 1 other resource went down.
Affected services
Tin
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 6:18am UTC
Webapps and Othello went down.
Affected services
Webapps
Othello
Updated
May 29, 2023 at 6:12am UTC
Director recovered.
Affected services
Director
Updated
May 29, 2023 at 6:07am UTC
Director went down.
Affected services
Director
Updated
May 29, 2023 at 5:58am UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 5:43am UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 5:34am UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 5:28am UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 29, 2023 at 5:10am UTC
Tin recovered.
Affected services
Tin
Updated
May 29, 2023 at 5:02am UTC
Tin went down.
Affected services
Tin
Updated
May 29, 2023 at 3:09am UTC
Director recovered.
Affected services
Director
Updated
May 29, 2023 at 3:04am UTC
Director went down.
Affected services
Director
Updated
May 29, 2023 at 1:52am UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 29, 2023 at 12:14am UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 28, 2023 at 11:22pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 11:04pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 9:33pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 9:31pm UTC
Tin recovered.
Affected services
Tin
Updated
May 28, 2023 at 9:30pm UTC
Director recovered.
Affected services
Director
Updated
May 28, 2023 at 9:28pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 28, 2023 at 9:22pm UTC
Tin went down.
Affected services
Tin
Updated
May 28, 2023 at 7:13pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 5:54pm UTC
Director went down.
Affected services
Director
Updated
May 28, 2023 at 5:39pm UTC
Director recovered.
Affected services
Director
Updated
May 28, 2023 at 5:24pm UTC
Director went down.
Affected services
Director
Updated
May 28, 2023 at 5:18pm UTC
Director recovered.
Affected services
Director
Updated
May 28, 2023 at 5:12pm UTC
Director went down.
Affected services
Director
Updated
May 28, 2023 at 5:03pm UTC
Director recovered.
Affected services
Director
Updated
May 28, 2023 at 5:00pm UTC
Director went down.
Affected services
Director
Updated
May 28, 2023 at 4:52pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 28, 2023 at 4:42pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 4:37pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 4:31pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 28, 2023 at 4:27pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 28, 2023 at 4:24pm UTC
Tin recovered.
Affected services
Tin
Updated
May 28, 2023 at 4:24pm UTC
Director recovered.
Affected services
Director
Updated
May 28, 2023 at 3:41pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 28, 2023 at 3:34pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 28, 2023 at 2:41pm UTC
Webapps and Othello recovered.
Affected services
Webapps
Othello
Updated
May 28, 2023 at 4:35am UTC
Webapps and Othello went down.
Affected services
Webapps
Othello
Updated
May 27, 2023 at 10:42pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 27, 2023 at 10:36pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 27, 2023 at 10:20pm UTC
Director went down.
Affected services
Director
Updated
May 27, 2023 at 10:16pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 27, 2023 at 10:02pm UTC
Director recovered.
Affected services
Director
Updated
May 27, 2023 at 9:33pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 27, 2023 at 8:54pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 27, 2023 at 8:48pm UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 27, 2023 at 8:43pm UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 27, 2023 at 8:08pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 27, 2023 at 8:02pm UTC
WWW, WWW, and JupyterHub recovered.
Affected services
JupyterHub
WWW
WWW
Updated
May 27, 2023 at 7:45pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 27, 2023 at 7:36pm UTC
Director went down.
Affected services
Director
Updated
May 27, 2023 at 7:09pm UTC
Tin went down.
Affected services
Tin
Updated
May 27, 2023 at 7:03pm UTC
WWW, Tin, WWW, and 1 other resource recovered.
Affected services
Tin
JupyterHub
WWW
WWW
Updated
May 27, 2023 at 6:51pm UTC
Tin went down.
Affected services
Tin
Updated
May 27, 2023 at 6:48pm UTC
WWW, WWW, and JupyterHub went down.
Affected services
JupyterHub
WWW
WWW
Updated
May 27, 2023 at 6:43pm UTC
Ion went down.
Affected services
Ion
Updated
May 27, 2023 at 5:03am UTC
Director Sites recovered.
Affected services
Director Sites
Updated
May 27, 2023 at 5:02am UTC
Tin recovered.
Affected services
Tin
Updated
May 27, 2023 at 5:01am UTC
Director and Remote Access Servers recovered.
Affected services
Director
Updated
May 27, 2023 at 5:01am UTC
Webapps and Othello recovered.
Affected services
Webapps
Othello
Updated
May 27, 2023 at 5:00am UTC
DNS Nameservers recovered.
Affected services
Updated
May 27, 2023 at 4:59am UTC
Webmail recovered.
Affected services
Webmail
Updated
May 27, 2023 at 4:49am UTC
Ion recovered.
Affected services
Ion
Updated
May 27, 2023 at 4:42am UTC
Webmail went down.
Affected services
Webmail
Updated
May 27, 2023 at 4:41am UTC
Director went down.
Affected services
Director
Updated
May 27, 2023 at 4:41am UTC
Ion went down.
Affected services
Ion
Updated
May 27, 2023 at 4:41am UTC
Remote Access Servers and DNS Nameservers went down.
Affected services
Updated
May 27, 2023 at 4:40am UTC
Webapps and Othello went down.
Affected services
Webapps
Othello
Updated
May 27, 2023 at 4:39am UTC
Director Sites went down.
Affected services
Director Sites
Updated
May 27, 2023 at 4:39am UTC
Tin went down.
Affected services
Tin
Created
May 27, 2023 at 4:37am UTC
Ceph went down.
Affected services