- 1/4/08, 2:30PM: All services should now be restored. If you
continue to experience problems, please contact your LSP. If you are a
student and experiencing further problems, please use the following form:
http://www.sas.upenn.edu/computing/forms/student_email_help.html or email
help@sas.upenn.edu.
- 1/4/08, 1:45PM: All file systems have been re-enabled. All users
should have full access to their Inbox and mail folders. All web
services should now be functional.
The only remaining issue is the shell frontends and sftp access. The
frontends will be rebooted within the hour and we expect this to complete
repairs.
- 1/4/08, 1:20PM: Data consistency checks are almost complete, and
results look good. We expect to have significant news by 2:30pm.
- 1/4/08, 11:40AM: Sun Engineers and ISUS staff have made significant
progress, and the system is now checking data consistency on the affected
directories. We will provide an update on this process by 1pm.
N.B.: A problem some users were experiencing when mailing system
aliases/lists should be resolved for now.
- 1/4/08, 10:00AM: Late last night, ISUS staff corrected a problem
affecting some users with home directories in /home4 and /home5 which was
preventing them from sending/receiving mail. These users can now
send/receive mail, but cannot yet see the Mail folders in their home
directory.
Sun Engineers are working to restore the remaining
volumes. Expect an update around noon.
- 1/3/08, 10:45PM: Mail.sas has returned from reboot with the same set
of services available (sending/receiving mail and web services). The
repaired hardware is still undetected by the system and Sun will be
working through the night to provide a plan of action. We are taking
every precaution in order to avoid data loss. We will update again in
the morning.
- 1/3/08, 9:45PM: Hardware has been repaired. System reboot is needed
to make system aware of new storage. System should return within the
hour.
- 1/3/08, 9:00PM: Mail.sas has returned from reboot and the same set of
services available at 12:45pm are again available. This includes
sending/receiving mail, and web services. Sun technicians and SASC staff
are on-site debugging hardware. Another reboot may be necessary later
this evening.
- 1/3/08, 6:30PM: Mail.sas experienced an unplanned shutdown during
diagnosis. The system is rebooting and checking file systems. We will
update this page when we have an estimated time for return of
service.
During this time, www.sas.upenn.edu web pages are not available. Mail
delivery to facstaff and PennLive accounts is operational, but may
experience some delays in delivery.
- 1/3/08, 12:45PM: ISUS staff are actively working with Sun
MicroSystems to resolve the hardware issue.
Currently, all mail.sas users can send and receive mail. Some users,
however, will only have access to their inbox, and will not be able to
access other mail folders.
Static web
pages on www.sas are functioning as well. We will update this page as
issues are resolved. A system shutdown may be necessary this evening to
correct additional problems.
Remaining issues:
- Mail1.sas and mail2.sas shell servers are still unavailable
- Sftp for web-updates is not currently functional
- Some web forms are not currently functional
- Mail.sas WebAccount Services is not currently functional
- Users with home directories in /home4 or /home5 cannot currently
access mail folders other than their INBOX
- 1/3/08, 5:30AM: The mail.sas server experienced a serious
storage problem. ISUS on-call staff is diagnosing. Facstaff and PennLive
are unaffected.
Last modified: January 04, 2008 14:41