MAJOR PENNNET OUTAGE 2014-12-04T19:22:05-05:00

gistfile1.txt

Date:                   Thursday, December 4, 2014 EST

Start time:             4:00 pm

Duration:               Unknown

Building(s) Affected:   Entire Campus 

Service(s) Affected:    ALL 

Description:            Good Evening, 
                        
                        Shortly before 4:00pm we experienced a problem on
                        our primary core services network (NOC1) that 
                        caused widespread disruption to several campus 
                        services including but not limited to: 
                        
                        1. Your ability to log in to websites with your 
                        PennKey username and password. 
                        
                        2. Central Email Services: Individuals who use 
                        either Zimbra and ISC Exchange, or the ISC 
                        Mailing Lists service were likely unable to send 
                        and receive email messages. During the 
                        disruption, messages sent to these users from 
                        other mail services were cached offsite and will 
                        be delivered this evening. 
                        
                        3. Wireless Connectivity: AirPennNet and 
                        AirPennNet-Guest may have been visible, but users
                        were unable to log in or get/maintain a network 
                        address. 
                        
                        4. Wired Connectivity: If your network connection
                        relied on the central DHCP service you may have 
                        been unable to obtain or renew your IP address 
                        lease. 
                        
                        The nature of the outage also disrupted 
                        connectivity to our monitoring systems making it 
                        difficult to provide a complete list of all the 
                        services that were impacted. 
                        
                        Our Systems team completed restoration of all the
                        systems and services hosted on the NOC 1 network 
                        at 6:37pm. We will continue to investigate the 
                        root cause and will take necessary measures to 
                        prevent a reoccurrence of this evening's 
                        disruption. 
                        
                        Our sincere apologies for the inconvenience that 
                        many in the Penn community experienced as a 
                        result of this problem and thank you for your 
                        patience as we worked to restore normal and 
                        reliable service. 




ISC Client Care
University of Pennsylvania
[email protected]
http://www.upenn.edu/isc/help/
(215)898-1000
Monday-Friday 8:00am - 6:00pm

To check the status of PennNet, please visit http://www.upenn.edu/isc/help/ and select "PennNet Status".