Unexpected Shutdown Caused by ASR

Posted in: Technical Track

In past few days I had two incidents and an outage, for just a few minutes. However, outage in a production environment is related to cost relatively and strictly. The server that had outage was because of failing over and then failing back about 4 to 5 times in 15 minutes. I was holding pager, and was then involved in investigating root cause for this fail-over and failed-back. Looking at the events in SQL Server error logs did not give me any clue towards what was happening, or why so I looked at the Windows Event View’s System log. I thought, “Maybe I have something there!”

There were two events that came to my attention:

Event Type:        Error

Event Source:    EventLog

Event Category:                None

Event ID:              6008

Date:                     7/24/2014

Time:                     1:14:12 AM

User:                     N/A

Computer:          SRV1

Description:

The previous system shutdown at 1:00:31 AM on 7/24/2014 was unexpected.

 

Event Type:        Information

Event Source:    Server Agents

Event Category:                Events

Event ID:              1090

Date:                     7/24/2014

Time:                     1:15:16 AM

User:                     N/A

Computer:          SRV1

Description:

System Information Agent: Health: The server is operational again.  The server has previously been shutdown by the Automatic Server Recovery (ASR) feature and has just become operational again.

 

 

The errors are closely related to the feature called Automatic Server Recovery (ASR) which is mainly configured with the server, and comes with the hardware. In our case, HP Blade, ProLiant server. There has been some resources/threads already discussed around similar topic. Most of the hardware vendor has somewhat similar software with similar functionality made available for servers.

In my case, my understanding was that maybe firmware are out of date and requiring updating, or the servers are aged. Further, I have sent my findings to customer with an incident report.  In a couple of hours, I had a reply and the feedback I received was just what I was expecting, the hardware was aged.  This may be the case with you when you see a message in event viewer which reads like “System Information Agent: Health: The server is operational again.  The server has previously been shutdown by the Automatic Server Recovery (ASR) feature and has just become operational again.”  Go check with your system administrator. The root cause of this unexepcted shutdown may not be related or caused by the SQL Server, rather, the system itself.  Please keep in mind that this could be one of the reasons, and certainly not the only.

References:

Automatic System Recovery

 

Interested in working with Hemantgiri? Schedule a tech call.

About the Author

I am a Database Administrator by profession, and a student of a university called life by heart. I am open and willing to learn things as it comes and is interest to me. I am passionate about SQL Server, photography, reading and sharing. During my professional life, I have privileged to work with some great a-like-minded people from whom I learnt a lot, technical as well as soft skills; I am trying and will continue to share what all I have learnt over the years by connecting a-like-minded via many technological forums.Currently, I'm Lead Database Consultant @Pythian. I have close to 17 years of experience, about which 15 years as hard core DBA. I have been a Microsoft SQL Server MVP for four years, and a published author of the book - SQL Server 2008 High Availability; a book for SQL Server DBA aspirants, System Administrators and Developers, it provides step-by-step information to get you through the installation of various SQL Server High Availability options like Clustering, Replication, Database Mirroring and Log Shipping. Sounds interesting, read more about me at http://www.sql-server-citation.com/p/about-me.htmlSpecialties: IT Project Management, SQL Server High Availability, Performance Tuning I have worked on IT Project Management using latest tools like Six Sigma, PMP and ITIL.Keep in touch with me: Twitter: https://twitter.com/ghemant Facebook: https://www.facebook.com/SQLServerCitation

No comments

Leave a Reply

Your email address will not be published. Required fields are marked *