topleft topright
CIOZone Forums
Welcome, Guest
Please Login or Register.    Lost Password?

Go to bottom Post Reply Favoured: 0
TOPIC: Re:Is Server Management Stressing Out IT?
Re:Is Server Management Stressing Out IT? 6 Years, 6 Months ago Karma: 0  
Ahh, server managment. Or should I say server mismanagement? As a long-time server/ datacenter admin (and now consultant), my experience is that a great deal of the pain of server management is due to unqualified people working on them, lousy management practices when it comes to server administration, and failure to document, automate, and be proactive.
A well-built server, when properly designed, implemented, and maintained, will give years of almost trouble-free service. It's the human factor that causes the grief.

I've done a lot of datacenter work and have been a consultant to a variety of clients that manage server farms. I've seen well-run and disastrous. Trying to run a highly-available server farm on the cheap just isn't going to happen.
The first requirement is good people. There are a lot of server admins out there who should never be allowed near anything with a keyboard. Too many companies also horizontally divide IT and eliminate any end-to-end responsibility. If an admin knows how to install windows but nothing about the application running on it, and the app tech doesn't know anything about how a server OS works, that server is never going to run right.
And it takes a certain breed of troubleshooter and wizard to diagnose and properly repair server-related problems, too. Hiring the right type of person to run and maintain servers is critical. You have to pay them well and treat them well or they go somewhere else. But too many companies are content with dime-a-dozen so-called admins who can't troubleshoot a driver issue to save their lives.

Management has to be willing to spend some money on maintenance and make it a priority. Too many companies want IT to be a profit center and that's not realistic. Proactive monitoring is important, too. This one factor has made a significant difference in many of the clients I've seen. Those that had proactive monitoring could keep 5 9's uptime easily; those without it never could. When IT gets a phone call that says "I think the server is down", they have failed completely. As a server admin, I should always be the first to know there's a problem.

So let's take a hypothetical example. CompanyA has 25 servers at their single-site office. They have one server admin who used to build his own PCs and was the only one that knew enough to install MS Exchange. Their IT work consists of rebooting the servers when they crash, which is daily for some, weekly for others. They don't want to spend money to upgrade, implement monitoring, patch management, or define and document IT policies and procedures. So they decide to go to Rackspace for all their server needs. They're able to consolidate and get down to 15 servers instead of their current 25. So now they're paying $25K per month to host those servers. "Wow. Our uptime is much better and our servers don't crash." Maybe that's because Rackspace is proactively monitoring them, maintaning them, documenting them, and hiring techs who know what they're doing? If they had implemented those same practices internally, their stuff would work well too. For a fraction of the money they spent on hosting, they could have educated their tech, implemented a monitoring sytem, and upgraded some of their old equipment.

Good server admins who understand and implement automation to keep things running can manage a staggering number of servers and still perform other tasks effectively. But it takes planning and ability. It must be proactive management. I consulted to a major financial institution bringing a subsidary in-house. The subsidary had 5 9's uptime for the previous 5 years due to our monitoring and proactive processes. During the migration I looked for the team that would take over the monitoring. I was stunned to find out there was none. "We have over a thousand servers. We can't proactively monitor each of them". There was nothing to say. Of course, their uptime was less than 90% corporate wide. Critical apps would go down for days at a time. I could implement a monitoring system that would end their reactive server management. But they're not interested. Their loss...

Another note about hosted server farms... While they definitely have their place, regulatory compliance issues (SOX, GLBA, HIPAA) can be formidable barriers to their use. Careful examination of what's stored there is critical to staying safe and legal. Even a webserver that just takes info and passes it on can be a huge risk if the data form caches aren't cleared out often enough. Say your customer has to put in PII. Name, address, SSN for a credit check; How long is it OK for that data to sit on that hosted server? A second? A minute? An hour, A day? A week? You'd better know, because if it gets hacked and your info might have been compromised, you better have your ducks in a row.

The tools are there to efficiently run server farms and data centers, for everyone from the SBS folks to the enterprise datacenters. I contend that the fault is with the people, not the servers...
Report to moderator   Logged Logged  
  The administrator has disabled public write access.
Re:Is Server Management Stressing Out IT? 6 Years, 5 Months ago Karma: 0  
I can't agree more as I was just thinking the same thing. Server management is not really all that hard with a skilled staff and good management. It does have multiple problems when the people working on them are just qualified enough to navigate the systems. I have seen this on multiple occasions in many different industries.

On the opposing side even an excellent admin can't overcome inept management and thus budgets that will never get the job done. Money must be freed up to invest in management and monitoring solutions which enable the IT departments to fix the problems as they come and as quick as possible.

Report to moderator   Logged Logged  
  The administrator has disabled public write access.
Re:Is Server Management Stressing Out IT? 6 Years, 5 Months ago Karma: 0  
Unfortunately, I think "inept management" is becoming all too common. A good admin will figure out ways to get around that. As a systems admin, my job is to work with whatever parameters I am given and make things work as well as possible. That often means going outside of "normal" best practices and making compromises that will allow things to work even if it's sub-optimal.
I think that it's important for admins to document their attempts to do it right and why they had to make any compromises, because if management is that inept, they're also likely to try to shift blame back to the admin when things blow up.

In the past, I think the admin's job had more to do with technical stuff, but these days there's a lot more of the balancing act trying to get things done with fewer resources.
Technical prowess is even more necessary now, though. A good admin just needs to be not only a tech wiz, but business savvy as well.

I totally agree that money has to come from somewhere to invest in IT infrastructure management. But it's SO hard to justify from an ROI standpoint. The returns on this type of IT spending are very nebulous; how can you say that investing in, let's say $100K for an enterprise management implementation saved you X? If things go really well, you're trying to quantify failures that didn't happen. That makes it really tough. If you don't put it in, and your LOB app goes down for 2 days, you can say "we could have saved X if we had the monitoring" but you can't always prove it and it sounds like whining.
It really does take good management that knows and appreciates the value of proactivity (is that a word?) to implement these solutions.
I've built a variety of homegrown monitoring solutions that are cheaper than the big stuff, but in the end, you still need to implement and monitor, which costs money.
I've also noticed that monitoring doesn't scale well. What works for a small org doesn't scale up to a large one. So the tools change as you climb the scale.
Report to moderator   Logged Logged  
  The administrator has disabled public write access.
Re:Is Server Management Stressing Out IT? 6 Years, 5 Months ago Karma: 0  
I agree, spending on Enterprise Management Solutions is often difficult to justify, but the cost of downtime or improperly configured servers or poorly running core applications within an organization tell the experience IT pro that these are investments that need to be made. Anyone that has ever "owned" the data center and the servers and apps that run on them can attest to the stress levels brought on by this ownership. The servers and apps are like children, they need constant attention, without which you will suffer bigger problems in the future.
Report to moderator   Logged Logged  
  The administrator has disabled public write access.
Re:Is Server Management Stressing Out IT? 6 Years, 5 Months ago Karma: 0  
One thing I learn as a consultant as their will always be companies who want to get by with less only to hire people like me to fix it. If they would only stick to some simple principles they would save money and put many consultancies out of business. This however will not happen any time soon.

Report to moderator   Logged Logged  
  The administrator has disabled public write access.
Re:Is Server Management Stressing Out IT? 6 Years, 4 Months ago Karma: 0  
I think server management ties to the type of organization. None IT-based companies or organizations do not believe in IT spending when they start. If the business takes off, they realize that IT is in fact required, and they race to fix up the mess.

I have across a number of situations where the business owners look at me funny when I tell them about server management and IT infrastructure. A year later, long and behold, I get a call to come and fix the mess.

IT-based companies, however, start on the right foot – at least the ones with some experience.
Report to moderator   Logged Logged  
  The administrator has disabled public write access.
Go to top Post Reply
Powered by FireBoardget the latest posts directly to your desktop
Copyright © 2007-2016 CIOZones. All Rights Reserved. CIOZone is a property of MMINC Digital Inc.