What is the future of DevOps?
The paradigm shift happened fast. Nimble companies leveraged cloud to break down silos between operations and development and embraced agile development for faster cycle times to create strategic advantage. They merged teams of engineers across the application lifecycle from development and test to deployment and operations and created new roles requiring a range of skills not limited to a single function. Then, they pushed the envelope even further with CI/CD and DevOps to automate pipelines for even faster delivery.
What comes next? True, evolved AIOps. That is the future of DevOps.
DevOps needs AIOps
DevOps is tasked with maintaining a toolchain for automated delivery of new code, scaling on-demand, and five-nines uptime. In their spare time, they work on improving performance and controlling cost. For a sizable application, there can be thousands of virtual machines or containers, each with a stack of software, plus cloud services like load balancers and auto scalers all of which have to be configured and maintained. And all of that is in constant motion.
One large unicorn I talked with has hundreds of developers, more than a hundred code pushes per day, over 4,000 virtual machines in the cloud and petabytes of data collected each month. Their DevOps team is just a dozen strong and didn’t even have a VP until last year. This is a Herculean-Sisyphean task.
Managing this myriad of challenges defies the speed and scale of human beings. Fortunately, AIOps is emerging as a solution.
The term AIOps was coined by Gartner, who defined it as “AIOps platforms enhance IT operations through greater insights by combining big data, machine learning, and visualization. IT leaders should initiate AIOps deployment to refine performance analysis today and augment IT service management and automation over the next two to five years.”
Gartner may have coined the phrase but in my humble opinion, they fell short of the mark. Their definition centers around humans in the loop while basically describing advanced big data analytics. To solve the DevOps Dilemma, we need to aim higher.
What should AIOps be?
Let’s start with what it shouldn’t be – a whitewash of existing decision support and ticketing tools by large vendors adding “powered by AI” to their sell sheets. This is already happening, as it always does when new technologies threaten established vendors. Adding an API to an existing tool doesn’t qualify. If decisions require human intervention, you don’t have AIOps.
Here’s a comparison between what true AIOps should be vs DevOps:
- DevOps teams have the tendency to do the same things and try the same fixes first everytime.
- Human developers sometimes neglect an idea/solution because it’s either “too risky” or “too difficult to execute”.
- Human developers make and execute decisions usually based on their experiences and expertise.
- DevOps teams can only keep up with so much of the stuff that’s going on in the CI/CD toolchain (one of the reasons why continuous optimization is not an option with humans).
- AIOps systems learn from your data and adapt to how your app works, which means they won’t do the same thing every time.
- AIOps systems can exhaust all possible solutions to a problem, even executing ideas human developers deem too difficult or risky.
- AIOps systems make and implement decisions without human intervention. Yes, a human can be in the loop, but only until you can trust the system to run by itself.
- AIOps systems run continuously, and they become a standard part of your delivery.
The transition to AIOps is still in its infancy, but the battle is heating up and there are already success stories. VCs are placing bets, and vendors small and large are bringing new solutions to the market. Savvy people know that the future of DevOps is AIOps.
Starting with log analysis systems a few years back, we began to see automated root cause analysis and even failure prediction. Intrusion detection systems now learn from aberrant traffic, some even across companies. More recently, predictive auto-scaling systems have debuted. Opsani, our AIOps solution, can make decisions about virtual machine type, instances, and application parameters and deploy them into test or production using the customers’ existing DevOps toolchain and monitoring.
DevOps has replaced the traditional IT department. The titles have changed, as have the roles, but the challenges IT departments were built to address have not gone away; they have only been multiplied by the scale inherent in microservice architectures. Hence, for the future of DevOps to look brighter, we need systems designed for these new challenges. AIOps must evolve over the coming years beyond Gartner’s vision to enable DevOps to embrace the scale and speed of modern development.
If you want more about how Opsani is shaping the future of DevOps, check out this video of Opsani in action. Or sign up for a 30-minute demo and see how we can save you a couple of dollars… a million times a year.