The COVID-19 pandemic has profoundly affected many areas of IT, including the data centre, where changes to the infrastructure -- particularly adoption of cloud services -- are bringing about the need for new skill sets among workers who staff them.
Perhaps no technology industry benefitted more from the pandemic than cloud computing; the location independence of cloud services makes them ideal for a world where the majority of line-of-business as well as IT workers are no longer in the office.
But does that mean businesses will rely on infrastructure-as-a-service (IaaS) and no longer need their own on-premises data centres and data centre IT teams? Analysts and futurists have been asking this question for about a decade, but now cloud, already strong before the pandemic, has gone through an inflection point and brought new immediacy to the issue.
The answer is that data centres are not going anywhere anytime soon, but they will look fundamentally different. That's good news for people currently working in data centres and those considering careers there, because adoption of cloud and other changes will create a wave of new opportunities.
Uptime Institute predicts that data centre staff requirements will grow globally from about two million full-time employees in 2019 to nearly 2.3 million by 2025. Growth in expected demand will mainly come from cloud and colocation data centres. Enterprise data centres will continue to employ a large number of staff, but cloud data centre staff will outnumber enterprise data centre staff after 2025, Uptime says.
On the hiring side, finding the right talent remains difficult for many organisations. In 2020, 50 per cent of data centre owners or operators globally reported having difficulty finding qualified candidates for open jobs, compared to 38 per cent in 2018, according to Uptime Institute.
For IT pros looking to be part of the new data centre, here are some of the top roles and in-demand skills to develop.
The role of the technical architect has grown in importance because applications are no longer deployed in technology silos. In the past, each application had its own servers, storage, and security. Modern data centres are built on disaggregated infrastructure where resources are shared across multiple applications.
This requires new infrastructure design skills to ensure application performance remains high as the underlying technology is being shared across a broad set of applications. And it requires high-level domain knowledge of network, storage, servers, virtualisation, and other infrastructure.
Data centre architect
The challenging job of data centre architect requires specific knowledge of the physical data centre -- an understanding of power, cooling, real estate, cost structure, and other factors essential to designing data centres.
Architects help determine the layout of the facility as well as its physical security. The internal design involving racks, flooring and wiring is also part of this role. If done poorly, the job can have an enormous negative impact on the workflows of the technical staff.
There is no single cloud provider, and an emerging and continually evolving enterprise role is selecting and managing cloud services -- private, public and hybrid. The attributes of cloud providers vary, with some being strong in specific regions while others may be better suited than competitors to provide specific services, for example.
In some cases, third-party cloud services are inappropriate, making private cloud the best answer, as is often the case when strict data privacy is called for.
Cloud services need to be constantly monitored and optimised to ensure businesses are not overspending in some areas and underspending in others. At the same time, cost optimisation cannot be allowed to result in performance issues. This role requires the skills to properly evaluate cloud offerings and provide ongoing management.
AI and ML
Data volumes are now massive and getting larger by the day, and with the rise of edge computing, more data will reside in more places. Artificial intelligence and machine learning are required to facilitate effective data management. There's a wide range of jobs in this area across the spectrum of the AI lifecycle, including training AI systems, modelling, programming and providing human-in-the-loop participation to ensure AI goals are being met.
The future data centre will be driven by analysing massive amounts of data. Expect this trend to continue as more data is being generated by IoT endpoints, video systems, robots -- almost everything we do. Data centre operations teams will make critical decisions based on the analysis of this data.
Businesses today have a shortage of people with analytic skills, particularly those who understand how to use AI/ML to accelerate the analysis.
Many IT engineers, particularly those who work with network infrastructure, are hardware centric. Sure, they may know how to hunt and peck on a command-line interface, but that's not really a software skill. Most network engineers have never executed even basic software functions like making an API call. Using APIs can make many tasks much easier than trying to write a script to parse a CLI.
Not all network engineers need to become programmers--although those who want to should focus on languages such as Python and Ruby--but all should become software power-users and understand how to use APIs and SDKs to perform administrative tasks.
All modern network infrastructure has been designed to be managed through APIs, many of them cloud based. The days of being a CLI jockey are over, and an unwillingness to admit it is the biggest threat to today's data-centre engineers.
Data centre security
There are multiple avenues for jobs in data centre security, given that this discipline refers to both physical and cyber security. Data centres house sensitive and proprietary data, and breaches can have disastrous consequences for an organisation.
Physical security was once done with badge readers and keypads, but there has been a wealth of innovation, including AI-enabled cameras, fingerprint scanners, iris readers and facial-recognition systems. This promises to be an exciting area to work in over the next decade.
Cyber security has also evolved as security-information and event-management tools transition to ML-based systems that enable security professionals to see things they never could before. Also, many advanced organisations are adopting zero-trust models to isolate application traffic from other systems. Through the use of micro-segmentation, secure zones can be created, minimising the "blast radius" of a breach.
Data centre networking
The role of the network in the data centre has changed significantly over the past decade. The traditional multi-tier architectures that were optimised for North-South traffic flows have shifted to leaf-spine networks that are designed for higher volumes of East-West traffic.
Also, software-defined networking (SDN) systems are being used to provision virtual-fabric overlays of the physical underlay. This brings greater automation, traffic visibility, and cost effectiveness to the data centre network.
Network engineers who work in data centres need to become familiar with new concepts associated with network fabrics such as Linux-based operating systems, open-source network platforms, VxLAN tunnels and Ethernet VPNs. These all increase the scalability, elasticity and resiliency of the network while simplifying network operations.
Also, most data centre platforms are now open by design, making vendor interoperability much easier and breaking the lock-in customers experienced in the past.
Another aspect of data centre networking that's changed is cloud connectivity. Historically, network engineers were concerned with the network inside the data centre, which is a highly controlled environment.
The rise of cloud and edge computing dictates that the network extend outside the physical confines of customer premises, across the wide area to the cloud provider. It's imperative that the network function as if it is a single, continuous fabric across all cloud locations. There are a number of ways to do this, including SD-WAN, SASE and direct cloud connects.
Jobs outside the data centre
What, if any, are the jobs for data centre professionals if they want to transition out of that environment but make use of their current skills? Unfortunately, those skills don't translate well. You don't see many mainframe engineers or PBX administrators around anymore.
However, while the future lies with the jobs outlined here, it will take a long time for legacy data centres to transition. After all, businesses do often adopt an "if it ain't broke, don't fix it" mentality when it comes to mission-critical systems.
So for those unable or unwilling to re-skill, it may be necessary to seek employers in verticals that tend to be on the slower end of technology adoption -- state and local government, regional banks, and specialty retail are some examples.
The future of data centres lies in distributed clouds, and that changes the skill sets needed to run them. Data centres are certainly not going away, but they will look much different in the future, and that should be exciting for all.