Definition

enterprise storage

Enterprise storage is a centralized repository for business information that provides common data management, protection and data sharing functions through connections to computer systems. Because enterprises deal with heavy workloads of business-critical information, enterprise storage systems should be scalable for workloads of hundreds of terabytes or even petabytes without relying on excessive cabling or the creation of subsystems. Other important aspects of an enterprise storage system are unlimited connectivity and support for multiple platforms.

Approaches to enterprise storage

A storage area network (SAN) is a dedicated high-performance network or subnetwork dedicated to storage that is independent of an organization's common user network. It interconnects pools of disk or solid-state storage and shares it to multiple servers so each one can access data as if it was directly attached. The three principle components that enable the interconnectedness of a SAN are cabling, host bus adapters (HBAs), and Fibre Channel (FC) or Ethernet switches attached to servers and storage. Admins centrally manage all the storage in a SAN with benefits such as high availability (HA), disaster recovery (DR), data sharing, efficient and reliable backup and restoration functions, as well as centralized administration and remote support. Through the SAN, multiple paths are created to all data, so failure of a server never results in a loss of access to critical information.

SAN architecture

Network-attached storage (NAS) enables multiple client devices and users to access data from a central pool of disk storage. Users access the shared storage of NAS, which appears as a node with its own Internet Protocol (IP) address on the local area network (LAN) over an Ethernet connection. Ease of access, low cost and high capacities characterize NAS.

network-attached storage

Direct-attached storage (DAS) is hard disk drives (HDDs) or solid-state drives (SSDs) connected directly inside or outside (in a storage enclosure) to a single computer or server that cannot be accessed by other computers or servers. Unlike NAS and SAN, DAS is not networked through Ethernet or FC switches.

DAS

Because DAS data isn't networked, it offers better performance for the server it is attached to. However, that also means DAS data can't be pooled and shared among servers. And, unlike NAS or SAN, the number of expansion slots in a server and the size of the DAS enclosure limit storage capacity. DAS also lacks more advanced storage management features, such as snapshots and remote replication, which are available in SAN and NAS devices.

Major trends

Newer approaches and technologies in enterprise storage that have trended upward over the last several years include cloud storage, hyper-converged storage and flash technologies, such as non-volatile memory express (NVMe).

Storage for containers is also becoming more important, and enterprise storage based on composable and disaggregated infrastructure concepts is starting to make some noise.

In addition, artificial intelligence (AI) and machine learning in the area of predicative analytics, as well as storage-class memory (SCM), should have a major impact on enterprise storage in the near future, if they haven't started to already.

Cloud storage

Enterprise cloud storage consists of storage capacity purchased from a public cloud service provider. Enterprises often turn to cloud storage to reduce or eliminate excessive on-premises storage costs, reduce the complexity of managing storage and upgrade data center infrastructure. The three major public cloud storage providers are Amazon Web Services (AWS), Google Cloud and Microsoft Azure. Others include Alibaba Cloud, IBM's Bluemix, Oracle and Rackspace, as well as a host of regional providers.

There are also systems integrators and managed providers offering cloud services, and many traditional software companies now offer cloud storage services for their applications and services. Lastly, cloud gateway vendors, like Panzura, have made enterprise cloud storage a part of their hybrid architectures, as have storage management vendors that have integrated management as a service (MaaS) into their products.

Hyper-converged and converged infrastructure

Hyper-converged storage integrates storage, compute and sometimes networking in a single unit. It adds a virtualization layer to the mix with storage managed through the hypervisor. That makes hyper-convergence a type of software-defined storage that enables all the storage in each node to be pooled across a cluster to give administrators more control of storage provisioning in a virtual server environment.

This gives hyper-converged storage a much higher degree of horizontal scalability because you simply plug a new node into your infrastructure to add more storage and compute resources.

scaling hyper-converged

A hyper-converged infrastructure (HCI) is different than a converged infrastructure (CI) that bundles the traditional SAN components -- storage, compute and networking -- into a preconfigured SKU that is sized and tuned before the sale. HCI moves those capabilities into a single box that can be clustered with other similar nodes. CI is a staple of enterprise storage, while HCI began mainly as an efficient way to run heavily virtualized loads, such as virtual desktop infrastructure (VDI). HCI has made its way into the enterprise, and now, HCI clusters typically run multiple workloads.

NVMe, storage-class memory and AI

The storage industry developed the NVMe host controller interface and storage protocol to speed up data transfer between servers and SSDs over the Peripheral Component Interconnect Express (PCIe) bus. It greatly reduces latency, removing communication between computer and fast SSD storage as a bottleneck, resulting in a significant increase in IOPS. The purpose of the related NVMe over Fabrics (NVMe-oF) specification is to extend the benefits of NVMe over network fabrics, like FC, Ethernet and InfiniBand.

NVMe and IOPS

The move toward widespread adoption of NVMe is a step toward another industry transition: SCM. SCM includes new types of non-volatile memory, like Samsung's Z-NAND media and Intel's 3D XPoint Optane, that combine the best of traditional storage and memory technologies by closing the huge performance gap between dynamic random access memory (DRAM) and flash storage in non-volatile storage packages. Slower than DRAM, SCM is far more scalable than standard memory and delivers 10 times the IOPS of NAND flash drives. Furthermore, unlike flash drives, SCM can be addressed at the byte rather than block level, which could eliminate huge amounts of I/O overhead for even better performance.

AI and, to a greater extent, machine learning have begun to permeate many different aspects of IT management, including storage. Machine learning algorithms are starting to be used for predictive storage analytics and storage management. For example, they enable storage management processes to learn and alter settings and operations to optimize workloads, broker storage infrastructure, manage large-scale data sets, and root out the causes of problems and abnormalities and fix them.

Disaggregated and composable storage

Some observers view composable infrastructure and disaggregated infrastructures as the next stages in the evolution in HCI. They retain the benefits of hyper-convergence -- such as physically combining computer resources into an easily scalable framework via nodes -- while making it easier to add more storage and compute hardware independently.

Disaggregation is accomplished by separating these computer components into discrete individual pools of CPU, cache, fabric, memory and storage resources than can be served on demand to specific applications. It combines these individual resources -- with the emphasis on individual -- at the hardware level and assembles them at the software level using application programming interfaces (APIs).

Composable infrastructure creates or composes consumable sets of hardware resources and combines them into a virtualized whole. So, instead of disaggregating these components, including storage, into virtual resources at the hardware level and then serving storage, memory and compute up individually using software like disaggregated infrastructure, composable infrastructure combines these singular pools of resources into a unified virtual infrastructure unit that a software entity operates.

Container storage

Unlike standard monolithic applications, containerized applications can consist of hundreds or thousands of individual related containers, each hosting isolated and separate scalable processing modules of the overall application process. Containers were designed to let users easily develop and deploy stateless microservice layers of an application as a type of agile middleware, with no persistent data storage required.

One reason containerized application design has grown in popularity with enterprises over the last several years is the design's support for Agile application development and deployment. Containers can quickly scale up as needed in a production environment and then go away when no longer needed. It is the efficiency, scalability, agility, cloud-friendliness and lower costs of this approach that have enterprises looking to container architectures for purposes beyond microservices.

As a result, container vendors, such as Docker and Kubernetes, started to bring some level of persistent data storage support to containers. In addition, startups such as Portworx have addressed this issue, often more thoroughly, by enabling container storage volumes to move with their containers.

Container data, like all enterprise data, needs protection. Due to a number of factors, containers by their nature cannot provide backup data to standard backup applications directly. They require an underlying orchestration platform at the storage or host layer. A number of storage vendors have stepped up and enabled enterprises to back up container data -- including Asigra, Blockbridge Networks, Commvault, NetApp, Nimble Storage and Pure Storage -- by offering this orchestration layer.

This was last updated in November 2018

Continue Reading About enterprise storage

Dig Deeper on Storage management and analytics

Disaster Recovery
Data Backup
Data Center
Sustainability and ESG
Close