Published: 12 May 2008
| Tools that automate complex storage processes are beginning to appear. Here's what's available and what benefits the tools can deliver today.
Managing all or most of your storage resources from a "single pane of glass" has been the Holy Grail of storage management, but the vision remains largely unrealized. For a variety of reasons, storage resource management (SRM) tools aren't engineered to deliver complex, multistep services such as storage provisioning, data migration and performance optimization across heterogeneous storage devices. They're also unable to coordinate the numerous people required to complete these tasks. When IT process automation is applied to storage management, it begins to address the issue of linking complex processes with multiple independent tools and automating some of the more rudimentary activities.
IT process automation tools provide a workflow that guides the storage administrator through the process. The real value is when these workflow engines are integrated with storage management apps to provide storage admins with information to make intelligent decisions and automate some of the more basic tasks.
Newer technologies, like storage networks, and server and storage virtualization, provide greater flexibility to mix-and-match IT resources to meet changing business needs. The ability to reallocate resources dynamically, independent of the physical configuration, has dramatically changed how IT services are delivered. But despite their benefits, newer technologies can often add management complexities.
For many firms, the yearly cost to manage an app can far outweigh its initial purchase price. In most IT organizations, it's a constant battle to balance capital and operational costs. The more complex the task, the more special management skills are required, and the management of these tasks is mostly done manually.
Highly skilled specialists are hard to find, take a long time to develop, are well compensated and difficult to keep. Jobs like provisioning storage, migrating data between arrays and optimizing performance can require the interaction of several experts. For example, moving a single application from one storage array to another may require the participation of storage, network, system, database and application admins. In addition, the business unit needs to be notified and management has to approve the changes. Through the planning, setup, execution and clean-up phases of a data migration project, there could be 50 to 100 unique operations.
To streamline the process, many companies dedicate project managers to coordinate the efforts of everyone working on a project. Most companies use Excel for status tracking and SharePoint for collaboration. These tools help, but require too much manual intervention.
All companies have a process they follow when they want to perform a storage management operation. Larger companies typically have run books that list the tasks, order of execution, individuals who will perform each task and approvals required. Run books codify a company's best practices about how it wants specific operational tasks performed. IT process automation (also referred to as run book automation) automates the end-to-end workflow associated with each procedure.
The goal of IT process automation is to move operational management from the craftsmanship era of storage management, where highly skilled personnel use a combination of scripts, point tools and manual processes, to an era of mass production where storage management can be performed in a repeatable fashion using interchangeable administrator resources.
Automating storage processes
Instead of trying to provide one tool that does it all, IT process automation links disparate tools across multivendor infrastructures and cross-management domains, providing a centralized portal to request, execute and monitor IT management operations.
There are no clear-cut criteria to determine if a company will benefit from process automation. But the following indicators can be used to identify whether an IT process management solution should be considered:
The cost of IT automation tools varies, with standalone IT process automation tools tending to be more expensive than storage management tools. But workflow (process automation) is becoming a standard part of some storage management tools at no additional cost. Microsoft's Windows Workflow Foundation is a .NET Framework 3.0 service that will make it easier for application vendors to deliver workflow capabilities within their products.
A sampling of vendors
BMC Software Inc. BMC Run Book Automation Platform (formerly RealOps) automates routine, labor-intensive and error-prone tasks by coordinating tasks across IT silos. By integrating with the storage management capabilities of Onaro (owned by NetApp), BMC extends business service automation into the storage domain. Because Onaro is primarily a monitoring and reporting product, the combined solution addresses tasks like configuration change control, service impact monitoring and provisioning request management.
EMC Corp. The first modules of EMC's IT Process Centre (ITPC) optimize the request and delivery of storage provisioning services. ITPC works with ControlCenter to automate specific storage management tasks. Automated Resource Manager is one of the ControlCenter products ITPC uses to automate storage provisioning. Expect EMC to next address automation in the areas of compliance, fault/incident remediation and data mobility.
Hewlett-Packard (HP) Co. Having acquired Opsware and Mercury Interactive, HP has one of the most comprehensive IT process automation portfolios. Its Operations Orchestration product provides various levels of automation to such manual tasks as building workflows, scheduling, notification and approval. Operations Orchestration integrates with HP's domain management tools for client, server, network and storage management. Storage Essentials (formerly AppIQ) is HP's tool for multivendor storage. The firm's process automation strength lies in client, server and network management domains; it's beginning to integrate storage into its IT process automation product.
IBM Corp. IBM's Tivoli Storage Process Manager (SPM) contains out-of-the-box workflows for storage provisioning and space reclamation. SPM leverages IBM's TotalStorage Productivity Center (TPC) to discover, report on and configure a multivendor storage environment. TPC also automates some storage management functions based on user-defined policies.
Incipient Inc. Incipient Automated Data Migration (iADM) software automates the data migration workflow process. It provides a central repository for server, SAN and storage configuration information required in the planning, resource reservation and execution of data migration projects. iADM comes with its own network-resident data mover software, but also supports other host-, network- or array-based data movers.
SANpulse Technologies Inc. SANpulse's SAN Logics 2.0 is an integrated SRM and run book automation tool. It automates storage management processes such as provisioning, data migration, data center consolidation, space reclamation and tier migration.
Symantec Corp. The company's Veritas Process Automation Manager (PAM) coordinates and enforces policies and complex workflows throughout the storage environment. Symantec provides device-specific adapters that work cooperatively with PAM to collect configuration information, and to make active configuration changes for processes such as provisioning, capacity reclamation, data tiering and migration.
Product selection considerations
Configuration management database (CMDB). The CMDB is the core of a storage automation product. It holds a snapshot of the environment, change control, scheduling and the status of all the processes planned, currently executing and completed. CMDBs typically include environment information from the app to the storage and everything in between. This information can be stored in a single database or in a federation of subject-oriented databases. The CMDB doesn't need to be all encompassing, but it must include comprehensive information relevant to the process being automated so that it mirrors the information you currently use to perform the process manually.
The CMDB needs to hold a lot of information, so you'll need to run tests and ask the vendor for benchmarks to provide an efficient, scalable data collection mechanism. One of the initial downfalls of SRM was its scalability, and the same holds true for these tools. If discovery times are too long or accessing data is very slow, an IT process automation product will be unusable. Make sure that any product you choose can scale to meet your current and future needs. Finally, not everything can be discovered automatically. For example, asset data, resource owner and resource administrator information may be kept in proprietary databases. Your choice of tool must have the ability to import data from other databases via custom integration modules or APIs.
Operationally focused reporting. Just because all of the data required to perform a management operation is being collected, that doesn't mean the presentation of the data is sufficiently organized for efficient operational execution. SRM tools have evolved from device-centric reporting to more operational reporting with analysis and corrective action recommendations. Most automation tools also provide this level of reporting. Make sure that the data needed to complete a task isn't strewn in multiple views or reports. Aggregating these reports manually can be almost as complex and error-prone a task as if you were using multiple tools.
Service portal/dashboard. Every IT process automation tool needs a service portal and dashboard to initiate and monitor requests, and to view a queue of tasks that must be performed. Project managers also need visibility into the status of multiple concurrent projects, and access to historical information to analyze the data for process improvements over time.
Out-of-the-box workflows. Some IT pro-cess automation products have rich feature sets that can be used to automate just about any process. They're basically sophisticated programming languages with visual and policy-based logic generators, and extensive interfaces to allow integration with other apps. Theoretically, these tools could automate storage management processes, but significant development is required to integrate them with a storage-aware CMDB and storage management tools. Still, sometimes that's the only way to automate more complex management tasks. Out-of-the-box workflow products tend to focus on simpler processes.
Task automation. When possible, IT process automation tools should automate detailed storage management tasks to simplify jobs such as automatically selecting storage resources for a provisioning task based on policies. Other tasks include validating host access to storage after a storage provisioning operation is complete, ensuring that no configuration problems prevent access to data and diagnosing problems.
IT process automation is still relatively new, and its application to storage is in the early stages (see "What's next," below). While it promises to simplify and standardize storage and IT management in general, it's not a quick fix to solve storage management operational complexity. Companies that start down this path must be open to modifying their storage management processes, tools and organizations.
- Reduce Management Complexity with Hitachi Storage Advisor –Hitachi Vantara Corporation
- Unified Storage for a Multi-Cloud World - Dell EMC Unity XT –DELL EMC & INTEL®