Essential Guide

Browse Sections

BACKGROUND IMAGE: iSTOCK/GETTY IMAGES

Big data tutorial: Everything you need to know

Last updated:June 2015

Editor's note

Big data is here to stay. Even technologists who might have previously disparaged it as a buzz word will now acknowledge that the term and its accompanying technologies are evolving into real-world enterprise offerings and data center strategies. This SearchStorage.com big data tutorial is designed to get data storage managers up to speed on the conversations shaping the decisions many IT managers are making about big data technology. An increasing number of data sources -- such as social media -- and a growing number of media-rich data types -- such as X-rays and video -- are fueling the challenges associated with big data at companies that might never have thought of themselves as big data customers. The divide between analytics and storage in the world of big data is narrowing as data storage managers find themselves tasked with designing and managing big data infrastructures. In addition, big data sets that include company-sensitive and personal data have unique security and compliance requirements that managers need to adhere to. View the content in our big data storage tutorial to learn more about these high-transaction environments, new scale-out technologies, rising I/O demands and the latest news on Hadoop.

1John Webster on big data architecture

John Webster, a senior partner at Evaluator Group based in Boulder, Colo., offers a thorough explanation of how to manage big data storage environments and Apache Hadoop technology, and provides readers with alternatives to DAS in Hadoop storage. This four-part video presentation begins with a high-level discussion of big data architecture and closes with a technical explanation of the Hadoop Distributed File System (HDFS) and NameNode in Hadoop architectures.

2Big data vendor trends

How do you know what to focus on when it comes to big data? In this section of our big data tutorial, we've selected the most crucial trends coming from the vendor sphere so data storage managers can stay up to date on popular storage options in the industry.

3CIOs: Big data challenges

CIOs have their own big data challenges: Many feel they should take the lead in identifying those patterns that might drive better business decisions. To do this, they'll need to add to their company's big data skill set by hiring data scientists, mathematicians and information architects. Evaluating the business value that big data and analytics can provide is difficult, and building architecture with adequate capacity and performance is a touchy task. Furthermore, convincing the business that big data governance is a concern for the executive suite and even the boardroom is an important issue. Find out more about the challenges CIOs face with big data in this special collection of news and analysis from SearchCIO.com.

4Big data analytics drive business value

Big data analytics can use real-time data to provide insight into business processes and trends, and ultimately can provide a lot of value to enterprises. But performing analytics that produce actionable results requires skilled data analysts and an infrastructure that can handle constant processing. To help you be sure you're extracting the most valuable results from your analytics project, these big data experts explain what to watch out for.

5Big data security and compliance issues

Information stored in big data environments is often extremely sensitive. An organization might be storing customer data, financial records or information integral to business processes -- all information that could do significant damage to the organization if compromised. Security is sometimes baked into database offerings, but it often isn't as comprehensive in open source big data technologies that are growing in popularity. For that reason, third-party or additional security measures may need to be taken. In addition, many enterprises analyze big data sets that have specific requirements for privacy and governance, so additional steps may be necessary for compliance. The following links present some common big data security and compliance issues and tips for proactively preventing a breach.

6Big data video

Our big data video section offers a behind-the-scenes glimpse into what users and analysts think of what vendors are doing in the space.

7Big data glossary

With so many technologies and products associated with big data and analytics, there are a lot of terms to know. Use this glossary for a quick take of some of the most common terms you'll likely come across.

-ADS BY GOOGLE

SearchDisasterRecovery

SearchDataBackup

SearchConvergedInfrastructure

Close