Chances are, when you’re talking about managing information, the word "big" works itself into the conversation. Big data is everywhere and it’s not going anywhere. No matter how hard you try, you can’t ignore it, so you might as well stare down the barrel of the big data gun and make the most of it.

Stand Up to Big Data

Fortunately, when we want to learn how to best tackle corporate data, we turn to Jim McGann, vice president of information discovery at Index Engines. McGann says that, when it comes to finding, reviewing and managing company information, there are two major trends shaping the big data landscape.

Defensible Deletion

As storage becomes cheaper and cheaper, companies seem to be keeping more information, just because they can. Yet, the more information you store, the more you have to sift through and files kept past their expiration date can play major roles in litigation, no matter how old they are. Companies are strongly encouraged to clean out the information being stored across platforms and systems to ensure that there are no surprises when search and discovery comes into play.

Just like your annual spring cleaning, it’s recommended that users set up policies to alert you or take appropriate action when content overstays its welcome. Additionally, make sure whatever you delete can be defended should it be called into question. 

Tiered Storage Environments

Speaking of cheap storage options, McGann says that as companies acquire more information, not all storage spaces are created equally. As a result, he recommends implementing a tiered model for what information gets stored where. Older, less relevant data can get pushed out to the cloud, allowing more space for newer and more important information within more secure and expensive storage platforms.

Fueling Big Data

These big data trends are reflected in new products introduced by Index Engines within the past few months. In January, Index Engines launched Octane Forensic Archive for Litigation Hold, which indexes MS Exchange and IBM Lotus Notes emails, allowing for full content and metadata culling.


Octane's archiving platform can connect to online, nearline and offline data

By preserving ESI from all sources including online networks, email servers, forensic images and backup tapes, a broad number of sources of ESI can be identified, culled and preserved in a forensically viable format. Content can be managed according to policies and placed on legal hold for a specified retention period, ensuring that compliance and information governance requirements are met.

At the end of the day, you’re either managing your big data, or big data is managing you. Just like spring cleaning, it seems like a daunting task, but the sooner you start, the more in control you feel.