Is There a Future for Enterprise Search?

5 minute read
Martin White avatar

In September I was taking part in a European Commission conference on search computing at which a senior executive of a major search technology vendor proclaimed that enterprise search is dead, and that the focus should be on data analytics. Without doubt there are some significant benefits in enabling managers to look for trends and outliers in the mass of data that is now being collected by many companies, but that does not mean to say that "enterprise search is dead."

Over the last couple of years more than a hundred books and countless reports have highlighted the benefits and challenges of providing effective access to Big Data. The October 2012 issue of Harvard Business Review has three articles on the topic, so it must be important! This still does not negate the importance of enterprise search.

Enterprise Search and Big Data


Most enterprise-level applications support defined business processes and associated workflows. As a result the manager responsible for the workflow (e.g. customer relationship management) is also willing to take on budget responsibility and work with IT on solution development.Enterprise search does not support specific workflows; it supports all of them. This makes it very difficult to find someone who wants to take responsibility for enterprise search management and also very difficult to agree who has budget responsibility.

For some time there has been a view that the unstructured information in a company represents 80 percent of the volume of information, a view heavily promoted by Autonomy. The evidence is anecdotal but even if the balance is in fact 50-50 the result is that Big Data applications are only going to meet half the business requirements for information and data access.

There are also vast collections of project reports, service reports, business plans, patient records, etc. where being able to find relevant information by using either keywords or through a natural language enquiry in whatever are relevant languages is absolutely business critical.

If you want to get a sense of the scale of the mismatch between business requirements and the availability of enterprise solutions then have look at surveys carried out by MarkLogic in 2011 and 2012, Findwise, Oracle and SmartLogic:

Although some of these surveys are notionally about Big Data you will see that the need to search unstructured information is also seen as very important as this category of information provides invaluable context for any analysis of data. This is highlighted in a recent AIIM survey in which over 60 percent of respondents noted they would find it very useful to be able to correlate text-based data with transactional data, but only 2 percent are able to do so at present.

Learning Opportunities

What is now emerging is a view of enterprise search as a managed framework of search applications which enable employees to find the data, information and knowledge that they have the authority to access in order to make business decisions.This is a view that is now being promoted by HP, IBM and Oracle after high profile acquisitions last year, and by the open source search community (notably Lucid Works) where Lucene and Hadoop are well positioned to provide enterprise-scale solutions to information and data management.

The Skills Gap

The wider adoption of enterprise search is not just a technology issue. There are two major barriers to gaining the best from the technology. The first of these is an understanding of how the technology works and what it is capable of delivering.Although there are many books on the science of information retrieval and blogs from search vendors, these do not help IT managers and developers understand the complex world of search and realize that Google is not necessarily the answer.

The second barrier is that of finding people with relevant experience and expertise. An EMC study indicates that there will be a significant shortfall in the number of data scientists over the next five years.Few universities have developed courses in data science and enterprise search and there are very few training courses in either Europe or North America. The people with these skills are being hired by major IT companies (especially Google) at benefits packages that few organizations will be able to compete with.

Tracking the Market and Technology

Starting with this, my monthly column is going to focus on issues around search technologies and the implementation of these both for internal enterprise use and for large websites. I’ve been tracking search since 1974 but only now do I see companies placing it high up on both business and IT strategy agendas as they begin to realize the fundamental importance of making the best possible use of their investment in information and data.

Image courtesy of @Nomad_Soul (Shutterstock)

Editor's Note: To read more of Martin's thoughts on enterprise search, why not read Marketing the Benefits of Enterprise Search & Search Vendor Products

About the author

Martin White

Martin White is Managing Director of Intranet Focus, Ltd. and is based in Horsham, UK. An information scientist by profession, he has been involved in information retrieval and search for nearly four decades as a consultant, author and columnist.

About CMSWire

For nearly two decades CMSWire, produced by Simpler Media Group, has been the world's leading community of customer experience professionals.


Today the CMSWire community consists of over 5 million influential customer experience, digital experience and customer service leaders, the majority of whom are based in North America and employed by medium to large organizations. Our sister community, Reworked gathers the world's leading employee experience and digital workplace professionals.

Join the Community

Get the CMSWire Mobile App

Download App Store
Download google play