The evidence may be along the lines of LucidWorks, Attivio, IntraFind and Polyspot, in which Lucene/Solr is blended with a range of open-source and proprietary modules. That is not to say that internal or external developers cannot build excellent open-source applications but many IT managers feel reassured by a post-implementation contract with a company that has investors to keep happy.
Search technology dates back to the early sixties, and it may come as a surprise to many to learn that the RAND Corporation was thinking about Bayesian statistical approaches to information retrieval in the late 1950s!
Over the last couple of years content analytics, search-based applications, semantic search, social search, clustering, multi-lingual search, multimedia search, unified information access and entity extraction have all moved on significantly. Another important trend is the way in which the information retrieval and enterprise search communities are beginning to see the benefits of working together.
Search is About People and Technology
The barriers to the wider and more successful implementation of search applications are all people-related. The Findwise survey indicated that the majority of organizations have, at best, only one person supporting all the search applications (including the corporate website) and that is ridiculous. Search touches every person in the organization. Try telling the IT manager responsible for the ERP application that they will have to manage with just one support person in 2013!
The problem is finding people with the skills and experience needed in development, pre-sales, sales and support positions. These skills are in addition to those of data scientists. The problem is that universities cannot suddenly modify degree courses and in any case the need is immediate, not just in five years’ time.
The recruitment industry also needs to understand these requirements. Some recent personal experience suggests that recruitment consultants have little idea about the specialist skill sets required, and there are still far too few training courses that are not run by organizations with an interest in pushing their own particular solutions.
Action Next Month
You are not going to be able to cope with the opportunities and challenges of 2013 without taking the following actions next month
- Appoint a full-time Search Manager and make sure that search logs are reviewed in detail on at least a monthly basis.
- Assess search satisfaction and search requirements across the organization.
- Ensure that a senior non-IT manager is responsible for a corporate search strategy that links technology and staff investment to maintaining competitive advantage.
- Find out what skills the organization already possesses in information and data discovery and analysis.
- Start to build networks with other organizations using your particular search technology stack. If your vendor is reluctant to help, ask them why!
- Plan to be at either Enterprise Search Europe or the Enterprise Search Summit in May.
Editor's Note: To read more of Martin's writings on search, try Is There a Future for Enterprise Search?