MarkLogic Announces Partnership With Yahoo Hadoop Spinoff HortonworksMarkLogic was doing big data long before big data became a required bullet point on every database provider’s sales slides, and it is continuing to evolve. Today at Strata, MarkLogic announced it has joined the technology partner program of Yahoo’s Hadoop spinoff Hortonworks.

MarkLogic Plus Hadoop

MarkLogic began as an XML repository, but its new image and messaging are all about storing anything -- lots and lots of anything. The company is taking another step toward living up to that goal by partnering with Hortonworks. MarkLogic will certify its Connector for Hadoop, introduced last year, against Hortonworks' value-added Hadoop distribution. In addition to certifying the connector, MarkLogic and Hortonworks will also be jointly developing reference architectures for using MarkLogic with Hadoop. The reference architectures will provide best practice guidance and help customers accelerate the design of their own solutions. 

What does this mean for MarkLogic customers? MarkLogic users have officially been able to integrate Hadoop and MarkLogic since the connector was introduced last year. However, since MarkLogic had not established a relationship with any commercial Hadoop vendors, if things went wrong, the customer had almost total responsibility to resolve it. The new partnership offers a commercially supported platform with real-time big data access, full-text search and batch processing.

What This Means

Although Hortonworks is a relatively new company, it’s far from a Hadoop newcomer; 70% of Hadoop’s codebase can be attributed to the team now at Yahoo’s spinoff Hortonworks. Today’s announcement is just the latest in a series of relationships Hortonworks is forming. The company is working with Microsoft to help develop a Windows-based Hadoop distribution and has partnerships with everyone from Informatica and Enterprise DB to Jaspersoft. These alliances move Hadoop closer to becoming a mainstream technology and cement Hadoop’s position as a de facto standard for processing big data.

There will continue to be lots of momentum in the big data market as new companies are created, existing companies realign their offerings and technologies stabilizes. Although it seems a bit chaotic, this is a natural progression of technology markets.