9. Medicare and Medicaid (CMS) helps customers easily
research, select and enroll in the right insurance plan...
while ensuring that the systems are
future-proof and can adapt to change.
When organizations are looking for infrastructure to manage and leverage Big Data, they look for three things:A database that can handle unstructured and multi-structured data with ease. Great search capabilities so users can find the data they are looking for and leverage it to make better decisions for the business.Application services and tools that allows developers to build applications quickly and easily so that the data turns into usable information.There are plenty of best of breed technologies out there to serve each one of these functions – but cobbling together a system to do that is time and resource intensive – not only to build, but more so to maintain.MarkLogic provides all three of those capabilities. And, we have the added bonus of having 12 years under our belt to ensure that the system is enterprise hardened with the security, back up, recovery, high availability and data integrity you come to expect from an Enterprise data management system.
Fairfax County is one of the five largest in the nation, with a population and budget that dwarfs many States. It is the preeminent local government in the Capital Region and has become the economic engine of both the area and its Commonwealth. Despite the national recession, the County continues to attract new businesses and residents, but must find a way to maintain and increase its service delivery to citizens & businesses while reducing the costs of its operations.Fairfax County, VA, wanted to promote a more open government. One clear benefit is the attraction of new businesses to the county. If constituents can easily research data collected by the county (particularly demographics), they can make better/quicker assessments about the viability of new businesses.
The solution Fairfax chose was to create a land data repository based on MarkLogic ServerThe repository has an easy to use search engine for property history and other information by tax map identification, by address or by keywords. For instance, typing in the word "heliport" quickly brings up data on all the heliports in Fairfax and their permits. The data can be spatially displayed by geographic information systems such as ESRI.Since MarkLogic was designed to aggregate many disparate data types, the first phase of consolidating the county’s data was completed in 2 months.Trying to retain the mainframe data (which was valuable, but expensive to maintain) was a big challenge, but MarkLogic helped to obsolete the mainframes and reduced maintenance costs.
When you think of Warner Brothers, you probably think of them as studio behind the creation of everything from Loony Toons to Harry Potter. And while the studio side of the business has clearly innovated and embraced new technologies – until recently the distribution department still relied on manual tasks to complete even every day requests. The challenge they were trying to address was finding a more efficient way to identify assets that could be licensed to third-parties. This is everything from full movies to deleted scenes to promotional materials like posters or internet banners ads.
Solution: Warner Brothers needed more than a search solution to solve their problem. They needed a platform that was able to search across different asset information, link the data together, and then transform and package the data. Whether the user’s requirements were XML, JSON, or a standard zip file they could get the specific format they wanted. Files could also be modified as part of the delivery. The real value-add for Warner Brothers was the ability to quickly build applications once the metadata layer was established. MarkLogic is accumulating the metadata from four disparate systems – 6 million assets. MarkLogic also provides stakeholders with a real-time, user-friendly self-service process to reuse content. Because the data was being used for more than cataloging, an RDBMS could not match our capabilities – particularly in finding the data and doing decision support.The system is critical for the distribution of media assets and requires enterprise capabilities and ability to scaleThe agility with which they were able to build the first application meant they were getting ROI on the system almost immediately.
When the Affordability Care Act passed, it required that the Centers for Medicare and Medicaid Services (CMS) build a health insurance exchange (HIX) which would allow everyone in the US to search, select and enroll in an insurance plan. They need to aggregate health care plans from across all 50 states, and present them in an easy-to-read format for subscribers/patients.And they also needed to ensure that system could easily adapt to change as requirements and regulation changed.
Using MarkLogic to unify and store all of the data dramatically simplified the legacy architecture, implementation and support approach initially envisioned. Load data “as is” removes the burden from states, providers and payers; provides ‘future-proofing’ for as-yet-unidentified data sources; enabled rapid prototyping and delivery early in the development cycle which was impossible with RDBMS modeling approach.MarkLogic’s performance, scalability, and flexibility significantly lowers overall TCO compared to legacy RDBMS approach.Because every state provides data in a different format, system could never have been built in a relational database which would require a new schema for every dataset.The system requires enterprise-features because it is the core technology driving the Health Information ExchangeApplication development tools enable rapid prototyping and quick delivery to meet deadlines.
This major oil and gas trading company realized it could optimize trading by understanding all factors that influence trading price. They could not get this from their existing system in real-time.
This major oil and gas trading company realized it could optimize trading by understanding all factors that influence trading price. They could not get this from their existing system in real-time.
BBC delivered over 10,000 pages of dynamic web content with just their normal staff of 14 journalists.
So how big was big data at the Olympics. Here are some stats for the BBC…
With the new JSON support, developers will be able to get JSON into and out of MarkLogic in an XML-centric application using XQuery and XSLT. Those working primarily with JSON in non-MarkLogic middleware (J2EE, .NET, PHP, etc.) will be able to leverage MarkLogic for search and CRUD using a JSON data model. It’s now easier to build web applications
Increasing data volumes have precipitated a move towards in-database analytics for performance reasons. Forrester describes in-database analytics as the embedding of application logic into the DBMS. The major advantage of doing so is that data, especially large data sets, do not have to be moved out of the DBMS so the analytics can leverage the processing power of the platform. The developer can use native functions, implemented and tested by MarkLogic, instead of writing these functions by hand. It also avoids the situation where different developers write and use different versions of the same standard functions.
Distribution of Hadoop combines Hortonworks Data Platform with MarkLogic and enterprise-grade supportEasy: interoperability with Hadoop toolsFast: leverages MarkLogic’s indexes and distributed architecture for performanceUnique benefits of combining Hadoop with MarkLogicWider range of analysis on Big Data- Real-time interactivity provides immediate answers plus drill-downs into specifics - Offline, batch analytics for answers where real-time is not necessaryReduced development costs of building out a Big Data platform- Out-of-the-box capabilities: search, alerting, geospatial, and transactions- Eliminates integration costs of stitching together toolsWorld-class professional support
Real-time Hadoop applications: HDFS is great for high-throughput applications, such as MapReduce. With MarkLogic running on HDFS, Hadoop is extended to support low-latency applications as well, such as real-time search and analytics. Using HDFS as storage for a NoSQL database is not new, of course. However, MarkLogic is the first to support transactional updates, full-text search, a document data model, and enterprise security together in one integrated system. Database management system, not custom middleware: If you’re building your own secondary indexes, replication, or transactions, you’re doing work you shouldn’t be focusing on. Having these low-level capabilities built into the database reduces custom code and one-off integrations, allowing your development and operations teams to focus on application features and SLAs that differentiate your business, and not plumbing. Unstructured throughout: MarkLogic and Hadoop are both built for unstructured data. By combining the two you eliminate the need to map data to rows and columns for every type of analysis or service endpoint that your business users will dream up. This makes it much easier to integrate new and unanticipated data sources. Easily age your data and store it appropriately
How did MarkLogic get here? Like everyone else in this room, a lot of hard work. MarkLogic began in 2001. The company and its technology was the brainchild of our founder, Chris Lindblad. The light bulb went off during a meeting with the FBI while Chris was an architect at Infoseek. Since then, Chris has guided every step of the company’s business development, and he is still the chief architect of our technology with very hands-on interactions with our entire engineering staff. And the technology isn’t some untested, flavor of the week, it is a proven itself for nearly a decade. MarkLogic is privately owned with the funding coming from Sequoia Capital and Tenaya Capital. We have more than 300 customers and more than 250 employees. MarkLogic is headquartered in the Silicon Valley. We have offices in New York, Washington, DC, London, Frankfurt, Tokyo, Austin and Boston.