Query at Speed of Thought
•Download as PPSX, PDF•
0 likes•561 views
Vectorwise is an extremely fast database that enables quick decision making through real-time analytics. It is multiple times faster than other databases, with some customer queries seeing speed increases of 70x. This speed is due to its innovative vector processing approach. Customers report being able to reduce BI project timelines by 50% using Vectorwise due to its ease of use and lack of need for tuning. It also reduces infrastructure costs through requiring less hardware and IT resources.
Recommended
Recommended
More Related Content
What's hot
What's hot (18)
Viewers also liked
Viewers also liked (20)
Similar to Query at Speed of Thought
Similar to Query at Speed of Thought (20)
More from MISNet - Integeo SE Asia
More from MISNet - Integeo SE Asia (9)
Recently uploaded
Recently uploaded (20)
Query at Speed of Thought
- 1. Query at the Speed of Thought ! 20 Oct, 11-12pm Singapore time 2pm Sydney time
- 2. Big Data We’re drowning in a sea of data • High volume of data sources • Operational analysis • Massive data sets from traditional BI
- 3. Big Data Is Everywhere Data Fast Operations Real-time Source Analytcs Real-time Write/index all trades, Show consolidated markets store tick data risk across trader Call initiation Real-time Fraud request authorization detection/analysis Inbound HTTP Hit logging, analysis, Reporting hot-spots / requests alerting site specific activity Rank scores: Online game • Defined intervals Leaderboard lookups • Player “bests” Check/update Report live ad and Website or device balance, serve ad click-thrus by device Package status, lost Package location Sensor scan shipment, package updates rerouting 3 3
- 4. The Single Biggest Issue in BI Today SPEED 1. Poor Query Response TDWI Q4 2009 Best Practices Report 1. Query Performance Slow 1. Speed, Costs & Irrelevance Ralph Kimball 4
- 5. Requirements Change Fast 70% Forrester Research – Q1 2010 49% “Proportion of the cases when BI requirements cannot be Survey respondents saying fulfilled by a canned, their “requirements change structured production and on a monthly, daily or even need free form exploration hourly basis.” and analysis.”
- 6. “Gartner clients increasingly report performance constrained data warehouses during inquires. Based on these inquiries, we estimate that nearly 70% of data warehouses experience performance-constrained issues of various types.” Magic Quadrant for Data Warehouse Database Management Systems Gartner Group – Jan 2010
- 7. Reporting / BI Architecture End-Users ERP ETL Enterprise CRM Data Warehouse BI SCM QUERY ISSUES Reporting Applications Legacy OLTP
- 8. What can we do? Faster Smarter Hardware? Software?
- 9. TPC-H Benchmark Results – Because of Faster HW?
- 10. Smarter Approach “This inevitably puts VectorWise 4 years ahead of the competition in terms of performance – Game Changing and it will remain 4 years ahead until some Technology competitor finds a way to Don Feinberg, Gartner Group catch up at a software level. 68% Better Price Performance This is unprecedented.” Price/QphH TPC-H@100GB Robin Bloor (Analyst)
- 11. Company Name Change As of 23rd Sep 2011 ………….. Became …………….. Confidential © 2011 Actian Corporation 11 Of XX
- 12. Company Name Change Why ? To take action on BIG data in B.I. “Executives have lots of information, but they don't know when to take action and what action to take” GARTNER GROUP OCT 2011 Confidential © 2011 Actian Corporation 12 Of XX
- 13. Actian Product and Services Portfolio Taking Action on Big Data Vectorwis Action Ingres Apps Cloud e Action Platform •World class mission •World’s fastest Big •Being proactive with critical RDBMS Data Analytics engine BI •CREDIBILITY, •PROVEN •LEADERSHIP RELIABILITY, GLOBAL INNOVATION Confidential © 2011 Actian Corporation 13
- 14. BIG DATA Business Intelligence Dilemma $10 Billion Spent worldwide on Business Intelligence Historical snapshots Reactive Decisions No real Actions ! Confidential © 2011 Actian Corporation 14 Of XX
- 15. Take Action on Big Data – With Action Apps Action Apps are lightweight consumer style applications that automate business actions. Taking action with Action Apps is the missing link between B.I. and Value ! Confidential © 2011 Actian Corporation 15 Of XX
- 16. Era of Action Apps Characteristics Features Lightweight Probes data important to you Consumer Style Set Triggers for data changes No Training Select the Actions you want Confidential © 2011 Actian Corporation 16
- 17. Action Apps - Example $ Data Triggers Actions Value Description Probes Stock selling quickly Monitor all Stock selling Alert you on Increased sales stock at least twice what stock is than average selling faster . Ability to alter price to for that day suit Automatically pre-order more Create proactive stock. promotion Confidential © 2011 Actian Corporation 17
- 18. Biggest issue in B.I. Today? BI Survey 9 (2010): Why BI Projects Fail? “1. Query Performance Too Slow” Slow Query Response Time 2010 TDWI Best Practices Report “45% Poor Query Response the top problem” Confidential © 2011 Actian Corporation 18
- 19. What is Vectorwise - Relational database for reporting, data analysis & B.I. - Runs data analysis FASTER than any other RDBMS - Enables business to make quicker, effective decisions - Don’t need to be an IT expert to use, extremely simple - Less cost using less hardware and IT/DBA resources Typical query response time Data Data VW base base Data x y vs. base 6.54 7.02 0.9 mins mins sec Confidential © 2011 Actian Corporation 19
- 20. What makes Vectorwise SO fast Core level parallel Millions DISK processing – 100X Time / Cycles to Process RAM Scaler Vector (rather than scaler) 150-250 CHIP 2-20 40-400MB 2-3GB 10GB Limit disk I/O to specific Data Processed columns instead of rows >100X Faster to process data on chip cache than in RAM. Maximizes throughput via 4 automatically optimized on-chip compression engines Confidential © 2011 Actian Corporation 20
- 21. TPC Benchmark results : Vectorwise FASTEST 1TB Performance Benchmark Composite Queries Per Hour TPC-H@1TB (Non-Clustered) Source: www.tpc.org / August 30, 2011 VectorWise 3 May 2011 32 Cores 1TB RAM Microsoft SQL Server Microsoft Oracle 30 August 2011 Oracle SQL Server 3 June 2011 26 September 2011 Oracle Sybase IQ 5 April 2011 80 Cores 15 Dec 2010 60 Cores 2TB RAM 32 Cores Sybase IQ 26 April 2010 512GB RAM 512GB RAM 1 Feb 2010 80 Cores 80 2TB RAM Cores 2TB 102,375 140,181 164,747 173,961 RAM 436,788 209,533 219,887 201,487 QphH QphH QphH QphH QphH QphH QphH QphH $3.62 USD $12.15 USD $6.85 USD $1.37 USD $0.88 USD $9.53 USD $1.86 USD $4.60 USD Price/QphH Price/QphH Price/QphH Price/QphH Price/QphH Price/QphH Price/QphH Price/QphH Confidential © 2011 Actian Corporation 21
- 22. Analyst comments on Vectorwise “Every now and then something occurs that tears up your expectations of how technology will evolve. This happened when I looked at the graph shown below. The Vectorwise results are jaw dropping. […] So this is like a set of 0-60 mph figures with four cars scoring somewhere in the 5-7 second range and the final one scoring below 2 seconds. It’s astonishing. Something inside you says, “that’s no car, it’s a rocket.” Robin Bloor, President, The Bloor Group Full text at http://www.thevirtualcircle.com/2011/02/vectorwise-theres-a-disturbance-in-the-force/ Confidential © 2011 Actian Corporation 22
- 23. Customer comments on Vectorwise “For the past 20 years, I’ve been searching for the killer database that would fulfill our most intense data processing needs and with the discovery of Ingres VectorWise, that search is now over – this database technology is in a class of its own. Right out of the box, Ingres VectorWise lets us effortlessly plow through millions and millions of rows of data…The Ingres and VectorWise leaders and technologists have performed a miracle here.” Warren S. Master, CTO, The Rohatyn Group, New York “We ported a business application from Oracle to Ingres VectorWise and were astounded by the substantial performance increases, which were up to 70x…With Ingres VectorWise Database, we get the best of both worlds; we can now offer our customers a lower cost and better performing analytic database.” Michael Thuleweit, Managing Director, Datamatics, Frankfurt Confidential © 2011 Actian Corporation 23
- 24. Customer comments on Vectorwise “The speed is blindingly fast right out of the box and it eliminates layers of work that had to be done in the past. Ingres Vectorwise uses automated compression and indexing which eliminates the need to spend extra hours tuning and tweaking our data. This means we are now able to cut the time of our business intelligence engagements with our customers by up to 50%.” Roy Hann, MD Rational Commerce, Systems Integrator, London “Ingres VectorWise performance has been outstanding and it was so easy to get up and running. Position analysis was 10 to 50 times faster than the leading commercial databases in our testing and with linear query performance from 12 mm – 1.2 billion financial records. These are drastic improvements in terms of speed.” Steve Ferrando, CEO, dbConcert, Systems Integrator to Wall Street investment firms, New York Confidential © 2011 Actian Corporation 24
- 25. Current Vectorwise Customers (in 10 months) • Groupe Adeo - World's 4th largest retailer • Sheetz Inc - Retail chain • DSG Retail– Retail chain • Givex Canada Corp - Gift card provider • Jasad – BI Bureau • Clinic Trial Services Unit & Epidemiological Studies Unit - Cancer research • OSBI Limited – Oil & Gas • TimoCom Soft und Hardware - Truck/Cargo/Logistics • Lloyd's Register - Maritime classification society • Royal & Sun Alliance Insurance – Insurance • DFV Deutsche Familieversicherung - Insurance • Bank of England – Bank • Office of Revenue Commissioners - Ireland Tax department • Telkom - Telco • D-Source - Software solution provider • Sogeti - Massive software solutions provider • Numsight Consulting • Qvantel - Software services • Viada GmbH - Software Service provider • InsightSoftware Investments - Network storage & software solutions • GSI Commerce - Data aggregator • Electricity North West - Energy • Datamatics – Smart Meter Technology provider Confidential © 2011 Actian Corporation 25
- 26. Vectorwise Roadmap VW Rev 1.6 Current VW Rev 2.0 Due Oct 2011 Updated Management Tools Faster Loader VW Rev 2.5 Mar 2012 Storage Management Stored Procedures VW Rev 3.0 Sep 2012 Confidential © 2011 Actian Corporation Research Projects 26
- 27. Customer PoC results Vectorwise v Greenplum birt.sql : query with a lot of agg_prices2.sql : testing 80m table with join filters dim_products VW Greenplum VW Greenplum real real 0m36.980s Execute consecutive Execute consecutive 0m12.663s real 0m2.383s real 0m20.596s agg_prices3.sql : testing 80m table with join birt1.sql : query with less filters dim_products & group by area VW Greenplum VW Greenplum real 0m4.024s real 0m10.862s Execute consecutive Execute consecutive real 0m3.389s real 0m25.920s Confidential © 2011 Actian Corporation 27
- 28. Implementation – Training – Support Implementation - Rough Implementation time frame for VW is 5-10 days - When upgrade, very little needs to be done Training - Admin and advanced course is total 5 days. - Can be conducted at clients offices Support - For severity 1 (server down) follow the sun 24/7 support - For severity 2-4 will be dealt on a business hours timeframe Confidential © 2011 Actian Corporation 28
- 29. Summary Vectorwise has the fastest performance – Nothing comes close !!! (Check TPC results) Using Vectorwise - Reduces complexity - Less tuning - Less upfront costs - BI projects delivered faster !!! Vectorwise will allow you to differentiate yourselves against your competition Vectorwise reduces your operating costs - Lowest infrastructure costs (IT admin, less H/W, less power, less A/C) Confidential © 2011 Actian Corporation 29
- 30. Thank You Contact: • Ms. Rhea Elinzano, rheae@misnet.com.sg • Mr. Raymond Ingal, raymondi@misnet.com.ph QUERY AT THE SPEED OF THOUGHT
Editor's Notes
- There’s a growing torrent of data. In a previous webinar we talked about 3 kinds of things happening in BIHigh Volume of Data Sources. Datasets are getting larger and larger, and the speed the data comes in is so fast and so users need high-performance systems.With this data explosion, comes the use of analysis not only in traditional BI sense, but also in operations. So, there’s a need for business units to get some simple analytics for transactions that happened for example in the last second, or last minute.At the same time, we still need to do the traditional BI where it uses massive datasets, running historical analysis, which when running on massive datasets can take days.Big Data is everywhere and it requires processing of massive datasets fast and in real-timeFor example at telco may want to use their CDR records to respond to service calls and complaints quickly and thereby improve their service assurance. Operations may want to use such data for real-time authorization. And /or for fraud detection and analysis.Retail may want to do real-time inventory and margin optimization.Banks may want to capitalize on their exadata to perform risk analysis faster and better, so as to reveal more opportunities.Healthcare may want to efficiently parse its patient information and understand the most effective treatments and how to efficiently administer them.
- Big Data is everywhere and it requires processing of massive datasets fast and in real-timeFor example at telco may want to use their CDR records to respond to service calls and complaints quickly and thereby improve their service assurance. Operations may want to use such data for real-time authorization. And /or for fraud detection and analysis.Retail may want to do real-time inventory and margin optimization.Banks may want to capitalize on their exadata to perform risk analysis faster and better, so as to reveal more opportunities.Healthcare may want to efficiently parse its patient information and understand the most effective treatments and how to efficiently administer them.There’s a sea of information but we still cannot make out on what’s actually happening. Because of one issue..
- And what is that issue?SPEED..Slowness of BI queries, Slow response times is the biggest issue in BI.Benefit of a fast query response is, the more business benefits reported, and the more likely the business goals will be achieved.Some survey results:The Data Warehouse Institute Best Practice Report surveyed their members for what will eventually drive them to replace their current DW platform. Poor Query Performance was the number one reason.BI Survey 8 will included a few thousands of organizations around the world also stated query performance as a deterrent to using BI. Ralph Kimball also reports his top 3 issues. So there’s speed again. He also talks about costs – which includes costs of implementation, costs of hw, cost of support, and cost of adopting to changes in BI. Things change quickly in the user’s perspectives, so how do we deal with that in BI? What kind of rework is required?
- Requirements change. In fact, seventy percent of survey by Forrester, respondents say their requirements change on a monthly, daily, or even hourly basis. What's more, 22 percent of respondents believe their requirements change too frequently, that it becomes difficult for traditional BI applications to "keep up.”
- Speed is a major challenge in BI. Per Gartner, nearly 70% of data warehouse and BI implementations experience performance constrained issues of various types.
- Here’s a typical BI and reporting architecture. In a typical BI and reporting architecture, you will usually have several data sources – you’ve got your ERP systems, your CRM systems, your sales, your POS, your existing data warehouses, and other sources, and because of the data explosion, reporting can experience bottlenecks in performance. And with this data explosion, comes the use of analysis not only in traditional BI sense, but also in operations. Business users require real-time and simple analytics. As data flowing in is fast, users want to be able to get insights fast also. For example for fraud management, chances are you will want to be alerted immediately if there’s a possible case of fraud, without it going through the typical data warehousing, churning, and BI cycle. There’s a need for business units to get some simple analytics for transactions that happened for example in the last second, or last minute.But how to achieve that if we’re having query issues. How in fact do we empower operational analytics when we still have for IT to run batch job reports? In one organization I worked for, every month-end the reporting server just painfully slows down and hangs because of the users’ adhoc queries, our technical department had to reallocate CPU during these instances. Some of the users are resigned to just wait for the reports from the weekly batch jobs, which may not be up-to-date, but what to do? The users cannot wait for one hour to get a report online or adhoc. It’s a pity that we want to empower our users to be more self-sufficient, but 1 hour for a user to get their adhoc report is not an acceptance performance.Performance is an issue.
- What can we do?There’s a couple of approaches – speeding up the hw, or you can actually take what you have now and work on it more quickly and more smartly in that environment.
- On HWEvery year databases shows incremental improvements, as shown in this report. It’s true that there are improvements in the database performance but a lot of it is becauseof incremental improvements in HW as well.
- Here’s a smarter approach.. Let’s go back to that TPC-H benchmark. See that blue bar encircled in red?Gartner calls it a game-changing technology. Robin Bloor says it’s 4 years ahead of its competition.The TPC shows 68% better price performance over the other databases.Billy, will tell you more about this.