Performance Testing of Big Data Applications - Impetus Webcast

•

8 likes•4,296 views

Impetus webcast "Performance Testing of Big Data Applications" available at http://lf1.me/cqb/ This Impetus webcast talks about: • A solution approach to measure performance and throughput of Big Data applications • Insights into areas to focus for increasing the effectiveness of Big Data performance testing • Tools available to address Big Data specific performance related challenges

Technology

Performance Testing of Big Data
Applications
Mustafa Batterywala, Performance Architect
Larry Pearson,Vice President Marketing

Impetus Technologies, Inc.

Key Big Data Technologies

• MapReduce
– Apache Hadoop, Cloudera, Hortonworks, MapR etc.

• NoSQL
– Cassandra, Mongo DB, Oracle NoSQL, Neo4j etc.

• Messaging Queues
– Kafka, ActiveMQ, RabbitMQ, ZeroMQ etc.

• Search
– Lucene, Elastic Search, Solr

© 2013 Impetus Technologies

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Agenda

• Big Data Performance Testing Focus
Areas

• Challenges
• Performance Testing Approach
• Solutions
© 2013 Impetus Technologies

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Performance Test Focus Areas

© 2013 Impetus Technologies

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Performance Testing Challenges

•
•
•
•
•
•

© 2013 Impetus Technologies

Diverse technologies
Unavailability of tools
Test scripting
Test environment
Limited monitoring solutions
Lack of diagnostic solutions

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Performance Testing Approach

© 2013 Impetus Technologies

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Performance Testing Solutions

• Performance Test Tools
– YCSB (Yahoo Cloud Serving Benchmark), SandStorm, JMeter

• Monitoring Tools
– Nagios, Zabbix, Ganglia, JMX utilities

• Diagnostic Tools (APM)
– visualVM, AppDynamics, Compuware

© 2013 Impetus Technologies

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Critical Performance Parameters

•
•
•
•
•
•
•
© 2013 Impetus Technologies

Data Storage
Commit Logs
Concurrency
Caching
JVM Parameters
MapReduce Configurations
Message Queue Configurations
Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Real World Experience
The Application
•

Online Social networking website with almost 100 million registered users across the
globe

•

Hundreds of thousands of users are online at any given time

The Challenges
•
•
•
•

Develop a near real time analytics solution to analyze the user feedback and interactions

•

Real time monitoring of test environment for bottleneck identification

© 2013 Impetus Technologies

Solution uses Kafka, HBase and Hive as major technologies
SLA to support 50K messages per minute
Optimize and tune the Kafka clusters for maximum throughout

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Real World Experience
Impetus Contributions
•
•
•
•
•
•

Proposed and implemented performance test strategy for analytics solution

•

Real time monitoring using SandStorm to identify performance bottlenecks

Identified key performance components namely Kafka and Hbase for focus testing
Proposed SandStorm as performance testing tool based on project requirements
Prepared Kafka clients to simulate expected data ingestion volumes
Optimized and tune single Kafka cluster in EC2 on medium instance
Executed tests with varying message rate and reached to the max throughput of 50k
messages per minute using 3 server cluster

Benefits Realized
•
•
•

© 2013 Impetus Technologies

Optimum hardware utilization for complete solution
Zero performance issues on Go live
Maximum throughput of Kafka servers
Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Summary

• Test each component of the eco-system
– Data Ingestion Rate, Throughput, System Resources

• Automate test environment in Cloud
• Appropriate tools and plug-ins
– Cloud v/s On-premise solutions
– Custom Test Harness
– Monitoring and Diagnostic Plug-ins

• Failover and Reliability testing
© 2013 Impetus Technologies

Recorded webinar is available at http://lf1.me/cqb/
For more Info contact bigdata@impetus.com

Thank You
Recorded version available at http://lf1.me/cqb/

For more info and/or a Demo of our Big Data performance testing solution bigdata@impetus.com

@impetustech

What's hot

Testing Big Data: Automated ETL Testing of Hadoop

RTTS

2014 International Software Testing Conference in Seoul

Jongwook Woo

Are You Ready? Stepping Up To The Big Data Challenge In 2016 - Learn why Testing is pivotal to the success of your Big Data Strategy. According to a new report by analyst firm IDG, 70% of enterprises have either deployed or are planning to deploy big data projects and programs this year due to the increase in the amount of data they need to manage. The growing variety of new data sources is pushing organizations to look for streamlined ways to manage complexities and get the most out of their data-related investments. The companies that do this correctly are realizing the power of big data for business expansion and growth. Learn why testing your enterprise's data is pivotal for success with big data and Hadoop. Learn how to increase your testing speed, boost your testing coverage (up to 100%), and improve the level of quality within your data - all with one data testing tool.

Testing Big Data: Automated Testing of Hadoop with QuerySurge

RTTS

If you are testing a simple mobile app, you may find it relatively easy to find representative test data. However, what if you are testing enterprise scale applications? In the enterprise data center, one hundred or more applications of various sizes, complexity, and criticality co-exist, operating on various data repositories, in some cases shared data repositories. In some cases, disparate data repositories hold related data, and the ability to test integration across applications that access these data sets is critical. In this keynote speech, Rex Black will talk about the challenges facing his clients as they deal with these testing problems. You’ll go away with a better understanding of the nature of the challenges, as well as ideas on how to handle them, grounded in lessons Rex has learned in over 30 years of software engineering and testing.

Testistanbul 2016 - Keynote: "Enterprise Challenges of Test Data" by Rex Black

Turkish Testing Board

Even in the current age of cloud computing there are still endless benefits of developing thick client software: non-dependency on browser version, offline support, low hosting fees, and utilizing existing end user hardware, to name a few. It's more than likely that your organization is utilizing at least a few thick client applications. Now consider this: as your user base grows, does your think client's back-end server need to grow as well? How quickly? How do you ensure that you provide the correct amount of additional capacity without overstepping and unnecessarily eating into your profits? The answer is volume testing. Read how RTTS does this with IBM Rational Performance Tester.

Whitepaper: Volume Testing Thick Clients and Databases

RTTS

You've made the move to MongoDB for its flexible schema and querying capabilities in order to enhance agility and reduce costs for your business. Shouldn't your data quality process be just as organized and efficient? Using QuerySurge for testing your MongoDB data as part of your quality effort will increase your testing speed, boost your testing coverage (up to 100%), and improve the level of quality within your Big Data store. QuerySurge will help you keep your team organized and on track too! To learn more about QuerySurge, visit www.QuerySurge.com

Big Data Testing: Ensuring MongoDB Data Quality

RTTS

TESTING IN BIG DATA WORLD

Konstantin Pletenev

In the U.S., pharmaceutical firms must meet electronic record-keeping regulations set by the Food and Drug Administration (FDA). The regulation is Title 21 CFR Part 11, commonly known as Part 11. Part 11 requires regulated firms to implement controls for software and systems involved in processing many forms of data as part of business operations and product development. Enterprise data warehouses are used by the pharmaceutical and medical device industries for storing data covered by Part 11. QuerySurge, the only test tool designed specifically for automating the testing of data warehouses and the ETL process, is the market leader in testing data warehouses used by Part 11-governed companies. For more on QuerySurge and Pharma, please visit http://www.querysurge.com/solutions/pharmaceutical-industry

Data Warehousing in Pharma: How to Find Bad Data while Meeting Regulatory Req...

RTTS

The Data World Distilled Understanding how the data world works in the Big Data era I created this slide deck as a learning tool for new employees, I figured I would post it in case it can help others understand the data space. This slide deck covers: - Big Data - Data Warehouses - ETL/Data Integration - Business Intelligence and Analytics - Data Quality - Data Testing - Data Governance It provides a brief description along with key vendors in the space.

the Data World Distilled

RTTS

Big Data Day LA 2016/ Use Case Driven track - Reliable Media Reporting in an ...

Data Con LA

Real Time Machine Learning Visualization with Spark

DataWorks Summit/Hadoop Summit

Completing the Data Equation In this presentation, we tackle 2 major challenges to assuring your data quality: 1) Test Data Generation 2) Data Validation We illustrate how GenRocket and QuerySurge, used in conjunction, can solve these challenges. Also see how they can be easily integrated into your Continuous Integration/Continuous Delivery pipeline. Session Overview - Primary challenges organizations are facing with their data projects - Key success factors for data validation & testing - How to setup a workflow around test data generation and data validation using GenRocket & QuerySurge - How to automate this workflow in your CI/CD DataOps pipeline to see the video, go to https://www.youtube.com/embed/Zy25i74l-qo?autoplay=1&showinfo=0

Completing the Data Equation: Test Data + Data Validation = Success

RTTS

This is a slide deck from QuerySurge's Big Data Testing webinar. Learn why Testing is pivotal to the success of your Big Data Strategy . Learn more at www.querysurge.com The growing variety of new data sources is pushing organizations to look for streamlined ways to manage complexities and get the most out of their data-related investments. The companies that do this correctly are realizing the power of big data for business expansion and growth. Learn why testing your enterprise's data is pivotal for success with big data, Hadoop and NoSQL. Learn how to increase your testing speed, boost your testing coverage (up to 100%), and improve the level of quality within your data warehouse - all with one ETL testing tool. This information is geared towards: - Big Data & Data Warehouse Architects, - ETL Developers - ETL Testers, Big Data Testers - Data Analysts - Operations teams - Business Intelligence (BI) Architects - Data Management Officers & Directors You will learn how to: - Improve your Data Quality - Accelerate your data testing cycles - Reduce your costs & risks - Provide a huge ROI (as high as 1,300%)

QuerySurge Slide Deck for Big Data Testing Webinar

RTTS

Make Streaming Analytics work for you: The Devil is in the Details

DataWorks Summit/Hadoop Summit

The changing role of a QA | QualiTest Group

Qualitest

Apache Eagle: Secure Hadoop in Real Time

DataWorks Summit/Hadoop Summit

In the U.S., pharmaceutical firms and medical device manufacturers must meet electronic record-keeping regulations set by the Food and Drug Administration (FDA). The regulation is Title 21 CFR Part 11, commonly known as Part 11. Part 11 requires regulated firms to implement controls for software and systems involved in processing many forms of data as part of business operations and product development. Enterprise data warehouses are used by the pharmaceutical and medical device industries for storing data covered by Part 11 (for example, Safety Data and Clinical Study project data). QuerySurge, the only test tool designed specifically for automating the testing of data warehouses and the ETL process, has been effective in testing data warehouses used by Part 11-governed companies. The purpose of QuerySurge is to assure that your warehouse is not populated with bad data. In industry surveys, bad data has been found in every database and data warehouse studied and is estimated to cost firms on average $8.2 million annually, according to analyst firm Gartner. Most firms test far less than 10% of their data, leaving at risk the rest of the data they are using for critical audits and compliance reporting. QuerySurge can test up to 100% of your data and help assure your organization that this critical information is accurate. QuerySurge not only helps in eliminating bad data, but is also designed to support Part 11 compliance. Learn more at www.QuerySurge.com

Data Warehouse Testing in the Pharmaceutical Industry

RTTS

Building a Graph Database in Neo4j with Spark & Spark SQL to gain new insight...

DataWorks Summit/Hadoop Summit

Session Overview ------------------------------------------------ During this webinar, we covered the following topics while demonstrating our plug-in for Azure DevOps: - Installing the QuerySurge Azure DevOps Extension - Key features of Azure DevOps - Azure DevOps Pipeline creation - QuerySurge offerings in the Azure Marketplace - Virtual machine options in the Azure Cloud - Azure Cloud versus on-prem deployment options for QuerySurge And we answered the following questions: - Is QuerySurge in the Azure Cloud the right solution for my team? - Where does QuerySurge fit into the Azure DevOps platform? - What are QuerySurge’s various offerings in the Azure Cloud? - If QuerySurge in the cloud is not the right choice, what is my best deployment option? T o see a recording of the wwebinar, go to: https://www.youtube.com/watch?v=Cd7P_nJOejE

Webinar - QuerySurge and Azure DevOps in the Azure Cloud

RTTS

Accelerating Data Warehouse Modernization

DataWorks Summit/Hadoop Summit

What's hot (20)

Testing Big Data: Automated ETL Testing of Hadoop

2014 International Software Testing Conference in Seoul

Testing Big Data: Automated Testing of Hadoop with QuerySurge

Testistanbul 2016 - Keynote: "Enterprise Challenges of Test Data" by Rex Black

Whitepaper: Volume Testing Thick Clients and Databases

Big Data Testing: Ensuring MongoDB Data Quality

TESTING IN BIG DATA WORLD

Data Warehousing in Pharma: How to Find Bad Data while Meeting Regulatory Req...

the Data World Distilled

Big Data Day LA 2016/ Use Case Driven track - Reliable Media Reporting in an ...

Real Time Machine Learning Visualization with Spark

Completing the Data Equation: Test Data + Data Validation = Success

QuerySurge Slide Deck for Big Data Testing Webinar

Make Streaming Analytics work for you: The Devil is in the Details

The changing role of a QA | QualiTest Group

Apache Eagle: Secure Hadoop in Real Time

Data Warehouse Testing in the Pharmaceutical Industry

Building a Graph Database in Neo4j with Spark & Spark SQL to gain new insight...

Webinar - QuerySurge and Azure DevOps in the Azure Cloud

Accelerating Data Warehouse Modernization

Viewers also liked

This tutorial was held at IEEE BigData '14 on October 29, 2014 in Bethesda, ML, USA. Presenters: Chaitan Baru and Tilmann Rabl More information available at: http://msrg.org/papers/BigData14-Rabl Summary: This tutorial will introduce the audience to the broad set of issues involved in defining big data benchmarks, for creating auditable industry-standard benchmarks that consider performance as well as price/performance. Big data benchmarks must capture the essential characteristics of big data applications and systems, including heterogeneous data, e.g. structured, semi- structured, unstructured, graphs, and streams; large-scale and evolving system configurations; varying system loads; processing pipelines that progressively transform data; workloads that include queries as well as data mining and machine learning operations and algorithms. Different benchmarking approaches will be introduced, from micro-benchmarks to application- level benchmarking. Since May 2012, five workshops have been held on Big Data Benchmarking including participation from industry and academia. One of the outcomes of these meetings has been the creation of industry’s first big data benchmark, viz., TPCx-HS, the Transaction Processing Performance Council’s benchmark for Hadoop Systems. During these workshops, a number of other proposals have been put forward for more comprehensive big data benchmarking. The tutorial will present and discuss salient points and essential features of such benchmarks that have been identified in these meetings, by experts in big data as well as benchmarking. Two key approaches are now being pursued—one, called BigBench, is based on extending the TPC- Decision Support (TPC-DS) benchmark with big data applications characteristics. The other called Deep Analytics Pipeline, is based on modeling processing that is routinely encountered in real-life big data applications. Both will be discussed. We conclude with a discussion of a number of future directions for big data benchmarking

Big Data Benchmarking Tutorial

Tilmann Rabl

Testing of Hadoop, NoSQL and Data Warehouses Visually ----------------------------------------------------------------------------- We just made automated data testing really easy. Automate your Big Data testing visually, with no programming needed. See how to automate Hadoop, No SQL and Data Warehouse testing visually, without writing any SQL or HQL. See how QuerySurge, the leading Big Data testing solution, provides novices and non-technical team members with a fast & easy way to be productive immediately while speeding up testing for team members skilled in SQL/HQL. This webinar is geared towards: - Big Data & Data Warehouse Architects, ETL Developers - ETL Testers, Big Data Testers - Data Analysts - Operations teams - Business Intelligence (BI) Architects - Data Management Officers & Directors You will learn how to: • Improve your Data Quality • Accelerate your data testing cycles • Reduce your costs & risks • Realize a huge ROI

Big Data Testing : Automate theTesting of Hadoop, NoSQL & DWH without Writing...

RTTS

Big Data Benchmarking

Venkata Naga Ravi

Java Agile ALM: OTAP and DevOps in the Cloud

MongoDB

Big Data - Outcomes Performance Measured

Greenway Health

Big Data Performance and Capacity Management

rightsize

Ravikanth_CV_10 yrs_ETL-BI-BigData-Testing

Ravikanth Marpuri

Keynote Systems - Mobile Solutions Overview Presentation

vprathap

How to perform Analytics testing on your website and tools

Mayank Solanki

Slides from my "Data Driven Design" presentation from Web Directions South 2009. This presentation looks at: - How web designers can think about data driven, or "performance based" design - What problem it addresses with how we currently do design - A case study of how I applied "performance based design" to a project - The 'testing trinity' of CSS + Google Analytics + Google Website Optimizer The ideas in this presentation come from a book I'm working on, please sign up to get notified when it's released at: http://msrmnt.com/book or follow me on Twitter - @msrmnt for occasional book updates.

Data Driven Design - Web Analytics & Testing for Designers (Web Directions So...

Luke Stevens

Big data testing (1)

vodqancr

[Presented at FOSDEM 2016: https://fosdem.org/2016/schedule/event/nondeterminism_in_hadoop/] Developing and maintaining distributed systems like Hadoop is difficult. The difficulty comes from many factors, but we believe that one of the most important reasons is lacking of a good debugger for bugs specific to distributed systems. (e.g., non-deterministic hardware faults, message ordering, ..) In the talk, we will show Earthquake, our open-source debugging framework for distributed systems. Earthquakes permutes Ethernet packets, Filesystem events, Java/C function calls, and injected faults in various orders so as to control non-determinism in the cluster. Basically, Earthquake permutes events in a random order, but the user can write his/her own state exploration policy (in Go language) for finding deep bugs efficiently. Earthquake also controls non-determinism of the thread interleaving by calling sched_setattr(2) with randomized parameters. We will also share our successful stories about testing some Hadoop components with Earthquake. For ZooKeeper, we found a distributed race condition bug which decreases availability of a ZooKeeper cluster. We also reproduced a known ZooKeeper bug that no one had successfully reproduced for 2 years, and analyzed its cause. For YARN, we found a disk-fault tolerance bug that inappropriately marks faulty node as healthy. We also found bugs of non-Hadoop softwares, such as etcd. With Earthquake, you can also test your real distibuted systems without any modification.

Tackling non-determinism in Hadoop - Testing and debugging distributed system...

Akihiro Suda

Cigniti Technologies is an Independent Software Testing Services Company, headquartered in Irving, TX. Our test offerings include TCoE, Testing on Cloud, Enterprise Mobility Testing, Big Data Testing, Functional, Automation, Security and Performance Testing services. Our workforce is equally distributed between NA & India with a vision to be your local partner. Cigniti's SMART Tools and Cloud Enabled test labs provide cost effective solutions with early Return on Investments.

Cigniti Independent Software Testing Services

Cigniti Technologies Ltd

Towards a Systematic Study of Big Data Performance and Benchmarking

Saliya Ekanayake

Handling Big Data in Ship Performance & Navigation Monitoring.

Lokukaluge Prasad Perera

Divide and-conquer approach towards data analytics testing

KokilaRudresh

ATAGTR2017 Appium

Agile Testing Alliance

Big Data: Architecture and Performance Considerations in Logical Data Lakes

Denodo

Viewers also liked (18)

Big Data Benchmarking Tutorial

Big Data Testing : Automate theTesting of Hadoop, NoSQL & DWH without Writing...

Big Data Benchmarking

Java Agile ALM: OTAP and DevOps in the Cloud

Big Data - Outcomes Performance Measured

Big Data Performance and Capacity Management

Ravikanth_CV_10 yrs_ETL-BI-BigData-Testing

Keynote Systems - Mobile Solutions Overview Presentation

How to perform Analytics testing on your website and tools

Data Driven Design - Web Analytics & Testing for Designers (Web Directions So...

Big data testing (1)

Tackling non-determinism in Hadoop - Testing and debugging distributed system...

Cigniti Independent Software Testing Services

Towards a Systematic Study of Big Data Performance and Benchmarking

Handling Big Data in Ship Performance & Navigation Monitoring.

Divide and-conquer approach towards data analytics testing

ATAGTR2017 Appium

Big Data: Architecture and Performance Considerations in Logical Data Lakes

Similar to Performance Testing of Big Data Applications - Impetus Webcast

Session: webMethods World; An Insider’s Tour with the webMethods Technology Team Slides from webMethods World session with Subhash Ramachandran, member of Group Executive Board, Software AG, during the Apama & Terracotta World Session at Innovation World 2014 conference, Oct 13-15, 2014, at the Hyatt Regency New Orleans, produced by Software AG. Three days of vision, inspiration and insight. Innovation World is THE global event for digital leaders who are driven to leverage the Software AG Suite: Alfabet, Apama, ARIS, webMethods, Software AG Live, Terracotta and Adabas-Natural.

IW14 Session: webMethods World

Software AG

SC15 PMIx Birds-of-a-Feather

rcastain

Spark One Platform Webinar

Cloudera, Inc.

Presented by Michael Noll, Product Manager, Confluent. Why are there so many stream processing frameworks that each define their own terminology? Are the components of each comparable? Why do you need to know about spouts or DStreams just to process a simple sequence of records? Depending on your application’s requirements, you may not need a full framework at all. Processing and understanding your data to create business value is the ultimate goal of a stream data platform. In this talk we will survey the stream processing landscape, the dimensions along which to evaluate stream processing technologies, and how they integrate with Apache Kafka. Particularly, we will learn how Kafka Streams, the built-in stream processing engine of Apache Kafka, compares to other stream processing systems that require a separate processing infrastructure.

A Practical Guide to Selecting a Stream Processing Technology

confluent

How Digital Changed the Game... and how to cross platform test for it

Lizzy Guido (she/her)

A top focus for application development today is on acceleration, but faster is not always equal to better. The bigger challenge is to improve both the speed and quality of software releases. By utilizing virtualization technology, specifically service virtualization and virtual dev/test labs, in software development lifecycles, companies can increase test coverage in less time and ultimately produce better software faster. HP Service Virtualization software allows development and testing teams to access limited or unavailable services in a simulated, virtual environment. This easy-to-use solution speeds application delivery, eliminates risks and reduces cost by virtualizing services within existing environments. By enabling parallel development and early functional testing, it eliminates wait times. HP Service Virtualization also reduces the use of high-cost, business-critical infrastructure or pay-per-use components for testing.

On-Demand Webinar: Software Virtualization Lifecycle

Skytap Cloud

Response time difference analysis of performance testing tools

Spoorthi Sham

No Devops Without Continuous Testing

Parasoft

Microservices, events, containers, and orchestrators are dominating our vernacular today. As operations teams adapt to support these technologies in production, cloud-native platforms like Pivotal Cloud Foundry and Kubernetes have quickly risen to serve as force multipliers of automation, productivity and value. Apache Kafka® is providing developers a critically important component as they build and modernize applications to cloud-native architecture. This talk will explore: • Why cloud-native platforms and why run Apache Kafka on Kubernetes? • What kind of workloads are best suited for this combination? • Tips to determine the path forward for legacy monoliths in your application portfolio • Demo: Running Apache Kafka as a Streaming Platform on Kubernetes

Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...

confluent

Musharraf_Syed_Resume

Syed Musharraf Ali Zaidi

Brendon Foxen (Channel 4) - Speeding up Software Delivery at Channel 4

Outlyer

Semaphore cloud development webinar

Ann Kelly

Marlabs’ independent testing services can help customers improve the quality and performance of their software applications along with faster time to market and reduced cost of testing. Our end-to-end outcome-based testing process is aligned with the client’s strategic and operational goals to provide maximum value. We offer a wide range of testing services including life cycle testing, test consulting, test automation services and specialized mobile and enterprise application testing services.

Marlabs Capabilities Overview: QA Services

Marlabs

Applications are moving to cloud and containers to boost reliability and speed delivery to production. However, if we use the same old approaches to testing, we'll fail to achieve the benefits of cloud. But what do we really need to change? We know we need to automate tests, but how do we keep our automation assets from becoming obsolete? Automatically provisioning test environments seems close, but some parts of our applications are hard to move to cloud.

Modernizing Testing as Apps Re-Architect

DevOps.com

NAMITA_KHULLAR

Namita Khullar

DevOps in the Hybrid Cloud

Richard Irving

Ramakrishnan M - Automation Tester

Ramakrishnan M

Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi

Felicia Haggarty

Change Management in Hybrid landscapes 2017

Chris Kernaghan

With every passing day, organizations are becoming more and more mindful about the performance of their Software Products. However, most of them still on look-out for the basics of Performance Engineering. According to a recent study by Gartner, fixing performance defects near the end of the development cycle costs 50 to 100 times more than the cost required for fixing it during the early phase of development. Hence, if a product suffers from serious performance issues it can be completely scrapped. Performance Engineering ensures that your application is performing as per expectations and the software is tested and tuned to meet specified or even the unstated performance requirements. We present you with a webcast on Performance Engineering Basics that would walk you through the elements and process of performance engineering, and also offers a methodical process for the same. It also offers details on a load testing tool, and describes how best to utilize it. Visit http: http://www.impetus.com/featured_webcast?eventid=10 to listen to the entire webcast (20 minutes). OR To post any queries on Performance Engineering, write to us at isales@impetus.com For case studies and articles on performance engineering please visit: http://www.impetus.com/plabs/casestudies?case_study=&pLabsClustering.pdf=

Performance Engineering Basics

Impetus Technologies

Similar to Performance Testing of Big Data Applications - Impetus Webcast (20)

IW14 Session: webMethods World

SC15 PMIx Birds-of-a-Feather

Spark One Platform Webinar

A Practical Guide to Selecting a Stream Processing Technology

How Digital Changed the Game... and how to cross platform test for it

On-Demand Webinar: Software Virtualization Lifecycle

Response time difference analysis of performance testing tools

No Devops Without Continuous Testing

Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...

Musharraf_Syed_Resume

Brendon Foxen (Channel 4) - Speeding up Software Delivery at Channel 4

Semaphore cloud development webinar

Marlabs Capabilities Overview: QA Services

Modernizing Testing as Apps Re-Architect

NAMITA_KHULLAR

DevOps in the Hybrid Cloud

Ramakrishnan M - Automation Tester

Whither the Hadoop Developer Experience, June Hadoop Meetup, Nitin Motgi

Change Management in Hybrid landscapes 2017

Performance Engineering Basics

More from Impetus Technologies

Data Warehouse Modernization Webinar Series- Critical Trends, Implementation ...

Impetus Technologies

Future-Proof Your Streaming Analytics Architecture- StreamAnalytix Webinar

Impetus Technologies

Building Real-time Streaming Apps in Minutes- Impetus Webinar

Impetus Technologies

Smart Enterprise Big Data Bus for the Modern Responsive Enterprise- StreamAna...

Impetus Technologies

Impetus White Paper- Handling Data Corruption in Elasticsearch

Impetus Technologies

Real-world Applications of Streaming Analytics- StreamAnalytix Webinar

Impetus Technologies

Real-world Applications of Streaming Analytics- StreamAnalytix Webinar

Impetus Technologies

Real-time Streaming Analytics for Enterprises based on Apache Storm - Impetus...

Impetus Technologies

Accelerating Hadoop Solution Lifecycle and Improving ROI- Impetus On-demand W...

Impetus Technologies

Presentation on 'Deep Learning: Evolution of ML from Statistical to Brain-like Computing' Speaker- Dr. Vijay Srinivas Agneeswaran,Director, Big Data Labs, Impetus The main objective of the presentation is to give an overview of our cutting edge work on realizing distributed deep learning networks over GraphLab. The objectives can be summarized as below: - First-hand experience and insights into implementation of distributed deep learning networks. - Thorough view of GraphLab (including descriptions of code) and the extensions required to implement these networks. - Details of how the extensions were realized/implemented in GraphLab source – they have been submitted to the community for evaluation. - Arrhythmia detection use case as an application of the large scale distributed deep learning network.

Deep Learning: Evolution of ML from Statistical to Brain-like Computing- Data...

Impetus Technologies

SPARK SUMMIT SESSION - A majority of the electricity in the U.S. is traded in independent system operator (ISO) based wholesale markets. ISO-based markets typically function in a two-step settlement process with day-ahead (DA) financial settlements followed by physical real-time (spot) market settlements for electricity. In this work, we focus on obtaining equilibrium bidding strategies for electricity generators in DA markets. Electricity prices in DA markets are determined by the ISO, which matches competing supply offers from power generators with demand bids from load serving entities. Since there are multiple generators competing with one another to supply power, this can be modeled as a competitive Markov decision problem, which we solve using a reinforcement learning approach. For power networks of realistic sizes, the state-action space could explode, making the RL procedure computationally intensive. This has motivated us to solve the above problem over Spark. The talk provides the following takeaways: 1. Modeling the day-ahead market as a Markov decision process 2. Code sketches to show the markov decision process solution over Spark and Mahout over Apache Tez 3. Performance results comparing Mahout over Apache Tez and Spark.

SPARK USE CASE- Distributed Reinforcement Learning for Electricity Market Bi...

Impetus Technologies

Enterprise Ready Android and Manageability- Impetus Webcast

Impetus Technologies

Impetus webcast ‘Real-time Streaming Analytics: Business Value, Use Cases and Architectural Considerations’ available at http://bit.ly/1i6OrwR The webinar talks about- • How business value is preserved and enhanced using Real-time Streaming Analytics with numerous use-cases in different industry verticals • Technical considerations for IT leaders and implementation teams looking to integrate Real-time Streaming Analytics into enterprise architecture roadmap • Recommendations for making Real-time Streaming Analytics – real – in your enterprise • Impetus StreamAnalytix – an enterprise ready platform for Real-time Streaming Analytics

Real-time Streaming Analytics: Business Value, Use Cases and Architectural Co...

Impetus Technologies

Impetus webcast "Leveraging NoSQL Database Technology to Implement Real-time Data Architectures” available at http://bit.ly/1g6Eaj4 This webcast: • Presents trade-offs of using different approaches to achieve a real-time architecture • Closely examines an implementation of a NoSQL based real-time architecture • Shares specific capabilities offered by NoSQL Databases that enable cost and reliability advantages over other techniques

Leveraging NoSQL Database Technology to Implement Real-time Data Architecture...

Impetus Technologies

Maturity of Mobile Test Automation: Approaches and Future Trends- Impetus Web...

Impetus Technologies

Big Data Analytics with Storm, Spark and GraphLab

Impetus Technologies

Webinar maturity of mobile test automation- approaches and future trends

Impetus Technologies

Next generation analytics with yarn, spark and graph lab

Impetus Technologies

For Impetus’ White Papers archive, visit- http://lf1.me/drb/ This white paper talks about the design considerations for enterprises to run Hadoop as a shared service for multiple departments. As Hadoop becomes more mainstream and indispensable to enterprises, it is imperative that they build, operate and scale shared Hadoop clusters. The design considerations discussed in this paper will help enterprises accomplish the essential mission of running multi-tenant, multi-use Hadoop clusters at scale. The white paper talks about Identity, Security, Resource Sharing, Monitoring and Operations on the Central Service. For Impetus’ White Papers archive, visit- http://lf1.me/drb/

The Shared Elephant - Hadoop as a Shared Service for Multiple Departments – I...

Impetus Technologies

Impetus webcast "Real-time Predictive Analytics in Manufacturing" available at http://lf1.me/hqb/ This Impetus webcast talks about: • The business value of predictive analytics • How real-time analytics is enabling ‘intelligent-data’ driven manufacturing • A Reference Architecture and real world examples based on the experiences of Impetus Big Data architects • A step-by-step guide for successfully implementing a predictive analytics solution

Real-time Predictive Analytics in Manufacturing - Impetus Webinar

Impetus Technologies

More from Impetus Technologies (20)