SlideShare a Scribd company logo
1 of 19
Download to read offline
PostgreSQL Portland
Performance Practice Project
    Database Test 2 (DBT-2)
          Background


         Mark Wong
    markwkm@postgresql.org

      Portland State University


        January 8, 2009
Contents




        DBT-2 Background
    ◮

        Test Architecture
    ◮

        Database Schema
    ◮

        Transactions
    ◮
Once upon a time. . .


   The OSDL (Open Source Development Labs) mission was:
          Providing Open Source developers with computing
          resources to build data center and telco class
          enhancements into Linux and its Open Source software
          stack, enabling it to become the leading UNIX Operating
          System for e-Business development and deployment.1




     1
         http://web.archive.org/web/20020517124256/http://www.osdl.org/lab/mission.html
One approach to achieve the OSDL mission




   The DBT (Database Test) kits were derived from industry
   standard specifications that have well understood workloads to
   characterize Linux based systems. But when using a completely
   open source software stack, it turned from an operating system
   oriented characterization to a database management systems
   tuning and development exercise. In other words the focus turned
   to open source database management systems.
Database Test 2 (DBT-2)




 What DBT-2 Is                     What DBT-2 Is Not
       Test Kit                         Marketing benchmarking kit
   ◮                                ◮

       OLTP Workload                    TPC-C Benchmark
   ◮                                ◮
                                        compliant
       TPC-C Fair-Use Derivative
   ◮

       Open Source
   ◮
Online transaction processing (OLTP)

          Online transaction processing, or OLTP, refers to a class
          of systems that facilitate and manage
          transaction-oriented applications, typically for data entry
          and retrieval transaction processing. The term is
          somewhat ambiguous; some understand a ”transaction”
          in the context of computer or database transactions,
          while others (such as the Transaction Processing
          Performance Council) define it in terms of business or
          commercial transactions.2 OLTP has also been used to
          refer to processing in which the system responds
          immediately to user requests. An automatic teller
          machine (ATM) for a bank is an example of a
          commercial transaction processing application.3

      2
        Transaction Processing Performance Council website
   (http://www.tpc.org/)
      3
        http://en.wikipedia.org/wiki/OLTP
TPC (Transaction Processing Performance Council)




          The TPC is a non-profit corporation founded to define
          transaction processing and database benchmarks and to
          disseminate objective, verifiable TPC performance data
          to the industry.4




     4
         http://www.tpc.org/information/about/about.asp
TPC-C Benchmark


         Approved in July of 1992, TPC Benchmark C is an
         on-line transaction processing (OLTP) benchmark.
         TPC-C is more complex than previous OLTP benchmarks
         such as TPC-A because of its multiple transaction types,
         more complex database and overall execution structure.
         TPC-C involves a mix of five concurrent transactions of
         different types and complexity either executed on-line or
         queued for deferred execution. The database is comprised
         of nine types of tables with a wide range of record and
         population sizes. TPC-C is measured in transactions per
         minute (tpmC).5




    5
        http://www.tpc.org/tpcc/
Why DBT-2?




  A TPC-C open source fair-use implementation for testing and
  characterizing database management systems.
Why isn’t this a TPC-C?




        Kit not audited by 3rd party auditor.
    ◮

        No terminal emulator.
    ◮

        No commercially supported transaction manager.
    ◮

        No ACID tests.
    ◮

        No pricing information.
    ◮
What does a TPC-C look like?




   Have a look:
   http://www.tpc.org/tpcc/results/tpcc_results.asp
What does DBT-2 look like?




   Have a look:
   http://osdldbt.sourceforge.net/dbt2/pgsql/report/
DBT-2 Components
DBT-2 Transactions




   5 Transactions
         Delivery - Read/Write
     ◮

         New Order - Read/Write
     ◮

         Order Status - Read/Write
     ◮

         Payment - Read/Write
     ◮

         Stock Level - Read Only
     ◮
Materials Are Freely Available




   PDF
         http://www.slideshare.net/markwkm
     ◮

   LTEX Beamer (source)
   A
     ◮ http://git.postgresql.org/?p=~markwkm/performance-tuning.git
Time and Location




   When: 2nd Thursday of the month
   Location: Portland State University
   Room: FAB 86-01 (Fourth Avenue Building)
   Map: http://www.pdx.edu/map.html
Coming up next time. . .




   Diving deep into the DBT-2 kit.

                     ~~~/    . o O ( Thank you! )
                 /
        ,----(         oo      )
                 
    /                        /
   /|             (    |(
   ^             / |
          /
        ||       | | -quot;
Acknowledgements




  Haley Jane Wakenshaw

                    ~~~/   
                /
       ,----(         oo        )
                
   /                        /
  /|             (    |(
  ^             / |
         /
       ||       | | -quot;
License




   This work is licensed under a Creative Commons Attribution 3.0
   Unported License. To view a copy of this license, (a) visit
   http://creativecommons.org/licenses/by/3.0/us/; or, (b)
   send a letter to Creative Commons, 171 2nd Street, Suite 300, San
   Francisco, California, 94105, USA.

More Related Content

Similar to PostgreSQL Portland Performance Practice Project - Database Test 2 Background

Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Hw09   Hadoop Based Data Mining Platform For The Telecom IndustryHw09   Hadoop Based Data Mining Platform For The Telecom Industry
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Cloudera, Inc.
 
Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02
johnbryan26
 
Resume_052715
Resume_052715Resume_052715
Resume_052715
Phu Sam
 

Similar to PostgreSQL Portland Performance Practice Project - Database Test 2 Background (20)

NLP-Focused Applied ML at Scale for Global Fleet Analytics at ExxonMobil
NLP-Focused Applied ML at Scale for Global Fleet Analytics at ExxonMobilNLP-Focused Applied ML at Scale for Global Fleet Analytics at ExxonMobil
NLP-Focused Applied ML at Scale for Global Fleet Analytics at ExxonMobil
 
5 pipeline arch_rationale
5 pipeline arch_rationale5 pipeline arch_rationale
5 pipeline arch_rationale
 
Best practices for_large_oracle_apps_r12_implementations
Best practices for_large_oracle_apps_r12_implementationsBest practices for_large_oracle_apps_r12_implementations
Best practices for_large_oracle_apps_r12_implementations
 
Functioning incessantly of Data Science Platform with Kubeflow - Albert Lewan...
Functioning incessantly of Data Science Platform with Kubeflow - Albert Lewan...Functioning incessantly of Data Science Platform with Kubeflow - Albert Lewan...
Functioning incessantly of Data Science Platform with Kubeflow - Albert Lewan...
 
Computers in management
Computers in managementComputers in management
Computers in management
 
15 Troubleshooting tips and Tricks for Database 21c - KSAOUG
15 Troubleshooting tips and Tricks for Database 21c - KSAOUG15 Troubleshooting tips and Tricks for Database 21c - KSAOUG
15 Troubleshooting tips and Tricks for Database 21c - KSAOUG
 
15 Troubleshooting Tips and Tricks for database 21c - OGBEMEA KSAOUG
15 Troubleshooting Tips and Tricks for database 21c - OGBEMEA KSAOUG15 Troubleshooting Tips and Tricks for database 21c - OGBEMEA KSAOUG
15 Troubleshooting Tips and Tricks for database 21c - OGBEMEA KSAOUG
 
Mainframe Technology Overview
Mainframe Technology OverviewMainframe Technology Overview
Mainframe Technology Overview
 
Synapse 2018 Guarding against failure in a hundred step pipeline
Synapse 2018 Guarding against failure in a hundred step pipelineSynapse 2018 Guarding against failure in a hundred step pipeline
Synapse 2018 Guarding against failure in a hundred step pipeline
 
Automatically partitioning packet processing applications for pipelined archi...
Automatically partitioning packet processing applications for pipelined archi...Automatically partitioning packet processing applications for pipelined archi...
Automatically partitioning packet processing applications for pipelined archi...
 
Ai meetup Neural machine translation updated
Ai meetup Neural machine translation updatedAi meetup Neural machine translation updated
Ai meetup Neural machine translation updated
 
PostgreSQL Portland Performance Practice Project - Database Test 2 Howto
PostgreSQL Portland Performance Practice Project - Database Test 2 HowtoPostgreSQL Portland Performance Practice Project - Database Test 2 Howto
PostgreSQL Portland Performance Practice Project - Database Test 2 Howto
 
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
Hw09   Hadoop Based Data Mining Platform For The Telecom IndustryHw09   Hadoop Based Data Mining Platform For The Telecom Industry
Hw09 Hadoop Based Data Mining Platform For The Telecom Industry
 
Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02Step by-step-lsmw-tutorial-101208040548-phpapp02
Step by-step-lsmw-tutorial-101208040548-phpapp02
 
Resume_052715
Resume_052715Resume_052715
Resume_052715
 
White paper: Software-Defined Networking Matrix Switching
White paper: Software-Defined Networking Matrix SwitchingWhite paper: Software-Defined Networking Matrix Switching
White paper: Software-Defined Networking Matrix Switching
 
Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....
Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....
Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....
 
Daya_DBA
Daya_DBADaya_DBA
Daya_DBA
 
Best practices for large oracle apps r12 implementations apps14
Best practices for large oracle apps r12 implementations apps14Best practices for large oracle apps r12 implementations apps14
Best practices for large oracle apps r12 implementations apps14
 
Container orchestration from theory to practice
Container orchestration from theory to practiceContainer orchestration from theory to practice
Container orchestration from theory to practice
 

More from Mark Wong

OHAI, my name is Chelnik! PGCon 2014 Mockumentary
OHAI, my name is Chelnik! PGCon 2014 MockumentaryOHAI, my name is Chelnik! PGCon 2014 Mockumentary
OHAI, my name is Chelnik! PGCon 2014 Mockumentary
Mark Wong
 
Introduction to PostgreSQL
Introduction to PostgreSQLIntroduction to PostgreSQL
Introduction to PostgreSQL
Mark Wong
 

More from Mark Wong (16)

OHAI, my name is Chelnik! PGCon 2014 Mockumentary
OHAI, my name is Chelnik! PGCon 2014 MockumentaryOHAI, my name is Chelnik! PGCon 2014 Mockumentary
OHAI, my name is Chelnik! PGCon 2014 Mockumentary
 
OHAI, my name is Chelnik! Postgres Open 2013 Report
OHAI, my name is Chelnik! Postgres Open 2013 ReportOHAI, my name is Chelnik! Postgres Open 2013 Report
OHAI, my name is Chelnik! Postgres Open 2013 Report
 
collectd & PostgreSQL
collectd & PostgreSQLcollectd & PostgreSQL
collectd & PostgreSQL
 
Android & PostgreSQL
Android & PostgreSQLAndroid & PostgreSQL
Android & PostgreSQL
 
PGTop for Android: Things I learned making this app
PGTop for Android: Things I learned making this appPGTop for Android: Things I learned making this app
PGTop for Android: Things I learned making this app
 
Introduction to PostgreSQL
Introduction to PostgreSQLIntroduction to PostgreSQL
Introduction to PostgreSQL
 
Developing PGTop for Android
Developing PGTop for AndroidDeveloping PGTop for Android
Developing PGTop for Android
 
Pg in-the-brazilian-armed-forces-presentation
Pg in-the-brazilian-armed-forces-presentationPg in-the-brazilian-armed-forces-presentation
Pg in-the-brazilian-armed-forces-presentation
 
pg_proctab: Accessing System Stats in PostgreSQL
pg_proctab: Accessing System Stats in PostgreSQLpg_proctab: Accessing System Stats in PostgreSQL
pg_proctab: Accessing System Stats in PostgreSQL
 
pg_proctab: Accessing System Stats in PostgreSQL
pg_proctab: Accessing System Stats in PostgreSQLpg_proctab: Accessing System Stats in PostgreSQL
pg_proctab: Accessing System Stats in PostgreSQL
 
Filesystem Performance from a Database Perspective
Filesystem Performance from a Database PerspectiveFilesystem Performance from a Database Perspective
Filesystem Performance from a Database Perspective
 
PostgreSQL Portland Performance Practice Project - Database Test 2 Filesystem...
PostgreSQL Portland Performance Practice Project - Database Test 2 Filesystem...PostgreSQL Portland Performance Practice Project - Database Test 2 Filesystem...
PostgreSQL Portland Performance Practice Project - Database Test 2 Filesystem...
 
PostgreSQL Portland Performance Practice Project - Database Test 2 Workload D...
PostgreSQL Portland Performance Practice Project - Database Test 2 Workload D...PostgreSQL Portland Performance Practice Project - Database Test 2 Workload D...
PostgreSQL Portland Performance Practice Project - Database Test 2 Workload D...
 
pg_top is 'top' for PostgreSQL: pg_top + pg_proctab
pg_top is 'top' for PostgreSQL: pg_top + pg_proctabpg_top is 'top' for PostgreSQL: pg_top + pg_proctab
pg_top is 'top' for PostgreSQL: pg_top + pg_proctab
 
Linux Filesystems, RAID, and more
Linux Filesystems, RAID, and moreLinux Filesystems, RAID, and more
Linux Filesystems, RAID, and more
 
What Is Going On?
What Is Going On?What Is Going On?
What Is Going On?
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 

PostgreSQL Portland Performance Practice Project - Database Test 2 Background

  • 1. PostgreSQL Portland Performance Practice Project Database Test 2 (DBT-2) Background Mark Wong markwkm@postgresql.org Portland State University January 8, 2009
  • 2. Contents DBT-2 Background ◮ Test Architecture ◮ Database Schema ◮ Transactions ◮
  • 3. Once upon a time. . . The OSDL (Open Source Development Labs) mission was: Providing Open Source developers with computing resources to build data center and telco class enhancements into Linux and its Open Source software stack, enabling it to become the leading UNIX Operating System for e-Business development and deployment.1 1 http://web.archive.org/web/20020517124256/http://www.osdl.org/lab/mission.html
  • 4. One approach to achieve the OSDL mission The DBT (Database Test) kits were derived from industry standard specifications that have well understood workloads to characterize Linux based systems. But when using a completely open source software stack, it turned from an operating system oriented characterization to a database management systems tuning and development exercise. In other words the focus turned to open source database management systems.
  • 5. Database Test 2 (DBT-2) What DBT-2 Is What DBT-2 Is Not Test Kit Marketing benchmarking kit ◮ ◮ OLTP Workload TPC-C Benchmark ◮ ◮ compliant TPC-C Fair-Use Derivative ◮ Open Source ◮
  • 6. Online transaction processing (OLTP) Online transaction processing, or OLTP, refers to a class of systems that facilitate and manage transaction-oriented applications, typically for data entry and retrieval transaction processing. The term is somewhat ambiguous; some understand a ”transaction” in the context of computer or database transactions, while others (such as the Transaction Processing Performance Council) define it in terms of business or commercial transactions.2 OLTP has also been used to refer to processing in which the system responds immediately to user requests. An automatic teller machine (ATM) for a bank is an example of a commercial transaction processing application.3 2 Transaction Processing Performance Council website (http://www.tpc.org/) 3 http://en.wikipedia.org/wiki/OLTP
  • 7. TPC (Transaction Processing Performance Council) The TPC is a non-profit corporation founded to define transaction processing and database benchmarks and to disseminate objective, verifiable TPC performance data to the industry.4 4 http://www.tpc.org/information/about/about.asp
  • 8. TPC-C Benchmark Approved in July of 1992, TPC Benchmark C is an on-line transaction processing (OLTP) benchmark. TPC-C is more complex than previous OLTP benchmarks such as TPC-A because of its multiple transaction types, more complex database and overall execution structure. TPC-C involves a mix of five concurrent transactions of different types and complexity either executed on-line or queued for deferred execution. The database is comprised of nine types of tables with a wide range of record and population sizes. TPC-C is measured in transactions per minute (tpmC).5 5 http://www.tpc.org/tpcc/
  • 9. Why DBT-2? A TPC-C open source fair-use implementation for testing and characterizing database management systems.
  • 10. Why isn’t this a TPC-C? Kit not audited by 3rd party auditor. ◮ No terminal emulator. ◮ No commercially supported transaction manager. ◮ No ACID tests. ◮ No pricing information. ◮
  • 11. What does a TPC-C look like? Have a look: http://www.tpc.org/tpcc/results/tpcc_results.asp
  • 12. What does DBT-2 look like? Have a look: http://osdldbt.sourceforge.net/dbt2/pgsql/report/
  • 14. DBT-2 Transactions 5 Transactions Delivery - Read/Write ◮ New Order - Read/Write ◮ Order Status - Read/Write ◮ Payment - Read/Write ◮ Stock Level - Read Only ◮
  • 15. Materials Are Freely Available PDF http://www.slideshare.net/markwkm ◮ LTEX Beamer (source) A ◮ http://git.postgresql.org/?p=~markwkm/performance-tuning.git
  • 16. Time and Location When: 2nd Thursday of the month Location: Portland State University Room: FAB 86-01 (Fourth Avenue Building) Map: http://www.pdx.edu/map.html
  • 17. Coming up next time. . . Diving deep into the DBT-2 kit. ~~~/ . o O ( Thank you! ) / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;
  • 18. Acknowledgements Haley Jane Wakenshaw ~~~/ / ,----( oo ) / / /| ( |( ^ / | / || | | -quot;
  • 19. License This work is licensed under a Creative Commons Attribution 3.0 Unported License. To view a copy of this license, (a) visit http://creativecommons.org/licenses/by/3.0/us/; or, (b) send a letter to Creative Commons, 171 2nd Street, Suite 300, San Francisco, California, 94105, USA.