Postgres Sql at TripAdvisor

•

5 gefällt mir•1,758 views

Slide Deck from my recent talk at the first New England PostgreSQL User group meeting.

No, we’re not a travel agency www.tripadvisor.com/careers

Postgres at TripAdvisor By Don O’Neill & Boris Partensky 2 © 2011 TripAdvisor LLC All rights reserved.

TripAdvisor is the world’s largesttravel site 3 © 2011 TripAdvisor LLC All rights reserved.

4 40M monthly visitors 4M visitors/day 20+M registered members 45+M reviews & opinions © 2011 TripAdvisor LLC All rights reserved.

Business runs on Postgres Large Mission critical deployment Combination of 8.3 and 8.4 Site Technologies include Linux (CentOS), Apache Java, Tomcat, Velocity, and Memcached No commercial Software – All Open Source Web Scale Deployment Over 100 Frontend and Backend servers per Data Center 14 Postgres Database Servers per Data Center DR Data Center with Replication between the two Platform 5 © 2011 TripAdvisor LLC All rights reserved.

33 Postgres Servers across 3 Data Centers Not including Dev and QA servers SSD’s instead of Spinning disks for select servers Multiple Read Only DB Servers Load Balanced using BigIP Sync’d using DB Mirror replication Just under 1 TB of data in multiple databases Sharded Pin Table Over 1.5 billion rows Sharded to improve read and write performance Spread over 12 databases on 2 Servers Scale out to multiple servers as needed Routing logic built into our application layer By the Numbers 6 © 2011 TripAdvisor LLC All rights reserved.

All Servers configured as Active/Passive Cluster Not using Shared Disks or SAN’s DRBD for Block level replication between systems Heartbeat for automatic failover between nodes Data Replicated to DR Site TripAdvisor has 2 Data centers (MA and VA) One site “Live” at a time Equal capacity at both sites Routinely switch between sites Data Replicated between data centers Redundancy/Failover 7 © 2011 TripAdvisor LLC All rights reserved.

Replication based on DBmirror Like Slonyonly deprecated Community project once part of the core distribution Trigger based Master/Slave Replication Written in C and Perl All replicated tables must have primary keys TripAdvisor Updates include A Rewrite in Java! Support for SQL Server Lots of Hardening for large scale use Replication 8 © 2011 TripAdvisor LLC All rights reserved.

20 TB Data Warehouse today Expecting to grow significantly in 12 months 16 Node cluster expanding to 24 Based on Hadoop and Hive Reporting and Cubes built with SQL Server End users access the data via Excel and Reporting Services Critical for the growth of the business Long term data storage in Hadoop and not our SAN! Mobile Applications Award winning travel application Supported in iPhone, iPad, Android, Nokia, Windows, Palm http://www.tripadvisor.com/MobileApps Facebook Integration More and more users logging in via Facebook Better social experience on the site Major Initiatives 9 © 2011 TripAdvisor LLC All rights reserved.

Q&A Questions? Did I mention we’re hiring? 10 © 2011 TripAdvisor LLC All rights reserved.

Weitere ähnliche Inhalte

Was ist angesagt?

The Stream is the Database - Revolutionizing Healthcare Data Architecture

The Stream is the Database - Revolutionizing Healthcare Data Architecture

The Stream is the Database - Revolutionizing Healthcare Data Architecture

DataWorks Summit/Hadoop Summit

Big data and the cloud are perfect partners for companies who want to unlock maximum value from all of their unstructured, semi-structured, and structured data. The challenge has been how to create and manage a reliable end-to-end solution that spans data ingestion, storage and analysis in the face of the volume, velocity and variety of big data sources. In this webinar, we will show you how to achieve big data bliss by combining StreamSets Data Collector, which specializes in creating and running complex any-to-any dataflows, with Microsoft's Azure Data Lake and Azure analytic solutions. We will walk through an example of how a major bank is using StreamSets to transport their on-premise data to the Azure Cloud Computing Platform and Azure Data Lake to take advantage of analytics tools with unprecedented scale and performance.

Enabling Next Gen Analytics with Azure Data Lake and StreamSets

Enabling Next Gen Analytics with Azure Data Lake and StreamSets

Enabling Next Gen Analytics with Azure Data Lake and StreamSets

Streamsets Inc.

In the race to invent multi-million dollar business opportunities with exclusive insights, data scientists and engineers are hampered by a multitude of challenges just to make one use case a reality – the need to ingest data from multiple sources, apply real-time analytics, build machine learning algorithms, and intermix different data processing models, all while navigating around their legacy data infrastructure that is just not up to the task. This need has created the demand for Virtual Analytics, where the complexities of disparate data and technology silos have been abstracted away, coupled with a powerful range of analytics and processing horsepower, all in one unified data platform. This talk describes how Databricks is powering this revolutionary new trend with Apache Spark.

Virtualizing Analytics with Apache Spark: Keynote by Arsalan Tavakoli

Virtualizing Analytics with Apache Spark: Keynote by Arsalan Tavakoli

Virtualizing Analytics with Apache Spark: Keynote by Arsalan Tavakoli

Spark Summit Keynote by Seshu Adunuthula

Spark Summit Keynote by Seshu Adunuthula

Spark Summit Keynote by Seshu Adunuthula

Introduction to basic data analytics tools

Introduction to basic data analytics tools

Introduction to basic data analytics tools

Database Camp 2016 @ United Nations, NYC - Michael Glukhovsky, Co-Founder, Re...

Database Camp 2016 @ United Nations, NYC - Michael Glukhovsky, Co-Founder, Re...

Database Camp 2016 @ United Nations, NYC - Michael Glukhovsky, Co-Founder, Re...

✔ Eric David Benari, PMP

Our retail banking market demands now more than ever to stay close to our customers, and to carefully understand what services, products, and wishes are relevant for each customer at any given time. This sort of marketing research is often beyond the capacity of traditional BI reporting frameworks. In this talk, we illustrate how we team up data scientists and big data engineers in order to create and scale distributed analyses on a big data platform.

Big and fast a quest for relevant and real-time analytics

Big and fast a quest for relevant and real-time analytics

Big and fast a quest for relevant and real-time analytics

Spark and the Enterprise by Tony Baer

Spark and the Enterprise by Tony Baer

Spark and the Enterprise by Tony Baer

Middle Tier Scalability - Present and Future

Middle Tier Scalability - Present and Future

Middle Tier Scalability - Present and Future

MongoDB World 2019: Streaming ETL on the Shoulders of Giants

MongoDB World 2019: Streaming ETL on the Shoulders of Giants

MongoDB World 2019: Streaming ETL on the Shoulders of Giants

Spark Usage in Enterprise Business Operations

Spark Usage in Enterprise Business Operations

Spark Usage in Enterprise Business Operations

How did eBay move their ETL computation from conventional RDBMS environment over to Spark? What did it take to go from a strategic vision to a viable solution? This paper will take you through a journey which lead to an implementation of a 1000+ node Spark Cluster running 10,000+ ETL jobs daily, all done in a span of less than 6 months, by a team with limited Spark experience. We will share the vision, technical architecture, critical Management decisions, Challenges and Road ahead. This will be a unique opportunity to look into this awesome Spark success story at eBay!

Moving eBay’s Data Warehouse Over to Apache Spark – Spark as Core ETL Platfor...

Moving eBay’s Data Warehouse Over to Apache Spark – Spark as Core ETL Platfor...

Moving eBay’s Data Warehouse Over to Apache Spark – Spark as Core ETL Platfor...

Cassandra Essentials Day Cambridge

Cassandra Essentials Day Cambridge

Cassandra Essentials Day Cambridge

DataStax Enterprise in Practice (Field Notes)

DataStax Enterprise in Practice (Field Notes)

DataStax Enterprise in Practice (Field Notes)

HP ships millions of PCs, Printers, and other devices every year to customers in all market segments. More customers are seeking services provided with our products enabling new opportunities for HP to create services from the data we can collect from our devices. Every device we ship is an IoT endpoint with powerful CPU to capture rich data. Insights from this data are used internally to improve our products and focus on customer needs. In this presentation, John will focus on HP’s journey to enabling Big Data analytics from within a large enterprise environment. He will review the challenges and how HP decided on AWS, Apache Spark and Databricks as the foundation for their entry into Big Data Analytics. John will also review how HP uses Spark to build analytic services from the data they generate from their devices.

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Slides from Alistair Hann's presentation at 2014 All Your Base Conference in Oxford, UK Synopsis: Skyscanner performs 200 million searches every month, and generated $7bn of downstream revenue last year. Scaling from zero brought many challenges, in the context of a continually growing variety of databases and hardware. Alistair will talk about how that rapid change has shaped Skyscanner’s data architecture and how they moved from just using SQL Server to a range of hardware and data technologies (Postgres, Couchbase, ElasticSearch, Hadoop). (Unfortunately the animations were destroyed by the upload)

SomeSQL at Skyscanner - Scaling in a changing world of databases and hardware

SomeSQL at Skyscanner - Scaling in a changing world of databases and hardware

SomeSQL at Skyscanner - Scaling in a changing world of databases and hardware

Presto summit israel 2019-04

Presto summit israel 2019-04

Presto summit israel 2019-04

Spark Summit presentation by Ken Tsai

Spark Summit presentation by Ken Tsai

Spark Summit presentation by Ken Tsai

Today’s on-demand economy drives companies to provide fast load times, personalization, and instantaneous service for hungry end-users across all types of applications. Yet most still use dated, legacy systems to process and analyze data. In this session, Ankur Goyal, VP of Engineering at MemSQL will showcase implementing a one-click Lambda Architecture with Apache Spark, Apache Kafka and an operational database, resulting in lightning fast analytics on large, changing datasets.

Winning the On-Demand Economy with Spark and Predictive Analytics

Winning the On-Demand Economy with Spark and Predictive Analytics

Winning the On-Demand Economy with Spark and Predictive Analytics

Data analytics at a petabyte scale final

Data analytics at a petabyte scale final

Data analytics at a petabyte scale final

Was ist angesagt? (20)

The Stream is the Database - Revolutionizing Healthcare Data Architecture

The Stream is the Database - Revolutionizing Healthcare Data Architecture

The Stream is the Database - Revolutionizing Healthcare Data Architecture

Enabling Next Gen Analytics with Azure Data Lake and StreamSets

Enabling Next Gen Analytics with Azure Data Lake and StreamSets

Enabling Next Gen Analytics with Azure Data Lake and StreamSets

Virtualizing Analytics with Apache Spark: Keynote by Arsalan Tavakoli

Virtualizing Analytics with Apache Spark: Keynote by Arsalan Tavakoli

Virtualizing Analytics with Apache Spark: Keynote by Arsalan Tavakoli

Spark Summit Keynote by Seshu Adunuthula

Spark Summit Keynote by Seshu Adunuthula

Spark Summit Keynote by Seshu Adunuthula

Introduction to basic data analytics tools

Introduction to basic data analytics tools

Introduction to basic data analytics tools

Database Camp 2016 @ United Nations, NYC - Michael Glukhovsky, Co-Founder, Re...

Database Camp 2016 @ United Nations, NYC - Michael Glukhovsky, Co-Founder, Re...

Database Camp 2016 @ United Nations, NYC - Michael Glukhovsky, Co-Founder, Re...

Big and fast a quest for relevant and real-time analytics

Big and fast a quest for relevant and real-time analytics

Big and fast a quest for relevant and real-time analytics

Spark and the Enterprise by Tony Baer

Spark and the Enterprise by Tony Baer

Spark and the Enterprise by Tony Baer

Middle Tier Scalability - Present and Future

Middle Tier Scalability - Present and Future

Middle Tier Scalability - Present and Future

MongoDB World 2019: Streaming ETL on the Shoulders of Giants

MongoDB World 2019: Streaming ETL on the Shoulders of Giants

MongoDB World 2019: Streaming ETL on the Shoulders of Giants

Spark Usage in Enterprise Business Operations

Spark Usage in Enterprise Business Operations

Spark Usage in Enterprise Business Operations

Moving eBay’s Data Warehouse Over to Apache Spark – Spark as Core ETL Platfor...

Moving eBay’s Data Warehouse Over to Apache Spark – Spark as Core ETL Platfor...

Moving eBay’s Data Warehouse Over to Apache Spark – Spark as Core ETL Platfor...

Cassandra Essentials Day Cambridge

Cassandra Essentials Day Cambridge

Cassandra Essentials Day Cambridge

DataStax Enterprise in Practice (Field Notes)

DataStax Enterprise in Practice (Field Notes)

DataStax Enterprise in Practice (Field Notes)

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

SomeSQL at Skyscanner - Scaling in a changing world of databases and hardware

SomeSQL at Skyscanner - Scaling in a changing world of databases and hardware

SomeSQL at Skyscanner - Scaling in a changing world of databases and hardware

Presto summit israel 2019-04

Presto summit israel 2019-04

Presto summit israel 2019-04

Spark Summit presentation by Ken Tsai

Spark Summit presentation by Ken Tsai

Spark Summit presentation by Ken Tsai

Winning the On-Demand Economy with Spark and Predictive Analytics

Winning the On-Demand Economy with Spark and Predictive Analytics

Winning the On-Demand Economy with Spark and Predictive Analytics

Data analytics at a petabyte scale final

Data analytics at a petabyte scale final

Data analytics at a petabyte scale final

Ähnlich wie Postgres Sql at TripAdvisor

Senior database administrator

Senior database administrator

Senior database administrator

Mustafa EL-Masry

Handling Data in Mega Scale Systems

Handling Data in Mega Scale Systems

Handling Data in Mega Scale Systems

Full Stack Web Developer (MERN STACK Developer.pptx

Full Stack Web Developer (MERN STACK Developer.pptx

Full Stack Web Developer (MERN STACK Developer.pptx

Mobile app development is a landscape that has been dominated by two major OS – Android (87% market share) and iOS (60% market share) in 2021. However, since the rise of startups, organizations have moved towards cross-platform app development practices. The two primary reasons behind this move are cost and time. https://www.tycoonstory.com/resource/top-local-databases-for-react-native-app-development/

Top local databases for react native app development

Top local databases for react native app development

Top local databases for react native app development

Neethu_Abraham

List of Top Local Databases used for react native app developement in 2022

List of Top Local Databases used for react native app developement in 2022

List of Top Local Databases used for react native app developement in 2022

Introduction to NoSQL and Couchbase

Introduction to NoSQL and Couchbase

Introduction to NoSQL and Couchbase

Scalding is a scala DSL for Cascading. Run on Hadoop, it’s a concise, functional, and very efficient way to build big data applications. One significant benefit of Scalding is that it allows easy porting of Scalding apps from MapReduce to newer, faster execution fabrics. In this webinar, Cyrille Chépélov, of Transparency Rights Management, will share how his organization boosted the performance of their Scalding apps by over 50% by moving away from MapReduce to Cascading 3.0 on Apache Tez. Dhruv Kumar, Hortonworks Partner Solution Engineer, will then explain how you can interact with data on HDP using Scala and leverage Scala as a programming language to develop Big Data applications.

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Scalding is a scala DSL for Cascading. Run on Hadoop, it’s a concise, functional, and very efficient way to build big data applications. One significant benefit of Scalding is that it allows easy porting of Scalding apps from MapReduce to newer, faster execution fabrics. In this webinar, Cyrille Chépélov, of Transparency Rights Management, will share how his organization boosted the performance of their Scalding apps by over 50% by moving away from MapReduce to Cascading 3.0 on Apache Tez. Dhruv Kumar, Hortonworks Partner Solution Engineer, will then explain how you can interact with data on HDP using Scala and leverage Scala as a programming language to develop Big Data applications.

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Scalding is a scala DSL for Cascading. Run on Hadoop, it’s a concise, functional, and very efficient way to build big data applications. One significant benefit of Scalding is that it allows easy porting of Scalding apps from MapReduce to newer, faster execution fabrics. In this webinar, Cyrille Chépélov, of Transparency Rights Management, will share how his organization boosted the performance of their Scalding apps by over 50% by moving away from MapReduce to Cascading 3.0 on Apache Tez. Dhruv Kumar, Hortonworks Partner Solution Engineer, will then explain how you can interact with data on HDP using Scala and leverage Scala as a programming language to develop Big Data applications.

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Metadata describes about data

Metadata describes about data

Metadata describes about data

Dev Sanskriti Vishwavidyalaya (University)

Presenters: Rachel Pedreschi, Senior Director, Solutions Engineering, Imply.io + Josh Treichel, Partner Solutions Architect, Confluent Analytic pipelines running purely on batch processing systems can suffer from hours of data lag, resulting in accuracy issues with analysis and overall decision-making. Join us for a demo to learn how easy it is to integrate your Apache Kafka® streams in Apache Druid (incubating) to provide real-time insights into the data. In this online talk, you’ll hear about ingesting your Kafka streams into Imply’s scalable analytic engine and gaining real-time insights via a modern user interface. Register now to learn about: -The benefits of combining a real-time streaming platform with a comprehensive analytics stack -Building an analytics pipeline by integrating Confluent Platform and Imply -How KSQL, streaming SQL for Kafka, can easily transform and filter streams of data in real time -Querying and visualizing streaming data in Imply -Practical ways to implement Confluent Platform and Imply to address common use cases such as analyzing network flows, collecting and monitoring IoT data and visualizing clickstream data Confluent Platform, developed by the creators of Kafka, enables the ingest and processing of massive amounts of real-time event data. Imply, the complete analytics stack built on Druid, can ingest, store, query and visualize streaming data from Confluent Platform, enabling end-to-end real-time analytics. Together, Confluent and Imply can provide low latency data delivery, data transform, and data querying capabilities to power a range of use cases.

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

To watch, please see: https://info.dynatrace.com/apm_wc_getting_started_with_devops_na_registration.html Starting Your DevOps Journey: Practical Tips for Ops In this webinar, Andreas Grabner, Chief DevOps Activist at Dynatrace, shares practical tips that all IT groups from Dev to Ops can use to start their DevOps journey quickly. With experience from hundreds of DevOps deployments, Andi provides insights it would take your team months or years to learn firsthand. - Learn how everyone on your Ops team can use APM to better understand and monitor SLAs, Performance and End User Impact of their applications. - Foster better collaboration between Ops and architects by extending basic system monitoring to monolith and microservices architectures. - Shift-left your testing and QA by working with metrics that you and the architects agreed on up front, resulting in early relevant feedback and faster code deployments. - Hear why changing the cultural mindset from “fear of change” to “Continuous Innovation and Optimization” is critical for success. Andi is joined by guest speaker, Brian Chandler, Systems Engineer at Raymond James, who shares commonly used Ops dashboards that increase collaboration across IT teams and pro-actively break down silos!

Starting Your DevOps Journey – Practical Tips for Ops

Starting Your DevOps Journey – Practical Tips for Ops

Starting Your DevOps Journey – Practical Tips for Ops

Whats new in Oracle Database 12c release 12.1.0.2

Whats new in Oracle Database 12c release 12.1.0.2

Whats new in Oracle Database 12c release 12.1.0.2

Connor McDonald

Introduction to Cloud Service Design

Introduction to Cloud Service Design

Introduction to Cloud Service Design

While a number of patterns and architectural guidelines exist for cloud-native applications, a discussion about data often leads to more questions than answers. For example, what are some of the typical data problems encountered, why are they different, and how can they be overcome? Join Prasad Radhakrishnan from Pivotal and Dave Nielsen from Redis Labs as they discuss: - Expectations and requirements of cloud-native data - Common faux pas and strategies on how you can avoid them Presenters: Prasad Radhakrishnan, Platform Architecture for Data at Pivotal Dave Nielsen, Head of Ecosystem Programs at Redis Labs

Cloud-Native Data: What data questions to ask when building cloud-native apps

Cloud-Native Data: What data questions to ask when building cloud-native apps

Cloud-Native Data: What data questions to ask when building cloud-native apps

React Native Local Database For Super Smart Applications.pdf

React Native Local Database For Super Smart Applications.pdf

React Native Local Database For Super Smart Applications.pdf

Rahul_Resume_310116

Rahul_Resume_310116

Rahul_Resume_310116

Ops Jumpstart: MongoDB Administration 101

Ops Jumpstart: MongoDB Administration 101

Ops Jumpstart: MongoDB Administration 101

Our experts will walk you through some key design considerations when deploying a Hadoop cluster in production. We'll also share practical best practices around HP and Hortonworks Data Platform to get you started on building your modern data architecture. Learn how to: - Leverage best practices for deployment - Choose a deployment model - Design your Hadoop cluster - Build a Modern Data Architecture and vision for the Data Lake

Hp Converged Systems and Hortonworks - Webinar Slides

Hp Converged Systems and Hortonworks - Webinar Slides

Hp Converged Systems and Hortonworks - Webinar Slides

Ähnlich wie Postgres Sql at TripAdvisor (20)

Senior database administrator

Senior database administrator

Senior database administrator

Handling Data in Mega Scale Systems

Handling Data in Mega Scale Systems

Handling Data in Mega Scale Systems

Full Stack Web Developer (MERN STACK Developer.pptx

Full Stack Web Developer (MERN STACK Developer.pptx

Full Stack Web Developer (MERN STACK Developer.pptx

Top local databases for react native app development

Top local databases for react native app development

Top local databases for react native app development

Neethu_Abraham

List of Top Local Databases used for react native app developement in 2022

List of Top Local Databases used for react native app developement in 2022

List of Top Local Databases used for react native app developement in 2022

Introduction to NoSQL and Couchbase

Introduction to NoSQL and Couchbase

Introduction to NoSQL and Couchbase

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Boost Performance with Scala – Learn From Those Who’ve Done It!

Metadata describes about data

Metadata describes about data

Metadata describes about data

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

Achieve Sub-Second Analytics on Apache Kafka with Confluent and Imply

Starting Your DevOps Journey – Practical Tips for Ops

Starting Your DevOps Journey – Practical Tips for Ops

Starting Your DevOps Journey – Practical Tips for Ops

Whats new in Oracle Database 12c release 12.1.0.2

Whats new in Oracle Database 12c release 12.1.0.2

Whats new in Oracle Database 12c release 12.1.0.2

Introduction to Cloud Service Design

Introduction to Cloud Service Design

Introduction to Cloud Service Design

Cloud-Native Data: What data questions to ask when building cloud-native apps

Cloud-Native Data: What data questions to ask when building cloud-native apps

Cloud-Native Data: What data questions to ask when building cloud-native apps

React Native Local Database For Super Smart Applications.pdf

React Native Local Database For Super Smart Applications.pdf

React Native Local Database For Super Smart Applications.pdf

Rahul_Resume_310116

Rahul_Resume_310116

Rahul_Resume_310116

Ops Jumpstart: MongoDB Administration 101

Ops Jumpstart: MongoDB Administration 101

Ops Jumpstart: MongoDB Administration 101

Hp Converged Systems and Hortonworks - Webinar Slides

Hp Converged Systems and Hortonworks - Webinar Slides

Hp Converged Systems and Hortonworks - Webinar Slides

Kürzlich hochgeladen

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Advantages of Hiring UIUX Design Service Providers for Your Business

Advantages of Hiring UIUX Design Service Providers for Your Business

Advantages of Hiring UIUX Design Service Providers for Your Business

Pixlogix Infotech

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

GenCyber Cyber Security Day Presentation

GenCyber Cyber Security Day Presentation

GenCyber Cyber Security Day Presentation

Michael W. Hawkins

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

Gabriella Davis

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Effective data discovery is crucial for maintaining compliance and mitigating risks in today's rapidly evolving privacy landscape. However, traditional manual approaches often struggle to keep pace with the growing volume and complexity of data. Join us for an insightful webinar where industry leaders from TrustArc and Privya will share their expertise on leveraging AI-powered solutions to revolutionize data discovery. You'll learn how to: - Effortlessly maintain a comprehensive, up-to-date data inventory - Harness code scanning insights to gain complete visibility into data flows leveraging the advantages of code scanning over DB scanning - Simplify compliance by leveraging Privya's integration with TrustArc - Implement proven strategies to mitigate third-party risks Our panel of experts will discuss real-world case studies and share practical strategies for overcoming common data discovery challenges. They'll also explore the latest trends and innovations in AI-driven data management, and how these technologies can help organizations stay ahead of the curve in an ever-changing privacy landscape.

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Imagine a world where information flows as swiftly as thought itself, making decision-making as fluid as the data driving it. Every moment is critical, and the right tools can significantly boost your organization’s performance. The power of real-time data automation through FME can turn this vision into reality. Aimed at professionals eager to leverage real-time data for enhanced decision-making and efficiency, this webinar will cover the essentials of real-time data and its significance. We’ll explore: FME’s role in real-time event processing, from data intake and analysis to transformation and reporting An overview of leveraging streams vs. automations FME’s impact across various industries highlighted by real-life case studies Live demonstrations on setting up FME workflows for real-time data Practical advice on getting started, best practices, and tips for effective implementation Join us to enhance your skills in real-time data automation with FME, and take your operational capabilities to the next level.

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Three things you will take away from the session: • How to run an effective tenant-to-tenant migration • Best practices for before, during, and after migration • Tips for using migration as a springboard to prepare for Copilot in Microsoft 365 Main ideas: Migration Overview: The presentation covers the current reality of cross-tenant migrations, the triggers, phases, best practices, and benefits of a successful tenant migration Considerations: When considering a migration, it is important to consider the migration scope, performance, customization, flexibility, user-friendly interface, automation, monitoring, support, training, scalability, data integrity, data security, cost, and licensing structure Next Wave: The next wave of change includes the launch of Copilot, which requires businesses to be prepared for upcoming changes related to Copilot and the cloud, and to consolidate data and tighten governance ShareGate: ShareGate can help with pre-migration analysis, configurable migration tool, and automated, end-user driven collaborative governance

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Enterprise Knowledge’s Urmi Majumder, Principal Data Architecture Consultant, and Fernando Aguilar Islas, Senior Data Science Consultant, presented "Driving Behavioral Change for Information Management through Data-Driven Green Strategy" on March 27, 2024 at Enterprise Data World (EDW) in Orlando, Florida. In this presentation, Urmi and Fernando discussed a case study describing how the information management division in a large supply chain organization drove user behavior change through awareness of the carbon footprint of their duplicated and near-duplicated content, identified via advanced data analytics. Check out their presentation to gain valuable perspectives on utilizing data-driven strategies to influence positive behavioral shifts and support sustainability initiatives within your organization. In this session, participants gained answers to the following questions: - What is a Green Information Management (IM) Strategy, and why should you have one? - How can Artificial Intelligence (AI) and Machine Learning (ML) support your Green IM Strategy through content deduplication? - How can an organization use insights into their data to influence employee behavior for IM? - How can you reap additional benefits from content reduction that go beyond Green IM?

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Enterprise Knowledge

Kürzlich hochgeladen (20)

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Tata AIG General Insurance Company - Insurer Innovation Award 2024

Advantages of Hiring UIUX Design Service Providers for Your Business

Advantages of Hiring UIUX Design Service Providers for Your Business

Advantages of Hiring UIUX Design Service Providers for Your Business

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays New York 2024 - The value of a flexible API Management solution for O...

GenCyber Cyber Security Day Presentation

GenCyber Cyber Security Day Presentation

GenCyber Cyber Security Day Presentation

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

A Domino Admins Adventures (Engage 2024)

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

Artificial Intelligence: Facts and Myths

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

From Event to Action: Accelerate Your Decision Making with Real-Time Automation

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

GenAI Risks & Security Meetup 01052024.pdf

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Partners Life - Insurer Innovation Award 2024

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Strategies for Landing an Oracle DBA Job as a Fresher

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Automating Google Workspace (GWS) & more with Apps Script

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Powerful Google developer tools for immediate impact! (2023-24 C)

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Driving Behavioral Change for Information Management through Data-Driven Gree...

Postgres Sql at TripAdvisor

1. No, we’re not a travel agency www.tripadvisor.com/careers

2. Postgres at TripAdvisor By Don O’Neill & Boris Partensky 2 © 2011 TripAdvisor LLC All rights reserved.

3. TripAdvisor is the world’s largesttravel site 3 © 2011 TripAdvisor LLC All rights reserved.

4. 4 40M monthly visitors 4M visitors/day 20+M registered members 45+M reviews & opinions © 2011 TripAdvisor LLC All rights reserved.

5. Business runs on Postgres Large Mission critical deployment Combination of 8.3 and 8.4 Site Technologies include Linux (CentOS), Apache Java, Tomcat, Velocity, and Memcached No commercial Software – All Open Source Web Scale Deployment Over 100 Frontend and Backend servers per Data Center 14 Postgres Database Servers per Data Center DR Data Center with Replication between the two Platform 5 © 2011 TripAdvisor LLC All rights reserved.

6. 33 Postgres Servers across 3 Data Centers Not including Dev and QA servers SSD’s instead of Spinning disks for select servers Multiple Read Only DB Servers Load Balanced using BigIP Sync’d using DB Mirror replication Just under 1 TB of data in multiple databases Sharded Pin Table Over 1.5 billion rows Sharded to improve read and write performance Spread over 12 databases on 2 Servers Scale out to multiple servers as needed Routing logic built into our application layer By the Numbers 6 © 2011 TripAdvisor LLC All rights reserved.

7. All Servers configured as Active/Passive Cluster Not using Shared Disks or SAN’s DRBD for Block level replication between systems Heartbeat for automatic failover between nodes Data Replicated to DR Site TripAdvisor has 2 Data centers (MA and VA) One site “Live” at a time Equal capacity at both sites Routinely switch between sites Data Replicated between data centers Redundancy/Failover 7 © 2011 TripAdvisor LLC All rights reserved.

8. Replication based on DBmirror Like Slonyonly deprecated Community project once part of the core distribution Trigger based Master/Slave Replication Written in C and Perl All replicated tables must have primary keys TripAdvisor Updates include A Rewrite in Java! Support for SQL Server Lots of Hardening for large scale use Replication 8 © 2011 TripAdvisor LLC All rights reserved.

9. 20 TB Data Warehouse today Expecting to grow significantly in 12 months 16 Node cluster expanding to 24 Based on Hadoop and Hive Reporting and Cubes built with SQL Server End users access the data via Excel and Reporting Services Critical for the growth of the business Long term data storage in Hadoop and not our SAN! Mobile Applications Award winning travel application Supported in iPhone, iPad, Android, Nokia, Windows, Palm http://www.tripadvisor.com/MobileApps Facebook Integration More and more users logging in via Facebook Better social experience on the site Major Initiatives 9 © 2011 TripAdvisor LLC All rights reserved.

10. Q&A Questions? Did I mention we’re hiring? 10 © 2011 TripAdvisor LLC All rights reserved.