The Eff monad, one monad to rule them all

•Als PPT, PDF herunterladen•

14 gefällt mir•5,401 views

The Eff monad is an alternative to monad transformers. It is implemented as a library in https://github.com/atnos-org/eff-cats and https://github.com/atnos-org/eff-scalaz

Technologie

Eric Torreborre
The Eff monad
One monad to
rule them all!

It must be evident how multifarious
and how mutually complicated are
the considerations which the working
of such an engine involve. There are
frequently several distinct sets of
effects going on simultaneously; all
in a manner independent of each
other, and yet to a greater or less
degree exercising a mutual influence.
Ada Lovelace,
1842

WHAT IF?
We need to use both Hadoop and S3?

Type-
level
effects
Eff monad
Value-
level
effects
Continuatio
nsInterpreters
Member
typeclass

Option
Interpreter
State
Interpreter
Continuation1
Continuation2
Option
Interpreter
Continuation3 +
State
Interpreter

Implicits
Use it in prod'
Renamings
Check laws
Missing functions
Benchmarking, Scalajs...

LINKS
Monads for functional programming
Monad transformers and modular interpreters
Extensible effects
Reflection without remorse
Freer monad, more extensible effects

Weitere ähnliche Inhalte

Was ist angesagt?

型プロバイダー開発ハンズオン.pptx

ssuserb6e6d5

Sorting Things Out: An Introduction to Card Sorting

Stephen Anderson

文献紹介：SegFormer: Simple and Efficient Design for Semantic Segmentation with Tr...

Toru Tamaki

scalar.pdf

Martin Odersky

Stack Data Structure & It's Application

Tech_MX

10.m way search tree

Chandan Singh

Information Architecture. Card Sorting

DCU_MPIUA

CPUの同時実行機能

Shinichiro Niiyama

Elasticsearchのサジェスト機能を使った話

ktaro_w

NTUSTxTDOH - Pwn基礎 2015/12/27

Sheng-Hao Ma

Unit 2 application of stack

LavanyaJ28

Analisys of Selection Sort and Bubble Sort

Humano Terricola

Bubble sort algorithm

David Burks-Courses

In this talk, I will dive into the stage level scheduling feature added to Apache Spark 3.1. Stage level scheduling extends upon Project Hydrogen by improving big data ETL and AI integration and also enables multiple other use cases. It is beneficial any time the user wants to change container resources between stages in a single Apache Spark application, whether those resources are CPU, Memory or GPUs. One of the most popular use cases is enabling end-to-end scalable Deep Learning and AI to efficiently use GPU resources. In this type of use case, users read from a distributed file system, do data manipulation and filtering to get the data into a format that the Deep Learning algorithm needs for training or inference and then sends the data into a Deep Learning algorithm. Using stage level scheduling combined with accelerator aware scheduling enables users to seamlessly go from ETL to Deep Learning running on the GPU by adjusting the container requirements for different stages in Spark within the same application. This makes writing these applications easier and can help with hardware utilization and costs. There are other ETL use cases where users want to change CPU and memory resources between stages, for instance there is data skew or perhaps the data size is much larger in certain stages of the application. In this talk, I will go over the feature details, cluster requirements, the API and use cases. I will demo how the stage level scheduling API can be used by Horovod to seamlessly go from data preparation to training using the Tensorflow Keras API using GPUs. The talk will also touch on other new Apache Spark 3.1 functionality, such as pluggable caching, which can be used to enable faster dataframe access when operating from GPUs.

Stage Level Scheduling Improving Big Data and AI Integration

Databricks

OpenFOAMスレッド並列化のための基礎検討

Fixstars Corporation

Reverse Engineering Dojo: Enhancing Assembly Reading Skills

Asuka Nakajima

Parquet is a columnar format designed to be extremely efficient and interoperable across the hadoop ecosystem. Its integration in most of the Hadoop processing frameworks (Impala, Hive, Pig, Cascading, Crunch, Scalding, Spark, …) and serialization models (Thrift, Avro, Protocol Buffers, …) makes it easy to use in existing ETL and processing pipelines, while giving flexibility of choice on the query engine (whether in Java or C++). In this talk, we will describe how one can us Parquet with a wide variety of data analysis tools like Spark, Impala, Pig, Hive, and Cascading to create powerful, efficient data analysis pipelines. Data management is simplified as the format is self describing and handles schema evolution. Support for nested structures enables more natural modeling of data for Hadoop compared to flat representations that create the need for often costly joins.

How to use Parquet as a basis for ETL and analytics

Julien Le Dem

about Tcpreplay

@ otsuka752

Spark 巨量資料處理基礎教學

NUTC, imac

Binary tree traversal ppt - 02.03.2020

V.V.Vanniapermal College for Women

Was ist angesagt? (20)

型プロバイダー開発ハンズオン.pptx

Sorting Things Out: An Introduction to Card Sorting

文献紹介：SegFormer: Simple and Efficient Design for Semantic Segmentation with Tr...

scalar.pdf

Stack Data Structure & It's Application

10.m way search tree

Information Architecture. Card Sorting

CPUの同時実行機能

Elasticsearchのサジェスト機能を使った話

NTUSTxTDOH - Pwn基礎 2015/12/27

Unit 2 application of stack

Analisys of Selection Sort and Bubble Sort

Bubble sort algorithm

Stage Level Scheduling Improving Big Data and AI Integration

OpenFOAMスレッド並列化のための基礎検討

Reverse Engineering Dojo: Enhancing Assembly Reading Skills

How to use Parquet as a basis for ETL and analytics

about Tcpreplay

Spark 巨量資料處理基礎教學

Binary tree traversal ppt - 02.03.2020

Mehr von Eric Torreborre

wire-all-the-things-lambda-days-2023.pdf

Eric Torreborre

Functional Programming is on the rise and many programmers fall in love with the idea that they can build well-behaved programs from small, well-understood, functions. However our community is still wondering how to best build large applications and services. Many techniques co-exist nowadays: functions-only, MTL, effects, Tagless-final, ReaderT pattern, dependency injection... This can be so confusing for newcomers. This talk will take a "zoom out" approach and come back to what we are really after: modularity. We will embark on a "modularity tour": - why is it so important to have modular programs? - vhy is it so hard to achieve modularity? - what can we expect from today's techniques? - what can we hope from the ongoing research?

The many faces of modularity

Eric Torreborre

What haskell taught us when we were not looking

Eric Torreborre

Wire once, rewire twice! (Haskell exchange-2018)

Eric Torreborre

Pratical eff-functional-conf

Eric Torreborre

Specs2, from starters to dessert and... a look in the kitchen

Eric Torreborre

Streaming, effects and beautiful folds: a winning trilogy

Eric Torreborre

Pratical eff-scalaitaly-2017

Eric Torreborre

Pratical eff monad at Scaladays Chicago

Eric Torreborre

Pratical eff

Eric Torreborre

Easy di-slideshare

Eric Torreborre

Generating data to run QuickCheck properties is a bit of a black art, especially when working with recursive data structures and (polymorphic) functions.In this talk we will review some of the issues and point to some literature aiming at solving them. We will in particular focus on one elegant piece of mathematics, combinatorial species, and see how they could serve as the foundation of data generation.

Data generation, the hard parts

Eric Torreborre

Origami, a monadic fold library for Scala

Eric Torreborre

“Make illegal state unrepresentable” - Yaron Minsky Starting from Yaron’s quote we will see where it traditionally applies: values sanitization (escaping), data structures (NonEmptyList), CS constructs (parsers). Does it still apply to the rest of the day-to-day programming where things look… complicated? In particular we will develop the example of executing applications which can run on single Amazon EC2 instances (for testing) or on full EMR clusters (for production) and which can take data from S3 (meaning that they need to download it and put it somewhere first) or use local data. Can we make sure we get the right paths? Can we know when it is possible to download data efficiently (using distcopy to go directly from S3 to the cluster for example)? The answer is: create specific data types to model the different cases and tame the complexity. The take-away: datatypes are not only for “data” but they can also encapsulate “logic”

Datatypes for the real world

Eric Torreborre

Specs2 3.4

Eric Torreborre

DSLs with fold algebras

Eric Torreborre

Specs2 whirlwind tour at Scaladays 2014

Eric Torreborre

$Epic success \/ failure, refactoring to *real* FP$ $Epic success \/ failure, refactoring to *real* FP$

Epic success \/ failure, refactoring to *real* FP

Eric Torreborre

Vampire methods

Eric Torreborre

Specs2 whirlwind-tour

Eric Torreborre

Mehr von Eric Torreborre (20)

wire-all-the-things-lambda-days-2023.pdf

The many faces of modularity

What haskell taught us when we were not looking

Wire once, rewire twice! (Haskell exchange-2018)

Pratical eff-functional-conf

Specs2, from starters to dessert and... a look in the kitchen

Streaming, effects and beautiful folds: a winning trilogy

Pratical eff-scalaitaly-2017

Pratical eff monad at Scaladays Chicago

Pratical eff

Easy di-slideshare

Data generation, the hard parts

Origami, a monadic fold library for Scala

Datatypes for the real world

Specs2 3.4

DSLs with fold algebras

Specs2 whirlwind tour at Scaladays 2014

$Epic success \/ failure, refactoring to *real* FP$ $Epic success \/ failure, refactoring to *real* FP$

Epic success \/ failure, refactoring to *real* FP

Vampire methods

Specs2 whirlwind-tour

Kürzlich hochgeladen

In this session, we will delve into strategic approaches for optimizing knowledge management within Microsoft 365, amidst the evolving landscape of Copilot. From leveraging automatic metadata classification and permission governance with SharePoint Premium, to unlocking Viva Engage for the cultivation of knowledge and communities, you will gain actionable insights to bolster your organization's knowledge-sharing initiatives. In this session, we will also explore how to facilitate solutions to enable your employees to find answers and expertise within Microsoft 365. You will leave equipped with practical techniques and a deeper understanding of how there is more to effective knowledge management than just enabling Copilot, but building actual solutions to prepare the knowledge that Copilot and your employees can use.

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Drew Madelung

A Principled Technologies deployment guide Conclusion Deploying VMware Cloud Foundation 5.1 on next gen Dell PowerEdge servers brings together critical virtualization capabilities and high-performing hardware infrastructure. Relying on our hands-on experience, this deployment guide offers a comprehensive roadmap that can guide your organization through the seamless integration of advanced VMware cloud solutions with the performance and reliability of Dell PowerEdge servers. In addition to the deployment efficiency, the Cloud Foundation 5.1 and PowerEdge solution delivered strong performance while running a MySQL database workload. By leveraging VMware Cloud Foundation 5.1 and PowerEdge servers, you could help your organization embrace cloud computing with confidence, potentially unlocking a new level of agility, scalability, and efficiency in your data center operations.

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Principled Technologies

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Increase engagement and revenue with Muvi Live Paywall! In this presentation, we will explore the five key benefits of using Muvi Live Paywall to monetize your live streams. You'll learn how Muvi Live Paywall can help you: Monetize your live content easily: Set up pay-per-view access to your live streams and start generating revenue from your content. Increase audience engagement: Provide exclusive, premium content behind the paywall to keep your viewers engaged. Gain valuable viewer insights: Track viewer data and analytics to better understand your audience and tailor your content accordingly. Reduce content piracy: Muvi Live Paywall's security features help protect your content from unauthorized distribution. Streamline your workflow: The all-in-one platform simplifies the process of managing and monetizing your live streams. With Muvi Live Paywall, you can take control of your live stream monetization and create a sustainable business model for your content. Learn more about Muvi Live Paywall and start generating revenue from your live streams today!

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams

Roshan Dwivedi

Created by Mozilla Research in 2012 and now part of Linux Foundation Europe, the Servo project is an experimental rendering engine written in Rust. It combines memory safety and concurrency to create an independent, modular, and embeddable rendering engine that adheres to web standards. Stewardship of Servo moved from Mozilla Research to the Linux Foundation in 2020, where its mission remains unchanged. After some slow years, in 2023 there has been renewed activity on the project, with a roadmap now focused on improving the engine’s CSS 2 conformance, exploring Android support, and making Servo a practical embeddable rendering engine. In this presentation, Rakhi Sharma reviews the status of the project, our recent developments in 2023, our collaboration with Tauri to make Servo an easy-to-use embeddable rendering engine, and our plans for the future to make Servo an alternative web rendering engine for the embedded devices industry. (c) Embedded Open Source Summit 2024 April 16-18, 2024 Seattle, Washington (US) https://events.linuxfoundation.org/embedded-open-source-summit/ https://ossna2024.sched.com/event/1aBNF/a-year-of-servo-reboot-where-are-we-now-rakhi-sharma-igalia

A Year of the Servo Reboot: Where Are We Now?

Igalia

presentation ICT roal in 21st century education

jfdjdjcjdnsjd

MINDCTI Revenue Release Quarter One 2024

MIND CTI

This presentation explores the impact of HTML injection attacks on web applications, detailing how attackers exploit vulnerabilities to inject malicious code into web pages. Learn about the potential consequences of such attacks and discover effective mitigation strategies to protect your web applications from HTML injection vulnerabilities. for more information visit https://bostoninstituteofanalytics.org/category/cyber-security-ethical-hacking/

HTML Injection Attacks: Impact and Mitigation Strategies

Boston Institute of Analytics

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

The Digital Insurer

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

Manulife - Insurer Innovation Award 2024

The Digital Insurer

Real Time Object Detection Using Open CV

Khem

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Partners Life - Insurer Innovation Award 2024

The Digital Insurer

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Product Anonymous

Following the popularity of "Cloud Revolution: Exploring the New Wave of Serverless Spatial Data," we're thrilled to announce this much-anticipated encore webinar. In this sequel, we'll dive deeper into the Cloud-Native realm by uncovering practical applications and FME support for these new formats, including COGs, COPC, FlatGeoBuf, GeoParquet, STAC, and ZARR. Building on the foundation laid by industry leaders Michelle Roby of Radiant Earth and Chris Holmes of Planet in the first webinar, this second part offers an in-depth look at the real-world application and behind-the-scenes dynamics of these cutting-edge formats. We will spotlight specific use-cases and workflows, showcasing their efficiency and relevance in practical scenarios. Discover the vast possibilities each format holds, highlighted through detailed discussions and demonstrations. Our expert speakers will dissect the key aspects and provide critical takeaways for effective use, ensuring attendees leave with a thorough understanding of how to apply these formats in their own projects. Elevate your understanding of how FME supports these cutting-edge technologies, enhancing your ability to manage, share, and analyze spatial data. Whether you're building on knowledge from our initial session or are new to the serverless spatial data landscape, this webinar is your gateway to mastering cloud-native formats in your workflows.

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Safe Software

Abhishek Deb(1), Mr Abdul Kalam(2) M. Des (UX) , School of Design, DIT University , Dehradun. This paper explores the future potential of AI-enabled smartphone processors, aiming to investigate the advancements, capabilities, and implications of integrating artificial intelligence (AI) into smartphone technology. The research study goals consist of evaluating the development of AI in mobile phone processors, analyzing the existing state as well as abilities of AI-enabled cpus determining future patterns as well as chances together with reviewing obstacles as well as factors to consider for more growth.

Exploring the Future Potential of AI-Enabled Smartphone Processors

debabhi2

The presentation explores the development and application of artificial intelligence (AI) from its inception to its current status in the modern world. The term "artificial intelligence" was first coined by John McCarthy in 1956 to describe efforts to develop computer programs capable of performing tasks that typically require human intelligence. This concept was first introduced at a conference held at Dartmouth College, where programs demonstrated capabilities such as playing chess, proving theorems, and interpreting texts. In the early stages, Alan Turing contributed to the field by defining intelligence as the ability of a being to respond to certain questions intelligently, proposing what is now known as the Turing Test to evaluate the presence of intelligent behavior in machines. As the decades progressed, AI evolved significantly. The 1980s focused on machine learning, teaching computers to learn from data, leading to the development of models that could improve their performance based on their experiences. The 1990s and 2000s saw further advances in algorithms and computational power, which allowed for more sophisticated data analysis techniques, including data mining. By the 2010s, the proliferation of big data and the refinement of deep learning techniques enabled AI to become mainstream. Notable milestones included the success of Google's AlphaGo and advancements in autonomous vehicles by companies like Tesla and Waymo. A major theme of the presentation is the application of generative AI, which has been used for tasks such as natural language text generation, translation, and question answering. Generative AI uses large datasets to train models that can then produce new, coherent pieces of text or other media. The presentation also discusses the ethical implications and the need for regulation in AI, highlighting issues such as privacy, bias, and the potential for misuse. These concerns have prompted calls for comprehensive regulations to ensure the safe and equitable use of AI technologies. Artificial intelligence has also played a significant role in healthcare, particularly highlighted during the COVID-19 pandemic, where it was used in drug discovery, vaccine development, and analyzing the spread of the virus. The capabilities of AI in healthcare are vast, ranging from medical diagnostics to personalized medicine, demonstrating the technology's potential to revolutionize fields beyond just technical or consumer applications. In conclusion, AI continues to be a rapidly evolving field with significant implications for various aspects of society. The development from theoretical concepts to real-world applications illustrates both the potential benefits and the challenges that come with integrating advanced technologies into everyday life. The ongoing discussion about AI ethics and regulation underscores the importance of managing these technologies responsibly to maximize their their benefits while minimizing potential harms.

Artificial Intelligence: Facts and Myths

Joaquim Jorge

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

Kürzlich hochgeladen (20)

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams

A Year of the Servo Reboot: Where Are We Now?

presentation ICT roal in 21st century education

MINDCTI Revenue Release Quarter One 2024

HTML Injection Attacks: Impact and Mitigation Strategies

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Manulife - Insurer Innovation Award 2024

Real Time Object Detection Using Open CV

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Partners Life - Insurer Innovation Award 2024

Automating Google Workspace (GWS) & more with Apps Script

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME

Exploring the Future Potential of AI-Enabled Smartphone Processors

Artificial Intelligence: Facts and Myths

GenAI Risks & Security Meetup 01052024.pdf

The Eff monad, one monad to rule them all

1. Eric Torreborre The Eff monad One monad to rule them all!

3. It must be evident how multifarious and how mutually complicated are the considerations which the working of such an engine involve. There are frequently several distinct sets of effects going on simultaneously; all in a manner independent of each other, and yet to a greater or less degree exercising a mutual influence. Ada Lovelace, 1842

5. You could have invented monads!

8. Exceptions?

9. Exceptions?

10. State?

11. State?

12. Genius!

13. Can we have both state and error?

14. First idea: stack them!

15. 1996!

16. Which order?

17. DOES NOT WORK!

18. THIS ONE WORKS!

19. DIFFERENCE?

20. DIFFERENCE?

21. DIFFERENCE?

22. ORDER IS IMPORTANT!

23. GENERALISE

24. STACKING HAS A COST!

25.

26.

27.

28. SIMILAR EFFECTS?

29. IN PRACTICE

30. Specialized stacks

31. Specialized functions

32. WHAT IF? We need to use both Hadoop and S3?

33.

34.

35.

36.

37.

38. WHAT ELSE?

39. WHAT ELSE?

40. Type- level effects Eff monad Value- level effects Continuatio nsInterpreters Member typeclass

41. Effect

42. Type-level effects Value-level effects

43. Value-level effect Continuations

44. Option Interpreter State Interpreter Continuation1 Continuation2 Option Interpreter Continuation3 + State Interpreter

45. OPTION RELOADED

46.

47. KLEISLI

48.

49. OPTION AS EFFECT

50. EFF

51.

52.

53.

54. ERROR AS EFFECT

55.

56. NEVER RE-IMPLEMENT flatMap EVER AGAIN!

57. EFFECTS UNITE!

58. Type-level effects

59. Value-level effects

60. Value-level effects

61. Member typeclass

62.

63.

64.

65.

66.

67. LIBRARY

68.

69.

70. scalaz.Future

71.

72.

73. STACKOVERFLOW :-(

74. STACK SAFE

75.

76. TRANSFORM EFFECTS

77.

78.

79. SO, SILVER BULLET?

80. SORRY NO

81. Implicits

82.

83. Implicits Use it in prod' Renamings Check laws Missing functions Benchmarking, Scalajs...

84. CREDITS

85. LINKS Monads for functional programming Monad transformers and modular interpreters Extensible effects Reflection without remorse Freer monad, more extensible effects

86. THANKS!

87.

88. Matchers

89. Matchers

90. Matchers

91. Matchers

92. MORE TROUBLE

93. List(5, 7, 1)

94. TOO BIG?

95.

96.

97. ONE MORE ERROR LAYER!