Python Performance: Single-threaded, multi-threaded, and Gevent

•

16 likes•9,375 views

emptysquare

A smatter of performance tips for Python programs.

Technology

What I Know About
Python Performance
A. Jesse Jiryu Davis 
http://emptysqua.re 
MongoDB

Agenda

• Single-threaded
• Multi-threaded
• Gevent

Single-Threaded
Why is Python slow? 
 

• Everything’s an object 
• Lookup

Everything’s an object
def f():!
i = 2000!
i += 1!

Everything’s an object

import dis!
dis.dis(f)!

Everything’s an object
def f():!
i = 2000!
i += 1
0
3
6
9
12
13

LOAD_CONST
STORE_FAST
LOAD_FAST
LOAD_CONST
INPLACE_ADD!
STORE_FAST

1
0
0
2

(2000)!
(i)!
(i)!
(1)!

0 (i)!

Everything’s an object
def f():!
i = 2000!
i += 1

malloc!
0
3
6
9
12
13

LOAD_CONST
STORE_FAST
LOAD_FAST
LOAD_CONST
INPLACE_ADD!
STORE_FAST

1
0
0
2

(2000)!
(i)!
malloc!
(i)!
(1)!

0 (i)!

Everything’s an object
12 seconds for 100M numbers:
total = 0!
for i in longs:!
total += i!
print float(total) / len(longs)

Everything’s an object
1 second for 100M numbers:

print float(sum(longs)) / len(longs)

Everything’s an object
0.2 seconds for 100M numbers:

print numpy.mean(array)

n = 1!
!

def f():!
print n!

0 LOAD_GLOBAL
3 PRINT_ITEM!
4 PRINT_NEWLINE
hashtable lookup

0 (n)!

n = 1!
!

def f(n=n):!
print n!

0 LOAD_FAST
3 PRINT_ITEM!
4 PRINT_NEWLINE
array offset

0 (n)!

Proﬁling
import yappi!
!

yappi.start(builtins=True)!
my_function()!
yappi.stop()!
stats = yappi.get_func_stats()!
stats.save('yappi.callgrind', type='callgrind')!

Multi-threaded
When is the GIL released? 
 

• Every 100 bytecodes 
• Acquiring other locks 
• Network or ﬁle operations

Multi-threaded
Because:
Py_BEGIN_ALLOW_THREADS!
outlen = recv(s->sock_fd, cbuf, len);!
Py_END_ALLOW_THREADS!

socketmodule.c

Multi-threaded
Because:
Py_BEGIN_ALLOW_THREADS!
outlen = recv(s->sock_fd, cbuf, len);!
Py_END_ALLOW_THREADS!

release the GIL!

socketmodule.c

Multi-threaded
This makes sense:
threads = [!
threading.Thread(target=download_a_url())!
for _ in range(10)]!
!

for t in threads:!
t.start()!
!

for t in threads:!
t.join()!

Multi-threaded
This makes no sense:
threads = [!
threading.Thread(target=do_calculations())!
for _ in range(10)]!
!

for t in threads:!
t.start()!
!

for t in threads:!
t.join()!

Gevent
from gevent import monkey!
monkey.patch_all()!
!

threads = [!
threading.Thread(target=download_a_url())]!
!

for t in threads:!
t.start()!
!

for t in threads:!
t.join()!

actually a greenlet

Viewers also liked

Profiling - 실시간 대화식 프로파일러

Heungsub Lee

파이썬 스터디 15장

SeongHyun Ahn

Deep into your applications, performance & profiling

Fabien Arcellier

Smashing the bottleneck: Qt application profiling

Develer S.r.l.

Concurrency in Python

Gavin Roy

Modern Post-Exploitation Strategies - 44CON 2012

44CON

Red teaming the CCDC

scriptjunkie

The future of async i/o in Python

Saúl Ibarra Corretgé

Asynchronous I/O in Python 3

Feihong Hsu

In theory, post-exploitation after having remote access is easy. Also in theory, there is no difference between theory and practice. In practice, there is. Imagine a scenario, where you have deployed a malware on a user’s workstation, but the target information is on a secure server accessed via two-factor authentication, with screen access only (e.g. RDP, Citrix, etc.). On top of that, the server runs application white-listing, and only the inbound port to the screen server (e.g. 3389) is allowed through the hardware firewall. But you also need persistent interactive C&C communication (e.g. Netcat, Meterpreter, RAT) to this server through the user’s workstation. I developed (and will publish) two tools that help you in these situations. The first tool can drop malware to the server through the screen while the user is logged in. The second tool can help you to circumvent the hardware firewall after we can execute code on the server with admin privileges (using a signed kernel driver). My tools are generic meaning that they work against Windows server 2012 and Windows 8, and they work with RDP or other remote desktops. The number of problems you can solve with them are endless, e.g., communicating with bind-shell on webserver behind restricted DMZ. Beware, live demo and fun included!

DEFCON 22: Bypass firewalls, application white lists, secure remote desktops ...

Zoltan Balazs

Six Degrees of Domain Admin - BloodHound at DEF CON 24

Andy Robbins

At all times there have been bad guys, who tried to steal money. ATM machines containing vast amounts of money have always been attractive targets. Until recently, criminals were only using physical weaknesses. Skimmers and shimmers for stealing magstripe-tracking data, fake pin pads and cameras for stealing pin codes, and even fake ATMs were created. Time passed and ATM software started to unify. Where there is unification, there are viruses. Trojan.Skimmer.*, Ploutus and other named or unnamed trojans. And what did we see on the public scene? Vendors started discussing the skimmers problem only after they were detected in the wild. As you remember, Barnaby Jack presented "Jackpotting Automated Teller Machines" at Black Hat USA 2010. He used some vulnerabilities in ATM software. He showed that malware, was injected into the OS of the ATM via bootable flash drive or via remote management TCP port. Barnaby Jack's work was based on assumptions that most vulnerabilities were concentrated in the host machine and that we can and should reuse software made by ATM vendors. And that's quite true, but... antiviruses, locked firmware upgrades, blocked USB connectors, and encrypted hard drives can mitigate such risks. But, what about connecting not to the host machine, but to devices themselves? What countermeasures exist, when we will try to impersonate ourselves as an ATM host? Hacking ATMs with small computer like Raspberry Pi should be impossible, but it isn't. The point of our presentation is to draw attention to the problem, which has existed for quite a long time. The problem is usage of common interfaces (like RS232 or USB) and protocols of communication from host machine to such devices as card readers, pin pads and/or dispenser units.

Hack your ATM with friend's Raspberry.Py (Black Hat EU-2014)

Olga Kochetova

Conference: InsomniHack (21 March 2014) Talk speakers: Michele Orru (@antisnatchor) Krzysztof Kotowicz (@kkotowicz) Talk abstract: A bag of fresh and juicy 0days is certainly something you would love to get as a Christmas present, but it would probably be just a dream you had one of those drunken nights. Hold on! Not all is lost! There is still hope for pwning targets without 0days. We will walk you through multiple real-life examples of client-side pwnage, from tricking the victim to take the bait, to achieving persistence on the compromised system. The talk will be highly practical and will demonstrate how you can do proper client-side exploitation effectively, simply by abusing existing functionalities of browsers, extensions, legacy features, etc. We'll delve into Chrome and Firefox extensions (automating various repetitive actions that you'll likely perform in your engagements), HTML applications, abusing User Interface expectations, (Open)Office macros and more. All the attacks are supposed to work on fully patched target software, with a bit of magic trickery as the secret ingredient. You might already know some of these exploitation vectors, but you might need a way to automate your attacks and tailor them based on the victim language, browser, and whatnot. Either way, if you like offensive security, then this talk is for you.

When you don't have 0days: client-side exploitation for the masses

Michele Orru

Async programming and python

Chetan Giridhar

Introduction to Apache Accumulo

Jared Winick

[1D2]아이비컨과 공유기 해킹을 통한 인도어 IOT 삽질기

NAVER D2

빅데이터, 데이터마이닝, 공공데이터, 오픈데이터 - 그 어느때보다 데이터 분석 및 활용이 중요해진 이 시기에 웹 상의 수많은 공개된 자료를 직접 수집할 수 있는 웹 스크래핑/크롤링 기술은 데이터 수집 및 활용 능력에 큰 도움이 됩니다. 이 강의에서는 크롤링 프레임웍을 사용하지 않고 HTTP, DOM, concurrency를 담당하는 기본적인 라이브러리만을 사용해 직접 웹 스크래퍼를 처음부터(from scratch) 작성해 봄으로써, 언제든 자유도 높은 동시성 크롤러를 직접 구현할 수 있도록 작동 원리를 이해할 수 있도록 합니다. 시연에서 작성된 전체 소스코드는 아래 링크에서 보실 수 있습니다. https://gist.github.com/cornchz/0ec0c3f5ca69bac2b625

[PyConKR 2014] 30분만에 따라하는 동시성 스크래퍼

Cheol Kang

[1A1]행복한프로그래머를위한철학

NAVER D2

Selenium을 이용한 동적 사이트 크롤러 만들기

Gyuhyeon Jeon

Scalable web application architecture

postrational

Viewers also liked (20)

Profiling - 실시간 대화식 프로파일러

파이썬 스터디 15장

Deep into your applications, performance & profiling

Smashing the bottleneck: Qt application profiling

Concurrency in Python

Modern Post-Exploitation Strategies - 44CON 2012

Red teaming the CCDC

The future of async i/o in Python

Asynchronous I/O in Python 3

DEFCON 22: Bypass firewalls, application white lists, secure remote desktops ...

Six Degrees of Domain Admin - BloodHound at DEF CON 24

Hack your ATM with friend's Raspberry.Py (Black Hat EU-2014)

When you don't have 0days: client-side exploitation for the masses

Async programming and python

Introduction to Apache Accumulo

[1D2]아이비컨과 공유기 해킹을 통한 인도어 IOT 삽질기

[PyConKR 2014] 30분만에 따라하는 동시성 스크래퍼

[1A1]행복한프로그래머를위한철학

Selenium을 이용한 동적 사이트 크롤러 만들기

Scalable web application architecture

Similar to Python Performance: Single-threaded, multi-threaded, and Gevent

Presented by Stephen Murtagh, Etsy.com, Inc. TF-IDF (term frequency, inverse document frequency) is a standard method of weighting query terms for scoring documents, and is the method that is used by default in Solr/Lucene. Unfortunately, TF-IDF is really only a measure of rarity, not quality or usefulness. This means it would give more weight to a useless, rare term, such as a misspelling, than to a more useful, but more common, term. In this presentation, we will discuss our experiences replacing Lucene's TF-IDF based scoring function with a more useful one using information gain, a standard machine-learning measure that combines frequency and specificity. Information gain is much more expensive to compute, however, so this requires periodically computing the term weights outside of Solr/Lucene and making the results accessible within Solr/Lucene.

Beyond tf idf why, what & how

lucenerevolution

Persistent Data Structures - partial::Conf

Ivan Vergiliev

From render() to DOM

Boris Dinkevich

Persitance Data with sqlite

Arif Huda

Python于Web 2.0网站的应用 - QCon Beijing 2010

Qiangning Hong

System insight without Interference

Tony Tam

Long Live the Rubyist

baccigalupi

ClojureScript Introduction

Falko Riemenschneider

Creating Hybrid mobile apps with YUI

Gonzalo Cordero

Similar to Python Performance: Single-threaded, multi-threaded, and Gevent (9)

Beyond tf idf why, what & how

Persistent Data Structures - partial::Conf

From render() to DOM

Persitance Data with sqlite

Python于Web 2.0网站的应用 - QCon Beijing 2010

System insight without Interference

Long Live the Rubyist

ClojureScript Introduction

Creating Hybrid mobile apps with YUI

More from emptysquare

Cat-Herd's Crook

emptysquare

How do MongoDB drivers discover and monitor your servers? How do they determine your replica set config, and how do they resolve a crisis like the loss of a primary? And finally, what's the best way to write your application to handle errors and outages? Staff Engineer A. Jesse Jiryu Davis covers these topics for the first time at any MongoDB conference, in his talk at MongoDB World 2015 about the new Server Discovery And Monitoring spec.

MongoDB Drivers And High Availability: Deep Dive

emptysquare

Python’s asynchronous frameworks, like asyncio, Tornado, and Twisted, are increasingly important for writing high-performance web applications. Even if you’re an experienced web programmer, you may lack a rigorous understanding of how these frameworks work and when to use them. Let’s see how asyncio's event loop works, and learn how to efficiently handle very large numbers of concurrent connections.

What Is Async, How Does It Work, And When Should I Use It?

emptysquare

Python Coroutines, Present and Future

emptysquare

PyCon lightning talk on my Toro module for Tornado

emptysquare

Python, async web frameworks, and MongoDB

emptysquare

More from emptysquare (6)

Cat-Herd's Crook

MongoDB Drivers And High Availability: Deep Dive

What Is Async, How Does It Work, And When Should I Use It?

Python Coroutines, Present and Future

PyCon lightning talk on my Toro module for Tornado

Python, async web frameworks, and MongoDB

Recently uploaded

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Zilliz

Modernizing Securities Finance: The cloud-native prime brokerage platform transforming capital markets. Madhu Subbu, Managing Director, Head of Securities Finance Engineering Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

apidays

Scaling API-first – The story of a global engineering organization Ian Reasor, Senior Computer Scientist - Adobe Radu Cotescu, Senior Computer Scientist - Adobe Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

apidays

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

Juan lago vázquez

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

MINDCTI Revenue Release Quarter One 2024

MIND CTI

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

GenAI Risks & Security Meetup 01052024.pdf

lior mazor

As privacy and data protection regulations evolve rapidly, organizations operating in multiple jurisdictions face mounting challenges to ensure compliance and safeguard customer data. With state-specific privacy laws coming up in multiple states this year, it is essential to understand what their unique data protection regulations will require clearly. How will data privacy evolve in the US in 2024? How to stay compliant? Our panellists will guide you through the intricacies of these states' specific data privacy laws, clarifying complex legal frameworks and compliance requirements. This webinar will review: - The essential aspects of each state's privacy landscape and the latest updates - Common compliance challenges faced by organizations operating in multiple states and best practices to achieve regulatory adherence - Valuable insights into potential changes to existing regulations and prepare your organization for the evolving landscape

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

TrustArc

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Whatsapp Number Escorts Call girls 8617370543 Available 24x7 Navi Mumbai Call Girls Service Offer Genuine VIP Model Escorts Call Girls in Your Budget. Navi Mumbai Call Girls Service Provide Real Call Girls Number. Make Your Sexual Pleasure Memorable with Our Navi Mumbai Call Girls at Affordable Price. Top VIP Escorts Call Girls, High Profile Independent Escorts Call Girls, Housewife Women Escorts Call Girl, College Girls Escorts Call Girls, Russian Escorts Call girls Service in Your Budget.

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

Deepika Singh

A Beginners Guide to Building a RAG App Using Open Source Milvus

Zilliz

In the thrilling conclusion to 2023, ransomware groups had a banner year, really outdoing themselves in the "make everyone's life miserable" department. LockBit 3.0 took gold in the hacking olympics, followed by the plucky upstarts Clop and ALPHV/BlackCat. Apparently, 48% of organizations were feeling left out and decided to get in on the cyber attack action. Business services won the "most likely to get digitally mugged" award, with education and retail nipping at their heels. Hackers expanded their repertoire beyond boring old encryption to the much more exciting world of extortion. The US, UK and Canada took top honors in the "countries most likely to pay up" category. Bitcoins were the currency of choice for discerning hackers, because who doesn't love untraceable money?

Ransomware_Q4_2023. The report. [EN].pdf

Overkill Security

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

The value of a flexible API Management solution for Open Banking Steve Melan, Manager for IT Innovation and Architecture - State's and Saving's Bank of Luxembourg Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - The value of a flexible API Management solution for O...

apidays

Scalable LLM APIs for AI and Generative AI Application Development Ettikan Karuppiah, Director/Technologist - NVIDIA Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

apidays

Building Digital Trust in a Digital Economy Veronica Tan, Director - Cyber Security Agency of Singapore Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

apidays

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the deployment of external web forms using Jotform for Bonterra Impact Management. This solution can be customized to your organization’s needs and deployed to support the common use cases below: - Intake and consent - Assessments - Surveys - Applications - Program registration Interested in deploying web form automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Jeffrey Haguewood

Join our latest Connector Corner webinar to discover how UiPath Integration Service revolutionizes API-centric automation in a 'Quote to Cash' process—and how that automation empowers businesses to accelerate revenue generation. A comprehensive demo will explore connecting systems, GenAI, and people, through powerful pre-built connectors designed to speed process cycle times. Speakers: James Dickson, Senior Software Engineer Charlie Greenberg, Host, Product Marketing Manager

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

DianaGray10

Recently uploaded (20)

Boost Fertility New Invention Ups Success Rates.pdf

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood

How to Troubleshoot Apps for the Modern Connected Worker

MINDCTI Revenue Release Quarter One 2024

Strategies for Landing an Oracle DBA Job as a Fresher

GenAI Risks & Security Meetup 01052024.pdf

TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model

A Beginners Guide to Building a RAG App Using Open Source Milvus

Ransomware_Q4_2023. The report. [EN].pdf

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Apidays New York 2024 - The value of a flexible API Management solution for O...

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...

Connector Corner: Accelerate revenue generation using UiPath API-centric busi...

Python Performance: Single-threaded, multi-threaded, and Gevent

1. What I Know About Python Performance A. Jesse Jiryu Davis  http://emptysqua.re  MongoDB

2. Agenda • Single-threaded • Multi-threaded • Gevent

3. Single-Threaded Why is Python slow?    • Everything’s an object  • Lookup

4. Everything’s an object def f():! i = 2000! i += 1!

5. Everything’s an object import dis! dis.dis(f)!

6. Everything’s an object def f():! i = 2000! i += 1 0 3 6 9 12 13 LOAD_CONST STORE_FAST LOAD_FAST LOAD_CONST INPLACE_ADD! STORE_FAST 1 0 0 2 (2000)! (i)! (i)! (1)! 0 (i)!

7. Everything’s an object def f():! i = 2000! i += 1 malloc! 0 3 6 9 12 13 LOAD_CONST STORE_FAST LOAD_FAST LOAD_CONST INPLACE_ADD! STORE_FAST 1 0 0 2 (2000)! (i)! malloc! (i)! (1)! 0 (i)!

8. Everything’s an object 12 seconds for 100M numbers: total = 0! for i in longs:! total += i! print float(total) / len(longs)

9. Everything’s an object 1 second for 100M numbers: print float(sum(longs)) / len(longs)

10. Everything’s an object 0.2 seconds for 100M numbers: print numpy.mean(array)

11. Lookup n = 1! ! def f():! print n!

12. n = 1! ! def f():! print n! 0 LOAD_GLOBAL 3 PRINT_ITEM! 4 PRINT_NEWLINE hashtable lookup 0 (n)!

13. n = 1! ! def f(n=n):! print n! 0 LOAD_FAST 3 PRINT_ITEM! 4 PRINT_NEWLINE array offset 0 (n)!

14. Proﬁling

15. Proﬁling import yappi! ! yappi.start(builtins=True)! my_function()! yappi.stop()! stats = yappi.get_func_stats()! stats.save('yappi.callgrind', type='callgrind')!

16. KCacheGrind

17. KCacheGrind

18. Multi-threaded

19. Multi-threaded When is the GIL released?    • Every 100 bytecodes  • Acquiring other locks  • Network or ﬁle operations

20. Multi-threaded Because: Py_BEGIN_ALLOW_THREADS! outlen = recv(s->sock_fd, cbuf, len);! Py_END_ALLOW_THREADS! socketmodule.c

21. Multi-threaded Because: Py_BEGIN_ALLOW_THREADS! outlen = recv(s->sock_fd, cbuf, len);! Py_END_ALLOW_THREADS! release the GIL! socketmodule.c

22. Multi-threaded This makes sense: threads = [! threading.Thread(target=download_a_url())! for _ in range(10)]! ! for t in threads:! t.start()! ! for t in threads:! t.join()!

23. Multi-threaded This makes no sense: threads = [! threading.Thread(target=do_calculations())! for _ in range(10)]! ! for t in threads:! t.start()! ! for t in threads:! t.join()!

24. Gevent from gevent import monkey! monkey.patch_all()! ! threads = [! threading.Thread(target=download_a_url())]! ! for t in threads:! t.start()! ! for t in threads:! t.join()! actually a greenlet

25. GreenletProﬁler

26. Links http://bit.ly/pythonperformance

Python Performance: Single-threaded, multi-threaded, and Gevent

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (20)

Similar to Python Performance: Single-threaded, multi-threaded, and Gevent

Similar to Python Performance: Single-threaded, multi-threaded, and Gevent (9)

More from emptysquare

More from emptysquare (6)

Recently uploaded

Recently uploaded (20)

Python Performance: Single-threaded, multi-threaded, and Gevent