Submit Search
Upload
Page Fault Support for Network Controllers
•
0 likes
•
75 views
TakuyaFukuoka2
Follow
Reading Circle
Read less
Read more
Software
Report
Share
Report
Share
1 of 33
Download now
Download to read offline
Recommended
LITE Kernel RDMA Support for Datacenter Applications
LITE Kernel RDMA Support for Datacenter Applications
TakuyaFukuoka2
A Survey on Performance Analytical Tools for Partitioned Global Address Space
A Survey on Performance Analytical Tools for Partitioned Global Address Space
TakuyaFukuoka2
Loom: flexible and efficient NIC packet scheduling
Loom: flexible and efficient NIC packet scheduling
TakuyaFukuoka2
Microkernels in the Era of Data-Centric Computing
Microkernels in the Era of Data-Centric Computing
Martin Děcký
Hardware/Software Co-Design for Efficient Microkernel Execution
Hardware/Software Co-Design for Efficient Microkernel Execution
Martin Děcký
Formal Verification of Functional Code
Formal Verification of Functional Code
Martin Děcký
Software Preservation: challenges and opportunities for reproductibility (Sci...
Software Preservation: challenges and opportunities for reproductibility (Sci...
Roberto Di Cosmo
IPC in Microkernel Systems, Capabilities
IPC in Microkernel Systems, Capabilities
Martin Děcký
Recommended
LITE Kernel RDMA Support for Datacenter Applications
LITE Kernel RDMA Support for Datacenter Applications
TakuyaFukuoka2
A Survey on Performance Analytical Tools for Partitioned Global Address Space
A Survey on Performance Analytical Tools for Partitioned Global Address Space
TakuyaFukuoka2
Loom: flexible and efficient NIC packet scheduling
Loom: flexible and efficient NIC packet scheduling
TakuyaFukuoka2
Microkernels in the Era of Data-Centric Computing
Microkernels in the Era of Data-Centric Computing
Martin Děcký
Hardware/Software Co-Design for Efficient Microkernel Execution
Hardware/Software Co-Design for Efficient Microkernel Execution
Martin Děcký
Formal Verification of Functional Code
Formal Verification of Functional Code
Martin Děcký
Software Preservation: challenges and opportunities for reproductibility (Sci...
Software Preservation: challenges and opportunities for reproductibility (Sci...
Roberto Di Cosmo
IPC in Microkernel Systems, Capabilities
IPC in Microkernel Systems, Capabilities
Martin Děcký
Artificial intelligence in IoT-to-core network operations and management
Artificial intelligence in IoT-to-core network operations and management
ADVA
ARIN 34 IPv6 IAB/IETF Activities Report
ARIN 34 IPv6 IAB/IETF Activities Report
ARIN
The Impact on Security due to the Vulnerabilities Existing in the network a S...
The Impact on Security due to the Vulnerabilities Existing in the network a S...
IJAEMSJORNAL
Asad Javaid Network Administrator CV
Asad Javaid Network Administrator CV
Muhammad Asad Javaid
The Evolution of IP Storage and Its Impact on the Network
The Evolution of IP Storage and Its Impact on the Network
EMC
Software Defined Networking
Software Defined Networking
Sonam Dargay
Asigra Product Marketing Strategy
Asigra Product Marketing Strategy
Jas Mann
NFV Tutorial
NFV Tutorial
Rashid Mijumbi
NFV Tutorial
NFV Tutorial
Rashid Mijumbi
Evolving Virtual Networking with IO Visor [OpenStack Summit Austin | April 2016]
Evolving Virtual Networking with IO Visor [OpenStack Summit Austin | April 2016]
IO Visor Project
Evolving Virtual Networking with IO Visor
Evolving Virtual Networking with IO Visor
Larry Lang
IT Vulnerability & Tools Watch 2011
IT Vulnerability & Tools Watch 2011
WASecurity
NFV evolution towards 5G
NFV evolution towards 5G
Marie-Paule Odini
Global IoT Cloud Services Survey-Aug-20160527
Global IoT Cloud Services Survey-Aug-20160527
August Lin
Metaverse - The 'Killer App' for 5G, 6G and Beyond
Metaverse - The 'Killer App' for 5G, 6G and Beyond
Anand Bhojan
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
Förderverein Technische Fakultät
14A81A05B1
14A81A05B1
Chaitanya Ram
IRJET- Survey on SDN based Network Intrusion Detection System using Machi...
IRJET- Survey on SDN based Network Intrusion Detection System using Machi...
IRJET Journal
Understanding NFV and the MANO stack
Understanding NFV and the MANO stack
Affan Syed
Akraino and Edge Computing
Akraino and Edge Computing
Liz Warner
業務で ISUCON することになった話.pdf
業務で ISUCON することになった話.pdf
TakuyaFukuoka2
Using RDMA Efficiently for Key-Value Services
Using RDMA Efficiently for Key-Value Services
TakuyaFukuoka2
More Related Content
Similar to Page Fault Support for Network Controllers
Artificial intelligence in IoT-to-core network operations and management
Artificial intelligence in IoT-to-core network operations and management
ADVA
ARIN 34 IPv6 IAB/IETF Activities Report
ARIN 34 IPv6 IAB/IETF Activities Report
ARIN
The Impact on Security due to the Vulnerabilities Existing in the network a S...
The Impact on Security due to the Vulnerabilities Existing in the network a S...
IJAEMSJORNAL
Asad Javaid Network Administrator CV
Asad Javaid Network Administrator CV
Muhammad Asad Javaid
The Evolution of IP Storage and Its Impact on the Network
The Evolution of IP Storage and Its Impact on the Network
EMC
Software Defined Networking
Software Defined Networking
Sonam Dargay
Asigra Product Marketing Strategy
Asigra Product Marketing Strategy
Jas Mann
NFV Tutorial
NFV Tutorial
Rashid Mijumbi
NFV Tutorial
NFV Tutorial
Rashid Mijumbi
Evolving Virtual Networking with IO Visor [OpenStack Summit Austin | April 2016]
Evolving Virtual Networking with IO Visor [OpenStack Summit Austin | April 2016]
IO Visor Project
Evolving Virtual Networking with IO Visor
Evolving Virtual Networking with IO Visor
Larry Lang
IT Vulnerability & Tools Watch 2011
IT Vulnerability & Tools Watch 2011
WASecurity
NFV evolution towards 5G
NFV evolution towards 5G
Marie-Paule Odini
Global IoT Cloud Services Survey-Aug-20160527
Global IoT Cloud Services Survey-Aug-20160527
August Lin
Metaverse - The 'Killer App' for 5G, 6G and Beyond
Metaverse - The 'Killer App' for 5G, 6G and Beyond
Anand Bhojan
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
Förderverein Technische Fakultät
14A81A05B1
14A81A05B1
Chaitanya Ram
IRJET- Survey on SDN based Network Intrusion Detection System using Machi...
IRJET- Survey on SDN based Network Intrusion Detection System using Machi...
IRJET Journal
Understanding NFV and the MANO stack
Understanding NFV and the MANO stack
Affan Syed
Akraino and Edge Computing
Akraino and Edge Computing
Liz Warner
Similar to Page Fault Support for Network Controllers
(20)
Artificial intelligence in IoT-to-core network operations and management
Artificial intelligence in IoT-to-core network operations and management
ARIN 34 IPv6 IAB/IETF Activities Report
ARIN 34 IPv6 IAB/IETF Activities Report
The Impact on Security due to the Vulnerabilities Existing in the network a S...
The Impact on Security due to the Vulnerabilities Existing in the network a S...
Asad Javaid Network Administrator CV
Asad Javaid Network Administrator CV
The Evolution of IP Storage and Its Impact on the Network
The Evolution of IP Storage and Its Impact on the Network
Software Defined Networking
Software Defined Networking
Asigra Product Marketing Strategy
Asigra Product Marketing Strategy
NFV Tutorial
NFV Tutorial
NFV Tutorial
NFV Tutorial
Evolving Virtual Networking with IO Visor [OpenStack Summit Austin | April 2016]
Evolving Virtual Networking with IO Visor [OpenStack Summit Austin | April 2016]
Evolving Virtual Networking with IO Visor
Evolving Virtual Networking with IO Visor
IT Vulnerability & Tools Watch 2011
IT Vulnerability & Tools Watch 2011
NFV evolution towards 5G
NFV evolution towards 5G
Global IoT Cloud Services Survey-Aug-20160527
Global IoT Cloud Services Survey-Aug-20160527
Metaverse - The 'Killer App' for 5G, 6G and Beyond
Metaverse - The 'Killer App' for 5G, 6G and Beyond
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
The Role of Machine Learning in Fluid Network Control and Data Planes.pdf
14A81A05B1
14A81A05B1
IRJET- Survey on SDN based Network Intrusion Detection System using Machi...
IRJET- Survey on SDN based Network Intrusion Detection System using Machi...
Understanding NFV and the MANO stack
Understanding NFV and the MANO stack
Akraino and Edge Computing
Akraino and Edge Computing
More from TakuyaFukuoka2
業務で ISUCON することになった話.pdf
業務で ISUCON することになった話.pdf
TakuyaFukuoka2
Using RDMA Efficiently for Key-Value Services
Using RDMA Efficiently for Key-Value Services
TakuyaFukuoka2
Hyperbolic Caching: Flexible Caching for Web Applications
Hyperbolic Caching: Flexible Caching for Web Applications
TakuyaFukuoka2
Latency-Tolerant Software Distributed Shared Memory
Latency-Tolerant Software Distributed Shared Memory
TakuyaFukuoka2
Tardis: Time Traveling Coherence Algorithm for Distributed Shared Memory
Tardis: Time Traveling Coherence Algorithm for Distributed Shared Memory
TakuyaFukuoka2
Hybrid MPI: Efficient Message Passing for Multi-core Systems
Hybrid MPI: Efficient Message Passing for Multi-core Systems
TakuyaFukuoka2
Overlapping Communication and Computation by Using a Hybrid MPI/SMPSs Approach
Overlapping Communication and Computation by Using a Hybrid MPI/SMPSs Approach
TakuyaFukuoka2
More from TakuyaFukuoka2
(7)
業務で ISUCON することになった話.pdf
業務で ISUCON することになった話.pdf
Using RDMA Efficiently for Key-Value Services
Using RDMA Efficiently for Key-Value Services
Hyperbolic Caching: Flexible Caching for Web Applications
Hyperbolic Caching: Flexible Caching for Web Applications
Latency-Tolerant Software Distributed Shared Memory
Latency-Tolerant Software Distributed Shared Memory
Tardis: Time Traveling Coherence Algorithm for Distributed Shared Memory
Tardis: Time Traveling Coherence Algorithm for Distributed Shared Memory
Hybrid MPI: Efficient Message Passing for Multi-core Systems
Hybrid MPI: Efficient Message Passing for Multi-core Systems
Overlapping Communication and Computation by Using a Hybrid MPI/SMPSs Approach
Overlapping Communication and Computation by Using a Hybrid MPI/SMPSs Approach
Recently uploaded
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the past
Papp Krisztián
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
masabamasaba
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
masabamasaba
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
masabamasaba
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Steffen Staab
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
masabamasaba
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
masabamasaba
Artyushina_Guest lecture_YorkU CS May 2024.pptx
Artyushina_Guest lecture_YorkU CS May 2024.pptx
AnnaArtyushina1
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
Jim McKeeth
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare
masabamasaba
The title is not connected to what is inside
The title is not connected to what is inside
shinachiaurasa2
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
chiefasafspells
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Bert Jan Schrijver
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
masabamasaba
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
masabamasaba
Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid
Philip Schwarz
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
masabamasaba
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
masabamasaba
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg
Recently uploaded
(20)
Architecture decision records - How not to get lost in the past
Architecture decision records - How not to get lost in the past
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
%+27788225528 love spells in new york Psychic Readings, Attraction spells,Bri...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
%in Benoni+277-882-255-28 abortion pills for sale in Benoni
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
Artyushina_Guest lecture_YorkU CS May 2024.pptx
Artyushina_Guest lecture_YorkU CS May 2024.pptx
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
%in Harare+277-882-255-28 abortion pills for sale in Harare
%in Harare+277-882-255-28 abortion pills for sale in Harare
The title is not connected to what is inside
The title is not connected to what is inside
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
Devoxx UK 2024 - Going serverless with Quarkus, GraalVM native images and AWS...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid
Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
%in tembisa+277-882-255-28 abortion pills for sale in tembisa
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
Abortion Pills In Pretoria ](+27832195400*)[ 🏥 Women's Abortion Clinic In Pre...
Page Fault Support for Network Controllers
1.
PageFaultSupportforNetwork Controllers ReadingCircle M2TakuyaFukuoka May27,2020 1
2.
AboutThisPaper Author:IlyaLesokhin,HaggaiEran,ShacharRaindel,GuyShapiro, SagiGrimberg,LiranLiss,MuliBen‑Yehuda,NadavAmitandDan Tsafrir ThecollaborationofTechnisonIsraelInstituteofTechnology, MellanoxTechnologiesandVMwareResearch PublishedinASPLOS'17 Proposedesignandimplementationofnetworkpagefault(NPF) supportforInfiniBandandEthernetNICs NPFsupportofInfiniBandisalreadyavailableforusason‑demand paging(ODP)[1] [1]https://community.mellanox.com/s/article/understanding‑on‑demand‑paging‑‑odp‑x 2
3.
BriefSummary DirectI/Odoesnotmakeuseoftwobenefitsofvirtualmemory Simplifiedprogrammingmodel Canonicalmemoryoptimization Networkpagefaults(NPFs)supportcansolvetheproblem HowtohandlereceiveNPFs(rNPFs)isachallengingtask ThispaperproposesdesignandimplementationofNPFssupport forInfiniBandandEthernetNICwithrNPFshandling Theevaluationshowsproposedmethodsachievememory efficienceandgoodperformance 3
4.
ThreeBenefitsofVertualMemory 4
5.
TheRiseofDirectNetworkI/O OS‑providedabstractionandisolationmightdegradeperformance CustomizedIOchannelssoftwarecanbe4‑20xmore performantthanawell‑tunedPOSIX‑compliantprocess Overheadscanbeavoidedifhardwaresupportabstractionand isolationdirectly 5
6.
ExamplesofDirectNetworkI/O RemoteDMA(RDMA) Single‑RootI/OVirautalization(SRIOV) DataPlaneDevlopmentKit(DPDK) https://ru.mellanox.com/products/adapter‑ethernet‑SW/RDMA‑RoCE‑Ethernet‑Network‑Efficiency https://access.redhat.com/documentation/ja‑ jp/red_hat_enterprise_linux/6/html/virtualization_host_configuration_and_guest_installation_guide/chap‑ virtualization_host_configuration_and_guest_installation_guide‑sr_iov http://www.mashfords.com/2018/08/21/dpdk‑data‑plane‑development‑kit‑for‑linux‑vms‑now‑generally‑available/ 6
7.
TheProblemofDirectNetworkNIC NICscannotcopewithpagefaultswhichDMAdevicesexperience Thereforelosingtwovirtualmemorybenefits 7
8.
HowtoMakeUseofVirtualMemory BenefitswithDMA Twoexistingmethods Staticallypinningtheentireaddressspacetophysicalmemory Dynamicallypin/unpinningDMAtargetbuffers Simplifiedprogramming model CanonicalMemory Optimization Static Yes No Dynamic
No Yes NPF (Proposed) Yes Yes 8
9.
ExistingDMAPageFaultsSupport Recently,PCIestandardprovidessimilarfunctionalityofNPFs ButtheproblemofreceiveNPFs(rNPFs)causedbyincoming externaldataisoutsidethescope ThispaperproposesimplementationwithsupportofrNPFs 9
10.
Implementation ▶InfiniBandPageFaultSupport Basicidea:relyonRCprotocolofInfiniBand EthernetPageFaultSupport Basicidea:preparebackupring 10
11.
InfiniBandImplementationofNPFs ImplementtheNPFsbymodifyingthedriverandfirmwareof InfiniBand NPFflowisbasicallyasfollows 1.NICconsultstheIOMMUpagetablesandcheckifNPFisneeded 2.Thefarmware[1]detectsthisfaultandraisesanNPFinterrupt 3.Thedrives'sNPFinterrputhandlerqueriestheOS 4.ThedriverupdatestheIOMMUpagetableandinformsthe farmware [1]farmwareissoftwareinNIC 11
12.
OverheadofNPFsinInfiniBand MellanoxConnect‑IB56Gb/sInfiniBandNIC Send4KBand4MBmessageswithnodiskaccess Theoverheadisdominatedbymodifiedhardware(firmware) 12
13.
HowtoHandlerNPFsinInfiniBand Makeuseofreliableconnection(RC)protocolofInfiniBandwhich assuresthemessagedelivery RNRNACKandretransmission Whenthereceiverisnotready,itsendareceiver‑not‑ready(RNR) negativeacknowledgmentpacket(NACK)toaskthesendertowait foraspecifiedtime Retransmitpacketsincaseofpacket‑drops 13
14.
Implementation InfiniBandPageFaultSupport Basicidea:relyonRCprotocolofInfiniBand ▶EthernetPageFaultSupport Basicidea:preparebackupring 14
15.
EthernetImplementationofNPFs TCPalsoassuresthepacketdelivery.DoesithandlerNPFsinthe samewayasInfiniBand? TheanswerisNo Thatisbecausepacketdropsareconsideredtoasignof congestionandcauseTCPtoreducethetransmissionrate Thecommunicationmayeventuallyhalt 15
16.
HowmuchSufferfromThisProblem Comparethethroughputofmemcached(key‑valuestore) Dropping(whichrelyonTCPretransmission)suffersforabout60 secondsduringwhichitsthroughputisalmostzero 16
17.
Solution:PrepareBackupRing Ifapagefaultisencountered,thepacketiswrittentoasmall, pinnedbackupringownedbytheIOprovider(OSorhypervisor) 17
18.
Evaluation MemoryUtilization Key‑valuestore Storagesystem OverheadofPinningandCopying MPImicrobenchmark HPCworkloadapplication ProgrammingComplexity What‑IfAnalysis MorefrequentrNPFs 18
19.
ExperimentalEnvironment Ethernet TwoDellPowerEdgeR210IIRackServers 8GB1333MHzmemory One4‑coreIntelXeonE3‑1220CPUat3.10GHzrunningUbuntu13.10witha Linux3.11.4 NPF‑supporting12GbpsprototypeNIC InfiniBand EightHPProLiantDL380pGen8servers 128GBmemory One12‑coredualsocketXeonE5‑2697v2CPUat2.7GHzrunningRedHat7.0 withLinux3.10 NPF‑supporting56GbpsConnect‑IBNICs 19
20.
MemoryUtilizationofKVS Key‑valuestorewithEthernet OnememcachedinstanceinoneVM Memslapbenchmark(90%get,10%set,1KBvaluesbydefault) Itispossibletorun4VMswithNPFswhileupto2VMswith pinning 20
21.
MemoryUtilizationofKVS WithNPFs,youcanrunfourVMsinproductivemanner 21
22.
MemoryUtilizationofKVSwithDynamic Reallocation Changethesizeofworkingsetafter50seconds InoneVM,100MBto900MBwhileinotherVM,900MBto 100MB 22
23.
MemoryutilizationofKVSwithDynamic Reallocation Withpinning,oneofthetwoinstancesalwayssuffer Staticallyallocatedmemory(500MB)istoosmalltoholdits workingset(900MB) OverallperformanceofNPFsisbetterthanpinning 23
24.
MemoryUtilizationofStorageSystem AMachineemploystgt,aniSCSItargetimplementationthat supportsiSCSIextensionsforRDMA(iSER) Evaluatebandwidthbymeasuringtherandom512KBread bandwidthusingfiobenchmark Comparetwosettings:pinningandNPFs 24
25.
MemoryUtilizationofStorageSystem Inthepinnedconfiguration,thestaticmemoryallocationleavesa smalleramountofmemorytothepagecache,whichcausesmore cachemisses WhatIthinkaboutisthatthebandwidthdiffersdependingonwhen themeasurementisconducted 25
26.
OverheadofPinningandCopying(1) MicrobenchmarksinIntelMPIbenchmarkssuits ComparebetweenthreeconfigurationsasMPIcommunication backend copying,pinning(astate‑of‑the‑artheuristicpin‑downcache) andNPFs 26
27.
OverheadofPinningandCopying(2) BeffbenchmarkwhichmodelsrealHPCworkloads NPFprovidessamebenefitaspinningwithouttheneedtopin downmemory 27
28.
ProgrammingComplexity PortingthetgtstoragedemonwithNPFrequireonly40LOC(lines ofcodes) IntheMPImiddlewarelibrary,NPFenableseliminationof thousandsofLOC 28
29.
What‑ifAnalysis SyntheticsituationwithmorefrequentrNPFs MeasurebandwidthofsendoperationswithrNPFsatavariable specifiedfrequency BackupringsignificantlyimprovesperformancewithEthernet IthinktheabsolutevalueoffrequencyshowsrNPFsdegrades performancegreatly 29
30.
Conclusion ThispaperproposedNPFssupportforInfiniBandandEthernetNIC InordertocopewithrNPFs InfiniBandsupportreliesonRCprotocolwithRNRNACKand retransmission Ethernetsupportreliesonbackupring TheevaluationsshowthattheirNPFssupport Improvestheutilizationofmemory Increasesoverallperformance Simplifiestheprogrammodel 30
31.
MyThoughts Thispaperisagoodexampleofwell‑writtenpapersinsystemsoftware Clearlyexplainsmotivationandrequirementwithmanycitations fromawideperspective Describebothoverallpicturesandthetechnicaldetailsseparetely intheimplementationpart Thegoodpointisthatitexplainsnotonlytheimplementation itselfbutalsowhyoneway(orsimplesolution)doesnotwork Plentifulevaluationassumingmanydifferentsituations 31
32.
FromthePerspectiveofmyResearch Provideproofthatproposedmethodworksinordinaryconditions butnotinextremeconditions TheymainlyevaluatesituationswithrarerNPFssuchasget‑ intensiveKVSandstorage Atleast,what‑ifanalysisreportsfrequentrNPFcandegrade performancegreatly ProvidenoevaluationoflatencyofrNPFs IwanttoseetheoverheadofrNPFsincludingretransmission Iwanttoknowmoreimformationaboutwhatmethodswereused withtheevalutionofRDMA Isuspectmostaresendoperations Howaboutone‑sidedoperationssuchasRDMA READ/WRITE? 32
33.
ThingsmentionedaboutRDMAOperation ButinsomecasesRCdoesnotpermitRNRNACKsforRDMA. Whenaninitiatorofaremotereadrequestencountersapagefault, RCprovidesnowayforittoasktherespondertostop.Theonly waytogetthesendertoretransmitisbyaskingittorewind,after therNPFisresolved.Untilthen,wemustdropallincoming packets. Iamnotsurewhat"insomecases"specificallymeans OnethingIgotfromthesesentencesisthattheimplementationof NPFsforRDMAoperationsismoredifficult ItisnowonderthattheusageofRDMAoperationsinOn‑demand Pagingcausesunexpectedoverhead 33
Download now