SlideShare ist ein Scribd-Unternehmen logo
1 von 29
Working with large
lists in SharePoint
2010
About Me
• Software Developer at Avaya Government
Solutions
• Executive office of immigration review (EOIR) an
agency within DOJ
• Have been developing for 10+ years
• SharePoint Development since 2007
• Married to my college sweetheart and mother of
twins boys
• Bikram Yoga rocks!!
Introduction
• When is a list/library considered large?
• >5000 items
• It is not recommended to query or run any
kind of operation that would require to scan
more than 5000 items at a time
• Database Contention
• Performance Degradation
• Service or page load timeout
• SharePoint supports list with millions of items
but must be carefully planned.
Throttling Exception
Resource throttling
• Introduced in SharePoint 2010
• To prevent operations that adversely affect farm
performance
• Configured in Central Administration >Manage
Web Applications >General Setting – Resource
Throttling
List View Threshold
• Prevent operations that will involve more
than 5000 items (query, indexing, calculated
fields etc..)
• Microsoft recommends NOT to increase this limit
List View threshold for
auditors and administrators
• Used by certain service
• Search Query Account
• Object cache super-reader and super-writer
accounts
Allow object model
override
• Privileged developers can programmatically
override list view threshold for
• A web application globally
• SPWebAppication.MaxItemsPerThrottledOperation
• An individual list
• Splist.EnableThrottling property to False
• the Query Throttling
• SpQueryThrottleOption
Daily time window
• A database operation or query started within
the daily time window continues until
completion even if it does not finish with the
specified time window
Unique permissions
• Default 50,000
• Recommended to be reduced to 5000
• Performance decreases as the number of
unique permissions increases
• The throughput difference for operations on a
list with 0 – 1000 permissions is around 20
percent
• Avoid fine-grained permissions
• Every broken permission inheritance adds
one to the unique permission count
Lookup columns and list
view
• Causes a join with another table
• Increases complexity of metadata navigation
and list view queries
• Workflow status also count
Operations Classifications
• List exceeding the list view threshold
• Add/remove/update a list Column
• Add/remove/update a list Content type
• Create/remove an index
• Container exceeding the list view threshold
• Delete/copy/rename a folder
• Queries that filter on non-indexed columns
• Set fine-grained security permissions
Techniques and Tips
• Indexed Columns
• Filtered views based on Column indexes
• Organizing items into folders
• Using the daily time windows
• Using Search
Indexing
• Up to 20 columns
• Columns Filtered or Sorted by
• Consumes extra resources in the database
• Adds overhead to every operation to maintain
the index
• Columns that cannot be indexed
• Multiple lines of text
• Choice (multi-valued)
• Calculated
• Hyperlink or Pictures
• For a complete list please visit Enforcing
Uniqueness in Column Values
How to Create an index
1. Go to the library settings for the list
2. Under the Columns section, click on indexed
columns
3. Create a new index
How to Create an index
4. In the Primary Column section, under Primary
column for this index, select your column
5. Click Create
Filtered Views
• First filter column must be index
• First filter column must not return more
items than the threshold limit
• Check recycle bin for deleted items
How to Create Filtered View
1. In the Managed Views group, click create
view
2. Click on Standard View
3. Enter your view name
How to Create Filtered View
4. In the Filter section, click on Show items only when
the following is true
5. choose your indexed columns and enter value
CAML Query
Organizing items into
Folders
• Internal index gets created
• Effectively using internal index to access data
• Can contain more items than the list view
threshold
• Show all items without folders
• Default view show all available folders
Daily time window
• Use the Daily time window for operations
like:
• Adding/deleting an index
• Adding Calculated field
• Deleting/copying folders
Using Search
• Has its own indexing mechanisms
• Not subject to List View Threshold
• Create Scope
• Keyword or phrase search
• Refinement Panel
SharePoint 2013
• This behavior has not changed in SharePoint
2013.
• http://technet.microsoft.com/en-
us/library/ff382641.aspx
References
• Query Throttling and Indexing
• http://msdn.microsoft.com/en-
us/library/ff798465.aspx
• Manage lists and Libraries with many items
• http://office2010.microsoft.com/en-us/sharepoint-
server-help/manage-lists-and-libraries-with-many-
items-HA010378155.aspx?redir=0
• Designing Large lists and maximizing list
performance (SharePoint Server 2010)
• http://technet.microsoft.com/en-
us/library/cc262813.aspx
Contact
• Email: zewdiyemane@msn.com
• Twitter: @zewdiyemane
• LinkedIn:http://www.linkedin.com/pub/zewdi
-solomon-mcp-mcts/17/324/2bb

Weitere ähnliche Inhalte

Was ist angesagt?

SharePoint: How to automatically assign managed metadata?
SharePoint: How to automatically assign managed metadata?SharePoint: How to automatically assign managed metadata?
SharePoint: How to automatically assign managed metadata?Layer2
 
Aiimi Project Management Office
Aiimi Project Management OfficeAiimi Project Management Office
Aiimi Project Management OfficeAiimiLtd
 
SharePoint Beginner Training for End Users
SharePoint Beginner Training for End UsersSharePoint Beginner Training for End Users
SharePoint Beginner Training for End UsersGregory Zelfond
 
SharePoint Tutorial and SharePoint Training - Introduction
SharePoint Tutorial and SharePoint Training - IntroductionSharePoint Tutorial and SharePoint Training - Introduction
SharePoint Tutorial and SharePoint Training - IntroductionGregory Zelfond
 
Understand the SharePoint Basics
Understand the SharePoint BasicsUnderstand the SharePoint Basics
Understand the SharePoint BasicsBenjamin Niaulin
 
Share point 2016 end user training module 1 - introduction
Share point 2016 end user training   module 1 - introductionShare point 2016 end user training   module 1 - introduction
Share point 2016 end user training module 1 - introductionDipti Chhatrapati
 
Document Management in SharePoint without folders - Introduction to Metadata
Document Management in SharePoint without folders - Introduction to MetadataDocument Management in SharePoint without folders - Introduction to Metadata
Document Management in SharePoint without folders - Introduction to MetadataGregory Zelfond
 
SharePoint Folders & Metadata
SharePoint Folders & MetadataSharePoint Folders & Metadata
SharePoint Folders & MetadataDrew Madelung
 
SharePoint Permissions Worst Practices
SharePoint Permissions Worst PracticesSharePoint Permissions Worst Practices
SharePoint Permissions Worst PracticesBobby Chang
 
Exploring the New Search in SharePoint 2013 - What can you do now?
Exploring the New Search in SharePoint 2013 - What can you do now?Exploring the New Search in SharePoint 2013 - What can you do now?
Exploring the New Search in SharePoint 2013 - What can you do now?Benjamin Niaulin
 
SharePoint Tips and Tricks you cannot live without
SharePoint Tips and Tricks you cannot live withoutSharePoint Tips and Tricks you cannot live without
SharePoint Tips and Tricks you cannot live withoutGregory Zelfond
 
SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013
SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013
SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013Jasper Oosterveld
 
Understanding SharePoint site structure what's inside
Understanding SharePoint site structure  what's insideUnderstanding SharePoint site structure  what's inside
Understanding SharePoint site structure what's insideBenjamin Niaulin
 
Designing a great SharePoint Online intranet in Office 365
Designing a great SharePoint Online intranet in Office 365Designing a great SharePoint Online intranet in Office 365
Designing a great SharePoint Online intranet in Office 365Danny Burlage
 
SharePoint Document Sets - SharePoint Saturday Denver 2013
SharePoint Document Sets - SharePoint Saturday Denver 2013SharePoint Document Sets - SharePoint Saturday Denver 2013
SharePoint Document Sets - SharePoint Saturday Denver 2013SharePointWolfe
 
Sharepoint tips and tricks
Sharepoint tips and tricksSharepoint tips and tricks
Sharepoint tips and tricksJeff Wisniewski
 
SharePoint Out of the Box
SharePoint Out of the BoxSharePoint Out of the Box
SharePoint Out of the BoxGregory Zelfond
 
5 Ways to Manage Documents in SharePoint & Office 365
5 Ways to Manage Documents in SharePoint & Office 3655 Ways to Manage Documents in SharePoint & Office 365
5 Ways to Manage Documents in SharePoint & Office 365Gregory Zelfond
 

Was ist angesagt? (20)

SharePoint: How to automatically assign managed metadata?
SharePoint: How to automatically assign managed metadata?SharePoint: How to automatically assign managed metadata?
SharePoint: How to automatically assign managed metadata?
 
Aiimi Project Management Office
Aiimi Project Management OfficeAiimi Project Management Office
Aiimi Project Management Office
 
SharePoint Beginner Training for End Users
SharePoint Beginner Training for End UsersSharePoint Beginner Training for End Users
SharePoint Beginner Training for End Users
 
SharePoint Tutorial and SharePoint Training - Introduction
SharePoint Tutorial and SharePoint Training - IntroductionSharePoint Tutorial and SharePoint Training - Introduction
SharePoint Tutorial and SharePoint Training - Introduction
 
Understand the SharePoint Basics
Understand the SharePoint BasicsUnderstand the SharePoint Basics
Understand the SharePoint Basics
 
Share point 2016 end user training module 1 - introduction
Share point 2016 end user training   module 1 - introductionShare point 2016 end user training   module 1 - introduction
Share point 2016 end user training module 1 - introduction
 
Document Management in SharePoint without folders - Introduction to Metadata
Document Management in SharePoint without folders - Introduction to MetadataDocument Management in SharePoint without folders - Introduction to Metadata
Document Management in SharePoint without folders - Introduction to Metadata
 
Introduction to SharePoint 2013 Out of the box Webparts
Introduction to SharePoint 2013 Out of the box WebpartsIntroduction to SharePoint 2013 Out of the box Webparts
Introduction to SharePoint 2013 Out of the box Webparts
 
SharePoint Folders & Metadata
SharePoint Folders & MetadataSharePoint Folders & Metadata
SharePoint Folders & Metadata
 
SharePoint Permissions Worst Practices
SharePoint Permissions Worst PracticesSharePoint Permissions Worst Practices
SharePoint Permissions Worst Practices
 
Exploring the New Search in SharePoint 2013 - What can you do now?
Exploring the New Search in SharePoint 2013 - What can you do now?Exploring the New Search in SharePoint 2013 - What can you do now?
Exploring the New Search in SharePoint 2013 - What can you do now?
 
SharePoint Tips and Tricks you cannot live without
SharePoint Tips and Tricks you cannot live withoutSharePoint Tips and Tricks you cannot live without
SharePoint Tips and Tricks you cannot live without
 
SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013
SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013
SPCA2013 - Best Practices Document Management in SharePoint (Online) 2013
 
Understanding SharePoint site structure what's inside
Understanding SharePoint site structure  what's insideUnderstanding SharePoint site structure  what's inside
Understanding SharePoint site structure what's inside
 
Webinar: Ditching File Shares For SharePoint Metadata
Webinar: Ditching File Shares For SharePoint MetadataWebinar: Ditching File Shares For SharePoint Metadata
Webinar: Ditching File Shares For SharePoint Metadata
 
Designing a great SharePoint Online intranet in Office 365
Designing a great SharePoint Online intranet in Office 365Designing a great SharePoint Online intranet in Office 365
Designing a great SharePoint Online intranet in Office 365
 
SharePoint Document Sets - SharePoint Saturday Denver 2013
SharePoint Document Sets - SharePoint Saturday Denver 2013SharePoint Document Sets - SharePoint Saturday Denver 2013
SharePoint Document Sets - SharePoint Saturday Denver 2013
 
Sharepoint tips and tricks
Sharepoint tips and tricksSharepoint tips and tricks
Sharepoint tips and tricks
 
SharePoint Out of the Box
SharePoint Out of the BoxSharePoint Out of the Box
SharePoint Out of the Box
 
5 Ways to Manage Documents in SharePoint & Office 365
5 Ways to Manage Documents in SharePoint & Office 3655 Ways to Manage Documents in SharePoint & Office 365
5 Ways to Manage Documents in SharePoint & Office 365
 

Andere mochten auch

Open Badges: A fit for purpose credit mechanism
Open Badges: A fit for purpose credit mechanismOpen Badges: A fit for purpose credit mechanism
Open Badges: A fit for purpose credit mechanismAmye Kenall
 
Seven most important metrics for video email marketing.
Seven most important metrics for video email marketing. Seven most important metrics for video email marketing.
Seven most important metrics for video email marketing. Vidoomail
 
9.2.12 The Missional Church - Matthew 16:13-27
9.2.12 The Missional Church - Matthew 16:13-279.2.12 The Missional Church - Matthew 16:13-27
9.2.12 The Missional Church - Matthew 16:13-27Cody Nazarene Church
 
Buying or Selling an Investment Advisory Firm: A Lawyer\'s Perspective
Buying or Selling an Investment Advisory Firm: A Lawyer\'s PerspectiveBuying or Selling an Investment Advisory Firm: A Lawyer\'s Perspective
Buying or Selling an Investment Advisory Firm: A Lawyer\'s Perspectivejimeccleston
 
Las nuevas tecnologías
Las nuevas tecnologíasLas nuevas tecnologías
Las nuevas tecnologíasMayra Canela
 
#GetsmART: Lessons from the Artists BLC15 Minikeynote
#GetsmART: Lessons from the Artists BLC15 Minikeynote#GetsmART: Lessons from the Artists BLC15 Minikeynote
#GetsmART: Lessons from the Artists BLC15 MinikeynoteAmy Burvall
 
How effective is the combination of my main product and ancillary
How effective is the combination of my main product and ancillaryHow effective is the combination of my main product and ancillary
How effective is the combination of my main product and ancillaryCraig Dennett
 
WeChangeMakers: Dmajor's TFT keynote
WeChangeMakers: Dmajor's TFT keynoteWeChangeMakers: Dmajor's TFT keynote
WeChangeMakers: Dmajor's TFT keynote경만 고
 
People in the Landscape
People in the LandscapePeople in the Landscape
People in the Landscapemaditabalnco
 
Better Life Insurance Risk Assessment by Leveraging Medical Innovations
Better Life Insurance Risk Assessment by Leveraging Medical InnovationsBetter Life Insurance Risk Assessment by Leveraging Medical Innovations
Better Life Insurance Risk Assessment by Leveraging Medical InnovationsCognizant
 
Who are the pharma social media butterflies?
Who are the pharma social media butterflies?Who are the pharma social media butterflies?
Who are the pharma social media butterflies?Ogilvy Health
 
Understanding the fundamentals of attacks
Understanding the fundamentals of attacksUnderstanding the fundamentals of attacks
Understanding the fundamentals of attacksCyber Security Alliance
 
大切なビジネスデータはownCloudに簡単バックアップ
大切なビジネスデータはownCloudに簡単バックアップ大切なビジネスデータはownCloudに簡単バックアップ
大切なビジネスデータはownCloudに簡単バックアップYuki Takahashi
 
Buzzword Bingo 2014
Buzzword Bingo 2014Buzzword Bingo 2014
Buzzword Bingo 2014ron mader
 
Digital Locker User Manual
Digital Locker User ManualDigital Locker User Manual
Digital Locker User ManualAmit Ranjan
 
Le Parc Rjz & Cyrela
Le Parc    Rjz & CyrelaLe Parc    Rjz & Cyrela
Le Parc Rjz & Cyrelaimoveisdorio
 
Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"
Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"
Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"SiteGround España
 
Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...
Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...
Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...Notis Mitarachi
 

Andere mochten auch (20)

Open Badges: A fit for purpose credit mechanism
Open Badges: A fit for purpose credit mechanismOpen Badges: A fit for purpose credit mechanism
Open Badges: A fit for purpose credit mechanism
 
Seven most important metrics for video email marketing.
Seven most important metrics for video email marketing. Seven most important metrics for video email marketing.
Seven most important metrics for video email marketing.
 
9.2.12 The Missional Church - Matthew 16:13-27
9.2.12 The Missional Church - Matthew 16:13-279.2.12 The Missional Church - Matthew 16:13-27
9.2.12 The Missional Church - Matthew 16:13-27
 
Buying or Selling an Investment Advisory Firm: A Lawyer\'s Perspective
Buying or Selling an Investment Advisory Firm: A Lawyer\'s PerspectiveBuying or Selling an Investment Advisory Firm: A Lawyer\'s Perspective
Buying or Selling an Investment Advisory Firm: A Lawyer\'s Perspective
 
Las nuevas tecnologías
Las nuevas tecnologíasLas nuevas tecnologías
Las nuevas tecnologías
 
Economía Popular y Solidaria
Economía Popular y SolidariaEconomía Popular y Solidaria
Economía Popular y Solidaria
 
#GetsmART: Lessons from the Artists BLC15 Minikeynote
#GetsmART: Lessons from the Artists BLC15 Minikeynote#GetsmART: Lessons from the Artists BLC15 Minikeynote
#GetsmART: Lessons from the Artists BLC15 Minikeynote
 
How effective is the combination of my main product and ancillary
How effective is the combination of my main product and ancillaryHow effective is the combination of my main product and ancillary
How effective is the combination of my main product and ancillary
 
Die....
Die....Die....
Die....
 
WeChangeMakers: Dmajor's TFT keynote
WeChangeMakers: Dmajor's TFT keynoteWeChangeMakers: Dmajor's TFT keynote
WeChangeMakers: Dmajor's TFT keynote
 
People in the Landscape
People in the LandscapePeople in the Landscape
People in the Landscape
 
Better Life Insurance Risk Assessment by Leveraging Medical Innovations
Better Life Insurance Risk Assessment by Leveraging Medical InnovationsBetter Life Insurance Risk Assessment by Leveraging Medical Innovations
Better Life Insurance Risk Assessment by Leveraging Medical Innovations
 
Who are the pharma social media butterflies?
Who are the pharma social media butterflies?Who are the pharma social media butterflies?
Who are the pharma social media butterflies?
 
Understanding the fundamentals of attacks
Understanding the fundamentals of attacksUnderstanding the fundamentals of attacks
Understanding the fundamentals of attacks
 
大切なビジネスデータはownCloudに簡単バックアップ
大切なビジネスデータはownCloudに簡単バックアップ大切なビジネスデータはownCloudに簡単バックアップ
大切なビジネスデータはownCloudに簡単バックアップ
 
Buzzword Bingo 2014
Buzzword Bingo 2014Buzzword Bingo 2014
Buzzword Bingo 2014
 
Digital Locker User Manual
Digital Locker User ManualDigital Locker User Manual
Digital Locker User Manual
 
Le Parc Rjz & Cyrela
Le Parc    Rjz & CyrelaLe Parc    Rjz & Cyrela
Le Parc Rjz & Cyrela
 
Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"
Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"
Presentación Webinar "Los 10 plugins SEO WordPress imprescindibles"
 
Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...
Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...
Απάντηση Υπουργού Δικαιοσύνης σε αναφορά για τα περιφερειακά υποθηκοφυλακεία ...
 

Ähnlich wie WSPDC June 2013: Working with Large Lists in SharePoint 2010 by Zewdi Solomon

Managing lists and libraries with more than 5000 items
Managing lists and libraries with more than 5000 itemsManaging lists and libraries with more than 5000 items
Managing lists and libraries with more than 5000 itemsPriority SharePoint
 
What's in a List?
What's in a List?What's in a List?
What's in a List?M Allmond
 
Help! I've got a share point site! Now What?
Help! I've got a share point site! Now What?Help! I've got a share point site! Now What?
Help! I've got a share point site! Now What?Becky Bertram
 
SPSDFW-Taking Content Management Beyond Content Types
SPSDFW-Taking Content Management Beyond Content TypesSPSDFW-Taking Content Management Beyond Content Types
SPSDFW-Taking Content Management Beyond Content TypesTheresa Lubelski
 
Taking document management beyond content types
Taking document management beyond content typesTaking document management beyond content types
Taking document management beyond content typesTheresa Lubelski
 
I serve the users
I serve the usersI serve the users
I serve the usersRon Delaney
 
SPCA2013 - Dude, Where’s my Search Scopes
SPCA2013 - Dude, Where’s my Search ScopesSPCA2013 - Dude, Where’s my Search Scopes
SPCA2013 - Dude, Where’s my Search ScopesNCCOMMS
 
Taking Content Management Beyond Content Types - SPS Paris
Taking Content Management Beyond Content Types - SPS ParisTaking Content Management Beyond Content Types - SPS Paris
Taking Content Management Beyond Content Types - SPS ParisTheresa Lubelski
 
What's in a List
What's in a ListWhat's in a List
What's in a ListM Allmond
 
TechFuse 2013 - Break down the walls SharePoint 2013
TechFuse 2013 - Break down the walls SharePoint 2013TechFuse 2013 - Break down the walls SharePoint 2013
TechFuse 2013 - Break down the walls SharePoint 2013Avtex
 
SharePoint 2013 Search Operations
SharePoint 2013 Search OperationsSharePoint 2013 Search Operations
SharePoint 2013 Search OperationsSPC Adriatics
 
SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014Avtex
 
Apache Solr Search Course Drupal 7 Acquia
Apache Solr Search Course Drupal 7 AcquiaApache Solr Search Course Drupal 7 Acquia
Apache Solr Search Course Drupal 7 AcquiaDropsolid
 
DTecH IT Education- Best Obiee training institute in bangalore
DTecH IT Education- Best Obiee training institute in bangaloreDTecH IT Education- Best Obiee training institute in bangalore
DTecH IT Education- Best Obiee training institute in bangaloreDTecH It Education
 
Presenting Data Effectively in XPages - ATLUG May 2013
Presenting Data Effectively in XPages - ATLUG May 2013Presenting Data Effectively in XPages - ATLUG May 2013
Presenting Data Effectively in XPages - ATLUG May 2013balassaitis
 
HTF-Taking Content Management Beyond Content Types
HTF-Taking Content Management Beyond Content TypesHTF-Taking Content Management Beyond Content Types
HTF-Taking Content Management Beyond Content TypesTheresa Lubelski
 
Top ten new ECM features in SharePoint 2013
Top ten new ECM features in SharePoint 2013Top ten new ECM features in SharePoint 2013
Top ten new ECM features in SharePoint 2013John F. Holliday
 
SPSSA SharePoint 101 Best Practices
SPSSA SharePoint 101 Best PracticesSPSSA SharePoint 101 Best Practices
SPSSA SharePoint 101 Best PracticesTheresa Lubelski
 
A day in the life of a SharePoint power user
A day in the life of a SharePoint power userA day in the life of a SharePoint power user
A day in the life of a SharePoint power userSerge Tremblay
 

Ähnlich wie WSPDC June 2013: Working with Large Lists in SharePoint 2010 by Zewdi Solomon (20)

Managing lists and libraries with more than 5000 items
Managing lists and libraries with more than 5000 itemsManaging lists and libraries with more than 5000 items
Managing lists and libraries with more than 5000 items
 
What's in a List?
What's in a List?What's in a List?
What's in a List?
 
Help! I've got a share point site! Now What?
Help! I've got a share point site! Now What?Help! I've got a share point site! Now What?
Help! I've got a share point site! Now What?
 
SPSDFW-Taking Content Management Beyond Content Types
SPSDFW-Taking Content Management Beyond Content TypesSPSDFW-Taking Content Management Beyond Content Types
SPSDFW-Taking Content Management Beyond Content Types
 
Taking document management beyond content types
Taking document management beyond content typesTaking document management beyond content types
Taking document management beyond content types
 
I serve the users
I serve the usersI serve the users
I serve the users
 
SPCA2013 - Dude, Where’s my Search Scopes
SPCA2013 - Dude, Where’s my Search ScopesSPCA2013 - Dude, Where’s my Search Scopes
SPCA2013 - Dude, Where’s my Search Scopes
 
Taking Content Management Beyond Content Types - SPS Paris
Taking Content Management Beyond Content Types - SPS ParisTaking Content Management Beyond Content Types - SPS Paris
Taking Content Management Beyond Content Types - SPS Paris
 
What's in a List
What's in a ListWhat's in a List
What's in a List
 
TechFuse 2013 - Break down the walls SharePoint 2013
TechFuse 2013 - Break down the walls SharePoint 2013TechFuse 2013 - Break down the walls SharePoint 2013
TechFuse 2013 - Break down the walls SharePoint 2013
 
SharePoint 2013 Search Operations
SharePoint 2013 Search OperationsSharePoint 2013 Search Operations
SharePoint 2013 Search Operations
 
SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014SharePoint Search - SPSNYC 2014
SharePoint Search - SPSNYC 2014
 
Apache Solr Search Course Drupal 7 Acquia
Apache Solr Search Course Drupal 7 AcquiaApache Solr Search Course Drupal 7 Acquia
Apache Solr Search Course Drupal 7 Acquia
 
DTecH IT Education- Best Obiee training institute in bangalore
DTecH IT Education- Best Obiee training institute in bangaloreDTecH IT Education- Best Obiee training institute in bangalore
DTecH IT Education- Best Obiee training institute in bangalore
 
Presenting Data Effectively in XPages - ATLUG May 2013
Presenting Data Effectively in XPages - ATLUG May 2013Presenting Data Effectively in XPages - ATLUG May 2013
Presenting Data Effectively in XPages - ATLUG May 2013
 
Obiee
ObieeObiee
Obiee
 
HTF-Taking Content Management Beyond Content Types
HTF-Taking Content Management Beyond Content TypesHTF-Taking Content Management Beyond Content Types
HTF-Taking Content Management Beyond Content Types
 
Top ten new ECM features in SharePoint 2013
Top ten new ECM features in SharePoint 2013Top ten new ECM features in SharePoint 2013
Top ten new ECM features in SharePoint 2013
 
SPSSA SharePoint 101 Best Practices
SPSSA SharePoint 101 Best PracticesSPSSA SharePoint 101 Best Practices
SPSSA SharePoint 101 Best Practices
 
A day in the life of a SharePoint power user
A day in the life of a SharePoint power userA day in the life of a SharePoint power user
A day in the life of a SharePoint power user
 

Kürzlich hochgeladen

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 

Kürzlich hochgeladen (20)

Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptxDigital Identity is Under Attack: FIDO Paris Seminar.pptx
Digital Identity is Under Attack: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxPasskey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 

WSPDC June 2013: Working with Large Lists in SharePoint 2010 by Zewdi Solomon

  • 1. Working with large lists in SharePoint 2010
  • 2. About Me • Software Developer at Avaya Government Solutions • Executive office of immigration review (EOIR) an agency within DOJ • Have been developing for 10+ years • SharePoint Development since 2007 • Married to my college sweetheart and mother of twins boys • Bikram Yoga rocks!!
  • 3. Introduction • When is a list/library considered large? • >5000 items • It is not recommended to query or run any kind of operation that would require to scan more than 5000 items at a time • Database Contention • Performance Degradation • Service or page load timeout • SharePoint supports list with millions of items but must be carefully planned.
  • 5. Resource throttling • Introduced in SharePoint 2010 • To prevent operations that adversely affect farm performance • Configured in Central Administration >Manage Web Applications >General Setting – Resource Throttling
  • 6.
  • 7.
  • 8. List View Threshold • Prevent operations that will involve more than 5000 items (query, indexing, calculated fields etc..) • Microsoft recommends NOT to increase this limit
  • 9. List View threshold for auditors and administrators • Used by certain service • Search Query Account • Object cache super-reader and super-writer accounts
  • 10. Allow object model override • Privileged developers can programmatically override list view threshold for • A web application globally • SPWebAppication.MaxItemsPerThrottledOperation • An individual list • Splist.EnableThrottling property to False • the Query Throttling • SpQueryThrottleOption
  • 11. Daily time window • A database operation or query started within the daily time window continues until completion even if it does not finish with the specified time window
  • 12. Unique permissions • Default 50,000 • Recommended to be reduced to 5000 • Performance decreases as the number of unique permissions increases • The throughput difference for operations on a list with 0 – 1000 permissions is around 20 percent • Avoid fine-grained permissions • Every broken permission inheritance adds one to the unique permission count
  • 13. Lookup columns and list view • Causes a join with another table • Increases complexity of metadata navigation and list view queries • Workflow status also count
  • 14. Operations Classifications • List exceeding the list view threshold • Add/remove/update a list Column • Add/remove/update a list Content type • Create/remove an index • Container exceeding the list view threshold • Delete/copy/rename a folder • Queries that filter on non-indexed columns • Set fine-grained security permissions
  • 15.
  • 16. Techniques and Tips • Indexed Columns • Filtered views based on Column indexes • Organizing items into folders • Using the daily time windows • Using Search
  • 17. Indexing • Up to 20 columns • Columns Filtered or Sorted by • Consumes extra resources in the database • Adds overhead to every operation to maintain the index • Columns that cannot be indexed • Multiple lines of text • Choice (multi-valued) • Calculated • Hyperlink or Pictures • For a complete list please visit Enforcing Uniqueness in Column Values
  • 18. How to Create an index 1. Go to the library settings for the list 2. Under the Columns section, click on indexed columns 3. Create a new index
  • 19. How to Create an index 4. In the Primary Column section, under Primary column for this index, select your column 5. Click Create
  • 20. Filtered Views • First filter column must be index • First filter column must not return more items than the threshold limit • Check recycle bin for deleted items
  • 21. How to Create Filtered View 1. In the Managed Views group, click create view 2. Click on Standard View 3. Enter your view name
  • 22. How to Create Filtered View 4. In the Filter section, click on Show items only when the following is true 5. choose your indexed columns and enter value
  • 24. Organizing items into Folders • Internal index gets created • Effectively using internal index to access data • Can contain more items than the list view threshold • Show all items without folders • Default view show all available folders
  • 25. Daily time window • Use the Daily time window for operations like: • Adding/deleting an index • Adding Calculated field • Deleting/copying folders
  • 26. Using Search • Has its own indexing mechanisms • Not subject to List View Threshold • Create Scope • Keyword or phrase search • Refinement Panel
  • 27. SharePoint 2013 • This behavior has not changed in SharePoint 2013. • http://technet.microsoft.com/en- us/library/ff382641.aspx
  • 28. References • Query Throttling and Indexing • http://msdn.microsoft.com/en- us/library/ff798465.aspx • Manage lists and Libraries with many items • http://office2010.microsoft.com/en-us/sharepoint- server-help/manage-lists-and-libraries-with-many- items-HA010378155.aspx?redir=0 • Designing Large lists and maximizing list performance (SharePoint Server 2010) • http://technet.microsoft.com/en- us/library/cc262813.aspx
  • 29. Contact • Email: zewdiyemane@msn.com • Twitter: @zewdiyemane • LinkedIn:http://www.linkedin.com/pub/zewdi -solomon-mcp-mcts/17/324/2bb

Hinweis der Redaktion

  1. These default has been tested and carefully chosen.The computer administrator of the front-end computer and the central administrator site owner accessing a list or library with many items are not subject to these limits. Specially during testing it might look that it is working fine
  2. You can temporarily change the EnableThrottling on an individual list
  3. You should only change this as a temporary solution or last resortQuery throttle Option:Default: Enumeration value of Default is 0. If the user is a local administrator on the server no throttling limits will apply to the query. Otherwise throttling limits on the number of items and the number of Lookup, Person/Group, and Workflow Status fields will apply to the query.Override:Enumeration value of Override is 1. If the user is a local administrator on the server no throttling limits will apply to the query. If the web application security policy grants the user Full Read or Full Control permissions the throttling limit for Auditors and Administrators will apply to the number of items involved in the query and no throttling will apply to the number of Lookup, Person/Group, and Workflow Status fields. Otherwise the [Microsoft.SharePoint.SPQueryThrottleOption.SPQueryThrottleOption.Default] setting will apply to the query. Strict:Enumeration value is 2. Throttling for both the number of items and for number of Lookup, Person/Group, and Workflow Status fields will apply to the query regardless of user permissions.