SlideShare ist ein Scribd-Unternehmen logo
1 von 21
Downloaden Sie, um offline zu lesen
Semi-automated penguin counting
 from digital aerial photographs

 S.J McNeill   K Barton     P Lyver       D Pairman


          Landcare Research New Zealand
Motivation
        Understanding changes in penguin population is important,
        as these can be used as indicators of anthropogenic and
        foodweb eects

        Aerial photography is used in the Ross Sea (Antarctica) to
        capture a reliable count of Adélie nesting penguins

        From 1981, the Ross Sea area (158 175
                                                  o    o E) has been

        surveyed annually

        There are many diculties in achieving this census count:
               Timing is critical,
               Ground counting is dicult or impossible,
               Counting using prints is dicult to control and validate.




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Objectives
        Determine if it is possible
        to reliably detect Adélie
        breeding penguins in
        images

        Generate software to
        (semi-)automate the
        census process.

        Test, using an expert,
        and optimise interactivity.




                                                                       Pygoscelis adeliae)
                                                  Adult Adélie penguin (




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Adélie penguins
        The most abundant and widespread Antarctic penguin

        10 million Adélie make up 80% of the Southern Ocean bird
        biomass

        38% of all Adélie penguins are found in the Ross Sea




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Image capture
        Images captured using a hand-held camera through the open
        doors of a helicopter and/or C-130 Hercules

        Hasselblad H1D with a Phase One digital camera back
               Image size 5440      × 4080,       3-bands natural colour, TIFF
               EXIF data provides date/time and aperture information
               Typical ground resolution better than 0.5 m

        Ten representative images were selected for analysis




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Full-scene example
 5440   × 4080    full-scene




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Sub-scene example
 870   × 510   sub-scene




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Analysis
        Human detection of breeding Adélie not straightforward
        There are many similar-looking objects in the images
        Proposed revised approach:
               Detect the distinctive area of the colony
               Only count penguins within colony area
               Provide software features to easily add/delete penguins




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Colony/background discrimination




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Colony  penguin detection
        Background is largely monochromatic

        Colony area covered in guano and has a red excess over
        green or blue, with higher saturation

        Use linear discriminant analysis to separate colony from
        background, based on:
               Natural colour counts (RGB) converted to hue, saturation,
               lightness (HSL) space values,
               Two-way interactions of HSL space values,
               Aperture setting.

        Classication followed by morphological opening and closing
        dene the colony area

        Penguins detected as dark local minima within colony area

        Penguin objects pruned to upper threshold of circularity
        P 2 / (4πA) to remove long thin objects
        Adopt the centroid of the surviving objects as penguins


IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Original image (350 × 250)




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Detected colony




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Cleaned colony




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Candidate penguin locations




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Overlaid penguins




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Editing facilties
        Detection procedure does not count all real penguins

        False penguins counted
               Non-breeding penguins within colony
               Penguin shadows or spurious dark objects

        True penguins missed
               Breeding penguins outside colony
               Penguins indistinct compared to surroundings

        Editing facilities required:
               Overlap between photographs requires group deletions
               Add or delete individual penguins
               Check that penguins are not double-counted
               Record of editing steps maintained
               Number of editing steps requires single-click operation




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Implementation
        Software written in Matlab 2010b, deployed with Matlab
        compiler

        Census results stored for each captured image in a small le

        Deployed for testing phase to a penguin ecologist

        Second development phase to x faults and improve
        interactive response:
               Reduce memory overhead for each counted penguin
               Reduce keystroke eort for additions/deletions
               Add ability to count penguins within non-guano stained area

        No problems reported after second phase deployment




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Editing software




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Bootstrap colony classication rates




IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Colony classication rates
        Accurate colony delineation is very important

        Requirement is for high true positive, low false negative rates

        About 5% of images give poor results:
               Due to very poor colony/background distinction
               No clear reason for this poor result




       CF001669                                   CF001720



IGARSS-2011, 25-29 July 2011, Vancouver, Canada
Conclusions
        Semi-automated penguin counting is a pragmatic approach

        Laborious counting automated; ne editing left for an expert

        Software allows editing, maintains counts, stores results

        Emphasis is interactive productivity




                                    Acknowledgements
                  Ministry for Science and Innovation (funding).
                 Antarctica New Zealand (funding and logistics).
                        Helicopters New Zealand (ying).
               Squadron 40, Royal New Zealand Air Force (ying).


IGARSS-2011, 25-29 July 2011, Vancouver, Canada

Weitere ähnliche Inhalte

Mehr von grssieee

Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...
Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...
Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...grssieee
 
SEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODEL
SEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODELSEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODEL
SEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODELgrssieee
 
TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...
TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...
TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...grssieee
 
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIESTHE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIESgrssieee
 
GMES SPACE COMPONENT:PROGRAMMATIC STATUS
GMES SPACE COMPONENT:PROGRAMMATIC STATUSGMES SPACE COMPONENT:PROGRAMMATIC STATUS
GMES SPACE COMPONENT:PROGRAMMATIC STATUSgrssieee
 
PROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETER
PROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETERPROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETER
PROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETERgrssieee
 
DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...
DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...
DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...grssieee
 
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...grssieee
 
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...grssieee
 
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...grssieee
 
test 34mb wo animations
test  34mb wo animationstest  34mb wo animations
test 34mb wo animationsgrssieee
 
2011_Fox_Tax_Worksheets.pdf
2011_Fox_Tax_Worksheets.pdf2011_Fox_Tax_Worksheets.pdf
2011_Fox_Tax_Worksheets.pdfgrssieee
 
DLR open house
DLR open houseDLR open house
DLR open housegrssieee
 
DLR open house
DLR open houseDLR open house
DLR open housegrssieee
 
DLR open house
DLR open houseDLR open house
DLR open housegrssieee
 
Tana_IGARSS2011.ppt
Tana_IGARSS2011.pptTana_IGARSS2011.ppt
Tana_IGARSS2011.pptgrssieee
 
Solaro_IGARSS_2011.ppt
Solaro_IGARSS_2011.pptSolaro_IGARSS_2011.ppt
Solaro_IGARSS_2011.pptgrssieee
 

Mehr von grssieee (20)

Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...
Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...
Tangent height accuracy of Superconducting Submillimeter-Wave Limb-Emission S...
 
SEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODEL
SEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODELSEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODEL
SEGMENTATION OF POLARIMETRIC SAR DATA WITH A MULTI-TEXTURE PRODUCT MODEL
 
TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...
TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...
TWO-POINT STATISTIC OF POLARIMETRIC SAR DATA TWO-POINT STATISTIC OF POLARIMET...
 
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIESTHE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
 
GMES SPACE COMPONENT:PROGRAMMATIC STATUS
GMES SPACE COMPONENT:PROGRAMMATIC STATUSGMES SPACE COMPONENT:PROGRAMMATIC STATUS
GMES SPACE COMPONENT:PROGRAMMATIC STATUS
 
PROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETER
PROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETERPROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETER
PROGRESSES OF DEVELOPMENT OF CFOSAT SCATTEROMETER
 
DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...
DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...
DEVELOPMENT OF ALGORITHMS AND PRODUCTS FOR SUPPORTING THE ITALIAN HYPERSPECTR...
 
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
 
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
 
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
EO-1/HYPERION: NEARING TWELVE YEARS OF SUCCESSFUL MISSION SCIENCE OPERATION A...
 
Test
TestTest
Test
 
test 34mb wo animations
test  34mb wo animationstest  34mb wo animations
test 34mb wo animations
 
Test 70MB
Test 70MBTest 70MB
Test 70MB
 
Test 70MB
Test 70MBTest 70MB
Test 70MB
 
2011_Fox_Tax_Worksheets.pdf
2011_Fox_Tax_Worksheets.pdf2011_Fox_Tax_Worksheets.pdf
2011_Fox_Tax_Worksheets.pdf
 
DLR open house
DLR open houseDLR open house
DLR open house
 
DLR open house
DLR open houseDLR open house
DLR open house
 
DLR open house
DLR open houseDLR open house
DLR open house
 
Tana_IGARSS2011.ppt
Tana_IGARSS2011.pptTana_IGARSS2011.ppt
Tana_IGARSS2011.ppt
 
Solaro_IGARSS_2011.ppt
Solaro_IGARSS_2011.pptSolaro_IGARSS_2011.ppt
Solaro_IGARSS_2011.ppt
 

Kürzlich hochgeladen

Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfPrecisely
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 

Kürzlich hochgeladen (20)

Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering TipsVertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdfHyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
Hyperautomation and AI/ML: A Strategy for Digital Transformation Success.pdf
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 

mcneills_igarss2011_penguins.pdf

  • 1. Semi-automated penguin counting from digital aerial photographs S.J McNeill K Barton P Lyver D Pairman Landcare Research New Zealand
  • 2. Motivation Understanding changes in penguin population is important, as these can be used as indicators of anthropogenic and foodweb eects Aerial photography is used in the Ross Sea (Antarctica) to capture a reliable count of Adélie nesting penguins From 1981, the Ross Sea area (158 175 o o E) has been surveyed annually There are many diculties in achieving this census count: Timing is critical, Ground counting is dicult or impossible, Counting using prints is dicult to control and validate. IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 3. Objectives Determine if it is possible to reliably detect Adélie breeding penguins in images Generate software to (semi-)automate the census process. Test, using an expert, and optimise interactivity. Pygoscelis adeliae) Adult Adélie penguin ( IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 4. Adélie penguins The most abundant and widespread Antarctic penguin 10 million Adélie make up 80% of the Southern Ocean bird biomass 38% of all Adélie penguins are found in the Ross Sea IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 5. Image capture Images captured using a hand-held camera through the open doors of a helicopter and/or C-130 Hercules Hasselblad H1D with a Phase One digital camera back Image size 5440 × 4080, 3-bands natural colour, TIFF EXIF data provides date/time and aperture information Typical ground resolution better than 0.5 m Ten representative images were selected for analysis IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 6. Full-scene example 5440 × 4080 full-scene IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 7. Sub-scene example 870 × 510 sub-scene IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 8. Analysis Human detection of breeding Adélie not straightforward There are many similar-looking objects in the images Proposed revised approach: Detect the distinctive area of the colony Only count penguins within colony area Provide software features to easily add/delete penguins IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 10. Colony penguin detection Background is largely monochromatic Colony area covered in guano and has a red excess over green or blue, with higher saturation Use linear discriminant analysis to separate colony from background, based on: Natural colour counts (RGB) converted to hue, saturation, lightness (HSL) space values, Two-way interactions of HSL space values, Aperture setting. Classication followed by morphological opening and closing dene the colony area Penguins detected as dark local minima within colony area Penguin objects pruned to upper threshold of circularity P 2 / (4πA) to remove long thin objects Adopt the centroid of the surviving objects as penguins IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 11. Original image (350 × 250) IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 12. Detected colony IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 13. Cleaned colony IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 14. Candidate penguin locations IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 15. Overlaid penguins IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 16. Editing facilties Detection procedure does not count all real penguins False penguins counted Non-breeding penguins within colony Penguin shadows or spurious dark objects True penguins missed Breeding penguins outside colony Penguins indistinct compared to surroundings Editing facilities required: Overlap between photographs requires group deletions Add or delete individual penguins Check that penguins are not double-counted Record of editing steps maintained Number of editing steps requires single-click operation IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 17. Implementation Software written in Matlab 2010b, deployed with Matlab compiler Census results stored for each captured image in a small le Deployed for testing phase to a penguin ecologist Second development phase to x faults and improve interactive response: Reduce memory overhead for each counted penguin Reduce keystroke eort for additions/deletions Add ability to count penguins within non-guano stained area No problems reported after second phase deployment IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 18. Editing software IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 19. Bootstrap colony classication rates IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 20. Colony classication rates Accurate colony delineation is very important Requirement is for high true positive, low false negative rates About 5% of images give poor results: Due to very poor colony/background distinction No clear reason for this poor result CF001669 CF001720 IGARSS-2011, 25-29 July 2011, Vancouver, Canada
  • 21. Conclusions Semi-automated penguin counting is a pragmatic approach Laborious counting automated; ne editing left for an expert Software allows editing, maintains counts, stores results Emphasis is interactive productivity Acknowledgements Ministry for Science and Innovation (funding). Antarctica New Zealand (funding and logistics). Helicopters New Zealand (ying). Squadron 40, Royal New Zealand Air Force (ying). IGARSS-2011, 25-29 July 2011, Vancouver, Canada