SlideShare ist ein Scribd-Unternehmen logo
1 von 24
Downloaden Sie, um offline zu lesen
Energy-efficient operation of GSM-
connected infrared rodent sensor
Gábor Paller, paller.gabor@sze.hu
Gábor Élő, elo@sze.hu
Széchenyi University, Győr
2016 February 19
Precision agriculture and the
agrodat.hu project
• Precision
agricultural
management
• Better control of
production risks and
costs
• Information systems
supporting
decisions
3
Crop production
AgroDat.hu project
Main objective: Establish an
agricultural knowledge centre
and decision support system
• based on data gathered by an
innovative, complex sensor
system and from international
open repositories
• relying on big data, cloud, and
HPC technologies
to support precision agriculture.
Duration: 2014-2017
Budget: 2.4 Mrd HUF (appr. 8
MEUR)
URL: www.agrodat.hu
Consortium:
Local
Senso
r
Globa
l
• Information about environmental and
vegetation processes (supplied off-line)
• Sensors and data capture tools
• Data processing system
• Visualization
• Decision support
5
Elements of the agricultural
decision support system
Sensor lineup
l
2014 – soil and environmental sensors
with simple scalar output – done
l
2015 – camera sensors in multiple
wavelengths with simple and intelligent
triggers – research phase completed,
field-ready implementation in progress
l
2016 – making the camera sensor
mobile
Soil sensor
8
Proposed system architecture
Sensor unit
Sensor
control
Network
Communication
+
App. logic
(Telit GL865)
Data server
GPRS/HTTP POST
requests
WSGI
HTTP server
Database
adapter
Data
visualization
SMSC
End user
Mobile
network
SMS
HP DSM
(Dynamic SIM Management)
SMPP
4.3+
Sensor management
server
Management
user
Server farm
Camera sensor
development
Camera sensors
l
Mission: observe plants and pests in
wide frequency spectrum (visible and
invisible)
l
Simple case: take a series of pictures
and videos at given time spots and
upload them to the server
l
More complicated: detect an event of
interest and upload only if something
interesting is happening
Camera sensor development
l
Use case: common
vole detection
l
Overpopulation due
to mild winters
l
2014 damage
estimation: 500000
tons only in winter
wheat
l
Night animal: cameras in different
wavelength are needed (short-
wavelength infrared and long-
wavelength infrared are being tried)
l
Energy consumption: send images
only if there's high chance of having
animals in the picture → image
processing on the sensor
Advantages of the use case
Common vole in short-
wavelenght infrared
Animal
Common vole in long-wavelenght
infrared
Dynamic mapping to 256-level
greyscale image
Image processing in the sensor
l
Image thresholding – 80% static threshold
l
Get rid of spurious patches – contour
tracing+convex hull filling
l
Close gaps - dilating by a kernel of 6x6
l
Calculate circles of interesting objects –
contour tracing+enclosing circles
l
Find out if the circles move – match the
circles with the circles on the previous
image and flag the circles that don't match
Image processing in the sensor
Eq – input image after
greyscaling
Th – after
thresholding
C1 – after contour
tracing + filling convex
hull
C2 – after dilating
Circle – enclosing
circle
Cost of sending an image
BeagleBone Black (TI Sitara AM335x)+Telit
GL865 modem, image size: 4Kbytes
Architectures:
- GL865 as a modem, all the logic (image
processing+communication) is on the Sitara
CPU – 10.755 mAh
- Image processing on the Sitara CPU,
communication logic on the GL865 – 3 mAh
Power consumption of
communication state machines
l Idle consumption of the Sitara CPU is a
problem in case of action-and-wait type
algorithms (typically communication state
machines)
l If the “wait” phase is long then the
processor could be put into a low-power
mode.
l A separate low-power CPU is justified just for
communication tasks.
Sensor
control
Network
Communication
+
App. logic
(Telit GL865)
Generic model
Same architecture for scalar and
image sensors
Soil sensor
Data acquisition:
ATxmega128u4
Network
Communication
+
App. logic
(Telit GL865)
App. Protocol #1
Camera sensor
Acquisition and
processing: TI
Sitara AM335x
Network
Communication
+
App. logic
(Telit GL865)
App. Protocol #2
Use case categorization
Use case Power consumption balance
between the processing and the
communication activities
Images taken at predetermined
moments of time and sent
No image processing, no balance
Images are taken continuously,
sent if relevant feature is found
Continuous image processing, no
balance*
Images taken at predetermined
moments and sent only if relevant
feature is found
Justified if the image processing
cycle consumes less than sending
the image
* Balance would mean that we compare with continuous image streaming which
is not possible over GPRS due to its low bandwidth.
Cost of image processing vs.
sending
Image processing
(acquiring and processing 5
images)
Sending the image
0.62 mAh 3 mAh
However:
l
Sitara consumes 156 mA in S3 state (69 secs to reach 3 mAh)
l
It takes 4.78 mAh to perform a shutdown-reboot cycle
l
No power saving possible in use case #3 due to high idle
consumption!
Takeaways
l
Low-power, low-consumption devices (e.g.
microcontrollers) are justified even if there's
a full-featured CPU in the system. Typical
use cases: sensor control, communication.
l
No magic bullet: high software engineering
productivity on embedded Linux but high
power consumption too.
l
Look for idle consumption!
l
Linux system optimized for extra-fast
shutdown-bootup cycle may work (but you
need a low-power sensor controller)
Questions?
paller.gabor@sze.hu
elo@sze.hu
24

Weitere ähnliche Inhalte

Was ist angesagt?

Accelerating Real-Time LiDAR Data Processing Using GPUs
Accelerating Real-Time LiDAR Data Processing Using GPUsAccelerating Real-Time LiDAR Data Processing Using GPUs
Accelerating Real-Time LiDAR Data Processing Using GPUs
Vivek Venugopalan
 
5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...
5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...
5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...
Bryan Len
 

Was ist angesagt? (20)

All about5g nov16-extract
All about5g nov16-extractAll about5g nov16-extract
All about5g nov16-extract
 
Webinar | HIL-based Wide-area Monitoring, Protection and Control R&D and Testing
Webinar | HIL-based Wide-area Monitoring, Protection and Control R&D and TestingWebinar | HIL-based Wide-area Monitoring, Protection and Control R&D and Testing
Webinar | HIL-based Wide-area Monitoring, Protection and Control R&D and Testing
 
Accelerating Real-Time LiDAR Data Processing Using GPUs
Accelerating Real-Time LiDAR Data Processing Using GPUsAccelerating Real-Time LiDAR Data Processing Using GPUs
Accelerating Real-Time LiDAR Data Processing Using GPUs
 
Power Grid Cybersecurity
Power Grid CybersecurityPower Grid Cybersecurity
Power Grid Cybersecurity
 
Optelix_NanoWave_G1000_pr3 (1)
Optelix_NanoWave_G1000_pr3 (1)Optelix_NanoWave_G1000_pr3 (1)
Optelix_NanoWave_G1000_pr3 (1)
 
5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...
5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...
5G NR Training, 5G New Radio (NR) Training Course, Wireless Training - Tonex ...
 
Beginners: Introduction to 5G Reduced Capability (RedCap) Devices
Beginners: Introduction to 5G Reduced Capability (RedCap) DevicesBeginners: Introduction to 5G Reduced Capability (RedCap) Devices
Beginners: Introduction to 5G Reduced Capability (RedCap) Devices
 
GSA WCDMA HSPA LTE Fact Sheet 1412009
GSA WCDMA HSPA LTE Fact Sheet 1412009GSA WCDMA HSPA LTE Fact Sheet 1412009
GSA WCDMA HSPA LTE Fact Sheet 1412009
 
Intermediate: 5G and Extended Reality (XR)
Intermediate: 5G and Extended Reality (XR)Intermediate: 5G and Extended Reality (XR)
Intermediate: 5G and Extended Reality (XR)
 
Quantum-safe data center interconnects
Quantum-safe data center interconnectsQuantum-safe data center interconnects
Quantum-safe data center interconnects
 
444070326 antenna-lab-57-200
444070326 antenna-lab-57-200444070326 antenna-lab-57-200
444070326 antenna-lab-57-200
 
Beginners: What is Infrastructure?
Beginners: What is Infrastructure?Beginners: What is Infrastructure?
Beginners: What is Infrastructure?
 
Smartmax M2M HSPA Smart Modem - Maxon Solutions
Smartmax M2M HSPA Smart Modem - Maxon SolutionsSmartmax M2M HSPA Smart Modem - Maxon Solutions
Smartmax M2M HSPA Smart Modem - Maxon Solutions
 
Beginners: Network In a Box (NIB)
Beginners: Network In a Box (NIB)Beginners: Network In a Box (NIB)
Beginners: Network In a Box (NIB)
 
NI100SMG
NI100SMGNI100SMG
NI100SMG
 
Cisco Connect 2018 Thailand - Innovation towards sp transformation mr.sean wa...
Cisco Connect 2018 Thailand - Innovation towards sp transformation mr.sean wa...Cisco Connect 2018 Thailand - Innovation towards sp transformation mr.sean wa...
Cisco Connect 2018 Thailand - Innovation towards sp transformation mr.sean wa...
 
6G Training Course Part 2: 6G Vision
6G Training Course Part 2: 6G Vision6G Training Course Part 2: 6G Vision
6G Training Course Part 2: 6G Vision
 
5G supports passive IoT
5G supports passive IoT5G supports passive IoT
5G supports passive IoT
 
Part 2: Standardization Organizations - 5G for Absolute Beginners
Part 2: Standardization Organizations - 5G for Absolute BeginnersPart 2: Standardization Organizations - 5G for Absolute Beginners
Part 2: Standardization Organizations - 5G for Absolute Beginners
 
Miscellaneous: 5G Uses Cases - April 2019
Miscellaneous: 5G Uses Cases - April 2019Miscellaneous: 5G Uses Cases - April 2019
Miscellaneous: 5G Uses Cases - April 2019
 

Ähnlich wie Energy-efficient operation of GSM-connected infrared rodent sensors

Real time-image-processing-applied-to-traffic-queue-detection-algorithm
Real time-image-processing-applied-to-traffic-queue-detection-algorithmReal time-image-processing-applied-to-traffic-queue-detection-algorithm
Real time-image-processing-applied-to-traffic-queue-detection-algorithm
ajayrampelli
 

Ähnlich wie Energy-efficient operation of GSM-connected infrared rodent sensors (20)

20181128 satellogic @ barcelona ai
20181128 satellogic @ barcelona ai20181128 satellogic @ barcelona ai
20181128 satellogic @ barcelona ai
 
Arpan pal roboticsensing_sw2015
Arpan pal roboticsensing_sw2015Arpan pal roboticsensing_sw2015
Arpan pal roboticsensing_sw2015
 
Real time-image-processing-applied-to-traffic-queue-detection-algorithm
Real time-image-processing-applied-to-traffic-queue-detection-algorithmReal time-image-processing-applied-to-traffic-queue-detection-algorithm
Real time-image-processing-applied-to-traffic-queue-detection-algorithm
 
Presentation for min project
Presentation for min projectPresentation for min project
Presentation for min project
 
GPS Assisted Roadmapping and Vehicle Monitoring
GPS Assisted Roadmapping and Vehicle Monitoring GPS Assisted Roadmapping and Vehicle Monitoring
GPS Assisted Roadmapping and Vehicle Monitoring
 
lecture5-wearables-and-motion-sening.pptx
lecture5-wearables-and-motion-sening.pptxlecture5-wearables-and-motion-sening.pptx
lecture5-wearables-and-motion-sening.pptx
 
5G for Reliable Industrial Wireless Networks
5G for Reliable Industrial Wireless Networks5G for Reliable Industrial Wireless Networks
5G for Reliable Industrial Wireless Networks
 
IRJET- Land Mine Data Collection System using Long Range WiFi and P2P Com...
IRJET-  	  Land Mine Data Collection System using Long Range WiFi and P2P Com...IRJET-  	  Land Mine Data Collection System using Long Range WiFi and P2P Com...
IRJET- Land Mine Data Collection System using Long Range WiFi and P2P Com...
 
MU- mimo [autosaved]
MU- mimo [autosaved]MU- mimo [autosaved]
MU- mimo [autosaved]
 
iCT Padova 2019 - RX Solutions
iCT Padova 2019 - RX SolutionsiCT Padova 2019 - RX Solutions
iCT Padova 2019 - RX Solutions
 
IoT Tech Expo 2023_Micha vor dem Berge presentation
IoT Tech Expo 2023_Micha vor dem Berge presentationIoT Tech Expo 2023_Micha vor dem Berge presentation
IoT Tech Expo 2023_Micha vor dem Berge presentation
 
Kk3517971799
Kk3517971799Kk3517971799
Kk3517971799
 
IRJET- Image Encryption based on Non-Subsampled Contourlet Transform with Dif...
IRJET- Image Encryption based on Non-Subsampled Contourlet Transform with Dif...IRJET- Image Encryption based on Non-Subsampled Contourlet Transform with Dif...
IRJET- Image Encryption based on Non-Subsampled Contourlet Transform with Dif...
 
 Gigapixel resolution imaging for near-remote sensing and phenomics
 Gigapixel resolution imaging for near-remote sensing and phenomics Gigapixel resolution imaging for near-remote sensing and phenomics
 Gigapixel resolution imaging for near-remote sensing and phenomics
 
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the projectLEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
LEGaTO: Low-Energy Heterogeneous Computing Use of AI in the project
 
Black Box for Accident Analysis Using MATLAB-Image Processing
Black Box for Accident Analysis Using MATLAB-Image ProcessingBlack Box for Accident Analysis Using MATLAB-Image Processing
Black Box for Accident Analysis Using MATLAB-Image Processing
 
Devtalks Cluj - Develop geolocation solutions with Sigfox
Devtalks Cluj - Develop geolocation solutions with SigfoxDevtalks Cluj - Develop geolocation solutions with Sigfox
Devtalks Cluj - Develop geolocation solutions with Sigfox
 
A New Chaos Based Image Encryption and Decryption using a Hash Function
A New Chaos Based Image Encryption and Decryption using a Hash FunctionA New Chaos Based Image Encryption and Decryption using a Hash Function
A New Chaos Based Image Encryption and Decryption using a Hash Function
 
PIMRC-2012, Sydney, Australia, 28 July, 2012
PIMRC-2012, Sydney, Australia, 28 July, 2012PIMRC-2012, Sydney, Australia, 28 July, 2012
PIMRC-2012, Sydney, Australia, 28 July, 2012
 
IRJET- Ad-hoc Based Outdoor Positioning System
IRJET- Ad-hoc Based Outdoor Positioning SystemIRJET- Ad-hoc Based Outdoor Positioning System
IRJET- Ad-hoc Based Outdoor Positioning System
 

Mehr von Gabor Paller

Mehr von Gabor Paller (12)

Towards a floating plastic waste early warning system
Towards a floating plastic waste early warning systemTowards a floating plastic waste early warning system
Towards a floating plastic waste early warning system
 
Dataflow-based heterogeneous code generator for IoT applications
Dataflow-based heterogeneous code generator for IoT applicationsDataflow-based heterogeneous code generator for IoT applications
Dataflow-based heterogeneous code generator for IoT applications
 
Sigfox szenzorfejlesztéssel kapcsolatos tapasztalatok
Sigfox szenzorfejlesztéssel kapcsolatos tapasztalatokSigfox szenzorfejlesztéssel kapcsolatos tapasztalatok
Sigfox szenzorfejlesztéssel kapcsolatos tapasztalatok
 
AgroDat poster at Sensornets 2015 conference
AgroDat poster at Sensornets 2015 conferenceAgroDat poster at Sensornets 2015 conference
AgroDat poster at Sensornets 2015 conference
 
Connect your Android to the real world with Bluetooth Low Energy
Connect your Android to the real world with Bluetooth Low EnergyConnect your Android to the real world with Bluetooth Low Energy
Connect your Android to the real world with Bluetooth Low Energy
 
Sensor fusion between car and smartphone
Sensor fusion between car and smartphoneSensor fusion between car and smartphone
Sensor fusion between car and smartphone
 
Advantages and limitations of PhoneGap for sensor processing
Advantages and limitations of PhoneGap for sensor processingAdvantages and limitations of PhoneGap for sensor processing
Advantages and limitations of PhoneGap for sensor processing
 
Better motion control using accelerometer/gyroscope sensor fusion
Better motion control using accelerometer/gyroscope sensor fusionBetter motion control using accelerometer/gyroscope sensor fusion
Better motion control using accelerometer/gyroscope sensor fusion
 
Motion recognition with Android devices
Motion recognition with Android devicesMotion recognition with Android devices
Motion recognition with Android devices
 
LiveFolders as feeds
LiveFolders as feedsLiveFolders as feeds
LiveFolders as feeds
 
Understanding the Dalvik bytecode with the Dedexer tool
Understanding the Dalvik bytecode with the Dedexer toolUnderstanding the Dalvik bytecode with the Dedexer tool
Understanding the Dalvik bytecode with the Dedexer tool
 
The dedexer disassembler
The dedexer disassemblerThe dedexer disassembler
The dedexer disassembler
 

Kürzlich hochgeladen

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Kürzlich hochgeladen (20)

HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptxSKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
SKILL OF INTRODUCING THE LESSON MICRO SKILLS.pptx
 

Energy-efficient operation of GSM-connected infrared rodent sensors

  • 1. Energy-efficient operation of GSM- connected infrared rodent sensor Gábor Paller, paller.gabor@sze.hu Gábor Élő, elo@sze.hu Széchenyi University, Győr 2016 February 19
  • 2. Precision agriculture and the agrodat.hu project
  • 3. • Precision agricultural management • Better control of production risks and costs • Information systems supporting decisions 3 Crop production
  • 4. AgroDat.hu project Main objective: Establish an agricultural knowledge centre and decision support system • based on data gathered by an innovative, complex sensor system and from international open repositories • relying on big data, cloud, and HPC technologies to support precision agriculture. Duration: 2014-2017 Budget: 2.4 Mrd HUF (appr. 8 MEUR) URL: www.agrodat.hu Consortium: Local Senso r Globa l
  • 5. • Information about environmental and vegetation processes (supplied off-line) • Sensors and data capture tools • Data processing system • Visualization • Decision support 5 Elements of the agricultural decision support system
  • 6. Sensor lineup l 2014 – soil and environmental sensors with simple scalar output – done l 2015 – camera sensors in multiple wavelengths with simple and intelligent triggers – research phase completed, field-ready implementation in progress l 2016 – making the camera sensor mobile
  • 8. 8 Proposed system architecture Sensor unit Sensor control Network Communication + App. logic (Telit GL865) Data server GPRS/HTTP POST requests WSGI HTTP server Database adapter Data visualization SMSC End user Mobile network SMS HP DSM (Dynamic SIM Management) SMPP 4.3+ Sensor management server Management user
  • 11. Camera sensors l Mission: observe plants and pests in wide frequency spectrum (visible and invisible) l Simple case: take a series of pictures and videos at given time spots and upload them to the server l More complicated: detect an event of interest and upload only if something interesting is happening
  • 12. Camera sensor development l Use case: common vole detection l Overpopulation due to mild winters l 2014 damage estimation: 500000 tons only in winter wheat
  • 13. l Night animal: cameras in different wavelength are needed (short- wavelength infrared and long- wavelength infrared are being tried) l Energy consumption: send images only if there's high chance of having animals in the picture → image processing on the sensor Advantages of the use case
  • 14. Common vole in short- wavelenght infrared Animal
  • 15. Common vole in long-wavelenght infrared Dynamic mapping to 256-level greyscale image
  • 16. Image processing in the sensor l Image thresholding – 80% static threshold l Get rid of spurious patches – contour tracing+convex hull filling l Close gaps - dilating by a kernel of 6x6 l Calculate circles of interesting objects – contour tracing+enclosing circles l Find out if the circles move – match the circles with the circles on the previous image and flag the circles that don't match
  • 17. Image processing in the sensor Eq – input image after greyscaling Th – after thresholding C1 – after contour tracing + filling convex hull C2 – after dilating Circle – enclosing circle
  • 18. Cost of sending an image BeagleBone Black (TI Sitara AM335x)+Telit GL865 modem, image size: 4Kbytes Architectures: - GL865 as a modem, all the logic (image processing+communication) is on the Sitara CPU – 10.755 mAh - Image processing on the Sitara CPU, communication logic on the GL865 – 3 mAh
  • 19. Power consumption of communication state machines l Idle consumption of the Sitara CPU is a problem in case of action-and-wait type algorithms (typically communication state machines) l If the “wait” phase is long then the processor could be put into a low-power mode. l A separate low-power CPU is justified just for communication tasks.
  • 20. Sensor control Network Communication + App. logic (Telit GL865) Generic model Same architecture for scalar and image sensors Soil sensor Data acquisition: ATxmega128u4 Network Communication + App. logic (Telit GL865) App. Protocol #1 Camera sensor Acquisition and processing: TI Sitara AM335x Network Communication + App. logic (Telit GL865) App. Protocol #2
  • 21. Use case categorization Use case Power consumption balance between the processing and the communication activities Images taken at predetermined moments of time and sent No image processing, no balance Images are taken continuously, sent if relevant feature is found Continuous image processing, no balance* Images taken at predetermined moments and sent only if relevant feature is found Justified if the image processing cycle consumes less than sending the image * Balance would mean that we compare with continuous image streaming which is not possible over GPRS due to its low bandwidth.
  • 22. Cost of image processing vs. sending Image processing (acquiring and processing 5 images) Sending the image 0.62 mAh 3 mAh However: l Sitara consumes 156 mA in S3 state (69 secs to reach 3 mAh) l It takes 4.78 mAh to perform a shutdown-reboot cycle l No power saving possible in use case #3 due to high idle consumption!
  • 23. Takeaways l Low-power, low-consumption devices (e.g. microcontrollers) are justified even if there's a full-featured CPU in the system. Typical use cases: sensor control, communication. l No magic bullet: high software engineering productivity on embedded Linux but high power consumption too. l Look for idle consumption! l Linux system optimized for extra-fast shutdown-bootup cycle may work (but you need a low-power sensor controller)