Electronics Rocks'14 - India's premier design engineer conference

1. Futuristic World with Sensors and Smart Devices
Samarth Shah
Infosys Labs

2. Outline
•Future
•Sensors
•Microsoft Kinect
•Leap Motion
•Smart Devices
•Pebble smart watch
•Few Case Studies

3. Future
•“You can not connect the dots looking forward , you can only connect them looking backwards” –Steve Jobs
•Internet Of Things
•Sensors
Image Source: http://www.businessinsider.in/Morgan-Stanley-75-Billion-Devices-Will-Be-Connected-To-The-Internet-Of-Things-By-2020/articleshow/23426604.cms

4. Sensors
•In general “A sensor is a device which can convert one form of signals to another form of signals.”
•Specific “A sensor is a device which can convert one form of signals to another form of signals which can be understood by the machine”
•Examples:
•Gesture Recognition
•Microsoft Kinect
•Leap Motion
•Sound
•Thermal
•Pressure
•Brainwave
•…

5. Microsoft Kinect
•Initially Started as Research Project “Project Natal”
•Kinect V1 and Kinect V2
•Skeleton Tracking
•Speech Recognition
•Gesture Recognition
Image Source : http://www.microsoftstore.com/store/msusa/en_US/pdp/Kinect-for-Windows-v2-Sensor/productID.298810500
http://www.microsoft.com/en-us/news/features/2011/oct11/10-31kinecteffect.aspx
http://www.codeproject.com/Articles/213034/Kinect-Getting-Started-Become-The-Incredible-Hulk

6. Feature
KinectV1
Kinect V2
Color Camera
640 * 480 @30fps
1920 * 1080 @30fps
Depth Camera
320 * 240
512 * 424
Infrared Capabilities
No
Yes
Max. Depth Distance
~4.5m
~4.5m
Min.Depth Distance
40 cm
50 cm
Horizontal Field of View
57 Degrees
70 Degrees
Vertical Field of View
43 Degrees
60 Degrees
Tilt Motor
Yes
No
Skeleton Joints Defined
20 joints
25 joints
Full skeleton tracked
2
6
USB standard
2.0
3.0
SupportedOS
Win 7 , Win 8
Win 8

7. Use Cases
•Gesture Controlled Website
•Gesture Controlled Robot
•Medical Field
•Education Field
•Computer Vision Research
•Raspberry Pi (Kinect V1)
•…

8. Leap Motion
•Tracks both hands and all 10 fingers with pinpoint precision and incredible speed.
•Two monochromatic IR cameras and Three IR LEDs
•Distance : Up to 1 meter
Image Source : https://www.leapmotion.com/

9. Use Cases
•Navigating a website
•Using pinch-to-zoom gestures on maps
•High-precision drawing
•Manipulating complex 3D data visualizations

11. Smart Devices
•A smart device is an Electronic device, generally connected to other devices/sensors or networks via different protocols.
•Examples:
•SmartWatch
•Pebble
•Apple Watch
•Moto 360
•SmartPhone
•Smart Coffee Maker
•Smart Toothbrush
•…

12. Pebble Smartwatch
•KickstarterCampaign
•Sensors
•Black and White E-paper display
•A Vibrating Motor
•A magnetometer
•Ambient light sensor
•An Accelerometer
•Connecting external sensors ?

13. Use cases
•Vibrating alert for
•Text messages
•Emails
•Incoming calls
•Notifications from social media accounts
•Remote Controller for
•Phone
•Camera like GoPro
•And maybe for your car
Image Source: https://blog.getpebble.com

15. Few Case Studies
•Where sensors are used to build a cool product
•OpenRelief
•OpenROV
•…
•Intelligent Devices
•RoboBrain

16. OpenRelief
•Planning disaster relief efforts is like trying to see through fog. OpenReliefis a project to develop better communications tools that help clear that fog. This enables the right aid to get to the right places at the right time.
Image Source: http://www.openrelief.org/home/

17. OpenRelief

18. OpenRelief
•Capabilities
•Take off from footpaths
•Recognize roads , people and smoke
•Photograph , Film and Map the landscape
•Measure weather , radiation and other conditions via modular sensors
•Technical Specifications
•Arduino Mega to fly the plane
•Super HAD CDD fisheye camera to see
•Arduino based sensors to gather information
•Raspberry Pi to process the data
•RaspianOS to analyze the results

19. RoboBrain
•RoboBrain is a large-scale computational system that learns from publicly available Internet resources, computer simulations, and real-life robot trials. It accumulates everything robotics into a comprehensive and interconnected knowledge base. Applications include prototyping for robotics research, household robots, and self-driving cars.
•Challenges:
•Machine Learning
•Large-Scale Data Processing
•Language and Dialog
•Perception
•AI and Reasoning Systems
•Embodiment
•Robotics and Automation

20. Future
•“Logic will take you from A to B. Imagination will take you everywhere” –Albert Einstein
•Interconnected Intelligent Sensors and Smart Devices
•JIBO

22. Thank You
•Samarth@outlook.com
•@SamarthShah_
•+91-9561813730