NYC Technology Forum 2015
•
1 gefällt mir•718 views
Machines are talking, are you listening? Jason Schogel, Sr. Sales Engineer, Splunk
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Andere mochten auch (16)
Ähnlich wie NYC Technology Forum 2015
Ähnlich wie NYC Technology Forum 2015 (20)
Mehr von Splunk
Mehr von Splunk (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
NYC Technology Forum 2015
- 1. Copyright © 2015 Splunk Inc. Machines are talking, are you listening? Jason Schogel Sr Sales Engineer
- 2. Copyright © 2015 Splunk, Inc. Copyright © 2015 Splunk, Inc. Machines are Talking Are you Listening? Jason Schogel Sales Engineer What is machine data? Where can I get some? What can I do with it? We’ll tackle these questions:
- 3. Copyright © 2015 Splunk, Inc. What is machine data? Logs files from computers and network devices Usage and Access Data from Personal electronics Data from sensors and remote metering devices Desktop Laptop Datacenters iPad iPhone Android Watches RFID All of these produce data on their own Lots of data Valuable data Energy Meters Weather Sensors Radar & Traffic Cameras
- 4. Copyright © 2015 Splunk, Inc. What does it look like? Applications Twitter Care IVR computer systems
- 5. Copyright © 2015 Splunk, Inc. A world of connected assets Internet of ThingsCity Services Data Transportation | Energy | Utilities | Building Management Water & Sewage | Public Safety Wearables, Home Appliances, Consumer Electronics, Gaming Systems, Personal Security, Set-Top Boxes, Vending Machines, Mobile Point of Sale, ATMs, Personal Vehicles Sensors, Pumps, GPS, Valves, Vats, Conveyors, Pipelines, Drills, Transformers, RTUs, PLCs, HMIs, Lighting, HVAC, Traffic Management, Turbines, Windmills, Generators, Fuel Cells, UPS 5 Retail | Home | Consumer Telemedicine | Connected Cars Gartner Inc estimates there will be 26 billion IoT devices online by 2020
- 6. Copyright © 2015 Splunk, Inc. Improve Constituent Engagement Mitigate Security Threats Deliver Better Eligibility Experience Reduce IT Costs Ensure HIPPA/PCI/FISMA Compliance Prevent Fraud Accelerate Transaction Processing Improve Operational Efficiency What do most agencies use it for? 6 State & Local Government Use Cases
- 7. Copyright © 2015 Splunk, Inc. Example: Major Events Improved planning for better services If a street is closed: How will traffic be affected? How will parking revenue be impacted? How should busses be rerouted? How do we measure the effectiveness of our decisions in real-time?
- 8. Copyright © 2015 Splunk, Inc. Example: Traffic Patterns EZ Pass Reader Owner/Operator - DOT/DoITT/Federal Highway Administration Primarily used for toll-collection Sensors can also track traffic flow, allowing traffic signals to respond to changing conditions. 3D Tracking Radar & Camera System Radar tracks passing vehicles’ location. Camera activated if car runs red light. Processes image to read the license plate. Ticket mailed to registered address.
- 9. Copyright © 2015 Splunk, Inc. Exploiting vehicle-to-vehicle (V2V) and intersection communications to improve vehicle flow and pedestrian safety in high-priority corridors in New York City. See more at http://www.its.dot.gov/pilots/ Example: Connected Vehicle Pilot Program
- 10. Copyright © 2015 Splunk, Inc. Example: Utility Delivery Improvement • Device – Meter Transmission Units • Owner/Operator – NYC DEP • Where – >800K Commercial and Residential Buildings Transmits data from water sensors inside the building. • Allows for – More accurate billing compared to estimating bills based on irregular manual meter readings – Near-real-time leak alerts for building owners.
- 11. Copyright © 2015 Splunk, Inc. Water utility use cases Reservoirs, Streams, Weather (aka raw water, non-potable) Treatment Plants (aka treated water, potable) Distribution pipes, compression stations, household taps IT Enterprise events (monitoring applications and systems) Desktop management (monitoring Windows logs for user support) IT Integration activities (monitoring service execution and performance) IT Security activities (DMZ access, Active Directory issues) 11
- 12. Copyright © 2015 Splunk, Inc. Example: Local Ordinance Enforcement Temperature Sensor & Heating System Control • Owner/Operator – Building Owner • Where – All New York City apartment building • Benefit – All apartment buildings must provide heating when outside temperature drops below stated minimum. – Help building owners abide by NYC Department of Housing Preservation and Development mandates.
- 13. Copyright © 2015 Splunk, Inc. Where else can I get machine data? There are many sources of machine data from nearly all city departments, and new ones are coming…
- 14. Copyright © 2015 Splunk, Inc. What are traditional barriers to machine data? • Data is on closed, legacy networks • Too expensive to transform data for reporting tools • Cannot get data in real time
- 15. Copyright © 2015 Splunk, Inc. How can I use machine data? • Informed Decision Making • Security Monitoring & IT Ops • Business Trending & Forecasting • Monitoring & Alerting • Real-time Feed Back on Decisions • Find Answers From Correlated Data
- 16. Copyright © 2015 Splunk, Inc. Machine data is powerful It’s available to you now It has immense and immediate value How you use it is up to your imagination
- 17. Copyright © 2015 Splunk, Inc. Thank You
Hinweis der Redaktion
- We are nearing the dawn of a very interesting age. From robotics, to smart homes, to web-connected light bulbs, HVAC units, servers and routers—machines are in use everywhere. These machines have a lot to say, but what happens when you start listening? What things come to light and what new discoveries can you make? What questions can you now ask of your world? This session will explore machine to machine analytics as government organizations deploy more applications for their citizens and contend with an exploding Internet of Things.
- Data is growing and embodies new characteristics not found in traditional structured data: Volume, Velocity, Variety, Variability. Machine data is one of the fastest, growing, most complex and most valuable segments of big data. "Big data" is a term applied to these expanding data sets whose size is beyond the ability of commonly used software tools to capture, manage, and process the data within a tolerable elapsed time. All the webservers, applications, network devices – all of the technology infrastructure running an enterprise or organization – generates massive streams of data, in an array of unpredictable formats that are difficult to process and analyze by traditional methods or in a timely manner. Why is this “machine data” valuable? Because it contains a trace - a categorical record - of user behavior, cyber-security risks, application behavior, service levels, fraudulent activity and customer experience.
- Physically, the data may look like streams of cryptic information, but it contains valuable information.
- Weather sensors may stream temperature, barometric pressure, and humidity information. Door swipes log the entry of employees to a facility. Wireless routers track user online access, and EZ-pass readers monitor traffic flowing through midtown Manhattan. All of of this data is continually produced, by thousands of devices, and it can contain a blueprint to what is going on in the world around us. Gartner research estimates there will be 26 billion devices on the Internet of Things by 2020. ABI Research estimates that more than 30 billion devices will be wirelessly connected to the Internet of Things by 2020 Currently, machine data is coming from every one of New York’s departments in one form or another. <animation> Add to that machine data from the general public, retail and manufacturing segments, and you have a treasure trove of information. Many of you in this room may be directly tied to some of these example – so please see me afterward with any corrections!
- But today we’ll be exploring a bunch of other use cases, all of which are in use today by one department or another in NYS/NYC governments departments. State & local government has been aggregating and storing the massive amounts of data they collect for years. Now is the time for agencies to capitalize on their data – and some innovate New York State and City agencies are. So where where can agencies get data from now, and what data sources can we add in the future? Lets look at a few examples of machine data being collected by various departments in major cities. ----------------- OLD CONTENT – JUST FOR BACKGROUND ON BORROWED SLIDE For years, state & local government has been aggregating and storing the massive amounts of data they collect, all resting on the promise that someday the information will be valuable. Now is the time for agencies to capitalize on their data. The technology now exists to quickly process and analyze data. Organizations can finally derive value from their data lakes as well as from their machine data, or data that is created without the intervention of humans, from transactions, APIs, call centers, sensors, and more.
- If a street is closed: How will traffic be affected? How will parking revenue be impacted? How should busses be rerouted? How do we measure the effectiveness of our decisions in real-time?
- Already, there are many city services collecting machine data. A few notable one include these: This device on a lamppost at an intersection is an “Encompass 4” RFID reader manufactured by TransCore of Pennsylvania. It is used to sense E-ZPass transponders in passing vehicles as part of the City and State Departments of Transportation and the NYCDOITT “Midtown in Motion” program. Although E-ZPass is primarily used for toll-collection across the Northeast, these sensors track traffic flow in midtown Manhattan, allowing traffic signals to respond to changing conditions. Data viewed at NYC-DOT’s Traffic Management Center in Long Island Source: http://www.invisibleboxes.info/encompass/
- Here’s something NYC DOT is looking at doing: Connected Vehicle CV Pilot Deployment Program http://www.its.dot.gov/pilots/
- Already, there are many city services collecting machine data. A few notable one include these: These grey boxes are attached to the exterior of over 800,000 buildings across New York City. They are Meter Transmission Units, manufactured by Aclara (owned by ESCO technologies of St Louis, Missouri) and part of a 2008 New York City Department of Environmental Protection (DEP) program titled “Citywide Advanced Metering Infrastructure Program.” They transmit data from meter sensors inside the building to nearby Network Data Collectors, which in turn send it to the DEP for more accurate billing compared to estimating bills based on irregular manual meter readings, and near-real-time leak alerts for building owners. Source: http://www.invisibleboxes.info/water-meter-transmission-unit/
- We have a current customer using Splunk for these use cases DON’T MENTION CUSTOMER DURING PRESENTATION, BUT IT IS DENVER WATER AND THEIR DECK IS ON THE CONF2015 WEBSITE.
- This small beige box mounted at a small distance from an exterior apartment building wall is an outdoor temperature sensor, manufactured by Heat-Timer Corporation of New Jersey. It senses the external temperature and controls the heating of a building, most commonly by cycling a boiler found in the basement of the building. NYC Department of Housing Preservation and Development mandates that all apartment buildings in the city provide heating when the outside temperature drops below given temperatures, and these sensors help buildings abide by those laws. Source: http://www.invisibleboxes.info/temperature-sensor/
- Already, there are many city services collecting machine data. A few notable one include these: Subway turnstiles, police cameras and license plate readers, traffic signal control systems, and the soon-to-be release LinkNYC pay-hone replacement.
- Already, there are many city services collecting machine data. A few notable ones include: Noise & Vibration Monitor Data is automatically sent to a compliance website Provides e-mail alerts, reports, and warnings of excessive noise or vibration The monitoring system includes four (4) noise and five (5) vibration monitors placed along the perimeter of the WTC site in Lower Manhattan. ButterJAM established a web interface which queries noise and vibration monitoring databases within the off-site server. The data is automatically sent to an innovative compliance website which displays appropriate data and allows access by authorized users. The system provides e-mail alerts, warning of any noise or vibration limit exceedance or equipment malfunction. In addition, the system automatically generates reports and directly e-mails reports to authorized personnel. Source: http://www.invisibleboxes.info/noise-monitoring-terminal/
- Informed Decision Making Security Monitoring Forecasting Monitoring & Alerting Real-time Feed Back