Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.

Divya Jain at AI Frontiers : Video Summarization

720 Aufrufe

Veröffentlicht am

As video content is becoming mainstream, video summarization is becoming a hot research topic in academia and industry. Video thumbnail generation and summarization has been worked on for years, but deep learning and reinforcement learning is changing the landscape and emerging as the winner for optimal frame selection. Recent advances in GANs are improving the quality, aesthetics and relevancy of the frames to represent the original videos. Come join this session to get an understanding of various challenges and emerging solutions around video summarization.

Veröffentlicht in: Technologie
  • Als Erste(r) kommentieren

  • Gehören Sie zu den Ersten, denen das gefällt!

Divya Jain at AI Frontiers : Video Summarization

  1. 1. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Video Summarization Divya Jain | Nov 2018
  2. 2. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Agenda • Adobe Introduction • Adobe Sensei (AI) • Adobe Video Use cases • Video Summarization • Why • What • How
  3. 3. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. $7.3B FY2017 Revenue Adobe is one of the largest and most diversified software companies in the world . 35 Years of revolutionizing industries ~4,300 Patents* ~18,600 Employees in 37 countries * As of June 2018 3 Only Adobe gives people everything they need to design and deliver exceptional digital experiences Most Innovative Companies in AI Best Workplace for Diversity
  4. 4. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adobe Sensei Creative Intelligence Experience Intelligence Content Intelligenc e Serve the creator, Respect the consumer
  5. 5. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Global Video Market is increasing and taking the center stage Video Content Growth Source: OMI Top Social Media Trends of 2018
  6. 6. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Video Processing and Understanding Video Summarization and Segmentation Bringing the Magic of AI to Videos Video Stabilization and Quality
  7. 7. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Demo : Video Stabilization and Quality https://research.adobe.com/project/subspace/
  8. 8. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Demo: Video Processing and Understanding https://www.youtube.com/watch?v=BxhcqhPzQIU&feature=youtu.be • Project Cloak – remove unwanted objects from a video • Experimental tool from Adobe Research
  9. 9. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Video Summarization Use Cases Efficient Viewing Sport Highlight Length Limitation Adaptation Multilength Video Ads Ascertaining Interest Thumbnail Quick Peek
  10. 10. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Video Summarization Categories Summaries/Highlights follow a specific structure/template Summaries/Highlights are very diverse and video-specific
  11. 11. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Video Summarization: Approach 1 Variational Auto-Encoder + Generative Adversarial Network Approach Input Video Frame and Feature Extractor Frame Features Frame Selector Subset of Frames Reconstruction Minimize Distance Generate summary from the most representative frames from the video
  12. 12. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Demo Original Video
  13. 13. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Demo Summary Videos 30 Seconds 10 Seconds
  14. 14. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Video Summarization: Approach 2 • Use Reinforcement Learning Source: https://arxiv.org/abs/1801.00054
  15. 15. © 2018 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Demo Highlights, fouls, and injuries only
  16. 16. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Thanks! For more information on Adobe AI follow @adobeSensei For my views on various topics follow @divyajain1

×