2023-My AI Experience - Colm Dunphy.pdf

Colm Dunphy
Colm DunphyLecturer um SETU
My AI Experience
Colm Dunphy - June 2023
TIMELINE - 1
• 1990 AI Subject in College
• Expert systems
• Machine Learning
• Neural Networks
• Natural Language Processing
• Languages
• Lisp, Prolog
• 1998 Furby
• “Furbish”
• Learned English commands
• Talk to another (infra red)
• 2010 Siri app
• 2011 Integrated into iOS
• DARPA
• 2013 Amazon Alexa
• 2019 3rd generation Alexa Dots
• 2001 Polish “Ivona”
TIMELINE - 2
• MS Word
• Spelling & grammar
• 1989 Word 2.0 spell check
• 1993 Word 6 for windows
• 1995 Word 95
• 1997 Autocorrect
• 2007 Contextual spelling &
grammar
TIMELINE - 3
• Grammarly
• 2009 First release
• 2017 iOS & Android
• 2018 Google Docs compatible
TIMELINE - 4
• MS Powerpoint
• Design Ideas
• 2016 Office 365 Windows
• Powerpoint Design Ideas
• 2017 Office 365 Mac
• Background Removal 2013
Adobe Photoshop
Fill
• Context Aware
• New AI Generative Fill
Canva - Assistant
Canva - Assistant
CANVA – Text to Image
CANVA Magic Eraser
WRTC/DIGITAL(DEC) Internship
• Karl Sandison & Larry Stapleton
• ECO – Engineering Change Order
• Learn the “lexographical structure of ECOs” so that they could be automatically
read/parsed and interpreted, by a computer program.
• Technologies
• LISP, ADA, C, VAX PARSE, RDBMS
• MIT Information Lens
• https://dspace.mit.edu/bitstream/handle/1721.1/2277/SWP-3082-
21174847-CISR-192.pdf?sequence=1
• VILE-MMS - 4th Year Project 1991
• - Vax Information Lens Editor & Mail Management System
• Mail Filtering Rules
• - Novell Groupwise Mail - 1995 before we had these features in Waterford.
DJ & Radio – R&D Background (TSSG)
• ABC PLAYOUT (1997)
• Schedule music ads,
automate a radio station
• (RCS, Myriad, RadioMation, Genesys, mAirList)
• Hash6 / Catch (2002)
• Identify a song on the radio, add to your locker,
buy and download
• (Spotify,Shazam)
• UMetaDJ (2003)
• Open format for sharing data between professional
DJ softwares
• (RecordBuddy, RecordCloud, MIXO, iTunes)
• MORP (2003)
• MObile Retail Payments
• (Revolut)
• MUZU (2002)
• online music video site
• largest legal catalogue of online music
videos.
• FeedHenry (2002)
• Global RSS feed curation
• Later pivoted to SAAS
Red Hat Mobile Services
DJ & Radio - Background
• MetaData / Cue Points
– MANUAL EXERCISE
• Vinyl (80s)
• Chewing gum
Labels
Painters Tape
• Video tape (90s)
• magnetic index markers
• Minidisc (90s)
• insert markers
• CD (90s)
• stored on separate SD memory cards
• Laptop (00s) / Digital Files
• Separate Database
• within metadata of the file
DJ & Radio
• CLUB DJ SOFTWARE
• Traktor, Serato, RecordBox,
VirtualDJ, MIXX, dJay Algorithm
• 2020 Pioneer RecordBox 6
• subscription model
• auto identifies song structure
during analysis
• (intro, verse, break, chorus, drop, etc.)
• Supervised Gianluca Zuccarelli
• Sun Life Computing Projects
Innovation Award 2020-21
• "Neural Network based Song
Structure Analysis".
• i.e. creating and training your own
model
2023-My AI Experience - Colm Dunphy.pdf
DJ – ACCAPELLAS / STEMS - services
2015
Native Instruments TRAKTOR
STEMs Open Format
•File containing 4 parts
•.stem.mp4
2020
LALAL.AI
2023
AuDImix
2020
djay Pro AI
2021
VirtualDJ
2022
Serato
FADR.com
2023
VirtualDJ (STEMS 2)
Rekordbox DJ
DJ – ACCAPELLAS / STEMS - RealTime
Music
• Writing a song – ChatGBT
• MelodyStudio
• Better context / syllables
• Chord Progression / melody
• Apple Logic / GarageBand
• Virtual Musicians
• Virtual drummer
• Move away from texboxes to sliders and emotions
Audio
• Focusrite FAST AI plugins
• Sound cards
• SHURE MOTIV AI
• Shure mv7 mic
Adobe VoCo
• Adobe Max 2016
• Photoshop for Voice
• Transcribe a video
• By editing the text transcript, you edit the video
• 2023 Adobe Premiere Pro now has this functionality
• Surprise:
• By adding new words, your could make the person say those words
• This is now available in resemble.ai
• Concerns over ethics, copyright, data privacy
– voiceprint biometrics, human image syntheses
Resemble.ai - Al Voice Synthesis
Resemble.ai - Al Voice Synthesis
Text to Speech / Voice Cloning
• Speechify $249 pa (best??)
• Snoop Dog - please open a web page
• Resemble.ai
Waterford Tech
Meetup 2018
• Deep learning techniques
• to better understand the
brainwaves (EEG) of newborn
babies
• detecting seizures in infants.
PhD candidate Alison O’Shea
• TensorFlow
• Creating your own machine
learning models
Computer Code Generation - 1
• Computers talk in Binary Machine Language (01010101)
• Chips Assembly Language
(Minimal instruction set)
• High Level Languages
• Basic, Cobol, Pascal ,C
• Python, Java,
JavaScript, Node.js
C++
• Interpetted v compiled
• Libraries of code
• can be reused
• Vast Number
• Versions!
• NPM
Computer Code Generation - 2
• Code Completion
• IntelliJ
• Visual Code
• CoPilot
• CoPilot VoiceAssist
• GitHub
• Bought by Microsoft in 2018 for $7.5 billion
• 100 million developers
• 92% of programmers using AI
• CEO Thomas Dohmke interview
• Copilot will write 80% of code “sooner than later”
• Keeps developers in the editor.
• Net Promoter score +81%
• 46% of code is now written by CoPilot
• 55% fastser
Last Year
Nov 2022
• Mobile App Dev assignment
• Slack Post appeared re writing a spec for
• AI Generation came to the fore
• Replied ok to use AI tools once acknowledged. However own words need to be own words.
• FINAL Project:
• Highlighted AI Detection (open source projects on GitHub)
• STUDENTS BEWARE
• Acknowledge
• Cite
• Policies
• Code of Conduct (dis) honest
• Plagiarism
Dec 2022
• Started reading around generative AI Tools
• Subscribing to Facebook groups
• Email Subscription
• TLDR AI
• Getting Informed for next semester
• Key Considerations
1. If ChatGBT can generate the solution to your assignment…
• Are you asking students to do the right assignment?
• Are you teaching the right thing?
2. Embrace AI versus trying to prevent it’s use
• (akin to pretending there is no internet and students don’t have mobile phones/data)
Jan 2003
• New Cohort of students starting Programming
• Q: Can ChatGPT generate the programming language being taught
(Processing)?
• A: Web says NO. However by trying it out myself I discovered partial YES
• Q: What do I need to change in Assigment 1
• A: No more than normal (change the theme and some constraints)
• Why?
• We don’t mark the code, we mark the reflection
• The reflection is tied to the marking rubric, which in turn is tied to the code
• WE ARE MAKING THE LEARNING NOT THE ARTIFACT
Feb 2023
• Following more education based AI Groups
• Differences of opinion about citing
• Personal communication.
• Appendix for
• Prompt
• Response
• Methods / Methodology
• Evaluation of AI responses used
Mar 2023
• CoP with Hazell and Peter
April 2023
• Colleagues in other schools complaining about generated
assignments
• Detecting an AI generated Final Project Report
• TurnItIn
• Similarity
• AI Detection
• 98% Confidence Interval
• 99% Confidence Interval for third level
• Highlighting of generated text
Generated Projects - How we handled it
• Ran all student reports manually through
TurnItIn
• Students above a combined threshold were
contacted.
• Result Message posted (next slide)
• Follow up interviews
• Traditional plagiarised project – Redo
• Generated Report – Redo
• Some generation
• Update citations
• Acknowledgements
• Chapter on AI use
Hi StudentX,
Based on University policy, we must follow up
with another call, in relation to your project.
There are issues with generated content. Can we
have a call tomorrow morning to discuss further?
If you send me a DM in the morning, I will call
you back ASAP after 9.30.
Thanks,
Colm
Hi @channel,
Thank you for your presentations last week. We have completed the initial processing of the marks. We indicated that feedback would be
given today. There have been unexpected delays in releasing that feedback as intended. However, we are releasing indicative
grades imminently (rather than percentages). You will receive a follow up DM shortly.During the course of our examination of the projects, a
number of issues arose in relation to referencing, citations, plagiarism, generated content, and a combination of both. In a number of cases,
generated content was found in the reports, in the code, or in both. As a result, we have re-examined everyone’s work, using all the tools at
our disposal and a number of students have already been contacted for follow-ups to address the issues found.If you have received a Slack
DM, requesting a further call, we will need to discuss your project further before releasing your grade. If not, we don’t foresee any further
additional examination or work, on your project.
…
We would like to point out that we were very happy with the standard of the projects this year overall, and indeed the variety. One major
issue, for most students, was with using Harvard referencing and citations in final reports. Despite asking everyone on our calls last semester
if they understood this, it was generally poorly done. For future reference see https://wit-ie.libguides.com/c.php?g=629615&p=4394252Text
generated by AI tools (e.g. ChatGPT, Bing Chat, etc.) should be used as follows:
•In-text citation: (OpenAI, 2023)
•In references: OpenAI. (2023) ChatGPT-4, Response to prompt: “Outline an essay on XYZ”, Accessed: April 26, 2023.
•Appendix: the full response included in the appendix. (The text generated should NOT be in your main core text.)
We look forward to seeing you all at the next workshop on May 25th / 26th. Don’t forget we will be presenting the Red Hat Online
Computing Award for Best Project and the DataWorks Online Computing Communitarian Award at the event. If not we’ll hopefully see you
at graduation (whenever that is).Well done. For most it’s over. It’s been a pleasure. From all the team we wish you the very best in your
future software careers. Don’t be strangers – you have an open invite to all our workshops, and we look forward to you coming back sharing
your experiences with future cohorts.Regards,
Colm
Observation – All Windows Computers in SETU
May 2023
• Generating images Computing Expo ‘23
• Project Catalogue
• Large Screen
• Panel Screens
• Used
• Dalle-E
• MidJourney
• inside DISCORD
• Require ATHENTICATOR for 2fa
2023-My AI Experience - Colm Dunphy.pdf
2023-My AI Experience - Colm Dunphy.pdf
2023-My AI Experience - Colm Dunphy.pdf
2023-My AI Experience - Colm Dunphy.pdf
2023-My AI Experience - Colm Dunphy.pdf
June
• Revisiting NoleJ.io
• Supply a static content
• Document / video / audio
• Creates dynamic activities
• h5p interactive video with stops actions,
• transcript
• glossary
• quizzes
• Games
• Fill in blanks
• Drag words
• Upload H5P/SCORM package to Moodle.
• Editable
• Runway for Video
Conclusions
• We’ve been using AI generation for years (without knowing)
• Exponential growth clearly visible in the last 8 months in particular
• generated, text, video, audio, metadata
• Data privacy, ethics, regulation, legislation
• (last week in Europe)
• Better Advice needed for students (in advance of CA/Exams)
• Moving target - Policies will need updating every semester in the short term
• No longer talking about AI NOT being allowed
1 von 44

Recomendados

PyData Texas 2015 Keynote von
PyData Texas 2015 KeynotePyData Texas 2015 Keynote
PyData Texas 2015 KeynotePeter Wang
2.6K views66 Folien
Search-Driven Programming von
Search-Driven ProgrammingSearch-Driven Programming
Search-Driven ProgrammingEthan Herdrick
193 views17 Folien
Everyone wants (someone else) to do it: writing documentation for open source... von
Everyone wants (someone else) to do it: writing documentation for open source...Everyone wants (someone else) to do it: writing documentation for open source...
Everyone wants (someone else) to do it: writing documentation for open source...Jody Garnett
925 views46 Folien
Prototyping like it is 2022 von
Prototyping like it is 2022 Prototyping like it is 2022
Prototyping like it is 2022 Michael Yagudaev
236 views89 Folien
IT Systems for Knowledge Management used in Software Engineering (2010) von
IT Systems for Knowledge Management used in Software Engineering (2010)IT Systems for Knowledge Management used in Software Engineering (2010)
IT Systems for Knowledge Management used in Software Engineering (2010)Peter Kofler
1.3K views76 Folien
Untangling spring week1 von
Untangling spring week1Untangling spring week1
Untangling spring week1Derek Jacoby
447 views53 Folien

Más contenido relacionado

Similar a 2023-My AI Experience - Colm Dunphy.pdf

Introducción al Machine Learning Automático von
Introducción al Machine Learning AutomáticoIntroducción al Machine Learning Automático
Introducción al Machine Learning AutomáticoSri Ambati
1.4K views77 Folien
Oscon 2016: open source lessons from the todo group von
Oscon 2016: open source lessons from the todo groupOscon 2016: open source lessons from the todo group
Oscon 2016: open source lessons from the todo groupBen VanEvery
143 views29 Folien
Citizen Developer Tools - session at SPS New England 10/20/2018 von
Citizen Developer Tools - session at SPS New England 10/20/2018Citizen Developer Tools - session at SPS New England 10/20/2018
Citizen Developer Tools - session at SPS New England 10/20/2018Antti Koskela
310 views63 Folien
Planning and Managing Digital Library & Archive Projects von
Planning and Managing Digital Library & Archive ProjectsPlanning and Managing Digital Library & Archive Projects
Planning and Managing Digital Library & Archive Projectsac2182
2.5K views124 Folien
Open Source Lessons from the TODO Group von
Open Source Lessons from the TODO GroupOpen Source Lessons from the TODO Group
Open Source Lessons from the TODO GroupChris Aniszczyk
625 views29 Folien
Citizen Developer Tools are not just for Citizen Developers (session at Share... von
Citizen Developer Tools are not just for Citizen Developers (session at Share...Citizen Developer Tools are not just for Citizen Developers (session at Share...
Citizen Developer Tools are not just for Citizen Developers (session at Share...Antti Koskela
305 views63 Folien

Similar a 2023-My AI Experience - Colm Dunphy.pdf(20)

Introducción al Machine Learning Automático von Sri Ambati
Introducción al Machine Learning AutomáticoIntroducción al Machine Learning Automático
Introducción al Machine Learning Automático
Sri Ambati1.4K views
Oscon 2016: open source lessons from the todo group von Ben VanEvery
Oscon 2016: open source lessons from the todo groupOscon 2016: open source lessons from the todo group
Oscon 2016: open source lessons from the todo group
Ben VanEvery143 views
Citizen Developer Tools - session at SPS New England 10/20/2018 von Antti Koskela
Citizen Developer Tools - session at SPS New England 10/20/2018Citizen Developer Tools - session at SPS New England 10/20/2018
Citizen Developer Tools - session at SPS New England 10/20/2018
Antti Koskela310 views
Planning and Managing Digital Library & Archive Projects von ac2182
Planning and Managing Digital Library & Archive ProjectsPlanning and Managing Digital Library & Archive Projects
Planning and Managing Digital Library & Archive Projects
ac21822.5K views
Open Source Lessons from the TODO Group von Chris Aniszczyk
Open Source Lessons from the TODO GroupOpen Source Lessons from the TODO Group
Open Source Lessons from the TODO Group
Chris Aniszczyk625 views
Citizen Developer Tools are not just for Citizen Developers (session at Share... von Antti Koskela
Citizen Developer Tools are not just for Citizen Developers (session at Share...Citizen Developer Tools are not just for Citizen Developers (session at Share...
Citizen Developer Tools are not just for Citizen Developers (session at Share...
Antti Koskela305 views
Intro+To+ChatGPT.pdf von Sara844770
Intro+To+ChatGPT.pdfIntro+To+ChatGPT.pdf
Intro+To+ChatGPT.pdf
Sara8447703 views
AI and Python: Developing a Conversational Interface using Python von amyiris
AI and Python: Developing a Conversational Interface using PythonAI and Python: Developing a Conversational Interface using Python
AI and Python: Developing a Conversational Interface using Python
amyiris28.7K views
Big Data & Artificial Intelligence von Zavain Dar
Big Data & Artificial IntelligenceBig Data & Artificial Intelligence
Big Data & Artificial Intelligence
Zavain Dar9.2K views
How Will AI Change the Role of the Data Scientist? von Hugo Gävert
How Will AI Change the Role of the Data Scientist?How Will AI Change the Role of the Data Scientist?
How Will AI Change the Role of the Data Scientist?
Hugo Gävert1.2K views
Introduction to Go von zhubert
Introduction to GoIntroduction to Go
Introduction to Go
zhubert623 views
Cp exam sectiona von Kim Fyson
Cp exam sectionaCp exam sectiona
Cp exam sectiona
Kim Fyson429 views
OCR Media Studies A2 Section A von Kim Fyson
OCR Media Studies A2 Section AOCR Media Studies A2 Section A
OCR Media Studies A2 Section A
Kim Fyson3.6K views
Wsrest13 gilherme keynote von ruyalarcon
Wsrest13 gilherme keynoteWsrest13 gilherme keynote
Wsrest13 gilherme keynote
ruyalarcon291 views
SoundSoftware.ac.uk: Sustainable software for audio and music research (DMRN 5+) von SoundSoftware ac.uk
SoundSoftware.ac.uk: Sustainable software for audio and music research (DMRN 5+)SoundSoftware.ac.uk: Sustainable software for audio and music research (DMRN 5+)
SoundSoftware.ac.uk: Sustainable software for audio and music research (DMRN 5+)
Doug McCune - Using Open Source Flex and ActionScript Projects von Doug McCune
Doug McCune - Using Open Source Flex and ActionScript ProjectsDoug McCune - Using Open Source Flex and ActionScript Projects
Doug McCune - Using Open Source Flex and ActionScript Projects
Doug McCune972 views
Know thy logos von Vishal V
Know thy logosKnow thy logos
Know thy logos
Vishal V62 views
Hadoop at Yahoo! -- University Talks von yhadoop
Hadoop at Yahoo! -- University TalksHadoop at Yahoo! -- University Talks
Hadoop at Yahoo! -- University Talks
yhadoop2.2K views

Más de Colm Dunphy

FutureNow-ColmDunphy-DigitalSocialPresence.pdf von
FutureNow-ColmDunphy-DigitalSocialPresence.pdfFutureNow-ColmDunphy-DigitalSocialPresence.pdf
FutureNow-ColmDunphy-DigitalSocialPresence.pdfColm Dunphy
3 views38 Folien
eucen Barcelona nov 2022.pptx von
eucen Barcelona nov 2022.pptxeucen Barcelona nov 2022.pptx
eucen Barcelona nov 2022.pptxColm Dunphy
31 views4 Folien
hdipannualsurveys.pdf von
hdipannualsurveys.pdfhdipannualsurveys.pdf
hdipannualsurveys.pdfColm Dunphy
13 views1 Folie
hdipannualsurveys.pptx von
hdipannualsurveys.pptxhdipannualsurveys.pptx
hdipannualsurveys.pptxColm Dunphy
3 views1 Folie
HDipAnnualSurveys.pptx von
HDipAnnualSurveys.pptxHDipAnnualSurveys.pptx
HDipAnnualSurveys.pptxColm Dunphy
3 views1 Folie
Hdip survey2022 von
Hdip survey2022Hdip survey2022
Hdip survey2022Colm Dunphy
19 views54 Folien

Más de Colm Dunphy(20)

FutureNow-ColmDunphy-DigitalSocialPresence.pdf von Colm Dunphy
FutureNow-ColmDunphy-DigitalSocialPresence.pdfFutureNow-ColmDunphy-DigitalSocialPresence.pdf
FutureNow-ColmDunphy-DigitalSocialPresence.pdf
Colm Dunphy3 views
eucen Barcelona nov 2022.pptx von Colm Dunphy
eucen Barcelona nov 2022.pptxeucen Barcelona nov 2022.pptx
eucen Barcelona nov 2022.pptx
Colm Dunphy31 views
hdipannualsurveys.pdf von Colm Dunphy
hdipannualsurveys.pdfhdipannualsurveys.pdf
hdipannualsurveys.pdf
Colm Dunphy13 views
WIT HDip Student Survey 2000 von Colm Dunphy
WIT HDip Student Survey 2000WIT HDip Student Survey 2000
WIT HDip Student Survey 2000
Colm Dunphy11 views
TutorStack Devconf.cz.pptx von Colm Dunphy
TutorStack Devconf.cz.pptxTutorStack Devconf.cz.pptx
TutorStack Devconf.cz.pptx
Colm Dunphy15 views
TutorStack19 dept meeting von Colm Dunphy
TutorStack19 dept meetingTutorStack19 dept meeting
TutorStack19 dept meeting
Colm Dunphy62 views
H dip student survey results 2018 von Colm Dunphy
H dip student survey results 2018H dip student survey results 2018
H dip student survey results 2018
Colm Dunphy43 views
H dip student survey results 2019 von Colm Dunphy
H dip student survey results 2019H dip student survey results 2019
H dip student survey results 2019
Colm Dunphy32 views
EdTechIE 2019 - Colm Dunphy - OnlineVideo - What, Why, How? von Colm Dunphy
EdTechIE 2019 - Colm Dunphy - OnlineVideo - What, Why, How?EdTechIE 2019 - Colm Dunphy - OnlineVideo - What, Why, How?
EdTechIE 2019 - Colm Dunphy - OnlineVideo - What, Why, How?
Colm Dunphy200 views
EdTech19-ColmDunphy-DataProjector-Gasta von Colm Dunphy
EdTech19-ColmDunphy-DataProjector-GastaEdTech19-ColmDunphy-DataProjector-Gasta
EdTech19-ColmDunphy-DataProjector-Gasta
Colm Dunphy316 views
Evolution of Online Course Delivery von Colm Dunphy
Evolution of Online Course DeliveryEvolution of Online Course Delivery
Evolution of Online Course Delivery
Colm Dunphy88 views
Learning from industry. A lesson in #Slack for educators von Colm Dunphy
Learning from industry. A lesson in #Slack for educatorsLearning from industry. A lesson in #Slack for educators
Learning from industry. A lesson in #Slack for educators
Colm Dunphy82 views
Asynchronous v synchronous. Who wins? Students Decide von Colm Dunphy
Asynchronous v synchronous. Who wins? Students DecideAsynchronous v synchronous. Who wins? Students Decide
Asynchronous v synchronous. Who wins? Students Decide
Colm Dunphy53 views

Último

The Open Access Community Framework (OACF) 2023 (1).pptx von
The Open Access Community Framework (OACF) 2023 (1).pptxThe Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxJisc
107 views7 Folien
ACTIVITY BOOK key water sports.pptx von
ACTIVITY BOOK key water sports.pptxACTIVITY BOOK key water sports.pptx
ACTIVITY BOOK key water sports.pptxMar Caston Palacio
511 views4 Folien
Class 10 English notes 23-24.pptx von
Class 10 English notes 23-24.pptxClass 10 English notes 23-24.pptx
Class 10 English notes 23-24.pptxTARIQ KHAN
125 views53 Folien
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptx von
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptxCollective Bargaining and Understanding a Teacher Contract(16793704.1).pptx
Collective Bargaining and Understanding a Teacher Contract(16793704.1).pptxCenter for Integrated Training & Education
91 views57 Folien
11.30.23 Poverty and Inequality in America.pptx von
11.30.23 Poverty and Inequality in America.pptx11.30.23 Poverty and Inequality in America.pptx
11.30.23 Poverty and Inequality in America.pptxmary850239
149 views33 Folien
2022 CAPE Merit List 2023 von
2022 CAPE Merit List 2023 2022 CAPE Merit List 2023
2022 CAPE Merit List 2023 Caribbean Examinations Council
4.6K views76 Folien

Último(20)

The Open Access Community Framework (OACF) 2023 (1).pptx von Jisc
The Open Access Community Framework (OACF) 2023 (1).pptxThe Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptx
Jisc107 views
Class 10 English notes 23-24.pptx von TARIQ KHAN
Class 10 English notes 23-24.pptxClass 10 English notes 23-24.pptx
Class 10 English notes 23-24.pptx
TARIQ KHAN125 views
11.30.23 Poverty and Inequality in America.pptx von mary850239
11.30.23 Poverty and Inequality in America.pptx11.30.23 Poverty and Inequality in America.pptx
11.30.23 Poverty and Inequality in America.pptx
mary850239149 views
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively von PECB
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks EffectivelyISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
ISO/IEC 27001 and ISO/IEC 27005: Managing AI Risks Effectively
PECB 574 views
Ch. 7 Political Participation and Elections.pptx von Rommel Regala
Ch. 7 Political Participation and Elections.pptxCh. 7 Political Participation and Elections.pptx
Ch. 7 Political Participation and Elections.pptx
Rommel Regala90 views
Scope of Biochemistry.pptx von shoba shoba
Scope of Biochemistry.pptxScope of Biochemistry.pptx
Scope of Biochemistry.pptx
shoba shoba126 views
REPRESENTATION - GAUNTLET.pptx von iammrhaywood
REPRESENTATION - GAUNTLET.pptxREPRESENTATION - GAUNTLET.pptx
REPRESENTATION - GAUNTLET.pptx
iammrhaywood91 views
Are we onboard yet University of Sussex.pptx von Jisc
Are we onboard yet University of Sussex.pptxAre we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptx
Jisc93 views
7 NOVEL DRUG DELIVERY SYSTEM.pptx von Sachin Nitave
7 NOVEL DRUG DELIVERY SYSTEM.pptx7 NOVEL DRUG DELIVERY SYSTEM.pptx
7 NOVEL DRUG DELIVERY SYSTEM.pptx
Sachin Nitave59 views
Community-led Open Access Publishing webinar.pptx von Jisc
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptx
Jisc91 views
Lecture: Open Innovation von Michal Hron
Lecture: Open InnovationLecture: Open Innovation
Lecture: Open Innovation
Michal Hron99 views
Classification of crude drugs.pptx von GayatriPatra14
Classification of crude drugs.pptxClassification of crude drugs.pptx
Classification of crude drugs.pptx
GayatriPatra1483 views
JiscOAWeek_LAIR_slides_October2023.pptx von Jisc
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptx
Jisc93 views
Solar System and Galaxies.pptx von DrHafizKosar
Solar System and Galaxies.pptxSolar System and Galaxies.pptx
Solar System and Galaxies.pptx
DrHafizKosar89 views

2023-My AI Experience - Colm Dunphy.pdf

  • 1. My AI Experience Colm Dunphy - June 2023
  • 2. TIMELINE - 1 • 1990 AI Subject in College • Expert systems • Machine Learning • Neural Networks • Natural Language Processing • Languages • Lisp, Prolog • 1998 Furby • “Furbish” • Learned English commands • Talk to another (infra red) • 2010 Siri app • 2011 Integrated into iOS • DARPA • 2013 Amazon Alexa • 2019 3rd generation Alexa Dots • 2001 Polish “Ivona”
  • 3. TIMELINE - 2 • MS Word • Spelling & grammar • 1989 Word 2.0 spell check • 1993 Word 6 for windows • 1995 Word 95 • 1997 Autocorrect • 2007 Contextual spelling & grammar
  • 4. TIMELINE - 3 • Grammarly • 2009 First release • 2017 iOS & Android • 2018 Google Docs compatible
  • 5. TIMELINE - 4 • MS Powerpoint • Design Ideas • 2016 Office 365 Windows • Powerpoint Design Ideas • 2017 Office 365 Mac • Background Removal 2013
  • 6. Adobe Photoshop Fill • Context Aware • New AI Generative Fill
  • 9. CANVA – Text to Image
  • 11. WRTC/DIGITAL(DEC) Internship • Karl Sandison & Larry Stapleton • ECO – Engineering Change Order • Learn the “lexographical structure of ECOs” so that they could be automatically read/parsed and interpreted, by a computer program. • Technologies • LISP, ADA, C, VAX PARSE, RDBMS • MIT Information Lens • https://dspace.mit.edu/bitstream/handle/1721.1/2277/SWP-3082- 21174847-CISR-192.pdf?sequence=1 • VILE-MMS - 4th Year Project 1991 • - Vax Information Lens Editor & Mail Management System • Mail Filtering Rules • - Novell Groupwise Mail - 1995 before we had these features in Waterford.
  • 12. DJ & Radio – R&D Background (TSSG) • ABC PLAYOUT (1997) • Schedule music ads, automate a radio station • (RCS, Myriad, RadioMation, Genesys, mAirList) • Hash6 / Catch (2002) • Identify a song on the radio, add to your locker, buy and download • (Spotify,Shazam) • UMetaDJ (2003) • Open format for sharing data between professional DJ softwares • (RecordBuddy, RecordCloud, MIXO, iTunes) • MORP (2003) • MObile Retail Payments • (Revolut) • MUZU (2002) • online music video site • largest legal catalogue of online music videos. • FeedHenry (2002) • Global RSS feed curation • Later pivoted to SAAS Red Hat Mobile Services
  • 13. DJ & Radio - Background • MetaData / Cue Points – MANUAL EXERCISE • Vinyl (80s) • Chewing gum Labels Painters Tape • Video tape (90s) • magnetic index markers • Minidisc (90s) • insert markers • CD (90s) • stored on separate SD memory cards • Laptop (00s) / Digital Files • Separate Database • within metadata of the file
  • 14. DJ & Radio • CLUB DJ SOFTWARE • Traktor, Serato, RecordBox, VirtualDJ, MIXX, dJay Algorithm • 2020 Pioneer RecordBox 6 • subscription model • auto identifies song structure during analysis • (intro, verse, break, chorus, drop, etc.) • Supervised Gianluca Zuccarelli • Sun Life Computing Projects Innovation Award 2020-21 • "Neural Network based Song Structure Analysis". • i.e. creating and training your own model
  • 16. DJ – ACCAPELLAS / STEMS - services 2015 Native Instruments TRAKTOR STEMs Open Format •File containing 4 parts •.stem.mp4 2020 LALAL.AI 2023 AuDImix
  • 17. 2020 djay Pro AI 2021 VirtualDJ 2022 Serato FADR.com 2023 VirtualDJ (STEMS 2) Rekordbox DJ DJ – ACCAPELLAS / STEMS - RealTime
  • 18. Music • Writing a song – ChatGBT • MelodyStudio • Better context / syllables • Chord Progression / melody • Apple Logic / GarageBand • Virtual Musicians • Virtual drummer • Move away from texboxes to sliders and emotions
  • 19. Audio • Focusrite FAST AI plugins • Sound cards • SHURE MOTIV AI • Shure mv7 mic
  • 20. Adobe VoCo • Adobe Max 2016 • Photoshop for Voice • Transcribe a video • By editing the text transcript, you edit the video • 2023 Adobe Premiere Pro now has this functionality • Surprise: • By adding new words, your could make the person say those words • This is now available in resemble.ai • Concerns over ethics, copyright, data privacy – voiceprint biometrics, human image syntheses
  • 21. Resemble.ai - Al Voice Synthesis
  • 22. Resemble.ai - Al Voice Synthesis
  • 23. Text to Speech / Voice Cloning • Speechify $249 pa (best??) • Snoop Dog - please open a web page • Resemble.ai
  • 24. Waterford Tech Meetup 2018 • Deep learning techniques • to better understand the brainwaves (EEG) of newborn babies • detecting seizures in infants. PhD candidate Alison O’Shea • TensorFlow • Creating your own machine learning models
  • 25. Computer Code Generation - 1 • Computers talk in Binary Machine Language (01010101) • Chips Assembly Language (Minimal instruction set) • High Level Languages • Basic, Cobol, Pascal ,C • Python, Java, JavaScript, Node.js C++ • Interpetted v compiled • Libraries of code • can be reused • Vast Number • Versions! • NPM
  • 26. Computer Code Generation - 2 • Code Completion • IntelliJ • Visual Code • CoPilot • CoPilot VoiceAssist • GitHub • Bought by Microsoft in 2018 for $7.5 billion • 100 million developers • 92% of programmers using AI • CEO Thomas Dohmke interview • Copilot will write 80% of code “sooner than later” • Keeps developers in the editor. • Net Promoter score +81% • 46% of code is now written by CoPilot • 55% fastser
  • 28. Nov 2022 • Mobile App Dev assignment • Slack Post appeared re writing a spec for • AI Generation came to the fore • Replied ok to use AI tools once acknowledged. However own words need to be own words. • FINAL Project: • Highlighted AI Detection (open source projects on GitHub) • STUDENTS BEWARE • Acknowledge • Cite • Policies • Code of Conduct (dis) honest • Plagiarism
  • 29. Dec 2022 • Started reading around generative AI Tools • Subscribing to Facebook groups • Email Subscription • TLDR AI • Getting Informed for next semester • Key Considerations 1. If ChatGBT can generate the solution to your assignment… • Are you asking students to do the right assignment? • Are you teaching the right thing? 2. Embrace AI versus trying to prevent it’s use • (akin to pretending there is no internet and students don’t have mobile phones/data)
  • 30. Jan 2003 • New Cohort of students starting Programming • Q: Can ChatGPT generate the programming language being taught (Processing)? • A: Web says NO. However by trying it out myself I discovered partial YES • Q: What do I need to change in Assigment 1 • A: No more than normal (change the theme and some constraints) • Why? • We don’t mark the code, we mark the reflection • The reflection is tied to the marking rubric, which in turn is tied to the code • WE ARE MAKING THE LEARNING NOT THE ARTIFACT
  • 31. Feb 2023 • Following more education based AI Groups • Differences of opinion about citing • Personal communication. • Appendix for • Prompt • Response • Methods / Methodology • Evaluation of AI responses used
  • 32. Mar 2023 • CoP with Hazell and Peter
  • 33. April 2023 • Colleagues in other schools complaining about generated assignments • Detecting an AI generated Final Project Report • TurnItIn • Similarity • AI Detection • 98% Confidence Interval • 99% Confidence Interval for third level • Highlighting of generated text
  • 34. Generated Projects - How we handled it • Ran all student reports manually through TurnItIn • Students above a combined threshold were contacted. • Result Message posted (next slide) • Follow up interviews • Traditional plagiarised project – Redo • Generated Report – Redo • Some generation • Update citations • Acknowledgements • Chapter on AI use Hi StudentX, Based on University policy, we must follow up with another call, in relation to your project. There are issues with generated content. Can we have a call tomorrow morning to discuss further? If you send me a DM in the morning, I will call you back ASAP after 9.30. Thanks, Colm
  • 35. Hi @channel, Thank you for your presentations last week. We have completed the initial processing of the marks. We indicated that feedback would be given today. There have been unexpected delays in releasing that feedback as intended. However, we are releasing indicative grades imminently (rather than percentages). You will receive a follow up DM shortly.During the course of our examination of the projects, a number of issues arose in relation to referencing, citations, plagiarism, generated content, and a combination of both. In a number of cases, generated content was found in the reports, in the code, or in both. As a result, we have re-examined everyone’s work, using all the tools at our disposal and a number of students have already been contacted for follow-ups to address the issues found.If you have received a Slack DM, requesting a further call, we will need to discuss your project further before releasing your grade. If not, we don’t foresee any further additional examination or work, on your project. … We would like to point out that we were very happy with the standard of the projects this year overall, and indeed the variety. One major issue, for most students, was with using Harvard referencing and citations in final reports. Despite asking everyone on our calls last semester if they understood this, it was generally poorly done. For future reference see https://wit-ie.libguides.com/c.php?g=629615&p=4394252Text generated by AI tools (e.g. ChatGPT, Bing Chat, etc.) should be used as follows: •In-text citation: (OpenAI, 2023) •In references: OpenAI. (2023) ChatGPT-4, Response to prompt: “Outline an essay on XYZ”, Accessed: April 26, 2023. •Appendix: the full response included in the appendix. (The text generated should NOT be in your main core text.) We look forward to seeing you all at the next workshop on May 25th / 26th. Don’t forget we will be presenting the Red Hat Online Computing Award for Best Project and the DataWorks Online Computing Communitarian Award at the event. If not we’ll hopefully see you at graduation (whenever that is).Well done. For most it’s over. It’s been a pleasure. From all the team we wish you the very best in your future software careers. Don’t be strangers – you have an open invite to all our workshops, and we look forward to you coming back sharing your experiences with future cohorts.Regards, Colm
  • 36. Observation – All Windows Computers in SETU
  • 37. May 2023 • Generating images Computing Expo ‘23 • Project Catalogue • Large Screen • Panel Screens • Used • Dalle-E • MidJourney • inside DISCORD • Require ATHENTICATOR for 2fa
  • 43. June • Revisiting NoleJ.io • Supply a static content • Document / video / audio • Creates dynamic activities • h5p interactive video with stops actions, • transcript • glossary • quizzes • Games • Fill in blanks • Drag words • Upload H5P/SCORM package to Moodle. • Editable • Runway for Video
  • 44. Conclusions • We’ve been using AI generation for years (without knowing) • Exponential growth clearly visible in the last 8 months in particular • generated, text, video, audio, metadata • Data privacy, ethics, regulation, legislation • (last week in Europe) • Better Advice needed for students (in advance of CA/Exams) • Moving target - Policies will need updating every semester in the short term • No longer talking about AI NOT being allowed