NYU ITP, Spring 2015
####"And the question is when is the last time that you had a great conversation, a conversation which wasn’t just two intersecting monologues, which is what passes for conversation a lot in this culture. But when had you last a great conversation, in which you overheard yourself saying things that you never knew you knew. That you heard yourself receiving from somebody words that absolutely found places within you that you thought you had lost and a sense of an event of a conversation that brought the two of you on to a different plane. …a conversation that continued to sing in your mind for weeks afterwards?" - John O’Donohue
#Description
Technology is becoming a part of every conversation we have. What influence does it have, and how might it be further leveraged to create new possibilities? This class explores various ways conversation may be analyzed, generated, and affected by computation. Specifically, we will study methods of linguistic analysis (LIWC, LSM, sentiment analysis) and body language analysis (face tracking, expression detection, Kinect). We will experiment with conversation automation (markov chains, chatbots, email scripting, social media APIs), and building software apps (Google Hangout apps, browser extensions, Skype API, Twilio API, webRTC) and physical devices (Arduino, RPi) for augmenting and affecting conversation. Finally, we will look at more public interventions, involving performance and text displays. The class will be based around three month-long projects, complemented by readings and shorter research exercises. This will be further contextualized by conversation analysis ideas from sociology and psychology, performance studies, other artists working with these themes.
#Evaluation Grades will be determined according to the following breakdown:
- Project 1 20%
- Project 2 20%
- Project 3 20%
- Conversation log 15%
- Participation and attendance 25%
Please see ITP's statement on Pass/Fail which states that a "Pass" is equivalent to an "A" or a "B" while anything less would be considered a "Fail".
###Projects This class is divided into three "parts" or general areas of inquiry. We will have three 3-4 week projects over the course of the semester, one for each part. You are expected to push your abilities both technically and conceptually to make original, thoughtful work. There will be check-ins during the duration of each project to discuss and review progress.
###Conversation log As this class is about conversation, we will regularly engage in and push ourselves in conversation. So we are not just working theoretically. Each person will keep a "conversation log". As a class, we will generate prompts for conversations. Each week, we will choose one prompt as a class and you will have a conversation that you reflect on and respond to in a post in the conversation log.
###Participation Attendance is mandatory. Please inform me via email if you are going to miss a class. Habitually showing up late for class or an excessive number of absences will adversely affect your grade.
This class will be participatory, you are expected to participate in discussions and give feedback to other students both in class and participate with their projects. There will also be occasional assigned readings.
#Syllabus
####Week 1 (1/28): Introduction
-
History of compuation and conversation
- Christopher Strachey's 1952 love letter generator, more, and more in Rhizome's Queer History of Computing
-
Metaphors We Live By, George Lakoff
-
Speaking Code, Geoff Cox and Alex McLean
-
Slackers film, Richard Linklater - description
-
Tools
- programmableweb.com - giant list of APIs and resources
- kimonolabs.com - easy tool for turning any website into an API
- temboo.com - simple APIs for many services in many languages
- IFTTT
- https://github.com/cido/ifttt-channel-extensions - create custom IFTTT channels
- Snapchat - Unofficial Python API
- Yo
- NYTimes
- Twilio lets you work with phones
-
Assignment 1 (DUE 2/4)
##Part 1: Language analysis and automation
####Week 2 (2/4): Linguistic analysis
- John Rothenberg (Sosolimited) guest lecture
- Sentiment analysis
- LIWC / LSM
- Social media APIs
- Conversation analysis, tutorial
- Tutorials
- Tools
-
LIWC available for javascript and python
-
corpora is a collection of words and phrases by category.
-
- Survey
####Week 3 (2/11): Generation and automation
####Week 4 (2/18): Generation and automation (cont)
- Darius Kazemi guest lecture
####Week 5 (2/25): Visualization and display
- Conversation / language viz
- Public text displays
- Survey
##Part 2: Physical augmentation and alternatives
####Week 6 (3/4): Augmentation apps
- Google Hangout apps
- Browser extensions
- Skype, Twilio, webRTC
- Survey
- Speaking Exchange
- Talk Therapy, Chris Reilly
####Week 7 (3/11): Physical analysis
- Body language
- Face tracking
- Expression detection
- Technical:
- Computer Vision for Artists and Designers by Golan Levin
- Face Tracking Notes for Appropriating New Technologies / Face as Interface workshop
- Eye Tracking Notes for Appropriating New Technologies
- Computer Vision in Interactive Art, Kyle McDonald
- Computer Vision: Algorithms and Applications by Richard Szeliski
- OpenCV-Processing book in progress by Greg Borenstein includes a great ontology of computer vision. He's also responsible for [Making Things See] (https://github.com/atduskgreg/Making-Things-See-Examples) which focuses on Kinect.
- Survel
- Expression Dispatcher, Gerard Rallo
- http://www.inmilee.net/untitled.html
####Week 8 (3/25): Physical augmentation and alternatives
- Devices / objects
- How are We Going to Talk After This?, Chris Reilly
- Linguaphone of Tremulous Communion, Chris Reilly
- Lucy + Jorge Orta
- Physical feedback
- Sign language
- Braille
- The Conservatism of Emoji, Kate Crawford and Luke Stark
- Physical correspondence, mail art
- [MoMA Mail Art exhibit](http://www.moma.org /interactives/exhibitions/2014/analognetwork/)
- On Kawara
##Part 3: Public and performance
####Week 9 (4/1): Performing conversation
-
Erving Goffman, Harold Garfinkel
-
Scripts, cues, prompts, improv
-
http://hyperallergic.com/94735/how-writing-is-like-performance/
-
http://www.stefanieposavec.co.uk/data/#/facebook-art-residency-relationship-dance-steps/
- Learning to Love You More
- http://www.mandiberg.com/the-essential-guide-to-performing-michael-mandiberg/ ####Week 10 (4/8): Public conversation
-
Anonymity
- Why Facebook and Google's Concept of Real Names is Revolutionary, The Atlantic
- “Real Names” Policies Are an Abuse of Power, danah boyd
- The Facebook Bully, Joanne McNeil
-
Public Text Displays
-
http://act.mit.edu/people/lecturers/matthew-mazzotta/ ####Week 11 (4/15): Protest
####Week 12 (4/22): Final project presentations