Skip to content

Commit

Permalink
lots of new osc tools
Browse files Browse the repository at this point in the history
  • Loading branch information
golanlevin committed Oct 6, 2022
1 parent a99654b commit eec53c1
Show file tree
Hide file tree
Showing 22 changed files with 81 additions and 45 deletions.
Binary file added code/gesture_tools/FaceOSC-v1.2-osx.zip
Binary file not shown.
Binary file removed code/gesture_tools/FaceOSC.zip
Binary file not shown.
Binary file added code/gesture_tools/FaceOSC_ProcessingReceiver.zip
Binary file not shown.
Binary file added code/gesture_tools/HandsFreeOSC.zip
Binary file not shown.
Binary file added code/gesture_tools/HolonistMovesenseOSC.zip
Binary file not shown.
69 changes: 24 additions & 45 deletions code/gesture_tools/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,12 @@ This document lists some powerful, low-budget, resources for capturing gestural
### Contents:

**OSC Tools**
* [VisionOSC](#VisionOSC)
* [touchOSC](#touchOSC)
* [gyrOSC](#gyrOSC)
* [FaceOSC](#FaceOSC)
* [blinkOSC](#blinkOSC)
* [EyeOSC](#EyeOSC)
* [sendMultiTouches](#sendMultiTouches)
* [PoseOSC](#PoseOSC)
* [TrackpadOSC](TrackpadOSC)
* [HandsFreeOSC](HandsFreeOSC)

**Non-OSC Tools**
* [PoseNet in the Browser](#PoseNet-in-the-Browser)
Expand All @@ -25,6 +24,16 @@ This document lists some powerful, low-budget, resources for capturing gestural
* [Diagnostic Tools](#Diagnostic-Tools)


---

### VisionOSC

Lingdong Huang has published [VisionOSC](https://github.com/LingDong-/VisionOSC), which includes PoseOSC + FaceOSC + HandOSC + OcrOSC + CatOSC + DogOSC. This sends (almost) all Apple Vision Framework's detection results via OSC. macOS 11+ only. Bundle includes app and Processing receiver.

[Download VisionOSC.zip](VisionOSC.zip)

![VisionOSC](images/vision-osc.png)

---

### touchOSC
Expand All @@ -38,7 +47,6 @@ This document lists some powerful, low-budget, resources for capturing gestural

![touchosc-20.png](images/touchosc-20.png)


---

### gyrOSC
Expand All @@ -51,18 +59,17 @@ This document lists some powerful, low-budget, resources for capturing gestural

![gyrOSC.png](images/gyrOSC.png)


---

### FaceOSC

[FaceOSC](https://github.com/kylemcdonald/ofxFaceTracker/) is an application by Kyle McDonald that transmits face landmark geometries over OSC. There are a wide variety of clients (Processing, openFrameworks, etc.) which can receive this data for further artistic play. Created 2012-2016 by Kyle McDonald in openFrameworks v0.98. Known to work with Mac OSX 10.13.6, includes Processing v3 demo. Windows FaceOSC is [also available](https://github.com/kylemcdonald/ofxFaceTracker/releases).
[FaceOSC](https://github.com/kylemcdonald/ofxFaceTracker/) is an older application by Kyle McDonald that transmits face landmark geometries over OSC. There are a wide variety of clients (Processing, openFrameworks, etc.) which can receive this data for further artistic play. Created 2012-2016 by Kyle McDonald in openFrameworks v0.98. Known to work with Mac OSX 10.15, includes Processing v3 demo. Windows FaceOSC is [also available](https://github.com/kylemcdonald/ofxFaceTracker/releases).

You will need:

* [FaceOSC.zip](FaceOSC.zip) (local copy), or from [Kyle's repository](https://github.com/kylemcdonald/ofxFaceTracker/releases)
* [FaceOSC.zip](FaceOSC-v1.2-osx.zip) (local copy), or from [Kyle's repository](https://github.com/kylemcdonald/ofxFaceTracker/releases)
* [OSCp5 library](http://www.sojamo.de/libraries/oscP5/) (enables Processing to receive OSC); install with the inbuilt installer
* [FaceOSC Receiver Templates](https://github.com/CreativeInquiry/FaceOSC-Templates)
* [FaceOSC Receiver Templates](https://github.com/CreativeInquiry/FaceOSC-Templates), [FaceOSC_ProcessingReceiver.zip](FaceOSC_ProcessingReceiver.zip)

![faceOSC_processing.png](images/faceOSC_processing.png)

Expand All @@ -75,54 +82,26 @@ Of related interest, are face-trackers that work with JavaScript in the browser:
* [p5.js + BRFv4 (via handsfree.js) at Editor.p5js.org](https://editor.p5js.org/golan/sketches/AeEppZ4XR) or [here](https://editor.p5js.org/sovid/sketches/bmTRGd3b5)
* [Face Landmarks at RunwayML.com](https://runwayml.com/).

![clm.png](images/clm.png)
![clm.png](images/clm.png)

---

### blinkOSC

Sends blink signals when sufficient motion is detected around the subject's eyes. Created by Kyle McDonald in openFrameworks v0.98 in 2016, as a branch of his ofxFaceTracker. Known to work with Mac OSX 10.13.6, includes Processing v3 demo.

* Download [blinkOSC.zip](blinkOSC.zip)

![blinkOSC.png](images/blinkOSC.png)
---

### EyeOSC
### TrackpadOSC

Gaze estimation application by Kyle McDonald (2012) that sends data over OSC, developed in collaboration with Yusuke Sugano. Known to work with Mac OSX 10.13.6, includes Processing v3 demo.
Lingdong Huang provides [TrackpadOSC](https://github.com/LingDong-/TrackpadOSC), which provides data about finger movements on the Mac trackpad. Bundle includes app and Processing receiver. [Download TrackpadOSC.zip](TrackpadOSC.zip)

* Download [EyeOSC.zip](EyeOSC.zip)
* [Original repository](https://github.com/kylemcdonald/AppropriatingNewTechnologies/downloads)
![TrackpadOSC](images/trackpad-osc.png)

![eyeOSC.png](images/eyeOSC.png)

---

### sendMultiTouches

This is a small bit of code that will allow you to send multitouch data
from a MacBook trackpad via OSC, by Duncan Boehle (2012).

![sendmultitouches.png](images/sendmultitouches.png)

* Download [sendMultiTouches.zip](sendMultiTouches.zip) for OSX
* [Original repository](https://github.com/dboehle/SendMultiTouches)

---

### PoseOSC
---

By Lingdong Huang (2019), developed in Node.js. Transmits pose data computed with OpenPose over OSC. For a Processing demo, use with [PoseOSCProcessingReceiverXML.pde](PoseOSCProcessingReceiverXML/PoseOSCProcessingReceiverXML.pde).
### HandsFreeOSC

* [Download PoseOSC](https://github.com/LingDong-/PoseOSC/releases)
* [Main repository](https://github.com/LingDong-/PoseOSC)
Processing receiver for "[Hands-free OSC](https://apps.apple.com/us/app/hands-free-osc-control-music-with-gestures/id1135788686)" iOS app by [James Hudson](http://www.disconnectionist.com/): [Download](HandsFreeOSC.zip)

![poseOSC.png](images/poseOSC.png)

---


# Non-OSC Tools


### PoseNet in the Browser
Expand Down
Binary file added code/gesture_tools/TrackpadOSC.zip
Binary file not shown.
Binary file added code/gesture_tools/VisionOSC.zip
Binary file not shown.
Binary file modified code/gesture_tools/gyrOSC.zip
Binary file not shown.
Binary file added code/gesture_tools/images/trackpad-osc.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added code/gesture_tools/images/vision-osc.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
File renamed without changes.
57 changes: 57 additions & 0 deletions code/gesture_tools/obsolete/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
# Some Gesture Capture Tools

---

### blinkOSC

Sends blink signals when sufficient motion is detected around the subject's eyes. Created by Kyle McDonald in openFrameworks v0.98 in 2016, as a branch of his ofxFaceTracker. Known to work with Mac OSX 10.13.6, includes Processing v3 demo.

* Download [blinkOSC.zip](blinkOSC.zip)

![blinkOSC.png](images/blinkOSC.png)
---

### EyeOSC

Gaze estimation application by Kyle McDonald (2012) that sends data over OSC, developed in collaboration with Yusuke Sugano. Known to work with Mac OSX 10.13.6, includes Processing v3 demo.

* Download [EyeOSC.zip](EyeOSC.zip)
* [Original repository](https://github.com/kylemcdonald/AppropriatingNewTechnologies/downloads)

![eyeOSC.png](images/eyeOSC.png)

---

### sendMultiTouches

This is a small bit of code that will allow you to send multitouch data
from a MacBook trackpad via OSC, by Duncan Boehle (2012).

![sendmultitouches.png](images/sendmultitouches.png)

* Download [sendMultiTouches.zip](sendMultiTouches.zip) for OSX
* [Original repository](https://github.com/dboehle/SendMultiTouches)

---

### PoseOSC

By Lingdong Huang (2019), developed in Node.js. Transmits pose data computed with OpenPose over OSC. For a Processing demo, use with [PoseOSCProcessingReceiverXML.pde](PoseOSCProcessingReceiverXML/PoseOSCProcessingReceiverXML.pde).

* [Download PoseOSC](https://github.com/LingDong-/PoseOSC/releases)
* [Main repository](https://github.com/LingDong-/PoseOSC)

![poseOSC.png](images/poseOSC.png)

---

### OpenTSPS

* [v.1.3.7 (2014) at tsps.cc](http://www.tsps.cc/download)
* [v.1.3.8 (2016) at SourceForge](https://sourceforge.net/projects/tsps/files/)
* [Examples for v.1.3.8](TSPS_examples_1.3.8.zip)
* [Examples/integrations at Github](https://github.com/labatrockwell/openTSPS)

![tsps.png](images/tsps.png)

---
Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes
File renamed without changes.

0 comments on commit eec53c1

Please sign in to comment.