See also: Creative Coding Notes list
Some hardware needs special device drivers
- There's not a simple messaging scheme (like Serial communication) that you can replicate without major reverse-engineering. for example:
- Kinect / Realsense
- Leap Motion
Some hardware uses electrical signals and basic data transmission
- Arduino / Raspberry Pi sensors & output devices
- Keyboard/mouse HID
- Webcams - "UVC" means that a camera of video device can be seen as a webcam by your operating system
- MIDI
- Network protocols
- Serial I/O - This is how we talk to custom sensors via Arduino (or other PCB boards)
- Example: Epic React: Instant Go treadmill
- Example: 30 Years of Air - sensor & motors
- Wireless protocols
- Lighting protocols
- Shared textures between apps
- Video streaming
You can use these protocols to create larger integrated systems!
- @ Wikipedia
- p5js CV examples
- https://github.com/kylemcdonald/cv-examples (need to change p5js version number)
- Processing OpenCV library - older classic CV algorithms
- Basic, custom CV
- Interesting cameras:
- Depth (Kinect / Realsense)
- High framerate
- Thermal
- Infrared (night vision)
- Mirrored webcam - (how to flip/mirror your webcam!)
- MediaPipe multi-mode tracker - original
- ml5 examples
- Teachable Machine (code is downloadable)
- Frame differencing example
Listen to an episode from either podcast:
- Tech+Art Podcast
- That's So New Media!?
Build something with a webcam or other hardware
- p5js resources
- Processing
- Arduino
- p5js: use the Web Serial API with Justin's example sketch (Chrome only)
- Show example video
- Processing: use the
Seriallibrary
- p5js: use the Web Serial API with Justin's example sketch (Chrome only)
- MIDI (Chrome only)
- Present your 3d sketches