New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Workshop: Hello Input HEAJ #28

Open

EloiStree opened this issue Oct 15, 2024 · 11 comments

Owner

EloiStree commented Oct 15, 2024 •

edited

Loading

"Ce sont des étudiants en option Game Design. Ils ont des bases sur Unreal et Unity.
L'objectif de ce workshop est de faire imaginer aux étudiants de Game Design des périphériques et des expériences de jeu créatives, hors des sentiers battus : un véritable laboratoire expérimental.
Il s’agit de créer des périphériques ludiques, comme une voiture télécommandée avec son circuit, de la réalité augmentée, etc.
L’idéal serait qu'ils produisent un livrable à la fin du workshop."

Proposition de cours

Version du 06/11/2024

Lundi 18 19 20 /11 de 8h40 à 15h40 :

Création des inputs
Simulation des inputs
Transmission en réseau

Mardi 26/11 de 8h40 à 15h40 :

L'atelier sera validé après avoir rencontré les apprenants.

Mardi 03/12 de 8h40 à 17h40 :

Inputs virtuels avec le Quest

Note de construction

https://youtu.be/mPTCq3LiZSE

Workshop is going to turn around integer, why ?

Topic: Why the IID ? #107

For the HEAJ, I am constructing a workshop to learn about how to use Input in for video game.

What are the words to learn:

HID: Keyword: HID #5
vJoy: Keyword: vJoy #6
MIDI: Keyword: MIDI #7
BLE MIDI: Keyword: BLE MIDI #8
Infrared: Keyword: Infrared Standard #9
UART: Keyword: UART #10
XInput: Keyword: XInput #11
- VigEM Keyword: ViGEm Bus Driver #239
PostMessage: Keyword: PostMessage #14

Audio

Spectrogram: Keyword: Spectrogram #13
Value Intensity: Keyword: Volume Intensity #29
AudioMixer: Keyword: Audio Mixer #15

Webcam:

Webcam Color: Keyword: Webcam Texture #30
Webcam Microphone : Hardware: Webcam microphone #22
Vuforia Keyword: Vuforia #31
- AR Core Keyword: AR Core #32
- Image Target Keyword: AR Image Target #33

XR specific

OpenXR: Keyword: OpenXR #12

Brain:

BCI: Keyword: BCI #17

Muscle:

Read muscule EMG Capteur: Keyword: EMG muscle captor #34

Kinect:

Kinect Body:
Kinect Depth:

Open CV:

Open CV in Unity3D
Open CV in Python

Unstore:

Radio Control FM: Arduino Antenna
Channel FM: FlySky Keyword: FlySky Channel #69
Channel FM: WheelCar
4G to Android Bluetooth RC
Unity3D: Bluetooth Package.

Hack existing:

Inside submarine RC
Inside Stear Car RC
Inside Double Stick RC
Inside Xbox RC

Injection:

Inject in Xbox with adapter
Inject in Xbox with Xbox App
Inject in app using Window fake keystoke
Inject in computer using Arduino
Inject in computer using Raspberry Pi Pico
Inject in app using SendMessage
Inject in app with mouse input
Inject Android with Scrcopy
Inject Android with USB Keyboard
Inject Android with ADB
Inject Android with BLE Keyboard and Gamepad
Inject in Unity3D DLL

Hardware:

XIAO RP2040: Keyword: Seeed Studio XIAO RP2040 #27
Arduino Keyword: Arduino #35
- Arduino Uno Keyword: Arduino Uno #37
- Arduino Leonardo Keyword: Arduino Leonardo #38
- Adruino Micro Keyword: Arduino Micro #39
- Arduino Mega Keyword: Arduino Mega #40
MicroPython Keyword: MicroPython #36
- Raspbery Pi Keyword: Raspberry Pi #42
- Raspbery Pi Pico Keyword: Rasperry Pi Pico #41
- XIAO RP2040: Keyword: Seeed Studio XIAO RP2040 #27
Micro Bit: Hardware: Micro:bit #21
Makey Makey: Hardware: Makey Makey #20

Electronic:

Resistor Keyword: Resistor #46
Light Sensor Keyword: Light Sensor #43
Hall Effect Keyword: Hall Effect Sensor #44
Button Keyword: Hardware Button #61
Infrared Receiver Keyword: Infrared Sensor #45
Touch Sensor Keyword: Touch Sensor #54
Potentiometer Resistor Keyword: Potentiometer #59
Digital Potentiometer Resistor Keyword: Control Digital Potentiometer #60
Pression Sensor Keyword: Pression Sensor #64
Learn
- Terminal Keyword: Terminal Block #66
- Board Keyword: Breadboard #67
Motor Driver Keyword: Step Motors #57
Step Motor Driver Keyword: Step motor driver #58
Sensors Kit Keyword: Sensor Kit #51
- Temperature Sensor Keyword: Temperature Sensor #53
Crocodile Clip Keyword: Crocodile Clip #52
Relay Solide State Keyword: Relay Solid state #55
Relay Classic Keyword: Relay Module #56
Piezo Sensor Keyword: Piezo Sensor #68
Capacitive Sensor Keyword: Capacitive Sensor #65
Servo Motor: Keyword: Servo Motor #70

Read about:

MicroPython: https://micropython.org
Aduino: https://www.arduino.cc

Unstore:

Barcode QR reader Keyword: Barcode and QR reader #50
NFC Tag Reader Keyword: NFC Tag Reader #49
NFC Tag Keyword: NFC Tag and RFID Reader #48

Under construction:

MicroBit to Midi
- Topic: Use MicroBit as a Midi Device ? #88

EloiStree pinned this issue

Owner Author

EloiStree commented Oct 15, 2024

IID To Actions

Turn Index Integer to actions:
- https://github.com/EloiStree/2024_05_14_IntegerIndexDateToRemoteControl.git

Owner Author

EloiStree commented Oct 31, 2024 •

edited

Loading

Found in Archive

Server to UDP
- Skill: Create Socket and UDP server that redirect to target application message (Javascript Python) #76

Owner Author

EloiStree commented Oct 31, 2024 •

edited

Loading

Must know

What is a manual IPV4 ?
- Keyword: IP Manual and Automatic #77
- Topic: Usable Network for Input Hijacking #226

Must Try Elixir (Android)

Observer all sensor your phone can provide
- https://play.google.com/store/apps/details?id=com.bartat.android.elixir&hl=en
- Software: Elixir 2 #86

Owner Author

EloiStree commented Nov 1, 2024 •

edited

Loading

Video created for workshop

MicroBit > COM3 >UDP > Unity
- Post-Mortem: Hello World sur MicroBit ( UART, Little Endian et UDP ) HelloEloiTeachingVideo#91

Video perferct from the web for the workshop

Initation à l'Arduino: Master class: Arduino 101- Crash Course w/ Mark Rober #219

Owner Author

EloiStree commented Nov 6, 2024 •

edited

Loading

Reminder:

Talk about:
- the Roger project
- Wow remapping (here)
- AI injection and Input wrote
- Safe firework (here)
- Open Macro Input
Javascript to local websocket relay
- Gamepad to Websocket Topic: Gamepad from javascript page to local websocket server #216
- Java to Websocket Topic: Javascript to websockets #217

Owner Author

EloiStree commented Nov 6, 2024

If you can create a device HID, Xinput or else. Don't forget that you can hack cheap device that did it:

Topic: Create BLE gamepad by hacking cheap one #163

Owner Author

EloiStree commented Nov 6, 2024 •

edited

Loading

UART / SerialPort Only: Arduino Uno et Nano
USB input injection: - Arduino Micro
Keyboard + MIDI + Media: Pico
XInput USB: - XArduino Micro

Package: 2024_05_09_GamepadXboxInputUnity #215
BLE gamepad or keyboard : - Feather and ESP32

MIDI: - Arduino Micro or Pico(CircuitPython)

Topic: Turn a keyboard to MIDI or HID keyboard ? #25
Arcade USB: gp2040-CE
Hardware: gp2040 #280
Joystick Simulation: Arduino Leonardo
Hardware: Simulate Joystick from Arduino Leonardo #279
No code: Generic USB Arcade
Hardware: USB Generic Arcade Joystick #102
Lot's of Input as UART: Arduino Mega
Keyword: Arduino Mega #40

Owner Author

EloiStree commented Nov 10, 2024 •

edited

Loading

Command:

Command: joy.cpl #241

https://www.x360ce.com

Software: x360ce #247

Owner Author

EloiStree commented Nov 11, 2024 •

edited

Loading

Micro Controller to integer on UDP

Voir ici #245

Owner Author

EloiStree commented Nov 11, 2024 •

edited

Loading

Python you need to know for input injection

pip install pywin32

pip3 install pyautogui

import ctypes
pip install mido
pip install keyboard https://pypi.org/project/keyboard/
import pyxinput https://github.com/bayangan1991/PYXInput?tab=readme-ov-file

Owner Author

EloiStree commented Nov 12, 2024

Connector:

Audio jack small
Audio Jack MIDI
Terminal d'électriciens
Flat Connector and SJT PH
...

EloiStree mentioned this issue

ToDoToday: Début de l'atelier #289

Open

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment