Lazy User -- HOWEST, CTAI
by Oleksandr Olkov in Living > Homesteading
14 Views, 0 Favorites, 0 Comments
Lazy User -- HOWEST, CTAI
Lasy user is about controlling your laptop from far away. As a demo it only allows you to control YouTube through hotkeys. With this demo you will be able to cook and control cooking video to complet every step without touching screen.
Supplies
Raspberry Pi5, RGB led, 4 female to female cabels, Webcam
Wood multiplex 4mm
Laptop and network cabel
Collecting Dataset
1: Finding all hand gestures that will suit functions
2: Taking as much photos of this gestures as possible
3: Place keypoints using MediaPipe
4: Convert annotations to coco.json
5: Correct labels
6: Balancing data by adding photos, putting keypoints manually
7: Add augmentations
8: Download dataset
Training Model
1: Train YOLOv11n-pose model for 30 epochs
2: Check confusion matrix
3: Apply hyperparameters
4: Retrain model with 50 epochs
Downloads
Controller and Processor
1: Create different varieties of test models (live, single photo, folder)
2: Create MediaController class using the keyboard library and a test file
3: Update the photo test file to process model results and connect with MediaController
4: Split processing code between the class and the test file
Downloads
Flask Server
1: Establish basic communication between Raspberry Pi and laptop via the socket library for test
2: Create HTML files
3: Learn Flask to run a Pi server on the Raspberry Pi, and create it
4: Creating an app.py in Raspi to run application
5: Creating a class communication in llaptop to contact and recieve all necessary data
Box
1: Measuring Raspi
2: Planning box with extra size to fit cabels
3: Creating holes and connections between walls
4: Using laser cut to get wood parts of box
5: Polishing edges and holes
6: Fitting raspi, rgb led and cabels