Lazy User -- HOWEST, CTAI

by Oleksandr Olkov in Living > Homesteading

14 Views, 0 Favorites, 0 Comments

Lazy User -- HOWEST, CTAI

Lazy_user_poster.png

Lasy user is about controlling your laptop from far away. As a demo it only allows you to control YouTube through hotkeys. With this demo you will be able to cook and control cooking video to complet every step without touching screen.

Supplies

Raspberry Pi5, RGB led, 4 female to female cabels, Webcam

Wood multiplex 4mm

Laptop and network cabel

Collecting Dataset

Screenshot 2025-06-19 213549.png

1: Finding all hand gestures that will suit functions

2: Taking as much photos of this gestures as possible

3: Place keypoints using MediaPipe

4: Convert annotations to coco.json

5: Correct labels

6: Balancing data by adding photos, putting keypoints manually

7: Add augmentations

8: Download dataset

Training Model

1: Train YOLOv11n-pose model for 30 epochs

2: Check confusion matrix

3: Apply hyperparameters

4: Retrain model with 50 epochs

Downloads

Controller and Processor

Screenshot 2025-06-19 213822.png

1: Create different varieties of test models (live, single photo, folder)

2: Create MediaController class using the keyboard library and a test file

3: Update the photo test file to process model results and connect with MediaController

4: Split processing code between the class and the test file

Downloads

Flask Server

Screenshot 2025-06-19 214129.png

1: Establish basic communication between Raspberry Pi and laptop via the socket library for test

2: Create HTML files

3: Learn Flask to run a Pi server on the Raspberry Pi, and create it

4: Creating an app.py in Raspi to run application

5: Creating a class communication in llaptop to contact and recieve all necessary data

Box

20250619_215613.jpg

1: Measuring Raspi

2: Planning box with extra size to fit cabels

3: Creating holes and connections between walls

4: Using laser cut to get wood parts of box

5: Polishing edges and holes

6: Fitting raspi, rgb led and cabels