Home
The goal of the project is to establish a platform for playing video games on a volumetric monitor. The games will be played using a developed mobile web application, featuring a joystick emulation where controllers will be connected to the platform via a WiFi network. Additionally, gesture-based controls will be developed, allowing users to control the game through gestures and poses using sensors and machine learning. The platform will be built as an application for the Raspbian OS, with a retro 80s-inspired design. Targeting students and visitors of the university where the console will be located, the system consists of a computer (Raspbian OS), volumetric monitor, sensors, and the user's mobile device as hardware components. The software components include the platform for game selection and execution, a website featuring the joystick interface for gameplay, and the actual games installed on the system.
Project Objectives:
- Development of a platform for running and playing games on a volumetric monitor.
- Development of a website for controlling games via a mobile device.
- Development of a gesture control system for game interaction.
Expected Outputs:
- Platform for running and playing games on a volumetric monitor, compatible with Raspbian OS and designed in a retro style (80s).
- Website that launches when a mobile phone connects to the WiFi hotspot and simulates a joystick for game control.
- System using a camera to recognize the player standing in front of it, enabling game control through gestures and/or poses.
- Documentation explaining the platform implementation using UML diagrams.
Acceptance Criteria:
- The platform is designed in a retro 80s style.
- The platform is activated when a person stands in front of it using camera vision.
- When connecting a mobile device to the platform's WiFi network, the mobile device automatically opens the web page with the controller.
- Each selected game starts within 30 seconds, and there is no need to adjust additional settings within the game itself, such as resolution or controls.
| Name | Role |
|---|---|
| Matija Dokmanović | Installing and testing games |
| Antonia Galinec | Implementation of the update system |
| Tim Juić | Implementation of design and platform |
| Matija Karaula | Project management |
| Matija Kljaić | Platform implementation |
| Karlo Kranjčina | Documentation |
| Noa Midžić | Implementation of controls using gestures |
| Stella Miketek | Installation and implementation of sensors |
| David Minđek | Implementation of WiFi access point |
| Tara Nikolić | User interface design |
| Nikola Pleić | Implementation of WiFi access point |
| Ivo Rošić | Platform implementation |
| Vilim Trakoštanec | Platform implementation |
| Matija Štefanec | Implementation of the update system |
The graphic interface designer will be responsible for designing the graphic interface of the controller and the interface for game selection. The interface implementation person will build the game selection graphic interface based on the designer's design. Once the interface is implemented, there will be a tester and a person responsible for installing the game who will choose several games, install them, and test them on the platform. In order to enable gameplay using a mobile controller, there is also a role for that. To connect the mobile controller to the console, a system for setting up a WiFi access point and a controller webpage for connecting it to the platform needs to be developed. In addition to playing with a mobile controller, there is also gesture control for playing games with hand movements, which requires setting up and implementing sensors. It is necessary to develop a platform for game selection and playing, for which a corresponding role is assigned. Finally, a system for updating needs to be added.
-
Project Management (Matija Karaula)
- Priority: High
- Duration: 13 weeks
-
Platform Design (Tara Nikolić)
- Priority: High
- Duration: 2 weeks
-
Design Implementation (Tim Juić)
- Priority: Medium
- Duration: 2 weeks
-
Platform Development (Vilim Trakoštanec, Ivo Rošić, David Minđek, Nikola Pleić)
- Priority: High
- Duration: 10 weeks
-
Controller Implementation (Matija Kljaić)
- Priority: High
- Duration: 2 weeks
-
Gesture Control Implementation (Noa Midžić)
- Priority: High
- Duration: 4 weeks
-
Maintenance System Development (Matija Štefanec, Antonia Galinec)
- Priority: Medium
- Duration: 2 weeks
-
Sensor System Implementation (Stella Miketek)
- Priority: Medium
- Duration: 3 weeks
-
Testing (Matija Dokmanović)
- Priority: High
- Duration: 9 weeks
-
Documentation (Matija Karaula, Karlo Kranjčina)
- Priority: High
- Duration: 10 weeks
Base setup of captive portal solution and wireless AP has been taken from Captive Portal & Access Point setup - Copyright (c) 2022-23 Splines.
For the purposes of this project, the AP configuration has been changed to use a different IP range, server port and network name. It has also been changed to an open network so it does not require a password to connect and it is running a custom node server for serving the html page.