Dissertation: StringStar - Generating 3D Hand Animations For Virtual Guitar Lessons



StringStar

The full project, including the Dissertation itself and the readme instructions file, can be found on the GitHub Repository. The project was originally backed up on a Google Drive, however as of recent the final version has been pushed to GitHub for better ease of access.

My dissertation project - a 3D Virtual Guitar Tutor demo that uses motion-captured hand animations with ManusVR Gloves in order to teach guitar players the ideal hand movements to play the associated chords and notes during song. This was programmed in C# within Unity. The project overall scored 71%.

The project itself is built around the concept of visual learning and mimickry when learning how to play a musical instrument. As someone who played the guitar growing up I often found it easier to copy my tutor’s hand positions and finger movements when learning a new song, rather than solely reading the chord notations and sheet music - oftentimes, the more comfortable hand position differed from what the printed sheets recommended.

This project functions similarly, in using motion-captured hand animations to demonstrate how to play the chords of the song. The user can adjust the tempo of the song, create checkpoints to loop between in order to rehearse certain sections better, or mute selective layers of the song (such as to play only along with the guitar, or to remove it to play instead with the rest of the song). As it is built upon the MIDI foundations and layers common within Guitar Hero (and its PC fan version, Clone Hero), there are a wide variety of popular songs that are compatible with StringStar.

Checkpoint

Unfortunately the project (as well as my final year of study) was disrupted by the COVID-19 global pandemic from the beginning of 2020, which led to the shutdown of UCL and its facilities. Subsequently, as I could no longer access the ManusVR gloves to record further animations, the animations orginally intended as proof of concept ended up becoming the ones used in the final version of the submitted project. The animations present in the downloadable version as a result may come off as rather inaccurate as a result, as the project has not been updated since submission.

If the opportunity ever presents itself, where I have enough time and full access to the resources for recording further motion-captured animations (with a more professional guitarist than I!), I would like to one day return to this project and fulfil its potential. For now, I am proud of this project, warts and all.


Portfolio

  • iGGi Game Jam 2025: Hammer To Fall

  • D2e: A TAG Framework Implementation of Descent: Journeys in the Dark

  • iGGi Game Jam 2024: See What Exists

  • iGGi Game Development 2: Hades of State

  • iGGi Game Jam 2023: Pseudo-Judo

  • iGGi Game Development 1: Versus Tower Defence

  • Dissertation: StringStar - Generating 3D Hand Animations For Virtual Guitar Lessons

  • Virtual Environments: VR Escape Room


  • Contact me via:
    Email - t.j.best@qmul.ac.uk
    GitHub - L0RDR0B
    LinkedIn - Toby Best
    Twitter - L0RDR0B