The project works by employing a siamese network to predict what you say and performs the respective action. Unlike traditional neural networks, this method does not require a large dataset to train on, powerful hardware resources or a long training time. You can get this up and running typically in 10-15 minutes and you do not need a GPU to run this program.

Github link :- https://github.com/andohuman/Shadowcol

I’ve provided very detailed installation instructions in the repo and instructions on how to train your own model with your own commands to aid your gaming experience.

I’d also like to mention that this project is still under development and there might be a few bugs. Please DO NOT ATTEMPT TO PLAY ANY COMPETITIVE GAMES WITH THIS (Had to learn this the hard way after dying a couple of times in overwatch).

The typical use case I see for this is mapping hard-to-reach keys to your voice instead. Or use your voice commands to open/close applications in your PC. I’ll leave you to your imagination.

Play with the code and let me know what you guys think, and if you have any suggestions I’d be glad to hear it.

Special thanks to u/chaosparrot and u/jonnor for their insights !