MicroGesture SensorFusion (mGesf)

Check out our video

This repo extends the work in this two papers: ThuMouse: A Micro-gesture Cursor Input through mmWave Radar-based Interaction and IndexPen: Two-Finger Text Input with Millimeter-Wave Radar. Cite us in your work if you find the code we shared help your project.

This application supports a variety of sensors, including:

• Texas Instrument mmWave Sensors: IWR6843ISK, IWR6843AoP
• LeapMotion (coming soon)
• DecaWave UWB sensors (coming soon)

To run this application, first make sure you have the GUI backend PyQT5 installed. Depending on your O.S., use the following commands:

ubuntu: sudo apt-get install python3-pyqt5 MacOs: brew install pyqt

Then install the package in your python interpreter: pip install pyqt5

first run this command to install the prerequisites.

python setup.py install

Now run this app with this command

python main.py

Make sure you have the audio library installed: Mac:

brew install ffmpeg

Ubuntu:

sudo apt-get install ffmpeg

For Windows, it's a bit more involved as the downloaded library needs to be added to the environment variables. This is a good tuorial.

If you are getting 'permission denied' errors (likely to occur on Windows), install the simpleaudio package by running:

pip install simpleaudio