Here is the command your looking for. I just did this to secure my Google Compute Engine Instance:
sudo apt-get purge phpmyadmin
You can choose the options to remove the phpmyadmin databases from mysql as well, which is what I did just now from my wordpress instance.
This is helpful after you get your site migrated and no longer need phpmyadmin installed.
Hackers go elsewhere. 🙂