Consider dropping py2 compatbility

[thatch]

At some point this should go 3.6+ instead of keeping py2 compatibility. This mostly means being able to use unittest.mock and removing compat.py but also means fewer things to keep track of.