Making Nice with MLMs