So I re-watched the last episode and now I think that whole story the Governor gave Rick about his wife was
.
He wasn’t intimidating Rick, he wasn’t softening him up with the whiskey and he needed some way to break the ice. Andrea told him about Shane, she most likely told him Rick is seeing Lori too.
The smug look on his face when Rick reaches for that shot of whiskey to me is the tell.
Edit: something else that makes me think this is during the after show they mentioned the Governor gives a quick smirk just before he says something screwed up, it’s the same thing he does when Rick reaches for the shot.