I'm telling ya man, you'll end up on the losing end of this if you make it an issue. Kill that fucking deer then start shit. Odds are after you kill it he'll get his wife to make ole dad kick you out anyway. But by then it's on your wall and he gets a yearly card in the mail. No matter how this plays out odds are you're gone, keep low and kill that deer first.
Kill that buck and hang his nut sack on his treestand step at eye level. Then send him a nice Holliday card with a pic