Get the large. You can cut the leg straps off as they are plenty long enough. It won't be too big.
I agree. Get the large. I'm 6'1 190 and I wear a large, but I don't think it'd be too big for you. I'd definitely rather have a safety harness that was slightly big vs slightly too small.