Yes and no.
Are you following the CDC or WHO recommendations regarding how its transmitted? And they aren't completely sure yet.
The basic masks that you see in surgery or China, e.t.c are only to protect you from spreading diseases, they don't protect you from catching them.
N95 masks are used in healthcare and elsewhere for a higher level of protection of you from the outside contaminant whether that be tuberculosis, vaporized herpes, e.t.c. To get the correct seal and full protection yes it's time to be clean shaven.
So...... up to you and how you see your risk.