What microphone do you use?
A Samsung Q2U. The real difference-maker though is post-processing software that strips background noise — it's wildfire season where I live (Canada), so I run an air purifier that's fairly loud (50-60 dB of white noise), and I need to clean that out of the audio. I also usually keep some white noise playing myself just to avoid distraction.