Can a niche be too narrow?

I’m debating among mompreneurs and more specifically mompreneurs with ADHD or women entrepreneurs with ADHD as a niche. I guess my hesitation is that there are so many out there who haven’t been diagnosed with ADHD and I’m worried that I won’t have a large enough pool of clients if I constrain from both endsmoms  and ADHD. Any advice?