I am a Realtor and I want to start a Luxury home sales department in my area

I want to sell homes of Luxury type only. They sell slower or sometimes don’t sell but in my area, there are no Luxury agents. Is this a market I can start to develop? I’m good at Real Estate and I’m starting back re-inventing myself after moving around more than I wanted however my goal is to also not turn down clients of lesser value homes.