Probing to frustration?

I experienced this recently in a non SCS session. I was asked a question, the same question, repeatedly. I know that he was hoping for another answer to pop up; but that was my answer. I found myself annoyed and even tried to think of something else in the long silence to satisfy the coach’s expectation. I understand digging deeper and creating space and that my thoughts about his style is what created my frustration; but how do I avoid this in my own Coaching practice? How do I know when probing crosses from useful to annoying?