It was narrated from Muhammad bin Sa"d that his father said,

"Umar asked permission to enter upon the Messenger of Allah (ﷺ), and there were some women with him whose voices had drowned out his voice. He gave him permission to enter, and they hastened to leave. "Umar came in and the Messenger of Allah (ﷺ) was smiling. ‘Umar said: May Allah make you happy all your life, O Messenger of Allah, may my father and mother be sacrificed for you. He said: “I wonder at these women who were with me. When they heard your voice they hastened to leave," "Umar turned to them and said: O enemies of your souls, by Allah you should have feared the Messenger of Allah (ﷺ) more than me. The Messenger of Allah (ﷺ) said: "Let them be, O ‘Umar. By Allah, the Shaitan: never meets you on a road but he takes a different road."