"So Jacob was greatly afraid and distressed..." Genesis 32.7
Fear leads to distress.
Where does fear come from? It comes from the absence of a firm conviction that God is Great and well able to sustain us.
Never mind other people's word or bad thoughts. What is written is determined and nobody can change it.