Patience in the face of others’ insolence is of three kinds: patience with someone who has power over you when you have none over him; patience with someone you have power over when he has none over you; finally patience with someone when neither of you has power over the other.
The first kind is humiliating and degrading; it is not a virtue. The advice for someone who is afraid of such an intolerable situation would be to abandon everything and run away.
The second kind is a virtue, it is charitable, it is the true meekness which characterizes virtuous souls.
The third sort consists of two kinds. The insolence may arise from a misunderstanding or from fear, and the one at fault may realize the ugliness of his act and regret it. To be patient with him would be a virtue and an obligation; this is true magnanimity. But with a person who overestimates his own value and is proud and arrogant and feels no regret for his action, to tolerate this is humiliating, it encourages the wrongdoer in his wrongdoing, because he will act even more violently and it would be stupid to respond in the same way. The wisest course of action is to let him know that you could fight back but that you are refraining from doing so because he is beneath contempt and unworthy of your attention. No more is necessary.
As for the insolent behaviour of the lower classes, the only remedy is to punish it.
Taken from ' Al-Akhlâq wa’l-Siyar (Morals and Behaviour) By Imam Ibn Hazm al-Andalusi