If free speech were really free

Why is the rise in this love for free speech only linked to the right to offend minorities in Europe? Can the offended minorities also have the right to speak back?