> Your position just means every disagreement comes down to a physical fight.
> Is that how you want to live?
The threat of violence is always present. It's just that in "civilized" societies it's often indirect and abstracted. People don't usually get violent, they pay lawyers to complain to the courts which have the power to order police to commit measured amounts of violence on their behalf if necessary.
When negotiation fails and police is unlikely to help, people quickly revert to taking matters into their own hands.
"Stop making a noise or I'll beat you up"
vs
"Quit complaining about the noise or I'll beat you up"
Your position just means every disagreement comes down to a physical fight. Is that how you want to live?
Willingness to use violence to get what you want is not inherently linked to being in the right.