Where Are We Without Self Defense?

If the case with Daniel Penny doesn’t take self defense into account, then where have our rights gone to protect ourselves against threatening and violent people?