Not really. I pretty much don't have an aggressive bone in my body, but I grew up with firearms, I own a lot, I carry them and I understand them. While I never have, and seriously hope I never have the need, I would not hesitate to use a firearm to defend myself or my family. I have weapons for different uses. I have a number of different styles of rifles for different types of hunting, I have some handguns for hunting and bear defense (Only one, really for bear defense - the S&W .500), and I have handguns for personal and home protection. Of the protective weapons, I would be happy to never fire them other than to keep in practice and assure proper functionality.
My statement really just points out that if someone wants to mess with my person, my home or my family, there would definitely be better choices...