I think your father's anger was because you had surpassed him in greatness and as a child no less. Your brother probably thought that joining with your dad would keep him safe from his anger and may have had some himself for the same reason. Some parents don't understand evolution. We're supposed to better our parents and it's a mission accomplished not a personal defeat. So he used his anger and his family against you. I'm so sorry he did that.