Well, no, not necessarily aberrant. A number of social species have a male-dispersion society, wherein males are expelled from the female-dominated social grouping and either find a group of females or engage in ritual combats during a breeding season. The problem with that theory is that the giants in the stories do not appear to be either young adults recently expelled from the herd or older males who have lost their mates; they appear most often to be in their prime, with some older individuals.