Why is god referred to as a "he"?

It annoys me that God is referred to as "He." If God is such an all-knowing, infinite, and mighty figure, how can it be condensed into a human gender? Humans always have the desire to provide images for themselves, and I thought God wasn't a gender, but a spirit, a figure. Something so complicated and divine, would not possess the imperfect qualities of "man." Can someone who believes God is a "he" explain to me your reasoning?