Why does H2 (hydrogen) form covalent bonds and not hydrogen bonds?

I thought it was because hydrogen atoms only need 2 valence electrons to fill their outer shell so they share each others (covalent bonding). but why exactly do they not have hydrogen bonding. THANKS