My birdie keeps getting hornay!?

his a budgie and he aways want to have ! and his partner budgie ped away because he was so hornay and knocked her up and she got sick. What can i do to stop him from having with a budgie that i will get for him?