He was the only survivor of a Cylon attack, and had no memory of his parents or anything that happened to him before the age of about four, including his real name--"Starbuck" was the name of the officer who led the rescue mission.

He was then raised in an orphanage, and nobody ever loved him until he met Apollo and his family. Classic Victorian waif angst.