Torbert was born in Georgetown, Delaware. He graduated from the United States Military Academy in 1855 and was commissioned a brevet second lieutenant in the 2nd U.S. Infantry regiment.Just before the start of the Civil War, Torbert was appointed a first lieutenant in the Confederate States Army on.