The British sculptor keeps haunting relics of the colonial era in his London studio – and soothes himself with audiobooks while he works