Yes, going from memory and it was many years ago. You need to write a letter to him relinquishing the number to him. He presents that to FAA.
A phone call to FAA would be a good idea just to make sure everything is done correctly and it only goes to him.