It's called a favicon.ico file
Do a google search for favicon.ico and you'll get the trick. It's not totally straightforward, but it's been a while since I did mine, so perhaps it's getting easier. There are lots of pre-made icons you can use easily.
