- - -
If the guys seem to be adamant/beligerant: take the number. Then you can register a case. Why put yourself in a difficult position?
One time, I refused to take a guy's number and he followed me and keyed my car.
Just take the number. You can give it to your daddy and tell him big scary man frightened you later.