Casual Dating Gone Wrong?

So, I've been dating casually for about six months now. Met some great people but nothing really serious yet. I usually stick to pretty casual stuff with no strings attached. Last night though, things got a bit... messy? It wasn't what I expected at all. I was hanging out with this one person who’s in their mid-thirties too, and we were just sort of talking about our interests over drinks. They mentioned liking to explore more BDSM stuff, which is fine by me, I'm pretty open-minded that way. But as the night went on, they started bringing up things like age-play, where you pretend to be younger or older than your actual age for roleplay. I kind of joked about it at first and laughed it off but then they got really serious, talking about specific scenarios and stuff I wasn't too keen on. I'm not really into that kind of play, so I tried to steer the conversation back to regular casual stuff. But man, this person wouldn’t let up, kept pushing for more explicit details and asking if we could do it later. I felt a bit weird about the whole thing, I just wanted a fun night out with no drama. So in the end, I said goodnight early and left before things got too intense or uncomfortable. But now I’m wondering: did I handle that situation poorly? Am I being overly cautious by pulling back when someone gets into something I don’t enjoy? I guess I'm not really sure how to feel about it all, was I the asshole for shutting down such an eager partner, or am I right to stick with what feels comfortable and safe? It’s a weird headspace to be in after a night out that started so casually. Maybe I’m overthinking things, but sometimes it's hard not to second-guess myself.