What to do relationship with older man?

on the 26th of May I got pulled over for running a red light, the cop asked for my registration & liscene, and I noticed he was being really surprisingly nice for a cop. Then he goes " you know what, I'm only letting you go because you're a pretty one. they didn't make them like you in my days" He's 26, so in a piece of paper i jotted my number down & gave it to him when he handed me my registration & license back, we've been in contact since then & he's taken my out to eat about 4 times now, but he has a kid but is divorced, recently we have been each other alot lately, for instance he will pick me up when his shift ends and we go to his house, his ex knows about this & doesn't think its healthy for him to be around me especially when their kid is around me too. I have ran into her at the grocery store once and it was the most awkward situation of my life. Should I keep on seeing him?