I generally ignored them because I'm not a confrontational person, they usually only scream thing at me especially young boys. Nobody ever compared it to ageplay
but if you only want to dress cute and is not what you intend you shouldn't worry about it. The most important thing is to not let it get to you, and when you can't handle it, lean on someone that listen to you (sorry, english is not my first language) I'm kinda of a beginner too to lolita but I' have been dressing weird since I was young. I hope you are doing fine right now (❁´◡`❁)💕💕 And not leting others tell you what to do with your life. 🙌