This study aims to investigate whether the average listener can identify autistic speakers based solely on phonetic patterns found in autistic speech. Participants completed a listening-based survey where they were asked to assess the person’s autistic status. The percentage of correct answers, d-prime, and certainty scores were analyzed both for the participants and the speakers. Results showed that middle-aged participants outperformed the younger and older age groups. They also suggest that women are more likely to be labeled ‘not autistic’ compared to their male counterparts. Finally, the ultimate conclusion is that the ‘autistic accent’, as investigated in purely phonetic terms in the current study, is slightly perceivable. These results have implications for linguistic profiling and perceptions of neurodivergence.