AI Image Detection through Human-Centered Training Methods

Project by Polygence alum Eva

AI Image Detection through Human-Centered Training Methods

Project's result

I developed an online training program and assessment to evaluate the effectiveness of the training for AI image detection. The program demonstrated measurable improvements in participants’ detection accuracy, and the findings were documented in a research paper that has been published in the American Journal of Student Research.

They started it from zero. Are you ready to level up with us?

Summary

As AI-generated images become increasingly prevalent in digital media, the ability to distinguish between real and manipulated content is essential for combating misinformation. Our study investigates whether targeted training can significantly improve individuals’ ability to detect AI-generated images. Somoray and Miller (2023) found that deepfake detection accuracy remained low, averaging around 55%, regardless of whether participants were given a list of detection strategies [1]. Our study builds on this by implementing a structured training program, which includes video demonstrations and interactive practice with feedback. We investigate whether detection accuracy improves after participants view videos explaining how to identify deepfakes for AI-image identification instead of just a list of strategies. The experiment began with a pre-test to assess participants’ baseline ability to distinguish between real and AI-generated images. Next, two-thirds of the participants received targeted training on identifying inconsistencies, while one-third served as a control group with no training. Finally, we administered a post-test to measure any improvements in their detection skills after training. Demographic and experiential factors such as age, sleep, AI experience, and screen time did not significantly impact detection accuracy. A paired t-test was performed to evaluate the impact of training on detection accuracy, and the results show a statistically significant improvement in detection accuracy post-training (p=0.009). A statistically significant positive correlation was found between the time spent analyzing images and detection accuracy (p < 0.0001), indicating that more thorough analysis improves performance.

Sahil

Sahil

Polygence mentor

MEng Master of Engineering

Subjects

Quantitative, Computer Science

Expertise

Machine Learning, Reinforcement Learning, Natural Language Processing, Simulation, Game Development, Algorithms

Eva

Eva

Student

Hello! My name is Eva and my project is on AI Image Detection through Human-Centered Training Methods. I chose to work on this project because I am interested in how people interact with AI and how training can improve our ability to identify AI-generated content. After my project is complete, I would like to apply what I learn to help improve AI literacy and make detection skills more accessible to others.

Graduation Year

2027

Project review

“My experience with this project was really valuable because it helped me understand the research and statistical process in a much deeper way. Instead of just learning concepts in theory, I had to think through how to design an experiment, create a control group, and measure change in a meaningful way. I learned how to move from a question to a testable study, and how important things like pre-tests, post-tests, and structured training are in isolating the effect of an intervention. On the statistical side, I gained experience interpreting results rather than just calculating them. Running a paired t-test and correlation analysis helped me see how statistical tools are used to draw conclusions from real data, not just numbers on a worksheet. It was especially interesting to see how significance values helped determine whether changes were meaningful or just due to chance. Overall, the project helped me better understand how research is structured and how data can be used to support clear, evidence-based conclusions.”

About my mentor

“My experience with my mentor was incredibly positive. Sahil was very supportive throughout the entire process and helped guide me as I navigated both the research design and statistical analysis. He made complex concepts feel approachable and encouraged me to think critically about my methodology and results. Working with him made the research process much more engaging and helped me grow more confident in my ability to carry out independent research.”