AI Misidentifies Doritos Bag as Gun, Triggers Police Response

An AI-powered gun detection system at a Baltimore County high school mistakenly identified a bag of Doritos as a firearm, leading to a police response involving multiple officers on March 15, 2024. Sixteen-year-old student Taki Allen was enjoying the snack outside Kenwood High School after football practice when the incident occurred.

According to reports from WBAL-TV 11 News, the situation escalated quickly. Allen was approached by several police officers who ordered him to the ground. “It was like eight cop cars that came pulling up for us,” he stated. The student described the moment as shocking, noting, “I was like, ‘What?’” Officers restrained him and conducted a search, ultimately finding that he was unarmed.

Allen recounted holding the Doritos bag with both hands. The AI system, according to him, interpreted the gesture as a potential threat. “They said it looked like a gun,” he explained. This incident raises significant concerns regarding the effectiveness of current gun detection technologies, particularly in educational environments.

Concerns Over AI Technology in Schools

The use of AI technology for gun detection in schools has gained traction across the United States, including the implementation of systems like that from Omnilert, a Virginia-based startup. This technology scans surveillance footage from approximately 7,000 cameras in the Baltimore County Public Schools system, alerting authorities to potential threats in real time.

In a statement to the Baltimore Banner, Blake Mitchell, a spokesperson for Omnilert, acknowledged the incident as a “false positive.” He noted, “Because the image closely resembled a gun being held, it was verified and forwarded to the Baltimore County Public Schools safety team within seconds for their assessment and decision-making.” Despite this acknowledgment, the incident underscores the limitations of AI systems in accurately identifying threats.

The technology’s inability to prevent actual shootings, such as the tragic event at Antioch High School in Nashville earlier this year, further complicates its deployment in schools. Critics argue that reliance on such systems not only fails to enhance safety but may also perpetuate racial biases, disproportionately affecting students of color.

Impact on Students and Community Response

The police response to Allen’s situation left him feeling frightened and anxious about returning to school. “I don’t feel like going out there anymore,” he admitted, expressing concern over potential future interactions with law enforcement while simply enjoying snacks. He has yet to receive an apology from the school administration, which cited protocol following the incident.

Allen’s grandfather, Lamont Davis, expressed his outrage, stating, “There was no threat for eight guns to be pointed at a 16-year-old.” The community reaction emphasizes the need for greater oversight and reevaluation of how AI technologies are used in school settings.

As discussions surrounding gun safety and school security continue, the incident involving Allen serves as a stark reminder of the potential dangers inherent in deploying unverified technology in environments meant to protect and educate young people. The call for a more balanced approach to school safety, combining technology with human oversight, is likely to gain momentum in the wake of this incident.