33
Doritos Alert
AI mistakes chips for gun prompting lawsuit
four Black high school students / Baltimore County, United States / Baltimore County Public Schools / Baltimore County Police Department / Omnilert /

Story Stats

Status
Active
Duration
1 day
Virality
4.8
Articles
12
Political leaning
Neutral

The Breakdown 9

  • A group of four Black high school football players in Baltimore County are suing after their school’s AI gun detection system mistakenly identified a bag of Doritos as a firearm, leading to a traumatic encounter with police.
  • The chilling incident unfolded in October 2025 when students were handcuffed and detained, triggering fears and confusion over safety protocols in the school environment.
  • Alarmingly, the AI system is reported to generate over 99% false positive alerts, raising serious concerns about the reliability and impact of technology used in schools.
  • Baltimore County Public Schools has stood by the flawed AI system, emphasizing its commitment to safety amid mounting criticism and accusations of civil rights violations.
  • An investigation revealed that the AI alert had been canceled prior to police intervention, calling into question the procedures involved in handling such alerts.
  • This troubling situation reflects broader issues surrounding the use of AI in public safety and education, highlighting urgent conversations about efficacy, ethics, and the potential for technology to exacerbate racial biases.

Top Keywords

four Black high school students / Baltimore County, United States / Maryland, United States / Baltimore County Public Schools / Baltimore County Police Department / Omnilert /

Further Learning

What is the role of AI in school safety?

AI in school safety aims to enhance security by detecting potential threats, such as weapons, through surveillance systems. These systems analyze video feeds and identify objects that may resemble firearms. However, reliance on AI raises concerns about accuracy and the potential for false alarms, as seen in the incident where a bag of Doritos was mistaken for a gun, leading to a traumatic experience for students.

How do AI systems classify objects?

AI systems classify objects using machine learning algorithms trained on extensive datasets. These algorithms analyze visual data from cameras, recognizing patterns and features associated with specific items. In the case of the Doritos incident, the AI misidentified a snack bag as a firearm, highlighting the challenges in training AI to distinguish between benign and dangerous objects accurately.

What are the legal implications of AI errors?

AI errors can lead to significant legal implications, including lawsuits for civil rights violations. In this case, students are suing the school district and police for the traumatic experience caused by the AI's false alarm. Legal frameworks may struggle to keep pace with technology, raising questions about accountability and the responsibilities of educational institutions and technology providers.

What are false positives in AI detection systems?

False positives occur when an AI system incorrectly identifies a harmless object as a threat. In the Doritos case, the AI system flagged a snack bag as a gun, leading to police intervention. High rates of false positives can undermine trust in AI technologies and raise safety concerns, prompting calls for improved accuracy and reliability in such systems.

How can AI bias affect surveillance outcomes?

AI bias can significantly impact surveillance outcomes by leading to disproportionate targeting or misidentification of individuals based on race or appearance. In this incident, the students involved were Black, raising concerns about how AI systems may perpetuate existing biases in law enforcement practices. Addressing bias is crucial for ensuring fair and equitable treatment in AI applications.

What historical precedents exist for AI misuse?

Historical precedents for AI misuse include incidents where flawed facial recognition technology led to wrongful arrests and racial profiling. These cases highlight the dangers of deploying untested or poorly designed AI systems in sensitive areas like law enforcement and school security, emphasizing the need for rigorous testing and ethical considerations in AI development.

What rights do students have in school settings?

Students have rights to safety, privacy, and due process in school settings. They are protected under laws such as the Fourth Amendment, which guards against unreasonable searches and seizures. In the context of the Doritos incident, students claim their civil rights were violated when they were detained without just cause, raising questions about the balance between security measures and students' rights.

How do schools implement AI technologies?

Schools implement AI technologies by integrating them into existing security frameworks, often using surveillance cameras equipped with AI detection capabilities. This process typically involves collaboration with technology providers and law enforcement agencies. However, the implementation must be accompanied by clear policies, training for staff, and ongoing evaluation to ensure effectiveness and address potential issues.

What are the psychological effects of such incidents?

Incidents involving AI misidentifications can lead to significant psychological effects on those involved, including trauma, anxiety, and distrust in authority figures. The students involved in the Doritos incident reported feeling traumatized after being handcuffed and detained, illustrating how such experiences can have lasting emotional impacts and affect students' perceptions of safety in schools.

What measures can improve AI accuracy in schools?

Improving AI accuracy in schools can involve several measures, including enhancing training datasets to include diverse and representative examples, conducting regular audits of AI performance, and implementing human oversight to verify AI alerts. Collaboration with experts in AI ethics and technology can also ensure that systems are designed with accuracy and fairness in mind, reducing the likelihood of false alarms.

You're all caught up

Break The Web presents the Live Language Model: AI in sync with the world as it moves. Powered by our breakthrough CT-X data engine, it fuses the capabilities of an LLM with continuously updating world knowledge to unlock real-time product experiences no static model or web search system can match.