A bill aimed at regulating the use of artificial intelligence (AI) in public schools is advancing through the Washington State Legislature. This proposed legislation seeks to prohibit certain applications of AI that could impact student discipline and personal data handling.
The bill outlines specific restrictions, including the use of automated decision systems as the sole basis for significant disciplinary actions such as suspensions, expulsions, or referrals to law enforcement. It also aims to curb the use of biometric data to infer personal characteristics, including emotional states and gender identity, without thorough human evaluation.
Sen. T’wina Nobles, one of the joint sponsors of the bill, emphasized the need for “guardrails” around AI technologies. She explained that the intention is to protect students from potential mistreatment resulting from algorithmic decisions. “We want to ensure that our systems don’t amplify existing disparities,” she stated, highlighting concerns about how such technologies could disproportionately affect students of color, those with disabilities, and LGBTQ+ individuals.
The legislation was partly inspired by incidents where AI systems have misinterpreted benign objects as threats. For instance, a case in Maryland saw a bag of empty Doritos mistakenly identified as a firearm, leading to unnecessary trauma for the involved student. Derick Harris, from the Black Education Strategy Roundtable, pointed out that “false alarms have triggered unnecessary trauma” among students.
While the bill does not seek to eliminate AI use in schools, it aims to ensure that human oversight remains integral in the decision-making process. “The data points may be brought forward from the technology, but the conclusion that is drawn and the analysis of the data should not be the machine,” said Sen. Lisa Wellman, Chair of the Senate Early Learning & K-12 Education Committee and a joint sponsor of the bill.
The proposed legislation is scheduled for an executive session in committee on March 7, 2024, where it could be voted on, amended, or potentially stalled. This move reflects a growing recognition of the implications of AI in educational settings and a desire to balance technological advancement with ethical considerations.
By addressing these concerns, Washington State aims to set a precedent for responsible AI use in education, fostering an environment where technology enhances learning without compromising student welfare.
