Microsoft is committing to strict AI privacy affecting millions of students in U.S. schools, in a move that could fundamentally change how tech giants handle minors’ data. The agreement, negotiated with the American Federation of Teachers (AFT), the second-largest U.S. education union, sets new standards for security and privacy in the use of artificial intelligence in education. The question now is whether other tech giants will follow suit.
Millions of students turn to AI chatbots for help with their studies, emotional support, and personal advice — often without knowing where their conversations and personal data end up. This lack is a growing concern for educators, parents, and students as artificial intelligence becomes an integral part of everyday school life, embedded in many of the tools students are required to use. The lack of federal and state legislation on AI in education has created a regulatory gap that companies and schools are left to fill on their own.
The backlash has been immediate in some cases: The country’s two largest school districts, New York and Los Angeles, have announced a year-long moratorium on the use of AI by students while they study how best to integrate the technology into education. The ban in New York applies to all elementary and middle school students, while in Los Angeles it extends to high school. Both districts are planning extensive audits of their contracts with educational technology companies, with a focus on data protection, transparency and accountability.
See also: OpenAI & Microsoft: Seattle Times and Newsday file lawsuit
What Microsoft's agreement on AI and privacy in schools includes
The agreement between Microsoft and AFT is legally binding and requires third-party audits for compliance. Under its terms, Microsoft commits not to use student or teacher data to train AI systems, with a narrow exception for data that could help protect students. The data collected cannot be sold, used for advertising or product development — a significant commitment that runs counter to the dominant business model of many tech companies.
Of particular note is the ban on the use of AI companions or features designed to foster emotional dependency and keep students engaged longer than required for an educational task. This provision directly addresses concerns about technology addiction and the manipulation of minors through AI. In addition, the agreement includes transparency measures that require the company to inform families, in plain language, about how its tools work.
Brad Smith , Microsoft ’s vice president and president , said this standard sets a high bar for child privacy and AI safety, and that the company will expand the agreement to every school district it partners with starting Nov. 1. AFT President Randi Weingarten called the agreement a first of its kind and an important step in setting an industry standard in the absence of federal and state legislation on AI in schools.
AI and privacy: Will Google, OpenAI and Anthropic follow?
The crucial question remains: Will other companies follow suit? OpenAI and Anthropic have announced that they are in discussions with the AFT about similar security and privacy agreements. However, Google , the dominant provider of educational technology for American schools, has not said whether it plans to offer similar protections . This silence is troubling, given that millions of students use tools like Google Workspace for Education and Google Classroom every day .
See also: Microsoft zero-day: Two Windows vulnerabilities actively exploited
Josh Golin , executive director of the nonprofit internet safety organization Fairplay , said the agreement's safety provisions are essential, but the standards will only be effective if all AI companies , especially tech giants, adopt them. He also expressed concern that the agreement sidesteps the question of whether AI products even belong in classrooms or at what age they should be introduced .
“I worry that a high-profile framework like this will be misunderstood and schools will think: if it does a good job on privacy and security, then that means we should use the tool,” Golin said.
The issue is particularly relevant in the context of the broader debate about screen time and the effects of technology on children’s mental health. Research has shown that excessive use of digital tools can negatively affect students’ concentration, sleep and social development. Integrating AI into education without appropriate safeguards could exacerbate these problems, while also exposing minors’ sensitive personal data to risks.
See also: Microsoft Humanist AI: "People come first"
According to SecurityWeek, the Microsoft-AFT represents an important step in the right direction, but it is not a panacea. Its effectiveness depends on its widespread adoption by all AI companies operating in the education sector, as well as on the existence of strong control and enforcement mechanisms. Without federal legislation, the protection of students remains dependent on the goodwill of companies.
🔒 Protect your privacy with Proton VPN
Swiss VPN from the creators of Proton Mail — strict no-logs policy, strong encryption, and built-in NetShield that blocks ads, trackers, & malware.
- ✔ No-logs, based in Switzerland (except 14-Eyes)
- ✔ NetShield: blocks ads, trackers & malicious domains
- ✔ Covers all devices — free version available
The link is an affiliate link — SecNews may receive a commission at no additional cost to you. It does not affect the independence of our article writing.
