A new memo sent to Meta employees announced the installation of new tracking software to capture mouse movements meant to train its artificial-intelligence models. The new initiative will work to make the AI agents perform work tasks autonomously, according to Reuters.
“If we’re building agents to help people complete everyday tasks using computers, our models need real examples of how people actually use them — things like mouse movements, clicking buttons, and navigating dropdown menus. To help, we’re launching an internal tool that will capture these kinds of inputs on certain applications to help us train our models,” Meta spokesperson Andy Stone told Reuters.
According to Meta, the data collected from the I have an agent will not be used for performance assessments, just model training. The agent is looking to track specific clicks and keystrokes, as Meta continues to build AI infrastructure.
Peeping Tom
In an internal memo reviewed by Reuters, the deployed AI tool operates across select work apps and websites, periodically capturing screen snapshots to understand employee workflows. The AI agents will then memorize the new patterns and improve on weak points, Meta says its AI still struggles with activities like choosing from dropdown menus and using keyboard shortcuts.
“This is where all Meta employees can help our models get better simply by doing their daily work,” the memo said. According to Reutersone of the teams having to use the new tool is the model-building Meta SuperIntelligence Labs team.
The new tool by Meta marks a new trend in work surveillance. Technology at JP Morgan has also been deployed to track keyboard strokes, video calls, and meetings for junior bankers, comparing them to their reported weekly hours. JP Morgan recently caused tension with employees after employing its own surveillance systems on its computers.
Although the new AI tool is unlikely to replace anyone in the near term, more layoffs are planned at Meta. According to a separate report from Reuters, Meta is set to do a round of layoffs by May 20. The company is reportedly planning to eliminate 10% of its global workforce, or close to 8,000 employees, as it continues to build new AI infrastructure.
The final deadline to apply for the 2026 Inc. 5000 is this Friday, April 24, at 11:59 p.m. PT. Apply here.
