Anthropic publicly releases AI tool that can take over the user’s mouse cursor Anthropic is one of the first to go beyond just screen vision.

The mouse cursor is tracked inside of a window by Python and the resulting coordinates on the LED grid are illuminated.