Apple develops AI can ‘see’ and understand screen context

Apple researchers have developed a new artificial intelligence system that can understand ambiguous references to on-screen entities as well as conversational and background context, enabling more natural interactions with voice assistants, according to a paper published on Friday.
 

https://venturebeat.com/ai/apple-researchers-develop-ai-that-can-see-and-understand-screen-context/#:~:text=Apple%20researchers%20have%20developed%20a,a%20paper%20published%20on%20Friday.