Apple proposes devices using depth mapping for gesture controls, contextual responses

By analyzing the environment and Home entertainment devices like HomePod could be improved's actions, Apple concept suggests, with monitoring of room potentially able to improve gesture-based control of audio, and contextual responses like turning down the volume if the room is empty...   This map data could be used to create depth map of the room, updated over time to cope with changes, such as moved or new furniture, to give the knowledge of the layout and background for room scans to be compared against.   Once detected, the depth map data could be used to detect user's hands, segmenting the overall mapping area to narrow down to just the relevant section.   Notably, the possibility of the proposed system using the context of situation to determine actions it should take, including those that do not quite line up to user's wishes.   One example given is user's request for higher volume, which the system could interpret amplifying the voice from media instead of increasing the average volume..   The patent also adds that, in some embodiments, the system could respond to user's intent or desire that may or may not be directed at system..   Examples given include pausing playback or if they return in part of the environment with low acoustic reflectance, the volume could be adjusted to compensate..   Apple does file quantity of patent applications with USPTO on regular basis, and the discovery of filings is not guarantee that Apple will use the described concepts in consumer device..   While this is adaptive, making it able to adjust to environment it does so with sound, with the device incapable of recognizing hand gestures at all..   One potential way is to fit HomePod-like with technology used in iPhone X's TrueDepth camera.   Read more