Augmented reality conferencing system and method

Abstract

The disclosure provides an augmented reality virtual videoconference for each of a plurality of computing devices during a networked communication session. The networked communication session is defined and provided a plurality of devices. Video content that is at least partially captured by a camera associated with a respective device is received, and a composited interactive audio/video feed comprised of audio/video input received during the networked communication session from each of the first user computing device and at least the respective user computing device of the one of the additional users is generated. At least some of the video content captured by the camera associated with a respective user computing device is removed prior to including the remaining video content in the composited interactive audio/video feed. The composited interactive audio/video feed is provided to the plurality of computing devices during the networked communication session.

What is claimed is: 
     
         1 . A system for providing an augmented reality virtual videoconference for each of a plurality of computing devices during a networked communication session, the system comprising:
 non-transitory processor readable media;   at least one processor operatively coupled to the non-transitory processor readable media, wherein the non-transitory processor readable media have instructions that, when executed by the at least one processor, causes the at least one processor to perform the following steps:
 define the networked communication session as a function of parameter information received from a first user computing device; 
 provide first access to the networked communication session to the first user computing device; 
 provide respective second access to the networked communication session to each of a plurality of user computing devices, as a function of information representing a plurality of additional users associated with the plurality of user computing devices, wherein one of the additional users is physically located remotely from at least one other of the additional users; 
 receive, from one of the additional users, video content that is at least partially captured by a camera associated with the respective user computing device of the one of the additional users; 
 generate a composited interactive audio/video feed comprised of audio/video input received during the networked communication session from each of the first user computing device and at least the respective user computing device of the one of the additional users, wherein at least some of the video content captured by the camera associated with the respective user computing device of the one of the additional users is removed prior to including all remaining video content captured by the camera associated with the respective user computing device of the one of the additional users in the composited interactive audio/video feed; and 
 provide the composited interactive audio/video feed to the plurality of computing devices during the networked communication session. 
   
     
     
         2 . The system of  claim 1 , wherein the non-transitory processor readable media have further instructions that, when executed by the at least one processor, causes the at least one processor to:
 receive initialization information from at least one user computing device, wherein the initialization information includes video content captured by a camera associated with the at least one user computing device.   
     
     
         3 . The system of  claim 2 , wherein the non-transitory processor readable media have further instructions that, when executed by the at least one processor, causes the at least one processor to:
 process the initialization information to detect objects and corresponding information associated with the detected objects.   
     
     
         4 . The system of  claim 3 , wherein the detected objects and corresponding information includes at least one plane of the object. 
     
     
         5 . The system of  claim 3 , wherein the non-transitory processor readable media have further instructions that, when executed by the at least one processor, causes the at least one processor to:
 use machine learning to process the initialization information.   
     
     
         6 . The system of  claim 5 , wherein the machine learning can be implemented for at least image processing. 
     
     
         7 . The system of  claim 1 , wherein the non-transitory processor readable media have further instructions that, when executed by the at least one processor, causes the at least one processor to:
 provide an augmented reality view of the remaining video content in the composited interactive audio/video feed as a function of movement of a viewer of the composited interactive audio/video feed.   
     
     
         8 . The system of  claim 7 , wherein the augmented reality view includes adjusting for skew and angle of view. 
     
     
         9 . The system of  claim 1 , wherein at least one of the additional user computing device(s) communicate on the networked communication session via one or more of Real Time Streaming Protocol, Web Real-Time Communication and/or hypertext transport protocol live streaming. 
     
     
         10 . The system of  claim 1 , wherein the non-transitory processor readable media have further instructions that, when executed by the at least one processor, causes the at least one processor to:
 receive from the additional user computing devices information representing an interaction by the one of the user computing devices; and   provide a representation of the interaction to each other user computing device.   
     
     
         11 . A method for providing an augmented reality virtual videoconference for each of a plurality of computing devices during a networked communication session, the method comprising:
 defining, by at least one processor configured to execute instructions stored on non-transitory processor readable media, the networked communication session as a function of parameter information received from a first user computing device;   providing, by the at least one processor, first access to the networked communication session to the first user computing device;   providing, by the at least one processor, respective second access to the networked communication session to each of a plurality of user computing devices, as a function of information representing a plurality of additional users associated with the plurality of user computing devices, wherein one of the additional users is physically located remotely from at least one other of the additional users;   receiving, by the at least one processor, from one of the additional users, video content that is at least partially captured by a camera associated with the respective user computing device of the one of the additional users;   generating, by the at least one processor, a composited interactive audio/video feed comprised of audio/video input received during the networked communication session from each of the first user computing device and at least the respective user computing device of the one of the additional users, wherein at least some of the video content captured by the camera associated with the respective user computing device of the one of the additional users is removed prior to including all remaining video content captured by the camera associated with the respective user computing device of the one of the additional users in the composited interactive audio/video feed; and   providing, by the at least one processor, the composited interactive audio/video feed to the plurality of computing devices during the networked communication session.   
     
     
         12 . The method of  claim 11 , further comprising:
 receiving, by the at least one processor, initialization information from at least one user computing device, wherein the initialization information includes video content captured by a camera associated with the at least one user computing device.   
     
     
         13 . The method of  claim 12 , further comprising:
 processing, by the at least one processor, the initialization information to detect objects and corresponding information associated with the detected objects.   
     
     
         14 . The method of  claim 13 , wherein the detected objects and corresponding information includes at least one plane of the object. 
     
     
         15 . The method of  claim 13 , further comprising:
 using, by the at least one processor, machine learning to process the initialization information.   
     
     
         16 . The method of  claim 15 , wherein the machine learning can be implemented for at least image processing. 
     
     
         17 . The method of  claim 11 , further comprising:
 providing, by the at least one processor, an augmented reality view of the remaining video content in the composited interactive audio/video feed as a function of movement of a viewer of the composited interactive audio/video feed.   
     
     
         18 . The method of  claim 17 , wherein the augmented reality view includes adjusting for skew and angle of view. 
     
     
         19 . The method of  claim 11 , wherein at least one of the additional user computing device(s) communicate on the networked communication session via one or more of Real Time Streaming Protocol, Web Real-Time Communication and/or hypertext transport protocol live streaming. 
     
     
         20 . The method of  claim 11 , further comprising:
 receiving, by the at least one processor, from the additional user computing devices information representing an interaction by the one of the user computing devices; and   providing a representation of the interaction to each other user computing device.