Multi-Modal Automation for Human Interactive Skill Assessment

Abstract

A method for screening applicants by a screening entity includes the steps of remotely accessing a screening entity's multi-modal pre-screening tool by a candidate using an Internet-accessible device, the pre-screening tool comprising audio and visual elements operable to communicatively interact with the candidate, and carrying out an interactive skills assessment of the candidate by communicating at least one cue to the candidate from the screening entity, requiring the candidate, upon receiving the at least one cue, to simultaneously interact with the pre-screening tool and, based upon this interaction, communicate a verbal response to the cue, recording the candidate's verbal response with the pre-screening tool and storing the verbal response in a database profile associated with the candidate and accessible by the screening entity, and analyzing the candidate's recorded response by the screening entity and carrying out a quality and criteria judgment to determine the hiring potential of the candidate.

1 . A method for screening applicants by a screening entity, which comprises:
 remotely accessing a screening entity's multi-modal pre-screening tool by a candidate using an Internet-accessible device, the pre-screening tool comprising audio and visual elements operable to communicatively interact with the candidate; and   carrying out an interactive skills assessment of the candidate by:
 communicating at least one cue to the candidate from the screening entity; 
 requiring the candidate, upon receiving the at least one cue, to simultaneously interact with the pre-screening tool and, based upon this interaction, communicate a verbal response to the at least one cue; 
 recording the candidate's verbal response with the pre-screening tool and storing the verbal response in a database profile associated with the candidate and accessible by the screening entity; and 
 analyzing the candidate's recorded response by the screening entity and carrying out a quality and criteria judgment to determine the hiring potential of the candidate. 
   
     
     
         2 . The method according to  claim 1 , which further comprises carrying out the communicating steps by:
 communicating the at least one cue to the candidate using at least the audio element of the pre-screening tool; and   communicating the candidate's verbal response to the screening entity using the audio element of the pre-screening tool.   
     
     
         3 . The method according to  claim 1 , which further comprises carrying out the candidate's interaction with the pre-screening tool using the visual element. 
     
     
         4 . The method according to  claim 3 , wherein the candidate's interaction using the visual element of the pre-screening tool comprises viewing at least one of textual and pictorial content displayed to the candidate using the visual element. 
     
     
         5 . The method according to  claim 1 , wherein the analyzing step further comprises automatically determining a confidence score of the candidate's verbal response with a computerized speech recognition tool of the pre-screening tool. 
     
     
         6 . The method according to  claim 1 , wherein the visual element of the pre-screening tool comprises an Internet web page. 
     
     
         7 . The method according to  claim 1 , wherein the audio element of the pre-screening tool comprises a Voice-Over-Internet Protocol component. 
     
     
         8 . The method according to  claim 1 , further comprising confirming the candidate's identity prior to commencing the interactive skills assessment of the candidate through a set of identification questions communicated to the candidate using the pre-screening tool. 
     
     
         9 . The method according to  claim 1 , which further comprises carrying out the storing step one of selectively and continually. 
     
     
         10 . The method according to  claim 5 , wherein the computerized speech recognition tool is programmed to parse a particular response into individual words and to either compare the parsed response to a desired response or to transcribe the parsed response for later use and access by the screening entity. 
     
     
         11 . The method according to  claim 10 , which further comprises carrying out the automated confidence scoring step by judging at least an accuracy and an intelligibility of the candidate's speech utilizing a target phrase represented in a speech recognition grammar. 
     
     
         12 . A method for screening applicants by a screening entity, which comprises:
 remotely accessing a screening entity's multi-modal pre-screening tool by a candidate using an Internet-accessible device, the pre-screening tool comprising audio and visual elements operable to communicatively interact with the candidate; and   carrying out an interactive skills assessment of the candidate with the pre-screening tool by:
 communicating an instruction to the candidate from the screening entity; 
   requiring the candidate, upon receiving the instruction, to perform a pre-defined speech task by simultaneously:
 viewing at least one of textual and pictorial content displayed to the candidate using the visual element of the pre-screening tool; and 
 communicating, with the audio element of the pre-screening tool, a verbal response from the candidate to the screening entity based upon the displayed content; 
   recording the candidate's verbal response with the pre-screening tool and storing the verbal response in a database profile associated with the candidate and accessible by the screening entity; and   analyzing the candidate's recorded response by the screening entity and carrying out a quality and criteria judgment to determine the hiring potential of the candidate.   
     
     
         13 . The method according to  claim 12 , which further comprises carrying out the communicating step by communicating the instruction to the candidate using at least the audio element of the pre-screening tool. 
     
     
         14 . The method according to  claim 12 , wherein the analyzing step further comprises automatically determining a confidence score of the candidate's verbal response with a computerized speech recognition tool of the pre-screening tool. 
     
     
         15 . The method according to  claim 12 , wherein the visual element of the pre-screening tool comprises an Internet web page. 
     
     
         16 . The method according to  claim 12 , wherein the audio element of the pre-screening tool comprises a Voice-Over-Internet Protocol component. 
     
     
         17 . The method according to  claim 12 , wherein:
 the instruction communicating step comprises prompting the candidate to view a written script displayed by the visual element of the pre-screening tool; and   the speech task step comprises requiring the candidate to read the written script aloud.   
     
     
         18 . The method according to  claim 12 , wherein the instruction communicating step comprises prompting the candidate to verbally repeat at least one spoken phrase. 
     
     
         19 . The method according to  claim 12 , wherein the instruction communicating step comprises prompting the candidate to verbally answer at least one multiple-choice question displayed to the candidate by the visual element of the pre-screening tool. 
     
     
         20 . The method according to  claim 12 , wherein the instruction communicating step comprises prompting the candidate to verbally answer at least one question regarding a graphic displayed to the candidate by the visual element of the pre-screening tool.