System for creating and rendering synchronized audio and visual programming defined by a markup language text file

Abstract

An audio program and message distribution system in which a host system organizes and transmits program segments to client subscriber locations. The host organizes the program segments by subject matter and creates scheduled programming in accordance with preferences associated with each subscriber. Program segments are associated with descriptive subject matter segments, and the subject matter segments may be used to generate both text and audio cataloging presentations to enable the user to more easily identify and select desirable programming. A playback unit at the subscriber location reproduces the program segments received from the host and includes mechanisms for interactively navigating among the program segments. A usage log is compiled to record the subscriber's use of the provided program materials, to return data to the host for billing, to adaptively modify the subscriber's preferences based on actual usage, and to send subscriber-generated comments and requests to the host for processing. Voice input and control mechanisms included in the player allow the user to perform hands-free navigation of the program materials and to dictate comments and messages which are returned to the host for retransmission to other subscribers. The program segments sent to each subscriber may include advertising materials which the user can selectively play to obtain credits against the subscriber fee. Parallel audio and text transcript files for at least selected programming enable subject matter searching and synchronization of the audio and text files. Speech synthesis may be used to convert transcript files into audio format. Image files may also be transmitted from the server for synchronized playback with the audio programming.

1 . A system for reproducing audible and visible program segments to a user comprising, in combination: 
 a program storage unit for storing an electronically readable markup file of text characters expressed in a standard markup language, said markup file including a plurality of markup tags each of which includes a predetermined distinctive string of characters identifying the meaning of said tag,    an audio player responsive to the content of said markup file for reproducing an audible program segment having audio content specified by said markup file, and    a display device for displaying the content of an image file specified by said markup file concurrently with the reproduction of said audio content.    
     
     
         2 . A system for reproducing audible and visible program segments to a user as set forth in  claim 1  wherein one of said plurality of markup tags includes an image tag that identifies said image file.  
     
     
         3 . A system for reproducing audible and visible program segments to a user as set forth in  claim 2  wherein said image tag specifies the filename of said image file.  
     
     
         4 . A system for reproducing audible and visible program segments to a user as set forth in  claim 3  wherein said image tag specifies the time at which said display device displays said image file relative to the audio play time when said audio player reproduces said audible program segment.  
     
     
         5 . A system for reproducing audible and visible program segments to a user as set forth in  claim 3  wherein the relative position of said image tag within said markup file specifies the time at which said image file is displayed to said user relative to said audio play time.  
     
     
         6 . A system for reproducing audible and visible program segments to a user as set forth in  claim 3  wherein at least some of said audible and visible program segments are retrieved by said system via the Internet from one or more remote storage servers prior to being reproduced to said user.  
     
     
         7 . A system for reproducing audible and visible program segments to a user. as set forth in  claim 1  wherein said plurality of markup tags includes at least one hypertext link tag that specifies anchor content and linked content and wherein said system includes: 
 means for accepting a jump command from said user when said anchor content is being reproduced for said user, and    means responsive to said jump command for initiating the reproduction of said linked content for said user.    
     
     
         8 . A media player for reproducing an audiovisual program defined by a markup file, said media player comprising, in combination: 
 one or more storage devices for storing at least one digitally recorded audio program file, at least one image file, and a text markup file including one or more imbedded markup tags establishing the relative times at which said audio program file is scheduled to be reproduced and said image file is scheduled to be displayed, and    processing means responsive to said text markup file for reproducing said digitally recorded audio program file in a form audible to said user at an audio playback time and for displaying said image file in a form visible to said user at a time relative to said playback time specified by said text markup file.    
     
     
         9 . A media player for reproducing an audiovisual program defined by a markup file as set forth in  claim 8  wherein said text markup file is expressed in a standard markup language which defines a set of markup tags of different types, each markup tag including a unique character string that indicates its meaning, said text markup file including an image tag that includes a filename identifying said image file.  
     
     
         10 . A media player for reproducing an audiovisual program defined by a markup file as set forth in  claim 9  wherein said time relative to said audio playback time is specified by the position of said image tag in said text markup file.  
     
     
         11 . A media player for reproducing an audiovisual program defined by a markup file as set forth in  claim 8  wherein said text markup file includes a first markup tag indicating when the display of said image file begins relative to said audio playback time and a second markup tag indicating when the display of said image file ends relative to said audio playback time.  
     
     
         12 . A media player for reproducing an audiovisual program defined by a markup file as set forth in  claim 8  wherein said imbedded markup tags include at least one hypertext link tag specifying the combination of anchor content and linked content within said audiovisual content and wherein said processing means initiates the presentation of said linked content to said user in response to receiving a hypertext jump command from said user while said anchor content is being presented to said user.  
     
     
         13 . The system for storing and rendering a synchronized audio and visual presentation comprising, in combination: 
 means for storing a markup language text file expressed in a standard markup language, said text file including a plurality of imbedded tag elements each of which comprises a predetermined string of characters having a predefined meaning in said markup language and including:    (a) a specification of an audio program segment,    (b) an identification of an image file containing visual content, and    (c) a specification of the relative times at which said audio program segment and said visual content are to be presented to a user, and    a playback system responsive to said text file of characters for presenting said audio program segment and said visual content to a user at said relative times specified by said text file.    
     
     
         14 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 13  wherein said identification of an image file comprises the combination of one of said tag elements and a string of characters identifying said image file by name.  
     
     
         15 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 14  wherein said specification of the relative times at which said audio and said visual content are to be presented to a user comprises a timing specification specified by one or more of said markup tags.  
     
     
         16 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 15  wherein said timing specification specifies the time at which the display of said visual content begins relative to the time or times at which said audio program segment is reproduced by said playback unit.  
     
     
         17 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 15  said timing specification specifies the time at which the display of said visual content ends relative to the time or times at which said audio program segment is reproduced by said playback unit.  
     
     
         18 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 15  wherein said timing specification specifies the time at which the display of said visual content begins and ends relative to the time or times at which said audio program segment is reproduced by said playback unit.  
     
     
         19 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 15  wherein said timing specification is specified by the position of one or more of said markup tags within said markup language text file.  
     
     
         20 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 15  wherein said timing specification is specified by the position within said markup language text file of a markup tag that identifies said image file.  
     
     
         21 . The system for storing and rendering a synchronized audio and visual presentation as set forth in  claim 14  wherein said imbedded tag elements include at least one hypertext link tag element specifying the combination of anchor content and linked content within said audio and visual presentation and wherein said playback system includes means for initiating the rendering of said linked content to said user in response to receiving a hypertext jump command from said user while said anchor content is being rendered to said user.