US20040083104A1 - Systems and methods for providing interactive speaker identification training - Google Patents
Systems and methods for providing interactive speaker identification training Download PDFInfo
- Publication number
- US20040083104A1 US20040083104A1 US10/685,478 US68547803A US2004083104A1 US 20040083104 A1 US20040083104 A1 US 20040083104A1 US 68547803 A US68547803 A US 68547803A US 2004083104 A1 US2004083104 A1 US 2004083104A1
- Authority
- US
- United States
- Prior art keywords
- speaker
- audio segments
- unidentified
- user
- speakers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/32—Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
Definitions
- the present invention relates generally to multimedia environments and, more particularly, to systems and methods for providing interactive speech identification training in a multimedia environment.
- the system requires a huge amount of training data.
- the system requires several minutes of speech to generate a Gaussian mixture model that can later be used to locate segments of speech from the same speaker.
- it is difficult to obtain sufficient training data from speakers who do not routinely speak or who speak in only small bursts i.e., one to two sentences at a time).
- Systems and methods consistent with the present invention collect data for training a speaker identification system in an interactive manner. Users may be prompted to identify speaker turns for unidentified or incorrectly identified speakers. The data from the users may be used to generate new speaker models and/or update links to existing speaker models. The speaker models may then be used to correctly label speaker turns.
- a system provides speaker identification training.
- the system generates speaker models and receives audio segments.
- the system identifies speakers corresponding to the audio segments based on the speaker models. At least one of the audio segments has an unidentified or misidentified speaker (i.e., an audio segment whose speaker cannot be accurately identified).
- the system presents, to a user, audio segments that include an audio segment whose speaker is unidentified or misidentified and receives, from the user, the name of the unidentified or misidentified speaker.
- the system may use this information to subsequently identify the unidentified or misidentified speaker by name for future audio segments.
- a speaker identification system in another aspect consistent with the principles of the invention, includes an indexer and a server.
- the indexer is configured to generate speaker models, receive audio segments, and identify speakers corresponding to the audio segments based on the speaker models.
- the indexer is unable to correctly identify at least one of the speakers corresponding to the audio segments.
- the server is configured to receive, from a user, the name of an unidentified speaker of the speakers corresponding to the audio segments, and provide the name of the unidentified speaker to the indexer for identification of the unidentified speaker in subsequent audio segments.
- a computer-readable medium stores instructions executable by one or more processors for speaker identification training by a speaker identification system.
- the computer-readable medium includes instructions for generating speaker models based on training data; instructions for presenting, to a user, audio segments for which no speakers can be identified from the speaker models; instructions for obtaining, from the user, a name of a speaker for at least one of the audio segments; instructions for generating a new speaker model for the speaker based on the at least one audio segment; and instructions for associating the name of the speaker with the new speaker model.
- a speaker identification system includes an indexer, a database, and a server.
- the indexer receives speech segments, where each of the speech segments has a corresponding speaker.
- the indexer also creates documents by transcribing the speech segments and identifies the names of the speakers corresponding to the speech segments.
- the indexer is unable to correctly identify the names of at least one of the speakers corresponding to the speech segments.
- some of the speakers are identified speakers and others of the speakers are unidentified speakers.
- the database stores the documents.
- the server retrieves one or more of the documents from the database and presents the one or more of the documents to a user.
- the server receives, from the user, the name of one of the unidentified speakers and provides the name of the unidentified speaker to the indexer for subsequent identification of speech segments from the unidentified speaker.
- FIG. 1 is a diagram of a system in which systems and methods consistent with the present invention may be implemented
- FIG. 2 is an exemplary diagram of the indexer of FIG. 1 according to an implementation consistent with the principles of the invention
- FIG. 3 is an exemplary diagram of a portion of the recognition system of FIG. 2 according to an implementation consistent with the present invention
- FIG. 4 is an exemplary diagram of the memory system of FIG. 1 according to an implementation consistent with the principles of the invention
- FIGS. 5 A- 5 C are flowcharts of exemplary processing for speaker identification training according to an implementation consistent with the principles of the invention.
- FIG. 6 is a diagram of an exemplary graphical user interface by which a document may be presented to a user according to an implementation consistent with the principles of the invention.
- Systems and methods consistent with the present invention permit users to aid in the training of a speaker identification system by, for example, correctly identifying unidentified and misidentified speakers.
- the systems and methods may use the user-identification of unidentified speakers to train new speaker models for improved recognition results.
- the systems and methods may use the user-identification of misidentified speakers to update links to existing speaker models.
- FIG. 1 is a diagram of an exemplary system 100 in which systems and methods consistent with the present invention may be implemented.
- System 100 may include multimedia (MM) sources 110 , indexer 120 , memory system 130 , and server 140 connected to clients 150 via network 160 .
- Network 160 may include any type of network, such as a local area network (LAN), a wide area network (WAN) (e.g., the Internet), a public telephone network (e.g., the Public Switched Telephone Network (PSTN)), a virtual private network (VPN), or a combination of networks.
- LAN local area network
- WAN wide area network
- PSTN Public Switched Telephone Network
- VPN virtual private network
- the various connections shown in FIG. 1 may be made via wired, wireless, and/or optical connections.
- Multimedia sources 110 may include one or more audio sources and/or one or more video sources.
- An audio source may include any source of audio data, such as radio, telephone, and conversations in any language.
- a video source may include any source of video data with integrated audio data in any language, such as television, satellite, and a camcorder. The audio and/or video data may be provided to indexer 120 as a stream or file.
- Indexer 120 may include mechanisms for processing audio and/or video data. Indexer 120 may include mechanisms that receive data from multimedia sources 110 , process the data, perform feature extraction, and output analyzed, marked-up, and enhanced language metadata. In one implementation consistent with the principles of the invention, indexer 120 includes mechanisms, such as the ones described in John Makhoul et al., “Speech and Language Technologies for Audio Indexing and Retrieval,” Proceedings of the IEEE, Vol. 88, No. 8, August 2000, pp. 1338-1353, which is incorporated herein by reference.
- FIG. 2 is an exemplary diagram of indexer 120 according to an implementation consistent with the principles of the invention.
- Indexer 120 may include training system 210 , statistical model 220 , and recognition system 230 .
- Training system 210 may include logic that estimates parameters of statistical model 220 from a corpus of training data.
- the training data may initially include human-produced data.
- the training data might include one hundred hours of audio data that has been meticulously and accurately transcribed by a human.
- Training system 210 may use the training data to generate parameters for statistical model 220 that recognition system 230 may later use to recognize future data that it receives (i.e., new audio that it has not heard before).
- the training data might also include audio data for which the speaker has been identified.
- Training system 210 may use the training data to generate parameters for statistical speaker models that recognition system 230 may later use to recognize speakers from future data that it receives.
- training system 210 may use a speaker independent Gaussian mixture model with approximately 2,048 Gaussians. This Gaussian mixture model may be trained based on a lot of diversified speakers (e.g., speakers of different ages, different genders, etc.).
- Training system 210 may use a conventional expectation and maximization process to fit audio from a speaker to the model. Training system 210 may then use a conventional maximum a posteriori adaptation process to generate a final model for the speaker.
- Statistical model 220 may include acoustic models, language models, and speaker models.
- the acoustic models may describe the time-varying evolution of feature vectors for each sound or phoneme.
- the acoustic models may employ continuous hidden Markov models (HMMs) to model each of the phonemes in the various phonetic contexts.
- HMMs continuous hidden Markov models
- the language models may include n-gram language models, where the probability of each word is a function of the previous word (for a bi-gram language model) and the previous two words (for a tri-gram language model).
- the higher the order of the language model the higher the recognition accuracy at the cost of slower recognition speeds.
- the speaker models may include a pool of models that are used to identify speakers from their speech. Speech from a particular speaker may be compared to the speaker models to determine the likelihood that the speech was produced from each of the models. The model with the highest likelihood may be determined to correspond to that speech. The particular speaker corresponding to the model may be determined based, for example, on a mapping function that links speaker names to speaker models.
- Recognition system 230 may use statistical model 220 to process input audio data.
- FIG. 3 is an exemplary diagram of a portion of recognition system 230 according to an implementation consistent with the principles of the invention.
- Recognition system 230 may include speaker segmentation logic 310 , speech recognition logic 320 , speaker clustering logic 330 , and speaker identification logic 340 .
- the functions performed by speaker segmentation logic 310 , speech recognition logic 320 , speaker clustering logic 330 , and speaker identification logic 340 are similar to the functions described in John Makhoul et al., “Speech and Language Technologies for Audio Indexing and Retrieval,” Proceedings of the IEEE, Vol. 88, No. 8, August 2000, pp. 1338-1353, which was previously incorporated herein by reference.
- speaker segmentation logic 310 may distinguish speech from silence, noise, and other audio signals in input audio data. For example, speaker segmentation logic 310 may analyze each thirty second window of the input data to determine whether it contains speech. Speaker segmentation logic 310 may also identify boundaries between speakers in the input stream. Speaker segmentation logic 310 may group speech segments from the same speaker and send the segments to speech recognition logic 320 .
- Speech recognition logic 320 may perform continuous speech recognition to recognize the words spoken in the segments that it receives from speaker segmentation logic 310 .
- Speech recognition logic 320 may generate a transcription of the speech using statistical model 220 .
- Speaker clustering logic 330 may identify all of the segments from the same speaker in a single document (i.e., a body of media that is contiguous in time (from beginning to end or from time A to time B)) and group them into speaker clusters (or speaker turns). Speaker clustering logic 330 may then assign each of the speaker turns a unique label.
- Speaker identification logic 340 may identify the speaker in each speaker turn by name or, when the name cannot be determined, by gender. Speaker identification logic 340 may use the speaker models within statistical model 220 to identify speakers from their speech. For example, speaker identification logic 340 may compare speech from a particular speaker within a speaker turn to the speaker models to determine the likelihood that the speech was produced from each of the models. Speaker identification logic 340 may identify the model with the highest likelihood (above some threshold) as the model corresponding to that speech. Speaker identification logic 340 may include a mapping function that links speaker names to the speaker models so that speaker identification logic 340 can identify the speaker by name once a model has been identified.
- memory system 130 may store documents from indexer 120 and, possibly, documents from clients 150 .
- FIG. 4 is an exemplary diagram of memory system 130 according to an implementation consistent with the principles of the invention.
- Memory system 130 may include loader 410 , trainer 420 , one or more databases 430 , and interface 440 .
- Loader 410 may include logic that receives documents from indexer 120 and stores them in database 430 .
- Trainer 420 may include logic that sends speaker identification information, such as audio data with identification of the corresponding speaker, in the form of training data to indexer 120 .
- Database 430 may include a conventional database, such as a relational database, that stores documents from indexer 120 .
- Database 430 may also store documents received from clients 150 via server 140 .
- Interface 440 may include logic that interacts with server 140 to store documents in database 130 , query or search database 130 , and retrieve documents from database 130 .
- server 140 may include a computer (e.g., a processor and memory) or another device that is capable of interacting with memory system 130 and clients 150 via network 170 .
- Server 140 may receive queries from clients 150 and use the queries to retrieve relevant documents from memory system 130 .
- Clients 150 may include personal computers, laptops, personal digital assistants, or other types of devices that are capable of interacting with server 140 to retrieve documents from memory system 130 . Clients 150 may present information to users via a graphical user interface, such as a web browser window.
- a graphical user interface such as a web browser window.
- Systems and methods consistent with the present invention permit users to assist in speaker identification training to improve recognition results of system 100 .
- the user may supply the name of an unidentified or misidentified speaker that may be used to retrain indexer 120 .
- FIGS. 5 A- 5 C are flowcharts of exemplary processing for speaker identification training according to an implementation consistent with the principles of the invention. Processing may begin with a user desiring to retrieve one or more documents from memory system 130 .
- the user may use a conventional web browser of client 150 to access server 140 in a conventional manner.
- the user may generate a search query and send the query to server 140 via client 150 .
- Server 140 may use the query to search memory system 130 and retrieve relevant documents.
- Server 140 may present the relevant documents to the user.
- the user may be presented with a list of relevant documents.
- the documents may include any combination of audio documents and video documents.
- the user may select one or more documents on the list to view. When this happens, the user may be presented with a transcription corresponding to the audio data from the document.
- the user may also be presented with the audio and/or video data corresponding to the transcription.
- FIG. 6 is a diagram of an exemplary graphical user interface (GUI) 600 by which a document may be presented to a user according to an implementation consistent with the principles of the invention.
- GUI 600 is part of an interface of a standard Internet browser, such as Internet Explorer or Netscape Navigator, or any browser that follows World Wide Web Consortium (W3C) specifications for HTML.
- W3C World Wide Web Consortium
- GUI 600 may include a speaker section 610 and a transcription section 620 .
- Speaker section 610 may identify boundaries between speakers, the gender of a speaker, and the name of a speaker (when known). In this way, speaker segments are clustered together over the entire document to group together segments from the same speaker under the same label.
- one speaker, Elizabeth Vargas has been identified by name.
- Other speakers have been identified by gender and number. For example, if “male 1” speaks again within the same document, his speech will also be labeled “male 1.”
- Transcription section 620 may include a transcription of the document.
- the document corresponds to video data from a television broadcast of ABC's World News Tonight.
- GUI 600 may also include playback button 630 .
- the user may select playback button 630 to hear the audio (or possibly see the video) corresponding to the transcription in transcription section 620 .
- the user may select a portion of the transcription in transcription section 620 by, for example, using a mouse to highlight the portion.
- the user may then select playback button 630 to hear the audio (or see the video) corresponding to the selected portion of the transcription.
- GUI 600 may further include a correction button 640 .
- the user may select correction button 640 when the user desires to supply the name of an unidentified speaker or correct the name of a misidentified speaker within speaker section 610 .
- a speaker may be identified only by gender in speaker section 610 because indexer 120 (FIG. 1) can identify the speaker's gender but cannot determine the speaker's name. This may occur when indexer 120 has not yet generated a speaker model corresponding to the speaker due, for example, to a lack of audio data for the speaker.
- a speaker may be misidentified (i.e., labeled with the incorrect speaker name) in speaker section 610 . This may occur when indexer 120 incorrectly matches the audio data from the speaker to a speaker model of another speaker. If the user desires, the user may provide the name of an unidentified speaker or correct the name of a misidentified speaker by selecting correction button 640 and providing the correct information.
- GUI 600 may receive the information provided by the user and modify the document onscreen. This way, the user may determine whether the information was correctly provided. GUI 600 may also send the speaker identification information to server 140 .
- the user may express a desire to provide the name of an unidentified speaker or correct the name of a misidentified speaker.
- the user may identify a segment, such as a speaker turn, within transcription section 620 (FIG. 6) (act 505 ).
- the user may identify the speaker turn by selecting the corresponding segment using, for example, a mouse or by selecting one of the labels within speaker section 610 .
- the user may then select correction button 640 to initiate the correction.
- Client 150 may determine whether the user has selected to identify the name of an unidentified speaker or correct the name of a misidentified speaker (act 510 ). Client 150 may make this determination based on the current speaker label provided in speaker section 610 for the segment identified by the user. For example, if the current speaker label includes a gender identification, then client 150 may determine that the user has selected to identify the name of an unidentified speaker. If, on the other hand, the current speaker label includes something other than a gender identification, then client 150 may determine that the user has selected to correct the name of a misidentified speaker.
- Client 150 may provide the name and, possibly, other identifying information, as speaker identification information, to server 140 .
- the other identifying information may include, for example, an indication of the audio segment to which the name corresponds, the audio (or video) data corresponding to the segment, and/or other information that may be useful for training indexer 120 to later identify audio data from this same speaker.
- Server 140 may determine whether additional audio data is necessary or desired (act 520 ). For example, server 140 may determine whether the amount of audio data associated with the audio segment labeled by the user is less than approximately four minutes of audio. As explained above, the minimum amount of audio data needed to build a good Gaussian mixture model (with over 2,000 Gaussians) is approximately four minutes of audio.
- server 140 may locate additional audio segments that may be from the same speaker (act 525 ). Server 140 may identify these additional audio segments based on the speaker clustering performed by indexer 120 . Using the speaker clustering, more, similar audio segments may be identified in the same document and in other documents within memory system 130 .
- sever 140 may confirm with the user that the audio segment is from the same speaker identified by the user (act 530 ). Server 140 may continue to obtain additional audio segments and confirm them with the user until it obtains around four minutes or more of audio data or the user expresses a desire to cease the confirmations.
- server 140 may provide the audio data, along with the name of the speaker, to indexer 120 as training data.
- Indexer 120 may use the audio data to build a speaker model for the new speaker (act 535 ).
- indexer 120 may use a speaker independent Gaussian mixture model with approximately 2,048 Gaussians. This Gaussian mixture model may be trained based on a lot of diversified speakers (e.g., speakers of different ages, different genders, etc.).
- Indexer 120 may use a conventional expectation and maximization process to fit the audio data from the speaker to the model. Indexer 120 may then use a conventional maximum a posteriori adaptation process to generate a final model for the speaker.
- Indexer 120 may add the speaker model to the pool of speaker models within statistical model 220 (FIG. 2) (act 540 ). Thereafter, indexer 120 may correctly identify new audio data that it receives corresponding to the new speaker.
- Client 150 may provide the correct name and, possibly, other identifying information, as speaker identification information, to server 140 .
- the other identifying information may include, for example, an indication of the segment (e.g., speaker turn) to which the name corresponds, the audio (or video) data corresponding to the segment, and/or other information that may be useful for indexer 120 to identify the speaker model corresponding to the speaker.
- Server 140 may determine whether confirmation of additional audio data is necessary or desired (act 550 ). For example, a certain amount of audio data may be needed to accurately identify the incorrectly labeled speaker model. In this case, server 140 may identify other audio segments that are close to the current segment (i.e., the speaker turn that the user identified as mislabeled) (act 555 ). Server 140 may use information relating to the speaker clustering performed by indexer 120 to identify these other potentially mislabeled audio segments. For each segment located, sever 140 may confirm with the user that the speaker turn is also labeled incorrectly (act 560 ). Server 140 may continue to obtain additional audio segments and confirm them with the user until it until some threshold is met or the user expresses a desire to cease the confirmations.
- Server 140 may then provide the audio data, along with the correct name of the speaker, to indexer 120 .
- Indexer 120 may use the audio data to identify the speaker model from which the audio data was produced.
- Indexer 120 may then update the name associated with the identified speaker model (act 565 ). For example, a mapping may exist between the names of speakers and the corresponding speaker models in statistical model 220 . Indexer 120 may update the mapping to identify the correct name of the speaker for that model.
- the user knows only that the speaker is misidentified, but does not know the true identity of the speaker. For example, the user may indicate simply that the name of the speaker associated with the speaker turn is incorrect. In this case, indexer 120 may simply remove the mapping of the incorrect speaker name to the corresponding speaker model.
- indexer 120 compares the audio data to the models in the speaker model pool. Indexer 120 may determine the likelihood that the audio data was created by each of the speaker models. Indexer 120 may identify the speaker model with the highest likelihood (above some threshold) as the speaker model corresponding to the audio data. Indexer 120 may then use its mapping of speaker models to speaker names to identify the speaker of that audio data by name. Indexer 120 may also update the documents in memory system 130 with the speaker name(s) identified by the user.
- Systems and methods consistent with the present invention provide an interactive speaker identification training system. Via these systems and methods, users are permitted to assist in the speaker identification training by, for example, correctly identifying unidentified and misidentified speakers.
- the systems and methods may use the user-identification of unidentified speakers to train new speaker models for improved recognition results.
- the systems and methods may use the user-identification of misidentified speakers to update links to existing speaker models.
- a graphical user interface has been described with regard to FIG. 6 as containing certain features consistent with the principles of the invention. It is to be understood that a graphical user interface, consistent with the present invention, may include any or all of these features or different features to facilitate user assistance in speaker identification training.
- a graphical user interface has been described as performing certain functions. It is to be understood that some, if not all, of these functions may be performed by client 150 or server 140 .
- logic that performs one or more functions.
- This logic may include hardware, such as an application specific integrated circuit or a field programmable gate array, software, or a combination of hardware and software.
Abstract
Description
- This application claims priority under 35 U.S.C. § 119 based on U.S. Provisional Application No. 60/419,214, filed Oct. 17, 2002, the disclosure of which is incorporated herein by reference.
- This application is related to U.S. patent application, Ser. No. 10/______ (Docket No. 02-4042), entitled “Continuous Learning for Speech Recognition Systems,” filed concurrently herewith, and U.S. patent application, Ser. No. 10/610,533 (Docket No. 02-4046), entitled “Systems and Methods for Improving Recognition Results via User-Augmentation of a Database,” filed Jul. 2, 2003, the disclosures of which are incorporated herein by reference.
- 1. Field of the Invention
- The present invention relates generally to multimedia environments and, more particularly, to systems and methods for providing interactive speech identification training in a multimedia environment.
- 2. Description of Related Art
- Conventional speaker identification systems require a huge amount of training data to identify speakers based on audio data received from the speakers. These systems typically train a set of models based on the training data. When audio data is received by one of these systems, the system segments the audio data into speaker turns. The system then analyzes each of the speaker turns to determine whether it matches one of the models. If a speaker turn matches one of the models, the system labels the speaker turn with the name of the speaker.
- For proper speaker identification, the system requires a huge amount of training data. For each speaker, for example, the system requires several minutes of speech to generate a Gaussian mixture model that can later be used to locate segments of speech from the same speaker. In some situations, it is difficult to obtain a sufficient amount of training data to generate an accurate Gaussian mixture model. For example, it is difficult to obtain sufficient training data from speakers who do not routinely speak or who speak in only small bursts (i.e., one to two sentences at a time).
- As a result, there is a need for mechanisms to improve speaker identification results even for speakers where there is insufficient training data.
- Systems and methods consistent with the present invention collect data for training a speaker identification system in an interactive manner. Users may be prompted to identify speaker turns for unidentified or incorrectly identified speakers. The data from the users may be used to generate new speaker models and/or update links to existing speaker models. The speaker models may then be used to correctly label speaker turns.
- In one aspect consistent with the principles of the invention, a system provides speaker identification training. The system generates speaker models and receives audio segments. The system identifies speakers corresponding to the audio segments based on the speaker models. At least one of the audio segments has an unidentified or misidentified speaker (i.e., an audio segment whose speaker cannot be accurately identified). The system presents, to a user, audio segments that include an audio segment whose speaker is unidentified or misidentified and receives, from the user, the name of the unidentified or misidentified speaker. The system may use this information to subsequently identify the unidentified or misidentified speaker by name for future audio segments.
- In another aspect consistent with the principles of the invention, a speaker identification system is provided. The system includes an indexer and a server. The indexer is configured to generate speaker models, receive audio segments, and identify speakers corresponding to the audio segments based on the speaker models. The indexer is unable to correctly identify at least one of the speakers corresponding to the audio segments. The server is configured to receive, from a user, the name of an unidentified speaker of the speakers corresponding to the audio segments, and provide the name of the unidentified speaker to the indexer for identification of the unidentified speaker in subsequent audio segments.
- In a further aspect consistent with the principles of the invention, a computer-readable medium stores instructions executable by one or more processors for speaker identification training by a speaker identification system. The computer-readable medium includes instructions for generating speaker models based on training data; instructions for presenting, to a user, audio segments for which no speakers can be identified from the speaker models; instructions for obtaining, from the user, a name of a speaker for at least one of the audio segments; instructions for generating a new speaker model for the speaker based on the at least one audio segment; and instructions for associating the name of the speaker with the new speaker model.
- In another aspect consistent with the principles of the invention, a speaker identification system includes an indexer, a database, and a server. The indexer receives speech segments, where each of the speech segments has a corresponding speaker. The indexer also creates documents by transcribing the speech segments and identifies the names of the speakers corresponding to the speech segments. The indexer is unable to correctly identify the names of at least one of the speakers corresponding to the speech segments. As a result, some of the speakers are identified speakers and others of the speakers are unidentified speakers. The database stores the documents. The server retrieves one or more of the documents from the database and presents the one or more of the documents to a user. The server receives, from the user, the name of one of the unidentified speakers and provides the name of the unidentified speaker to the indexer for subsequent identification of speech segments from the unidentified speaker.
- The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate the invention and, together with the description, explain the invention. In the drawings,
- FIG. 1 is a diagram of a system in which systems and methods consistent with the present invention may be implemented;
- FIG. 2 is an exemplary diagram of the indexer of FIG. 1 according to an implementation consistent with the principles of the invention;
- FIG. 3 is an exemplary diagram of a portion of the recognition system of FIG. 2 according to an implementation consistent with the present invention;
- FIG. 4 is an exemplary diagram of the memory system of FIG. 1 according to an implementation consistent with the principles of the invention;
- FIGS.5A-5C are flowcharts of exemplary processing for speaker identification training according to an implementation consistent with the principles of the invention; and
- FIG. 6 is a diagram of an exemplary graphical user interface by which a document may be presented to a user according to an implementation consistent with the principles of the invention.
- The following detailed description of the invention refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. Also, the following detailed description does not limit the invention. Instead, the scope of the invention is defined by the appended claims and equivalents.
- Systems and methods consistent with the present invention permit users to aid in the training of a speaker identification system by, for example, correctly identifying unidentified and misidentified speakers. The systems and methods may use the user-identification of unidentified speakers to train new speaker models for improved recognition results. The systems and methods may use the user-identification of misidentified speakers to update links to existing speaker models.
- FIG. 1 is a diagram of an
exemplary system 100 in which systems and methods consistent with the present invention may be implemented.System 100 may include multimedia (MM)sources 110,indexer 120,memory system 130, andserver 140 connected toclients 150 vianetwork 160.Network 160 may include any type of network, such as a local area network (LAN), a wide area network (WAN) (e.g., the Internet), a public telephone network (e.g., the Public Switched Telephone Network (PSTN)), a virtual private network (VPN), or a combination of networks. The various connections shown in FIG. 1 may be made via wired, wireless, and/or optical connections. -
Multimedia sources 110 may include one or more audio sources and/or one or more video sources. An audio source may include any source of audio data, such as radio, telephone, and conversations in any language. A video source may include any source of video data with integrated audio data in any language, such as television, satellite, and a camcorder. The audio and/or video data may be provided toindexer 120 as a stream or file. - Indexer120 may include mechanisms for processing audio and/or video data.
Indexer 120 may include mechanisms that receive data frommultimedia sources 110, process the data, perform feature extraction, and output analyzed, marked-up, and enhanced language metadata. In one implementation consistent with the principles of the invention,indexer 120 includes mechanisms, such as the ones described in John Makhoul et al., “Speech and Language Technologies for Audio Indexing and Retrieval,” Proceedings of the IEEE, Vol. 88, No. 8, August 2000, pp. 1338-1353, which is incorporated herein by reference. - FIG. 2 is an exemplary diagram of
indexer 120 according to an implementation consistent with the principles of the invention.Indexer 120 may includetraining system 210,statistical model 220, andrecognition system 230.Training system 210 may include logic that estimates parameters ofstatistical model 220 from a corpus of training data. The training data may initially include human-produced data. For example, the training data might include one hundred hours of audio data that has been meticulously and accurately transcribed by a human.Training system 210 may use the training data to generate parameters forstatistical model 220 thatrecognition system 230 may later use to recognize future data that it receives (i.e., new audio that it has not heard before). - The training data might also include audio data for which the speaker has been identified.
Training system 210 may use the training data to generate parameters for statistical speaker models thatrecognition system 230 may later use to recognize speakers from future data that it receives. To build a speaker model for a new speaker,training system 210 may use a speaker independent Gaussian mixture model with approximately 2,048 Gaussians. This Gaussian mixture model may be trained based on a lot of diversified speakers (e.g., speakers of different ages, different genders, etc.).Training system 210 may use a conventional expectation and maximization process to fit audio from a speaker to the model.Training system 210 may then use a conventional maximum a posteriori adaptation process to generate a final model for the speaker. -
Statistical model 220 may include acoustic models, language models, and speaker models. The acoustic models may describe the time-varying evolution of feature vectors for each sound or phoneme. The acoustic models may employ continuous hidden Markov models (HMMs) to model each of the phonemes in the various phonetic contexts. - The language models may include n-gram language models, where the probability of each word is a function of the previous word (for a bi-gram language model) and the previous two words (for a tri-gram language model). Typically, the higher the order of the language model, the higher the recognition accuracy at the cost of slower recognition speeds.
- The speaker models may include a pool of models that are used to identify speakers from their speech. Speech from a particular speaker may be compared to the speaker models to determine the likelihood that the speech was produced from each of the models. The model with the highest likelihood may be determined to correspond to that speech. The particular speaker corresponding to the model may be determined based, for example, on a mapping function that links speaker names to speaker models.
-
Recognition system 230 may usestatistical model 220 to process input audio data. FIG. 3 is an exemplary diagram of a portion ofrecognition system 230 according to an implementation consistent with the principles of the invention.Recognition system 230 may includespeaker segmentation logic 310,speech recognition logic 320,speaker clustering logic 330, andspeaker identification logic 340. In one implementation consistent with the principles of the invention, the functions performed byspeaker segmentation logic 310,speech recognition logic 320,speaker clustering logic 330, andspeaker identification logic 340 are similar to the functions described in John Makhoul et al., “Speech and Language Technologies for Audio Indexing and Retrieval,” Proceedings of the IEEE, Vol. 88, No. 8, August 2000, pp. 1338-1353, which was previously incorporated herein by reference. - Generally,
speaker segmentation logic 310 may distinguish speech from silence, noise, and other audio signals in input audio data. For example,speaker segmentation logic 310 may analyze each thirty second window of the input data to determine whether it contains speech.Speaker segmentation logic 310 may also identify boundaries between speakers in the input stream.Speaker segmentation logic 310 may group speech segments from the same speaker and send the segments tospeech recognition logic 320. -
Speech recognition logic 320 may perform continuous speech recognition to recognize the words spoken in the segments that it receives fromspeaker segmentation logic 310.Speech recognition logic 320 may generate a transcription of the speech usingstatistical model 220.Speaker clustering logic 330 may identify all of the segments from the same speaker in a single document (i.e., a body of media that is contiguous in time (from beginning to end or from time A to time B)) and group them into speaker clusters (or speaker turns).Speaker clustering logic 330 may then assign each of the speaker turns a unique label. -
Speaker identification logic 340 may identify the speaker in each speaker turn by name or, when the name cannot be determined, by gender.Speaker identification logic 340 may use the speaker models withinstatistical model 220 to identify speakers from their speech. For example,speaker identification logic 340 may compare speech from a particular speaker within a speaker turn to the speaker models to determine the likelihood that the speech was produced from each of the models.Speaker identification logic 340 may identify the model with the highest likelihood (above some threshold) as the model corresponding to that speech.Speaker identification logic 340 may include a mapping function that links speaker names to the speaker models so thatspeaker identification logic 340 can identify the speaker by name once a model has been identified. - Returning to FIG. 1,
memory system 130 may store documents fromindexer 120 and, possibly, documents fromclients 150. FIG. 4 is an exemplary diagram ofmemory system 130 according to an implementation consistent with the principles of the invention.Memory system 130 may includeloader 410,trainer 420, one ormore databases 430, andinterface 440.Loader 410 may include logic that receives documents fromindexer 120 and stores them indatabase 430.Trainer 420 may include logic that sends speaker identification information, such as audio data with identification of the corresponding speaker, in the form of training data toindexer 120. -
Database 430 may include a conventional database, such as a relational database, that stores documents fromindexer 120.Database 430 may also store documents received fromclients 150 viaserver 140.Interface 440 may include logic that interacts withserver 140 to store documents indatabase 130, query orsearch database 130, and retrieve documents fromdatabase 130. - Returning to FIG. 1,
server 140 may include a computer (e.g., a processor and memory) or another device that is capable of interacting withmemory system 130 andclients 150 via network 170.Server 140 may receive queries fromclients 150 and use the queries to retrieve relevant documents frommemory system 130. -
Clients 150 may include personal computers, laptops, personal digital assistants, or other types of devices that are capable of interacting withserver 140 to retrieve documents frommemory system 130.Clients 150 may present information to users via a graphical user interface, such as a web browser window. - Systems and methods consistent with the present invention permit users to assist in speaker identification training to improve recognition results of
system 100. For example, the user may supply the name of an unidentified or misidentified speaker that may be used to retrainindexer 120. - FIGS.5A-5C are flowcharts of exemplary processing for speaker identification training according to an implementation consistent with the principles of the invention. Processing may begin with a user desiring to retrieve one or more documents from
memory system 130. The user may use a conventional web browser ofclient 150 to accessserver 140 in a conventional manner. To obtain documents of interest, the user may generate a search query and send the query toserver 140 viaclient 150.Server 140 may use the query to searchmemory system 130 and retrieve relevant documents. -
Server 140 may present the relevant documents to the user. For example, the user may be presented with a list of relevant documents. The documents may include any combination of audio documents and video documents. The user may select one or more documents on the list to view. When this happens, the user may be presented with a transcription corresponding to the audio data from the document. The user may also be presented with the audio and/or video data corresponding to the transcription. - FIG. 6 is a diagram of an exemplary graphical user interface (GUI)600 by which a document may be presented to a user according to an implementation consistent with the principles of the invention. In one implementation,
GUI 600 is part of an interface of a standard Internet browser, such as Internet Explorer or Netscape Navigator, or any browser that follows World Wide Web Consortium (W3C) specifications for HTML. -
GUI 600 may include aspeaker section 610 and atranscription section 620.Speaker section 610 may identify boundaries between speakers, the gender of a speaker, and the name of a speaker (when known). In this way, speaker segments are clustered together over the entire document to group together segments from the same speaker under the same label. In the example of FIG. 6, one speaker, Elizabeth Vargas, has been identified by name. Other speakers have been identified by gender and number. For example, if “male 1” speaks again within the same document, his speech will also be labeled “male 1.”Transcription section 620 may include a transcription of the document. In the example of FIG. 6, the document corresponds to video data from a television broadcast of ABC's World News Tonight. -
GUI 600 may also includeplayback button 630. The user may selectplayback button 630 to hear the audio (or possibly see the video) corresponding to the transcription intranscription section 620. To facilitate this, the user may select a portion of the transcription intranscription section 620 by, for example, using a mouse to highlight the portion. The user may then selectplayback button 630 to hear the audio (or see the video) corresponding to the selected portion of the transcription. -
GUI 600 may further include acorrection button 640. The user may selectcorrection button 640 when the user desires to supply the name of an unidentified speaker or correct the name of a misidentified speaker withinspeaker section 610. Sometimes, a speaker may be identified only by gender inspeaker section 610 because indexer 120 (FIG. 1) can identify the speaker's gender but cannot determine the speaker's name. This may occur whenindexer 120 has not yet generated a speaker model corresponding to the speaker due, for example, to a lack of audio data for the speaker. Sometimes, a speaker may be misidentified (i.e., labeled with the incorrect speaker name) inspeaker section 610. This may occur whenindexer 120 incorrectly matches the audio data from the speaker to a speaker model of another speaker. If the user desires, the user may provide the name of an unidentified speaker or correct the name of a misidentified speaker by selectingcorrection button 640 and providing the correct information. -
GUI 600 may receive the information provided by the user and modify the document onscreen. This way, the user may determine whether the information was correctly provided.GUI 600 may also send the speaker identification information toserver 140. - Returning to FIG. 5A, the user may express a desire to provide the name of an unidentified speaker or correct the name of a misidentified speaker. In doing so, the user may identify a segment, such as a speaker turn, within transcription section620 (FIG. 6) (act 505). The user may identify the speaker turn by selecting the corresponding segment using, for example, a mouse or by selecting one of the labels within
speaker section 610. The user may then selectcorrection button 640 to initiate the correction. -
Client 150 may determine whether the user has selected to identify the name of an unidentified speaker or correct the name of a misidentified speaker (act 510).Client 150 may make this determination based on the current speaker label provided inspeaker section 610 for the segment identified by the user. For example, if the current speaker label includes a gender identification, thenclient 150 may determine that the user has selected to identify the name of an unidentified speaker. If, on the other hand, the current speaker label includes something other than a gender identification, thenclient 150 may determine that the user has selected to correct the name of a misidentified speaker. - If the user desires to provide the name of an unidentified speaker, the user may input the name in any conventional manner (act515) (FIG. 5B).
Client 150 may provide the name and, possibly, other identifying information, as speaker identification information, toserver 140. The other identifying information may include, for example, an indication of the audio segment to which the name corresponds, the audio (or video) data corresponding to the segment, and/or other information that may be useful fortraining indexer 120 to later identify audio data from this same speaker. -
Server 140 may determine whether additional audio data is necessary or desired (act 520). For example,server 140 may determine whether the amount of audio data associated with the audio segment labeled by the user is less than approximately four minutes of audio. As explained above, the minimum amount of audio data needed to build a good Gaussian mixture model (with over 2,000 Gaussians) is approximately four minutes of audio. - If the audio data associated with the audio segment is less than four minutes in length, then
server 140 may locate additional audio segments that may be from the same speaker (act 525).Server 140 may identify these additional audio segments based on the speaker clustering performed byindexer 120. Using the speaker clustering, more, similar audio segments may be identified in the same document and in other documents withinmemory system 130. - For each audio segment located, sever140 may confirm with the user that the audio segment is from the same speaker identified by the user (act 530).
Server 140 may continue to obtain additional audio segments and confirm them with the user until it obtains around four minutes or more of audio data or the user expresses a desire to cease the confirmations. - Once
server 140 collects a sufficient amount of audio data or the user stops the confirmations,server 140 may provide the audio data, along with the name of the speaker, to indexer 120 as training data.Indexer 120 may use the audio data to build a speaker model for the new speaker (act 535). As described above,indexer 120 may use a speaker independent Gaussian mixture model with approximately 2,048 Gaussians. This Gaussian mixture model may be trained based on a lot of diversified speakers (e.g., speakers of different ages, different genders, etc.).Indexer 120 may use a conventional expectation and maximization process to fit the audio data from the speaker to the model.Indexer 120 may then use a conventional maximum a posteriori adaptation process to generate a final model for the speaker. - Indexer120 may add the speaker model to the pool of speaker models within statistical model 220 (FIG. 2) (act 540). Thereafter,
indexer 120 may correctly identify new audio data that it receives corresponding to the new speaker. - If, instead of providing the name of an unidentified speaker, the user desires to correct the name of a misidentified speaker, the user may optionally input the correct name in any conventional manner (act545) (FIG. 5C).
Client 150 may provide the correct name and, possibly, other identifying information, as speaker identification information, toserver 140. The other identifying information may include, for example, an indication of the segment (e.g., speaker turn) to which the name corresponds, the audio (or video) data corresponding to the segment, and/or other information that may be useful forindexer 120 to identify the speaker model corresponding to the speaker. -
Server 140 may determine whether confirmation of additional audio data is necessary or desired (act 550). For example, a certain amount of audio data may be needed to accurately identify the incorrectly labeled speaker model. In this case,server 140 may identify other audio segments that are close to the current segment (i.e., the speaker turn that the user identified as mislabeled) (act 555).Server 140 may use information relating to the speaker clustering performed byindexer 120 to identify these other potentially mislabeled audio segments. For each segment located, sever 140 may confirm with the user that the speaker turn is also labeled incorrectly (act 560).Server 140 may continue to obtain additional audio segments and confirm them with the user until it until some threshold is met or the user expresses a desire to cease the confirmations. -
Server 140 may then provide the audio data, along with the correct name of the speaker, toindexer 120.Indexer 120 may use the audio data to identify the speaker model from which the audio data was produced.Indexer 120 may then update the name associated with the identified speaker model (act 565). For example, a mapping may exist between the names of speakers and the corresponding speaker models instatistical model 220.Indexer 120 may update the mapping to identify the correct name of the speaker for that model. - In an alternate implementation, the user knows only that the speaker is misidentified, but does not know the true identity of the speaker. For example, the user may indicate simply that the name of the speaker associated with the speaker turn is incorrect. In this case,
indexer 120 may simply remove the mapping of the incorrect speaker name to the corresponding speaker model. - When
indexer 120 thereafter comes across audio data corresponding to a speaker that has been identified by the user (either as a result of an unidentified or misidentified speaker turn),indexer 120 compares the audio data to the models in the speaker model pool.Indexer 120 may determine the likelihood that the audio data was created by each of the speaker models.Indexer 120 may identify the speaker model with the highest likelihood (above some threshold) as the speaker model corresponding to the audio data.Indexer 120 may then use its mapping of speaker models to speaker names to identify the speaker of that audio data by name.Indexer 120 may also update the documents inmemory system 130 with the speaker name(s) identified by the user. - Systems and methods consistent with the present invention provide an interactive speaker identification training system. Via these systems and methods, users are permitted to assist in the speaker identification training by, for example, correctly identifying unidentified and misidentified speakers. The systems and methods may use the user-identification of unidentified speakers to train new speaker models for improved recognition results. The systems and methods may use the user-identification of misidentified speakers to update links to existing speaker models.
- The foregoing description of preferred embodiments of the present invention provides illustration and description, but is not intended to be exhaustive or to limit the invention to the precise form disclosed. Modifications and variations are possible in light of the above teachings or may be acquired from practice of the invention.
- For example, an exemplary graphical user interface has been described with regard to FIG. 6 as containing certain features consistent with the principles of the invention. It is to be understood that a graphical user interface, consistent with the present invention, may include any or all of these features or different features to facilitate user assistance in speaker identification training.
- Further, a graphical user interface has been described as performing certain functions. It is to be understood that some, if not all, of these functions may be performed by
client 150 orserver 140. - While series of acts have been described with regard to FIGS.5A-5C, the order of the acts may differ in other implementations consistent with the principles of the invention.
- Further, certain portions of the invention have been described as “logic” that performs one or more functions. This logic may include hardware, such as an application specific integrated circuit or a field programmable gate array, software, or a combination of hardware and software.
- No element, act, or instruction used in the description of the present application should be construed as critical or essential to the invention unless explicitly described as such. Also, as used herein, the article “a” is intended to include one or more items. Where only one item is intended, the term “one” or similar language is used. The scope of the invention is defined by the claims and their equivalents.
Claims (26)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/685,478 US20040083104A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for providing interactive speaker identification training |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US41921402P | 2002-10-17 | 2002-10-17 | |
US10/685,478 US20040083104A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for providing interactive speaker identification training |
Publications (1)
Publication Number | Publication Date |
---|---|
US20040083104A1 true US20040083104A1 (en) | 2004-04-29 |
Family
ID=32110223
Family Applications (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/685,566 Abandoned US20040176946A1 (en) | 2002-10-17 | 2003-10-16 | Pronunciation symbols based on the orthographic lexicon of a language |
US10/685,410 Expired - Fee Related US7389229B2 (en) | 2002-10-17 | 2003-10-16 | Unified clustering tree |
US10/685,586 Abandoned US20040204939A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for speaker change detection |
US10/685,445 Abandoned US20040138894A1 (en) | 2002-10-17 | 2003-10-16 | Speech transcription tool for efficient speech transcription |
US10/685,403 Abandoned US20040083090A1 (en) | 2002-10-17 | 2003-10-16 | Manager for integrating language technology components |
US10/685,565 Active - Reinstated 2026-04-05 US7292977B2 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for providing online fast speaker adaptation in speech recognition |
US10/685,585 Active 2026-01-10 US7424427B2 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for classifying audio into broad phoneme classes |
US10/685,478 Abandoned US20040083104A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for providing interactive speaker identification training |
US10/685,479 Abandoned US20040163034A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for labeling clusters of documents |
Family Applications Before (7)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/685,566 Abandoned US20040176946A1 (en) | 2002-10-17 | 2003-10-16 | Pronunciation symbols based on the orthographic lexicon of a language |
US10/685,410 Expired - Fee Related US7389229B2 (en) | 2002-10-17 | 2003-10-16 | Unified clustering tree |
US10/685,586 Abandoned US20040204939A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for speaker change detection |
US10/685,445 Abandoned US20040138894A1 (en) | 2002-10-17 | 2003-10-16 | Speech transcription tool for efficient speech transcription |
US10/685,403 Abandoned US20040083090A1 (en) | 2002-10-17 | 2003-10-16 | Manager for integrating language technology components |
US10/685,565 Active - Reinstated 2026-04-05 US7292977B2 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for providing online fast speaker adaptation in speech recognition |
US10/685,585 Active 2026-01-10 US7424427B2 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for classifying audio into broad phoneme classes |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/685,479 Abandoned US20040163034A1 (en) | 2002-10-17 | 2003-10-16 | Systems and methods for labeling clusters of documents |
Country Status (1)
Country | Link |
---|---|
US (9) | US20040176946A1 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080065380A1 (en) * | 2006-09-08 | 2008-03-13 | Kwak Keun Chang | On-line speaker recognition method and apparatus thereof |
US20080175556A1 (en) * | 2005-08-24 | 2008-07-24 | Chitra Dorai | System and method for semantic video segmentation based on joint audiovisual and text analysis |
US20090119103A1 (en) * | 2007-10-10 | 2009-05-07 | Franz Gerl | Speaker recognition system |
US20110295603A1 (en) * | 2010-04-28 | 2011-12-01 | Meisel William S | Speech recognition accuracy improvement through speaker categories |
US20120053936A1 (en) * | 2010-08-31 | 2012-03-01 | Fujitsu Limited | System and Method for Generating Videoconference Transcriptions |
US20130144414A1 (en) * | 2011-12-06 | 2013-06-06 | Cisco Technology, Inc. | Method and apparatus for discovering and labeling speakers in a large and growing collection of videos with minimal user effort |
US20140136204A1 (en) * | 2012-11-13 | 2014-05-15 | GM Global Technology Operations LLC | Methods and systems for speech systems |
US8791977B2 (en) | 2010-10-05 | 2014-07-29 | Fujitsu Limited | Method and system for presenting metadata during a videoconference |
US20140244257A1 (en) * | 2013-02-25 | 2014-08-28 | Nuance Communications, Inc. | Method and Apparatus for Automated Speaker Parameters Adaptation in a Deployed Speaker Verification System |
US9754593B2 (en) * | 2015-11-04 | 2017-09-05 | International Business Machines Corporation | Sound envelope deconstruction to identify words and speakers in continuous speech |
US11315545B2 (en) | 2020-07-09 | 2022-04-26 | Raytheon Applied Signal Technology, Inc. | System and method for language identification in audio data |
US11373657B2 (en) * | 2020-05-01 | 2022-06-28 | Raytheon Applied Signal Technology, Inc. | System and method for speaker identification in audio data |
US11862168B1 (en) * | 2020-03-30 | 2024-01-02 | Amazon Technologies, Inc. | Speaker disambiguation and transcription from multiple audio feeds |
Families Citing this family (155)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2002092533A1 (en) * | 2001-05-16 | 2002-11-21 | E.I. Du Pont De Nemours And Company | Dielectric composition with reduced resistance |
ATE508455T1 (en) * | 2002-09-27 | 2011-05-15 | Callminer Inc | METHOD FOR STATISTICALLY ANALYZING LANGUAGE |
WO2004090870A1 (en) * | 2003-04-04 | 2004-10-21 | Kabushiki Kaisha Toshiba | Method and apparatus for encoding or decoding wide-band audio |
US7567908B2 (en) * | 2004-01-13 | 2009-07-28 | International Business Machines Corporation | Differential dynamic content delivery with text display in dependence upon simultaneous speech |
JP2005202014A (en) * | 2004-01-14 | 2005-07-28 | Sony Corp | Audio signal processor, audio signal processing method, and audio signal processing program |
US8923838B1 (en) | 2004-08-19 | 2014-12-30 | Nuance Communications, Inc. | System, method and computer program product for activating a cellular phone account |
JP4220449B2 (en) * | 2004-09-16 | 2009-02-04 | 株式会社東芝 | Indexing device, indexing method, and indexing program |
US7956905B2 (en) * | 2005-02-28 | 2011-06-07 | Fujifilm Corporation | Titling apparatus, a titling method, and a machine readable medium storing thereon a computer program for titling |
GB0511307D0 (en) * | 2005-06-03 | 2005-07-13 | South Manchester University Ho | A method for generating output data |
US8560327B2 (en) * | 2005-08-26 | 2013-10-15 | Nuance Communications, Inc. | System and method for synchronizing sound and manually transcribed text |
US7801893B2 (en) * | 2005-09-30 | 2010-09-21 | Iac Search & Media, Inc. | Similarity detection and clustering of images |
US20070094023A1 (en) * | 2005-10-21 | 2007-04-26 | Callminer, Inc. | Method and apparatus for processing heterogeneous units of work |
US20070094270A1 (en) * | 2005-10-21 | 2007-04-26 | Callminer, Inc. | Method and apparatus for the processing of heterogeneous units of work |
KR100755677B1 (en) * | 2005-11-02 | 2007-09-05 | 삼성전자주식회사 | Apparatus and method for dialogue speech recognition using topic detection |
US8756057B2 (en) * | 2005-11-02 | 2014-06-17 | Nuance Communications, Inc. | System and method using feedback speech analysis for improving speaking ability |
US7503724B2 (en) * | 2005-11-18 | 2009-03-17 | Blacklidge Emulsions, Inc. | Method for bonding prepared substrates for roadways using a low-tracking asphalt emulsion coating |
US20070129943A1 (en) * | 2005-12-06 | 2007-06-07 | Microsoft Corporation | Speech recognition using adaptation and prior knowledge |
CA2536976A1 (en) * | 2006-02-20 | 2007-08-20 | Diaphonics, Inc. | Method and apparatus for detecting speaker change in a voice transaction |
US8996592B2 (en) * | 2006-06-26 | 2015-03-31 | Scenera Technologies, Llc | Methods, systems, and computer program products for identifying a container associated with a plurality of files |
US20080004876A1 (en) * | 2006-06-30 | 2008-01-03 | Chuang He | Non-enrolled continuous dictation |
US20080051916A1 (en) * | 2006-08-28 | 2008-02-28 | Arcadyan Technology Corporation | Method and apparatus for recording streamed audio |
US8073681B2 (en) | 2006-10-16 | 2011-12-06 | Voicebox Technologies, Inc. | System and method for a cooperative conversational voice user interface |
US20080104066A1 (en) * | 2006-10-27 | 2008-05-01 | Yahoo! Inc. | Validating segmentation criteria |
US7272558B1 (en) | 2006-12-01 | 2007-09-18 | Coveo Solutions Inc. | Speech recognition training method for audio and video file indexing on a search engine |
US20080154579A1 (en) * | 2006-12-21 | 2008-06-26 | Krishna Kummamuru | Method of analyzing conversational transcripts |
US7818176B2 (en) | 2007-02-06 | 2010-10-19 | Voicebox Technologies, Inc. | System and method for selecting and presenting advertisements based on natural language processing of voice-based input |
US8386254B2 (en) * | 2007-05-04 | 2013-02-26 | Nuance Communications, Inc. | Multi-class constrained maximum likelihood linear regression |
US20090043797A1 (en) * | 2007-07-27 | 2009-02-12 | Sparkip, Inc. | System And Methods For Clustering Large Database of Documents |
JP4405542B2 (en) * | 2007-10-24 | 2010-01-27 | 株式会社東芝 | Apparatus, method and program for clustering phoneme models |
US9386154B2 (en) | 2007-12-21 | 2016-07-05 | Nuance Communications, Inc. | System, method and software program for enabling communications between customer service agents and users of communication devices |
JPWO2009122779A1 (en) * | 2008-04-03 | 2011-07-28 | 日本電気株式会社 | Text data processing apparatus, method and program |
US9305548B2 (en) | 2008-05-27 | 2016-04-05 | Voicebox Technologies Corporation | System and method for an integrated, multi-modal, multi-device natural language voice services environment |
US9020816B2 (en) * | 2008-08-14 | 2015-04-28 | 21Ct, Inc. | Hidden markov model for speech processing with training method |
CA2680304C (en) * | 2008-09-25 | 2017-08-22 | Multimodal Technologies, Inc. | Decoding-time prediction of non-verbalized tokens |
US8458105B2 (en) | 2009-02-12 | 2013-06-04 | Decisive Analytics Corporation | Method and apparatus for analyzing and interrelating data |
US8326637B2 (en) | 2009-02-20 | 2012-12-04 | Voicebox Technologies, Inc. | System and method for processing multi-modal device interactions in a natural language voice services environment |
US8301446B2 (en) * | 2009-03-30 | 2012-10-30 | Adacel Systems, Inc. | System and method for training an acoustic model with reduced feature space variation |
US8412525B2 (en) * | 2009-04-30 | 2013-04-02 | Microsoft Corporation | Noise robust speech classifier ensemble |
US8713018B2 (en) | 2009-07-28 | 2014-04-29 | Fti Consulting, Inc. | System and method for displaying relationships between electronically stored information to provide classification suggestions via inclusion |
EP2471009A1 (en) | 2009-08-24 | 2012-07-04 | FTI Technology LLC | Generating a reference set for use during document review |
US8554562B2 (en) * | 2009-11-15 | 2013-10-08 | Nuance Communications, Inc. | Method and system for speaker diarization |
US8983958B2 (en) * | 2009-12-21 | 2015-03-17 | Business Objects Software Limited | Document indexing based on categorization and prioritization |
JP5477635B2 (en) * | 2010-02-15 | 2014-04-23 | ソニー株式会社 | Information processing apparatus and method, and program |
EP2539511B1 (en) | 2010-02-24 | 2019-09-11 | Blacklidge Emulsions, Inc. | Hot applied tack coat |
US9009040B2 (en) * | 2010-05-05 | 2015-04-14 | Cisco Technology, Inc. | Training a transcription system |
US8391464B1 (en) | 2010-06-24 | 2013-03-05 | Nuance Communications, Inc. | Customer service system, method, and software program product for responding to queries using natural language understanding |
JP2012038131A (en) * | 2010-08-09 | 2012-02-23 | Sony Corp | Information processing unit, information processing method, and program |
WO2012033873A1 (en) * | 2010-09-10 | 2012-03-15 | Icosystem Corporation | Methods and systems for online advertising with interactive text clouds |
CN102455997A (en) * | 2010-10-27 | 2012-05-16 | 鸿富锦精密工业(深圳)有限公司 | Component name extraction system and method |
KR101172663B1 (en) * | 2010-12-31 | 2012-08-08 | 엘지전자 주식회사 | Mobile terminal and method for grouping application thereof |
US20120197643A1 (en) * | 2011-01-27 | 2012-08-02 | General Motors Llc | Mapping obstruent speech energy to lower frequencies |
GB2489489B (en) * | 2011-03-30 | 2013-08-21 | Toshiba Res Europ Ltd | A speech processing system and method |
US9774747B2 (en) * | 2011-04-29 | 2017-09-26 | Nexidia Inc. | Transcription system |
WO2012174639A1 (en) * | 2011-06-22 | 2012-12-27 | Rogers Communications Inc. | Systems and methods for ranking document clusters |
US9313336B2 (en) | 2011-07-21 | 2016-04-12 | Nuance Communications, Inc. | Systems and methods for processing audio signals captured using microphones of multiple devices |
JP5638479B2 (en) * | 2011-07-26 | 2014-12-10 | 株式会社東芝 | Transcription support system and transcription support method |
JP2013025299A (en) * | 2011-07-26 | 2013-02-04 | Toshiba Corp | Transcription support system and transcription support method |
JP5404726B2 (en) * | 2011-09-26 | 2014-02-05 | 株式会社東芝 | Information processing apparatus, information processing method, and program |
US8433577B2 (en) | 2011-09-27 | 2013-04-30 | Google Inc. | Detection of creative works on broadcast media |
US9002848B1 (en) * | 2011-12-27 | 2015-04-07 | Google Inc. | Automatic incremental labeling of document clusters |
JP2013161205A (en) * | 2012-02-03 | 2013-08-19 | Sony Corp | Information processing device, information processing method and program |
US20130266127A1 (en) | 2012-04-10 | 2013-10-10 | Raytheon Bbn Technologies Corp | System and method for removing sensitive data from a recording |
US20140365221A1 (en) * | 2012-07-31 | 2014-12-11 | Novospeech Ltd. | Method and apparatus for speech recognition |
US8676590B1 (en) | 2012-09-26 | 2014-03-18 | Google Inc. | Web-based audio transcription tool |
US20140207786A1 (en) * | 2013-01-22 | 2014-07-24 | Equivio Ltd. | System and methods for computerized information governance of electronic documents |
US9330167B1 (en) * | 2013-05-13 | 2016-05-03 | Groupon, Inc. | Method, apparatus, and computer program product for classification and tagging of textual data |
US9700227B2 (en) | 2013-09-25 | 2017-07-11 | Bardy Diagnostics, Inc. | Ambulatory electrocardiography monitoring patch optimized for capturing low amplitude cardiac action potential propagation |
US10251576B2 (en) | 2013-09-25 | 2019-04-09 | Bardy Diagnostics, Inc. | System and method for ECG data classification for use in facilitating diagnosis of cardiac rhythm disorders with the aid of a digital computer |
US9408545B2 (en) | 2013-09-25 | 2016-08-09 | Bardy Diagnostics, Inc. | Method for efficiently encoding and compressing ECG data optimized for use in an ambulatory ECG monitor |
US20190167139A1 (en) | 2017-12-05 | 2019-06-06 | Gust H. Bardy | Subcutaneous P-Wave Centric Insertable Cardiac Monitor For Long Term Electrocardiographic Monitoring |
US10888239B2 (en) | 2013-09-25 | 2021-01-12 | Bardy Diagnostics, Inc. | Remote interfacing electrocardiography patch |
US10624551B2 (en) | 2013-09-25 | 2020-04-21 | Bardy Diagnostics, Inc. | Insertable cardiac monitor for use in performing long term electrocardiographic monitoring |
US9655538B2 (en) | 2013-09-25 | 2017-05-23 | Bardy Diagnostics, Inc. | Self-authenticating electrocardiography monitoring circuit |
US10806360B2 (en) | 2013-09-25 | 2020-10-20 | Bardy Diagnostics, Inc. | Extended wear ambulatory electrocardiography and physiological sensor monitor |
US9717432B2 (en) | 2013-09-25 | 2017-08-01 | Bardy Diagnostics, Inc. | Extended wear electrocardiography patch using interlaced wire electrodes |
US10433751B2 (en) | 2013-09-25 | 2019-10-08 | Bardy Diagnostics, Inc. | System and method for facilitating a cardiac rhythm disorder diagnosis based on subcutaneous cardiac monitoring data |
US9775536B2 (en) | 2013-09-25 | 2017-10-03 | Bardy Diagnostics, Inc. | Method for constructing a stress-pliant physiological electrode assembly |
US10799137B2 (en) | 2013-09-25 | 2020-10-13 | Bardy Diagnostics, Inc. | System and method for facilitating a cardiac rhythm disorder diagnosis with the aid of a digital computer |
US10667711B1 (en) | 2013-09-25 | 2020-06-02 | Bardy Diagnostics, Inc. | Contact-activated extended wear electrocardiography and physiological sensor monitor recorder |
US10820801B2 (en) | 2013-09-25 | 2020-11-03 | Bardy Diagnostics, Inc. | Electrocardiography monitor configured for self-optimizing ECG data compression |
US9433367B2 (en) | 2013-09-25 | 2016-09-06 | Bardy Diagnostics, Inc. | Remote interfacing of extended wear electrocardiography and physiological sensor monitor |
US9504423B1 (en) | 2015-10-05 | 2016-11-29 | Bardy Diagnostics, Inc. | Method for addressing medical conditions through a wearable health monitor with the aid of a digital computer |
US9737224B2 (en) | 2013-09-25 | 2017-08-22 | Bardy Diagnostics, Inc. | Event alerting through actigraphy embedded within electrocardiographic data |
US9345414B1 (en) | 2013-09-25 | 2016-05-24 | Bardy Diagnostics, Inc. | Method for providing dynamic gain over electrocardiographic data with the aid of a digital computer |
US11723575B2 (en) | 2013-09-25 | 2023-08-15 | Bardy Diagnostics, Inc. | Electrocardiography patch |
US9619660B1 (en) | 2013-09-25 | 2017-04-11 | Bardy Diagnostics, Inc. | Computer-implemented system for secure physiological data collection and processing |
US9408551B2 (en) | 2013-11-14 | 2016-08-09 | Bardy Diagnostics, Inc. | System and method for facilitating diagnosis of cardiac rhythm disorders with the aid of a digital computer |
US9730593B2 (en) | 2013-09-25 | 2017-08-15 | Bardy Diagnostics, Inc. | Extended wear ambulatory electrocardiography and physiological sensor monitor |
US10736531B2 (en) | 2013-09-25 | 2020-08-11 | Bardy Diagnostics, Inc. | Subcutaneous insertable cardiac monitor optimized for long term, low amplitude electrocardiographic data collection |
US10736529B2 (en) | 2013-09-25 | 2020-08-11 | Bardy Diagnostics, Inc. | Subcutaneous insertable electrocardiography monitor |
US10433748B2 (en) | 2013-09-25 | 2019-10-08 | Bardy Diagnostics, Inc. | Extended wear electrocardiography and physiological sensor monitor |
US9364155B2 (en) | 2013-09-25 | 2016-06-14 | Bardy Diagnostics, Inc. | Self-contained personal air flow sensing monitor |
US9615763B2 (en) | 2013-09-25 | 2017-04-11 | Bardy Diagnostics, Inc. | Ambulatory electrocardiography monitor recorder optimized for capturing low amplitude cardiac action potential propagation |
US9655537B2 (en) | 2013-09-25 | 2017-05-23 | Bardy Diagnostics, Inc. | Wearable electrocardiography and physiology monitoring ensemble |
US10463269B2 (en) | 2013-09-25 | 2019-11-05 | Bardy Diagnostics, Inc. | System and method for machine-learning-based atrial fibrillation detection |
WO2015048194A1 (en) | 2013-09-25 | 2015-04-02 | Bardy Diagnostics, Inc. | Self-contained personal air flow sensing monitor |
US9717433B2 (en) | 2013-09-25 | 2017-08-01 | Bardy Diagnostics, Inc. | Ambulatory electrocardiography monitoring patch optimized for capturing low amplitude cardiac action potential propagation |
US11213237B2 (en) | 2013-09-25 | 2022-01-04 | Bardy Diagnostics, Inc. | System and method for secure cloud-based physiological data processing and delivery |
US20150100582A1 (en) * | 2013-10-08 | 2015-04-09 | Cisco Technology, Inc. | Association of topic labels with digital content |
US9495439B2 (en) * | 2013-10-08 | 2016-11-15 | Cisco Technology, Inc. | Organizing multimedia content |
US9942396B2 (en) * | 2013-11-01 | 2018-04-10 | Adobe Systems Incorporated | Document distribution and interaction |
DE102013224417B3 (en) * | 2013-11-28 | 2015-05-07 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Hearing aid with basic frequency modification, method for processing a speech signal and computer program with a program code for performing the method |
CN104143326B (en) * | 2013-12-03 | 2016-11-02 | 腾讯科技(深圳)有限公司 | A kind of voice command identification method and device |
US9544149B2 (en) | 2013-12-16 | 2017-01-10 | Adobe Systems Incorporated | Automatic E-signatures in response to conditions and/or events |
US9413891B2 (en) | 2014-01-08 | 2016-08-09 | Callminer, Inc. | Real-time conversational analytics facility |
JP6392012B2 (en) * | 2014-07-14 | 2018-09-19 | 株式会社東芝 | Speech synthesis dictionary creation device, speech synthesis device, speech synthesis dictionary creation method, and speech synthesis dictionary creation program |
US9728190B2 (en) * | 2014-07-25 | 2017-08-08 | International Business Machines Corporation | Summarization of audio data |
US9626703B2 (en) | 2014-09-16 | 2017-04-18 | Voicebox Technologies Corporation | Voice commerce |
US9703982B2 (en) | 2014-11-06 | 2017-07-11 | Adobe Systems Incorporated | Document distribution and interaction |
US9531545B2 (en) | 2014-11-24 | 2016-12-27 | Adobe Systems Incorporated | Tracking and notification of fulfillment events |
US9432368B1 (en) | 2015-02-19 | 2016-08-30 | Adobe Systems Incorporated | Document distribution and interaction |
JP6464411B6 (en) * | 2015-02-25 | 2019-03-13 | Dynabook株式会社 | Electronic device, method and program |
US10447646B2 (en) * | 2015-06-15 | 2019-10-15 | International Business Machines Corporation | Online communication modeling and analysis |
US10068445B2 (en) | 2015-06-24 | 2018-09-04 | Google Llc | Systems and methods of home-specific sound event detection |
US10089061B2 (en) * | 2015-08-28 | 2018-10-02 | Kabushiki Kaisha Toshiba | Electronic device and method |
US9935777B2 (en) | 2015-08-31 | 2018-04-03 | Adobe Systems Incorporated | Electronic signature framework with enhanced security |
US20170075652A1 (en) | 2015-09-14 | 2017-03-16 | Kabushiki Kaisha Toshiba | Electronic device and method |
US9626653B2 (en) | 2015-09-21 | 2017-04-18 | Adobe Systems Incorporated | Document distribution and interaction with delegation of signature authority |
WO2017106454A1 (en) | 2015-12-16 | 2017-06-22 | Dolby Laboratories Licensing Corporation | Suppression of breath in audio signals |
US10347215B2 (en) | 2016-05-27 | 2019-07-09 | Adobe Inc. | Multi-device electronic signature framework |
AU2017274558B2 (en) | 2016-06-02 | 2021-11-11 | Nuix North America Inc. | Analyzing clusters of coded documents |
US10255905B2 (en) * | 2016-06-10 | 2019-04-09 | Google Llc | Predicting pronunciations with word stress |
US10217453B2 (en) | 2016-10-14 | 2019-02-26 | Soundhound, Inc. | Virtual assistant configured by selection of wake-up phrase |
US20180232623A1 (en) * | 2017-02-10 | 2018-08-16 | International Business Machines Corporation | Techniques for answering questions based on semantic distances between subjects |
US10503919B2 (en) | 2017-04-10 | 2019-12-10 | Adobe Inc. | Electronic signature framework with keystroke biometric authentication |
US20180336892A1 (en) * | 2017-05-16 | 2018-11-22 | Apple Inc. | Detecting a trigger of a digital assistant |
GB2578386B (en) | 2017-06-27 | 2021-12-01 | Cirrus Logic Int Semiconductor Ltd | Detection of replay attack |
GB2563953A (en) | 2017-06-28 | 2019-01-02 | Cirrus Logic Int Semiconductor Ltd | Detection of replay attack |
GB201713697D0 (en) | 2017-06-28 | 2017-10-11 | Cirrus Logic Int Semiconductor Ltd | Magnetic detection of replay attack |
GB201801532D0 (en) | 2017-07-07 | 2018-03-14 | Cirrus Logic Int Semiconductor Ltd | Methods, apparatus and systems for audio playback |
GB201801528D0 (en) | 2017-07-07 | 2018-03-14 | Cirrus Logic Int Semiconductor Ltd | Method, apparatus and systems for biometric processes |
GB201801527D0 (en) | 2017-07-07 | 2018-03-14 | Cirrus Logic Int Semiconductor Ltd | Method, apparatus and systems for biometric processes |
GB201801526D0 (en) | 2017-07-07 | 2018-03-14 | Cirrus Logic Int Semiconductor Ltd | Methods, apparatus and systems for authentication |
GB201801664D0 (en) | 2017-10-13 | 2018-03-21 | Cirrus Logic Int Semiconductor Ltd | Detection of liveness |
GB201804843D0 (en) | 2017-11-14 | 2018-05-09 | Cirrus Logic Int Semiconductor Ltd | Detection of replay attack |
GB2567503A (en) * | 2017-10-13 | 2019-04-17 | Cirrus Logic Int Semiconductor Ltd | Analysing speech signals |
GB201801661D0 (en) | 2017-10-13 | 2018-03-21 | Cirrus Logic International Uk Ltd | Detection of liveness |
GB201801659D0 (en) | 2017-11-14 | 2018-03-21 | Cirrus Logic Int Semiconductor Ltd | Detection of loudspeaker playback |
TWI625680B (en) | 2017-12-15 | 2018-06-01 | 財團法人工業技術研究院 | Method and device for recognizing facial expressions |
US11475899B2 (en) | 2018-01-23 | 2022-10-18 | Cirrus Logic, Inc. | Speaker identification |
US11264037B2 (en) | 2018-01-23 | 2022-03-01 | Cirrus Logic, Inc. | Speaker identification |
US11735189B2 (en) | 2018-01-23 | 2023-08-22 | Cirrus Logic, Inc. | Speaker identification |
CN109300486B (en) * | 2018-07-30 | 2021-06-25 | 四川大学 | PICGTFs and SSMC enhanced cleft palate speech pharynx fricative automatic identification method |
US10692490B2 (en) | 2018-07-31 | 2020-06-23 | Cirrus Logic, Inc. | Detection of replay attack |
JP7007617B2 (en) * | 2018-08-15 | 2022-01-24 | 日本電信電話株式会社 | End-of-speech judgment device, end-of-speech judgment method and program |
US10915614B2 (en) | 2018-08-31 | 2021-02-09 | Cirrus Logic, Inc. | Biometric authentication |
US11037574B2 (en) | 2018-09-05 | 2021-06-15 | Cirrus Logic, Inc. | Speaker recognition and speaker change detection |
US11116451B2 (en) | 2019-07-03 | 2021-09-14 | Bardy Diagnostics, Inc. | Subcutaneous P-wave centric insertable cardiac monitor with energy harvesting capabilities |
US11096579B2 (en) | 2019-07-03 | 2021-08-24 | Bardy Diagnostics, Inc. | System and method for remote ECG data streaming in real-time |
US11696681B2 (en) | 2019-07-03 | 2023-07-11 | Bardy Diagnostics Inc. | Configurable hardware platform for physiological monitoring of a living body |
US11410642B2 (en) * | 2019-08-16 | 2022-08-09 | Soundhound, Inc. | Method and system using phoneme embedding |
US11354920B2 (en) | 2019-10-12 | 2022-06-07 | International Business Machines Corporation | Updating and implementing a document from an audio proceeding |
US11404049B2 (en) * | 2019-12-09 | 2022-08-02 | Microsoft Technology Licensing, Llc | Interactive augmentation and integration of real-time speech-to-text |
US11875791B2 (en) * | 2020-05-21 | 2024-01-16 | Orcam Technologies Ltd. | Systems and methods for emphasizing a user's name |
CN113284508B (en) * | 2021-07-21 | 2021-11-09 | 中国科学院自动化研究所 | Hierarchical differentiation based generated audio detection system |
Citations (96)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4879648A (en) * | 1986-09-19 | 1989-11-07 | Nancy P. Cochran | Search system which continuously displays search terms during scrolling and selections of individually displayed data sets |
US4908866A (en) * | 1985-02-04 | 1990-03-13 | Eric Goldwasser | Speech transcribing system |
US5317732A (en) * | 1991-04-26 | 1994-05-31 | Commodore Electronics Limited | System for relocating a multimedia presentation on a different platform by extracting a resource map in order to remap and relocate resources |
US5404295A (en) * | 1990-08-16 | 1995-04-04 | Katz; Boris | Method and apparatus for utilizing annotations to facilitate computer retrieval of database material |
US5418716A (en) * | 1990-07-26 | 1995-05-23 | Nec Corporation | System for recognizing sentence patterns and a system for recognizing sentence patterns and grammatical cases |
US5544257A (en) * | 1992-01-08 | 1996-08-06 | International Business Machines Corporation | Continuous parameter hidden Markov model approach to automatic handwriting recognition |
US5559875A (en) * | 1995-07-31 | 1996-09-24 | Latitude Communications | Method and apparatus for recording and retrieval of audio conferences |
US5572728A (en) * | 1993-12-24 | 1996-11-05 | Hitachi, Ltd. | Conference multimedia summary support system and method |
US5613032A (en) * | 1994-09-02 | 1997-03-18 | Bell Communications Research, Inc. | System and method for recording, playing back and searching multimedia events wherein video, audio and text can be searched and retrieved |
US5614940A (en) * | 1994-10-21 | 1997-03-25 | Intel Corporation | Method and apparatus for providing broadcast information with indexing |
US5684924A (en) * | 1995-05-19 | 1997-11-04 | Kurzweil Applied Intelligence, Inc. | User adaptable speech recognition system |
US5715367A (en) * | 1995-01-23 | 1998-02-03 | Dragon Systems, Inc. | Apparatuses and methods for developing and using models for speech recognition |
US5752021A (en) * | 1994-05-24 | 1998-05-12 | Fuji Xerox Co., Ltd. | Document database management apparatus capable of conversion between retrieval formulae for different schemata |
US5757960A (en) * | 1994-09-30 | 1998-05-26 | Murdock; Michael Chase | Method and system for extracting features from handwritten text |
US5768607A (en) * | 1994-09-30 | 1998-06-16 | Intel Corporation | Method and apparatus for freehand annotation and drawings incorporating sound and for compressing and synchronizing sound |
US5777614A (en) * | 1994-10-14 | 1998-07-07 | Hitachi, Ltd. | Editing support system including an interactive interface |
US5787198A (en) * | 1992-11-24 | 1998-07-28 | Lucent Technologies Inc. | Text recognition using two-dimensional stochastic models |
US5806032A (en) * | 1996-06-14 | 1998-09-08 | Lucent Technologies Inc. | Compilation of weighted finite-state transducers from decision trees |
US5835667A (en) * | 1994-10-14 | 1998-11-10 | Carnegie Mellon University | Method and apparatus for creating a searchable digital video library and a system and method of using such a library |
US5862259A (en) * | 1996-03-27 | 1999-01-19 | Caere Corporation | Pattern recognition employing arbitrary segmentation and compound probabilistic evaluation |
US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5960447A (en) * | 1995-11-13 | 1999-09-28 | Holt; Douglas | Word tagging and editing system for speech recognition |
US5963940A (en) * | 1995-08-16 | 1999-10-05 | Syracuse University | Natural language information retrieval system and method |
US5970473A (en) * | 1997-12-31 | 1999-10-19 | At&T Corp. | Video communication device providing in-home catalog services |
US6006221A (en) * | 1995-08-16 | 1999-12-21 | Syracuse University | Multilingual document retrieval system and method using semantic vector matching |
US6006184A (en) * | 1997-01-28 | 1999-12-21 | Nec Corporation | Tree structured cohort selection for speaker recognition system |
US6024571A (en) * | 1996-04-25 | 2000-02-15 | Renegar; Janet Elaine | Foreign language communication system/device and learning aid |
US6029195A (en) * | 1994-11-29 | 2000-02-22 | Herz; Frederick S. M. | System for customized electronic identification of desirable objects |
US6029124A (en) * | 1997-02-21 | 2000-02-22 | Dragon Systems, Inc. | Sequential, nonparametric speech recognition and speaker identification |
US6052657A (en) * | 1997-09-09 | 2000-04-18 | Dragon Systems, Inc. | Text segmentation and identification of topic using language models |
US6064963A (en) * | 1997-12-17 | 2000-05-16 | Opus Telecom, L.L.C. | Automatic key word or phrase speech recognition for the corrections industry |
US6067517A (en) * | 1996-02-02 | 2000-05-23 | International Business Machines Corporation | Transcription of speech data with segments from acoustically dissimilar environments |
US6067514A (en) * | 1998-06-23 | 2000-05-23 | International Business Machines Corporation | Method for automatically punctuating a speech utterance in a continuous speech recognition system |
US6073096A (en) * | 1998-02-04 | 2000-06-06 | International Business Machines Corporation | Speaker adaptation system and method based on class-specific pre-clustering training speakers |
US6076053A (en) * | 1998-05-21 | 2000-06-13 | Lucent Technologies Inc. | Methods and apparatus for discriminative training and adaptation of pronunciation networks |
US6088669A (en) * | 1997-01-28 | 2000-07-11 | International Business Machines, Corporation | Speech recognition with attempted speaker recognition for speaker model prefetching or alternative speech modeling |
US6112172A (en) * | 1998-03-31 | 2000-08-29 | Dragon Systems, Inc. | Interactive searching |
US6151598A (en) * | 1995-08-14 | 2000-11-21 | Shaw; Venson M. | Digital dictionary with a communication system for the creating, updating, editing, storing, maintaining, referencing, and managing the digital dictionary |
US6161087A (en) * | 1998-10-05 | 2000-12-12 | Lernout & Hauspie Speech Products N.V. | Speech-recognition-assisted selective suppression of silent and filled speech pauses during playback of an audio recording |
US6169789B1 (en) * | 1996-12-16 | 2001-01-02 | Sanjay K. Rao | Intelligent keyboard system |
US6185531B1 (en) * | 1997-01-09 | 2001-02-06 | Gte Internetworking Incorporated | Topic indexing method |
US6219640B1 (en) * | 1999-08-06 | 2001-04-17 | International Business Machines Corporation | Methods and apparatus for audio-visual speaker recognition and utterance verification |
US6253179B1 (en) * | 1999-01-29 | 2001-06-26 | International Business Machines Corporation | Method and apparatus for multi-environment speaker verification |
US20010026377A1 (en) * | 2000-03-21 | 2001-10-04 | Katsumi Ikegami | Image display system, image registration terminal device and image reading terminal device used in the image display system |
US6308222B1 (en) * | 1996-06-03 | 2001-10-23 | Microsoft Corporation | Transcoding of audio data |
US20010051984A1 (en) * | 1996-01-30 | 2001-12-13 | Toshihiko Fukasawa | Coordinative work environment construction system, method and medium therefor |
US6332139B1 (en) * | 1998-11-09 | 2001-12-18 | Mega Chips Corporation | Information communication system |
US6332147B1 (en) * | 1995-11-03 | 2001-12-18 | Xerox Corporation | Computer controlled display system using a graphical replay device to control playback of temporal data representing collaborative activities |
US20020001261A1 (en) * | 2000-04-21 | 2002-01-03 | Yoshinori Matsui | Data playback apparatus |
US20020010575A1 (en) * | 2000-04-08 | 2002-01-24 | International Business Machines Corporation | Method and system for the automatic segmentation of an audio stream into semantic or syntactic units |
US20020010916A1 (en) * | 2000-05-22 | 2002-01-24 | Compaq Computer Corporation | Apparatus and method for controlling rate of playback of audio data |
US6345252B1 (en) * | 1999-04-09 | 2002-02-05 | International Business Machines Corporation | Methods and apparatus for retrieving audio information using content and speaker information |
US6347295B1 (en) * | 1998-10-26 | 2002-02-12 | Compaq Computer Corporation | Computer method and apparatus for grapheme-to-phoneme rule-set-generation |
US6360237B1 (en) * | 1998-10-05 | 2002-03-19 | Lernout & Hauspie Speech Products N.V. | Method and system for performing text edits during audio recording playback |
US6360234B2 (en) * | 1997-08-14 | 2002-03-19 | Virage, Inc. | Video cataloger system with synchronized encoders |
US6373985B1 (en) * | 1998-08-12 | 2002-04-16 | Lucent Technologies, Inc. | E-mail signature block analysis |
US20020049589A1 (en) * | 2000-06-28 | 2002-04-25 | Poirier Darrell A. | Simultaneous multi-user real-time voice recognition system |
US6381640B1 (en) * | 1998-09-11 | 2002-04-30 | Genesys Telecommunications Laboratories, Inc. | Method and apparatus for automated personalization and presentation of workload assignments to agents within a multimedia communication center |
US20020059204A1 (en) * | 2000-07-28 | 2002-05-16 | Harris Larry R. | Distributed search system and method |
US6434520B1 (en) * | 1999-04-16 | 2002-08-13 | International Business Machines Corporation | System and method for indexing and querying audio archives |
US6437818B1 (en) * | 1993-10-01 | 2002-08-20 | Collaboration Properties, Inc. | Video conferencing on existing UTP infrastructure |
US20020133477A1 (en) * | 2001-03-05 | 2002-09-19 | Glenn Abel | Method for profile-based notice and broadcast of multimedia content |
US6463444B1 (en) * | 1997-08-14 | 2002-10-08 | Virage, Inc. | Video cataloger system with extensibility |
US6480826B2 (en) * | 1999-08-31 | 2002-11-12 | Accenture Llp | System and method for a telephonic emotion detection that provides operator feedback |
US20020184373A1 (en) * | 2000-11-01 | 2002-12-05 | International Business Machines Corporation | Conversational networking via transport, coding and control conversational protocols |
US20030051214A1 (en) * | 1997-12-22 | 2003-03-13 | Ricoh Company, Ltd. | Techniques for annotating portions of a document relevant to concepts of interest |
US20030088414A1 (en) * | 2001-05-10 | 2003-05-08 | Chao-Shih Huang | Background learning of speaker voices |
US20030093580A1 (en) * | 2001-11-09 | 2003-05-15 | Koninklijke Philips Electronics N.V. | Method and system for information alerts |
US6567980B1 (en) * | 1997-08-14 | 2003-05-20 | Virage, Inc. | Video cataloger system with hyperlinked output |
US6571208B1 (en) * | 1999-11-29 | 2003-05-27 | Matsushita Electric Industrial Co., Ltd. | Context-dependent acoustic models for medium and large vocabulary speech recognition with eigenvoice training |
US6604110B1 (en) * | 2000-08-31 | 2003-08-05 | Ascential Software, Inc. | Automated software code generation from a metadata-based repository |
US6602300B2 (en) * | 1998-02-03 | 2003-08-05 | Fujitsu Limited | Apparatus and method for retrieving data from a document database |
US6611803B1 (en) * | 1998-12-17 | 2003-08-26 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for retrieving a video and audio scene using an index generated by speech recognition |
US20030167163A1 (en) * | 2002-02-22 | 2003-09-04 | Nec Research Institute, Inc. | Inferring hierarchical descriptions of a set of documents |
US6624826B1 (en) * | 1999-09-28 | 2003-09-23 | Ricoh Co., Ltd. | Method and apparatus for generating visual representations for audio documents |
US6647383B1 (en) * | 2000-09-01 | 2003-11-11 | Lucent Technologies Inc. | System and method for providing interactive dialogue and iterative search functions to find information |
US6654735B1 (en) * | 1999-01-08 | 2003-11-25 | International Business Machines Corporation | Outbound information analysis for generating user interest profiles and improving user productivity |
US6708148B2 (en) * | 2001-10-12 | 2004-03-16 | Koninklijke Philips Electronics N.V. | Correction device to mark parts of a recognized text |
US6711541B1 (en) * | 1999-09-07 | 2004-03-23 | Matsushita Electric Industrial Co., Ltd. | Technique for developing discriminative sound units for speech recognition and allophone modeling |
US6714911B2 (en) * | 2001-01-25 | 2004-03-30 | Harcourt Assessment, Inc. | Speech transcription and analysis system and method |
US6718305B1 (en) * | 1999-03-19 | 2004-04-06 | Koninklijke Philips Electronics N.V. | Specifying a tree structure for speech recognizers using correlation between regression classes |
US6718303B2 (en) * | 1998-05-13 | 2004-04-06 | International Business Machines Corporation | Apparatus and method for automatically generating punctuation marks in continuous speech recognition |
US20040073444A1 (en) * | 2001-01-16 | 2004-04-15 | Li Li Peh | Method and apparatus for a financial database structure |
US6732183B1 (en) * | 1996-12-31 | 2004-05-04 | Broadware Technologies, Inc. | Video and audio streaming for multiple users |
US6748356B1 (en) * | 2000-06-07 | 2004-06-08 | International Business Machines Corporation | Methods and apparatus for identifying unknown speakers using a hierarchical tree structure |
US6748350B2 (en) * | 2001-09-27 | 2004-06-08 | Intel Corporation | Method to compensate for stress between heat spreader and thermal interface material |
US6778958B1 (en) * | 1999-08-30 | 2004-08-17 | International Business Machines Corporation | Symbol insertion apparatus and method |
US6792409B2 (en) * | 1999-12-20 | 2004-09-14 | Koninklijke Philips Electronics N.V. | Synchronous reproduction in a speech recognition system |
US6847961B2 (en) * | 1999-06-30 | 2005-01-25 | Silverbrook Research Pty Ltd | Method and system for searching information using sensor with identifier |
US20050060162A1 (en) * | 2000-11-10 | 2005-03-17 | Farhad Mohit | Systems and methods for automatic identification and hyperlinking of words or other data items and for information retrieval using hyperlinked words or data items |
US6922691B2 (en) * | 2000-08-28 | 2005-07-26 | Emotion, Inc. | Method and apparatus for digital media management, retrieval, and collaboration |
US6961954B1 (en) * | 1997-10-27 | 2005-11-01 | The Mitre Corporation | Automated segmentation, information extraction, summarization, and presentation of broadcast news |
US6973428B2 (en) * | 2001-05-24 | 2005-12-06 | International Business Machines Corporation | System and method for searching, analyzing and displaying text transcripts of speech after imperfect speech recognition |
US6999918B2 (en) * | 2002-09-20 | 2006-02-14 | Motorola, Inc. | Method and apparatus to facilitate correlating symbols to sounds |
US7131117B2 (en) * | 2002-09-04 | 2006-10-31 | Sbc Properties, L.P. | Method and system for automating the analysis of word frequencies |
US7257528B1 (en) * | 1998-02-13 | 2007-08-14 | Zi Corporation Of Canada, Inc. | Method and apparatus for Chinese character text input |
Family Cites Families (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0693221B2 (en) | 1985-06-12 | 1994-11-16 | 株式会社日立製作所 | Voice input device |
US4908868A (en) * | 1989-02-21 | 1990-03-13 | Mctaggart James E | Phase polarity test instrument and method |
US6978277B2 (en) * | 1989-10-26 | 2005-12-20 | Encyclopaedia Britannica, Inc. | Multimedia search system |
JP2524472B2 (en) * | 1992-09-21 | 1996-08-14 | インターナショナル・ビジネス・マシーンズ・コーポレイション | How to train a telephone line based speech recognition system |
GB2285895A (en) | 1994-01-19 | 1995-07-26 | Ibm | Audio conferencing system which generates a set of minutes |
US5729656A (en) | 1994-11-30 | 1998-03-17 | International Business Machines Corporation | Reduction of search space in speech recognition using phone boundaries and phone ranking |
US5638487A (en) * | 1994-12-30 | 1997-06-10 | Purespeech, Inc. | Automatic speech recognition |
US6026388A (en) * | 1995-08-16 | 2000-02-15 | Textwise, Llc | User interface and other enhancements for natural language information retrieval system and method |
DE69712277T2 (en) * | 1996-02-27 | 2002-12-19 | Koninkl Philips Electronics Nv | METHOD AND DEVICE FOR AUTOMATIC VOICE SEGMENTATION IN PHONEMIC UNITS |
US5778187A (en) * | 1996-05-09 | 1998-07-07 | Netcast Communications Corp. | Multicasting method and apparatus |
US5897614A (en) * | 1996-12-20 | 1999-04-27 | International Business Machines Corporation | Method and apparatus for sibilant classification in a speech recognition system |
US6317716B1 (en) * | 1997-09-19 | 2001-11-13 | Massachusetts Institute Of Technology | Automatic cueing of speech |
JP2001511991A (en) | 1997-10-01 | 2001-08-14 | エイ・ティ・アンド・ティ・コーポレーション | Method and apparatus for storing and retrieving label interval data for multimedia records |
SE511584C2 (en) * | 1998-01-15 | 1999-10-25 | Ericsson Telefon Ab L M | information Routing |
US6327343B1 (en) | 1998-01-16 | 2001-12-04 | International Business Machines Corporation | System and methods for automatic call and data transfer processing |
US6243680B1 (en) * | 1998-06-15 | 2001-06-05 | Nortel Networks Limited | Method and apparatus for obtaining a transcription of phrases through text and spoken utterances |
US6246983B1 (en) * | 1998-08-05 | 2001-06-12 | Matsushita Electric Corporation Of America | Text-to-speech e-mail reader with multi-modal reply processor |
AU3878600A (en) | 1999-03-30 | 2000-10-16 | Tivo, Inc. | Data storage management and scheduling system |
US6711585B1 (en) * | 1999-06-15 | 2004-03-23 | Kanisa Inc. | System and method for implementing a knowledge management system |
EP1079313A3 (en) | 1999-08-20 | 2005-10-19 | Digitake Software Systems Limited | An audio processing system |
EP1185976B1 (en) * | 2000-02-25 | 2006-08-16 | Philips Electronics N.V. | Speech recognition device with reference transformation means |
JP2002008389A (en) * | 2000-06-20 | 2002-01-11 | Mitsubishi Electric Corp | Semiconductor memory |
US6931376B2 (en) * | 2000-07-20 | 2005-08-16 | Microsoft Corporation | Speech-related event notification system |
WO2002010887A2 (en) | 2000-07-28 | 2002-02-07 | Jan Pathuel | Method and system of securing data and systems |
AU2000276394A1 (en) | 2000-09-30 | 2002-04-15 | Intel Corporation | Method and system for generating and searching an optimal maximum likelihood decision tree for hidden markov model (hmm) based speech recognition |
WO2002029614A1 (en) | 2000-09-30 | 2002-04-11 | Intel Corporation | Method and system to scale down a decision tree-based hidden markov model (hmm) for speech recognition |
US7221663B2 (en) | 2001-12-31 | 2007-05-22 | Polycom, Inc. | Method and apparatus for wideband conferencing |
US6778979B2 (en) * | 2001-08-13 | 2004-08-17 | Xerox Corporation | System for automatically generating queries |
US7668816B2 (en) * | 2002-06-11 | 2010-02-23 | Microsoft Corporation | Dynamically updated quick searches and strategies |
US7580838B2 (en) | 2002-11-22 | 2009-08-25 | Scansoft, Inc. | Automatic insertion of non-verbalized punctuation |
-
2003
- 2003-10-16 US US10/685,566 patent/US20040176946A1/en not_active Abandoned
- 2003-10-16 US US10/685,410 patent/US7389229B2/en not_active Expired - Fee Related
- 2003-10-16 US US10/685,586 patent/US20040204939A1/en not_active Abandoned
- 2003-10-16 US US10/685,445 patent/US20040138894A1/en not_active Abandoned
- 2003-10-16 US US10/685,403 patent/US20040083090A1/en not_active Abandoned
- 2003-10-16 US US10/685,565 patent/US7292977B2/en active Active - Reinstated
- 2003-10-16 US US10/685,585 patent/US7424427B2/en active Active
- 2003-10-16 US US10/685,478 patent/US20040083104A1/en not_active Abandoned
- 2003-10-16 US US10/685,479 patent/US20040163034A1/en not_active Abandoned
Patent Citations (99)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4908866A (en) * | 1985-02-04 | 1990-03-13 | Eric Goldwasser | Speech transcribing system |
US4879648A (en) * | 1986-09-19 | 1989-11-07 | Nancy P. Cochran | Search system which continuously displays search terms during scrolling and selections of individually displayed data sets |
US5418716A (en) * | 1990-07-26 | 1995-05-23 | Nec Corporation | System for recognizing sentence patterns and a system for recognizing sentence patterns and grammatical cases |
US5404295A (en) * | 1990-08-16 | 1995-04-04 | Katz; Boris | Method and apparatus for utilizing annotations to facilitate computer retrieval of database material |
US5317732A (en) * | 1991-04-26 | 1994-05-31 | Commodore Electronics Limited | System for relocating a multimedia presentation on a different platform by extracting a resource map in order to remap and relocate resources |
US5875108A (en) * | 1991-12-23 | 1999-02-23 | Hoffberg; Steven M. | Ergonomic man-machine interface incorporating adaptive pattern recognition based control system |
US5544257A (en) * | 1992-01-08 | 1996-08-06 | International Business Machines Corporation | Continuous parameter hidden Markov model approach to automatic handwriting recognition |
US5787198A (en) * | 1992-11-24 | 1998-07-28 | Lucent Technologies Inc. | Text recognition using two-dimensional stochastic models |
US6437818B1 (en) * | 1993-10-01 | 2002-08-20 | Collaboration Properties, Inc. | Video conferencing on existing UTP infrastructure |
US5572728A (en) * | 1993-12-24 | 1996-11-05 | Hitachi, Ltd. | Conference multimedia summary support system and method |
US5752021A (en) * | 1994-05-24 | 1998-05-12 | Fuji Xerox Co., Ltd. | Document database management apparatus capable of conversion between retrieval formulae for different schemata |
US5613032A (en) * | 1994-09-02 | 1997-03-18 | Bell Communications Research, Inc. | System and method for recording, playing back and searching multimedia events wherein video, audio and text can be searched and retrieved |
US5768607A (en) * | 1994-09-30 | 1998-06-16 | Intel Corporation | Method and apparatus for freehand annotation and drawings incorporating sound and for compressing and synchronizing sound |
US5757960A (en) * | 1994-09-30 | 1998-05-26 | Murdock; Michael Chase | Method and system for extracting features from handwritten text |
US5777614A (en) * | 1994-10-14 | 1998-07-07 | Hitachi, Ltd. | Editing support system including an interactive interface |
US5835667A (en) * | 1994-10-14 | 1998-11-10 | Carnegie Mellon University | Method and apparatus for creating a searchable digital video library and a system and method of using such a library |
US5614940A (en) * | 1994-10-21 | 1997-03-25 | Intel Corporation | Method and apparatus for providing broadcast information with indexing |
US6029195A (en) * | 1994-11-29 | 2000-02-22 | Herz; Frederick S. M. | System for customized electronic identification of desirable objects |
US5715367A (en) * | 1995-01-23 | 1998-02-03 | Dragon Systems, Inc. | Apparatuses and methods for developing and using models for speech recognition |
US5684924A (en) * | 1995-05-19 | 1997-11-04 | Kurzweil Applied Intelligence, Inc. | User adaptable speech recognition system |
US5559875A (en) * | 1995-07-31 | 1996-09-24 | Latitude Communications | Method and apparatus for recording and retrieval of audio conferences |
US6151598A (en) * | 1995-08-14 | 2000-11-21 | Shaw; Venson M. | Digital dictionary with a communication system for the creating, updating, editing, storing, maintaining, referencing, and managing the digital dictionary |
US5963940A (en) * | 1995-08-16 | 1999-10-05 | Syracuse University | Natural language information retrieval system and method |
US6006221A (en) * | 1995-08-16 | 1999-12-21 | Syracuse University | Multilingual document retrieval system and method using semantic vector matching |
US6332147B1 (en) * | 1995-11-03 | 2001-12-18 | Xerox Corporation | Computer controlled display system using a graphical replay device to control playback of temporal data representing collaborative activities |
US5960447A (en) * | 1995-11-13 | 1999-09-28 | Holt; Douglas | Word tagging and editing system for speech recognition |
US20010051984A1 (en) * | 1996-01-30 | 2001-12-13 | Toshihiko Fukasawa | Coordinative work environment construction system, method and medium therefor |
US6067517A (en) * | 1996-02-02 | 2000-05-23 | International Business Machines Corporation | Transcription of speech data with segments from acoustically dissimilar environments |
US5862259A (en) * | 1996-03-27 | 1999-01-19 | Caere Corporation | Pattern recognition employing arbitrary segmentation and compound probabilistic evaluation |
US6024571A (en) * | 1996-04-25 | 2000-02-15 | Renegar; Janet Elaine | Foreign language communication system/device and learning aid |
US6308222B1 (en) * | 1996-06-03 | 2001-10-23 | Microsoft Corporation | Transcoding of audio data |
US5806032A (en) * | 1996-06-14 | 1998-09-08 | Lucent Technologies Inc. | Compilation of weighted finite-state transducers from decision trees |
US6169789B1 (en) * | 1996-12-16 | 2001-01-02 | Sanjay K. Rao | Intelligent keyboard system |
US6732183B1 (en) * | 1996-12-31 | 2004-05-04 | Broadware Technologies, Inc. | Video and audio streaming for multiple users |
US6185531B1 (en) * | 1997-01-09 | 2001-02-06 | Gte Internetworking Incorporated | Topic indexing method |
US6088669A (en) * | 1997-01-28 | 2000-07-11 | International Business Machines, Corporation | Speech recognition with attempted speaker recognition for speaker model prefetching or alternative speech modeling |
US6006184A (en) * | 1997-01-28 | 1999-12-21 | Nec Corporation | Tree structured cohort selection for speaker recognition system |
US6029124A (en) * | 1997-02-21 | 2000-02-22 | Dragon Systems, Inc. | Sequential, nonparametric speech recognition and speaker identification |
US6877134B1 (en) * | 1997-08-14 | 2005-04-05 | Virage, Inc. | Integrated data and real-time metadata capture system and method |
US6360234B2 (en) * | 1997-08-14 | 2002-03-19 | Virage, Inc. | Video cataloger system with synchronized encoders |
US6463444B1 (en) * | 1997-08-14 | 2002-10-08 | Virage, Inc. | Video cataloger system with extensibility |
US6567980B1 (en) * | 1997-08-14 | 2003-05-20 | Virage, Inc. | Video cataloger system with hyperlinked output |
US6052657A (en) * | 1997-09-09 | 2000-04-18 | Dragon Systems, Inc. | Text segmentation and identification of topic using language models |
US6961954B1 (en) * | 1997-10-27 | 2005-11-01 | The Mitre Corporation | Automated segmentation, information extraction, summarization, and presentation of broadcast news |
US6064963A (en) * | 1997-12-17 | 2000-05-16 | Opus Telecom, L.L.C. | Automatic key word or phrase speech recognition for the corrections industry |
US20030051214A1 (en) * | 1997-12-22 | 2003-03-13 | Ricoh Company, Ltd. | Techniques for annotating portions of a document relevant to concepts of interest |
US5970473A (en) * | 1997-12-31 | 1999-10-19 | At&T Corp. | Video communication device providing in-home catalog services |
US6602300B2 (en) * | 1998-02-03 | 2003-08-05 | Fujitsu Limited | Apparatus and method for retrieving data from a document database |
US6073096A (en) * | 1998-02-04 | 2000-06-06 | International Business Machines Corporation | Speaker adaptation system and method based on class-specific pre-clustering training speakers |
US7257528B1 (en) * | 1998-02-13 | 2007-08-14 | Zi Corporation Of Canada, Inc. | Method and apparatus for Chinese character text input |
US6112172A (en) * | 1998-03-31 | 2000-08-29 | Dragon Systems, Inc. | Interactive searching |
US6718303B2 (en) * | 1998-05-13 | 2004-04-06 | International Business Machines Corporation | Apparatus and method for automatically generating punctuation marks in continuous speech recognition |
US6076053A (en) * | 1998-05-21 | 2000-06-13 | Lucent Technologies Inc. | Methods and apparatus for discriminative training and adaptation of pronunciation networks |
US6067514A (en) * | 1998-06-23 | 2000-05-23 | International Business Machines Corporation | Method for automatically punctuating a speech utterance in a continuous speech recognition system |
US6373985B1 (en) * | 1998-08-12 | 2002-04-16 | Lucent Technologies, Inc. | E-mail signature block analysis |
US6381640B1 (en) * | 1998-09-11 | 2002-04-30 | Genesys Telecommunications Laboratories, Inc. | Method and apparatus for automated personalization and presentation of workload assignments to agents within a multimedia communication center |
US6161087A (en) * | 1998-10-05 | 2000-12-12 | Lernout & Hauspie Speech Products N.V. | Speech-recognition-assisted selective suppression of silent and filled speech pauses during playback of an audio recording |
US6360237B1 (en) * | 1998-10-05 | 2002-03-19 | Lernout & Hauspie Speech Products N.V. | Method and system for performing text edits during audio recording playback |
US6347295B1 (en) * | 1998-10-26 | 2002-02-12 | Compaq Computer Corporation | Computer method and apparatus for grapheme-to-phoneme rule-set-generation |
US6332139B1 (en) * | 1998-11-09 | 2001-12-18 | Mega Chips Corporation | Information communication system |
US6611803B1 (en) * | 1998-12-17 | 2003-08-26 | Matsushita Electric Industrial Co., Ltd. | Method and apparatus for retrieving a video and audio scene using an index generated by speech recognition |
US6728673B2 (en) * | 1998-12-17 | 2004-04-27 | Matsushita Electric Industrial Co., Ltd | Method and apparatus for retrieving a video and audio scene using an index generated by speech recognition |
US6654735B1 (en) * | 1999-01-08 | 2003-11-25 | International Business Machines Corporation | Outbound information analysis for generating user interest profiles and improving user productivity |
US6253179B1 (en) * | 1999-01-29 | 2001-06-26 | International Business Machines Corporation | Method and apparatus for multi-environment speaker verification |
US6718305B1 (en) * | 1999-03-19 | 2004-04-06 | Koninklijke Philips Electronics N.V. | Specifying a tree structure for speech recognizers using correlation between regression classes |
US6345252B1 (en) * | 1999-04-09 | 2002-02-05 | International Business Machines Corporation | Methods and apparatus for retrieving audio information using content and speaker information |
US6434520B1 (en) * | 1999-04-16 | 2002-08-13 | International Business Machines Corporation | System and method for indexing and querying audio archives |
US6847961B2 (en) * | 1999-06-30 | 2005-01-25 | Silverbrook Research Pty Ltd | Method and system for searching information using sensor with identifier |
US6219640B1 (en) * | 1999-08-06 | 2001-04-17 | International Business Machines Corporation | Methods and apparatus for audio-visual speaker recognition and utterance verification |
US6778958B1 (en) * | 1999-08-30 | 2004-08-17 | International Business Machines Corporation | Symbol insertion apparatus and method |
US6480826B2 (en) * | 1999-08-31 | 2002-11-12 | Accenture Llp | System and method for a telephonic emotion detection that provides operator feedback |
US6711541B1 (en) * | 1999-09-07 | 2004-03-23 | Matsushita Electric Industrial Co., Ltd. | Technique for developing discriminative sound units for speech recognition and allophone modeling |
US6624826B1 (en) * | 1999-09-28 | 2003-09-23 | Ricoh Co., Ltd. | Method and apparatus for generating visual representations for audio documents |
US6571208B1 (en) * | 1999-11-29 | 2003-05-27 | Matsushita Electric Industrial Co., Ltd. | Context-dependent acoustic models for medium and large vocabulary speech recognition with eigenvoice training |
US6792409B2 (en) * | 1999-12-20 | 2004-09-14 | Koninklijke Philips Electronics N.V. | Synchronous reproduction in a speech recognition system |
US20010026377A1 (en) * | 2000-03-21 | 2001-10-04 | Katsumi Ikegami | Image display system, image registration terminal device and image reading terminal device used in the image display system |
US20020010575A1 (en) * | 2000-04-08 | 2002-01-24 | International Business Machines Corporation | Method and system for the automatic segmentation of an audio stream into semantic or syntactic units |
US20020001261A1 (en) * | 2000-04-21 | 2002-01-03 | Yoshinori Matsui | Data playback apparatus |
US20020010916A1 (en) * | 2000-05-22 | 2002-01-24 | Compaq Computer Corporation | Apparatus and method for controlling rate of playback of audio data |
US6748356B1 (en) * | 2000-06-07 | 2004-06-08 | International Business Machines Corporation | Methods and apparatus for identifying unknown speakers using a hierarchical tree structure |
US20020049589A1 (en) * | 2000-06-28 | 2002-04-25 | Poirier Darrell A. | Simultaneous multi-user real-time voice recognition system |
US20020059204A1 (en) * | 2000-07-28 | 2002-05-16 | Harris Larry R. | Distributed search system and method |
US6922691B2 (en) * | 2000-08-28 | 2005-07-26 | Emotion, Inc. | Method and apparatus for digital media management, retrieval, and collaboration |
US6604110B1 (en) * | 2000-08-31 | 2003-08-05 | Ascential Software, Inc. | Automated software code generation from a metadata-based repository |
US6647383B1 (en) * | 2000-09-01 | 2003-11-11 | Lucent Technologies Inc. | System and method for providing interactive dialogue and iterative search functions to find information |
US20020184373A1 (en) * | 2000-11-01 | 2002-12-05 | International Business Machines Corporation | Conversational networking via transport, coding and control conversational protocols |
US20050060162A1 (en) * | 2000-11-10 | 2005-03-17 | Farhad Mohit | Systems and methods for automatic identification and hyperlinking of words or other data items and for information retrieval using hyperlinked words or data items |
US20040073444A1 (en) * | 2001-01-16 | 2004-04-15 | Li Li Peh | Method and apparatus for a financial database structure |
US6714911B2 (en) * | 2001-01-25 | 2004-03-30 | Harcourt Assessment, Inc. | Speech transcription and analysis system and method |
US20020133477A1 (en) * | 2001-03-05 | 2002-09-19 | Glenn Abel | Method for profile-based notice and broadcast of multimedia content |
US20030088414A1 (en) * | 2001-05-10 | 2003-05-08 | Chao-Shih Huang | Background learning of speaker voices |
US7171360B2 (en) * | 2001-05-10 | 2007-01-30 | Koninklijke Philips Electronics N.V. | Background learning of speaker voices |
US6973428B2 (en) * | 2001-05-24 | 2005-12-06 | International Business Machines Corporation | System and method for searching, analyzing and displaying text transcripts of speech after imperfect speech recognition |
US6748350B2 (en) * | 2001-09-27 | 2004-06-08 | Intel Corporation | Method to compensate for stress between heat spreader and thermal interface material |
US6708148B2 (en) * | 2001-10-12 | 2004-03-16 | Koninklijke Philips Electronics N.V. | Correction device to mark parts of a recognized text |
US20030093580A1 (en) * | 2001-11-09 | 2003-05-15 | Koninklijke Philips Electronics N.V. | Method and system for information alerts |
US20030167163A1 (en) * | 2002-02-22 | 2003-09-04 | Nec Research Institute, Inc. | Inferring hierarchical descriptions of a set of documents |
US7131117B2 (en) * | 2002-09-04 | 2006-10-31 | Sbc Properties, L.P. | Method and system for automating the analysis of word frequencies |
US6999918B2 (en) * | 2002-09-20 | 2006-02-14 | Motorola, Inc. | Method and apparatus to facilitate correlating symbols to sounds |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080175556A1 (en) * | 2005-08-24 | 2008-07-24 | Chitra Dorai | System and method for semantic video segmentation based on joint audiovisual and text analysis |
US8121432B2 (en) * | 2005-08-24 | 2012-02-21 | International Business Machines Corporation | System and method for semantic video segmentation based on joint audiovisual and text analysis |
US20080065380A1 (en) * | 2006-09-08 | 2008-03-13 | Kwak Keun Chang | On-line speaker recognition method and apparatus thereof |
US20090119103A1 (en) * | 2007-10-10 | 2009-05-07 | Franz Gerl | Speaker recognition system |
US9305553B2 (en) * | 2010-04-28 | 2016-04-05 | William S. Meisel | Speech recognition accuracy improvement through speaker categories |
US20110295603A1 (en) * | 2010-04-28 | 2011-12-01 | Meisel William S | Speech recognition accuracy improvement through speaker categories |
US20120053936A1 (en) * | 2010-08-31 | 2012-03-01 | Fujitsu Limited | System and Method for Generating Videoconference Transcriptions |
US8630854B2 (en) * | 2010-08-31 | 2014-01-14 | Fujitsu Limited | System and method for generating videoconference transcriptions |
US8791977B2 (en) | 2010-10-05 | 2014-07-29 | Fujitsu Limited | Method and system for presenting metadata during a videoconference |
US20130144414A1 (en) * | 2011-12-06 | 2013-06-06 | Cisco Technology, Inc. | Method and apparatus for discovering and labeling speakers in a large and growing collection of videos with minimal user effort |
US20140136204A1 (en) * | 2012-11-13 | 2014-05-15 | GM Global Technology Operations LLC | Methods and systems for speech systems |
US20140244257A1 (en) * | 2013-02-25 | 2014-08-28 | Nuance Communications, Inc. | Method and Apparatus for Automated Speaker Parameters Adaptation in a Deployed Speaker Verification System |
US9865266B2 (en) * | 2013-02-25 | 2018-01-09 | Nuance Communications, Inc. | Method and apparatus for automated speaker parameters adaptation in a deployed speaker verification system |
US9754593B2 (en) * | 2015-11-04 | 2017-09-05 | International Business Machines Corporation | Sound envelope deconstruction to identify words and speakers in continuous speech |
US11862168B1 (en) * | 2020-03-30 | 2024-01-02 | Amazon Technologies, Inc. | Speaker disambiguation and transcription from multiple audio feeds |
US11373657B2 (en) * | 2020-05-01 | 2022-06-28 | Raytheon Applied Signal Technology, Inc. | System and method for speaker identification in audio data |
US11315545B2 (en) | 2020-07-09 | 2022-04-26 | Raytheon Applied Signal Technology, Inc. | System and method for language identification in audio data |
Also Published As
Publication number | Publication date |
---|---|
US20040163034A1 (en) | 2004-08-19 |
US20040204939A1 (en) | 2004-10-14 |
US20050038649A1 (en) | 2005-02-17 |
US20040230432A1 (en) | 2004-11-18 |
US7292977B2 (en) | 2007-11-06 |
US7389229B2 (en) | 2008-06-17 |
US20040138894A1 (en) | 2004-07-15 |
US7424427B2 (en) | 2008-09-09 |
US20040083090A1 (en) | 2004-04-29 |
US20040176946A1 (en) | 2004-09-09 |
US20040172250A1 (en) | 2004-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20040083104A1 (en) | Systems and methods for providing interactive speaker identification training | |
US8001066B2 (en) | Systems and methods for improving recognition results via user-augmentation of a database | |
US11380330B2 (en) | Conversational recovery for voice user interface | |
US10643609B1 (en) | Selecting speech inputs | |
US10917758B1 (en) | Voice-based messaging | |
Makhoul et al. | Speech and language technologies for audio indexing and retrieval | |
EP3598437A1 (en) | Information processing device, information processing system, information processing method, and program | |
US9514126B2 (en) | Method and system for automatically detecting morphemes in a task classification system using lattices | |
US10056078B1 (en) | Output of content based on speech-based searching and browsing requests | |
EP1171871B1 (en) | Recognition engines with complementary language models | |
US6434520B1 (en) | System and method for indexing and querying audio archives | |
EP2453436B1 (en) | Automatic language model update | |
EP1696421B1 (en) | Learning in automatic speech recognition | |
US8069043B2 (en) | System and method for using meta-data dependent language modeling for automatic speech recognition | |
US11093110B1 (en) | Messaging feedback mechanism | |
US20050055210A1 (en) | Method and apparatus for speech recognition using a dynamic vocabulary | |
US9495955B1 (en) | Acoustic model training | |
US8326631B1 (en) | Systems and methods for speech indexing | |
US7085720B1 (en) | Method for task classification using morphemes | |
EP3005152B1 (en) | Systems and methods for adaptive proper name entity recognition and understanding | |
US8401855B2 (en) | System and method for generating data for complex statistical modeling for use in dialog systems | |
Hori et al. | Deriving disambiguous queries in a spoken interactive ODQA system | |
Wang | Mandarin spoken document retrieval based on syllable lattice matching | |
Nouza et al. | A system for information retrieval from large records of Czech spoken data | |
Huang et al. | Task-independent call-routing |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BBNT SOLUTIONS LLC, TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIU, DABEN;KUBALA, FRANCIS;REEL/FRAME:014608/0707 Effective date: 20031010 |
|
AS | Assignment |
Owner name: FLEET NATIONAL BANK, AS AGENT, MASSACHUSETTS Free format text: PATENT & TRADEMARK SECURITY AGREEMENT;ASSIGNOR:BBNT SOLUTIONS LLC;REEL/FRAME:014624/0196 Effective date: 20040326 Owner name: FLEET NATIONAL BANK, AS AGENT,MASSACHUSETTS Free format text: PATENT & TRADEMARK SECURITY AGREEMENT;ASSIGNOR:BBNT SOLUTIONS LLC;REEL/FRAME:014624/0196 Effective date: 20040326 |
|
AS | Assignment |
Owner name: BBN TECHNOLOGIES CORP.,MASSACHUSETTS Free format text: MERGER;ASSIGNOR:BBNT SOLUTIONS LLC;REEL/FRAME:017274/0318 Effective date: 20060103 Owner name: BBN TECHNOLOGIES CORP., MASSACHUSETTS Free format text: MERGER;ASSIGNOR:BBNT SOLUTIONS LLC;REEL/FRAME:017274/0318 Effective date: 20060103 |
|
AS | Assignment |
Owner name: BBNT SOLUTIONS LLC, MASSACHUSETTS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIU, DABEN;KUBALA, FRANCIS G.;REEL/FRAME:019648/0422 Effective date: 20031010 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: BBN TECHNOLOGIES CORP. (AS SUCCESSOR BY MERGER TO Free format text: RELEASE OF SECURITY INTEREST;ASSIGNOR:BANK OF AMERICA, N.A. (SUCCESSOR BY MERGER TO FLEET NATIONAL BANK);REEL/FRAME:023427/0436 Effective date: 20091026 |