CN102439659B - 在自然语言语音服务环境中处理多模式装置交互的系统和方法 - Google Patents

在自然语言语音服务环境中处理多模式装置交互的系统和方法 Download PDF

Info

Publication number
CN102439659B
CN102439659B CN201080017511.4A CN201080017511A CN102439659B CN 102439659 B CN102439659 B CN 102439659B CN 201080017511 A CN201080017511 A CN 201080017511A CN 102439659 B CN102439659 B CN 102439659B
Authority
CN
China
Prior art keywords
voice
relevant
mutual
alternately
natural language
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201080017511.4A
Other languages
English (en)
Other versions
CN102439659A (zh
Inventor
L·贝尔德文
克里斯·魏德
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Weber Assets Co., Ltd.
Original Assignee
VoiceBox Technologies Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by VoiceBox Technologies Corp filed Critical VoiceBox Technologies Corp
Publication of CN102439659A publication Critical patent/CN102439659A/zh
Application granted granted Critical
Publication of CN102439659B publication Critical patent/CN102439659B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0261—Targeted advertisements based on user location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0273—Determination of fees for advertising
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1815—Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/24—Speech recognition using non-acoustical features
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification
    • G10L17/22—Interactive procedures; Man-machine interfaces
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/226—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics
    • G10L2015/227—Procedures used during a speech recognition process, e.g. man-machine dialogue using non-speech characteristics of the speaker; Human-factor methodology

Abstract

本发明可以提供在自然语言语音服务环境中处理多模式装置交互的系统和方法。具体地，可以在包括一个或多个电子装置的自然语言语音服务环境中接收一个或多个多模式装置交互。所述多模式装置交互可以包括与至少一个所述电子装置或与和所述电子装置有关的应用程序进行的非语音交互，且还可包括与所述非语音交互有关的自然语言语句。与所述非语音交互有关的背景和与所述自然语言语句有关的背景可以被提取并组合以确定所述多模式装置交互的目的，并且可以基于确定的所述多模式装置交互的目的来将请求路由到一个或多个所述电子装置。

Description

在自然语言语音服务环境中处理多模式装置交互的系统和方法
相关申请的交叉引用
本申请要求2009年2月20日提交的名称为“SYSTEMAND METHOD FORPROCESSING MULTI-MODAL DEVICE INTERACTIONS IN A NATURALLANGUAGE VOICE SERVICES ENVIRONMENT”的第12/389,678号美国专利申请的权益，该美国专利申请的全部内容通过引用并入本文。
技术领域
本发明涉及用于处理与一个或多个装置和/或应用程序进行的多模式交互的综合自然语言语音服务环境，其中所述多模式交互可以提供用于配合解释和另外处理伴随所述多模式交互的自然语言语句的额外背景。
背景技术
近年来随着技术的进步，消费性电子装置已出现并几乎在很多人的日常生活中无处不在。为了满足移动电话、导航装置、嵌入式装置和其他这样的装置的功能性和移动性的增长引起的日益增长的需求，很多装置除了核心应用以外还提供大量特征和功能。然而，较大的功能性还带来了折衷，包括通常抑制用户完全利用他们的电子装置的所有性能的学习难度。例如，很多现有的电子装置包括复杂的人机界面，这些复杂的人机界面可能不是特别方便使用，这会抑制很多技术的大规模市场应用。而且，不方便的界面还经常导致难以找到或使用期望的特征(例如，因为菜单复杂或导航繁琐)。就这一点而言，很多用户趋向于不使用甚或不了解他们的装置的很多潜在性能。
就这一点而论，电子装置的增加的功能往往趋向于浪费，市场研究表明，很多用户仅使用给定装置上可用的特征或应用的一部分。而且，在无线联网和宽带接入越来越普遍的社会中，消费者往往自然地希望他们的电子装置具有无缝移动性能。因此，由于消费者对更简单的与电子装置交互的机制的需求加强，因此妨碍快速且集约化交互的不方便的界面成为重要的议题。但是，在很大程度上仍未满足对以直观方式使用技术的机制的日益增长的需求。
一种简化电子装置中的人机交互的方法包括使用语音识别软件，该语音识别软件有可能使用户利用原本不熟悉、不了解或难以使用的特征。例如，最近由Navteq公司(其提供比如自动导航和基于网页的应用的各种应用中使用的数据)进行的一项调查表明，语音识别在电子装置消费者最期望的特征中占首位。虽然如此，就用户而言，现有的语音用户界面在实际工作时仍需要大量学习。
例如，很多现有的语音用户界面仅支持根据特定的命令与控制序列或语法制定的请求。而且，很多现有的语音用户界面因不准确的语音识别而导致用户沮丧或不满。类似地，通过强迫用户提供预先建立的命令或关键字来以系统可以理解的方式传递请求，现有的语音用户界面未能有效地使用户加入富有成效的、配合的对话中以解析请求并促进对话朝着令人满意的目标进行(例如，当用户可能不确定具体需求、可用信息、装置性能等时)。就这一点而言，现有的语音用户界面往往有各种缺点，包括大大限制了使用户以配合方式和对话方式加入对话。
此外，很多现有的语音用户界面达不到利用分布在不同领域、装置和应用程序中的信息以解析基于自然语言语音的输入。因此，现有的语音用户界面的缺陷在于局限于已经设计出的有限的一组应用程序或者局限于存在有它们的装置。尽管技术进步已使得用户通常利用若干装置来满足他们的各种需求，但现有的语音用户界面并不足以使用户摆脱装置的限制。例如，用户可能对与不同应用程序和装置关联的服务感兴趣，但现有的语音用户界面往往限制用户利用他们认为合适的应用程序和装置。而且，实际上，用户在任一给定时间通常仅能够携带有限数量的装置，而在各种情况下可能需要与用户目前使用的其他装置有关的内容或服务。
因此，尽管用户往往具有不同的需求，其中在各种背景或环境中可能想要与不同的装置关联的内容或服务，但现有的语音技术往往达不到提供这样的综合环境：在该综合环境中，用户可以请求与几乎任何装置或网络关联的内容或服务。就这一点而言，现有的语音服务环境中对信息可用性和装置交互机制的限制往往妨碍用户以直观、自然且有效的方式体验技术。例如，当用户想要利用给定的电子装置执行给定的功能、但不一定了解如何着手执行该功能时，用户通常无法加入与该装置的多模式交互以仅发出自然语言的词来请求该功能。
而且，利用不具有语音识别能力的电子装置，相对简单的功能通常可能执行起来繁琐。例如，为移动电话购买新的电话铃声往往是很简单的过程，但用户通常必须导航若干菜单并按下很多不同的按钮来完成该过程。就这一点而言，很明显，如果用户能够使用自然语言来开发隐藏或其他难以使用的功能，则与电子装置的交互会有效得多。现有的系统具有这些问题和其他问题。
发明内容
根据本发明的一个方面，可以提供用于在自然语言语音服务环境中处理多模式装置交互的系统和方法。具体地，可以在包括一个或多个电子装置的自然语言语音服务环境中接收一个或多个多模式交互。所述多模式装置交互可以包括用户加入与所述电子装置中的一个或多个电子装置或与和所述装置有关的应用程序进行的非语音交互中，同时还提供与所述非语音交互有关的自然语言语句。例如，所述非语音装置交互可以包括用户选择特定的部分、项目、数据、注意点或关注点或者加入与所述电子装置或者与和所述电子装置关联的应用程序的一个或多个唯一且可区分的交互中。就这一点而言，可以从所述自然语言语句中提取出背景，且所述非语音装置交互可以提供用于所述自然语言语句的其他背景。接着可以使所述语句的背景和所述非语音装置交互的背景组合以确定所述多模式装置交互的目的，其中所述电子装置中的一个或多个电子装置可以基于所述多模式装置交互的目的处理请求。
根据本发明的一个方面，所述电子装置中的至少一个电子装置可以包括配置成接收基于语音的输入的输入装置。在一个实现方式中，响应于检测与所述一个或多个电子装置或者应用程序的非语音交互，可以用信号通知所述基于语音的输入装置捕获所述自然语言语句。而且，所述自然语言语音服务环境可以包括针对电子装置和相关应用程序建立的一个或多个收听器，其中所述收听器可以配置成检测与所述电子装置或应用程序的非语音交互。就这一点而言，与非语音交互有关的信息和与伴随的自然语言语句有关的信息可以被对齐以实现合作性处理所述语句和所述非语音装置交互。
根据本发明的一个方面，可以基于所述多模式装置交互的目的产生至少一个交易提示。例如，可以接收附加多模式装置交互，其中所述附加多模式装置交互可以与针对第一多模式装置交互产生的交易提示有关。接着可以基于针对所述附加多模式装置交互确定的目的将至少一个请求路由到所述电子装置中的一个或多个电子装置，由此可以响应于接收到与所产生的交易提示有关的装置交互来处理交易点进。例如，所述交易提示可以包括基于最初的多模式装置交互的目的选择的广告或推荐，而附加多模式装置交互可以包括用户选择该广告或推荐。因此，选择该广告或者推荐可以被视为交易点进，这可以为具体的组织(例如，自然语言语音服务环境的提供商)产生收益。
基于以下附图和详细描述，本发明的其他目的和优势将显而易见。
附图说明
图1示出了根据本发明的各个方面的在自然语言语音服务环境中处理多模式装置交互的示例性系统的框图。
图2示出了根据本发明的各个方面的用于在自然语言语音服务环境中使多模式装置同步的示例性方法的框图。
图3示出了根据本发明的各个方面的用于在自然语言语音服务环境中处理多模式装置交互的示例性方法的流程图。
图4示出了根据本发明的各个方面的用于在自然语言语音服务环境中处理多模式装置交互以产生一个或多个交易提示的示例性方法的流程图。
具体实施方式
根据本发明的各个方面，图1示出了用于在自然语言语音服务环境中处理多模式装置交互的示例性系统100的框图。从本文要提供的进一步描述中将看出，图1中示出的系统100可以包括一个输入装置105或多个输入装置105的组合，输入装置105使用户能够以多模式方式与系统100交互。具体而言，系统100可以包括各种自然语言处理元件，所述的各种自然语言处理元件至少包括语音点击模块108，其可以共同地处理用户与一个或多个输入装置105的多模式交互。例如，在一个实现方式中，输入装置105可以包括至少一个语音输入装置105a(例如，话筒)和至少一个非语音输入装置105b(例如鼠标、触摸屏显示器、滚轮选择器等)的任何适当组合。就这一点而言，输入装置105可以包括具有接收基于语音的输入和基于非语音的输入的机制的电子装置的任意适当组合(例如，连接到远程信息处理装置、个人导航装置、移动电话、VoIP节点、个人计算机、媒体装置、嵌入式装置、服务器或其他电子装置中的一个或者多个的话筒)。就这一点而言，系统100可以使用户能够加入与一个或多个电子输入装置105或与和电子装置105有关的应用程序的多模式对话性交互中，其中系统100可以以适于路由任务或解析请求的自由形式和配合方式处理装置交互。
如上所述，在一个实现方式中，该系统可以包括能够支持自由形式语句和/或其他形式的装置交互的各种自然语言处理元件，所述各种自然语言处理元件可以将用户从与制定命令、查询或其他请求的方式有关的约束中解放出来。就这一点而言，用户可以利用对语音输入装置105a讲话或与非语音输入装置105b交互中的任一方式来与输入装置105交互以请求系统100中可用的内容或服务。例如，用户可以通过将自然语言语句提供给语音输入装置105a来请求在系统100中可用的任何内容或服务。在一个实现方式中，接着可以利用2008年7月8日授权的名称为“Systems and Methods for Responding to Natural Language SpeechUtterance”的第7,398,209号美国专利和2003年6月15日提交的名称为“MobileSystems and Methods for Responding to Natural Language Speech Utterance”的美国专利申请10/618,633中描述的技术处理该语句，所述的美国专利和美国专利申请公开的全部内容通过引用并入本文。此外，用户可以与一个或多个非语音输入装置105b交互以提供与该语句和/或请求的内容或服务有关的进一步语境或其他信息。
在一个实现方式中，系统100可以连接到包括额外多模式装置的各种其他系统，所述其他系统具有和图1中所示的自然语言处理性能相似的自然语言处理性能。因此，系统100可以为多装置环境提供一界面，在该界面中，用户可以请求通过该环境中的各个额外装置可得到的内容或服务。例如，在一个实现方式中，系统100可以包括星座模型130b，该星座模型130b提供与通过该环境中的其他系统和装置可以得到的内容、服务、应用程序、目的确定性能和其他特征有关的知识。例如，在一个实现方式中，系统100可以与该环境中的装置、应用程序或其他系统交互以合作性地解析请求，如2008年5月27日提交的名称为“System and Method for an integrated，Multi-Modal，Multi-Device NaturalLanguage Voice Services Environment”的共同待决的美国专利申请12/127,343中所述，该美国专利申请公开的全部内容通过引用并入本文。例如，该多装置环境可以在各个系统和装置中共享信息以提供解析请求的合作性环境，其中，所共享的信息可以涉及比如装置性能、背景、先前的交互、领域知识、短期性知识、长期性知识和认知模型等方面。
如上所述，除了别的以外，图1中示出的系统100可以包括一个或多个电子输入装置105，所述一个或多个电子输入装置105共同提供用于接收来自用户的一个或多个多模式装置交互的界面(或界面组合)，其中装置交互至少包括用户口语语句。尽管图1中示出的实现方式包括分立的语音输入装置105a和非语音输入装置105b，但是显然，在一个或多个实现方式中，语音输入装置105a和非语音输入装置105b可以是相同装置或不同装置的元件。例如，输入装置105可以包括连接到移动电话的话筒(即，语音输入装置105a)，且还可以包括连接到该移动电话的一个或多个按钮、可选显示器、滚轮选择器或其他元件(即，非语音输入装置105b)。在另一示例中，输入装置105可以包括连接到远程信息处理装置的话筒组合(即，语音输入装置105a)且还可以包括连接到媒体播放器的按钮、触摸屏显示器、轨迹滚轮或其他非语音输入装置105b，该媒体播放器可通信地连接到该远程信息处理装置、然而与该远程信息处理装置分立。因此，输入装置105可以包括可通信地连接的电子装置的任意适当组合，该任意适当组合包括用于接收自然语言语句输入的至少一个输入装置和用于接收多模式非语音输入的至少一个输入装置。
在一个实现方式中，可通信地连接到一个或多个输入装置105的语音点击模块108可以实现对语音输入装置105a和一个或多个非语音输入装置105b接收到的多模式装置交互进行配合处理。例如，语音点击模块108可以为系统100提供能够用以鉴于通过非语音输入装置105b接收到的一个或多个非语音装置交互处理通过语音输入装置105a接收到的自然语言语句的信息。因此，语音点击模块108使用户能够与各种输入装置105以直观且自由形式的方式交互，由此，当试图发起行动、检索信息或请求系统100中可用的内容或服务时，用户可以将各种类型的信息提供给系统100。
语音输入装置105a可以包括具有用于接收自然语言语句或其他形式的口语输入的性能的任何适当的装置或装置的组合。例如，在一个实现方式中，语音输入装置105a可以包括定向话筒、话筒阵列或能够创建编码语音的其他装置。在一个实现方式中，语音输入装置105a可以配置成最大化编码语音的保真度。例如，语音输入装置105a可以配置成最大化沿着用户方向的增益、消除回音和零点噪声源、执行可变速率采样、滤去环境噪声或背景对话、或者使用其他技术来最大化编码语音的保真度。就这一点而言，语音输入装置105a可以以容忍噪声或可能干扰系统100准确解释自然语言语句的其他因素的方式创建编码语音。
非语音输入装置105b可以包括具有支持非语音装置交互的性能的任何适当装置或装置的组合。例如，在一个实现方式中，非语音输入装置105b可以包括手写笔和触摸屏或写字板界面组合、黑莓滚轮选择器、iPod点击式转盘、鼠标、键盘、按钮或支持可区分的非语音装置交互的任何其他装置。因此，用户可以利用非语音输入装置105b进行数据选择或识别待与通过语音输入装置105a提供的相关自然语言语句连同处理的注意点(或关注点)。例如，用户可以将手写笔指向触摸屏显示器的特定部分、利用鼠标突出文本、点击按钮、与一应用程序交互、或加入用于选择数据或识别注意点的任何适当的装置交互中(即，语音激活或“语音点击”所选择的数据和/或识别的注意点)。
而且，除了可用于进行数据选择、识别注意点、或激活与一个或多个语句有关的待解释的数据，用户还可以使用非语音输入装置105b来加入系统100中的具有意义的专用的装置交互中。例如，专用的装置交互(其可以被称为“点击”或者“语音点击”)可以包括持续给定时间段的点击、连续保持给定时间段的点击、按预定顺序进行的点击、或输入装置105和/或语音点击模块108可以识别、检测或以其他方式区分的任何其他交互或交互序列。
在一个实现方式中，专用的装置交互可以与和系统100中可用的应用程序或服务有关的一个或多个动作、查询、命令、任务或其他请求关联。在一个实现方式中，专用的装置交互还可以包括与部署在多装置环境中的各个装置中的任一装置有关的一个或多个动作、查询、命令、任务或其他请求，如以上提及的2008年5月27日提交的名称为“System and Method for an Integrated，Multi-Modal，Multi-Device Natural Language Voice Services Environment”的共同待决的美国专利申请12/127,343中所述。例如，在显示于触摸屏显示器上的具体部分或项目上用手写笔点击的不同顺序可以被定义为用于在移动电话上发起电话呼叫、在导航装置上计算路径、为媒体播放器购买歌曲或其他类型的请求的专用装置交互或语音点击。
因此，连接到输入装置105的语音点击模块108可以持续地监测用户与非语音输入装置105b的交互以检测至少一个非语音装置交互的发生，非语音装置交互在此可以被称为“语音点击”。因此，检测到的语音点击可以提供处理多模式装置交互的进一步背景，该多模式装置交互可以包括至少一个语音点击和一个或多个自然语言语句，它们每一个都可以提供任务说明的背景。因此，语音点击通常可以用信号通知系统100当前语句或其他基于语音的输入要和与一个或者多个装置105的当前交互一起处理。例如，在一个实现方式中，当前装置交互可以包括与一个或多个装置105关联的用户选择、突出或识别具体的关注点、对象或者其他项目。就这一点而言，当前装置交互可以提供用于加强辨别、解释和理解伴随的语句的背景，而且，当前语句可以提供用以增强由所伴随的装置交互提供的背景的信息。
在一个实现方式中，语音点击模块108可以基于非语音输入装置105b的具体特性确定待检测的各种语音点击交互(例如，语音点击交互可以包括非语音输入装置105b支持的可区分的交互)。例如，多触摸显示器通常包括触摸屏显示器装置，该触摸屏显示器装置被配置成支持与显示在该触摸屏显示器装置中的信息交互的各种可区分的手势(例如，用户可以利用特定的手势或者其他交互技术放大、缩小、旋转、或以其他方式控制显示在多触摸屏上的图形信息)。因此，在一个示例中，非语音输入装置105b可以包括多触摸显示器，在该情况下，语音点击模块108可以被配置成在用户加入由非语音多触摸显示器105b支持的一个或多个可区分的手势时检测语音点击的发生。
在一个实现方式中，用户可以自定义或修改待由语音点击模块108检测的语音点击交互。具体地，由语音点击模块108检测的特定装置交互可以被删除或修改，或可以添加新的装置交互。就这一点而言，由语音点击模块108检测的语音点击装置交互可以包括非语音输入装置105b和/或语音点击模块108可以区分的任何适当的交互或交互的组合。
当语音点击模块108检测到用户加入语音点击装置交互中时，语音点击模块108可以提取出与语音点击装置交互有关的背景信息以用于语音激活。具体地，语音点击模块108可以识别与用户选择的部分、项目、注意点、关注点或者其他数据有关的信息，或者以其他方式识别与用户加入的具体的装置交互或装置交互序列有关的信息。因此，语音点击模块108提取出所识别的与检测到的语音点击有关的信息，该信息可以用作与一个或者多个先前的、同时发生的或随后的自然语言语句有关的背景信息。
因此，响应于语音点击模块108检测到语音点击(例如，选择图标、一段文本、地图显示器上的特定坐标或其他信息)，语音点击模块108可以用信号通知系统100利用自然语言语句语音输入(其可通过语音输入装置105a接收)作为用于确定待执行的动作、查询、命令、任务或其他请求的进一步背景以服务于检测到的语音点击。就这一点而言，系统100中的各种自然语言处理元件可以使用语音点击和伴随的自然语言语句的组合背景来确定语音点击装置交互的目的并适当地将一个或多个动作、查询、命令、任务或其他请求路由到部署在多装置环境中的各个装置中的任何装置。
例如，在一个实现方式中，多装置环境可以包括语音启用导航装置。因此，示例性语音点击装置交互可以包括用户用手写笔触碰与语音启用导航装置关联的触摸屏显示器105b上显示的特定交叉点，同时还将比如“这周围有什么餐馆？”的语句提供到话筒105a。在该示例中，语音点击模块108可以提取出与语音点击的交叉点有关的信息，该信息可以用作处理伴随的语句的背景(即，与用户的当前位置或一些其他含义相对比，所选择的交叉点可以为解释“这周围”提供背景)。而且，如上所述，语音输入可以用作确定任务说明的附加背景。因此，可以利用系统100的各个自然语言处理元件进一步处理所述语句以用于识别和对话解释，这将在下文更详细地描述。
在一个实现方式中，自动语音识别器(ASR)110可以产生通过语音输入装置105a接收到的语句的一个或多个初步解释。例如，ASR 110可以利用一个或多个动态适应识别语法识别语句的音节、单词、短语或其他声学特征。在一个实现方式中，动态识别语法可以用来利用基于一个或多个声学模型的语音听写识别一连串音位(例如，如2005年8月5日提交的名称为“Systems and Methodsfor Responding to Natural Language Speech Utterance”的共同待决的美国专利申请11/197,504中所述，该美国专利申请公开的全部内容通过引用并入本文)。
在一个实现方式中，ASR 110可以配置成执行多遍语音识别，其中第一语音识别引擎可以产生语句的初级转录(例如，利用大列表听写语法)，且随后可以向一个或多个第二语音识别引擎请求一个或者多个次级转录(例如，利用具有未登录词的假词的虚拟听写语法)。在一个实现方式中，第一语音识别引擎可以基于初级转录的可信度请求次级转录。
ASR 110中使用的识别语法可以包括用于识别语句的各种词汇表、词典、音节、单词、短语或其他信息。在一个实现方式中，识别语法中包括的信息可以被动态地优化以提高准确识别给定语句的可能性(例如，在不正确地解释一单词或短语之后，可以将该不正确解释从语法中删除以降低重复该不正确解释的可能性)。另外，各种形式的知识可用来在动态的基础上持续优化识别语法中包括的信息。例如，系统100可以具有如下知识，包括环境知识(例如，点对点关系、该环境中的各种装置的性能等)、历史知识(例如，频繁的请求、先前背景等)或与当前对话性谈话或交互有关的短期共享知识，以及其他类型的知识。
在一个实现方式中，识别语法中的信息可以根据背景或特定应用领域而进一步优化。具体地，相似的语句可以根据该语句所涉及的背景而被不同地解释，所述背景包括导航、音乐、电影、天气、购物、新闻、语言、时间或地理相邻性或者其他背景或领域。例如，包括词“traffic”的语句可以根据该背景与导航(即，路况)、音乐(即，1960年的摇滚乐队)、还是电影(即，由Steven Soderbergh导演的影片)有关而面临不同的解释。因此，ASR 110可以使用各种技术来产生自然语言语句的初步解释，比如以上提及的共同待决的美国专利申请和/或2006年8月31日提交的名称为“Dynamic Speech Sharpening”的共同待决的美国专利申请11/513,269中所述，该美国专利申请11/513,269公开的全部内容通过引用并入本文。
就这一点而言，ASR 110可以将语音点击中包括的自然语言语句的一个或多个初步解释提供给对话语言处理器120。对话语言处理器120可以包括各种自然语言处理元件，所述各种自然语言处理元件共同配置成模拟人与人对话或交互。例如，对话语言处理器120可以包括目的确定引擎130a、星座模型130b、一个或多个领域代理130c、背景追踪引擎130d、错误识别引擎130e以及语音搜索引擎130f等。而且，对话语言处理器120可以连接到一个或多个数据知识库160和与各种背景或领域有关联的一个或多个应用程序150。
因此，系统100可以使用与对话语言处理器120有关联的各种自然语言处理元件以使用户加入合作性对话中并基于用户发起语音点击的目的解析语音点击装置交互。更具体地，目的确定引擎130a可以基于系统100的性能以及多装置环境中的任何其他装置的性能建立给定多模式装置交互的含义。例如，参照用户语音点击具体交叉点以确定“这周围有什么餐馆”的以上示例，对话语言处理器120可以确定语音点击的对话目的(例如，“什么”可以表示所述语句与请求数据检索的查询有关)。此外，对话语言处理器120可以调用背景追踪引擎130d以确定该语音点击的背景。例如，为了确定语音点击背景，背景追踪引擎130d可以将与识别的注意点有关的背景(即，选择的交叉点)和与所述语句有关的背景(即餐馆)组合起来。
因此，语音点击的组合背景(其包括装置交互和伴随的语句)可以为路由特定查询提供充足信息。例如，该查询可以包括与餐馆和识别出的交叉点有关的各种参数或准则。接着对话语言处理器120可以选择可以向其路由该查询以进行处理的具体装置、应用程序或其他元件。例如，在一个实现方式中，对话语言处理器120可以评估星座模型130b，星座模型130b包括多装置环境中的每一装置的性能的模型。在一个实现方式中，星座模型130b可以包括该环境中的每一装置可用的处理知识和存储资源以及每一装置的领域代理、背景、性能、内容、服务和其他信息的性质和范围等。
就这一点而言，利用星座模型130b和/或其他信息，对话语言处理器120可以确定哪一装置或哪些装置的组合具有可以被调用以处理给定的语音点击装置交互的适当性能。例如，再次参照以上给出的示例，对话语言处理器120可以确定语音点击的背景涉及与导航装置的交互且因此路由该查询以利用导航应用程序150进行处理。查询结果可以随后被处理(例如，基于用户的知识比如对素食餐馆的偏好权衡结果)并通过输出装置180返给用户。
根据本发明的各个方面，图2示出了用于在自然语言语音服务环境中同步不多模式装置的示例性方法的框图。如上所述，多模式装置交互(或“语音点击”)通常可以发生在以下时候：用户加入与一个或多个多模式装置的一个或多个交互中同时提供和与多模式装置的交互有关的一个或多个自然语言语句。在一个实现方式中，和与多模式装置的交互有关的背景信息可以与和自然语言语句有关的背景信息组合以确定语音点击的目的(例如，以发起特定的动作、查询、命令、任务或其他请求)。
在一个实现方式中，各种自然语言处理元件可以配置成持续收听或以其他方式监测多模式装置以确定语音点击何时发生。就这一点而言，图2中示出的方法可以用来调整或配置负责持续收听或监测多模式装置的元件。例如，在一个实现方式中，自然语言语音服务环境可以包括多个提供不同性能或服务的多模式装置，且用户可以加入一个或多个语音点击中以请求与各个装置中的任一装置有关的服务或任一给定装置交互的性能。
为了能够持续收听多模式装置交互或语音点击，该环境中的多个装置中的每一装置可以配置成接收与语音点击有关的信息。因此，在一个实现方式中，操作210可以包括为该环境中的多个装置中的每一装置建立装置收听器。另外，可以响应于一个或多个新装置添加到该环境中而执行操作210。操作210中建立的装置收听器可以包括配置成在一个或多个处理装置或其他硬件元件上执行的指令、固件或其他程序的任何适当组合。对于该环境中的每一装置，相关的装置收听器可以与该装置进行通信以确定与该装置有关的性能、特征、支持的领域或其他信息。在一个实现方式中，装置收听器可以配置成利用针对辅助计算机装置设计的通用即插即用协议与该装置进行通信。然而，显然可以使用与多模式装置进行通信的任何适当机制。
当已经为该环境中的每一装置建立装置收听器时(或者当已经为添加到该环境中的新装置建立装置收听器时)，可以在操作220中同步各个装置收听器。具体地，所述各个装置中的每一装置可能具有不同的内部时钟或其他计时机制，其中操作220可以包括根据装置各自的内部时钟或计时机制来同步各个装置收听器。在一个实现方式中，同步装置收听器可以包括各个装置收听器中的每一个装置收听器公布与相关装置的内部时钟或计时有关的信息。
因此，当随后发生针对一个或多个装置的一个或多个多模式交互或语音点击时，在操作230中，相关装置收听器可以检测与语音点击有关的信息。例如，在一个实现方式中，在操作210中建立的各个装置收听器可以与上文描述和图1中示出的语音点击模块有关。因此，操作230可以包括一个或多个装置收听器或语音点击模块检测用户与一个或者多个装置交互的发生(例如，选择与该装置有关的数据、识别与该装置有关的注意点或关注点、或者以其他方式加入与该装置的一个或多个交互或交互序列中)。而且，操作240于是可以包括捕获来自用户的与操作230中检测到的装置交互有关的语句。
例如，浏览显示装置上呈现的网页的用户可能在该网页上看到产品名称并且想要得到关于购买该产品的更多信息。该用户可以从该网页中选择出包括该产品名称的文本(例如，使用鼠标或键盘突出文本)，接着发起语音点击以询问“这可以在Amazon.com上买到吗？”。在该示例中，操作230可以包括与该显示装置关联的装置收听器检测对与该产品名称关联的文本的选择，而操作240可以包括捕获询问是否可在Amazon.com上买到该产品的语句。
如上所述，接收来自用户的输入的每一装置都可以具有内部时钟或计时机制。因此，在操作250中，每一装置可以从本地角度来确定何时接收到该输入并通知语音点击模块接收到该输入。具体而言，除了与一个或多个其他装置的一个或多个其他交互之外，给定的语音点击可以至少还包括通过语音输入装置接收到的自然语言语句。该语句可以在装置交互之前、与其同时或之后接收到，由此操作250包括确定装置交互的时间以与所述相关语句关联。具体而言，利用参照操作220描述的被同步的装置收听器信号，操作260可以包括使装置交互的信号和该语句的信号对齐。在使装置交互信号和语句信号匹配时，可以产生包括对齐的语音和非语音成分的语音点击输入。接着，语音点击输入可以经受进一步的自然语言处理，如下文详细描述。
根据本发明的各个方面，图3示出了用于在自然语言语音服务环境中处理多模式装置交互的示例性方法的流程图。如上所述，多模式装置交互(或“语音点击”)通常可以在以下时候发生：用户与一个或多个多模式装置交互，同时还提供与所述装置交互有关的一个或多个自然语言语句。就这一点而言，在一个实现方式中，图3中示出的方法可以在以下时候执行：一个或多个自然语言处理元件持续收听或以其他方式监测一个或多个多模式装置以确定一个或多个语音点击何时发生。
在一个实现方式中，一个或多个装置交互可以被限定为发起语音点击。例如，任一给定的电子装置通常可以支持各种不同的交互，所述各种不同的交互可以引起执行给定的动作、命令、查询或其他请求。因此，在一个实现方式中，给定的电子装置可以唯一识别或者使用以产生可唯一识别信号的装置交互的任何适当组合可以被定义为语音点击，其中该语音点击可以提供这样的信号：该信号指示自然语言语句要和与相关装置交互关联的背景一起被处理。例如，具有四通导航键或五通导航键的装置可以支持特定不同的交互，其中以特定方式按导航键可以引起执行特定任务或其他动作，比如控制地图显示或计算路径。在另一示例中，具有滚轮选择器的BlackBerry装置可以支持多种交互，比如在具体的注意点或关注点上滚动光标、按压滚轮以选择特定数据或给定的应用程序、或者各种其他交互。各种其他装置交互可以用来指示自然语言语句何时与和所述装置交互有关的背景一起处理，但不限于此，其中在任一给定的实现方式中，具体的装置交互可以变化。例如，相关装置交互还可以包括下列中的一个或多个：利用定向仪器或绘图仪器在触摸感应显示屏上用动作示意(例如，绘制耳状波形曲线)，比如长触摸或者双击的独特交互方法，和/或如果系统在以上所述的持续收听模式下工作，则预定义的背景命令字可以表示当前装置背景要和跟在该背景命令字之后的一部分基于语音的输入一起处理(例如，命令字为“可以(OK)”、“请”、“计算机”或其他适当的字，其中用户可以在地图上选择特定的点并说“请放大”，或者当显示电子邮件时说“可以读取”，等)。
就这一点而言，操作310可以包括在自然语言语音服务环境中处理多模式装置交互以检测表示发起语音点击的一个或者多个装置交互的发生。具体地，操作310中检测到的装置交互可以包括引起电子装置产生唯一的、可识别的或其他可区分的信号的任何适当交互，该可区分的信号涉及用户选择数据、识别注意点或关注点、调用应用程序或任务、或者根据装置的特定性能以另一方式和该装置交互。
除了装置响应于用户交互而产生的特定信号外，操作310中检测到的交互可以表示发起语音点击，由此先前的、同时发生的或随后的自然语言语音输入可提供用于解释操作310中检测到的装置交互的进一步背景。例如，自然语言处理系统通常可以配置成在具体的装置交互发生(例如，按按钮以打开话筒)时接受语音输入。因此，在图3中示出的方法中，表示进入的语音输入的装置交互还可以包括与电子装置的任何适当的交互或交互组合，包括与用户选择数据、识别注意点或关注点、调用应用程序或任务、或根据装置的特定性能以另一方式与该装置进行交互有关的交互。
就这一点而言，当操作310中已检测到语音点击装置交互时，可以在操作320中产生语音点击信号以表示自然语言语音输入应当与操作320中检测到的交互关联。随后，操作330可以包括捕获要和操作310中检测到的交互关联的用户语句。在一个实现方式中，操作310中检测到的交互可以表示随后将提供语音输入，但是显然，在一个或多个实现方式中，操作330中捕获的语句可以在操作310中检测到的交互之前或与其同时提供(例如，用户可以提供比如“在iTunes上查找此艺术家”的语句并随后在媒体播放器上语音点击该艺术家的名字，或者该用户可以在语音点击该艺术家的名字的同时提供此语句，或者该用户可以语音点击该艺术家的名字且接着提供该语句)。
当已接收到与语音点击装置交互有关的信息和相关自然语言语句时，操作340可以包括提取并组合装置交互的背景信息和相关语句的背景信息。具体而言，从语音点击装置交互中提取出的背景信息可以包括与用户选择的部分、项目、注意点、关注点或数据、或者用户加入的具体的装置交互或装置交互序列有关的信息。提取出的装置交互的背景接着可以与针对在操作330中捕获的自然语言语句提取出的背景组合，其中在操作350中，组合的背景信息可以用来确定语音点击的目的。
例如，在示例性语音点击装置交互中，用户可以选择性地将来自媒体播放器的音乐合集拷贝到备份存储装置。当在媒体播放器上浏览音乐时，用户可能遇到具体的歌曲并语音点击该歌曲，同时说“拷贝此整个唱片集”(例如，在突出该歌曲的同时通过长时间按该媒体播放器上的具体的按键)。在该示例中，操作310可以包括检测长时间的按钮按下的交互，该长时间的按钮按下引起操作320中产生语音点击信号。接着，可以在操作330中捕获语句“拷贝此整个唱片集”，并且与该语音点击装置交互有关的背景信息和所述语句的背景信息可以在操作340中组合。具体地，装置交互的背景可以包括与所选择的歌曲有关的信息等(例如，该背景还可以包括与该歌曲有关的元数据中包括的信息，比如音乐文件的ID3标记)。此外，所述语句的背景可以包括识别拷贝操作和包括所选歌曲的唱片集的信息。
就这一点而言，与和多模式装置的语音点击交互有关的背景信息可以和与自然语言语句有关的背景信息组合，由此操作350可以确定语音点击交互的目的。例如，参照以上示例，操作350中确定的目的可以包括将包括来自媒体播放器的突出显示的歌曲的唱片集拷贝到备份存储装置上的目的。因此，响应于操作350中确定语音点击的目的，在操作360中可以适当地路由一个或多个请求。在本文讨论的示例中，操作360可以包括将一个或多个请求路由到该媒体播放器，以识别与包括该突出显示的歌曲的唱片集有关的所有数据，以及将一个或多个请求路由到能够管理将所识别的数据从媒体播放器拷贝到备份存储装置的装置的任何适当组合(例如，与媒体播放器和存储装置连接的个人计算机)。
根据本发明的各个方面，图4示出了用于在自然语言语音服务环境中处理多模式装置交互以产生交易提示或“点进”的示例性方法的流程图。具体而言，图4中示出的方法可以用于结合响应于检测到的一个或多个语音点击装置交互而执行的一个或多个动作来产生交易提示或点进。
例如，操作410可以包括检测从用户接收到的一个或多个语音点击装置交互，其中所述语音点击装置交互可以包括与一个或多个相关自然语言语句结合的一个或多个装置交互的任一适当组合。接着可以在操作420中确定用户加入语音点击装置交互的目的，且随后的操作430可以包括基于确定的目的将一个或多个请求路由到一个或多个处理装置以解析语音点击交互。在一个实现方式中，可以与以上参照图2和图3所述的方式相似的方式执行操作410、420和430，由此用于装置交互的信号可以与用于一个或多个自然语言语句的信号对齐，且可以从所述信号中提取出背景信息以确定语音点击装置交互的目的。
除了基于用户目的来路由一个或多个请求外，图4中示出的方法还可包括产生一个或多个交易提示，所述交易提示可以导致一个或多个点进。例如，点进通常可以指用户点击或选择电子广告以访问与刊登广告的人有关的一个或多个服务的示例。在很多电子系统中，点进或点进率可以提供用于测量用户与电子广告交互的机制，该机制可以提供各种测量，刊登广告的人可以使用所述各种测量以确定要付给将广告提供给用户的组织的金额。
就这一点而言，图4中示出的方法可以产生包括广告或推荐的交易提示，由此用户的与特定的装置交互组合的基于语音的输入可以提供用于产生交易提示的进一步的注意点。以此方式，提供给用户的广告或推荐可以与用户可能与其交互的特定信息更相关。而且，利用自然语言认知模型与用户的偏好有关的共享知识可以为对特定用户量身订制的目标交易提示提供进一步的背景，因此这可以更有可能导致能够产生向语音服务提供商支付费用的点进。
因此，除了基于用户加入语音点击装置交互的目的而路由一个或多个请求之外，操作440还可包括基于确定的目的产生一个或多个交易提示。具体而言，基于装置交互和相关自然语言语句的组合背景，可以以“更接近”用户的方式处理交易提示，其中本地语音背景和非语音背景可用作执行目标广告的任一适当系统中的状态数据。例如，参照以上给出的用户选择导航装置上显示的交叉点并同时说“找到这周围的餐馆”的示例，操作440中产生的交易提示可以包括交叉点附近的餐馆的一个或多个广告或推荐，所述广告和推荐可以基于用户的短期偏好和长期偏好(例如，偏好的餐馆类型、偏好的价格范围等)的知识而面向用户。
接着，所述交易提示可以呈现给用户(例如，作为地图显示上的可选点)。接着可以在操作450中监测用户的随后的多模式装置交互以确定一个或多个其他多模式装置交互是否发生或何时发生。如果未发生其他交互，则可以确定用户未按照交易提示行动，则该过程可以结束。然而，如果发生附加的多模式交互，则可以在操作480中处理该多模式输入以确定输入的目的并相应地路由一个或多个请求。此外，操作460可以包括确定所述多模式输入是否与操作440中产生的交易提示有关。例如，用户可以通过提供语句、非语音装置交互或请求与所述交易提示有关的进一步动作或信息的语音点击装置交互来选择做广告的或推荐的餐馆中的一个餐馆。在这样的情况下，操作470还可以包括处理与操作440中产生的交易提示有关的交易点进，其中所述交易点进可以用来为具体组织(例如，语音服务的提供商或与所述交易提示或交易点进有关的另一组织)确定支付费用或产生收益。
本发明的实现方式可以在硬件、固件、软件或它们的各种组合中进行。本发明还可作为存储在机器可读介质上的指令实现，所述指令可以由一个或多个处理器读取并执行。机器可读介质可以包括用来存储或发送机器(例如计算装置)可读形式的信息的各种机构。例如，机器可读存储介质可以包括只读存储器、随机存取存储器、磁盘存储媒介、光学存储媒介、闪存装置或其他存储媒介，机器可读传输媒介可以包括多种形式的传播信号，比如载波、红外线信号、数字信号或其他传输媒介。而且，可以在以上公开内容中就本发明的具体示例方面和实现方式以及执行某些动作这些方面来描述固件、软件、程序或指令。然而，显然，这些描述仅是为了方便，且这些动作实际上由执行所述固件、软件、程序或指令的计算装置、处理器、控制器或其他装置产生。
尽管本文提供的描述主要集中在用于在自然语言语音服务环境中处理多模式装置交互的技术，但是显然，各种其他自然语言处理性能可以用于结合、附加于或代替与本文讨论的具体方面和实现方式关联描述的自然语言处理性能。例如，除了以上提及的共同待决的美国专利申请描述的技术外，本文描述的系统和方法还可利用2005年8月5日提交的名称为“Systems and Methods forResponding to Natural Language Speech Utterance”的共同待决的美国专利申请11/197,504、2005年8月10日提交的名称为“System and Method of SupportingAdaptive Misrecognition in Conversational Speech”的美国专利申请11/200,164、2005年8月29日提交的名称为“Mobile Systems and Methods of SupportingNatural Language Human-Machine Interactions”的美国专利申请11/212,693、2006年10月16日提交的名称为“System and Method for a Cooperative ConversationalVoice User Interface”的美国专利申请11/580,926、2007年2月6日提交的名称为“System and Method for Selecting and Presenting Advertisements based onNatural Language Processing of Voice-Based Input”的美国专利申请11/671,526以及2007年12月11日提交的名称为“System and Method for Providing a NaturalLanguage Voice User Interface in an Integrated Voice Navigation ServicesEnvironment”的美国专利申请11/954,064中描述的自然语言处理性能，所述美国专利申请公开的全部内容通过引用并入本文。
因此，本发明的方面和实现方式可以在本文中描述为包括具体的特征、结构或性质，但将明显的是，每一方面或实现方式可以或者可以不一定包括具体的特征、结构或性质。此外，当具体的特征、结构或者性质已结合一给定的方面或实现方式予以描述时，应当理解，无论是否明确描述，这样的特征、结构或性质也可以包括在其他的方面或实现方式中。因此，可以对以上描述进行各种改变或修改，而不脱离本发明的精神或范围，因此，本说明书和附图应当仅看作示例性的，本发明的范围仅由所附权利要求确定。

Claims (16)

1.一种用于在包括一个或多个电子装置的自然语言语音服务环境中处理一个或多个多模式装置交互的方法，所述方法包括：
检测至少一个多模式装置交互，其中所述多模式装置交互包括与所述电子装置中的至少一个或与和所述电子装置中的至少一个有关的应用程序进行的非语音交互，且其中所述多模式装置交互还包括与所述非语音交互有关的至少一个自然语言语句；
提取与所述多模式装置交互有关的背景信息，其中所提取的背景信息包括与所述非语音交互有关的背景，与所述非语音交互有关的背景包括与选择的产品有关的信息，以及其中所提取的背景信息还包括与所述自然语言语句有关的背景；
组合与所述非语音交互有关的背景和与所述自然语言语句有关的背景；
基于与所述非语音交互和所述自然语言语句有关的组合的背景，确定所述多模式装置交互的目的；以及
基于所确定的所述多模式装置交互的目的，将至少一个请求路由到所述电子装置中的一个或多个。
2.如权利要求1所述的方法，其中所述电子装置中的至少一个包括配置成接收所述自然语言语句的输入装置。
3.如权利要求2所述的方法，所述方法还包括响应于检测到的所述非语音交互，用信号通知所述输入装置捕获自然语言语句。
4.如权利要求3所述的方法，所述方法还包括：
在所述自然语言语音服务环境中建立一个或多个装置收听器，所述装置收听器被配置成检测所述非语音交互；以及
使与由所述装置收听器检测到的所述非语音交互有关的信息以及与由所述输入装置捕获的所述自然语言语句有关的信息对齐。
5.如权利要求1所述的方法，其中
所述方法还包括：
基于所确定的多模式装置交互的目的，产生至少一个交易提示；
接收与产生的所述交易提示有关的至少一个附加多模式装置交互；以及
响应于接收与所产生的交易提示有关的多模式装置交互，处理交易点进，
产生的所述交易提示包括与所确定的所述多模式装置交互的目的有关的广告或推荐中的至少一个。
6.如权利要求1所述的方法，其中所述非语音交互包括选择与所述电子装置中的一个或多个有关的部分、项目、数据或应用程序。
7.如权利要求1所述的方法，其中所述非语音交互包括识别与所述电子装置中的一个或多个有关的注意点或关注点。
8.如权利要求1所述的方法，其中所述非语音交互包括与所述电子装置中的一个或多个有关的一个或多个唯一且可区分的交互。
9.一种用于在包括一个或多个电子装置的自然语言语音服务环境中处理一个或多个多模式装置交互的系统，其中所述系统包括一个或多个处理装置，所述一个或多个处理装置配置成：
检测至少一个多模式装置交互，其中所述多模式装置交互包括与所述电子装置中的至少一个或与和所述电子装置中的至少一个有关的应用程序进行的非语音交互，且其中所述多模式装置交互还包括与所述非语音交互有关的至少一个自然语言语句；
提取与所述多模式装置交互有关的背景信息，其中所提取的背景信息包括与所述非语音交互有关的背景，与所述非语音交互有关的背景包括与选择的产品有关的信息，且其中所提取的背景信息还包括与所述自然语言语句有关的背景；
组合与所述非语音交互有关的背景和与所述自然语言语句有关的背景；
基于与所述非语音交互和所述自然语言语句有关的组合的背景，确定所述多模式装置交互的目的；以及
基于所确定的所述多模式装置交互的目的，将至少一个请求路由到所述电子装置中的一个或多个。
10.如权利要求9所述的系统，其中所述电子装置中的至少一个包括配置成接收所述自然语言语句的输入装置。
11.如权利要求10所述的系统，其中所述处理装置还配置成响应于正在被检测的所述非语音交互，用信号通知所述输入装置捕获自然语言语句。
12.如权利要求11所述的系统，其中所述处理装置还配置成：
在所述自然语言语音服务环境中建立一个或多个装置收听器，所述装置收听器被配置成检测所述非语音交互；以及
使与由所述装置收听器检测到的所述非语音交互有关的信息以及与由所述输入装置捕获的自然语言语句有关的信息对齐。
13.如权利要求9所述的系统，其中所述处理装置还配置成：
基于所确定的多模式装置交互的目的，产生至少一个交易提示；
接收与所产生的所述交易提示有关的至少一个附加多模式装置交互；以及
响应于接收与所产生的交易提示有关的多模式装置交互，处理交易点进，
所产生的所述交易提示包括与所确定的所述多模式装置交互的目的有关的广告或推荐中的至少一个。
14.如权利要求9所述的系统，其中所述非语音交互包括选择与所述电子装置中的一个或多个有关的部分、项目、数据或应用程序。
15.如权利要求9所述的系统，其中所述非语音交互包括识别与所述电子装置中的一个或多个有关的注意点或关注点。
16.如权利要求9所述的系统，其中所述非语音交互包括与所述电子装置中的一个或多个有关的一个或多个唯一且可区分的交互。
CN201080017511.4A 2009-02-20 2010-02-22 在自然语言语音服务环境中处理多模式装置交互的系统和方法 Active CN102439659B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/389,678 US8326637B2 (en) 2009-02-20 2009-02-20 System and method for processing multi-modal device interactions in a natural language voice services environment
US12/389,678 2009-02-20
PCT/US2010/024895 WO2010096752A1 (en) 2009-02-20 2010-02-22 System and method for processing multi-modal device interactions in a natural language voice services environment

Publications (2)

Publication Number Publication Date
CN102439659A CN102439659A (zh) 2012-05-02
CN102439659B true CN102439659B (zh) 2015-05-20

Family

ID=42631746

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201080017511.4A Active CN102439659B (zh) 2009-02-20 2010-02-22 在自然语言语音服务环境中处理多模式装置交互的系统和方法

Country Status (5)

Country Link
US (7) US8326637B2 (zh)
EP (1) EP2399255B1 (zh)
JP (3) JP2012518847A (zh)
CN (1) CN102439659B (zh)
WO (1) WO2010096752A1 (zh)

Families Citing this family (384)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001013255A2 (en) 1999-08-13 2001-02-22 Pixo, Inc. Displaying and traversing links in character array
US8645137B2 (en) 2000-03-16 2014-02-04 Apple Inc. Fast, language-independent method for user authentication by voice
ITFI20010199A1 (it) 2001-10-22 2003-04-22 Riccardo Vieri Sistema e metodo per trasformare in voce comunicazioni testuali ed inviarle con una connessione internet a qualsiasi apparato telefonico
US7398209B2 (en) 2002-06-03 2008-07-08 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
US7693720B2 (en) 2002-07-15 2010-04-06 Voicebox Technologies, Inc. Mobile systems and methods for responding to natural language speech utterance
US7669134B1 (en) 2003-05-02 2010-02-23 Apple Inc. Method and apparatus for displaying information during an instant messaging session
US10032452B1 (en) 2016-12-30 2018-07-24 Google Llc Multimodal transmission of packetized data
US20060271520A1 (en) * 2005-05-27 2006-11-30 Ragan Gene Z Content-based implicit search query
US7640160B2 (en) 2005-08-05 2009-12-29 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
US7620549B2 (en) 2005-08-10 2009-11-17 Voicebox Technologies, Inc. System and method of supporting adaptive misrecognition in conversational speech
US7949529B2 (en) 2005-08-29 2011-05-24 Voicebox Technologies, Inc. Mobile systems and methods of supporting natural language human-machine interactions
US7634409B2 (en) 2005-08-31 2009-12-15 Voicebox Technologies, Inc. Dynamic speech sharpening
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US7633076B2 (en) 2005-09-30 2009-12-15 Apple Inc. Automated response to and sensing of user activity in portable devices
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8073681B2 (en) 2006-10-16 2011-12-06 Voicebox Technologies, Inc. System and method for a cooperative conversational voice user interface
US7818176B2 (en) 2007-02-06 2010-10-19 Voicebox Technologies, Inc. System and method for selecting and presenting advertisements based on natural language processing of voice-based input
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
ITFI20070177A1 (it) 2007-07-26 2009-01-27 Riccardo Vieri Sistema per la creazione e impostazione di una campagna pubblicitaria derivante dall'inserimento di messaggi pubblicitari all'interno di uno scambio di messaggi e metodo per il suo funzionamento.
US9053089B2 (en) 2007-10-02 2015-06-09 Apple Inc. Part-of-speech tagging using latent analogy
US8364694B2 (en) 2007-10-26 2013-01-29 Apple Inc. Search assistant for digital media assets
US8620662B2 (en) 2007-11-20 2013-12-31 Apple Inc. Context-aware unit selection
US8140335B2 (en) 2007-12-11 2012-03-20 Voicebox Technologies, Inc. System and method for providing a natural language voice user interface in an integrated voice navigation services environment
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US9330720B2 (en) 2008-01-03 2016-05-03 Apple Inc. Methods and apparatus for altering audio output signals
US8327272B2 (en) 2008-01-06 2012-12-04 Apple Inc. Portable multifunction device, method, and graphical user interface for viewing and managing electronic calendars
US8065143B2 (en) 2008-02-22 2011-11-22 Apple Inc. Providing text input using speech data and non-speech data
US8289283B2 (en) 2008-03-04 2012-10-16 Apple Inc. Language input interface on a device
US8996376B2 (en) 2008-04-05 2015-03-31 Apple Inc. Intelligent text-to-speech conversion
US10496753B2 (en) 2010-01-18 2019-12-03 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8589161B2 (en) 2008-05-27 2013-11-19 Voicebox Technologies, Inc. System and method for an integrated, multi-modal, multi-device natural language voice services environment
US9305548B2 (en) 2008-05-27 2016-04-05 Voicebox Technologies Corporation System and method for an integrated, multi-modal, multi-device natural language voice services environment
US8464150B2 (en) 2008-06-07 2013-06-11 Apple Inc. Automatic language identification for dynamic text processing
US20100030549A1 (en) 2008-07-31 2010-02-04 Lee Michael M Mobile device having human language translation capability with positional feedback
US8768702B2 (en) 2008-09-05 2014-07-01 Apple Inc. Multi-tiered voice feedback in an electronic device
US8898568B2 (en) 2008-09-09 2014-11-25 Apple Inc. Audio user interface
US8712776B2 (en) 2008-09-29 2014-04-29 Apple Inc. Systems and methods for selective text to speech synthesis
US8352268B2 (en) 2008-09-29 2013-01-08 Apple Inc. Systems and methods for selective rate of speech and speech preferences for text to speech synthesis
US8352272B2 (en) 2008-09-29 2013-01-08 Apple Inc. Systems and methods for text to speech synthesis
US8355919B2 (en) 2008-09-29 2013-01-15 Apple Inc. Systems and methods for text normalization for text to speech synthesis
US8583418B2 (en) * 2008-09-29 2013-11-12 Apple Inc. Systems and methods of detecting language and natural language strings for text to speech synthesis
US8396714B2 (en) 2008-09-29 2013-03-12 Apple Inc. Systems and methods for concatenation of words in text to speech synthesis
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
WO2010067118A1 (en) 2008-12-11 2010-06-17 Novauris Technologies Limited Speech recognition involving a mobile device
US8862252B2 (en) 2009-01-30 2014-10-14 Apple Inc. Audio user interface for displayless electronic device
US8326637B2 (en) 2009-02-20 2012-12-04 Voicebox Technologies, Inc. System and method for processing multi-modal device interactions in a natural language voice services environment
US8380507B2 (en) 2009-03-09 2013-02-19 Apple Inc. Systems and methods for determining the language to use for speech generated by a text to speech engine
US20120311585A1 (en) 2011-06-03 2012-12-06 Apple Inc. Organizing task items that represent tasks to perform
US10540976B2 (en) 2009-06-05 2020-01-21 Apple Inc. Contextual voice commands
US10241644B2 (en) 2011-06-03 2019-03-26 Apple Inc. Actionable reminder entries
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10241752B2 (en) 2011-09-30 2019-03-26 Apple Inc. Interface for a virtual digital assistant
US9431006B2 (en) 2009-07-02 2016-08-30 Apple Inc. Methods and apparatuses for automatic speech recognition
JP5471106B2 (ja) * 2009-07-16 2014-04-16 独立行政法人情報通信研究機構 音声翻訳システム、辞書サーバ装置、およびプログラム
US9171541B2 (en) * 2009-11-10 2015-10-27 Voicebox Technologies Corporation System and method for hybrid processing in a natural language voice services environment
WO2011059997A1 (en) * 2009-11-10 2011-05-19 Voicebox Technologies, Inc. System and method for providing a natural language content dedication service
US8682649B2 (en) 2009-11-12 2014-03-25 Apple Inc. Sentiment prediction from textual data
US8600743B2 (en) 2010-01-06 2013-12-03 Apple Inc. Noise profile determination for voice-related feature
US8381107B2 (en) 2010-01-13 2013-02-19 Apple Inc. Adaptive audio feedback system and method
US8311838B2 (en) 2010-01-13 2012-11-13 Apple Inc. Devices and methods for identifying a prompt corresponding to a voice input in a sequence of prompts
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US10553209B2 (en) 2010-01-18 2020-02-04 Apple Inc. Systems and methods for hands-free notification summaries
US10679605B2 (en) 2010-01-18 2020-06-09 Apple Inc. Hands-free list-reading by intelligent automated assistant
US10705794B2 (en) 2010-01-18 2020-07-07 Apple Inc. Automatically adapting user interfaces for hands-free interaction
US8676581B2 (en) * 2010-01-22 2014-03-18 Microsoft Corporation Speech recognition analysis via identification information
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US9342500B2 (en) * 2010-03-15 2016-05-17 Michael V. Liguori Object memory management system
US8639516B2 (en) 2010-06-04 2014-01-28 Apple Inc. User-specific noise suppression for voice quality improvements
US8296151B2 (en) * 2010-06-18 2012-10-23 Microsoft Corporation Compound gesture-speech commands
US8713021B2 (en) 2010-07-07 2014-04-29 Apple Inc. Unsupervised document clustering using latent semantic density analysis
US8538760B2 (en) * 2010-07-13 2013-09-17 Qualcomm Incorporated Methods and apparatuses for identifying audible samples for use in a speech recognition capability of a mobile device
US9104670B2 (en) 2010-07-21 2015-08-11 Apple Inc. Customized search or acquisition of digital media assets
US8719006B2 (en) 2010-08-27 2014-05-06 Apple Inc. Combined statistical and rule-based part-of-speech tagging for text-to-speech synthesis
US20120059814A1 (en) * 2010-09-08 2012-03-08 Nuance Communications, Inc. Methods and apparatus for selecting a search engine to which to provide a search query
US8719014B2 (en) 2010-09-27 2014-05-06 Apple Inc. Electronic device with text error correction based on voice recognition data
US10515147B2 (en) 2010-12-22 2019-12-24 Apple Inc. Using statistical language models for contextual lookup
US10762293B2 (en) 2010-12-22 2020-09-01 Apple Inc. Using parts-of-speech tagging and named entity recognition for spelling correction
KR101295711B1 (ko) * 2011-02-15 2013-08-16 주식회사 팬택 음성 인식으로 애플리케이션의 실행 가능한 이동통신 단말 장치 및 방법
US8781836B2 (en) 2011-02-22 2014-07-15 Apple Inc. Hearing assistance system for providing consistent human speech
US11062615B1 (en) 2011-03-01 2021-07-13 Intelligibility Training LLC Methods and systems for remote language learning in a pandemic-aware world
US10019995B1 (en) 2011-03-01 2018-07-10 Alice J. Stiebel Methods and systems for language learning based on a series of pitch patterns
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US9858343B2 (en) 2011-03-31 2018-01-02 Microsoft Technology Licensing Llc Personalization of queries, conversations, and searches
US9298287B2 (en) 2011-03-31 2016-03-29 Microsoft Technology Licensing, Llc Combined activation for natural user interface systems
US9760566B2 (en) 2011-03-31 2017-09-12 Microsoft Technology Licensing, Llc Augmented conversational understanding agent to identify conversation context between two humans and taking an agent action thereof
US10642934B2 (en) 2011-03-31 2020-05-05 Microsoft Technology Licensing, Llc Augmented conversational understanding architecture
US9842168B2 (en) 2011-03-31 2017-12-12 Microsoft Technology Licensing, Llc Task driven user intents
EP2691885A4 (en) * 2011-03-31 2015-09-30 Microsoft Technology Licensing Llc INCREASED CONVERSATIONAL UNDERSTANDING ARCHITECTURE
US9244984B2 (en) 2011-03-31 2016-01-26 Microsoft Technology Licensing, Llc Location based conversational understanding
US9064006B2 (en) 2012-08-23 2015-06-23 Microsoft Technology Licensing, Llc Translating natural language utterances to keyword search queries
US9454962B2 (en) 2011-05-12 2016-09-27 Microsoft Technology Licensing, Llc Sentence simplification for spoken language understanding
US9263045B2 (en) * 2011-05-17 2016-02-16 Microsoft Technology Licensing, Llc Multi-mode text input
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
US20120310642A1 (en) 2011-06-03 2012-12-06 Apple Inc. Automatically creating a mapping between text data and audio data
US8812294B2 (en) 2011-06-21 2014-08-19 Apple Inc. Translating phrases from one language into another using an order-based set of declarative rules
US8706472B2 (en) 2011-08-11 2014-04-22 Apple Inc. Method for disambiguating multiple readings in language conversion
US8994660B2 (en) 2011-08-29 2015-03-31 Apple Inc. Text correction processing
US8762156B2 (en) 2011-09-28 2014-06-24 Apple Inc. Speech recognition repair using contextual information
WO2013130644A1 (en) 2012-02-28 2013-09-06 Centurylink Intellectual Property Llc Apical conduit and methods of using same
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
US9483461B2 (en) 2012-03-06 2016-11-01 Apple Inc. Handling speech synthesis of content for multiple languages
US8694522B1 (en) * 2012-03-28 2014-04-08 Amazon Technologies, Inc. Context dependent recognition
US9093076B2 (en) 2012-04-30 2015-07-28 2236008 Ontario Inc. Multipass ASR controlling multiple applications
US9431012B2 (en) * 2012-04-30 2016-08-30 2236008 Ontario Inc. Post processing of natural language automatic speech recognition
US9620111B1 (en) * 2012-05-01 2017-04-11 Amazon Technologies, Inc. Generation and maintenance of language model
US9280610B2 (en) 2012-05-14 2016-03-08 Apple Inc. Crowd sourcing information to fulfill user requests
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US8775442B2 (en) 2012-05-15 2014-07-08 Apple Inc. Semantic search using a single-source semantic model
US10776830B2 (en) 2012-05-23 2020-09-15 Google Llc Methods and systems for identifying new computers and providing matching services
US9721563B2 (en) 2012-06-08 2017-08-01 Apple Inc. Name recognition system
WO2013185109A2 (en) 2012-06-08 2013-12-12 Apple Inc. Systems and methods for recognizing textual identifiers within a plurality of words
US20130332450A1 (en) * 2012-06-11 2013-12-12 International Business Machines Corporation System and Method for Automatically Detecting and Interactively Displaying Information About Entities, Activities, and Events from Multiple-Modality Natural Language Sources
WO2013187610A1 (en) * 2012-06-15 2013-12-19 Samsung Electronics Co., Ltd. Terminal apparatus and control method thereof
US9373338B1 (en) * 2012-06-25 2016-06-21 Amazon Technologies, Inc. Acoustic echo cancellation processing based on feedback from speech recognizer
US9495129B2 (en) 2012-06-29 2016-11-15 Apple Inc. Device, method, and user interface for voice-activated navigation and browsing of a document
US9576574B2 (en) 2012-09-10 2017-02-21 Apple Inc. Context-sensitive handling of interruptions by intelligent digital assistant
US9547647B2 (en) 2012-09-19 2017-01-17 Apple Inc. Voice-based media searching
US8935167B2 (en) 2012-09-25 2015-01-13 Apple Inc. Exemplar-based latent perceptual modeling for automatic speech recognition
US9479390B2 (en) 2012-11-14 2016-10-25 Accuzip, Inc. Automatic initiation of a response action when an event associated with an item in transit is based on logistical node scan data
US11153146B2 (en) 2012-11-14 2021-10-19 Accuzip, Inc. Hardware server and technical method to optimize bulk printing of mailing items
US9097548B2 (en) * 2013-01-07 2015-08-04 Televav, Inc. Content delivery system with natural language mechanism and method of operation thereof
US10735552B2 (en) 2013-01-31 2020-08-04 Google Llc Secondary transmissions of packetized data
US10650066B2 (en) 2013-01-31 2020-05-12 Google Llc Enhancing sitelinks with creative content
KR102516577B1 (ko) 2013-02-07 2023-04-03 애플 인크. 디지털 어시스턴트를 위한 음성 트리거
DE102013101871A1 (de) * 2013-02-26 2014-08-28 PSYWARE GmbH Wortwahlbasierte Sprachanalyse und Sprachanalyseeinrichtung
US10783139B2 (en) 2013-03-06 2020-09-22 Nuance Communications, Inc. Task assistant
US10795528B2 (en) 2013-03-06 2020-10-06 Nuance Communications, Inc. Task assistant having multiple visual displays
US10629186B1 (en) * 2013-03-11 2020-04-21 Amazon Technologies, Inc. Domain and intent name feature identification and processing
US10572476B2 (en) 2013-03-14 2020-02-25 Apple Inc. Refining a search based on schedule items
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US10642574B2 (en) 2013-03-14 2020-05-05 Apple Inc. Device, method, and graphical user interface for outputting captions
US9977779B2 (en) 2013-03-14 2018-05-22 Apple Inc. Automatic supplementation of word correction dictionaries
US9368114B2 (en) 2013-03-14 2016-06-14 Apple Inc. Context-sensitive handling of interruptions
US9733821B2 (en) 2013-03-14 2017-08-15 Apple Inc. Voice control to diagnose inadvertent activation of accessibility features
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
WO2014144579A1 (en) 2013-03-15 2014-09-18 Apple Inc. System and method for updating an adaptive speech recognition model
US11151899B2 (en) 2013-03-15 2021-10-19 Apple Inc. User training by intelligent digital assistant
CN112230878A (zh) 2013-03-15 2021-01-15 苹果公司 对中断进行上下文相关处理
WO2014144949A2 (en) 2013-03-15 2014-09-18 Apple Inc. Training an at least partial voice command system
KR102102157B1 (ko) 2013-03-29 2020-04-21 삼성전자주식회사 복수 어플리케이션을 실행하는 디스플레이 장치 및 그 제어 방법
US9875494B2 (en) * 2013-04-16 2018-01-23 Sri International Using intents to analyze and personalize a user's dialog experience with a virtual personal assistant
US9384751B2 (en) * 2013-05-06 2016-07-05 Honeywell International Inc. User authentication of voice controlled devices
US9582608B2 (en) 2013-06-07 2017-02-28 Apple Inc. Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
WO2014197336A1 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for detecting errors in interactions with a voice-based digital assistant
WO2014197334A2 (en) 2013-06-07 2014-12-11 Apple Inc. System and method for user-specified pronunciation of words for speech synthesis and recognition
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
EP3008641A1 (en) * 2013-06-09 2016-04-20 Apple Inc. Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant
CN105265005B (zh) 2013-06-13 2019-09-17 苹果公司 用于由语音命令发起的紧急呼叫的系统和方法
KR102053820B1 (ko) 2013-07-02 2019-12-09 삼성전자주식회사 서버 및 그 제어방법과, 영상처리장치 및 그 제어방법
US9786997B2 (en) 2013-08-01 2017-10-10 Centurylink Intellectual Property Llc Wireless access point in pedestal or hand hole
WO2015020942A1 (en) 2013-08-06 2015-02-12 Apple Inc. Auto-activating smart responses based on activities from remote devices
US9892745B2 (en) 2013-08-23 2018-02-13 At&T Intellectual Property I, L.P. Augmented multi-tier classifier for multi-modal voice activity detection
US10276921B2 (en) 2013-09-06 2019-04-30 Centurylink Intellectual Property Llc Radiating closures
US10154325B2 (en) 2014-02-12 2018-12-11 Centurylink Intellectual Property Llc Point-to-point fiber insertion
US9780433B2 (en) 2013-09-06 2017-10-03 Centurylink Intellectual Property Llc Wireless distribution using cabinets, pedestals, and hand holes
US9189742B2 (en) 2013-11-20 2015-11-17 Justin London Adaptive virtual intelligent agent
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US8938394B1 (en) * 2014-01-09 2015-01-20 Google Inc. Audio triggers based on context
US9620105B2 (en) 2014-05-15 2017-04-11 Apple Inc. Analyzing audio input for efficient speech and music recognition
US10592095B2 (en) 2014-05-23 2020-03-17 Apple Inc. Instantaneous speaking of content on touch devices
US9502031B2 (en) 2014-05-27 2016-11-22 Apple Inc. Method for supporting dynamic grammars in WFST-based ASR
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9842101B2 (en) 2014-05-30 2017-12-12 Apple Inc. Predictive conversion of language input
US9760559B2 (en) 2014-05-30 2017-09-12 Apple Inc. Predictive text input
US10078631B2 (en) 2014-05-30 2018-09-18 Apple Inc. Entropy-guided text prediction using combined word and character n-gram language models
US10289433B2 (en) 2014-05-30 2019-05-14 Apple Inc. Domain specific language for encoding assistant dialog
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9734193B2 (en) 2014-05-30 2017-08-15 Apple Inc. Determining domain salience ranking from ambiguous words in natural speech
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
EP3149728B1 (en) 2014-05-30 2019-01-16 Apple Inc. Multi-command single utterance input method
US9785630B2 (en) 2014-05-30 2017-10-10 Apple Inc. Text prediction using combined word N-gram and unigram language models
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
US10102195B2 (en) 2014-06-25 2018-10-16 Amazon Technologies, Inc. Attribute fill using text extraction
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10659851B2 (en) 2014-06-30 2020-05-19 Apple Inc. Real-time digital assistant knowledge updates
US9257120B1 (en) 2014-07-18 2016-02-09 Google Inc. Speaker verification using co-location information
US11942095B2 (en) 2014-07-18 2024-03-26 Google Llc Speaker verification using co-location information
US11676608B2 (en) 2021-04-02 2023-06-13 Google Llc Speaker verification using co-location information
US9548066B2 (en) * 2014-08-11 2017-01-17 Amazon Technologies, Inc. Voice application architecture
US10446141B2 (en) 2014-08-28 2019-10-15 Apple Inc. Automatic speech recognition based on user feedback
CN104216982B (zh) * 2014-09-01 2019-06-21 北京搜狗科技发展有限公司 一种信息处理方法及电子设备
US9818400B2 (en) 2014-09-11 2017-11-14 Apple Inc. Method and apparatus for discovering trending terms in speech requests
US10789041B2 (en) 2014-09-12 2020-09-29 Apple Inc. Dynamic thresholds for always listening speech trigger
EP3195145A4 (en) 2014-09-16 2018-01-24 VoiceBox Technologies Corporation Voice commerce
US9898459B2 (en) 2014-09-16 2018-02-20 Voicebox Technologies Corporation Integration of domain information into state transitions of a finite state transducer for natural language processing
US9646609B2 (en) 2014-09-30 2017-05-09 Apple Inc. Caching apparatus for serving phonetic pronunciations
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US9886432B2 (en) 2014-09-30 2018-02-06 Apple Inc. Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
WO2016053276A1 (en) * 2014-09-30 2016-04-07 Nuance Communications, Inc. Methods and apparatus for module arbitration
US20160103655A1 (en) * 2014-10-08 2016-04-14 Microsoft Corporation Co-Verbal Interactions With Speech Reference Point
US9318107B1 (en) 2014-10-09 2016-04-19 Google Inc. Hotword detection on multiple devices
US9424841B2 (en) 2014-10-09 2016-08-23 Google Inc. Hotword detection on multiple devices
CN107003999B (zh) 2014-10-15 2020-08-21 声钰科技 对用户的在先自然语言输入的后续响应的系统和方法
US10276158B2 (en) 2014-10-31 2019-04-30 At&T Intellectual Property I, L.P. System and method for initiating multi-modal speech recognition using a long-touch gesture
US10203933B2 (en) 2014-11-06 2019-02-12 Microsoft Technology Licensing, Llc Context-based command surfacing
US9922098B2 (en) 2014-11-06 2018-03-20 Microsoft Technology Licensing, Llc Context-based search and relevancy generation
US9842593B2 (en) 2014-11-14 2017-12-12 At&T Intellectual Property I, L.P. Multi-level content analysis and response
US10614799B2 (en) 2014-11-26 2020-04-07 Voicebox Technologies Corporation System and method of providing intent predictions for an utterance prior to a system detection of an end of the utterance
US10431214B2 (en) 2014-11-26 2019-10-01 Voicebox Technologies Corporation System and method of determining a domain and/or an action related to a natural language input
US10552013B2 (en) 2014-12-02 2020-02-04 Apple Inc. Data detection
US9711141B2 (en) 2014-12-09 2017-07-18 Apple Inc. Disambiguating heteronyms in speech synthesis
US9904450B2 (en) 2014-12-19 2018-02-27 At&T Intellectual Property I, L.P. System and method for creating and sharing plans through multimodal dialog
US10509829B2 (en) * 2015-01-21 2019-12-17 Microsoft Technology Licensing, Llc Contextual search using natural language
US9865280B2 (en) 2015-03-06 2018-01-09 Apple Inc. Structured dictation using intelligent automated assistants
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US10567477B2 (en) 2015-03-08 2020-02-18 Apple Inc. Virtual assistant continuity
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US11100291B1 (en) 2015-03-13 2021-08-24 Soundhound, Inc. Semantic grammar extensibility within a software development framework
US9899019B2 (en) 2015-03-18 2018-02-20 Apple Inc. Systems and methods for structured stem and suffix language models
US9460713B1 (en) 2015-03-30 2016-10-04 Google Inc. Language model biasing modulation
US9842105B2 (en) 2015-04-16 2017-12-12 Apple Inc. Parsimonious continuous-space phrase representations for natural language processing
CN104794218B (zh) * 2015-04-28 2019-07-05 百度在线网络技术（北京）有限公司 语音搜索方法和装置
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US10200824B2 (en) 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
US10127220B2 (en) 2015-06-04 2018-11-13 Apple Inc. Language identification from short strings
US10101822B2 (en) 2015-06-05 2018-10-16 Apple Inc. Language input correction
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
US10255907B2 (en) 2015-06-07 2019-04-09 Apple Inc. Automatic accent detection using acoustic models
US10186254B2 (en) 2015-06-07 2019-01-22 Apple Inc. Context-based endpoint detection
US11025565B2 (en) 2015-06-07 2021-06-01 Apple Inc. Personalized prediction of responses for instant messaging
US20160378747A1 (en) 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
US10623162B2 (en) 2015-07-23 2020-04-14 Centurylink Intellectual Property Llc Customer based internet of things (IoT)
US10375172B2 (en) 2015-07-23 2019-08-06 Centurylink Intellectual Property Llc Customer based internet of things (IOT)—transparent privacy functionality
US9448993B1 (en) 2015-09-07 2016-09-20 Voicebox Technologies Corporation System and method of recording utterances using unmanaged crowds for natural language processing
US9401142B1 (en) 2015-09-07 2016-07-26 Voicebox Technologies Corporation System and method for validating natural language content using crowdsourced validation jobs
WO2017044409A1 (en) * 2015-09-07 2017-03-16 Voicebox Technologies Corporation System and method of annotating utterances based on tags assigned by unmanaged crowds
WO2017044415A1 (en) 2015-09-07 2017-03-16 Voicebox Technologies Corporation System and method for eliciting open-ended natural language responses to questions to train natural language processors
US9519766B1 (en) 2015-09-07 2016-12-13 Voicebox Technologies Corporation System and method of providing and validating enhanced CAPTCHAs
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10740384B2 (en) 2015-09-08 2020-08-11 Apple Inc. Intelligent automated assistant for media search and playback
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
KR102420518B1 (ko) * 2015-09-09 2022-07-13 삼성전자주식회사 자연어 처리 시스템, 자연어 처리 장치, 자연어 처리 방법 및 컴퓨터 판독가능 기록매체
US9697820B2 (en) 2015-09-24 2017-07-04 Apple Inc. Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
US11010550B2 (en) 2015-09-29 2021-05-18 Apple Inc. Unified language modeling framework for word prediction, auto-completion and auto-correction
US10366158B2 (en) 2015-09-29 2019-07-30 Apple Inc. Efficient word encoding for recurrent neural network language models
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10956666B2 (en) 2015-11-09 2021-03-23 Apple Inc. Unconventional virtual assistant interactions
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US9779735B2 (en) 2016-02-24 2017-10-03 Google Inc. Methods and systems for detecting and processing speech signals
US10229687B2 (en) 2016-03-10 2019-03-12 Microsoft Technology Licensing, Llc Scalable endpoint-dependent natural language understanding
US10446143B2 (en) 2016-03-14 2019-10-15 Apple Inc. Identification of voice inputs providing credentials
US9934775B2 (en) 2016-05-26 2018-04-03 Apple Inc. Unit-selection text-to-speech synthesis based on predicted concatenation parameters
US10832665B2 (en) * 2016-05-27 2020-11-10 Centurylink Intellectual Property Llc Internet of things (IoT) human interface apparatus, system, and method
US9972304B2 (en) 2016-06-03 2018-05-15 Apple Inc. Privacy preserving distributed evaluation framework for embedded personalized systems
US10249300B2 (en) 2016-06-06 2019-04-02 Apple Inc. Intelligent list reading
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
DK179309B1 (en) 2016-06-09 2018-04-23 Apple Inc Intelligent automated assistant in a home environment
US10490187B2 (en) 2016-06-10 2019-11-26 Apple Inc. Digital assistant providing automated status report
US10067938B2 (en) 2016-06-10 2018-09-04 Apple Inc. Multilingual word prediction
US10192552B2 (en) 2016-06-10 2019-01-29 Apple Inc. Digital assistant providing whispered speech
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
US10509862B2 (en) 2016-06-10 2019-12-17 Apple Inc. Dynamic phrase expansion of language input
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
DK179343B1 (en) 2016-06-11 2018-05-14 Apple Inc Intelligent task discovery
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK179049B1 (en) 2016-06-11 2017-09-18 Apple Inc Data driven natural language event detection and classification
US10331784B2 (en) 2016-07-29 2019-06-25 Voicebox Technologies Corporation System and method of disambiguating natural language processing requests
US10249103B2 (en) 2016-08-02 2019-04-02 Centurylink Intellectual Property Llc System and method for implementing added services for OBD2 smart vehicle connection
US10110272B2 (en) 2016-08-24 2018-10-23 Centurylink Intellectual Property Llc Wearable gesture control device and method
US9972320B2 (en) 2016-08-24 2018-05-15 Google Llc Hotword detection on multiple devices
US10438264B1 (en) 2016-08-31 2019-10-08 Amazon Technologies, Inc. Artificial intelligence feature extraction service for products
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
CN106403176B (zh) * 2016-09-14 2019-12-10 北京云知声信息技术有限公司 一种调整温度的方法及装置
US10687377B2 (en) 2016-09-20 2020-06-16 Centurylink Intellectual Property Llc Universal wireless station for multiple simultaneous wireless services
US10043516B2 (en) * 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
KR102241970B1 (ko) 2016-11-07 2021-04-20 구글 엘엘씨 기록된 미디어 핫워드 트리거 억제
US10515632B2 (en) 2016-11-15 2019-12-24 At&T Intellectual Property I, L.P. Asynchronous virtual assistant
US9867112B1 (en) 2016-11-23 2018-01-09 Centurylink Intellectual Property Llc System and method for implementing combined broadband and wireless self-organizing network (SON)
US11281993B2 (en) 2016-12-05 2022-03-22 Apple Inc. Model and ensemble compression for metric learning
US10426358B2 (en) 2016-12-20 2019-10-01 Centurylink Intellectual Property Llc Internet of things (IoT) personal tracking apparatus, system, and method
US10593346B2 (en) 2016-12-22 2020-03-17 Apple Inc. Rank-reduced token representation for automatic speech recognition
US10222773B2 (en) 2016-12-23 2019-03-05 Centurylink Intellectual Property Llc System, apparatus, and method for implementing one or more internet of things (IoT) capable devices embedded within a roadway structure for performing various tasks
US10193981B2 (en) 2016-12-23 2019-01-29 Centurylink Intellectual Property Llc Internet of things (IoT) self-organizing network
US10150471B2 (en) 2016-12-23 2018-12-11 Centurylink Intellectual Property Llc Smart vehicle apparatus, system, and method
US10637683B2 (en) 2016-12-23 2020-04-28 Centurylink Intellectual Property Llc Smart city apparatus, system, and method
US10735220B2 (en) 2016-12-23 2020-08-04 Centurylink Intellectual Property Llc Shared devices with private and public instances
US10268680B2 (en) * 2016-12-30 2019-04-23 Google Llc Context-aware human-to-computer dialog
US10708313B2 (en) * 2016-12-30 2020-07-07 Google Llc Multimodal transmission of packetized data
US10593329B2 (en) 2016-12-30 2020-03-17 Google Llc Multimodal transmission of packetized data
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US10146024B2 (en) 2017-01-10 2018-12-04 Centurylink Intellectual Property Llc Apical conduit method and system
US10388282B2 (en) * 2017-01-25 2019-08-20 CliniCloud Inc. Medical voice command device
US10339927B2 (en) * 2017-02-16 2019-07-02 GM Global Technology Operations LLC Vehicle control systems and methods for multi-intent queries input by voice
KR101924852B1 (ko) * 2017-04-14 2018-12-04 네이버 주식회사 네트워크에 연결된 음향기기와의 멀티모달 인터렉션 방법 및 시스템
EP4293661A3 (en) 2017-04-20 2024-02-21 Google LLC Multi-user authentication on a device
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. USER INTERFACE FOR CORRECTING RECOGNITION ERRORS
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
DK201770439A1 (en) 2017-05-11 2018-12-13 Apple Inc. Offline personal assistant
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
DK201770429A1 (en) 2017-05-12 2018-12-14 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770432A1 (en) 2017-05-15 2018-12-21 Apple Inc. Hierarchical belief states for digital assistants
DK201770431A1 (en) 2017-05-15 2018-12-20 Apple Inc. Optimizing dialogue policy decisions for digital assistants using implicit feedback
US20180336275A1 (en) 2017-05-16 2018-11-22 Apple Inc. Intelligent automated assistant for media exploration
US20180336892A1 (en) 2017-05-16 2018-11-22 Apple Inc. Detecting a trigger of a digital assistant
DK179560B1 (en) 2017-05-16 2019-02-18 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
US10657328B2 (en) 2017-06-02 2020-05-19 Apple Inc. Multi-task recurrent neural network architecture for efficient morphology handling in neural language modeling
US10395650B2 (en) 2017-06-05 2019-08-27 Google Llc Recorded media hotword trigger suppression
US10643224B2 (en) 2017-07-24 2020-05-05 Accenture Global Solutions Limited Analyzing event-associated connections
US10719507B2 (en) * 2017-09-21 2020-07-21 SayMosaic Inc. System and method for natural language processing
US10445429B2 (en) 2017-09-21 2019-10-15 Apple Inc. Natural language understanding using vocabularies with compressed serialized tries
US10755051B2 (en) 2017-09-29 2020-08-25 Apple Inc. Rule-based natural language processing
US10620911B2 (en) 2017-10-25 2020-04-14 International Business Machines Corporation Machine learning to identify a user interface trace
US10620912B2 (en) 2017-10-25 2020-04-14 International Business Machines Corporation Machine learning to determine and execute a user interface trace
US10552410B2 (en) 2017-11-14 2020-02-04 Mindbridge Analytics Inc. Method and system for presenting a user selectable interface in response to a natural language request
US10636424B2 (en) 2017-11-30 2020-04-28 Apple Inc. Multi-turn canned dialog
US10713007B2 (en) 2017-12-12 2020-07-14 Amazon Technologies, Inc. Architecture for a hub configured to control a second device while a connection to a remote system is unavailable
US10627794B2 (en) 2017-12-19 2020-04-21 Centurylink Intellectual Property Llc Controlling IOT devices via public safety answering point
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
KR102044541B1 (ko) * 2018-03-16 2019-11-13 박귀현 음성 특성 분류를 이용한 영상 내 그래픽 생성 방법 및 장치
KR102044540B1 (ko) * 2018-03-16 2019-11-13 박귀현 영상 내 그래픽 생성 방법 및 장치
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
CN108512586B (zh) * 2018-04-17 2020-08-04 Oppo广东移动通信有限公司 信号处理方法和装置、电子设备、计算机可读存储介质
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
US10692496B2 (en) 2018-05-22 2020-06-23 Google Llc Hotword suppression
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. VIRTUAL ASSISTANT OPERATION IN MULTI-DEVICE ENVIRONMENTS
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
DK179822B1 (da) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11087740B2 (en) 2018-11-27 2021-08-10 Rovi Guides, Inc. Systems and methods for training a control system based on prior audio inputs
US10872206B2 (en) 2018-12-03 2020-12-22 Bank Of America Corporation System and framework for dynamic regulatory change management
US11087091B2 (en) * 2018-12-27 2021-08-10 Wipro Limited Method and system for providing contextual responses to user interaction
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
CN110111772B (zh) * 2019-05-16 2021-07-23 电子科技大学 一种加密VoIP网络流量所使用语言的识别方法
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
DK201970510A1 (en) 2019-05-31 2021-02-11 Apple Inc Voice identification in digital assistant systems
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. USER ACTIVITY SHORTCUT SUGGESTIONS
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11468890B2 (en) 2019-06-01 2022-10-11 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
CN112102820A (zh) * 2019-06-18 2020-12-18 北京京东尚科信息技术有限公司 交互方法、交互装置、电子设备和介质
KR20210016739A (ko) 2019-08-05 2021-02-17 삼성전자주식회사 전자 장치 및 전자 장치의 입력 방법
US11538468B2 (en) * 2019-09-12 2022-12-27 Oracle International Corporation Using semantic frames for intent classification
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11567788B1 (en) 2019-10-18 2023-01-31 Meta Platforms, Inc. Generating proactive reminders for assistant systems
US11861674B1 (en) 2019-10-18 2024-01-02 Meta Platforms Technologies, Llc Method, one or more computer-readable non-transitory storage media, and a system for generating comprehensive information for products of interest by assistant systems
WO2021100918A1 (ko) * 2019-11-21 2021-05-27 엘지전자 주식회사 지능형 대화 서비스 제공 방법 및 지능형 대화 시스템
US11869497B2 (en) * 2020-03-10 2024-01-09 MeetKai, Inc. Parallel hypothetical reasoning to power a multi-lingual, multi-turn, multi-domain virtual assistant
US11183193B1 (en) 2020-05-11 2021-11-23 Apple Inc. Digital assistant hardware abstraction
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
CN111968631B (zh) * 2020-06-29 2023-10-10 百度在线网络技术（北京）有限公司 智能设备的交互方法、装置、设备及存储介质
CN111966212A (zh) * 2020-06-29 2020-11-20 百度在线网络技术（北京）有限公司 基于多模态的交互方法、装置、存储介质及智能屏设备
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones
US11206330B1 (en) 2020-09-01 2021-12-21 T-Mobile Usa, Inc. Interactive voice response using intent prediction and a 5G capable device
US11461681B2 (en) * 2020-10-14 2022-10-04 Openstream Inc. System and method for multi-modality soft-agent for query population and information mining
US11789696B2 (en) 2021-03-23 2023-10-17 Microsoft Technology Licensing, Llc Voice assistant-enabled client application with user view context
US11657805B2 (en) * 2021-06-24 2023-05-23 Amazon Technologies, Inc. Dynamic context-based routing of speech processing
CN113742599B (zh) * 2021-11-05 2022-03-18 太平金融科技服务(上海)有限公司深圳分公司 内容推荐方法、装置、设备及计算机可读存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7036128B1 (en) * 1999-01-05 2006-04-25 Sri International Offices Using a community of distributed electronic agents to support a highly mobile, ambient computing environment

Family Cites Families (782)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4430669A (en) * 1981-05-29 1984-02-07 Payview Limited Transmitting and receiving apparatus for permitting the transmission and reception of multi-tier subscription programs
US4829423A (en) 1983-01-28 1989-05-09 Texas Instruments Incorporated Menu-based natural language understanding system
US5208748A (en) 1985-11-18 1993-05-04 Action Technologies, Inc. Method and apparatus for structuring and managing human communications by explicitly defining the types of communications permitted between participants
US4887212A (en) 1986-10-29 1989-12-12 International Business Machines Corporation Parser for natural language text
US4910784A (en) 1987-07-30 1990-03-20 Texas Instruments Incorporated Low cost speech recognition system and method
CA1268228A (en) 1987-09-14 1990-04-24 Gary Lennartz Voice interactive security system
US5027406A (en) 1988-12-06 1991-06-25 Dragon Systems, Inc. Method for interactive speech recognition and training
SE466029B (sv) * 1989-03-06 1991-12-02 Ibm Svenska Ab Anordning och foerfarande foer analys av naturligt spraak i ett datorbaserat informationsbehandlingssystem
JPH03129469A (ja) 1989-10-14 1991-06-03 Canon Inc 自然言語処理装置
JP3266246B2 (ja) 1990-06-15 2002-03-18 インターナシヨナル・ビジネス・マシーンズ・コーポレーシヨン 自然言語解析装置及び方法並びに自然言語解析用知識ベース構築方法
US5164904A (en) 1990-07-26 1992-11-17 Farradyne Systems, Inc. In-vehicle traffic congestion information system
JP2764343B2 (ja) 1990-09-07 1998-06-11 富士通株式会社 節／句境界抽出方式
US5722084A (en) * 1990-09-28 1998-02-24 At&T Corp. Cellular/PCS handset NAM download capability using a wide-area paging system
CA2096352A1 (en) 1990-11-27 1993-04-23 Gordon M. Jacobs Digital data converter
US5274560A (en) 1990-12-03 1993-12-28 Audio Navigation Systems, Inc. Sensor free vehicle navigation system utilizing a voice input/output interface for routing a driver from his source point to his destination point
US5265065A (en) 1991-10-08 1993-11-23 West Publishing Company Method and apparatus for information retrieval from a database by replacing domain specific stemmed phases in a natural language to create a search query
EP0543329B1 (en) 1991-11-18 2002-02-06 Kabushiki Kaisha Toshiba Speech dialogue system for facilitating human-computer interaction
US5608635A (en) * 1992-04-14 1997-03-04 Zexel Corporation Navigation system for a vehicle with route recalculation between multiple locations
US5369575A (en) 1992-05-15 1994-11-29 International Business Machines Corporation Constrained natural language interface for a computer system
US5331554A (en) 1992-12-10 1994-07-19 Ricoh Corporation Method and apparatus for semantic pattern matching for text retrieval
CA2102077C (en) 1992-12-21 1997-09-16 Steven Lloyd Greenspan Call billing and measurement methods for redirected calls
US5465289A (en) 1993-03-05 1995-11-07 E-Systems, Inc. Cellular based traffic sensor system
KR100309207B1 (ko) 1993-03-12 2001-12-17 에드워드 이. 데이비스 음성-대화식언어명령방법및장치
US5471318A (en) 1993-04-22 1995-11-28 At&T Corp. Multimedia communications network
US5377350A (en) 1993-04-30 1994-12-27 International Business Machines Corporation System for cooperative communication between local object managers to provide verification for the performance of remote calls by object messages
US5537436A (en) 1993-06-14 1996-07-16 At&T Corp. Simultaneous analog and digital communication applications
US5983161A (en) * 1993-08-11 1999-11-09 Lemelson; Jerome H. GPS vehicle collision avoidance warning and control system and method
DE69423838T2 (de) * 1993-09-23 2000-08-03 Xerox Corp Semantische Gleichereignisfilterung für Spracherkennung und Signalübersetzungsanwendungen
US5475733A (en) 1993-11-04 1995-12-12 At&T Corp. Language accommodated message relaying for hearing impaired callers
US5615296A (en) 1993-11-12 1997-03-25 International Business Machines Corporation Continuous speech recognition and voice response system and method to enable conversational dialogues with microprocessors
CA2118278C (en) 1993-12-21 1999-09-07 J. David Garland Multimedia system
US5748841A (en) 1994-02-25 1998-05-05 Morin; Philippe Supervised contextual language acquisition system
US5533108A (en) 1994-03-18 1996-07-02 At&T Corp. Method and system for routing phone calls based on voice and data transport capability
US5488652A (en) * 1994-04-14 1996-01-30 Northern Telecom Limited Method and apparatus for training speech recognition algorithms for directory assistance applications
US5652570A (en) 1994-05-19 1997-07-29 Lepkofker; Robert Individual location system
US5752052A (en) 1994-06-24 1998-05-12 Microsoft Corporation Method and system for bootstrapping statistical processing into a rule-based natural language parser
JP2674521B2 (ja) 1994-09-21 1997-11-12 日本電気株式会社 移動体誘導装置
US5539744A (en) 1994-10-17 1996-07-23 At&T Corp. Hand-off management for cellular telephony
US5696965A (en) 1994-11-03 1997-12-09 Intel Corporation Electronic information appraisal agent
JP2855409B2 (ja) 1994-11-17 1999-02-10 日本アイ・ビー・エム株式会社 自然言語処理方法及びシステム
US6571279B1 (en) 1997-12-05 2003-05-27 Pinpoint Incorporated Location enhanced information delivery system
US5499289A (en) * 1994-12-06 1996-03-12 At&T Corp. Systems, methods and articles of manufacture for performing distributed telecommunications
US5748974A (en) 1994-12-13 1998-05-05 International Business Machines Corporation Multimodal natural language interface for cross-application tasks
US5774859A (en) 1995-01-03 1998-06-30 Scientific-Atlanta, Inc. Information system having a speech interface
US5794050A (en) 1995-01-04 1998-08-11 Intelligent Text Processing, Inc. Natural language understanding system
US5892900A (en) 1996-08-30 1999-04-06 Intertrust Technologies Corp. Systems and methods for secure transaction management and electronic rights protection
US6948070B1 (en) 1995-02-13 2005-09-20 Intertrust Technologies Corporation Systems and methods for secure transaction management and electronic rights protection
US5918222A (en) 1995-03-17 1999-06-29 Kabushiki Kaisha Toshiba Information disclosing apparatus and multi-modal information input/output system
JP3363283B2 (ja) * 1995-03-23 2003-01-08 株式会社日立製作所 入力装置、入力方法、情報処理システムおよび入力情報の管理方法
US6965864B1 (en) * 1995-04-10 2005-11-15 Texas Instruments Incorporated Voice activated hypermedia systems using grammatical metadata
EP1199707A3 (en) 1995-05-26 2002-05-02 Speechworks International, Inc. Method and apparatus for dynamic adaptation of a large vocabulary speech recognition system and for use of constraints from a database in a large vocabulary speech recognition system
JP3716870B2 (ja) 1995-05-31 2005-11-16 ソニー株式会社 音声認識装置および音声認識方法
US5708422A (en) * 1995-05-31 1998-01-13 At&T Transaction authorization and alert system
US20070061735A1 (en) 1995-06-06 2007-03-15 Hoffberg Steven M Ergonomic man-machine interface incorporating adaptive pattern recognition based control system
US5721938A (en) * 1995-06-07 1998-02-24 Stuckey; Barbara K. Method and device for parsing and analyzing natural language sentences and text
US5617407A (en) 1995-06-21 1997-04-01 Bareis; Monica M. Optical disk having speech recognition templates for information access
US5794196A (en) 1995-06-30 1998-08-11 Kurzweil Applied Intelligence, Inc. Speech recognition system distinguishing dictation from commands by arbitration between continuous speech and isolated word modules
US6292767B1 (en) 1995-07-18 2001-09-18 Nuance Communications Method and system for building and running natural language understanding systems
US5963940A (en) 1995-08-16 1999-10-05 Syracuse University Natural language information retrieval system and method
US5855000A (en) 1995-09-08 1998-12-29 Carnegie Mellon University Method and apparatus for correcting and repairing machine-transcribed input using independent or cross-modal secondary input
US5675629A (en) 1995-09-08 1997-10-07 At&T Cordless cellular system base station
US5911120A (en) 1995-09-08 1999-06-08 At&T Wireless Services Wireless communication system having mobile stations establish a communication link through the base station without using a landline or regional cellular network and without a call in progress
US6192110B1 (en) * 1995-09-15 2001-02-20 At&T Corp. Method and apparatus for generating sematically consistent inputs to a dialog manager
US5774841A (en) 1995-09-20 1998-06-30 The United States Of America As Represented By The Adminstrator Of The National Aeronautics And Space Administration Real-time reconfigurable adaptive speech recognition command and control apparatus and method
US5799276A (en) 1995-11-07 1998-08-25 Accent Incorporated Knowledge-based speech recognition system and methods having frame length computed based upon estimated pitch period of vocalic intervals
US5960447A (en) 1995-11-13 1999-09-28 Holt; Douglas Word tagging and editing system for speech recognition
JPH11502324A (ja) 1995-12-15 1999-02-23 フィリップス エレクトロニクス エヌ ベー 適応雑音除去装置、雑音減少システム及び送受信機
US6567778B1 (en) 1995-12-21 2003-05-20 Nuance Communications Natural language speech recognition using slot semantic confidence scores related to their word recognition confidence scores
US5742763A (en) 1995-12-29 1998-04-21 At&T Corp. Universal message delivery system for handles identifying network presences
US5633922A (en) 1995-12-29 1997-05-27 At&T Process and apparatus for restarting call routing in a telephone network
US5802510A (en) 1995-12-29 1998-09-01 At&T Corp Universal directory service
US5832221A (en) 1995-12-29 1998-11-03 At&T Corp Universal message storage system
US6119101A (en) 1996-01-17 2000-09-12 Personal Agents, Inc. Intelligent agents for electronic commerce
US6286002B1 (en) 1996-01-17 2001-09-04 @Yourcommand System and method for storing and searching buy and sell information of a marketplace
US5987404A (en) 1996-01-29 1999-11-16 International Business Machines Corporation Statistical natural language understanding using hidden clumpings
US6377919B1 (en) 1996-02-06 2002-04-23 The Regents Of The University Of California System and method for characterizing voiced excitations of speech and acoustic signals, removing acoustic noise from speech, and synthesizing speech
WO1997033221A2 (en) 1996-03-05 1997-09-12 Philips Electronics N.V. Transaction system based on a bidirectional speech channel through status graph building and problem detection for thereupon providing feedback to a human user person
JPH09258945A (ja) * 1996-03-25 1997-10-03 Hitachi Ltd 個人情報機器
US5995943A (en) 1996-04-01 1999-11-30 Sabre Inc. Information aggregation and synthesization system
US6314420B1 (en) 1996-04-04 2001-11-06 Lycos, Inc. Collaborative/adaptive search engine
US5848396A (en) 1996-04-26 1998-12-08 Freedom Of Information, Inc. Method and apparatus for determining behavioral profile of a computer user
US5878386A (en) * 1996-06-28 1999-03-02 Microsoft Corporation Natural language parser with dictionary-based part-of-speech probabilities
US5953393A (en) 1996-07-15 1999-09-14 At&T Corp. Personal telephone agent
US5867817A (en) * 1996-08-19 1999-02-02 Virtual Vision, Inc. Speech recognition manager
US6009382A (en) 1996-08-19 1999-12-28 International Business Machines Corporation Word storage table for natural language determination
US6385646B1 (en) 1996-08-23 2002-05-07 At&T Corp. Method and system for establishing voice communications in an internet environment
US6470315B1 (en) 1996-09-11 2002-10-22 Texas Instruments Incorporated Enrollment and modeling method and apparatus for robust speaker dependent speech models
US5878385A (en) * 1996-09-16 1999-03-02 Ergo Linguistic Technologies Method and apparatus for universal parsing of language
US6085186A (en) 1996-09-20 2000-07-04 Netbot, Inc. Method and system using information written in a wrapper description language to execute query on a network
US6961700B2 (en) 1996-09-24 2005-11-01 Allvoice Computing Plc Method and apparatus for processing the output of a speech recognition engine
US6035267A (en) * 1996-09-26 2000-03-07 Mitsubishi Denki Kabushiki Kaisha Interactive processing apparatus having natural language interfacing capability, utilizing goal frames, and judging action feasibility
US5892813A (en) 1996-09-30 1999-04-06 Matsushita Electric Industrial Co., Ltd. Multimodal voice dialing digital key telephone with dialog manager
US5995928A (en) 1996-10-02 1999-11-30 Speechworks International, Inc. Method and apparatus for continuous spelling speech recognition with early identification
US5829000A (en) 1996-10-31 1998-10-27 Microsoft Corporation Method and system for correcting misrecognized spoken words or phrases
US5902347A (en) 1996-11-19 1999-05-11 American Navigation Systems, Inc. Hand-held GPS-mapping device
JP2950260B2 (ja) 1996-11-22 1999-09-20 日本電気株式会社 雑音抑圧送話装置
US5839107A (en) 1996-11-29 1998-11-17 Northern Telecom Limited Method and apparatus for automatically generating a speech recognition vocabulary from a white pages listing
US6154526A (en) 1996-12-04 2000-11-28 Intellivoice Communications, Inc. Data acquisition and error correcting speech recognition system
US5960399A (en) 1996-12-24 1999-09-28 Gte Internetworking Incorporated Client/server speech processor/recognizer
US6456974B1 (en) 1997-01-06 2002-09-24 Texas Instruments Incorporated System and method for adding speech recognition capabilities to java
CA2226233C (en) 1997-01-21 2006-05-09 At&T Corp. Systems and methods for determinizing and minimizing a finite state transducer for speech recognition
US6285987B1 (en) 1997-01-22 2001-09-04 Engage, Inc. Internet advertising system
US6009355A (en) 1997-01-28 1999-12-28 American Calcar Inc. Multimedia information and control system for automobiles
US6122613A (en) 1997-01-30 2000-09-19 Dragon Systems, Inc. Speech recognition using multiple recognizers (selectively) applied to the same input sample
JPH10254486A (ja) 1997-03-13 1998-09-25 Canon Inc 音声認識装置および方法
GB2323693B (en) 1997-03-27 2001-09-26 Forum Technology Ltd Speech to text conversion
US6167377A (en) 1997-03-28 2000-12-26 Dragon Systems, Inc. Speech recognition language models
FR2761837B1 (fr) 1997-04-08 1999-06-11 Sophie Sommelet Dispositif d'aide a la navigation ayant une architecture distribuee basee sur internet
US6014559A (en) * 1997-04-10 2000-01-11 At&T Wireless Services, Inc. Method and system for delivering a voice mail notification to a private base station using cellular phone network
US6078886A (en) 1997-04-14 2000-06-20 At&T Corporation System and method for providing remote automatic speech recognition services via a packet network
US6058187A (en) 1997-04-17 2000-05-02 At&T Corp. Secure telecommunications data transmission
US5895464A (en) 1997-04-30 1999-04-20 Eastman Kodak Company Computer program product and a method for using natural language for the description, search and retrieval of multi-media objects
CA2292959A1 (en) * 1997-05-06 1998-11-12 Speechworks International, Inc. System and method for developing interactive speech applications
US5899991A (en) 1997-05-12 1999-05-04 Teleran Technologies, L.P. Modeling technique for system access control and management
US6128369A (en) 1997-05-14 2000-10-03 A.T.&T. Corp. Employing customer premises equipment in communications network maintenance
US5983190A (en) 1997-05-19 1999-11-09 Microsoft Corporation Client server animation system for managing interactive user interface characters
US5960397A (en) 1997-05-27 1999-09-28 At&T Corp System and method of recognizing an acoustic environment to adapt a set of based recognition models to the current acoustic environment for subsequent speech recognition
US5995119A (en) 1997-06-06 1999-11-30 At&T Corp. Method for generating photo-realistic animated characters
US6199043B1 (en) * 1997-06-24 2001-03-06 International Business Machines Corporation Conversation management in speech recognition interfaces
FI972723A0 (fi) 1997-06-24 1997-06-24 Nokia Mobile Phones Ltd Mobila kommunikationsanordningar
US6816830B1 (en) 1997-07-04 2004-11-09 Xerox Corporation Finite state data structures with paths representing paired strings of tags and tag combinations
US6101241A (en) 1997-07-16 2000-08-08 At&T Corp. Telephone-based speech recognition for data collection
US5926784A (en) 1997-07-17 1999-07-20 Microsoft Corporation Method and system for natural language parsing using podding
US5933822A (en) 1997-07-22 1999-08-03 Microsoft Corporation Apparatus and methods for an information retrieval system that employs natural language processing of search results to improve overall precision
US6275231B1 (en) 1997-08-01 2001-08-14 American Calcar Inc. Centralized control and management system for automobiles
US6044347A (en) * 1997-08-05 2000-03-28 Lucent Technologies Inc. Methods and apparatus object-oriented rule-based dialogue management
US6144667A (en) 1997-08-07 2000-11-07 At&T Corp. Network-based method and apparatus for initiating and completing a telephone call via the internet
US6192338B1 (en) * 1997-08-12 2001-02-20 At&T Corp. Natural language knowledge servers as network resources
US6360234B2 (en) 1997-08-14 2002-03-19 Virage, Inc. Video cataloger system with synchronized encoders
US6707421B1 (en) 1997-08-19 2004-03-16 Siemens Vdo Automotive Corporation Driver information system
US5895466A (en) 1997-08-19 1999-04-20 At&T Corp Automated natural language understanding customer service system
US6081774A (en) 1997-08-22 2000-06-27 Novell, Inc. Natural language information retrieval system and method
US6018708A (en) * 1997-08-26 2000-01-25 Nortel Networks Corporation Method and apparatus for performing speech recognition utilizing a supplementary lexicon of frequently used orthographies
US6076059A (en) 1997-08-29 2000-06-13 Digital Equipment Corporation Method for aligning text with audio signals
US5960384A (en) 1997-09-03 1999-09-28 Brash; Douglas E. Method and device for parsing natural language sentences and other sequential symbolic expressions
US6049602A (en) 1997-09-18 2000-04-11 At&T Corp Virtual call center
US6650747B1 (en) 1997-09-18 2003-11-18 At&T Corp. Control of merchant application by system monitor in virtual contact center
DE19742054A1 (de) 1997-09-24 1999-04-01 Philips Patentverwaltung Eingabesystem wenigstens für Orts- und/oder Straßennamen
US5897613A (en) 1997-10-08 1999-04-27 Lucent Technologies Inc. Efficient transmission of voice silence intervals
US6134235A (en) 1997-10-08 2000-10-17 At&T Corp. Pots/packet bridge
US6272455B1 (en) 1997-10-22 2001-08-07 Lucent Technologies, Inc. Method and apparatus for understanding natural language
JPH11126090A (ja) 1997-10-23 1999-05-11 Pioneer Electron Corp 音声認識方法及び音声認識装置並びに音声認識装置を動作させるためのプログラムが記録された記録媒体
US6021384A (en) * 1997-10-29 2000-02-01 At&T Corp. Automatic generation of superwords
US6498797B1 (en) 1997-11-14 2002-12-24 At&T Corp. Method and apparatus for communication services on a network
US6073098A (en) 1997-11-21 2000-06-06 At&T Corporation Method and apparatus for generating deterministic approximate weighted finite-state automata
US6188982B1 (en) * 1997-12-01 2001-02-13 Industrial Technology Research Institute On-line background noise adaptation of parallel model combination HMM with discriminative learning using weighted HMM for noisy speech recognition
US6219346B1 (en) 1997-12-02 2001-04-17 At&T Corp. Packet switching architecture in cellular radio
US6614773B1 (en) 1997-12-02 2003-09-02 At&T Corp. Packet transmissions over cellular radio
US5970412A (en) 1997-12-02 1999-10-19 Maxemchuk; Nicholas Frank Overload control in a packet-switching cellular environment
US6195634B1 (en) * 1997-12-24 2001-02-27 Nortel Networks Corporation Selection of decoys for non-vocabulary utterances rejection
US6301560B1 (en) 1998-01-05 2001-10-09 Microsoft Corporation Discrete speech recognition system with ballooning active grammar
US6278377B1 (en) 1999-08-25 2001-08-21 Donnelly Corporation Indicator for vehicle accessory
US5950167A (en) 1998-01-26 1999-09-07 Lucent Technologies Inc. Screen-less remote voice or tone-controlled computer program operations via telephone set
US6226612B1 (en) 1998-01-30 2001-05-01 Motorola, Inc. Method of evaluating an utterance in a speech recognition system
US6385596B1 (en) 1998-02-06 2002-05-07 Liquid Audio, Inc. Secure online music distribution system
JP3844874B2 (ja) * 1998-02-27 2006-11-15 株式会社東芝 マルチモーダルインタフェース装置およびマルチモーダルインタフェース方法
US6160883A (en) 1998-03-04 2000-12-12 At&T Corporation Telecommunications network system and method
ATE254328T1 (de) 1998-03-09 2003-11-15 Lernout & Hauspie Speechprod Vorrichtung und verfahren zum gleichzeitigen multimodalen diktieren
US6119087A (en) 1998-03-13 2000-09-12 Nuance Communications System architecture for and method of voice processing
US6233559B1 (en) 1998-04-01 2001-05-15 Motorola, Inc. Speech control of multiple applications using applets
US6420975B1 (en) 1999-08-25 2002-07-16 Donnelly Corporation Interior rearview mirror sound processing system
US6173279B1 (en) * 1998-04-09 2001-01-09 At&T Corp. Method of using a natural language interface to retrieve information from one or more data resources
US6144938A (en) 1998-05-01 2000-11-07 Sun Microsystems, Inc. Voice user interface with personality
US6574597B1 (en) 1998-05-08 2003-06-03 At&T Corp. Fully expanded context-dependent networks for speech recognition
US6236968B1 (en) 1998-05-14 2001-05-22 International Business Machines Corporation Sleep prevention dialog based car system
US6424983B1 (en) 1998-05-26 2002-07-23 Global Information Research And Technologies, Llc Spelling and grammar checking system
US20070094222A1 (en) 1998-05-28 2007-04-26 Lawrence Au Method and system for using voice input for performing network functions
US7072826B1 (en) * 1998-06-04 2006-07-04 Matsushita Electric Industrial Co., Ltd. Language conversion rule preparing device, language conversion device and program recording medium
US6219643B1 (en) 1998-06-26 2001-04-17 Nuance Communications, Inc. Method of analyzing dialogs in a natural language speech recognition system
US6393428B1 (en) 1998-07-13 2002-05-21 Microsoft Corporation Natural language information retrieval system
US6175858B1 (en) * 1998-07-13 2001-01-16 At&T Corp. Intelligent network messaging agent and method
US6553372B1 (en) 1998-07-13 2003-04-22 Microsoft Corporation Natural language information retrieval system
US6269336B1 (en) 1998-07-24 2001-07-31 Motorola, Inc. Voice browser for interactive services and methods thereof
US6539348B1 (en) * 1998-08-24 2003-03-25 Virtual Research Associates, Inc. Systems and methods for parsing a natural language sentence
US6208964B1 (en) * 1998-08-31 2001-03-27 Nortel Networks Limited Method and apparatus for providing unsupervised adaptation of transcriptions
US6434524B1 (en) 1998-09-09 2002-08-13 One Voice Technologies, Inc. Object interactive user interface using speech recognition and natural language processing
US6499013B1 (en) * 1998-09-09 2002-12-24 One Voice Technologies, Inc. Interactive user interface using speech recognition and natural language processing
US6049607A (en) 1998-09-18 2000-04-11 Lamar Signal Processing Interference canceling method and apparatus
US6606598B1 (en) 1998-09-22 2003-08-12 Speechworks International, Inc. Statistical computing and reporting for interactive speech applications
US6405170B1 (en) 1998-09-22 2002-06-11 Speechworks International, Inc. Method and system of reviewing the behavior of an interactive speech recognition application
US7003463B1 (en) * 1998-10-02 2006-02-21 International Business Machines Corporation System and method for providing network coordinated conversational services
US7137126B1 (en) 1998-10-02 2006-11-14 International Business Machines Corporation Conversational computing via conversational virtual machine
US6311159B1 (en) 1998-10-05 2001-10-30 Lernout & Hauspie Speech Products N.V. Speech controlled computer user interface
JP2002527829A (ja) 1998-10-09 2002-08-27 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 自動照会方法およびシステム
US6928614B1 (en) 1998-10-13 2005-08-09 Visteon Global Technologies, Inc. Mobile office with speech recognition
US6185535B1 (en) * 1998-10-16 2001-02-06 Telefonaktiebolaget Lm Ericsson (Publ) Voice control of a user interface to service applications
EP1123581A4 (en) 1998-10-21 2005-08-10 American Calcar Inc POSITION CAMERA AND GPS DATA EXCHANGE DEVICE
US6453292B2 (en) 1998-10-28 2002-09-17 International Business Machines Corporation Command boundary identifier for conversational natural language
US6028514A (en) 1998-10-30 2000-02-22 Lemelson Jerome H. Personal emergency, safety warning system and method
US6477200B1 (en) * 1998-11-09 2002-11-05 Broadcom Corporation Multi-pair gigabit ethernet transceiver
US8121891B2 (en) * 1998-11-12 2012-02-21 Accenture Global Services Gmbh Personalized product report
US6208972B1 (en) * 1998-12-23 2001-03-27 Richard Grant Method for integrating computer processes with an interface controlled by voice actuated grammars
US6195651B1 (en) * 1998-11-19 2001-02-27 Andersen Consulting Properties Bv System, method and article of manufacture for a tuned user application experience
US6246981B1 (en) 1998-11-25 2001-06-12 International Business Machines Corporation Natural language task-oriented dialog manager and method
US7881936B2 (en) * 1998-12-04 2011-02-01 Tegic Communications, Inc. Multimodal disambiguation of speech recognition
US6430285B1 (en) 1998-12-15 2002-08-06 At&T Corp. Method and apparatus for an automated caller interaction system
US6721001B1 (en) 1998-12-16 2004-04-13 International Business Machines Corporation Digital camera with voice recognition annotation
US6233556B1 (en) 1998-12-16 2001-05-15 Nuance Communications Voice processing and verification system
US6968333B2 (en) 2000-04-02 2005-11-22 Tangis Corporation Soliciting information based on a computer user's context
US6754485B1 (en) 1998-12-23 2004-06-22 American Calcar Inc. Technique for effectively providing maintenance and information to vehicles
US6570555B1 (en) 1998-12-30 2003-05-27 Fuji Xerox Co., Ltd. Method and apparatus for embodied conversational characters with multimodal input/output in an interface device
US6523061B1 (en) * 1999-01-05 2003-02-18 Sri International, Inc. System, method, and article of manufacture for agent-based navigation in a speech-based data navigation system
US6757718B1 (en) 1999-01-05 2004-06-29 Sri International Mobile navigation of network-based electronic information using spoken input
US6742021B1 (en) 1999-01-05 2004-05-25 Sri International, Inc. Navigating network-based electronic information using spoken input with multimodal error feedback
US6851115B1 (en) * 1999-01-05 2005-02-01 Sri International Software-based architecture for communication and cooperation among distributed electronic agents
JP3822990B2 (ja) 1999-01-07 2006-09-20 株式会社日立製作所 翻訳装置、記録媒体
US6429813B2 (en) 1999-01-14 2002-08-06 Navigation Technologies Corp. Method and system for providing end-user preferences with a navigation system
US6567797B1 (en) 1999-01-26 2003-05-20 Xerox Corporation System and method for providing recommendations based on multi-modal user clusters
GB2361339B (en) 1999-01-27 2003-08-06 Kent Ridge Digital Labs Method and apparatus for voice annotation and retrieval of multimedia data
US6556970B1 (en) 1999-01-28 2003-04-29 Denso Corporation Apparatus for determining appropriate series of words carrying information to be recognized
US6278968B1 (en) 1999-01-29 2001-08-21 Sony Corporation Method and apparatus for adaptive speech recognition hypothesis construction and selection in a spoken language translation system
TWM253017U (en) 1999-02-03 2004-12-11 Matsushita Electric Ind Co Ltd Emergency reporting apparatus emergency reporting network system
US6430531B1 (en) 1999-02-04 2002-08-06 Soliloquy, Inc. Bilateral speech system
JP2000231427A (ja) * 1999-02-08 2000-08-22 Nec Corp マルチモーダル情報解析装置
US6643620B1 (en) 1999-03-15 2003-11-04 Matsushita Electric Industrial Co., Ltd. Voice activated controller for recording and retrieving audio/video programs
JP4176228B2 (ja) 1999-03-15 2008-11-05 株式会社東芝 自然言語対話装置及び自然言語対話方法
US6272461B1 (en) 1999-03-22 2001-08-07 Siemens Information And Communication Networks, Inc. Method and apparatus for an enhanced presentation aid
US6631346B1 (en) 1999-04-07 2003-10-07 Matsushita Electric Industrial Co., Ltd. Method and apparatus for natural language parsing using multiple passes and tags
US6539345B1 (en) 1999-04-09 2003-03-25 Intel Corporation Symbolic simulation using input space decomposition via Boolean functional representation in parametric form
US6233561B1 (en) 1999-04-12 2001-05-15 Matsushita Electric Industrial Co., Ltd. Method for goal-oriented speech translation in hand-held devices using meaning extraction and dialogue
US6408272B1 (en) 1999-04-12 2002-06-18 General Magic, Inc. Distributed voice user interface
US6570964B1 (en) 1999-04-16 2003-05-27 Nuance Communications Technique for recognizing telephone numbers and other spoken information embedded in voice messages stored in a voice messaging system
US6434523B1 (en) 1999-04-23 2002-08-13 Nuance Communications Creating and editing grammars for speech recognition graphically
US6314402B1 (en) 1999-04-23 2001-11-06 Nuance Communications Method and apparatus for creating modifiable and combinable speech objects for acquiring information from a speaker in an interactive voice response system
US6804638B2 (en) 1999-04-30 2004-10-12 Recent Memory Incorporated Device and method for selective recall and preservation of events prior to decision to record the events
US6356869B1 (en) 1999-04-30 2002-03-12 Nortel Networks Limited Method and apparatus for discourse management
US6505155B1 (en) 1999-05-06 2003-01-07 International Business Machines Corporation Method and system for automatically adjusting prompt feedback based on predicted recognition accuracy
US6308151B1 (en) 1999-05-14 2001-10-23 International Business Machines Corp. Method and system using a speech recognition system to dictate a body of text in response to an available body of text
US6505230B1 (en) 1999-05-14 2003-01-07 Pivia, Inc. Client-server independent intermediary mechanism
US6604075B1 (en) 1999-05-20 2003-08-05 Lucent Technologies Inc. Web-based voice dialog interface
GB9911971D0 (en) 1999-05-21 1999-07-21 Canon Kk A system, a server for a system and a machine for use in a system
US6584439B1 (en) 1999-05-21 2003-06-24 Winbond Electronics Corporation Method and apparatus for controlling voice controlled devices
US7787907B2 (en) 1999-05-26 2010-08-31 Johnson Controls Technology Company System and method for using speech recognition with a vehicle control system
US20020032564A1 (en) 2000-04-19 2002-03-14 Farzad Ehsani Phrase-based dialogue modeling with particular application to creating a recognition grammar for a voice-controlled user interface
US20020107694A1 (en) 1999-06-07 2002-08-08 Traptec Corporation Voice-recognition safety system for aircraft and method of using the same
US7072888B1 (en) 1999-06-16 2006-07-04 Triogo, Inc. Process for improving search engine efficiency using feedback
US6389398B1 (en) 1999-06-23 2002-05-14 Lucent Technologies Inc. System and method for storing and executing network queries used in interactive voice response systems
US6374214B1 (en) 1999-06-24 2002-04-16 International Business Machines Corp. Method and apparatus for excluding text phrases during re-dictation in a speech recognition system
DE60026637T2 (de) 1999-06-30 2006-10-05 International Business Machines Corp. Verfahren zur Erweiterung des Wortschatzes eines Spracherkennungssystems
US6321196B1 (en) 1999-07-02 2001-11-20 International Business Machines Corporation Phonetic spelling for speech recognition
US6871179B1 (en) 1999-07-07 2005-03-22 International Business Machines Corporation Method and apparatus for executing voice commands having dictation as a parameter
US6374226B1 (en) 1999-08-06 2002-04-16 Sun Microsystems, Inc. System and method for interfacing speech recognition grammars to individual components of a computer program
US7069220B2 (en) 1999-08-13 2006-06-27 International Business Machines Corporation Method for determining and maintaining dialog focus in a conversational speech system
US6377913B1 (en) 1999-08-13 2002-04-23 International Business Machines Corporation Method and system for multi-client access to a dialog system
US6415257B1 (en) 1999-08-26 2002-07-02 Matsushita Electric Industrial Co., Ltd. System for identifying and adapting a TV-user profile by means of speech technology
US6901366B1 (en) 1999-08-26 2005-05-31 Matsushita Electric Industrial Co., Ltd. System and method for assessing TV-related information over the internet
US6513006B2 (en) * 1999-08-26 2003-01-28 Matsushita Electronic Industrial Co., Ltd. Automatic control of household activity using speech recognition and natural language
US6901431B1 (en) 1999-09-03 2005-05-31 Cisco Technology, Inc. Application server providing personalized voice enabled web application services using extensible markup language documents
JP2001071289A (ja) * 1999-09-03 2001-03-21 Sony Corp 情報処理装置および方法、並びにプログラム格納媒体
EP1083545A3 (en) * 1999-09-09 2001-09-26 Xanavi Informatics Corporation Voice recognition of proper names in a navigation apparatus
US6658388B1 (en) 1999-09-10 2003-12-02 International Business Machines Corporation Personality generator for conversational systems
US7340040B1 (en) * 1999-09-13 2008-03-04 Microstrategy, Incorporated System and method for real-time, personalized, dynamic, interactive voice services for corporate-analysis related information
US6850603B1 (en) 1999-09-13 2005-02-01 Microstrategy, Incorporated System and method for the creation and automatic deployment of personalized dynamic and interactive voice services
US6631351B1 (en) 1999-09-14 2003-10-07 Aidentity Matrix Smart toys
US6601026B2 (en) 1999-09-17 2003-07-29 Discern Communications, Inc. Information retrieval by natural language querying
US20020049535A1 (en) 1999-09-20 2002-04-25 Ralf Rigo Wireless interactive voice-actuated mobile telematics system
US6587858B1 (en) 1999-09-30 2003-07-01 Steven Paul Strazza Systems and methods for the control of dynamic data and request criteria in a data repository
JP2001100781A (ja) 1999-09-30 2001-04-13 Sony Corp 音声処理装置および音声処理方法、並びに記録媒体
US6868385B1 (en) 1999-10-05 2005-03-15 Yomobile, Inc. Method and apparatus for the provision of information signals based upon speech recognition
US6937977B2 (en) 1999-10-05 2005-08-30 Fastmobile, Inc. Method and apparatus for processing an input speech signal during presentation of an output audio signal
US6963759B1 (en) 1999-10-05 2005-11-08 Fastmobile, Inc. Speech recognition technique based on local interrupt detection
US6442522B1 (en) 1999-10-12 2002-08-27 International Business Machines Corporation Bi-directional natural language system for interfacing with multiple back-end applications
US6721697B1 (en) 1999-10-18 2004-04-13 Sony Corporation Method and system for reducing lexical ambiguity
AU8030300A (en) 1999-10-19 2001-04-30 Sony Electronics Inc. Natural language interface control system
KR100749016B1 (ko) 1999-10-19 2007-08-14 아메리칸 캘카어 인코포레이티드 사용자 선호도에 기초한 효과적인 내비게이션 기술
US6581103B1 (en) 1999-10-22 2003-06-17 Dedicated Radio, Llc Method for internet radio broadcasting including listener requests of audio and/or video files with input dedications
US7376586B1 (en) 1999-10-22 2008-05-20 Microsoft Corporation Method and apparatus for electronic commerce using a telephone interface
US6594367B1 (en) 1999-10-25 2003-07-15 Andrea Electronics Corporation Super directional beamforming design and implementation
US6882970B1 (en) 1999-10-28 2005-04-19 Canon Kabushiki Kaisha Language recognition using sequence frequency
CA2389186A1 (en) 1999-10-29 2001-05-03 British Telecommunications Public Limited Company Method and apparatus for processing queries
GB2355833B (en) 1999-10-29 2003-10-29 Canon Kk Natural language input method and apparatus
US6622119B1 (en) 1999-10-30 2003-09-16 International Business Machines Corporation Adaptive command predictor and method for a natural language dialog system
US6526139B1 (en) * 1999-11-03 2003-02-25 Tellabs Operations, Inc. Consolidated noise injection in a voice processing system
US6681206B1 (en) * 1999-11-05 2004-01-20 At&T Corporation Method for generating morphemes
US8482535B2 (en) 1999-11-08 2013-07-09 Apple Inc. Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics
US6615172B1 (en) 1999-11-12 2003-09-02 Phoenix Solutions, Inc. Intelligent query engine for processing voice based queries
US7392185B2 (en) * 1999-11-12 2008-06-24 Phoenix Solutions, Inc. Speech based learning/training system using semantic decoding
US9076448B2 (en) 1999-11-12 2015-07-07 Nuance Communications, Inc. Distributed real time speech recognition system
US6633846B1 (en) 1999-11-12 2003-10-14 Phoenix Solutions, Inc. Distributed realtime speech recognition system
US6751612B1 (en) 1999-11-29 2004-06-15 Xerox Corporation User query generate search results that rank set of servers where ranking is based on comparing content on each server with user query, frequency at which content on each server is altered using web crawler in a search engine
US6418210B1 (en) 1999-11-29 2002-07-09 At&T Corp Method and apparatus for providing information between a calling network and a called network
GB9928420D0 (en) * 1999-12-02 2000-01-26 Ibm Interactive voice response system
US6288319B1 (en) 1999-12-02 2001-09-11 Gary Catona Electronic greeting card with a custom audio mix
US6219645B1 (en) 1999-12-02 2001-04-17 Lucent Technologies, Inc. Enhanced automatic speech recognition using multiple directional microphones
US6591239B1 (en) 1999-12-09 2003-07-08 Steris Inc. Voice controlled surgical suite
GB9929284D0 (en) 1999-12-11 2000-02-02 Ibm Voice processing apparatus
US6732088B1 (en) 1999-12-14 2004-05-04 Xerox Corporation Collaborative searching by query induction
US6598018B1 (en) 1999-12-15 2003-07-22 Matsushita Electric Industrial Co., Ltd. Method for natural dialog interface to car devices
US6976229B1 (en) 1999-12-16 2005-12-13 Ricoh Co., Ltd. Method and apparatus for storytelling with digital photographs
US6832230B1 (en) 1999-12-22 2004-12-14 Nokia Corporation Apparatus and associated method for downloading an application with a variable lifetime to a mobile terminal
US6920421B2 (en) 1999-12-28 2005-07-19 Sony Corporation Model adaptive apparatus for performing adaptation of a model used in pattern recognition considering recentness of a received pattern data
US6678680B1 (en) * 2000-01-06 2004-01-13 Mark Woo Music search engine
US6701294B1 (en) * 2000-01-19 2004-03-02 Lucent Technologies, Inc. User interface for translating natural language inquiries into database queries and data presentations
US20010047261A1 (en) 2000-01-24 2001-11-29 Peter Kassan Partially automated interactive dialog
US6829603B1 (en) 2000-02-02 2004-12-07 International Business Machines Corp. System, method and program product for interactive natural dialog
US6560590B1 (en) 2000-02-14 2003-05-06 Kana Software, Inc. Method and apparatus for multiple tiered matching of natural language queries to positions in a text corpus
US6640098B1 (en) 2000-02-14 2003-10-28 Action Engine Corporation System for obtaining service-related information for local interactive wireless devices
US6434529B1 (en) 2000-02-16 2002-08-13 Sun Microsystems, Inc. System and method for referencing object instances and invoking methods on those object instances from within a speech recognition grammar
GB0003903D0 (en) 2000-02-18 2000-04-05 Canon Kk Improved speech recognition accuracy in a multimodal input system
EP1269357A4 (en) 2000-02-22 2005-10-12 Metacarta Inc SPANISH CODING AND DISPLAYING INFORMATION
US7110951B1 (en) 2000-03-03 2006-09-19 Dorothy Lemelson, legal representative System and method for enhancing speech intelligibility for the hearing impaired
US6466654B1 (en) 2000-03-06 2002-10-15 Avaya Technology Corp. Personal virtual assistant with semantic tagging
US6757362B1 (en) 2000-03-06 2004-06-29 Avaya Technology Corp. Personal virtual assistant
US6510417B1 (en) * 2000-03-21 2003-01-21 America Online, Inc. System and method for voice access to internet-based information
US7103563B1 (en) 2000-03-21 2006-09-05 America Online, Inc. System and method for advertising with an internet voice portal
US7974875B1 (en) * 2000-03-21 2011-07-05 Aol Inc. System and method for using voice over a telephone to access, process, and carry out transactions over the internet
DE60130880T2 (de) 2000-03-24 2008-07-17 Eliza Corp., Beverly Web-gestützte spracherkennung durch scripting und semantische objekte
US6868380B2 (en) * 2000-03-24 2005-03-15 Eliza Corporation Speech recognition system and method for generating phonotic estimates
US6980092B2 (en) 2000-04-06 2005-12-27 Gentex Corporation Vehicle rearview mirror assembly incorporating a communication system
WO2001078065A1 (en) 2000-04-06 2001-10-18 One Voice Technologies, Inc. Natural language and dialogue generation processing
US7177798B2 (en) 2000-04-07 2007-02-13 Rensselaer Polytechnic Institute Natural language interface using constrained intermediate dictionary of results
US7734287B2 (en) 2000-04-10 2010-06-08 I/O Controls Corporation System for providing remote access to diagnostic information over a wide area network
US6726636B2 (en) 2000-04-12 2004-04-27 Loran Technologies, Inc. Breathalyzer with voice recognition
US6578022B1 (en) 2000-04-18 2003-06-10 Icplanet Corporation Interactive intelligent searching with executable suggestions
US6556973B1 (en) 2000-04-19 2003-04-29 Voxi Ab Conversion between data representation formats
US20020007267A1 (en) 2000-04-21 2002-01-17 Leonid Batchilo Expanded search and display of SAO knowledge base information
US7502672B1 (en) 2000-04-24 2009-03-10 Usa Technologies, Inc. Wireless vehicle diagnostics with service and part determination capabilities
US6560576B1 (en) 2000-04-25 2003-05-06 Nuance Communications Method and apparatus for providing active help to a user of a voice-enabled application
AU2001255742A1 (en) 2000-04-26 2001-11-07 Portable Internet Inc. Portable internet services
JP3542026B2 (ja) 2000-05-02 2004-07-14 インターナショナル・ビジネス・マシーンズ・コーポレーション 音声認識システム、音声認識方法およびコンピュータ可読な記録媒体
WO2001084535A2 (en) 2000-05-02 2001-11-08 Dragon Systems, Inc. Error correction in speech recognition
US6567805B1 (en) 2000-05-15 2003-05-20 International Business Machines Corporation Interactive automated response system
MXPA02011302A (es) 2000-05-16 2004-08-12 John Taschereau Metodo y sistema para proporcionar informacion y publicidad dirigidas geograficamente.
AU2001263397A1 (en) 2000-05-24 2001-12-03 Stars 1-To-1 Interactive voice communication method and system for information and entertainment
WO2001090921A2 (en) 2000-05-25 2001-11-29 Kanisa, Inc. System and method for automatically classifying text
WO2001093554A2 (en) * 2000-05-26 2001-12-06 Koninklijke Philips Electronics N.V. Method and device for acoustic echo cancellation combined with adaptive beamforming
SE517005C2 (sv) 2000-05-31 2002-04-02 Hapax Information Systems Ab Segmentering av text
US7031908B1 (en) 2000-06-01 2006-04-18 Microsoft Corporation Creating a language model for a language processing system
US6487495B1 (en) 2000-06-02 2002-11-26 Navigation Technologies Corporation Navigation applications using related location-referenced keywords
US7082469B2 (en) 2000-06-09 2006-07-25 Gold Mustache Publishing, Inc. Method and system for electronic song dedication
WO2001097558A2 (en) * 2000-06-13 2001-12-20 Gn Resound Corporation Fixed polar-pattern-based adaptive directionality systems
US6990513B2 (en) * 2000-06-22 2006-01-24 Microsoft Corporation Distributed computing services platform
JP3567864B2 (ja) 2000-07-21 2004-09-22 株式会社デンソー 音声認識装置及び記録媒体
US7143039B1 (en) 2000-08-11 2006-11-28 Tellme Networks, Inc. Providing menu and other services for an information processing system using a telephone or other audio interface
US6636790B1 (en) 2000-07-25 2003-10-21 Reynolds And Reynolds Holdings, Inc. Wireless diagnostic system and method for monitoring vehicles
DE60133902D1 (zh) 2000-07-28 2008-06-19 Siemens Vdo Automotive Corp
DE10036851A1 (de) 2000-07-28 2002-02-28 Mannesmann Vdo Ag Verfahren zur Auswahl einer Ortsbezeichnung in einem Navigationssystem durch Spracheingabe
US6587855B1 (en) 2000-07-31 2003-07-01 Ncr Corporation Formatting and displaying data retrieved from a database
US7092928B1 (en) 2000-07-31 2006-08-15 Quantum Leap Research, Inc. Intelligent portal engine
US7027975B1 (en) 2000-08-08 2006-04-11 Object Services And Consulting, Inc. Guided natural language interface system and method
US7653748B2 (en) 2000-08-10 2010-01-26 Simplexity, Llc Systems, methods and computer program products for integrating advertising within web content
US6574624B1 (en) 2000-08-18 2003-06-03 International Business Machines Corporation Automatic topic identification and switch for natural language search of textual document collections
WO2002017069A1 (en) 2000-08-21 2002-02-28 Yahoo! Inc. Method and system of interpreting and presenting web content using a voice browser
US8200485B1 (en) 2000-08-29 2012-06-12 A9.Com, Inc. Voice interface and methods for improving recognition accuracy of voice search queries
US7062488B1 (en) 2000-08-30 2006-06-13 Richard Reisman Task/domain segmentation in applying feedback to command control
CN1226717C (zh) * 2000-08-30 2005-11-09 国际商业机器公司 自动新词提取方法和系统
US6813341B1 (en) 2000-08-31 2004-11-02 Ivoice, Inc. Voice activated/voice responsive item locator
EP1184841A1 (de) 2000-08-31 2002-03-06 Siemens Aktiengesellschaft Sprachgesteuerte Anordnung und Verfahren zur Spracheingabe und -erkennung
JP2004508636A (ja) 2000-09-07 2004-03-18 テレフオンアクチーボラゲット　エル　エム　エリクソン（パブル） 情報提供システム及びその制御方法
US20040205671A1 (en) 2000-09-13 2004-10-14 Tatsuya Sukehiro Natural-language processing system
US6785651B1 (en) 2000-09-14 2004-08-31 Microsoft Corporation Method and apparatus for performing plan-based dialog
KR20070118707A (ko) 2000-09-21 2007-12-17 아메리칸 캘카어 인코포레이티드 차량을 효과적으로 그리고 안전하게 운전하는 기술
US7085708B2 (en) 2000-09-23 2006-08-01 Ravenflow, Inc. Computer system with natural language to machine language translator
US6754647B1 (en) 2000-09-26 2004-06-22 Verity, Inc. Method and apparatus for hierarchically decomposed bot scripts
US6362748B1 (en) * 2000-09-27 2002-03-26 Lite Vision Corporation System for communicating among vehicles and a communication system control center
US6704576B1 (en) 2000-09-27 2004-03-09 At&T Corp. Method and system for communicating multimedia content in a unicast, multicast, simulcast or broadcast environment
AU2001295080A1 (en) 2000-09-29 2002-04-08 Professorq, Inc. Natural-language voice-activated personal assistant
JP2003044708A (ja) 2000-10-02 2003-02-14 Omron Corp 情報仲介システムとそれに用いられる情報仲介方法
US7219058B1 (en) 2000-10-13 2007-05-15 At&T Corp. System and method for processing speech recognition results
US6922670B2 (en) 2000-10-24 2005-07-26 Sanyo Electric Co., Ltd. User support apparatus and system using agents
US7027974B1 (en) 2000-10-27 2006-04-11 Science Applications International Corporation Ontology-based parser for natural language processing
US6795808B1 (en) 2000-10-30 2004-09-21 Koninklijke Philips Electronics N.V. User interface/entertainment device that simulates personal interaction and charges external database with relevant data
US6721706B1 (en) 2000-10-30 2004-04-13 Koninklijke Philips Electronics N.V. Environment-responsive user interface/entertainment device that simulates personal interaction
US6934756B2 (en) 2000-11-01 2005-08-23 International Business Machines Corporation Conversational networking via transport, coding and control conversational protocols
GB0027178D0 (en) * 2000-11-07 2000-12-27 Canon Kk Speech processing system
US6941266B1 (en) 2000-11-15 2005-09-06 At&T Corp. Method and system for predicting problematic dialog situations in a task classification system
US6735592B1 (en) 2000-11-16 2004-05-11 Discern Communications System, method, and computer program product for a network-based content exchange system
US7013308B1 (en) 2000-11-28 2006-03-14 Semscript Ltd. Knowledge storage and retrieval system and method
US20020065568A1 (en) 2000-11-30 2002-05-30 Silfvast Robert Denton Plug-in modules for digital signal processor functionalities
US6973429B2 (en) 2000-12-04 2005-12-06 A9.Com, Inc. Grammar generation for voice-based searches
US20020067839A1 (en) 2000-12-04 2002-06-06 Heinrich Timothy K. The wireless voice activated and recogintion car system
JP2002175316A (ja) 2000-12-07 2002-06-21 Sanyo Electric Co Ltd ユーザ支援装置およびシステム
US7016847B1 (en) 2000-12-08 2006-03-21 Ben Franklin Patent Holdings L.L.C. Open architecture for a voice user interface
US6456711B1 (en) 2000-12-12 2002-09-24 At&T Corp. Method for placing a call intended for an enhanced network user on hold while the enhanced network user is unavailable to take the call using a distributed feature architecture
US7170993B2 (en) 2000-12-19 2007-01-30 Lucent Technologies Inc. Methods and apparatus for automated monitoring and action taking based on decision support mechanism
US8023622B2 (en) 2000-12-21 2011-09-20 Grape Technology Group, Inc. Technique for call context based advertising through an information assistance service
US20020082911A1 (en) 2000-12-22 2002-06-27 Dunn Charles L. Online revenue sharing
US6973427B2 (en) * 2000-12-26 2005-12-06 Microsoft Corporation Method for adding phonetic descriptions to a speech recognition lexicon
US20020133347A1 (en) 2000-12-29 2002-09-19 Eberhard Schoneburg Method and apparatus for natural language dialog interface
US20020087312A1 (en) 2000-12-29 2002-07-04 Lee Victor Wai Leung Computer-implemented conversation buffering method and system
US20020087326A1 (en) 2000-12-29 2002-07-04 Lee Victor Wai Leung Computer-implemented web page summarization method and system
US7085723B2 (en) 2001-01-12 2006-08-01 International Business Machines Corporation System and method for determining utterance context in a multi-context speech application
DE10101282A1 (de) 2001-01-12 2002-07-18 Siemens Ag Notrufmeldung mittels mobiler Telekommunikationsgeräte
US6751591B1 (en) 2001-01-22 2004-06-15 At&T Corp. Method and system for predicting understanding errors in a task classification system
US7069207B2 (en) 2001-01-26 2006-06-27 Microsoft Corporation Linguistically intelligent text compression
US7487110B2 (en) 2001-01-30 2009-02-03 International Business Machines Corporation Automotive information communication exchange system, method, and program product
US6964023B2 (en) 2001-02-05 2005-11-08 International Business Machines Corporation System and method for multi-modal focus detection, referential ambiguity resolution and mood classification using multi-modal input
US20020107873A1 (en) 2001-02-07 2002-08-08 Bandag Licensing Corporation System and method for data collection, reporting, and analysis of fleet vehicle information
US7206418B2 (en) 2001-02-12 2007-04-17 Fortemedia, Inc. Noise suppression for a wireless communication device
EP1231788A1 (en) 2001-02-12 2002-08-14 Koninklijke Philips Electronics N.V. Arrangement for distributing content, profiling center, receiving device and method
US6549629B2 (en) 2001-02-21 2003-04-15 Digisonix Llc DVE system with normalized selection
GB2372864B (en) 2001-02-28 2005-09-07 Vox Generation Ltd Spoken language interface
US6754627B2 (en) 2001-03-01 2004-06-22 International Business Machines Corporation Detecting speech recognition errors in an embedded speech recognition system
US20020173961A1 (en) 2001-03-09 2002-11-21 Guerra Lisa M. System, method and computer program product for dynamic, robust and fault tolerant audio output in a speech recognition framework
US7024364B2 (en) 2001-03-09 2006-04-04 Bevocal, Inc. System, method and computer program product for looking up business addresses and directions based on a voice dial-up session
US20020178003A1 (en) 2001-03-09 2002-11-28 Motorola, Inc. Method and apparatus for providing voice recognition service to a wireless communication device
US20020152260A1 (en) 2001-03-12 2002-10-17 Qiming Chen Dynamic agent with embedded web server and mark-up language support for e-commerce automation
US20020169597A1 (en) 2001-03-12 2002-11-14 Fain Systems, Inc. Method and apparatus providing computer understanding and instructions from natural language
US7216073B2 (en) 2001-03-13 2007-05-08 Intelligate, Ltd. Dynamic natural language understanding
US20020133402A1 (en) 2001-03-13 2002-09-19 Scott Faber Apparatus and method for recruiting, communicating with, and paying participants of interactive advertising
US7574362B2 (en) 2001-03-14 2009-08-11 At&T Intellectual Property Ii, L.P. Method for automated sentence planning in a task classification system
WO2002073453A1 (en) 2001-03-14 2002-09-19 At & T Corp. A trainable sentence planning system
US7729918B2 (en) 2001-03-14 2010-06-01 At&T Intellectual Property Ii, Lp Trainable sentence planning system
US7380250B2 (en) 2001-03-16 2008-05-27 Microsoft Corporation Method and system for interacting with devices having different capabilities
US6801897B2 (en) 2001-03-28 2004-10-05 International Business Machines Corporation Method of providing concise forms of natural commands
US7406421B2 (en) 2001-10-26 2008-07-29 Intellisist Inc. Systems and methods for reviewing informational content in a vehicle
US7472075B2 (en) 2001-03-29 2008-12-30 Intellisist, Inc. System and method to associate broadcast radio content with a transaction via an internet server
US8175886B2 (en) 2001-03-29 2012-05-08 Intellisist, Inc. Determination of signal-processing approach based on signal destination characteristics
US6487494B2 (en) 2001-03-29 2002-11-26 Wingcast, Llc System and method for reducing the amount of repetitive data sent by a server to a client for vehicle navigation
JP2002358095A (ja) 2001-03-30 2002-12-13 Sony Corp 音声処理装置および音声処理方法、並びにプログラムおよび記録媒体
FR2822994B1 (fr) 2001-03-30 2004-05-21 Bouygues Telecom Sa Assistance au conducteur d'un vehicule automobile
US20040117804A1 (en) 2001-03-30 2004-06-17 Scahill Francis J Multi modal interface
US6996531B2 (en) * 2001-03-30 2006-02-07 Comverse Ltd. Automated database assistance using a telephone for a speech based or text based multimedia communication mode
US20040030741A1 (en) 2001-04-02 2004-02-12 Wolton Richard Ernest Method and apparatus for search, visual navigation, analysis and retrieval of information from networks with remote notification and content delivery
US6885989B2 (en) 2001-04-02 2005-04-26 International Business Machines Corporation Method and system for collaborative speech recognition for small-area network
US6856990B2 (en) * 2001-04-09 2005-02-15 Intel Corporation Network dedication system
JP2002318132A (ja) 2001-04-23 2002-10-31 Hitachi Ltd 音声対話型ナビゲーションシステムおよび移動端末装置および音声対話サーバ
US7698228B2 (en) 2001-04-27 2010-04-13 Accenture Llp Tracking purchases in a location-based services system
US7970648B2 (en) 2001-04-27 2011-06-28 Accenture Global Services Limited Advertising campaign and business listing management for a location-based services system
US7437295B2 (en) 2001-04-27 2008-10-14 Accenture Llp Natural language processing for a location-based services system
US6950821B2 (en) 2001-05-04 2005-09-27 Sun Microsystems, Inc. System and method for resolving distributed network search queries to information providers
US6804684B2 (en) 2001-05-07 2004-10-12 Eastman Kodak Company Method for associating semantic information with multiple images in an image database environment
US20020173333A1 (en) 2001-05-18 2002-11-21 Buchholz Dale R. Method and apparatus for processing barge-in requests
US6944594B2 (en) 2001-05-30 2005-09-13 Bellsouth Intellectual Property Corporation Multi-context conversational environment system and method
JP2002366166A (ja) 2001-06-11 2002-12-20 Pioneer Electronic Corp コンテンツ提供システム及び方法、並びにそのためのコンピュータプログラム
JP2003005897A (ja) * 2001-06-20 2003-01-08 Alpine Electronics Inc 情報入力方法および装置
US6801604B2 (en) 2001-06-25 2004-10-05 International Business Machines Corporation Universal IP-based and scalable architectures across conversational applications using web services for speech and audio processing resources
US20020198714A1 (en) 2001-06-26 2002-12-26 Guojun Zhou Statistical spoken dialog system
US20100029261A1 (en) 2001-06-27 2010-02-04 John Mikkelsen Virtual wireless data cable method, apparatus and system
US7606712B1 (en) 2001-06-28 2009-10-20 At&T Intellectual Property Ii, L.P. Speech recognition interface for voice actuation of legacy systems
US20050234727A1 (en) 2001-07-03 2005-10-20 Leo Chiu Method and apparatus for adapting a voice extensible markup language-enabled voice system for natural speech recognition and system response
US20090144131A1 (en) 2001-07-03 2009-06-04 Leo Chiu Advertising method and apparatus
US6983307B2 (en) * 2001-07-11 2006-01-03 Kirusa, Inc. Synchronization among plural browsers
US7123727B2 (en) * 2001-07-18 2006-10-17 Agere Systems Inc. Adaptive close-talking differential microphone array
US7966177B2 (en) 2001-08-13 2011-06-21 Hans Geiger Method and device for recognising a phonetic sound sequence or character sequence
US7283951B2 (en) 2001-08-14 2007-10-16 Insightful Corporation Method and system for enhanced data searching
US6757544B2 (en) 2001-08-15 2004-06-29 Motorola, Inc. System and method for determining a location relevant to a communication device and/or its associated user
US6941264B2 (en) 2001-08-16 2005-09-06 Sony Electronics Inc. Retraining and updating speech models for speech recognition
US20030093419A1 (en) * 2001-08-17 2003-05-15 Srinivas Bangalore System and method for querying information using a flexible multi-modal interface
US7920682B2 (en) 2001-08-21 2011-04-05 Byrne William J Dynamic interactive voice interface
JP2003157259A (ja) 2001-09-05 2003-05-30 Fuji Xerox Co Ltd 情報検索システム
US20030046071A1 (en) 2001-09-06 2003-03-06 International Business Machines Corporation Voice recognition apparatus and method
US7305381B1 (en) 2001-09-14 2007-12-04 Ricoh Co., Ltd Asynchronous unconscious retrieval in a network of information appliances
US7403938B2 (en) 2001-09-24 2008-07-22 Iac Search & Media, Inc. Natural language query processing
US6959276B2 (en) 2001-09-27 2005-10-25 Microsoft Corporation Including the category of environmental noise when processing speech signals
US6721633B2 (en) 2001-09-28 2004-04-13 Robert Bosch Gmbh Method and device for interfacing a driver information system using a voice portal server
US7289606B2 (en) 2001-10-01 2007-10-30 Sandeep Sibal Mode-swapping in multi-modal telephonic applications
JP3997459B2 (ja) 2001-10-02 2007-10-24 株式会社日立製作所 音声入力システムおよび音声ポータルサーバおよび音声入力端末
US7640006B2 (en) 2001-10-03 2009-12-29 Accenture Global Services Gmbh Directory assistance with multi-modal messaging
US7254384B2 (en) 2001-10-03 2007-08-07 Accenture Global Services Gmbh Multi-modal messaging
US20030069734A1 (en) 2001-10-05 2003-04-10 Everhart Charles Allen Technique for active voice recognition grammar adaptation for dynamic multimedia application
JP4065936B2 (ja) 2001-10-09 2008-03-26 独立行政法人情報通信研究機構 機械学習法を用いた言語解析処理システムおよび機械学習法を用いた言語省略解析処理システム
US6501834B1 (en) 2001-11-21 2002-12-31 At&T Corp. Message sender status monitor
US20030101054A1 (en) 2001-11-27 2003-05-29 Ncc, Llc Integrated system and method for electronic speech recognition and transcription
US7174300B2 (en) 2001-12-11 2007-02-06 Lockheed Martin Corporation Dialog processing method and apparatus for uninhabited air vehicles
US7165028B2 (en) * 2001-12-12 2007-01-16 Texas Instruments Incorporated Method of speech recognition resistant to convolutive distortion and additive distortion
GB2383247A (en) 2001-12-13 2003-06-18 Hewlett Packard Co Multi-modal picture allowing verbal interaction between a user and the picture
US7231343B1 (en) 2001-12-20 2007-06-12 Ianywhere Solutions, Inc. Synonyms mechanism for natural language systems
US20030120493A1 (en) 2001-12-21 2003-06-26 Gupta Sunil K. Method and system for updating and customizing recognition vocabulary
EP1324274A3 (en) 2001-12-28 2005-11-02 Matsushita Electric Industrial Co., Ltd. Vehicle information recording system
US7203644B2 (en) 2001-12-31 2007-04-10 Intel Corporation Automating tuning of speech recognition systems
US6804330B1 (en) 2002-01-04 2004-10-12 Siebel Systems, Inc. Method and system for accessing CRM data via voice
US7493259B2 (en) 2002-01-04 2009-02-17 Siebel Systems, Inc. Method for accessing data via voice
US7493559B1 (en) * 2002-01-09 2009-02-17 Ricoh Co., Ltd. System and method for direct multi-modal annotation of objects
US7117200B2 (en) 2002-01-11 2006-10-03 International Business Machines Corporation Synthesizing information-bearing content from multiple channels
US7111248B2 (en) 2002-01-15 2006-09-19 Openwave Systems Inc. Alphanumeric information input method
US7536297B2 (en) 2002-01-22 2009-05-19 International Business Machines Corporation System and method for hybrid text mining for finding abbreviations and their definitions
US7054817B2 (en) 2002-01-25 2006-05-30 Canon Europa N.V. User interface for speech model generation and testing
US20030144846A1 (en) 2002-01-31 2003-07-31 Denenberg Lawrence A. Method and system for modifying the behavior of an application based upon the application's grammar
US7130390B2 (en) 2002-02-01 2006-10-31 Microsoft Corporation Audio messaging system and method
US7177814B2 (en) 2002-02-07 2007-02-13 Sap Aktiengesellschaft Dynamic grammar for voice-enabled applications
US6591185B1 (en) 2002-02-11 2003-07-08 Visteon Global Technologies, Inc. Method for determination of fuel usage for a vehicle in a vehicle navigation system
US7058890B2 (en) 2002-02-13 2006-06-06 Siebel Systems, Inc. Method and system for enabling connectivity to a data system
US8249880B2 (en) 2002-02-14 2012-08-21 Intellisist, Inc. Real-time display of system instructions
US7587317B2 (en) 2002-02-15 2009-09-08 Microsoft Corporation Word training interface
JP3974419B2 (ja) * 2002-02-18 2007-09-12 株式会社日立製作所 音声入力を用いた情報取得方法及び情報取得システム
US20030167167A1 (en) 2002-02-26 2003-09-04 Li Gong Intelligent personal assistants
US7301093B2 (en) 2002-02-27 2007-11-27 Neil D. Sater System and method that facilitates customizing media
US6704396B2 (en) 2002-02-27 2004-03-09 Sbc Technology Resources, Inc. Multi-modal communications method
US7016849B2 (en) * 2002-03-25 2006-03-21 Sri International Method and apparatus for providing speech-driven routing between spoken language applications
US7181398B2 (en) 2002-03-27 2007-02-20 Hewlett-Packard Development Company, L.P. Vocabulary independent speech recognition system and method using subword units
US7136875B2 (en) 2002-09-24 2006-11-14 Google, Inc. Serving advertisements based on content
US20050021397A1 (en) 2003-07-22 2005-01-27 Cui Yingwei Claire Content-targeted advertising using collected user behavior data
US7072834B2 (en) 2002-04-05 2006-07-04 Intel Corporation Adapting to adverse acoustic environment in speech processing using playback training data
US7197460B1 (en) 2002-04-23 2007-03-27 At&T Corp. System for handling frequently asked questions in a natural language dialog service
US6877001B2 (en) 2002-04-25 2005-04-05 Mitsubishi Electric Research Laboratories, Inc. Method and system for retrieving documents with spoken queries
US7167568B2 (en) 2002-05-02 2007-01-23 Microsoft Corporation Microphone array signal enhancement
US20030212558A1 (en) 2002-05-07 2003-11-13 Matula Valentine C. Method and apparatus for distributed interactive voice processing
US6915126B2 (en) 2002-05-08 2005-07-05 General Motors Corporation Method of activating a wireless communication system in a mobile vehicle
US20030212550A1 (en) 2002-05-10 2003-11-13 Ubale Anil W. Method, apparatus, and system for improving speech quality of voice-over-packets (VOP) systems
US20030212562A1 (en) 2002-05-13 2003-11-13 General Motors Corporation Manual barge-in for server-based in-vehicle voice recognition systems
JP2003329477A (ja) * 2002-05-15 2003-11-19 Pioneer Electronic Corp ナビゲーション装置及び対話型情報提供プログラム
US7107210B2 (en) 2002-05-20 2006-09-12 Microsoft Corporation Method of noise reduction based on dynamic aspects of speech
US7127400B2 (en) 2002-05-22 2006-10-24 Bellsouth Intellectual Property Corporation Methods and systems for personal interactive voice response
US7546382B2 (en) 2002-05-28 2009-06-09 International Business Machines Corporation Methods and systems for authoring of mixed-initiative multi-modal interactions and related browsing mechanisms
US20040140989A1 (en) 2002-05-28 2004-07-22 John Papageorge Content subscription and delivery service
US7398209B2 (en) 2002-06-03 2008-07-08 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
US7512906B1 (en) 2002-06-04 2009-03-31 Rockwell Automation Technologies, Inc. System and methodology providing adaptive interface in an industrial controller environment
US20030233230A1 (en) 2002-06-12 2003-12-18 Lucent Technologies Inc. System and method for representing and resolving ambiguity in spoken dialogue systems
US7143037B1 (en) 2002-06-12 2006-11-28 Cisco Technology, Inc. Spelling words using an arbitrary phonetic alphabet
US7548491B2 (en) 2002-06-13 2009-06-16 General Motors Corporation Personalized key system for a mobile vehicle
US7502730B2 (en) 2002-06-14 2009-03-10 Microsoft Corporation Method and apparatus for federated understanding
US7502737B2 (en) 2002-06-24 2009-03-10 Intel Corporation Multi-pass recognition of spoken dialogue
US20050021470A1 (en) 2002-06-25 2005-01-27 Bose Corporation Intelligent music track selection
US7177815B2 (en) * 2002-07-05 2007-02-13 At&T Corp. System and method of context-sensitive help for multi-modal dialog systems
US7177816B2 (en) 2002-07-05 2007-02-13 At&T Corp. System and method of handling problematic input during context-sensitive help for multi-modal dialog systems
US20040010358A1 (en) 2002-07-12 2004-01-15 General Motors Corporation Vehicle personalization through web portal
US7693720B2 (en) 2002-07-15 2010-04-06 Voicebox Technologies, Inc. Mobile systems and methods for responding to natural language speech utterance
EP1391830A1 (fr) 2002-07-19 2004-02-25 Albert Inc. S.A. Système d'extraction d'informations dans un texte en langage naturel
EP1394692A1 (en) * 2002-08-05 2004-03-03 Alcatel Method, terminal, browser application, and mark-up language for multimodal interaction between a user and a terminal
US7236923B1 (en) 2002-08-07 2007-06-26 Itt Manufacturing Enterprises, Inc. Acronym extraction system and method of identifying acronyms and extracting corresponding expansions from text
US7146315B2 (en) 2002-08-30 2006-12-05 Siemens Corporate Research, Inc. Multichannel voice detection in adverse environments
US6741931B1 (en) 2002-09-05 2004-05-25 Daimlerchrysler Corporation Vehicle navigation system with off-board server
US20060130002A1 (en) 2002-09-09 2006-06-15 Sadahiro Hirayama Requirement defining method, method for developing software, and method for changing requirement word, and newly defining method
US7184957B2 (en) * 2002-09-25 2007-02-27 Toyota Infotechnology Center Co., Ltd. Multiple pass speech recognition method and system
US7328155B2 (en) * 2002-09-25 2008-02-05 Toyota Infotechnology Center Co., Ltd. Method and system for speech recognition using grammar weighted based upon location information
US7424427B2 (en) 2002-10-17 2008-09-09 Verizon Corporate Services Group Inc. Systems and methods for classifying audio into broad phoneme classes
US20030115062A1 (en) 2002-10-29 2003-06-19 Walker Marilyn A. Method for automated sentence planning
US8321427B2 (en) 2002-10-31 2012-11-27 Promptu Systems Corporation Method and apparatus for generation and augmentation of search terms from external and internal sources
EP1599866B1 (de) 2002-11-13 2007-08-22 Bernd Schönebeck Sprachverarbeitendes system und verfahren
US6739556B1 (en) 2002-11-20 2004-05-25 Raytheon Company Method and apparatus for providing an aircraft emergency safety control system
US6889188B2 (en) 2002-11-22 2005-05-03 Intel Corporation Methods and apparatus for controlling an electronic device
US7684985B2 (en) 2002-12-10 2010-03-23 Richard Dominach Techniques for disambiguating speech input using multimodal interfaces
KR100580619B1 (ko) 2002-12-11 2006-05-16 삼성전자주식회사 사용자와 에이전트 간의 대화 관리방법 및 장치
US6834265B2 (en) 2002-12-13 2004-12-21 Motorola, Inc. Method and apparatus for selective speech recognition
US7890324B2 (en) 2002-12-19 2011-02-15 At&T Intellectual Property Ii, L.P. Context-sensitive interface widgets for multi-modal dialog systems
US20040143440A1 (en) 2003-01-03 2004-07-22 Venkatesh Prasad Vehicle speech recognition system
US8335683B2 (en) 2003-01-23 2012-12-18 Microsoft Corporation System for using statistical classifiers for spoken language understanding
US20040148170A1 (en) 2003-01-23 2004-07-29 Alejandro Acero Statistical classifiers for spoken language understanding and command/control scenarios
US20040158555A1 (en) 2003-02-11 2004-08-12 Terradigtal Systems Llc. Method for managing a collection of media objects
DE10306022B3 (de) 2003-02-13 2004-02-19 Siemens Ag Dreistufige Einzelworterkennung
KR100486733B1 (ko) 2003-02-24 2005-05-03 삼성전자주식회사 음소 결합정보를 이용한 연속 음성인식방법 및 장치
GB2398913B (en) * 2003-02-27 2005-08-17 Motorola Inc Noise estimation in speech recognition
JP4103639B2 (ja) 2003-03-14 2008-06-18 セイコーエプソン株式会社 音響モデル作成方法および音響モデル作成装置ならびに音声認識装置
US7729913B1 (en) 2003-03-18 2010-06-01 A9.Com, Inc. Generation and selection of voice recognition grammars for conducting database searches
JP4155854B2 (ja) 2003-03-24 2008-09-24 富士通株式会社 対話制御システム及び方法
US7146319B2 (en) 2003-03-31 2006-12-05 Novauris Technologies Ltd. Phonetically based speech recognition system and method
US20050021826A1 (en) * 2003-04-21 2005-01-27 Sunil Kumar Gateway controller for a multimodal system that provides inter-communication among different data and voice servers through various mobile devices, and interface for that controller
EP1473964A3 (en) 2003-05-02 2006-08-09 Samsung Electronics Co., Ltd. Microphone array, method to process signals from this microphone array and speech recognition method and system using the same
US7421393B1 (en) 2004-03-01 2008-09-02 At&T Corp. System for developing a dialog manager using modular spoken-dialog components
US7200559B2 (en) 2003-05-29 2007-04-03 Microsoft Corporation Semantic object synchronous understanding implemented with speech application language tags
US20050015256A1 (en) * 2003-05-29 2005-01-20 Kargman James B. Method and apparatus for ordering food items, and in particular, pizza
US7103553B2 (en) 2003-06-04 2006-09-05 Matsushita Electric Industrial Co., Ltd. Assistive call center interface
JP2005003926A (ja) * 2003-06-11 2005-01-06 Sony Corp 情報処理装置および方法、並びにプログラム
JP2005010691A (ja) 2003-06-20 2005-01-13 P To Pa:Kk 音声認識装置、音声認識方法、会話制御装置、会話制御方法及びこれらのためのプログラム
US7454368B2 (en) 2003-06-30 2008-11-18 At&T Intellectual Property I, L.P. Method, computer readable medium, and system for assisting a customer in making purchases
KR100577387B1 (ko) * 2003-08-06 2006-05-10 삼성전자주식회사 음성 대화 시스템에서의 음성 인식 오류 처리 방법 및 장치
US20050043940A1 (en) * 2003-08-20 2005-02-24 Marvin Elder Preparing a data source for a natural language query
US7099821B2 (en) 2003-09-12 2006-08-29 Softmax, Inc. Separation of target acoustic signals in a multi-transducer arrangement
US7428497B2 (en) * 2003-10-06 2008-09-23 Utbk, Inc. Methods and apparatuses for pay-per-call advertising in mobile/wireless applications
US20070162296A1 (en) 2003-10-06 2007-07-12 Utbk, Inc. Methods and apparatuses for audio advertisements
US7454608B2 (en) 2003-10-31 2008-11-18 International Business Machines Corporation Resource configuration in multi-modal distributed computing systems
GB0325497D0 (en) 2003-10-31 2003-12-03 Vox Generation Ltd Automated speech application creation deployment and management
US20050102282A1 (en) 2003-11-07 2005-05-12 Greg Linden Method for personalized search
KR100651729B1 (ko) 2003-11-14 2006-12-06 한국전자통신연구원 홈네트워크 환경에서의 멀티-모달 상황 인식어플리케이션을 위한 시스템 및 방법
US7697673B2 (en) 2003-11-17 2010-04-13 Apptera Inc. System for advertisement selection, placement and delivery within a multiple-tenant voice interaction service system
JP2005157494A (ja) 2003-11-20 2005-06-16 Aruze Corp 会話制御装置及び会話制御方法
JP4558308B2 (ja) 2003-12-03 2010-10-06 ニュアンス コミュニケーションズ，インコーポレイテッド 音声認識システム、データ処理装置、そのデータ処理方法及びプログラム
US20050137877A1 (en) 2003-12-17 2005-06-23 General Motors Corporation Method and system for enabling a device function of a vehicle
US7027586B2 (en) 2003-12-18 2006-04-11 Sbc Knowledge Ventures, L.P. Intelligently routing customer communications
GB2409561A (en) 2003-12-23 2005-06-29 Canon Kk A method of correcting errors in a speech recognition system
US20050137850A1 (en) 2003-12-23 2005-06-23 Intel Corporation Method for automation of programmable interfaces
WO2005064592A1 (ja) * 2003-12-26 2005-07-14 Kabushikikaisha Kenwood 機器制御装置、音声認識装置、エージェント装置、車載機器制御装置、ナビゲーション装置、オーディオ装置、機器制御方法、音声認識方法、エージェント処理方法、車載機器制御方法、ナビゲーション方法、オーディオ装置制御方法及びプログラム
US7386443B1 (en) 2004-01-09 2008-06-10 At&T Corp. System and method for mobile automatic speech recognition
US7349527B2 (en) 2004-01-30 2008-03-25 Hewlett-Packard Development Company, L.P. System and method for extracting demographic information
WO2005076258A1 (ja) 2004-02-03 2005-08-18 Matsushita Electric Industrial Co., Ltd. ユーザ適応型装置およびその制御方法
US7542903B2 (en) 2004-02-18 2009-06-02 Fuji Xerox Co., Ltd. Systems and methods for determining predictive models of discourse functions
US7706616B2 (en) 2004-02-27 2010-04-27 International Business Machines Corporation System and method for recognizing word patterns in a very large vocabulary based on a virtual keyboard layout
US7412393B1 (en) 2004-03-01 2008-08-12 At&T Corp. Method for developing a dialog manager using modular spoken-dialog components
US7430510B1 (en) 2004-03-01 2008-09-30 At&T Corp. System and method of using modular spoken-dialog components
US20050216254A1 (en) 2004-03-24 2005-09-29 Gupta Anurag K System-resource-based multi-modal input fusion
US7289904B2 (en) 2004-04-06 2007-10-30 Honda Motor Co., Ltd. Vehicle navigation system and methods for incorporating user preferences into same
US20050246174A1 (en) 2004-04-28 2005-11-03 Degolia Richard C Method and system for presenting dynamic commercial content to clients interacting with a voice extensible markup language system
US20060041926A1 (en) 2004-04-30 2006-02-23 Vulcan Inc. Voice control of multimedia content
US20050283752A1 (en) 2004-05-17 2005-12-22 Renate Fruchter DiVAS-a cross-media system for ubiquitous gesture-discourse-sketch knowledge capture and reuse
US20090018829A1 (en) 2004-06-08 2009-01-15 Metaphor Solutions, Inc. Speech Recognition Dialog Management
US20060206310A1 (en) 2004-06-29 2006-09-14 Damaka, Inc. System and method for natural language processing in a peer-to-peer hybrid communications network
US8528078B2 (en) 2004-07-15 2013-09-03 Anakam, Inc. System and method for blocking unauthorized network log in using stolen password
DE102004037858A1 (de) 2004-08-04 2006-03-16 Harman Becker Automotive Systems Gmbh Navigationssystem mit sprachgesteuerter Angabe von Sonderzielen
US9129312B1 (en) 2004-08-25 2015-09-08 Amazon Technologies, Inc. Bidding on pending, query term-based advertising opportunities
US20060046740A1 (en) 2004-09-01 2006-03-02 Johnson Karen L Technique for providing location-based information concerning products and services through an information assistance service
US7480618B2 (en) 2004-09-02 2009-01-20 Microsoft Corporation Eliminating interference of noisy modality in a multimodal application
FR2875919A1 (fr) * 2004-09-27 2006-03-31 France Telecom Agent rationnel dialoguant, systeme de dialogue intelligent l'utilisant, procede de pilotage d'un dialogue intelligent, et programme pour sa mise en oeuvre
US7716056B2 (en) 2004-09-27 2010-05-11 Robert Bosch Corporation Method and system for interactive conversational dialogue for cognitively overloaded device users
US20060074660A1 (en) 2004-09-29 2006-04-06 France Telecom Method and apparatus for enhancing speech recognition accuracy by using geographic data to filter a set of words
JP4478939B2 (ja) 2004-09-30 2010-06-09 株式会社国際電気通信基礎技術研究所 音声処理装置およびそのためのコンピュータプログラム
US7925506B2 (en) 2004-10-05 2011-04-12 Inago Corporation Speech recognition accuracy via concept to keyword mapping
WO2006040971A1 (ja) 2004-10-08 2006-04-20 Matsushita Electric Industrial Co., Ltd. 対話支援装置
US20060106769A1 (en) 2004-11-12 2006-05-18 Gibbs Kevin A Method and system for autocompletion for languages having ideographs and phonetic characters
US20060253281A1 (en) 2004-11-24 2006-11-09 Alan Letzt Healthcare communications and documentation system
US7376645B2 (en) 2004-11-29 2008-05-20 The Intellection Group, Inc. Multimodal natural language query system and architecture for processing voice and proximity-based queries
US7590635B2 (en) 2004-12-15 2009-09-15 Applied Minds, Inc. Distributed data store with an orderstamp to ensure progress
US20070214182A1 (en) 2005-01-15 2007-09-13 Outland Research, Llc Establishment-based media and messaging service
US7826605B1 (en) 2005-01-20 2010-11-02 Andre Denis Vanier Method and system for integrating information from wireless and landline telephone systems
US7873654B2 (en) 2005-01-24 2011-01-18 The Intellection Group, Inc. Multimodal natural language query system for processing and analyzing voice and proximity-based queries
US7437297B2 (en) 2005-01-27 2008-10-14 International Business Machines Corporation Systems and methods for predicting consequences of misinterpretation of user commands in automated systems
US7606708B2 (en) 2005-02-01 2009-10-20 Samsung Electronics Co., Ltd. Apparatus, method, and medium for generating grammar network for use in speech recognition and dialogue speech recognition
US7831433B1 (en) 2005-02-03 2010-11-09 Hrl Laboratories, Llc System and method for using context in navigation dialog
US7609669B2 (en) 2005-02-14 2009-10-27 Vocollect, Inc. Voice directed system and method configured for assured messaging to multiple recipients
US7461059B2 (en) 2005-02-23 2008-12-02 Microsoft Corporation Dynamically updated search results based upon continuously-evolving search query that is based at least in part upon phrase suggestion, search engine uses previous result sets performing additional search tasks
DK1866610T3 (da) * 2005-02-23 2012-12-10 Micro Motion Inc Gennemstrømningsmåler med en indgang og flere udgange
WO2006096873A1 (en) 2005-03-09 2006-09-14 Medio Systems, Inc. Method and system of bidding for advertisement placement on computing devices
US7283829B2 (en) 2005-03-25 2007-10-16 Cisco Technology, Inc. Management of call requests in multi-modal communication environments
US20060236343A1 (en) 2005-04-14 2006-10-19 Sbc Knowledge Ventures, Lp System and method of locating and providing video content via an IPTV network
US7668716B2 (en) 2005-05-05 2010-02-23 Dictaphone Corporation Incorporation of external knowledge in multimodal dialog systems
US7565239B2 (en) 2005-05-06 2009-07-21 Alpine Electronics, Inc. Method and apparatus for navigation system for searching selected type of information along route to destination
US8024186B1 (en) 2005-05-24 2011-09-20 Mobitv, Inc. System and method for location based interaction with a device
US7813485B2 (en) 2005-05-26 2010-10-12 International Business Machines Corporation System and method for seamlessly integrating an interactive visual menu with an voice menu provided in an interactive voice response system
US7917365B2 (en) 2005-06-16 2011-03-29 Nuance Communications, Inc. Synchronizing visual and speech events in a multimodal application
US7672931B2 (en) 2005-06-30 2010-03-02 Microsoft Corporation Searching for content using voice search queries
US7873523B2 (en) * 2005-06-30 2011-01-18 Microsoft Corporation Computer implemented method of analyzing recognition results between a user and an interactive application utilizing inferred values instead of transcribed speech
US8180037B1 (en) 2005-06-30 2012-05-15 Sprint Spectrum L.P. Automated registration for mobile device reminders
JP2007011928A (ja) 2005-07-04 2007-01-18 Sony Corp コンテンツ提供システム、コンテンツ提供装置、コンテンツ配信サーバ、コンテンツ受信端末およびコンテンツ提供方法
WO2007008798A2 (en) 2005-07-07 2007-01-18 V-Enable, Inc. System and method for searching for network-based content in a multi-modal system using spoken keywords
US20070011012A1 (en) * 2005-07-11 2007-01-11 Steve Yurick Method, system, and apparatus for facilitating captioning of multi-media content
US7424431B2 (en) 2005-07-11 2008-09-09 Stragent, Llc System, method and computer program product for adding voice activation and voice control to a media player
US7548859B2 (en) * 2005-08-03 2009-06-16 Motorola, Inc. Method and system for assisting users in interacting with multi-modal dialog systems
US7640160B2 (en) 2005-08-05 2009-12-29 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
US20070106499A1 (en) 2005-08-09 2007-05-10 Kathleen Dahlgren Natural language search system
US7620549B2 (en) 2005-08-10 2009-11-17 Voicebox Technologies, Inc. System and method of supporting adaptive misrecognition in conversational speech
US20070043569A1 (en) 2005-08-19 2007-02-22 Intervoice Limited Partnership System and method for inheritance of advertised functionality in a user interactive system
US8027684B2 (en) 2005-08-22 2011-09-27 Infosys Technologies, Ltd. System for performing a task in a communication network and methods thereof
US20070050279A1 (en) 2005-08-26 2007-03-01 Palo Alto Research Center Incorporated Reverse bidding for trip services
US7949529B2 (en) * 2005-08-29 2011-05-24 Voicebox Technologies, Inc. Mobile systems and methods of supporting natural language human-machine interactions
US7634409B2 (en) * 2005-08-31 2009-12-15 Voicebox Technologies, Inc. Dynamic speech sharpening
EP1919771A4 (en) 2005-08-31 2010-06-09 Intuview Itd EXPERT DECISION SUPPORT SYSTEM AND REAL-TIME METHODS OF OPERATING DOCUMENTS IN LANGUAGES OTHER THAN ENGLISH
US8805339B2 (en) 2005-09-14 2014-08-12 Millennial Media, Inc. Categorization of a mobile user profile based on browse and viewing behavior
US20070060114A1 (en) 2005-09-14 2007-03-15 Jorey Ramer Predictive text completion for a mobile communication facility
US8503995B2 (en) 2005-09-14 2013-08-06 Jumptap, Inc. Mobile dynamic advertisement creation and placement
US9009046B1 (en) 2005-09-27 2015-04-14 At&T Intellectual Property Ii, L.P. System and method for disambiguating multiple intents in a natural language dialog system
US7672852B2 (en) * 2005-09-29 2010-03-02 Microsoft Corporation Localization of prompts
US20070078708A1 (en) 2005-09-30 2007-04-05 Hua Yu Using speech recognition to determine advertisements relevant to audio content and/or audio content relevant to advertisements
US8626588B2 (en) 2005-09-30 2014-01-07 Google Inc. Advertising with audio content
US20070078814A1 (en) 2005-10-04 2007-04-05 Kozoru, Inc. Novel information retrieval systems and methods
US20070185859A1 (en) 2005-10-12 2007-08-09 John Flowers Novel systems and methods for performing contextual information retrieval
US20070192309A1 (en) 2005-10-12 2007-08-16 Gordon Fischer Method and system for identifying sentence boundaries
JP4849662B2 (ja) 2005-10-21 2012-01-11 株式会社ユニバーサルエンターテインメント 会話制御装置
WO2007109541A2 (en) 2006-03-16 2007-09-27 Brubaker Curtis M System and method for obtaining revenue through the display of hyper-relevant advertising on moving objects
US7747612B2 (en) 2005-10-31 2010-06-29 Yahoo! Inc. Indication of exclusive items in a result set
US7477909B2 (en) 2005-10-31 2009-01-13 Nuance Communications, Inc. System and method for conducting a search using a wireless mobile device
US20070112567A1 (en) 2005-11-07 2007-05-17 Scanscout, Inc. Techiques for model optimization for statistical pattern recognition
US7587308B2 (en) 2005-11-21 2009-09-08 Hewlett-Packard Development Company, L.P. Word recognition using ontologies
US8751145B2 (en) 2005-11-30 2014-06-10 Volkswagen Of America, Inc. Method for voice recognition
US20070135101A1 (en) 2005-12-08 2007-06-14 Comverse, Ltd. Enhanced visual IVR capabilities
GB2433403B (en) * 2005-12-16 2009-06-24 Emil Ltd A text editing apparatus and method
US8325398B2 (en) 2005-12-22 2012-12-04 Canon Kabushiki Kaisha Image editing system, image management apparatus, and image editing program
US20070174258A1 (en) 2006-01-23 2007-07-26 Jones Scott A Targeted mobile device advertisements
US20070208732A1 (en) 2006-02-07 2007-09-06 Future Vistas, Inc. Telephonic information retrieval systems and methods
US20070186165A1 (en) 2006-02-07 2007-08-09 Pudding Ltd. Method And Apparatus For Electronically Providing Advertisements
US8719005B1 (en) 2006-02-10 2014-05-06 Rusty Shawn Lee Method and apparatus for using directed reasoning to respond to natural language queries
JP4131978B2 (ja) 2006-02-24 2008-08-13 本田技研工業株式会社 音声認識機器制御装置
US20070203736A1 (en) 2006-02-28 2007-08-30 Commonwealth Intellectual Property Holdings, Inc. Interactive 411 Directory Assistance
US8204751B1 (en) 2006-03-03 2012-06-19 At&T Intellectual Property Ii, L.P. Relevance recognition for a human machine dialog system contextual question answering based on a normalization of the length of the user input
EP2011017A4 (en) 2006-03-30 2010-07-07 Stanford Res Inst Int METHOD AND APPARATUS FOR ANNOTATING MULTIMEDIA STREAMS
US7941753B2 (en) 2006-03-31 2011-05-10 Aol Inc. Communicating appointment and/or mapping information among a calendar application and a navigation application
US8224695B2 (en) 2006-03-31 2012-07-17 Google Inc. Monetizing service calls through advertising
US20070276651A1 (en) 2006-05-23 2007-11-29 Motorola, Inc. Grammar adaptation through cooperative client and server based speech recognition
US7966324B2 (en) 2006-05-30 2011-06-21 Microsoft Corporation Personalizing a search results page based on search history
US7533089B2 (en) 2006-06-27 2009-05-12 International Business Machines Corporation Hybrid approach for query recommendation in conversation systems
CN101489469B (zh) 2006-07-10 2012-12-12 埃森哲环球服务有限公司 用于提供反馈的移动个人服务平台
WO2008011432A2 (en) 2006-07-17 2008-01-24 Abraham Vasant System and method for coordinating customized mobility services through a network
US7620551B2 (en) 2006-07-20 2009-11-17 Mspot, Inc. Method and apparatus for providing search capability and targeted advertising for audio, image, and video content over the internet
US8799073B2 (en) 2006-08-15 2014-08-05 Microsoft Corporation Computing system for monetizing calendar applications
JP4181590B2 (ja) * 2006-08-30 2008-11-19 株式会社東芝 インタフェース装置及びインタフェース処理方法
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8145493B2 (en) * 2006-09-11 2012-03-27 Nuance Communications, Inc. Establishing a preferred mode of interaction between a user and a multimodal application
US8086463B2 (en) * 2006-09-12 2011-12-27 Nuance Communications, Inc. Dynamically generating a vocal help prompt in a multimodal application
US7957976B2 (en) 2006-09-12 2011-06-07 Nuance Communications, Inc. Establishing a multimodal advertising personality for a sponsor of a multimodal application
WO2008032329A2 (en) * 2006-09-13 2008-03-20 Alon Atsmon Providing content responsive to multimedia signals
US7849041B2 (en) 2006-09-18 2010-12-07 Microsoft Corporation Intent prediction and response employing sensing, networking, and communication among distributed devices
US7788084B2 (en) 2006-09-19 2010-08-31 Xerox Corporation Labeling of work of art titles in text for natural language processing
US8073681B2 (en) 2006-10-16 2011-12-06 Voicebox Technologies, Inc. System and method for a cooperative conversational voice user interface
WO2008057268A2 (en) 2006-10-26 2008-05-15 Mobile Content Networks, Inc. Techniques for determining relevant advertisements in response to queries
US8880402B2 (en) 2006-10-28 2014-11-04 General Motors Llc Automatically adapting user guidance in automated speech recognition
US8924197B2 (en) 2006-10-31 2014-12-30 Semantifi, Inc. System and method for converting a natural language query into a logical query
US7805740B2 (en) 2006-11-10 2010-09-28 Audiogate Technologies Ltd. System and method for providing advertisement based on speech recognition
US8055502B2 (en) 2006-11-28 2011-11-08 General Motors Llc Voice dialing using a rejection reference
JP4833043B2 (ja) * 2006-11-30 2011-12-07 ヤフー株式会社 ブログ又はクエリ・クリックを利用したアフィニティ装置
US7640272B2 (en) 2006-12-07 2009-12-29 Microsoft Corporation Using automated content analysis for audio/video content consumption
TWI342010B (en) 2006-12-13 2011-05-11 Delta Electronics Inc Speech recognition method and system with intelligent classification and adjustment
US7630978B2 (en) 2006-12-14 2009-12-08 Yahoo! Inc. Query rewriting with spell correction suggestions using a generated set of query features
US20080154604A1 (en) 2006-12-22 2008-06-26 Nokia Corporation System and method for providing context-based dynamic speech grammar generation for use in search applications
JP2008170820A (ja) * 2007-01-12 2008-07-24 Takeshi Moriyama コンテンツ提供システム及び方法
US8078502B2 (en) 2007-02-01 2011-12-13 International Business Machines Corporation Populating an E-commerce shopping cart and other E-commerce fields based upon content extracted from natural language input
US7818176B2 (en) 2007-02-06 2010-10-19 Voicebox Technologies, Inc. System and method for selecting and presenting advertisements based on natural language processing of voice-based input
US8788258B1 (en) 2007-03-15 2014-07-22 At&T Intellectual Property Ii, L.P. Machine translation using global lexical selection and sentence reconstruction
US8219406B2 (en) * 2007-03-15 2012-07-10 Microsoft Corporation Speech-centric multimodal user interface design in mobile technology
US8909532B2 (en) 2007-03-23 2014-12-09 Nuance Communications, Inc. Supporting multi-lingual user interaction with a multimodal application
CN101669090A (zh) 2007-04-26 2010-03-10 福特全球技术公司 情绪提示系统和方法
US8396713B2 (en) 2007-04-30 2013-03-12 Nuance Communications, Inc. Method and system for using a statistical language model and an action classifier in parallel with grammar for better handling of out-of-grammar utterances
US8032383B1 (en) 2007-05-04 2011-10-04 Foneweb, Inc. Speech controlled services and devices using internet
US20080294994A1 (en) 2007-05-18 2008-11-27 Justin David Kruger Event management system and method with calendar interface
EP2003572B1 (en) 2007-05-22 2010-08-04 Honda Motor Co., Ltd. Language understanding device
US8060367B2 (en) 2007-06-26 2011-11-15 Targus Information Corporation Spatially indexed grammar and methods of use
US20090006194A1 (en) 2007-06-27 2009-01-01 Microsoft Corporation Location, destination and other contextual information-based mobile advertisements
US8219399B2 (en) * 2007-07-11 2012-07-10 Garmin Switzerland Gmbh Automated speech recognition (ASR) tiling
US20090024476A1 (en) 2007-07-18 2009-01-22 Idelix Software Inc. Method and system for enhanced geographically-based and time-based online advertising
US8639509B2 (en) 2007-07-27 2014-01-28 Robert Bosch Gmbh Method and system for computing or determining confidence scores for parse trees at all levels
US8024188B2 (en) 2007-08-24 2011-09-20 Robert Bosch Gmbh Method and system of optimal selection strategy for statistical classifications
US20090070109A1 (en) 2007-09-12 2009-03-12 Microsoft Corporation Speech-to-Text Transcription for Personal Communication Devices
DE102007044792B4 (de) 2007-09-19 2012-12-13 Siemens Ag Verfahren, Steuergerät und System zur Steuerung oder Bedienung
US8868479B2 (en) 2007-09-28 2014-10-21 Telogis, Inc. Natural language parsers to normalize addresses for geocoding
JP2009104450A (ja) * 2007-10-24 2009-05-14 Nagoya Institute Of Technology Ｗｅｂチャットの観測に基づく商品推薦システム
DE102008051757A1 (de) * 2007-11-12 2009-05-14 Volkswagen Ag Multimodale Benutzerschnittstelle eines Fahrerassistenzsystems zur Eingabe und Präsentation von Informationen
US8140335B2 (en) 2007-12-11 2012-03-20 Voicebox Technologies, Inc. System and method for providing a natural language voice user interface in an integrated voice navigation services environment
US8423362B2 (en) * 2007-12-21 2013-04-16 General Motors Llc In-vehicle circumstantial speech recognition
US20090171908A1 (en) 2008-01-02 2009-07-02 Michael Patrick Nash Natural language minimally explicit grammar pattern
US20090197582A1 (en) 2008-02-01 2009-08-06 Lewis Robert C Platform for mobile advertising and microtargeting of promotions
WO2009102885A1 (en) 2008-02-12 2009-08-20 Phone Through, Inc. Systems and methods for enabling interactivity among a plurality of devices
US8077975B2 (en) * 2008-02-26 2011-12-13 Microsoft Corporation Handwriting symbol recognition accuracy using speech input
US8255224B2 (en) * 2008-03-07 2012-08-28 Google Inc. Voice recognition grammar selection based on context
US20090248565A1 (en) 2008-03-25 2009-10-01 Kai Chuang Systems and Methods for Creating and Pricing Search Advertising Derivatives
US20090259646A1 (en) 2008-04-09 2009-10-15 Yahoo!, Inc. Method for Calculating Score for Search Query
US20090259561A1 (en) 2008-04-15 2009-10-15 Donald Robert Martin Boys Method and System for Correlation of Product Quantities to Multiple Ship-to Addresses for a Single Online Order
US20090276700A1 (en) 2008-04-30 2009-11-05 Nokia Corporation Method, apparatus, and computer program product for determining user status indicators
US20090287626A1 (en) 2008-05-14 2009-11-19 Microsoft Corporation Multi-modal query generation
US9305548B2 (en) 2008-05-27 2016-04-05 Voicebox Technologies Corporation System and method for an integrated, multi-modal, multi-device natural language voice services environment
US8589161B2 (en) 2008-05-27 2013-11-19 Voicebox Technologies, Inc. System and method for an integrated, multi-modal, multi-device natural language voice services environment
US20090304161A1 (en) 2008-06-05 2009-12-10 Nathan Marshall Pettyjohn system and method utilizing voice search to locate a product in stores from a phone
US8171021B2 (en) 2008-06-23 2012-05-01 Google Inc. Query identification and association
US8781833B2 (en) 2008-07-17 2014-07-15 Nuance Communications, Inc. Speech recognition semantic classification training
US8909810B2 (en) 2008-08-05 2014-12-09 Isabella Products, Inc. Systems and methods for multimedia content sharing
US20100064025A1 (en) 2008-09-10 2010-03-11 Nokia Corporation Method and Apparatus for Providing Media Service
US8224652B2 (en) 2008-09-26 2012-07-17 Microsoft Corporation Speech and text driven HMM-based body animation synthesis
US20100094707A1 (en) * 2008-10-10 2010-04-15 Carl Johan Freer Method and platform for voice and location-based services for mobile advertising
US20100138300A1 (en) 2008-12-02 2010-06-03 At&T Intellectual Property I, L.P. Method and apparatus for promoting products or services
US8260938B2 (en) 2009-01-23 2012-09-04 Google Inc. Predicting user requests to reduce network connection latency
US8326637B2 (en) 2009-02-20 2012-12-04 Voicebox Technologies, Inc. System and method for processing multi-modal device interactions in a natural language voice services environment
JP4977163B2 (ja) 2009-03-30 2012-07-18 株式会社東芝 有限状態トランスデューサ決定化装置及び有限状態トランスデューサ決定化方法
US8543401B2 (en) 2009-04-17 2013-09-24 Synchronoss Technologies System and method for improving performance of semantic classifiers in spoken dialog systems
US8326599B2 (en) 2009-04-21 2012-12-04 Xerox Corporation Bi-phrase filtering for statistical machine translation
US20130254314A1 (en) 2009-06-09 2013-09-26 Edmond K. Chow Digital content delivery
US9858925B2 (en) 2009-06-05 2018-01-02 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US10540976B2 (en) 2009-06-05 2020-01-21 Apple Inc. Contextual voice commands
US8979538B2 (en) 2009-06-26 2015-03-17 Microsoft Technology Licensing, Llc Using game play elements to motivate learning
US9171541B2 (en) 2009-11-10 2015-10-27 Voicebox Technologies Corporation System and method for hybrid processing in a natural language voice services environment
WO2011059997A1 (en) 2009-11-10 2011-05-19 Voicebox Technologies, Inc. System and method for providing a natural language content dedication service
US8712759B2 (en) 2009-11-13 2014-04-29 Clausal Computing Oy Specializing disambiguation of a natural language expression
US8612206B2 (en) 2009-12-08 2013-12-17 Microsoft Corporation Transliterating semitic languages including diacritics
US8676565B2 (en) 2010-03-26 2014-03-18 Virtuoz Sa Semantic clustering and conversational agents
US8612205B2 (en) 2010-06-14 2013-12-17 Xerox Corporation Word alignment method and system for improved vocabulary coverage in statistical machine translation
US8543374B2 (en) 2010-08-12 2013-09-24 Xerox Corporation Translation system combining hierarchical and phrase-based models
US9292149B2 (en) 2010-10-22 2016-03-22 Litl Llc Method and apparatus for public computing
GB2486002A (en) 2010-11-30 2012-06-06 Youview Tv Ltd Media Content Provision
US8645208B2 (en) 2010-12-14 2014-02-04 Yellowpages.Com Llc Systems and methods for providing automatic reminders for saved advertisements
US8849791B1 (en) 2011-06-29 2014-09-30 Amazon Technologies, Inc. Assisted shopping
US20130006734A1 (en) 2011-06-30 2013-01-03 Matthew Adam Ocko Automated bidding platform for digital incentives
WO2013006215A1 (en) 2011-07-01 2013-01-10 Nec Corporation Method and apparatus of confidence measure calculation
US10546306B2 (en) 2011-09-07 2020-01-28 Elwha Llc Computational systems and methods for regulating information flow during interactions
US8762156B2 (en) 2011-09-28 2014-06-24 Apple Inc. Speech recognition repair using contextual information
US8340975B1 (en) 2011-10-04 2012-12-25 Theodore Alfred Rosenberger Interactive speech recognition device and system for hands-free building control
US9443514B1 (en) 2012-02-08 2016-09-13 Google Inc. Dynamic voice response control based on a weighted pace of spoken terms
US8346563B1 (en) 2012-04-10 2013-01-01 Artificial Solutions Ltd. System and methods for delivering advanced natural language interaction applications
EP2839391A4 (en) 2012-04-20 2016-01-27 Maluuba Inc CONVERSATION AGENT
WO2013170383A1 (en) 2012-05-16 2013-11-21 Xtreme Interactions Inc. System, device and method for processing interlaced multimodal user input
US20130311260A1 (en) 2012-05-17 2013-11-21 Luvocracy Inc. Reward Structures
US8892575B2 (en) 2012-06-06 2014-11-18 Sap Se Dictionary entry name generator
KR20140011073A (ko) 2012-07-17 2014-01-28 삼성전자주식회사 텍스트 추천 방법 및 장치
US8577671B1 (en) 2012-07-20 2013-11-05 Veveo, Inc. Method of and system for using conversation state information in a conversational interaction system
US9798799B2 (en) 2012-11-15 2017-10-24 Sri International Vehicle personal assistant that interprets spoken natural language input based upon vehicle context
US8972243B1 (en) 2012-11-20 2015-03-03 Amazon Technologies, Inc. Parse information encoding in a finite state transducer
US9070367B1 (en) 2012-11-26 2015-06-30 Amazon Technologies, Inc. Local speech recognition of frequent utterances
US9070366B1 (en) 2012-12-19 2015-06-30 Amazon Technologies, Inc. Architecture for multi-domain utterance processing
US10235358B2 (en) 2013-02-21 2019-03-19 Microsoft Technology Licensing, Llc Exploiting structured content for unsupervised natural language semantic parsing
US9308446B1 (en) 2013-03-07 2016-04-12 Posit Science Corporation Neuroplasticity games for social cognition disorders
US9542947B2 (en) 2013-03-12 2017-01-10 Google Technology Holdings LLC Method and apparatus including parallell processes for voice recognition
WO2014144949A2 (en) 2013-03-15 2014-09-18 Apple Inc. Training an at least partial voice command system
US9430465B2 (en) 2013-05-13 2016-08-30 Facebook, Inc. Hybrid, offline/online speech translation system
US10372815B2 (en) 2013-07-12 2019-08-06 Microsoft Technology Licensing, Llc Interactive concept editing in computer-human interactive learning
US20150193379A1 (en) 2014-01-06 2015-07-09 Apple Inc. System and method for cognizant time-based reminders
US9037455B1 (en) 2014-01-08 2015-05-19 Google Inc. Limiting notification interruptions
US20150199339A1 (en) 2014-01-14 2015-07-16 Xerox Corporation Semantic refining of cross-lingual information retrieval results
US9519686B2 (en) 2014-04-09 2016-12-13 International Business Machines Corporation Confidence ranking of answers based on temporal semantics
EP3149728B1 (en) 2014-05-30 2019-01-16 Apple Inc. Multi-command single utterance input method
US9898459B2 (en) 2014-09-16 2018-02-20 Voicebox Technologies Corporation Integration of domain information into state transitions of a finite state transducer for natural language processing
EP3195145A4 (en) 2014-09-16 2018-01-24 VoiceBox Technologies Corporation Voice commerce
US20160078491A1 (en) 2014-09-16 2016-03-17 Voicebox Technologies Corporation System and method of marketing of reminders
US20160078773A1 (en) 2014-09-17 2016-03-17 Voicebox Technologies Corporation System and method of providing task-based solicitation of request related user inputs
CN107003999B (zh) 2014-10-15 2020-08-21 声钰科技 对用户的在先自然语言输入的后续响应的系统和方法
US10431214B2 (en) 2014-11-26 2019-10-01 Voicebox Technologies Corporation System and method of determining a domain and/or an action related to a natural language input
US10614799B2 (en) 2014-11-26 2020-04-07 Voicebox Technologies Corporation System and method of providing intent predictions for an utterance prior to a system detection of an end of the utterance
US20160188292A1 (en) 2014-12-30 2016-06-30 Voicebox Technologies Corporation System and method for interpreting natural language inputs based on storage of the inputs

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7036128B1 (en) * 1999-01-05 2006-04-25 Sri International Offices Using a community of distributed electronic agents to support a highly mobile, ambient computing environment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Multimodal Maps: An Agent-Based Approach;Adam Cheyer and Luc Julia;《Multimodal Human-Computer Communication Lecture Notes in Computer Science》;19981231;第1374卷;第115页 *

Also Published As

Publication number Publication date
US8738380B2 (en) 2014-05-27
US10553213B2 (en) 2020-02-04
JP2017037658A (ja) 2017-02-16
US20100217604A1 (en) 2010-08-26
US9953649B2 (en) 2018-04-24
US20130304473A1 (en) 2013-11-14
EP2399255A1 (en) 2011-12-28
US20130054228A1 (en) 2013-02-28
US9105266B2 (en) 2015-08-11
JP2015122084A (ja) 2015-07-02
US20140249822A1 (en) 2014-09-04
US9570070B2 (en) 2017-02-14
US8719009B2 (en) 2014-05-06
US8326637B2 (en) 2012-12-04
EP2399255B1 (en) 2020-07-08
US20180308479A1 (en) 2018-10-25
CN102439659A (zh) 2012-05-02
US20170221482A1 (en) 2017-08-03
EP2399255A4 (en) 2016-12-07
JP2012518847A (ja) 2012-08-16
US20150348544A1 (en) 2015-12-03
WO2010096752A1 (en) 2010-08-26

Similar Documents

Publication Publication Date Title
CN102439659B (zh) 在自然语言语音服务环境中处理多模式装置交互的系统和方法
US11900017B2 (en) Optimizing display engagement in action automation
US11227600B2 (en) Virtual assistant identification of nearby computing devices
US9646609B2 (en) Caching apparatus for serving phonetic pronunciations
CN102792294B (zh) 自然语言语音服务环境中的混合处理的系统及方法
US9502025B2 (en) System and method for providing a natural language content dedication service
US8527274B2 (en) System and method for delivering targeted advertisements and tracking advertisement interactions in voice recognition contexts
AU2017100208B4 (en) A caching apparatus for serving phonetic pronunciations

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C41 Transfer of patent application or patent right or utility model
TR01 Transfer of patent right

Effective date of registration: 20160905

Address after: Washington, USA

Patentee after: Voicebox Technologies Inc.

Address before: Washington, USA

Patentee before: Voicebox Technologies Inc.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20181218

Address after: Washington, USA

Patentee after: Weber Assets Co., Ltd.

Address before: Washington, USA

Patentee before: Voicebox Technologies Inc.