Apex Standards Claim Construction


Patent: US11042623B2
Filed: 2014-03-10
Issued: 2021-06-22
Patent Holder: (Original Assignee) FaceToFace Biometrics Inc     (Current Assignee) FaceToFace Biometrics Inc
Inventor(s): Eric Leuthardt, Scott Stern

Title: Expression recognition in messaging systems

Abstract: Some embodiments include a messaging system capable of expression-based communication and/or expression-based actions. The messaging system can run on a computing device. For example, the messaging system monitors a camera feed from a camera of the computing device to detect a biometric signature when a messaging interface of the messaging application is actively being used. The messaging system can match the detected biometric signature against a known profile utilizing a facial recognition process to authenticate an operating user to use the messaging application. The messaging system can determine a human expression based on the detected biometric signature utilizing an expression recognition process to associate a contextual tag with an activity on the messaging interface. The messaging system can then communicate with a message server system to associate the contextual tag with content presented to the operating user or a conversation participated by the operating user via the messaging application.

The First Claim: 1. A computer device comprising at least one processor in communication with at least one memory device, wherein the at least one processor is programmed to: receive a selection of an emoticon; monitor a sensor feed provided by one or more sensors of the computer device to detect a plurality of human facial expression states; automatically generate a dynamic emoticon that simulates the detected plurality of human facial expression states on the selected emoticon based on the sensor feed of the plurality of human facial expression states; and route a message with the dynamic emoticon to a second computer device.


Disclaimer: The promise of Apex Standards Claim Construction (CC) is that it will conduct the Broadest Reasonable, Ordinary, or Customary Interpretation for the claim elements of a target patent or the technical specification languages of an industrial standard. Therefore, a top-down, apriori evaluation is enabled, allowing stakeholders to swiftly and effectively analyze the relevance and scope of terms and phrases under consideration prior to making complex, high-value judgments. CC is intended to alleviate the initial burden of evidence by providing an exhaustive list of contextual semantic understandings that can be used as building blocks in the development of a prosecution-ready, licensing-ready, or litigation-ready work product. Stakeholders can then utilize the CC to revise the original claim or technical languages, as well as to find more relevant arts in order to build strategy and accomplish additional goals.

Reference	Claim Element / Subject Matter	Feature	Meaning	Claim Construction & Interpretation
[1]	1 . A computer device [1]	computer device [1]	[Meaning 1] system [Meaning 2] device [Meaning 3] computer [Meaning 4] server [Meaning 5] method [Meaning 6] computing device [Meaning 7] computer device for messaging [Meaning 8] device for generating em [Meaning 9] computing device comprising hardware [Meaning 10] system comprising an electronic device [Meaning 11] system for generating dynamic em [Meaning 12] method implemented by an electronic device [Meaning 13] method comprising the steps of providing computer device	[Interpretation 1] system for generating dynamic em icons for human facial expressions on an em icon selected by an electronic device and [Interpretation 2] method for generating an em social interface for sim sim human facial expression states on an em
[2]	comprising (comprising an interface and, that generates dynamic em, configured to operate with, for messaging comprising of, comprising an electronic device having, having an electronic display and, with enhanced messaging capabilities comprising) at least one processor [2]	processor [2]	[Meaning 1] microprocessor [Meaning 2] processors [Meaning 3] hardware processor [Meaning 4] processor device [Meaning 5] computer processor [Meaning 6] processor that is [Meaning 7] program code processor [Meaning 8] processor coupled to and [Meaning 9] processor configured to execute instructions [Meaning 10] memory device and one processor [Meaning 11] program processor configured to be [Meaning 12] sensor and at least one processor [Meaning 13] of one or more processors disposed [Meaning 14] display device and at least one processor device	[Interpretation 1] processor and one or more sensors for detecting human facial expression states on an em messenger on the computer device
[3]	in communication [3]	communication [3]	[Meaning 1] communications [Meaning 2] connection [Meaning 3] association [Meaning 4] electronic communication [Meaning 5] operable communication [Meaning 6] wired or wireless communication [Meaning 7] communication with and in communication [Meaning 8] electronic communication with and associated [Meaning 9] communication with one or more interfaces [Meaning 10] one or more integrated circuits coupled [Meaning 11] at least one electronic circuit coupled [Meaning 12] communication with at least one communication interface and [Meaning 13] at least one integrated circuit in electronic communication
[4]	with at least one memory device [4]	memory device [4]	[Meaning 1] memory [Meaning 2] sensor [Meaning 3] transceiver [Meaning 4] storage [Meaning 5] component [Meaning 6] storage device [Meaning 7] system memory [Meaning 8] data store [Meaning 9] communication interface [Meaning 10] computer readable medium [Meaning 11] electronic storage device [Meaning 12] signal transmission device [Meaning 13] memory and storage [Meaning 14] storage device storing instructions	[Interpretation 1] storage device and at least one input device for receiving user input to select one or more em messenger elements [Interpretation 2] input device and at least one display device to display at least one em
[5]	, wherein the at least one processor [2] is programmed (configured to execute instructions, at least partially configured, programmed by executable instructions, programmed by the memory device, in communication with instructions configured, operable to cause the computer device, in communication with the memory device) to : receive (receive an indication of, obtain user input indicating, process an input indicating, provide an interface for, detect from the user, receive from an input device, monitor an input to detect) a selection [5]	selection [5]	[Meaning 1] choice [Meaning 2] select [Meaning 3] request [Meaning 4] user selection [Meaning 5] first selection [Meaning 6] manual selection [Meaning 7] dynamic selection [Meaning 8] selection input [Meaning 9] command for selection [Meaning 10] request for selection [Meaning 11] message requesting selection [Meaning 12] selection of characteristics [Meaning 13] selection from the user [Meaning 14] selection of an em	[Interpretation 1] selected em aromatic character from an im user interface of the computer device that is configured to receive an im message and to receive user selection [Interpretation 2] user input from the user interface of the computer device to select an em messenger on one or more icons [Interpretation 3] message from an application program executing on the computer device and generate an em
[6]	of an emoticon [6]	emoticon [6]	[Meaning 1] icon [Meaning 2] avatar [Meaning 3] animation [Meaning 4] image [Meaning 5] expression [Meaning 6] selected em [Meaning 7] instant message [Meaning 8] animated object [Meaning 9] electronic message [Meaning 10] im icon [Meaning 11] el em [Meaning 12] em messenger object [Meaning 13] electronic user interface [Meaning 14] original original em
[7]	; monitor (perform an analysis of, receive an indication of, analyze the selected em, monitor the selected em, at least partially analyze, monitor for changes in, receive from the em) a sensor feed [7]	sensor feed [7]	[Meaning 1] feed [Meaning 2] signal [Meaning 3] feedback [Meaning 4] sensor [Meaning 5] data [Meaning 6] data feed [Meaning 7] sensory feed [Meaning 8] user input [Meaning 9] sensing feed [Meaning 10] plurality of signals [Meaning 11] stream of data [Meaning 12] continuous sensor feed [Meaning 13] human sensor feed [Meaning 14] sensor feed continuously	[Interpretation 1] user interface of the computer device to detect an input from the user interface that triggers analysis of sensor data [Interpretation 2] computer device to detect one or more human facial expression states on the em
[8]	provided (comprising sensor data generated, of facial expressions captured, that includes data collected, from the computer device, from the selected em, comprising one or more signals generated, of the plurality of facial expressions generated) by one or more sensors [8]	sensors [8]	[Meaning 1] cameras [Meaning 2] components [Meaning 3] processors [Meaning 4] devices [Meaning 5] external sensors [Meaning 6] input devices [Meaning 7] sensor devices [Meaning 8] camera sensors [Meaning 9] sensors outside [Meaning 10] facial expression sensors [Meaning 11] image capture devices [Meaning 12] human facial sensors [Meaning 13] sensors in proximity [Meaning 14] sensors in the vicinity	[Interpretation 1] cameras of the computer device to detect one or more human facial expression states based on the selected em
[9]	of the computer device [1] to detect (obtain sensor feed of, generate sensor feed of, detect the selected em messenger, determine whether the sensor feed includes, detect from the monitored sensor feed, obtain from the sensor feed information about, identify the selected em messenger and detect) a plurality of human facial expression states [9]	expression states [9]	[Meaning 1] expressions [Meaning 2] states [Meaning 3] appearances [Meaning 4] poses [Meaning 5] expressions states [Meaning 6] emotion states [Meaning 7] expressions in different states [Meaning 8] state of the computer device [Meaning 9] expression states that are associated with the em [Meaning 10] emotion states associated with the selected em icon	[Interpretation 1] expressions states that are in the same or similar emotional state as the selected em
[10]	; automatically generate (select the selected em, generate on the em, determine whether to overlay, and dynamically pop up, generate and automatically display, overlay on the selection, overlay at least part of) a dynamic emoticon [6] that simulates (reflects the effect of, includes an overlay of, displays an indication of, is configured to overlay, highlights the appearance of, displays at least one of, superimpose at least one of) the detected (sensor feed of the, visual effect of the, dynamic effect of the, human expression of the, user to perform the, effect of each of the, appearance of each of the) plurality of human facial expression states [9] on the selected (visual appearance of the, selected portion of the, basis of the selected, selection of the dynamic, computer device with the selected, computer device by dynamically modifying the, screen and automatically update the dynamic) emoticon [6] based on the sensor feed [7] of the plurality of human facial expression states [9] ; and route a message [10]	message [10]	[Meaning 1] communication [Meaning 2] signal [Meaning 3] request [Meaning 4] transmission [Meaning 5] message associated [Meaning 6] communication associated [Meaning 7] signal associated [Meaning 8] request associated [Meaning 9] data stream associated [Meaning 10] user input associated [Meaning 11] user input in accordance [Meaning 12] communication from the computer device [Meaning 13] plurality of data packets associated [Meaning 14] stream of video data associated
[11]	with the dynamic emoticon [6] to a second computer device [1] .