[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

US20070094330A1 - Animated messaging - Google Patents

Animated messaging Download PDF

Info

Publication number
US20070094330A1
US20070094330A1 US10/522,809 US52280903A US2007094330A1 US 20070094330 A1 US20070094330 A1 US 20070094330A1 US 52280903 A US52280903 A US 52280903A US 2007094330 A1 US2007094330 A1 US 2007094330A1
Authority
US
United States
Prior art keywords
animated character
user
message
sender
animated
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/522,809
Inventor
Nicholas Russell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY Ltd
Original Assignee
E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY Ltd filed Critical E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY Ltd
Assigned to E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY. LTD. reassignment E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY. LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: JENKINS, JAMES, FELICH, ANTON, RUSSELL, NICHOLAS
Publication of US20070094330A1 publication Critical patent/US20070094330A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/203D [Three Dimensional] animation
    • G06T13/403D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/802D [Two Dimensional] animation, e.g. using sprites
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241Advertisements
    • G06Q30/0277Online advertisement
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10Transforming into visible information
    • G10L2021/105Synthesis of the lips movements from speech, e.g. for talking heads

Definitions

  • the present invention relates to the field of instant messaging. More specifically, the present invention relates to a solution that allows for animated instant messaging.
  • IM Instant Messaging
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • the present invention provides a solution that allows an animated interactive talking character to appear on a user's screen when conducting an Instant Messaging (IM session.
  • the character which is displayed on the user's screen may be determined by a profile for the sender of the message. This allows a user to pre-select which character will be displayed on the screen of recipients of the instant messages.
  • FIG. 1 is a block diagram illustrating a system utilizing a robot in accordance with an embodiment of the present invention.
  • FIG. 2 is a flow diagram illustrating a method for instant messaging on a computer system in accordance with an embodiment of the present invention.
  • FIG. 3 is a flow diagram illustrating a method for receiving advertising on a computer system in accordance with an embodiment of the present invention.
  • FIG. 4 is a flow diagram illustrating a method for interacting with a software robot in accordance with an embodiment of the present invention.
  • FIG. 5 is a flow diagram illustrating a method for managing an IM system in accordance with an embodiment of the present invention.
  • FIG. 6 is a flow diagram illustrating a method for serving advertising to a user of a computer system in accordance with an embodiment of the present invention.
  • FIG. 7 is a flow diagram illustrating a method for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present inventions.
  • FIG. 8 is a flow diagram illustrating a method for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention.
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • FIG. 9 is a flow diagram illustrating a method for personalizing an animated character on a computer system in accordance with an embodiment of the present invention.
  • FIG. 10 is a block diagram illustrating an apparatus for instant messaging on a computer system in accordance with an embodiment of the present invention.
  • FIG. 11 is a block diagram illustrating an apparatus for receiving advertising on a computer system in accordance with an embodiment of the present invention.
  • FIG. 12 is a block diagram illustrating an apparatus for interacting with a software robot in accordance with an embodiment of the present invention.
  • FIG. 13 is a block diagram illustrating an apparatus for managing an IM system in accordance with an embodiment of the present invention.
  • FIG. 14 is a block diagram illustrating an apparatus for serving advertising to a user of a computer system in accordance with an embodiment of the present invention.
  • FIG. 15 is a block diagram illustrating an apparatus for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present invention.
  • FIG. 16 is a block diagram illustrating an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention.
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • FIG. 17 is a block diagram illustrating an apparatus for personalizing an animated character on a computer system in accordance with an embodiment of the present invention.
  • An image receiver 1700 may receive an image from the user.
  • FIG. 18 is a block diagram illustrating a method and an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention which makes use of a dynamic array to form an instruction queue.
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • the components, process steps, and/or data structures may be implemented using various types of operating systems, computing platforms, computer programs, and/or general purpose machines.
  • devices of a less general purpose nature such as hardwired devices, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), or the like, may also be used without departing from the scope and spirit of the inventive concepts disclosed herein.
  • the present invention provides a solution that allows an animated interactive talking character to appear on a user's screen when conducting an Instant Messaging (IM) session.
  • the character which is displayed on the user's screen may be determined by a profile for the sender of the message. This allows a user to pre-select which character will be displayed on the screen of recipients of the instant messages.
  • a system that allows users to select from many different animated personalities that will represent them during an IM session. Furthermore, an embodiment of the present invention allows users to import images into the animated personality, therefore permitting them to utilize characters that may, for example, have the user's face on it, or perhaps the face of the user's favourite celebrity.
  • the animated character When the animated character is displayed on the recipient's screen, it may appear outside of the typical IM window, allowing user's to move the animated character to a convenient portion of the desktop.
  • text-to-speech software may be utilized to allow the animated character to read instant messages aloud.
  • the animated characters may be programmed such that their lips may move along with the text being read.
  • the typical “smileys” or “emoticons” may be interpreted by the character and the animation may change based on the corresponding emoticon. For example, if the sender of the IM message indicates an “angry” emoticon, the animated character may be displayed as pounding his fist against a table.
  • the user may select a character to act as their personality using an interface.
  • the interface may be a web interface, such as a web page, where the user logs in with an account name and password, such as with their IM account name and password, and selects from a number of different features. Once the user has selected a character, the selection may be transmitted to the server containing the relevant information.
  • a user's preferences may be stored in a database that may be referenced by the IM account name and a user defined password. The database may be used to hold all relevant user information and the associated character data.
  • the user may download the add-in using this interface as well.
  • the add-in may connect to the IM messaging system. It may then wait for automation events that signify that an incoming message has arrived. At this point, the add-in may contact the database to look up which personality or character the message sender has chosen.
  • the connection to the database of stored information may be indirect, as it may be retrieved through the server where a dynamically generated query to the database may be created using the incoming request. If no record is found, a default personality may be used. The personality may then be loaded onto the user's display.
  • the new details may be broadcast to all members of their contact lists so that remote copies of the add-in can updated the displayed character for the user.
  • the add-in must perform the aforementioned request for every incoming message if it wants to ensure that the character displayed is the current one.
  • the request may be performed only sporadically, loading the character data from a local cache until such time as it deems an update is necessary (perhaps once a day, for example).
  • the character may be used to graphically output, using animated and/or static images, a visual representation of the personality defined by the sender. Additionally, pre-recorded audio clips may be utilized along with text-to-speech synthesis in order to provide an audio version or representation of the message.
  • the audio portion may not be limited to merely an audio transcript of the written information. It may, for example, include sound effects. Perhaps a user wishes to have a symbol indicated anger cause a sound effect of a dog growling to be played by the recipient's computer system.
  • the add-in may parse incoming messages for a predefined list of emoticons and may match them with a predefined list of character animations or audio clips. The add-in may then request the specified animation file from the server and play it for the user.
  • the present invention allows the character to be a consistent identify across multiple messaging platforms, so a user may log-in on their computer at work, for example, and their character will be present in their messages just as it is from their home computer.
  • an auto responder function may be included to allow users to enable an automated response, such as “On vacation until May 30th” to any received messages.
  • the add-in may automatically type and submit the user-defined message back to the sender of the incoming message.
  • Each auto-responder message may be sent pre-appended with a specially formatted string that may be used to prevent auto-responders from responding to each other.
  • interactive advertising may be provided through the add-in.
  • This advertising may be maintained in a database. it may list all advertisement details. A simple interface may be provided for administrators where they can specify the details of the advertisement.
  • the add-in may request an advertisement from the database periodically, such as every 30 minutes.
  • FIG. 1 is a block diagram illustrating a system utilizing a robot in accordance with an embodiment of the present invention.
  • the robot 100 may actually be a server application that listens for incoming messages from the messenger 102 . When one of these alerts is received, it may store the message in a data structure such as an array, which is keyed against the name of the user who sent the alert. The message may then be sent to an artificial intelligence (AI) application 104 along with any previous messages from the initiating user.
  • AI artificial intelligence
  • the AI 104 may appear to be having an intelligent conversation by referring to things previously spoken about and keeping the conversation in context.
  • the message Once the message has been processed and a response formed, it may be returned to the robot 100 which may forward the response via the messenger 102 to the initiating user.
  • the web searching function may be implemented by, for example, having the first six characters of an IM message read “google”.
  • a keyword to search may be provided after the word “google” to indicate what to search.
  • the Robot may then take this word and forward it to the GoogleTM search engine, created by Google, Inc. of Mountain View, Calif. and request five results. Google may then respond with details to then be deciphered by the robot. This may then be sent back to the initiating user.
  • the sending of the results of the search need not be immediate. It may, for example, search for 24 hours and then follow up with the results.
  • the robot may also be used for other. artificial intelligence applications. It may even be proactive, that is, initiate communication with a user before the user initiates communication.
  • the add-in may display a plurality of animated characters simultaneously if multiple IM sessions are being conducted.
  • the animated characters may be placed anywhere on the display, to avoid overlap. This may also be extended to allow a “chat session” with many different animated characters representing the various senders in the chat session.
  • support may be provided for cellular phone or other “non-traditional” IM environments. SMS and MMS messaging may be provided as an option to subscribers. They may then provide their cellular phone information and set their auto-responder to “forward” mode to indicate that they wish their cell phone to receive their IM messages.
  • the add-in may then detect when a message is received and check to see if the user has set the auto-responder to forward mode. If so, then the add-in may send the message details to the server.
  • the server may then retrieve the mobile phone number.
  • the server may then format the message into SMS or MMS. If MMS is utilized, the server may send a thumbnail image representing the user of the incoming message and convert the message from plain text into an audio file.
  • the message may then be forwarded to the communications gateway, which would in turn send the message into the public telephone network to be received by the user's mobile telephone.
  • the technology of the present invention may be modified to support other messaging services such as Yahoo, ICQ, Trillian, etc.
  • API Application Programming Interface
  • an Application Programming Interface API
  • the “handles” of all conversation windows may be stored.
  • the add-in may then scan the contents of the conversation window every 100 ms or the like, and compare its contents with the contents of the previous scan. If the contents were different, it would indicate a new message has arrived and the difference would be parsed to extract the name of the sender and the contents of the message. These characters may then be presented to the character to visualize for the user.
  • the user may personalize an IM character. This allows the user to add, for example, an image of his face on the character.
  • the personalization of the animated characters may operate in the following manner.
  • a user interface may be provided within the application.
  • the user Upon entering the “Personalization” menu area, the user may be redirected to a section of the host web site. Within this area are instructions advising a user of the processes and a means for a user to link a single image file (e.g., photograph) and upload this file to the user.
  • the user may be provided with tools to crop the image, defining an area over the image that reduces the display area to capture only the external facial and head area. Once the upload of the user's image is complete, the user may submit the uploaded image for processing.
  • the images processing engine may use the area defined by the user and crop the image to that size. From this point, depending on the image processing engine deployed, the extraneous information within the image may be modified, leaving a transparent image area surrounding the facial features and head of the subject image.
  • the image may be subsequently processed (rendered) to give the appearance of it having been “extruded”, creating the appearance of a three-dimensional image.
  • the engine may use predetermined parameters to manipulate the extruded image into preconfigured positions and interpolate the movement from the base position to the new position. As a result, the image processing engine may output a series of sequential, specifically sized images that depict the rendered, extruded facial images moving from the base point to the predetermined point.
  • a further stage of processing may be performed wherein the images are introduced to a three-dimensional geometry engine.
  • the base image that contains the rendered facial features may be aligned and mapped to three-dimensional geometry representing a character. This alignment of the image occurs to that the processed image exists to cover the face of the character in three-dimensional geometry.
  • the other character attributes may be predefined in terms of body shape, surface such as clothing and colours and textures.
  • the geometry engine may then be used to render out a total sequence of animated motion, and output to a series of still, sequential images. These images may conform to the standard required by the next level of image processing. These images may be named and numbered following a strict nomenclature and in accordance with a suitable colour table that enables the next processing step to occur.
  • the sequential rendered images from the previous step may then be compiled into a single, digital file.
  • the images are compiled in such a way as to bring together individual static images into a series of animated sequences.
  • the animated sequences may then be compiled into a proprietary format.
  • the resultant compilation may deliver several files that describe its contents and deliver connectivity to the user application.
  • the completed files may be deposited on the server.
  • the server may be notified of the newly created character and include the image within the character library, assigning the image to the identity of the initial image provider.
  • the user may then be notified by email of their completed character.
  • a specific animation may be assigned to an idle “state”. There may be, for example, 3 levels of idle, levels 1 , 2 , and 3 . The first level may idle a randomly selected movement and play it on the screen. This may occur when the character has not bee used for a short period of time. If no interaction with the character continues, the agent application may begin to play animations with an assigned state of idle level 2 animations. Similarly, when the time interval of interaction with the user increases, idle 3 assigned animations may be displayed to the user, and so on.
  • the add-in may automatically download an idle animation and display it on the screen when a user has not interacted with the animated character for a predetermined period of time. It may similarly download a next level of idle if there continues to be no interaction.
  • instant messages include acronyms for typically-used phrases, such as LTR for later, and A/S/L for Age/Sex/Location.
  • a table may be utilized to store these acronyms and their corresponding definitions.
  • the add-in detects such an acronym, it may substitute the definition when delivering it to the user (via the screen or the text-to-speech synthesis).
  • the present invention may also include the opposite, speech-to-text synthesis.
  • the add-in may receive voice commands from a user through a microphone and convert the speech to text in the instant message. Certain phrases may then be used for special commands, such as sending the instant message.
  • FIG. 2 is a flow diagram illustrating a method for instant messaging on a computer system in accordance with an embodiment of the present invention.
  • an IM may be received containing content from the sender.
  • an identification of the sender of the IM may be determined from the IM.
  • a request may be sent to a server with the identification of the sender.
  • an animated character associated with the sender may be received from the server.
  • an animated character associated with the sender may be displayed. This displaying may include displaying the animated character outside of an IM window, and allowing a user to move the animated character anywhere on the screen.
  • the content may be delivered to a user through the animated character.
  • This may include converting text from the IM into audio through text-to-speech synthesis and playing the audio.
  • the delivering may further include animating the character in synchronization with the playing of the audio. Further, the delivering may include detecting an emoticon in the IM and animating the character in a way that reflects the emoticon.
  • FIG. 3 is a flow diagram illustrating a method for receiving advertising on a computer system in accordance with an embodiment of the present invention.
  • advertisement details may be periodically retrieved from a server.
  • an animated character specified to represent the advertisement may be downloaded.
  • the animated character specified to represent the advertisement may be displayed.
  • content specified for the advertisement may be delivered.
  • FIG. 4 is a flow diagram illustrating a method for interacting with a software robot in accordance with an embodiment of the present invention.
  • an alert may be sent to a server.
  • the sending of an alert may include a sending a message indicating that a web search is to be performed and sending keywords to search in the web search.
  • a response containing content may be received from the server generated by an artificial intelligence (AI) application.
  • AI artificial intelligence
  • an animated character associated with the AI application may be displayed.
  • the content may be delivered to a user through the animated character associated with the AI application. This may include delivering results of a web search if one was conducted.
  • FIG. 5 is a flow diagram illustrating a method for managing an IM system in accordance with an embodiment of the present invention.
  • a request may be received from a user for an animated character, the request including an identification of a sender of the IM message to the user.
  • a database may be queried with the identification.
  • information regarding the animated character may be received from the database. This information may include a location for an animation file representing the animated character.
  • the information regarding the animated character may be forwarded to the user.
  • FIG. 6 is a flow diagram illustrating a method for serving advertising to a user of a computer system in accordance with an embodiment of the present invention.
  • a periodic request for an advertisement may be received from a user.
  • an advertisement may be selected from an advertising database.
  • the advertisement may be served to the user.
  • FIG. 7 is a flow diagram illustrating a method for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present invention
  • an alert being sent from the user in an IM message may be detected, the IM message including content.
  • the alert and the content may be passed to an artificial intelligence application.
  • the AI application may provide interactive help, web searching, or other capabilities to the user.
  • a response from the artificial intelligence application may be received.
  • the response may be forwarded to the user.
  • FIG. 8 is a flow diagram illustrating a method for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • a message may be received from the user indicating that the user wishes for all messages to be forwarded to a device utilizing the SMS format.
  • an identification of the device may be retrieved from a database. This identification may be a cellular phone number.
  • message intended for the user may be formatted in SMS.
  • the formatted message may be forwarded to a communications gateway along with the identification.
  • FIG. 9 is a flow diagram illustrating a method for personalizing an animated character on a computer system in accordance with an embodiment of the present invention.
  • an image may be received from the user.
  • the image may be rendered as an animated character. This may include removing extraneous information from the image, modifying the image to a three-dimensional image, manipulating the image into preconfigured positions, interpolating movements from a base position to a new position for each of one or more animations for the animated character to perform, and introducing the image to a three-dimensional geometry engine.
  • the rendered image may be saved in a database.
  • FIG. 10 is a block diagram illustrating an apparatus for instant messaging on a computer system in accordance with an embodiment of the present invention.
  • An IM receiver 1000 may receive an IM containing content from the sender.
  • a sender identification determiner 1002 coupled to the IM receiver 1000 may determine an identification of the sender of the IM from the IM.
  • a server request sender 1004 coupled to the sender identification determiner 1002 may send a request to a server with the identification of the sender.
  • An animated character receiver 1006 may receive an animated character associated with the sender from the server.
  • An animated character displayer 1008 coupled to the animated character receiver 1006 and to the IM receiver 1000 may display an animated character associated with the sender.
  • This displaying may include displaying the animated character outside of an IM window using an IM window-external character displayer 1010 , and allowing a user to move the animated character anywhere on the screen using an animated character mover 1012 .
  • An animated character content deliverer 1014 coupled to the animated character displayer 1008 may deliver the content to a user through the animated character. This may include converting text from the IM into audio through text-to-speech synthesis with a text-to-speech synthesizer 1016 and playing the audio with an audio player 1018 coupled to the text-to-speech synthesizer 1016 .
  • the delivering may further include animating the character in synchronization with the playing of the audio using an animated character audio synchronizer 1020 . Further, the delivering may include detecting an emoticon in the IM using an emoticon detector 1022 and animating the character in a way that reflects the emoticon using an emoticon character animator 1024 coupled to the emoticon detector 1022 .
  • FIG. 11 is a block diagram illustrating an apparatus for receiving advertising on a computer system in accordance with an embodiment of the present invention.
  • An advertisement details periodic retriever 1100 may periodically retrieve advertisement details from a server.
  • An animated character downloader 1102 coupled to said advertisement details periodic retriever 1100 may download an animated character specified to represent the advertisement.
  • An animated character displayer 1104 coupled to the animated character downloader 1102 may display the animated character specified to represent the advertisement.
  • An animated character content deliverer 1106 coupled to the animated character displayer 1104 may deliver content specified in the dynamically created file.
  • FIG. 12 is a block diagram illustrating an apparatus for interacting with a software robot in accordance with an embodiment of the present invention.
  • a server alert sender 1200 may send an alert to a server. The sending of an alert may include a sending a message indicating that a web search is to be performed using a web search message sender 1202 and sending keywords to search in the web search using a keyword sender 1204 coupled to the web search message sender.
  • An artificial intelligence response receiver 1206 may receive a response containing content from the server generated by an artificial intelligence (AI) application.
  • An animated character displayer 1208 coupled to the artificial intelligence response receiver 1206 may display an animated character associated with the AI application.
  • An animated character content deliverer 1210 coupled to the animated character displayer 1208 may deliver the content to a user through the animated character associated with the AI application. This may include delivering results of a web search if one was conducted using a web search results deliverer 1212 .
  • FIG. 13 is a block diagram illustrating an apparatus for managing an IM system in accordance with an embodiment of the present invention.
  • An animated character request receiver 1300 may receive a request from a user for an animated character, the request including an identification of a sender of the IM message to the user.
  • a database query generator 1302 coupled to the animated character request receiver 1300 may query a database with the identification.
  • An animated character database information receiver 1304 may receive information regarding the animated character from the database. This information may include a location for an animation file representing the animated character.
  • An animated character database information forwarder 1306 coupled to the animated character database information receiver 1304 may forward the information regarding the animated character to the user.
  • FIG. 14 is a block diagram illustrating an apparatus for serving advertising to a user of a computer system in accordance with an embodiment of the present invention.
  • a periodic advertisement request receiver 1400 may receive a periodic request for an advertisement from a user.
  • An advertisement selector 1402 coupled to the periodic advertisement request receiver 1400 may select an advertisement from an advertising database.
  • An advertisement server 1404 coupled to the advertisement selector 1402 may serve the advertisement to the user.
  • FIG. 15 is a block diagram illustrating an apparatus for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present invention.
  • An alert detector 1500 may detect an alert being sent from the user in an IM message, the IM message including content.
  • An artificial intelligence alert passer 1502 coupled to the alert detector 1500 may pass the alert and the content to an artificial intelligence application.
  • the AI application may provide interactive help, web searching, or other capabilities to the user.
  • An artificial intelligence response receiver 1504 may receive a response from the artificial intelligence application.
  • An artificial intelligence response forwarder 1506 coupled to the artificial intelligence response receiver 1504 may forward the response to the user.
  • FIG. 16 is a block diagram illustrating an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MWS) format device in accordance with an embodiment of the present invention.
  • SMS or MMS forwarding message receiver 1600 may receive a message from the user indicating that the user wishes for all messages to be forwarded to a device utilizing the SMS format.
  • An SMS or MMS device identification retriever 1602 coupled to the SMS or MMS forwarding message receiver 1600 may retrieve an identification of the device from a database. This identification may be a cellular phone number.
  • An SMS or MMS message formatter 1604 may format a message intended for the user in SMS or MMS.
  • An SMS or MMS message forwarder 1606 coupled to the SMS or MMS message formatter 1604 and to the SMS or MMS device identification retriever 1602 may forward the formatted message to a communications gateway along with the identification
  • FIG. 17 is a block diagram illustrating an apparatus for personalizing an animated character on a computer system in accordance with an embodiment of the present invention.
  • An image receiver 1700 may receive an image from the user.
  • An animated character image renderer 1702 coupled to the image receiver 1700 may render the image as an animated character.
  • This may include removing extraneous information from the image using an extraneous information remover 1704 , modifing the image to a three-dimensional image using a three-dimensional image modifier 1706 coupled to the extraneous information remover 1704 , manipulating the image into preconfigured positions using a preconfigured position image manipulator 1708 coupled to the three-dimensional image modifier 1706 , interpolating movements from a base position to a new position for each of one or more animations for the animated character to perform using a movement interpolator 1710 coupled to the preconfigured position image manipulator 1708 , and introducing the image to a three-dimensional geometry engine 1712 coupled to the movement interpolator 1710 .
  • the rendered image may then be saved in a database.
  • FIG. 18 is a block diagram illustrating a method and an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention which makes use of a dynamic array to form an instruction queue.
  • SMS Short Message Service
  • MMS Multimedia Message Service
  • the biggest problem was in displaying the animated characters for each user.
  • Initial version of the invention saw just a single animated character on the desktop, which would act primarily as a friendly interface for the user.
  • One of its functions was to read out the text of incoming instant messages and prefix the audio output with the name of the sender.
  • generally relevant software is programmed asynchronously. This means that a user program would tell the animated character what it needed to do and then continue with its own processing.
  • the program would initiate and make the animated character perform whatever you had requested. Once this is completed the software then notifies the user program that it has finished and the user program can do whatever with this information it chooses. Due to this it is not possible to harbour more than an animated character at a time, and the reading out of the incoming messages might not take place in their designated order. In addition to this some computer systems can only support audio output from one user program at a time. If two animated characters needed to speak at once then only one of the characters output would be heard and the other would be blocked.
  • the second biggest problem to be overcome was how to determine an incoming message had arrived.
  • the solution we decided upon was to have the invention locate the messaging windows and scan their contents at a regular interval (say 100 ms). It would then compare the contents of the messaging window with the contents of the window previously. It was determined that if the contents were different then a new message had arrived and that the different between the two would represent this message. It was then into a process of extracting the name of the sender from this message and adding its details to the queue for processing.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Human Computer Interaction (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Signal Processing (AREA)
  • Marketing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • General Engineering & Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

A method and apparatus that allows an animated interactive talking character to appear on a user's screen when conducting an Instant Messaging (IM) session. The character which is displayed on the user's screen is determined by a profile for the sender of the message. This allows a user to pre-select which character will be displayed on the screen of recipients of the instant message.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • The present application claims priority based on Australian Provisional Application 20022950502, filed on Jul. 31, 2002, by e-Clips Intelligent Agent Technologies Pty. Ltd, entitled “Animated Messaging”. This application and its disclosure are fully incorporated in the present disclosure by reference thereto.
  • FIELD OF THE INVENTION
  • The present invention relates to the field of instant messaging. More specifically, the present invention relates to a solution that allows for animated instant messaging.
  • BACKGROUND OF THE INVENTION
  • Instant Messaging (IM) has been growing in popularity in recent years. Commonly utilized IM formats, such as Yahoo™ Messenger, created by Yahoo™ of Sunnyvale, Calif, and Net Messenger, created by Microsoft™ of Redmoneed, Wash., allow a computer user to transmit typed information or other data (such as images and videos) to other users of the IM service almost instantaneously. Additionally, many cellular phones now have text messaging services, most utilizing the Short Message Service (SMS) and Multimedia Message Service (MMS), to allow customers to send and receive text messages.
  • In both formats, it is common to utilize fixed simple diagrams that can be displayed within the space of one or two characters in order to quickly convey common pieces of information. Most commonly, these simple diagrams represent emotional states of the user, such as happy being indicated by a smiley-face. As such, these symbols are sometimes known as “smileys”. In other circles, they are also known as “emoticons”. They need not be limited to emotional states, as the simple, diagram can represent any type of message, such as a “happy birthday” symbol or the like. The rigidity and lack of choice of these fixed simple diagrams, however, is a limitation.
  • What is needed is a solution that allows more creativity and variety in the IM environment
  • BRIEF DESCRIPTION
  • The present invention provides a solution that allows an animated interactive talking character to appear on a user's screen when conducting an Instant Messaging (IM session. The character which is displayed on the user's screen may be determined by a profile for the sender of the message. This allows a user to pre-select which character will be displayed on the screen of recipients of the instant messages.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings, which are incorporated into and constitute a part of this specification, illustrate one or more embodiments of the present invention and, together with the detailed description, serve to explain the principles and implementations of the invention.
  • In the drawings:
  • FIG. 1 is a block diagram illustrating a system utilizing a robot in accordance with an embodiment of the present invention.
  • FIG. 2 is a flow diagram illustrating a method for instant messaging on a computer system in accordance with an embodiment of the present invention.
  • FIG. 3 is a flow diagram illustrating a method for receiving advertising on a computer system in accordance with an embodiment of the present invention.
  • FIG. 4 is a flow diagram illustrating a method for interacting with a software robot in accordance with an embodiment of the present invention.
  • FIG. 5 is a flow diagram illustrating a method for managing an IM system in accordance with an embodiment of the present invention.
  • FIG. 6 is a flow diagram illustrating a method for serving advertising to a user of a computer system in accordance with an embodiment of the present invention.
  • FIG. 7 is a flow diagram illustrating a method for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present inventions.
  • FIG. 8 is a flow diagram illustrating a method for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention.
  • FIG. 9 is a flow diagram illustrating a method for personalizing an animated character on a computer system in accordance with an embodiment of the present invention.
  • FIG. 10 is a block diagram illustrating an apparatus for instant messaging on a computer system in accordance with an embodiment of the present invention.
  • FIG. 11 is a block diagram illustrating an apparatus for receiving advertising on a computer system in accordance with an embodiment of the present invention.
  • FIG. 12 is a block diagram illustrating an apparatus for interacting with a software robot in accordance with an embodiment of the present invention.
  • FIG. 13 is a block diagram illustrating an apparatus for managing an IM system in accordance with an embodiment of the present invention.
  • FIG. 14 is a block diagram illustrating an apparatus for serving advertising to a user of a computer system in accordance with an embodiment of the present invention.
  • FIG. 15 is a block diagram illustrating an apparatus for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present invention.
  • FIG. 16 is a block diagram illustrating an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention.
  • FIG. 17 is a block diagram illustrating an apparatus for personalizing an animated character on a computer system in accordance with an embodiment of the present invention. An image receiver 1700 may receive an image from the user.
  • FIG. 18 is a block diagram illustrating a method and an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention which makes use of a dynamic array to form an instruction queue.
  • DETAILED DESCRIPTION
  • Embodiments of the present invention are described herein in the context of a system of computers, servers, and software. Those of ordinary skill in the art will realize that the following detailed description of the present invention is illustrative only and is not intended to be in any way limiting. Other embodiments of the present invention will readily suggest themselves to such skilled persons having the benefit of this disclosure. Reference will now be made in detail to implementations of the present invention as illustrated in the accompanying drawings. The same reference indicators will be used throughout the drawings and the following detailed description to refer to the same or like parts.
  • In the interest of clarity, not all of the routine features of the implementations described herein are shown and described. It will, of course, be appreciated that in the development of any such actual implementation, numerous implementation-specific decisions must be made in order to achieve the developer's specific goals, such as compliance with application- and business-related constraints, and that these specific goals will vary from one implementation to another and from one developer to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming, but would nevertheless be a routine undertaking of engineering for those of ordinary skill in the art having the benefit of this disclosure.
  • In accordance with the present invention, the components, process steps, and/or data structures may be implemented using various types of operating systems, computing platforms, computer programs, and/or general purpose machines. In addition, those of ordinary skill in the art will recognize that devices of a less general purpose nature, such as hardwired devices, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), or the like, may also be used without departing from the scope and spirit of the inventive concepts disclosed herein.
  • The present invention provides a solution that allows an animated interactive talking character to appear on a user's screen when conducting an Instant Messaging (IM) session. The character which is displayed on the user's screen may be determined by a profile for the sender of the message. This allows a user to pre-select which character will be displayed on the screen of recipients of the instant messages.
  • An embodiment of the present invention is described for use with the Microsoft Messenger. As such, it is described as a plug in. One of ordinary skill in the art will recognize that the invention may be modified for use with other messaging systems.
  • In an embodiment of the present invention, a system is provided that allows users to select from many different animated personalities that will represent them during an IM session. Furthermore, an embodiment of the present invention allows users to import images into the animated personality, therefore permitting them to utilize characters that may, for example, have the user's face on it, or perhaps the face of the user's favourite celebrity. When the animated character is displayed on the recipient's screen, it may appear outside of the typical IM window, allowing user's to move the animated character to a convenient portion of the desktop.
  • In an embodiment of the present invention, text-to-speech software may be utilized to allow the animated character to read instant messages aloud. The animated characters may be programmed such that their lips may move along with the text being read. Furthermore, the typical “smileys” or “emoticons” may be interpreted by the character and the animation may change based on the corresponding emoticon. For example, if the sender of the IM message indicates an “angry” emoticon, the animated character may be displayed as pounding his fist against a table.
  • The user may select a character to act as their personality using an interface. In an embodiment of the present invention, the interface may be a web interface, such as a web page, where the user logs in with an account name and password, such as with their IM account name and password, and selects from a number of different features. Once the user has selected a character, the selection may be transmitted to the server containing the relevant information. A user's preferences may be stored in a database that may be referenced by the IM account name and a user defined password. The database may be used to hold all relevant user information and the associated character data.
  • The user may download the add-in using this interface as well. The add-in may connect to the IM messaging system. It may then wait for automation events that signify that an incoming message has arrived. At this point, the add-in may contact the database to look up which personality or character the message sender has chosen. The connection to the database of stored information may be indirect, as it may be retrieved through the server where a dynamically generated query to the database may be created using the incoming request. If no record is found, a default personality may be used. The personality may then be loaded onto the user's display.
  • In an embodiment of the present invention, when a user changes their character, the new details may be broadcast to all members of their contact lists so that remote copies of the add-in can updated the displayed character for the user. However, in the current Microsoft functionality, there is no way for this broadcast to take place, thus in some embodiments the add-in must perform the aforementioned request for every incoming message if it wants to ensure that the character displayed is the current one. In another embodiment, the request may be performed only sporadically, loading the character data from a local cache until such time as it deems an update is necessary (perhaps once a day, for example).
  • The character may be used to graphically output, using animated and/or static images, a visual representation of the personality defined by the sender. Additionally, pre-recorded audio clips may be utilized along with text-to-speech synthesis in order to provide an audio version or representation of the message. The audio portion may not be limited to merely an audio transcript of the written information. It may, for example, include sound effects. Perhaps a user wishes to have a symbol indicated anger cause a sound effect of a dog growling to be played by the recipient's computer system.
  • The add-in may parse incoming messages for a predefined list of emoticons and may match them with a predefined list of character animations or audio clips. The add-in may then request the specified animation file from the server and play it for the user.
  • By maintaining the character personality based on the user's log-in name, the present invention allows the character to be a consistent identify across multiple messaging platforms, so a user may log-in on their computer at work, for example, and their character will be present in their messages just as it is from their home computer.
  • In an embodiment of the present invention, an auto responder function may be included to allow users to enable an automated response, such as “On vacation until May 30th” to any received messages. The add-in may automatically type and submit the user-defined message back to the sender of the incoming message. Each auto-responder message may be sent pre-appended with a specially formatted string that may be used to prevent auto-responders from responding to each other.
  • In an embodiment of the present invention, interactive advertising may be provided through the add-in. This advertising may be maintained in a database. it may list all advertisement details. A simple interface may be provided for administrators where they can specify the details of the advertisement. The add-in may request an advertisement from the database periodically, such as every 30 minutes.
  • In an embodiment of the present invention, a “robot” may be provided to allow interactive communications between a user and the server. This could be used, for example, to allow web searching through IM, access to database information (such as corporate sales records in the case where IM is used at the corporate level) or interactive help. FIG. 1 is a block diagram illustrating a system utilizing a robot in accordance with an embodiment of the present invention. The robot 100 may actually be a server application that listens for incoming messages from the messenger 102. When one of these alerts is received, it may store the message in a data structure such as an array, which is keyed against the name of the user who sent the alert. The message may then be sent to an artificial intelligence (AI) application 104 along with any previous messages from the initiating user. This allows the AI 104 to appear to be having an intelligent conversation by referring to things previously spoken about and keeping the conversation in context. Once the message has been processed and a response formed, it may be returned to the robot 100 which may forward the response via the messenger 102 to the initiating user.
  • The web searching function may be implemented by, for example, having the first six characters of an IM message read “google”. A keyword to search may be provided after the word “google” to indicate what to search. The Robot may then take this word and forward it to the Google™ search engine, created by Google, Inc. of Mountain View, Calif. and request five results. Google may then respond with details to then be deciphered by the robot. This may then be sent back to the initiating user. The sending of the results of the search need not be immediate. It may, for example, search for 24 hours and then follow up with the results. The robot may also be used for other. artificial intelligence applications. It may even be proactive, that is, initiate communication with a user before the user initiates communication.
  • In an embodiment of the present invention, the add-in may display a plurality of animated characters simultaneously if multiple IM sessions are being conducted. The animated characters may be placed anywhere on the display, to avoid overlap. This may also be extended to allow a “chat session” with many different animated characters representing the various senders in the chat session.
  • In an embodiment of the present invention, support may be provided for cellular phone or other “non-traditional” IM environments. SMS and MMS messaging may be provided as an option to subscribers. They may then provide their cellular phone information and set their auto-responder to “forward” mode to indicate that they wish their cell phone to receive their IM messages.
  • The add-in may then detect when a message is received and check to see if the user has set the auto-responder to forward mode. If so, then the add-in may send the message details to the server. The server may then retrieve the mobile phone number. The server may then format the message into SMS or MMS. If MMS is utilized, the server may send a thumbnail image representing the user of the incoming message and convert the message from plain text into an audio file. The message may then be forwarded to the communications gateway, which would in turn send the message into the public telephone network to be received by the user's mobile telephone.
  • The technology of the present invention may be modified to support other messaging services such as Yahoo, ICQ, Trillian, etc. However, there are interface issues that apply to each of these services. Generally, in order to interface with these services an Application Programming Interface (API) needs to be utilized, which exposes the features of the service to outside programmers. Thus, in that vain, some services do not provide all the needed features in their API or even simply do not provide an API at all. This problem may be overcome using several techniques. In one technique, the “handles” of all conversation windows may be stored. The add-in may then scan the contents of the conversation window every 100 ms or the like, and compare its contents with the contents of the previous scan. If the contents were different, it would indicate a new message has arrived and the difference would be parsed to extract the name of the sender and the contents of the message. These characters may then be presented to the character to visualize for the user.
  • In addition to a set of predefined characters from which to select, in an embodiment of the present invention the user may personalize an IM character. This allows the user to add, for example, an image of his face on the character. The personalization of the animated characters may operate in the following manner. A user interface may be provided within the application. Upon entering the “Personalization” menu area, the user may be redirected to a section of the host web site. Within this area are instructions advising a user of the processes and a means for a user to link a single image file (e.g., photograph) and upload this file to the user. The user may be provided with tools to crop the image, defining an area over the image that reduces the display area to capture only the external facial and head area. Once the upload of the user's image is complete, the user may submit the uploaded image for processing.
  • Once the image is submitted for processing, the images processing engine may use the area defined by the user and crop the image to that size. From this point, depending on the image processing engine deployed, the extraneous information within the image may be modified, leaving a transparent image area surrounding the facial features and head of the subject image. The image may be subsequently processed (rendered) to give the appearance of it having been “extruded”, creating the appearance of a three-dimensional image. Once the rendered image is created, the engine may use predetermined parameters to manipulate the extruded image into preconfigured positions and interpolate the movement from the base position to the new position. As a result, the image processing engine may output a series of sequential, specifically sized images that depict the rendered, extruded facial images moving from the base point to the predetermined point.
  • Using the previously outputted images, a further stage of processing may be performed wherein the images are introduced to a three-dimensional geometry engine. The base image that contains the rendered facial features may be aligned and mapped to three-dimensional geometry representing a character. This alignment of the image occurs to that the processed image exists to cover the face of the character in three-dimensional geometry. The other character attributes may be predefined in terms of body shape, surface such as clothing and colours and textures. The geometry engine may then be used to render out a total sequence of animated motion, and output to a series of still, sequential images. These images may conform to the standard required by the next level of image processing. These images may be named and numbered following a strict nomenclature and in accordance with a suitable colour table that enables the next processing step to occur.
  • The sequential rendered images from the previous step may then be compiled into a single, digital file. During this process, the images are compiled in such a way as to bring together individual static images into a series of animated sequences. The animated sequences may then be compiled into a proprietary format.
  • The resultant compilation may deliver several files that describe its contents and deliver connectivity to the user application. The completed files may be deposited on the server. The server may be notified of the newly created character and include the image within the character library, assigning the image to the identity of the initial image provider. The user may then be notified by email of their completed character.
  • Additionally, in certain circumstances it may be desirable to define animations to an “idle” state. It has been discovered that if characters appear on screen without moving for long periods of time, it becomes disconcerting to users. At the same time, small character movements at frequent/random intervals help to enhance the realism of a given characters. As a result, when creating a character, a specific animation may be assigned to an idle “state”. There may be, for example, 3 levels of idle, levels 1, 2, and 3. The first level may idle a randomly selected movement and play it on the screen. This may occur when the character has not bee used for a short period of time. If no interaction with the character continues, the agent application may begin to play animations with an assigned state of idle level 2 animations. Similarly, when the time interval of interaction with the user increases, idle 3 assigned animations may be displayed to the user, and so on.
  • In an embodiment of the present invention, the add-in may automatically download an idle animation and display it on the screen when a user has not interacted with the animated character for a predetermined period of time. It may similarly download a next level of idle if there continues to be no interaction.
  • Commonly, instant messages include acronyms for typically-used phrases, such as LTR for later, and A/S/L for Age/Sex/Location. A table may be utilized to store these acronyms and their corresponding definitions. When the add-in detects such an acronym, it may substitute the definition when delivering it to the user (via the screen or the text-to-speech synthesis).
  • In addition to the text-to-speech functionality described above, the present invention may also include the opposite, speech-to-text synthesis. Through such features, the add-in may receive voice commands from a user through a microphone and convert the speech to text in the instant message. Certain phrases may then be used for special commands, such as sending the instant message.
  • FIG. 2 is a flow diagram illustrating a method for instant messaging on a computer system in accordance with an embodiment of the present invention. At 200, an IM may be received containing content from the sender. At 202, an identification of the sender of the IM may be determined from the IM. At 204, a request may be sent to a server with the identification of the sender. At 206, an animated character associated with the sender may be received from the server. At 208, an animated character associated with the sender may be displayed. This displaying may include displaying the animated character outside of an IM window, and allowing a user to move the animated character anywhere on the screen. At 210, the content may be delivered to a user through the animated character. This may include converting text from the IM into audio through text-to-speech synthesis and playing the audio. The delivering may further include animating the character in synchronization with the playing of the audio. Further, the delivering may include detecting an emoticon in the IM and animating the character in a way that reflects the emoticon.
  • FIG. 3 is a flow diagram illustrating a method for receiving advertising on a computer system in accordance with an embodiment of the present invention. At 300, advertisement details may be periodically retrieved from a server. At 302, an animated character specified to represent the advertisement may be downloaded. At 304, the animated character specified to represent the advertisement may be displayed. At 306, content specified for the advertisement may be delivered.
  • FIG. 4 is a flow diagram illustrating a method for interacting with a software robot in accordance with an embodiment of the present invention. At 400, an alert may be sent to a server. The sending of an alert may include a sending a message indicating that a web search is to be performed and sending keywords to search in the web search. At 402, a response containing content may be received from the server generated by an artificial intelligence (AI) application. At 404, an animated character associated with the AI application may be displayed. At 406, the content may be delivered to a user through the animated character associated with the AI application. This may include delivering results of a web search if one was conducted.
  • FIG. 5 is a flow diagram illustrating a method for managing an IM system in accordance with an embodiment of the present invention. At 500, a request may be received from a user for an animated character, the request including an identification of a sender of the IM message to the user. At 502, a database may be queried with the identification. At 504, information regarding the animated character may be received from the database. This information may include a location for an animation file representing the animated character. At 506, the information regarding the animated character may be forwarded to the user.
  • FIG. 6 is a flow diagram illustrating a method for serving advertising to a user of a computer system in accordance with an embodiment of the present invention. At 600, a periodic request for an advertisement may be received from a user. At 602, an advertisement may be selected from an advertising database. At 604, the advertisement may be served to the user.
  • FIG. 7 is a flow diagram illustrating a method for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present invention At 700, an alert being sent from the user in an IM message may be detected, the IM message including content. At 702, the alert and the content may be passed to an artificial intelligence application. The AI application may provide interactive help, web searching, or other capabilities to the user. At 704, a response from the artificial intelligence application may be received. At 706, the response may be forwarded to the user.
  • FIG. 8 is a flow diagram illustrating a method for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention, At 800, a message may be received from the user indicating that the user wishes for all messages to be forwarded to a device utilizing the SMS format. At 802, an identification of the device may be retrieved from a database. This identification may be a cellular phone number. At 804, message intended for the user may be formatted in SMS. At 806, the formatted message may be forwarded to a communications gateway along with the identification.
  • FIG. 9 is a flow diagram illustrating a method for personalizing an animated character on a computer system in accordance with an embodiment of the present invention. At 900, an image may be received from the user. At 902, the image may be rendered as an animated character. This may include removing extraneous information from the image, modifying the image to a three-dimensional image, manipulating the image into preconfigured positions, interpolating movements from a base position to a new position for each of one or more animations for the animated character to perform, and introducing the image to a three-dimensional geometry engine. At 904, the rendered image may be saved in a database.
  • FIG. 10 is a block diagram illustrating an apparatus for instant messaging on a computer system in accordance with an embodiment of the present invention. An IM receiver 1000 may receive an IM containing content from the sender. A sender identification determiner 1002 coupled to the IM receiver 1000 may determine an identification of the sender of the IM from the IM. A server request sender 1004 coupled to the sender identification determiner 1002 may send a request to a server with the identification of the sender. An animated character receiver 1006 may receive an animated character associated with the sender from the server. An animated character displayer 1008 coupled to the animated character receiver 1006 and to the IM receiver 1000 may display an animated character associated with the sender. This displaying may include displaying the animated character outside of an IM window using an IM window-external character displayer 1010, and allowing a user to move the animated character anywhere on the screen using an animated character mover 1012. An animated character content deliverer 1014 coupled to the animated character displayer 1008 may deliver the content to a user through the animated character. This may include converting text from the IM into audio through text-to-speech synthesis with a text-to-speech synthesizer 1016 and playing the audio with an audio player 1018 coupled to the text-to-speech synthesizer 1016. The delivering may further include animating the character in synchronization with the playing of the audio using an animated character audio synchronizer 1020. Further, the delivering may include detecting an emoticon in the IM using an emoticon detector 1022 and animating the character in a way that reflects the emoticon using an emoticon character animator 1024 coupled to the emoticon detector 1022.
  • FIG. 11 is a block diagram illustrating an apparatus for receiving advertising on a computer system in accordance with an embodiment of the present invention. An advertisement details periodic retriever 1100 may periodically retrieve advertisement details from a server. An animated character downloader 1102 coupled to said advertisement details periodic retriever 1100 may download an animated character specified to represent the advertisement. An animated character displayer 1104 coupled to the animated character downloader 1102 may display the animated character specified to represent the advertisement. An animated character content deliverer 1106 coupled to the animated character displayer 1104 may deliver content specified in the dynamically created file.
  • FIG. 12 is a block diagram illustrating an apparatus for interacting with a software robot in accordance with an embodiment of the present invention. A server alert sender 1200 may send an alert to a server. The sending of an alert may include a sending a message indicating that a web search is to be performed using a web search message sender 1202 and sending keywords to search in the web search using a keyword sender 1204 coupled to the web search message sender. An artificial intelligence response receiver 1206 may receive a response containing content from the server generated by an artificial intelligence (AI) application. An animated character displayer 1208 coupled to the artificial intelligence response receiver 1206 may display an animated character associated with the AI application. An animated character content deliverer 1210 coupled to the animated character displayer 1208 may deliver the content to a user through the animated character associated with the AI application. This may include delivering results of a web search if one was conducted using a web search results deliverer 1212.
  • FIG. 13 is a block diagram illustrating an apparatus for managing an IM system in accordance with an embodiment of the present invention. An animated character request receiver 1300 may receive a request from a user for an animated character, the request including an identification of a sender of the IM message to the user. A database query generator 1302 coupled to the animated character request receiver 1300 may query a database with the identification. An animated character database information receiver 1304 may receive information regarding the animated character from the database. This information may include a location for an animation file representing the animated character. An animated character database information forwarder 1306 coupled to the animated character database information receiver 1304 may forward the information regarding the animated character to the user.
  • FIG. 14 is a block diagram illustrating an apparatus for serving advertising to a user of a computer system in accordance with an embodiment of the present invention. A periodic advertisement request receiver 1400 may receive a periodic request for an advertisement from a user. An advertisement selector 1402 coupled to the periodic advertisement request receiver 1400 may select an advertisement from an advertising database. An advertisement server 1404 coupled to the advertisement selector 1402 may serve the advertisement to the user.
  • FIG. 15 is a block diagram illustrating an apparatus for providing access to an artificial intelligence software robot to a user in accordance with an embodiment of the present invention. An alert detector 1500 may detect an alert being sent from the user in an IM message, the IM message including content. An artificial intelligence alert passer 1502 coupled to the alert detector 1500 may pass the alert and the content to an artificial intelligence application. The AI application may provide interactive help, web searching, or other capabilities to the user. An artificial intelligence response receiver 1504 may receive a response from the artificial intelligence application. An artificial intelligence response forwarder 1506 coupled to the artificial intelligence response receiver 1504 may forward the response to the user.
  • FIG. 16 is a block diagram illustrating an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MWS) format device in accordance with an embodiment of the present invention. An SMS or MMS forwarding message receiver 1600 may receive a message from the user indicating that the user wishes for all messages to be forwarded to a device utilizing the SMS format. An SMS or MMS device identification retriever 1602 coupled to the SMS or MMS forwarding message receiver 1600 may retrieve an identification of the device from a database. This identification may be a cellular phone number. An SMS or MMS message formatter 1604 may format a message intended for the user in SMS or MMS. An SMS or MMS message forwarder 1606 coupled to the SMS or MMS message formatter 1604 and to the SMS or MMS device identification retriever 1602 may forward the formatted message to a communications gateway along with the identification
  • FIG. 17 is a block diagram illustrating an apparatus for personalizing an animated character on a computer system in accordance with an embodiment of the present invention. An image receiver 1700 may receive an image from the user. An animated character image renderer 1702 coupled to the image receiver 1700 may render the image as an animated character. This may include removing extraneous information from the image using an extraneous information remover 1704, modifing the image to a three-dimensional image using a three-dimensional image modifier 1706 coupled to the extraneous information remover 1704, manipulating the image into preconfigured positions using a preconfigured position image manipulator 1708 coupled to the three-dimensional image modifier 1706, interpolating movements from a base position to a new position for each of one or more animations for the animated character to perform using a movement interpolator 1710 coupled to the preconfigured position image manipulator 1708, and introducing the image to a three-dimensional geometry engine 1712 coupled to the movement interpolator 1710. The rendered image may then be saved in a database.
  • FIG. 18 is a block diagram illustrating a method and an apparatus for providing IM access on a Short Message Service (SMS) or Multimedia Message Service (MMS) format device in accordance with an embodiment of the present invention which makes use of a dynamic array to form an instruction queue. The biggest problem was in displaying the animated characters for each user. Initial version of the invention saw just a single animated character on the desktop, which would act primarily as a friendly interface for the user. One of its functions was to read out the text of incoming instant messages and prefix the audio output with the name of the sender. However, generally relevant software is programmed asynchronously. This means that a user program would tell the animated character what it needed to do and then continue with its own processing. Then at some undetermined time the program would initiate and make the animated character perform whatever you had requested. Once this is completed the software then notifies the user program that it has finished and the user program can do whatever with this information it chooses. Due to this it is not possible to harbour more than an animated character at a time, and the reading out of the incoming messages might not take place in their designated order. In addition to this some computer systems can only support audio output from one user program at a time. If two animated characters needed to speak at once then only one of the characters output would be heard and the other would be blocked.
  • Now because of the notification process mentioned above whereby program notifies the user program that a request has been processed we were able to build a ‘sliding window’ or a dynamic array which is simply a code version of a queue. So what would happen is the user program would receive an incoming message and it would be added into this queue, rather than immediately requesting an animated character. If this request is the first or only item in the queue it would be automatically ‘popped’ off and requests an animated character. Once request had been performed it would notify the user program and the user program would (if the queue is not empty) pop off another request and repeat the cycle over again. By doing this we overcame both of the problems whereby not only can we control the order in which incoming messages are displayed to the user, but also prevent the animated characters from talking over one and another.
  • The process therefore as shown in FIG. 18 is:
      • 1. The invention awaits an incoming message for the instant messaging program.
      • 2. Once it has been determined that an incoming message was received the invention would perform the following: -
        • a. Check to see if the auto-responder is turned on
          • i. If it is then a predefined message would be returned to the sender of the incoming message
        • b. Extract the name of the sender
        • c. Determine the unique identifier of this sender by checking in the contacts list
        • d. Convert any acronyms into ‘English’
        • e. Check for any emoticons and store them in a list for later.
      • 3. Request the details regarding the senders animated character from the server
      • 4. Add the message text into the queue (as mentioned above) along with any emoticons that were extracted
      • 5. Once these items in the queue get processed the invention will retrieve the emoticons for the defined animated character from the server
      • 6. Load the users animated character onto the screen
      • 7. Read out the message while the above step 5 is taking place
      • 8. Play the emoticons
  • The second biggest problem to be overcome was how to determine an incoming message had arrived. The solution we decided upon was to have the invention locate the messaging windows and scan their contents at a regular interval (say 100 ms). It would then compare the contents of the messaging window with the contents of the window previously. It was determined that if the contents were different then a new message had arrived and that the different between the two would represent this message. It was then into a process of extracting the name of the sender from this message and adding its details to the queue for processing.
  • While embodiments and applications of this invention have been shown and described, it would be apparent to those skilled in the art having the benefit of this disclosure that many more modifications than mentioned above are possible without departing from the inventive concepts herein. The invention, therefore, is not to be restricted except in the spirit of the appended claims.

Claims (28)

1. A method for instant messaging on a computer system, including receiving an instant message (IM) containing content from a sender; displaying an animated character associated with said sender; and delivering said content to a user through said animated character.
2-8. (canceled)
9. The method of claim 1 further including:
periodically retrieving advertisement details from a server;
downloading an animated character specified to represent said advertisement;
displaying said animated character specified to represent said advertisement; and
delivering content specified for said advertisement.
10. The method of claim 1, further including:
sending an alert to a server;
receiving a response containing content from said server generated by an artificial intelligence (AI) application;
displaying an animated character associated with said AI application; and
delivering said content to a user through said animated character associated with said AI application.
11. The method of claim 10, wherein said sending an alert includes:
sending a message indicating that a web search is to be performed; and
sending keywords to search in said web search.
12. The method of claim 11, wherein said delivering said content comprises delivering results of said web search.
13. The method of claim 1, further including:
allowing the user to select from one or more predefined animated characters to be displayed on a recipient's computer system when said user sends an IM message to said recipient.
14. The method of claim 1, further including:
allowing the user to upload an image to be used in creating an animated character to be displayed on a recipient's computer system when said user sends an IM message to said recipient.
15. A method for instant messaging on a digital communication system such as a computer system or digital telephone system or combination thereof, including:
receiving one or more instant messages (IM) containing content from one or more senders;
forming a queue by creating a dynamic array and inserting incoming message into said queue;
controlling the timing of operations of actions in the queue and when required displaying an animated character associated with said sender; and
delivering said content to a user through said animated character.
16-18. (canceled)
19. A method for managing an Instant Messaging (IM) system, including:
receiving a request from a user for an animated character, said request including an identification of a sender of an IM message to said user;
querying a database with said identification;
receiving information regarding said animated character from said database; and
forwarding said information regarding said animated character to said user.
20-30. (canceled)
31. An apparatus for instant messaging on a computer system, including:
an IM receiver;
an animated character displayer coupled to said IM receiver; and
an animated character content deliverer coupled to said animated character displayer.
32-38. (canceled)
39. The apparatus of claim 31, further including:
an advertisement details periodic retriever; and
an animated character downloader coupled to said advertisement details periodic retriever and to said animated character content deliverer,.
40. The apparatus of claim 31, further including:
a server alert sender;
an artificial intelligence response receiver coupled to said animated character displayer and to said animated character content deliverer.
41. The apparatus of claim 40, wherein said server alert sender includes:
a web search message sender; and
a keyword sender coupled to said web search message sender.
42. (canceled)
43. An apparatus for managing an instant Messaging (IM) system, including:
an animated character request receiver;
a database query generator coupled to said animated character request receiver;
an animated character database information receiver; and
an animated character database information forwarder coupled to said animated character database information receiver.
44-49. (canceled)
50. An apparatus for instant messaging on a computer system, including:
means for receiving an instant message (IM) containing content from a sender;
means for displaying an animated character associated with said sender; and
means for delivering said content to a user through said animated character.
51-61. (canceled)
62. The apparatus of claim 50, further including:
means for allowing the user to select from one or more predefined animated characters to be displayed on a recipient's computer system when said user sends an IM message to said recipient.
63. The apparatus of claim 50, further including:
means for allowing the user to upload an image to be used in creating an animated character to be displayed on a recipient's computer system when said user sends an IM message to said recipient.
64. An apparatus for managing an Instant Messaging (IM) system, including:
means for receiving a request from a user for an animated character, said request including an identification of a sender of an IM message to said user;
means for querying a database with said identification;
means for receiving information regarding said animated character from said database; and
means for forwarding said information regarding said animated character to said user.
65-78. (canceled)
79. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method for instant messaging on a computer system, the method including:
receiving an instant message (IM) containing content from a sender;
displaying an animated character associated with said sender; and
delivering said content to a user through said animated character.
80. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine to perform a method for managing an Instant Messaging (IM) system, the method including:
receiving a request from a user for an animated character, said request including an identification of a sender of an IM message to said user;
querying a database with said identification;
receiving information regarding said animated character from said database; and
forwarding said information regarding said animated character to said user.
US10/522,809 2002-07-31 2003-03-31 Animated messaging Abandoned US20070094330A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
AU2002950502A AU2002950502A0 (en) 2002-07-31 2002-07-31 Animated messaging
AU2002950502 2002-07-31
PCT/AU2003/000393 WO2004012151A1 (en) 2002-07-31 2003-03-31 Animated messaging

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2003/000393 A-371-Of-International WO2004012151A1 (en) 2002-07-31 2003-03-31 Animated messaging

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/909,090 Continuation US9135740B2 (en) 2002-07-31 2010-10-21 Animated messaging

Publications (1)

Publication Number Publication Date
US20070094330A1 true US20070094330A1 (en) 2007-04-26

Family

ID=27809599

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/522,809 Abandoned US20070094330A1 (en) 2002-07-31 2003-03-31 Animated messaging
US12/909,090 Expired - Fee Related US9135740B2 (en) 2002-07-31 2010-10-21 Animated messaging

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12/909,090 Expired - Fee Related US9135740B2 (en) 2002-07-31 2010-10-21 Animated messaging

Country Status (9)

Country Link
US (2) US20070094330A1 (en)
EP (1) EP1535243A4 (en)
JP (1) JP2005535012A (en)
KR (1) KR101029743B1 (en)
CN (1) CN1672178B (en)
AU (2) AU2002950502A0 (en)
IN (1) IN2012DN01199A (en)
NZ (1) NZ537984A (en)
WO (1) WO2004012151A1 (en)

Cited By (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060058014A1 (en) * 2004-07-07 2006-03-16 Samsung Electronics Co., Ltd. Device and method for downloading character image from website in wireless terminal
US20060167992A1 (en) * 2005-01-07 2006-07-27 At&T Corp. System and method for text translations and annotation in an instant messaging session
US20070101005A1 (en) * 2005-11-03 2007-05-03 Lg Electronics Inc. System and method of transmitting emoticons in mobile communication terminals
US20070287478A1 (en) * 2006-04-18 2007-12-13 Samsung Electronics Co. Ltd. System and method for transferring character between portable communication devices
US20080059152A1 (en) * 2006-08-17 2008-03-06 Neustar, Inc. System and method for handling jargon in communication systems
US20090030775A1 (en) * 2007-07-26 2009-01-29 Braintexter, Inc. System to generate and set up an advertising campaign based on the insertion of advertising messages within an exchange of messages, and method to operate said system
US20090113311A1 (en) * 2007-10-25 2009-04-30 Eric Philip Fried Personal status display system
US20090186635A1 (en) * 2008-01-22 2009-07-23 Braintexter, Inc. Systems and methods of contextual advertising
US20090287469A1 (en) * 2006-05-26 2009-11-19 Nec Corporation Information provision system, information provision method, information provision program, and information provision program recording medium
US7640304B1 (en) * 2006-06-14 2009-12-29 Yes International Ag System and method for detecting and measuring emotional indicia
US20100131601A1 (en) * 2008-11-25 2010-05-27 International Business Machines Corporation Method for Presenting Personalized, Voice Printed Messages from Online Digital Devices to Hosted Services
US20100198584A1 (en) * 2009-02-04 2010-08-05 Kddi Corporation Server for automatically scoring opinion conveyed by text message containing pictorial-symbols
US20100205061A1 (en) * 2005-09-21 2010-08-12 Amit Karmarkar Incentive marketing with a context-enriched message
US20100255865A1 (en) * 2005-09-21 2010-10-07 Amit Karmarkar Text message including a contextual attribute of a mobile device
US20100299400A1 (en) * 2004-01-21 2010-11-25 Terry Durand Linking Sounds and Emoticons
US20100318364A1 (en) * 2009-01-15 2010-12-16 K-Nfb Reading Technology, Inc. Systems and methods for selection and use of multiple characters for document narration
US20120151381A1 (en) * 2010-12-14 2012-06-14 Microsoft Corporation Defining actions for data streams via icons
US20130151237A1 (en) * 2011-12-09 2013-06-13 Chrysler Group Llc Dynamic method for emoticon translation
WO2014024399A1 (en) * 2012-08-10 2014-02-13 Casio Computer Co., Ltd. Content reproduction control device, content reproduction control method and program
US20140161356A1 (en) * 2012-12-10 2014-06-12 Rawllin International Inc. Multimedia message from text based images including emoticons and acronyms
US20140225899A1 (en) * 2011-12-08 2014-08-14 Bazelevs Innovations Ltd. Method of animating sms-messages
US20140324414A1 (en) * 2013-04-28 2014-10-30 Tencent Technology (Shenzhen) Company Limited Method and apparatus for displaying emoticon
US20140344713A1 (en) * 2013-05-16 2014-11-20 Streamwide Personalization of a message interface
US20150025882A1 (en) * 2013-07-16 2015-01-22 Samsung Electronics Co., Ltd. Method for operating conversation service based on messenger, user interface and electronic device using the same
WO2015047011A1 (en) * 2013-09-30 2015-04-02 고석주 System and method for free text chat service using character-icon advertisement on convergent chat and advertisement service multi-platform
US9191790B2 (en) 2013-11-14 2015-11-17 Umar Blount Method of animating mobile device messages
US20160034167A1 (en) * 2014-08-02 2016-02-04 Apple Inc. Context-specific user interfaces
US9288303B1 (en) 2014-09-18 2016-03-15 Twin Harbor Labs, LLC FaceBack—automated response capture using text messaging
JP2017037636A (en) * 2015-08-10 2017-02-16 ネイバー コーポレーションNAVER Corporation System and method for providing virtual communication session for partial participant on communication session
US9916075B2 (en) 2015-06-05 2018-03-13 Apple Inc. Formatting content for a reduced-size user interface
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US10250537B2 (en) 2014-02-12 2019-04-02 Mark H. Young Methods and apparatuses for animated messaging between messaging participants represented by avatar
US10250743B2 (en) * 2005-04-20 2019-04-02 Mobile Messenger Global, Inc. Sender identification system and method
US10254948B2 (en) 2014-09-02 2019-04-09 Apple Inc. Reduced-size user interfaces for dynamically updated application overviews
US10272294B2 (en) 2016-06-11 2019-04-30 Apple Inc. Activity and workout updates
US10304347B2 (en) 2015-08-20 2019-05-28 Apple Inc. Exercised-based watch face and complications
US10452253B2 (en) 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US10613743B2 (en) 2014-09-02 2020-04-07 Apple Inc. User interface for receiving user input
US10620590B1 (en) 2019-05-06 2020-04-14 Apple Inc. Clock faces for an electronic device
US10671251B2 (en) 2017-12-22 2020-06-02 Arbordale Publishing, LLC Interactive eReader interface generation based on synchronization of textual and audial descriptors
US10771606B2 (en) 2014-09-02 2020-09-08 Apple Inc. Phone user interface
US10802703B2 (en) 2015-03-08 2020-10-13 Apple Inc. Sharing user-configurable graphical constructs
US10838586B2 (en) 2017-05-12 2020-11-17 Apple Inc. Context-specific user interfaces
US10852905B1 (en) 2019-09-09 2020-12-01 Apple Inc. Techniques for managing display usage
US10872318B2 (en) 2014-06-27 2020-12-22 Apple Inc. Reduced size user interface
US11061372B1 (en) 2020-05-11 2021-07-13 Apple Inc. User interfaces related to time
US11301130B2 (en) 2019-05-06 2022-04-12 Apple Inc. Restricted operation of an electronic device
US11327650B2 (en) 2018-05-07 2022-05-10 Apple Inc. User interfaces having a collection of complications
US11372659B2 (en) 2020-05-11 2022-06-28 Apple Inc. User interfaces for managing user interface sharing
US11443646B2 (en) 2017-12-22 2022-09-13 Fathom Technologies, LLC E-Reader interface system with audio and highlighting synchronization for digital books
US11526256B2 (en) 2020-05-11 2022-12-13 Apple Inc. User interfaces for managing user interface sharing
US11604571B2 (en) 2014-07-21 2023-03-14 Apple Inc. Remote user interface
US11694590B2 (en) 2020-12-21 2023-07-04 Apple Inc. Dynamic user interface with time indicator
US11720239B2 (en) 2021-01-07 2023-08-08 Apple Inc. Techniques for user interfaces related to an event
US11921992B2 (en) 2021-05-14 2024-03-05 Apple Inc. User interfaces related to time
US11960701B2 (en) 2019-05-06 2024-04-16 Apple Inc. Using an illustration to show the passing of time
US12045014B2 (en) 2022-01-24 2024-07-23 Apple Inc. User interfaces for indicating time

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100456749C (en) * 2004-11-05 2009-01-28 腾讯科技(深圳)有限公司 Method and system for providing dynamic graphic display for user based on instantaneous communication platform
WO2006129967A1 (en) * 2005-05-30 2006-12-07 Daumsoft, Inc. Conversation system and method using conversational agent
WO2006129968A1 (en) * 2005-05-30 2006-12-07 Daumsoft, Inc. System and method of analysing a conversation using conversational agent
EP2849059A3 (en) * 2005-06-02 2015-07-22 Tencent Technology (Shenzhen) Company Limited Animation displaying method and system thereof
US8224647B2 (en) * 2005-10-03 2012-07-17 Nuance Communications, Inc. Text-to-speech user's voice cooperative server for instant messaging clients
US9626341B1 (en) * 2005-11-22 2017-04-18 Syniverse Communications, Inc. Method of and system for displaying mobile messages in unsupported formats
CN101064693B (en) * 2006-04-24 2010-08-11 腾讯科技(深圳)有限公司 Method for presenting animation synchronously in instant communication
US10963648B1 (en) * 2006-11-08 2021-03-30 Verizon Media Inc. Instant messaging application configuration based on virtual world activities
JP4897611B2 (en) 2007-08-10 2012-03-14 インターナショナル・ビジネス・マシーンズ・コーポレーション Instant messaging system, method, and program
CN101137152B (en) * 2007-09-27 2010-09-15 腾讯科技(深圳)有限公司 Method, system and equipment for interacting three-dimensional cartoon in mobile instant communication
US8595642B1 (en) 2007-10-04 2013-11-26 Great Northern Research, LLC Multiple shell multi faceted graphical user interface
US8165886B1 (en) 2007-10-04 2012-04-24 Great Northern Research LLC Speech interface system and method for control and interaction with applications on a computing system
KR101473335B1 (en) * 2008-02-05 2014-12-16 삼성전자 주식회사 Apparatus and method for transferring message based on animation
US20090311993A1 (en) * 2008-06-16 2009-12-17 Horodezky Samuel Jacob Method for indicating an active voice call using animation
US9105014B2 (en) 2009-02-03 2015-08-11 International Business Machines Corporation Interactive avatar in messaging environment
US9191713B2 (en) * 2011-09-02 2015-11-17 William R. Burnett Method for generating and using a video-based icon in a multimedia message
CN102368198A (en) * 2011-10-04 2012-03-07 上海量明科技发展有限公司 Method and system for carrying out information cue through lip images
CN103309872A (en) * 2012-03-09 2013-09-18 腾讯科技(深圳)有限公司 Method and device for processing dynamic expression
WO2013166588A1 (en) 2012-05-08 2013-11-14 Bitstrips Inc. System and method for adaptable avatars
RU2520394C1 (en) * 2012-11-19 2014-06-27 Эльдар Джангирович Дамиров Method of distributing advertising and informational messages on internet
US10410180B2 (en) 2012-11-19 2019-09-10 Oath Inc. System and method for touch-based communications
CN103092969A (en) * 2013-01-22 2013-05-08 上海量明科技发展有限公司 Method, client side and system for conducting streaming media retrieval to input method candidate item
US20140324991A1 (en) * 2013-04-25 2014-10-30 Xiao Long Zhang Method and im client device for playing multimedia messages and im server
EP3007165B1 (en) 2013-05-31 2018-08-01 Yamaha Corporation Technology for responding to remarks using speech synthesis
CN103634200B (en) * 2013-09-10 2016-10-12 北京思特奇信息技术股份有限公司 A kind of flash map sending system and flash map sending based on instant message
CN104392729B (en) * 2013-11-04 2018-10-12 贵阳朗玛信息技术股份有限公司 A kind of providing method and device of animated content
CN103973544B (en) 2014-04-02 2017-10-24 小米科技有限责任公司 Audio communication method, speech playing method and device
KR101633762B1 (en) * 2014-06-25 2016-06-27 김남진 Advertisement-system in the mobile messenger screen
KR101540544B1 (en) * 2014-09-05 2015-07-30 서용창 Message service method using character, user device for performing the method, message application comprising the method
CN104850335B (en) * 2015-05-28 2018-01-23 瞬联软件科技(北京)有限公司 Expression curve generation method based on phonetic entry
KR102396634B1 (en) * 2015-09-18 2022-05-11 삼성전자주식회사 Apparatus and method for transmitting of message reception information in wireless communication system
US10339365B2 (en) 2016-03-31 2019-07-02 Snap Inc. Automated avatar generation
US10360708B2 (en) 2016-06-30 2019-07-23 Snap Inc. Avatar based ideogram generation
US10432559B2 (en) 2016-10-24 2019-10-01 Snap Inc. Generating and displaying customized avatars in electronic messages
US10454857B1 (en) 2017-01-23 2019-10-22 Snap Inc. Customized digital avatar accessories
US10212541B1 (en) 2017-04-27 2019-02-19 Snap Inc. Selective location-based identity communication
US11893647B2 (en) 2017-04-27 2024-02-06 Snap Inc. Location-based virtual avatars
EP3616152A1 (en) 2017-04-27 2020-03-04 Snap Inc. Map-based graphical user interface indicating geospatial activity metrics
JP7130201B2 (en) * 2018-01-18 2022-09-05 株式会社ユピテル Equipment and programs, etc.
CN110276232A (en) * 2018-03-16 2019-09-24 东方联合动画有限公司 A kind of data processing method based on social scene, system
KR102116315B1 (en) * 2018-12-17 2020-05-28 주식회사 인공지능연구원 System for synchronizing voice and motion of character
CN114793295B (en) * 2021-01-25 2023-07-07 腾讯科技(深圳)有限公司 Video processing method and device, electronic equipment and computer readable storage medium

Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5111409A (en) * 1989-07-21 1992-05-05 Elon Gasper Authoring and use systems for sound synchronized animation
US5736982A (en) * 1994-08-03 1998-04-07 Nippon Telegraph And Telephone Corporation Virtual space apparatus with avatars and speech
US6175842B1 (en) * 1997-07-03 2001-01-16 At&T Corp. System and method for providing dynamic three-dimensional multi-user virtual spaces in synchrony with hypertext browsing
US6212548B1 (en) * 1998-07-30 2001-04-03 At & T Corp System and method for multiple asynchronous text chat conversations
US20020008716A1 (en) * 2000-07-21 2002-01-24 Colburn Robert A. System and method for controlling expression characteristics of a virtual agent
US20020083140A1 (en) * 2000-12-21 2002-06-27 Shin Dong Seok Advertisement servicing system using e-mail arrival notifying program and method therefor
US20020087691A1 (en) * 1997-06-20 2002-07-04 U.S. Philips Corporation Network communication system for providing a user with a paging message
US20020097266A1 (en) * 1996-12-20 2002-07-25 Kazuhiko Hachiya Method and apparatus for sending E-mail, method and apparatus for receiving E-mail, sending/receiving method and apparatus for E-mail, sending program supplying medium, receiving program supplying medium and sending/receiving program supplying medium
US20020184089A1 (en) * 2001-05-29 2002-12-05 Tsou I-Wen Winnie Methods, devices and systems for real-time instant presence with advertisement (RIPA)
US6493001B1 (en) * 1998-09-03 2002-12-10 Sony Corporation Method, apparatus and medium for describing a virtual shared space using virtual reality modeling language
US20030005062A1 (en) * 1997-12-17 2003-01-02 Kazuhiko Hachiya Method and apparatus for automatic sending of E-mail and automatic sending control program supplying medium
US20030011643A1 (en) * 2000-02-18 2003-01-16 Minoru Nishihata Representation data control system, and representation data control device constituting it, and recording medium recording its program
US20030154446A1 (en) * 2002-01-28 2003-08-14 Constant Nicholas Robert Character-based, graphically expressive mobile messaging system
US20040030741A1 (en) * 2001-04-02 2004-02-12 Wolton Richard Ernest Method and apparatus for search, visual navigation, analysis and retrieval of information from networks with remote notification and content delivery
US20040030596A1 (en) * 2000-09-27 2004-02-12 Oussama Attar Interactive method for communication data to communication network users
US20040075677A1 (en) * 2000-11-03 2004-04-22 Loyall A. Bryan Interactive character system
US20040201624A1 (en) * 2000-06-30 2004-10-14 America Online, Inc., A Delaware Corporation Gradual image display
US6907571B2 (en) * 2000-03-01 2005-06-14 Benjamin Slotznick Adjunct use of instant messenger software to enable communications to or between chatterbots or other software agents
US6910186B2 (en) * 2000-12-08 2005-06-21 Kyunam Kim Graphic chatting with organizational avatars
US20050188018A1 (en) * 2002-05-30 2005-08-25 Yuka Endo Information transmission/reception device
US6961755B2 (en) * 2000-04-28 2005-11-01 Sony Corporation Information processing apparatus and method, and storage medium
US7085259B2 (en) * 2001-07-31 2006-08-01 Comverse, Inc. Animated audio messaging
US7159008B1 (en) * 2000-06-30 2007-01-02 Immersion Corporation Chat interface with haptic feedback functionality
US7181690B1 (en) * 1995-11-13 2007-02-20 Worlds. Com Inc. System and method for enabling users to interact in a virtual space
US7246315B1 (en) * 2000-05-10 2007-07-17 Realtime Drama, Inc. Interactive personal narrative agent system and method

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4266411B2 (en) 1998-10-19 2009-05-20 キヤノン株式会社 Information processing apparatus and control method therefor, information transmission system, and storage medium
US6766299B1 (en) 1999-12-20 2004-07-20 Thrillionaire Productions, Inc. Speech-controlled animation system
US6404438B1 (en) 1999-12-21 2002-06-11 Electronic Arts, Inc. Behavioral learning for a visual representation in a communication environment
JP2001236290A (en) 2000-02-22 2001-08-31 Toshinao Komuro Communication system using avatar
FR2807188B1 (en) * 2000-03-30 2002-12-20 Vrtv Studios EQUIPMENT FOR AUTOMATIC REAL-TIME PRODUCTION OF VIRTUAL AUDIOVISUAL SEQUENCES FROM A TEXT MESSAGE AND FOR THE BROADCAST OF SUCH SEQUENCES
AU2001249892A1 (en) * 2000-04-07 2001-10-23 America Online, Inc. Displaying advertising in a computer network environment
AU2001255787A1 (en) 2000-05-01 2001-11-12 Lifef/X Networks, Inc. Virtual representatives for use as communications tools
US6784901B1 (en) * 2000-05-09 2004-08-31 There Method, system and computer program product for the delivery of a chat message in a 3D multi-user environment
WO2001086471A1 (en) * 2000-05-10 2001-11-15 Chikka Pte Ltd Instant messaging account system
GB0019982D0 (en) 2000-08-14 2000-10-04 Co3I Ltd Message system
NO315679B1 (en) * 2001-10-19 2003-10-06 Dmates As Rich communication over the internet
RU2396599C2 (en) * 2005-12-31 2010-08-10 Тенсент Текнолоджи (Шэньчжэнь) Компани Лимитед Method for displaying three-dimensional icon and system, which realises this method

Patent Citations (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5111409A (en) * 1989-07-21 1992-05-05 Elon Gasper Authoring and use systems for sound synchronized animation
US5736982A (en) * 1994-08-03 1998-04-07 Nippon Telegraph And Telephone Corporation Virtual space apparatus with avatars and speech
US7181690B1 (en) * 1995-11-13 2007-02-20 Worlds. Com Inc. System and method for enabling users to interact in a virtual space
US20020097266A1 (en) * 1996-12-20 2002-07-25 Kazuhiko Hachiya Method and apparatus for sending E-mail, method and apparatus for receiving E-mail, sending/receiving method and apparatus for E-mail, sending program supplying medium, receiving program supplying medium and sending/receiving program supplying medium
US20020087691A1 (en) * 1997-06-20 2002-07-04 U.S. Philips Corporation Network communication system for providing a user with a paging message
US6175842B1 (en) * 1997-07-03 2001-01-16 At&T Corp. System and method for providing dynamic three-dimensional multi-user virtual spaces in synchrony with hypertext browsing
US20030005062A1 (en) * 1997-12-17 2003-01-02 Kazuhiko Hachiya Method and apparatus for automatic sending of E-mail and automatic sending control program supplying medium
US6212548B1 (en) * 1998-07-30 2001-04-03 At & T Corp System and method for multiple asynchronous text chat conversations
US6493001B1 (en) * 1998-09-03 2002-12-10 Sony Corporation Method, apparatus and medium for describing a virtual shared space using virtual reality modeling language
US20030011643A1 (en) * 2000-02-18 2003-01-16 Minoru Nishihata Representation data control system, and representation data control device constituting it, and recording medium recording its program
US6907571B2 (en) * 2000-03-01 2005-06-14 Benjamin Slotznick Adjunct use of instant messenger software to enable communications to or between chatterbots or other software agents
US6961755B2 (en) * 2000-04-28 2005-11-01 Sony Corporation Information processing apparatus and method, and storage medium
US7246315B1 (en) * 2000-05-10 2007-07-17 Realtime Drama, Inc. Interactive personal narrative agent system and method
US7159008B1 (en) * 2000-06-30 2007-01-02 Immersion Corporation Chat interface with haptic feedback functionality
US20040201624A1 (en) * 2000-06-30 2004-10-14 America Online, Inc., A Delaware Corporation Gradual image display
US20020008716A1 (en) * 2000-07-21 2002-01-24 Colburn Robert A. System and method for controlling expression characteristics of a virtual agent
US20040030596A1 (en) * 2000-09-27 2004-02-12 Oussama Attar Interactive method for communication data to communication network users
US20040075677A1 (en) * 2000-11-03 2004-04-22 Loyall A. Bryan Interactive character system
US6910186B2 (en) * 2000-12-08 2005-06-21 Kyunam Kim Graphic chatting with organizational avatars
US20020083140A1 (en) * 2000-12-21 2002-06-27 Shin Dong Seok Advertisement servicing system using e-mail arrival notifying program and method therefor
US20040030741A1 (en) * 2001-04-02 2004-02-12 Wolton Richard Ernest Method and apparatus for search, visual navigation, analysis and retrieval of information from networks with remote notification and content delivery
US20020184089A1 (en) * 2001-05-29 2002-12-05 Tsou I-Wen Winnie Methods, devices and systems for real-time instant presence with advertisement (RIPA)
US7085259B2 (en) * 2001-07-31 2006-08-01 Comverse, Inc. Animated audio messaging
US20030154446A1 (en) * 2002-01-28 2003-08-14 Constant Nicholas Robert Character-based, graphically expressive mobile messaging system
US20050188018A1 (en) * 2002-05-30 2005-08-25 Yuka Endo Information transmission/reception device

Cited By (118)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8321518B2 (en) * 2004-01-21 2012-11-27 At&T Mobility Ii Llc Linking sounds and emoticons
US20100299400A1 (en) * 2004-01-21 2010-11-25 Terry Durand Linking Sounds and Emoticons
US9049161B2 (en) * 2004-01-21 2015-06-02 At&T Mobility Ii Llc Linking sounds and emoticons
US20060058014A1 (en) * 2004-07-07 2006-03-16 Samsung Electronics Co., Ltd. Device and method for downloading character image from website in wireless terminal
US7522912B2 (en) * 2004-07-07 2009-04-21 Samsung Electric Co., Ltd. Device and method for downloading character image from website in wireless terminal
US7451188B2 (en) * 2005-01-07 2008-11-11 At&T Corp System and method for text translations and annotation in an instant messaging session
US20060167992A1 (en) * 2005-01-07 2006-07-27 At&T Corp. System and method for text translations and annotation in an instant messaging session
US10250743B2 (en) * 2005-04-20 2019-04-02 Mobile Messenger Global, Inc. Sender identification system and method
US20100205061A1 (en) * 2005-09-21 2010-08-12 Amit Karmarkar Incentive marketing with a context-enriched message
US8472985B2 (en) * 2005-09-21 2013-06-25 Buckyball Mobile, Inc Incentive marketing with a context-enriched message
US20100255865A1 (en) * 2005-09-21 2010-10-07 Amit Karmarkar Text message including a contextual attribute of a mobile device
US20070101005A1 (en) * 2005-11-03 2007-05-03 Lg Electronics Inc. System and method of transmitting emoticons in mobile communication terminals
US8290478B2 (en) * 2005-11-03 2012-10-16 Lg Electronics Inc. System and method of transmitting emoticons in mobile communication terminals
US20070287478A1 (en) * 2006-04-18 2007-12-13 Samsung Electronics Co. Ltd. System and method for transferring character between portable communication devices
US20090287469A1 (en) * 2006-05-26 2009-11-19 Nec Corporation Information provision system, information provision method, information provision program, and information provision program recording medium
US8340956B2 (en) * 2006-05-26 2012-12-25 Nec Corporation Information provision system, information provision method, information provision program, and information provision program recording medium
US7640304B1 (en) * 2006-06-14 2009-12-29 Yes International Ag System and method for detecting and measuring emotional indicia
US20080059152A1 (en) * 2006-08-17 2008-03-06 Neustar, Inc. System and method for handling jargon in communication systems
US8909545B2 (en) * 2007-07-26 2014-12-09 Braintexter, Inc. System to generate and set up an advertising campaign based on the insertion of advertising messages within an exchange of messages, and method to operate said system
US20090030775A1 (en) * 2007-07-26 2009-01-29 Braintexter, Inc. System to generate and set up an advertising campaign based on the insertion of advertising messages within an exchange of messages, and method to operate said system
US20130103501A1 (en) * 2007-07-26 2013-04-25 Braintexter, Inc. System to Generate and Set Up an Advertising Campaign Based on the Insertion of Advertising Messages within an Exchange of Messages, and Method to Operate Said System
US8359234B2 (en) * 2007-07-26 2013-01-22 Braintexter, Inc. System to generate and set up an advertising campaign based on the insertion of advertising messages within an exchange of messages, and method to operate said system
US20090113311A1 (en) * 2007-10-25 2009-04-30 Eric Philip Fried Personal status display system
US20120179550A1 (en) * 2008-01-22 2012-07-12 Braintexter, Inc. Systems and methods of contextual advertising
US20090186635A1 (en) * 2008-01-22 2009-07-23 Braintexter, Inc. Systems and methods of contextual advertising
US8156005B2 (en) * 2008-01-22 2012-04-10 Braintexter, Inc. Systems and methods of contextual advertising
US8423412B2 (en) * 2008-01-22 2013-04-16 Braintexter, Inc. Systems and methods of contextual advertising
US20100131601A1 (en) * 2008-11-25 2010-05-27 International Business Machines Corporation Method for Presenting Personalized, Voice Printed Messages from Online Digital Devices to Hosted Services
US7853659B2 (en) 2008-11-25 2010-12-14 International Business Machines Corporation Method for presenting personalized, voice printed messages from online digital devices to hosted services
US8498866B2 (en) * 2009-01-15 2013-07-30 K-Nfb Reading Technology, Inc. Systems and methods for multiple language document narration
US20100318364A1 (en) * 2009-01-15 2010-12-16 K-Nfb Reading Technology, Inc. Systems and methods for selection and use of multiple characters for document narration
US8498867B2 (en) * 2009-01-15 2013-07-30 K-Nfb Reading Technology, Inc. Systems and methods for selection and use of multiple characters for document narration
US20100324904A1 (en) * 2009-01-15 2010-12-23 K-Nfb Reading Technology, Inc. Systems and methods for multiple language document narration
US8478582B2 (en) * 2009-02-04 2013-07-02 Kddi Corporation Server for automatically scoring opinion conveyed by text message containing pictorial-symbols
US20100198584A1 (en) * 2009-02-04 2010-08-05 Kddi Corporation Server for automatically scoring opinion conveyed by text message containing pictorial-symbols
US9449308B2 (en) * 2010-12-14 2016-09-20 Microsoft Technology Licensing, Llc Defining actions for data streams via icons
US20120151381A1 (en) * 2010-12-14 2012-06-14 Microsoft Corporation Defining actions for data streams via icons
US20140225899A1 (en) * 2011-12-08 2014-08-14 Bazelevs Innovations Ltd. Method of animating sms-messages
US9824479B2 (en) * 2011-12-08 2017-11-21 Timur N. Bekmambetov Method of animating messages
US8862462B2 (en) * 2011-12-09 2014-10-14 Chrysler Group Llc Dynamic method for emoticon translation
US20130151237A1 (en) * 2011-12-09 2013-06-13 Chrysler Group Llc Dynamic method for emoticon translation
WO2014024399A1 (en) * 2012-08-10 2014-02-13 Casio Computer Co., Ltd. Content reproduction control device, content reproduction control method and program
US20140161356A1 (en) * 2012-12-10 2014-06-12 Rawllin International Inc. Multimedia message from text based images including emoticons and acronyms
US20140324414A1 (en) * 2013-04-28 2014-10-30 Tencent Technology (Shenzhen) Company Limited Method and apparatus for displaying emoticon
US20140344713A1 (en) * 2013-05-16 2014-11-20 Streamwide Personalization of a message interface
US20150025882A1 (en) * 2013-07-16 2015-01-22 Samsung Electronics Co., Ltd. Method for operating conversation service based on messenger, user interface and electronic device using the same
WO2015047011A1 (en) * 2013-09-30 2015-04-02 고석주 System and method for free text chat service using character-icon advertisement on convergent chat and advertisement service multi-platform
US9191790B2 (en) 2013-11-14 2015-11-17 Umar Blount Method of animating mobile device messages
US10250537B2 (en) 2014-02-12 2019-04-02 Mark H. Young Methods and apparatuses for animated messaging between messaging participants represented by avatar
US10979375B2 (en) * 2014-02-12 2021-04-13 Mark H. Young Methods and apparatuses for animated messaging between messaging participants represented by avatar
US11720861B2 (en) 2014-06-27 2023-08-08 Apple Inc. Reduced size user interface
US11250385B2 (en) 2014-06-27 2022-02-15 Apple Inc. Reduced size user interface
US10872318B2 (en) 2014-06-27 2020-12-22 Apple Inc. Reduced size user interface
US11604571B2 (en) 2014-07-21 2023-03-14 Apple Inc. Remote user interface
US12093515B2 (en) 2014-07-21 2024-09-17 Apple Inc. Remote user interface
US10496259B2 (en) 2014-08-02 2019-12-03 Apple Inc. Context-specific user interfaces
US10990270B2 (en) 2014-08-02 2021-04-27 Apple Inc. Context-specific user interfaces
US9459781B2 (en) * 2014-08-02 2016-10-04 Apple Inc. Context-specific user interfaces for displaying animated sequences
US9804759B2 (en) 2014-08-02 2017-10-31 Apple Inc. Context-specific user interfaces
US10606458B2 (en) 2014-08-02 2020-03-31 Apple Inc. Clock face generation based on contact on an affordance in a clock face selection mode
US11740776B2 (en) 2014-08-02 2023-08-29 Apple Inc. Context-specific user interfaces
US20160034167A1 (en) * 2014-08-02 2016-02-04 Apple Inc. Context-specific user interfaces
US11922004B2 (en) 2014-08-15 2024-03-05 Apple Inc. Weather user interface
US11042281B2 (en) 2014-08-15 2021-06-22 Apple Inc. Weather user interface
US11550465B2 (en) 2014-08-15 2023-01-10 Apple Inc. Weather user interface
US10452253B2 (en) 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US10771606B2 (en) 2014-09-02 2020-09-08 Apple Inc. Phone user interface
US10613745B2 (en) 2014-09-02 2020-04-07 Apple Inc. User interface for receiving user input
US10613743B2 (en) 2014-09-02 2020-04-07 Apple Inc. User interface for receiving user input
US11700326B2 (en) 2014-09-02 2023-07-11 Apple Inc. Phone user interface
US10254948B2 (en) 2014-09-02 2019-04-09 Apple Inc. Reduced-size user interfaces for dynamically updated application overviews
US9288303B1 (en) 2014-09-18 2016-03-15 Twin Harbor Labs, LLC FaceBack—automated response capture using text messaging
US10409483B2 (en) 2015-03-07 2019-09-10 Apple Inc. Activity based thresholds for providing haptic feedback
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US12019862B2 (en) 2015-03-08 2024-06-25 Apple Inc. Sharing user-configurable graphical constructs
US10802703B2 (en) 2015-03-08 2020-10-13 Apple Inc. Sharing user-configurable graphical constructs
US10572132B2 (en) 2015-06-05 2020-02-25 Apple Inc. Formatting content for a reduced-size user interface
US9916075B2 (en) 2015-06-05 2018-03-13 Apple Inc. Formatting content for a reduced-size user interface
JP2017037636A (en) * 2015-08-10 2017-02-16 ネイバー コーポレーションNAVER Corporation System and method for providing virtual communication session for partial participant on communication session
US10304347B2 (en) 2015-08-20 2019-05-28 Apple Inc. Exercised-based watch face and complications
US11580867B2 (en) 2015-08-20 2023-02-14 Apple Inc. Exercised-based watch face and complications
US11908343B2 (en) 2015-08-20 2024-02-20 Apple Inc. Exercised-based watch face and complications
US11660503B2 (en) 2016-06-11 2023-05-30 Apple Inc. Activity and workout updates
US11148007B2 (en) 2016-06-11 2021-10-19 Apple Inc. Activity and workout updates
US10272294B2 (en) 2016-06-11 2019-04-30 Apple Inc. Activity and workout updates
US11918857B2 (en) 2016-06-11 2024-03-05 Apple Inc. Activity and workout updates
US11161010B2 (en) 2016-06-11 2021-11-02 Apple Inc. Activity and workout updates
US11327634B2 (en) 2017-05-12 2022-05-10 Apple Inc. Context-specific user interfaces
US11775141B2 (en) 2017-05-12 2023-10-03 Apple Inc. Context-specific user interfaces
US10838586B2 (en) 2017-05-12 2020-11-17 Apple Inc. Context-specific user interfaces
US10671251B2 (en) 2017-12-22 2020-06-02 Arbordale Publishing, LLC Interactive eReader interface generation based on synchronization of textual and audial descriptors
US11443646B2 (en) 2017-12-22 2022-09-13 Fathom Technologies, LLC E-Reader interface system with audio and highlighting synchronization for digital books
US11657725B2 (en) 2017-12-22 2023-05-23 Fathom Technologies, LLC E-reader interface system with audio and highlighting synchronization for digital books
US11977411B2 (en) 2018-05-07 2024-05-07 Apple Inc. Methods and systems for adding respective complications on a user interface
US11327650B2 (en) 2018-05-07 2022-05-10 Apple Inc. User interfaces having a collection of complications
US11131967B2 (en) 2019-05-06 2021-09-28 Apple Inc. Clock faces for an electronic device
US11301130B2 (en) 2019-05-06 2022-04-12 Apple Inc. Restricted operation of an electronic device
US10620590B1 (en) 2019-05-06 2020-04-14 Apple Inc. Clock faces for an electronic device
US11960701B2 (en) 2019-05-06 2024-04-16 Apple Inc. Using an illustration to show the passing of time
US11340757B2 (en) 2019-05-06 2022-05-24 Apple Inc. Clock faces for an electronic device
US10788797B1 (en) 2019-05-06 2020-09-29 Apple Inc. Clock faces for an electronic device
US11340778B2 (en) 2019-05-06 2022-05-24 Apple Inc. Restricted operation of an electronic device
US10878782B1 (en) 2019-09-09 2020-12-29 Apple Inc. Techniques for managing display usage
US10908559B1 (en) 2019-09-09 2021-02-02 Apple Inc. Techniques for managing display usage
US10936345B1 (en) 2019-09-09 2021-03-02 Apple Inc. Techniques for managing display usage
US10852905B1 (en) 2019-09-09 2020-12-01 Apple Inc. Techniques for managing display usage
US11842032B2 (en) 2020-05-11 2023-12-12 Apple Inc. User interfaces for managing user interface sharing
US11822778B2 (en) 2020-05-11 2023-11-21 Apple Inc. User interfaces related to time
US11372659B2 (en) 2020-05-11 2022-06-28 Apple Inc. User interfaces for managing user interface sharing
US11442414B2 (en) 2020-05-11 2022-09-13 Apple Inc. User interfaces related to time
US12008230B2 (en) 2020-05-11 2024-06-11 Apple Inc. User interfaces related to time with an editable background
US11526256B2 (en) 2020-05-11 2022-12-13 Apple Inc. User interfaces for managing user interface sharing
US11061372B1 (en) 2020-05-11 2021-07-13 Apple Inc. User interfaces related to time
US12099713B2 (en) 2020-05-11 2024-09-24 Apple Inc. User interfaces related to time
US11694590B2 (en) 2020-12-21 2023-07-04 Apple Inc. Dynamic user interface with time indicator
US11720239B2 (en) 2021-01-07 2023-08-08 Apple Inc. Techniques for user interfaces related to an event
US11921992B2 (en) 2021-05-14 2024-03-05 Apple Inc. User interfaces related to time
US12045014B2 (en) 2022-01-24 2024-07-23 Apple Inc. User interfaces for indicating time

Also Published As

Publication number Publication date
EP1535243A1 (en) 2005-06-01
AU2003215430A1 (en) 2004-02-16
US20120030038A1 (en) 2012-02-02
KR101029743B1 (en) 2011-04-20
US9135740B2 (en) 2015-09-15
AU2003215430B2 (en) 2006-04-27
NZ537984A (en) 2007-07-27
WO2004012151A1 (en) 2004-02-05
EP1535243A4 (en) 2010-07-21
KR20050036963A (en) 2005-04-20
JP2005535012A (en) 2005-11-17
IN2012DN01199A (en) 2015-04-10
CN1672178B (en) 2011-07-27
AU2002950502A0 (en) 2002-09-12
CN1672178A (en) 2005-09-21

Similar Documents

Publication Publication Date Title
US9135740B2 (en) Animated messaging
US10601759B2 (en) Systems, apparatus and methods for facilitating multiple levels of detail of display based on receipt of messaging and management of information for communication devices
US8532637B2 (en) System and method for interactive messaging
CN100418333C (en) Contact sidebar tile
US9497147B2 (en) Systems and methods for supporting downloadable applications on a portable client device
US20110007077A1 (en) Animated messaging
US20140214988A1 (en) Methods for truncating attachments for mobile devices
US20070073517A1 (en) Method of predicting input
US20060089147A1 (en) Mobile network infrastructure for applications, personalized user interfaces, and services
JP2014197401A (en) Notification of mobile device event
US20120148034A1 (en) Interruptible, contextually linked messaging system with audible contribution indicators
WO2015024743A1 (en) Method and arrangement for processing and providing media content
US10200338B2 (en) Integrating communication modes in persistent conversations
US10965629B1 (en) Method for generating imitated mobile messages on a chat writer server
EP1849291A1 (en) Method for displaying text messages and programme for implementing said method
US9848023B2 (en) Electronic device and method for transmitting data by using messenger application
AU2006201368B2 (en) Animated Messages
KR100556888B1 (en) Multimedia message transmit method for mobile communcation terminal
KR20240138582A (en) Method, computer device, and computer program to provide event effects to encourage conversation
US20020196291A1 (en) System and method for implementing entity bookmarks
CN114827121A (en) Method, system and storage medium for sending photos under environment without data network
US20020197982A1 (en) System and method for entity programming

Legal Events

Date Code Title Description
AS Assignment

Owner name: E-CLIPS INTELLIGENT AGENT TECHNOLOGIES PTY. LTD.,

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:RUSSELL, NICHOLAS;FELICH, ANTON;JENKINS, JAMES;REEL/FRAME:018804/0985;SIGNING DATES FROM 20050909 TO 20050925

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION