KR20120085688A - System and method for managing multiple concurrent communication sessions using a graphical call connection metaphor - Google Patents

Abstract

The present invention relates to a system, method and computer readable storage medium for managing a plurality of simultaneous communication sessions through a graphical user interface (GUI). A system configured to implement the method provides a set of connected graphical elements representing the structure of each communication session via a GUI for each of a plurality of concurrent communication sessions. Each communication session includes at least two participants and the appearance of the set of connected graphical elements is based on the communication mode. The system receives user input associated with a set of connected graphical elements and having an action associated with each communication session, and performs an action based on the received user input. The communication mode is one of Voice over IP (VoIP), private branch switched telephone, telephone, video conferencing, instant messaging, text messaging and email. The operation may combine two communication sessions and split one communication session into a plurality of communication sessions.

Description

TECHNICAL AND METHOD FOR MANAGING MULTIPLE CONCURRENT COMMUNICATION SESSIONS USING A GRAPHICAL CALL CONNECTION METAPHOR

This application claims the priority of US Provisional Application No. 61 / 164,753, filed March 30, 2009, which is incorporated herein by reference in its entirety.

This application is filed on March 30, 2010, application Nos. 509022-US2 (Application No. 12 / 749,058), 509022-US3 (Application No. 12 / 749,094), 509022-US4 (Application) No. 12 / 749,123), 509022-US5 (Application No. 12 / 749,150), 509048-US (Application No. 12 / 749,178), 509049-US (Application No. 12 / 749,103) ) And 509098-US (Application No. 12 / 749,122), each of which is incorporated herein by reference.

TECHNICAL FIELD The present invention relates to communication, and more particularly, to managing a plurality of simultaneous communication sessions through a graphical user interface (GUI). The communication session may exist in various modes, such as a phone call, a communication session, an instant messaging session, an email session, a video conference session, a multimedia session, and the like.

Touchtone phones are complemented year after year by adding function buttons and menus. Interfaces for these functions have evolved from hierarchical menus that are activated by trackballs, quadrant style pointers, and so on. As the number of functions increases, the interface adds more buttons, sequences, and / or combinations of button presses. This increase in functionality has resulted in a number of different interfaces with varying levels of complexity. Often users want to memorize key functions, but this is not always practical or desirable. Recently, smartphones with touch sensitive displays have begun to provide similar functionality. However, touch-sensitive displays in such devices typically recreate function buttons and menus even on touch-sensitive displays.

In addition, users are moving to other forms of communication, such as text messaging, instant messaging, email, chat sessions, video conferencing, and the like. Incorporating the ability to handle these communication modes into conventional telephones will increase the complexity and difficulty many times. There is a need in the art for a more intuitive communication management interface.

1 illustrates an example system embodiment.
2A shows an initial view with no communication session.
2B illustrates an appearance of an incoming communication session.
2C shows an initial view after accepting an incoming communication session.
FIG. 2D illustrates an appearance of a communication session after adding a third party. FIG.
3 is a network diagram of a communication session.
4 illustrates a second aspect of a communication session.
5 shows a third view of a communication session with another concurrent communication session.
6A illustrates the operation of merging two communication sessions.
6B illustrates a first example of a merged communication session.
6C illustrates a second example of a merged communication session.
7 illustrates an exemplary method embodiment.

BRIEF DESCRIPTION OF DRAWINGS To describe the above-described advantages and features of the present invention, as well as how other advantages and features may be obtained, refer to specific embodiments illustrated in the accompanying drawings in which a more detailed description of the principles briefly described above is provided. Will be given. These drawings are only illustrative embodiments of the present invention, and should not be considered as limiting the scope of the present invention, the principles of the present disclosure have been described and described in more detail and with reference to the accompanying drawings.

Various embodiments of the invention have been discussed in detail below. Although particular implementations have been discussed, this should be understood as illustrative only. Those skilled in the art will appreciate that other components and configurations may be used without departing from the spirit and scope of the invention.

The present invention addresses the need for improved multiple concurrent communication session management in the art. The related application (Agent DOC NO. 509022US1; 069-0011US1) discloses a graphical interface that allows a user to set up a communication session that includes various users, and can tear down or remove users from the communication session. have. Systems and methods are disclosed for displaying a plurality of graphical connected elements on a graphical user interface on a graphical user interface, each representing a structure or incoming communication request of a particular communication session group. A brief description is provided for introduction with reference to FIGS. 2A-2D, followed by a more detailed description of the basic general purpose system and method and graphical interface of FIG. 1 that may be used to implement the concepts disclosed herein.

The provision of the graphical interface of FIGS. 2A-2D depicting a communication session allows the system to receive, via the interface, user input that may include multi-mode user input for managing the communication session. For example, a user on a conference call can drag and drop or move or find another person to add to a communication session from a contact list. The system receives this input and automatically dials the contact's phone number and adds the contact to the conference call. The user can be excluded from the phone call by dragging the connection element representing the user to the trash can or another icon representing deletion from the communication session.

The communication session is also agnostic about the mode of communication. The same metaphor of a user connected in a communication session displayed on the graphical interface is called / calling user, instant messaging (IM) user, email user, user connected via video conferencing, multimedia, web conferencing. And the like. For example, from the content shown in FIG. 2A, a user selects a contact and initiates the same type of user input (drag and drop, flicking, gestures, etc.) to initiate any mode of communication with the selected contact. Can be used. The user does not need to know or learn different input mechanisms for different communication modes.

The presentation of the graphical elements associated with the participants in the session, the manner in which the graphical elements are connected, and the way in which the user interacts with the elements all change depending on the needs of the communication session and the content of the current activity. For example, elements associated with participants in a session may include text, titles, locations, or any other data for each user. Connection metaphors between users can include the type of connection (telephone, video, web conferencing, etc.), the quality of the connection (low-band, high-band, etc.), and the participants the main users (friends, stakeholders, acquaintances, Information such as hierarchy, connection status (activation, deactivation, hold, etc.) associated with an untrusted user). Such changes may be discussed herein as various embodiments have been set. Reference is made to FIG. 1 below.

Referring to FIG. 1, an exemplary system 100 includes a system memory 130 such as a processing unit (CPU or processor) 120 and a read only memory (ROM) 140 and a random access memory (RAM) 150. Includes a general purpose computing device 100, including a system bus 110 that couples various system components to the processor 120. System 100 may include a cache 122 of high speed memory that is directly connected to, nearby, or integrated as part of processor 120. System 100 copies data from memory 130 and / or storage 160 to cache 122 for quick access by processor 120. In this way, cache 122 provides a performance boost that prevents the processor 120 from delaying while waiting for data. These and other modules may control the processor 120 to perform various operations. Other system memory 130 may also be available for use. Memory 130 may include a plurality of different types of memory having different performance characteristics. It may be appreciated that the present disclosure may operate on computing device 100 having one or more processors 120 or on a group or cluster of computing devices networked together to provide more processing power. Processor 120 is hardware, such as module 1 162, module 2 164, and module 3 166 stored in storage 160, configured to control any general purpose processor and processor 120. In addition to modules or software modules, they may also include special purpose processors in which software instructions are incorporated into the actual processor design. The processor 120 may be essentially a fully self-contained computing system including a plurality of cores or processors, buses, memory controllers, caches, and the like. Multicore processors may be symmetrical or asymmetrical.

System bus 110 may be any of several types of bus structures, including memory buses or memory controllers, peripheral buses, and local subs using any of a variety of bus structures. Basic Input / Output (BIOS) or the like stored in ROM 140 may provide a basic routine to assist in the transfer of information between components within computing device 100, eg, during start-up. Computing device 100 also includes storage device 160, such as a hard disk drive, magnetic disk drive, optical disk drive, tape drive, and the like. Storage device 160 may include software modules 162, 164, and 166 that control processor 120. Other hardware or software modules can be expected. Storage device 160 is connected to system bus 110 by a drive interface. Drives and associated computer readable storage media provide non-volatile storage of computer readable instructions, data structures, program modules, and other data for computing device 100. In one aspect, a hardware module that performs a particular function includes software components stored on a non-transitory computer readable medium and associated hardware components, such as the processor 120, that perform the function. Bus 110, display 170, and the like. The basic components are known to those skilled in the art and suitable variations are contemplated depending on the type of device, such as whether the device 100 is a small, portable computing device, desktop computer, or computer server.

Although the example embodiments described herein utilize hard disk 160, those skilled in the art should understand that other types of computer readable media storing data accessible by the computer can also be used in the exemplary operating environment. This may include a magnetic cassette, a flash memory card, a digital versatile disk (DVD), a cartridge, a random access memory (RAM) 150, a read only memory 140, a cable including a bit stream, or a wireless signal. . Non-transitory computer readable storage media clearly excludes media such as energy, carrier signals, electromagnetic waves, the signal itself, and the like.

To enable user interaction with the computing device 100, the input device 190 may be any number of input mechanisms, such as a microphone for speech, a touch-sensitive screen for gesture or handwriting input. screen, keyboard, mouse, motion input, speech, etc. Output device 170 may also be one or more output mechanisms known to those skilled in the art. If the device includes a graphical display that also receives touch sensing input, input device 190 and output device 170 may be essentially the same component or display. In some examples, a multimodal system allows a user to provide various types of inputs for communicating with computing device 100. The communication interface 180 generally controls and manages user input and system output. Operation is not limited to any particular hardware configuration, so the basic features herein may be easily replaced as advanced hardware or firmware configurations are developed.

For clarity of explanation, illustrative system embodiments are represented as including individual functional blocks, including functional blocks called "processors" or processors 120. The functions represented by these blocks may be provided by use of either shared or dedicated hardware, and may be hardware that is capable of executing hardware and software designed to operate equally to software running on a general purpose processor, such as processor 120. Including but not limited to. For example, the functionality of one or more processors shown in FIG. 1 may be provided by a single shared processor or a plurality of processors. (The use of the term “processor” should not be construed as exclusively referring to hardware capable of executing software.) An illustrative embodiment performs microprocessor and / or digital signal processor (DSP) hardware, operations described below. ROM 140 for storing software, RAM 150 for storing the result may be included. In addition to Very Large Scale Integration (VLSI) hardware embodiments, custom VLSI circuitry may be provided in combination with general purpose DSP circuitry.

The logical operations of various embodiments include (1) a computer implemented sequence of steps, operations or procedures that operate on programmable circuitry within a general purpose computer, and (2) a computer implementation that operates on specific-use programmable circuitry. Sequence of steps, operations or procedures, (3) as an interconnected machine module or program engine in a programmable circuit. The system 100 shown in FIG. 1 may perform some or all of the mentioned methods, may be part of the mentioned system, and / or in accordance with instructions in the non-transitory computer readable storage medium mentioned. It can work. This logical operation may be implemented as a module configured to control the processor 120 to perform a specific function according to the programming of the module. For example, FIG. 1 shows three modules Mod1 162, Mod2 164 and Mod3 166, which are modules configured to control the processor 120. Such modules may be stored in storage 160 and loaded into RAM 150 or memory 130 at runtime or stored in other computer readable memory locations as known to those skilled in the art.

Exemplary system embodiments have been briefly discussed, with reference now to other graphical diagrams of the interfaces for managing communication sessions with FIGS. 2A, 2B, 2C, and 2D. The system 100 as described in FIG. 1 may be configured to display a graphical user interface 200 as described in FIGS. 2A-2D and receive input for manipulating and managing a communication session. In one aspect, system 100 interacts with a communication device such as a telephone, instant message, PC or mobile computer, or email device for managing a communication session. For example, a user may have a desktop phone that communicates with a computing device that can interface with the phone and display a display such as that shown in FIGS. 2A-2D to use the phone to manage a communication session.

2A shows an initial graphical display 200 without any communication session. Display 200 may include, for example, a series of icons 208, 210, 212, 214, 216, 220 and a contact list 218 that initiate a communication session and interact with an incoming communication session. have. 2A-2D may illustrate communication session management characteristics, such as setting up and tearing down a communication session from the initial state shown in FIG. 2A, adding and removing participants to and from the session, and the like.

As can be discussed in the context of FIG. 2A, a user can identify a person to contact and initiate any type of communication using the same mode as for initiating any other type of communication. . The system is agnostic in this regard. The drag and drop, gesture, tapping, or any input mode described herein can be used to initiate and establish telephone calls, teleconferences with groups of individuals, IM or email sessions, and the like. While various examples of different inputs will be described in connection with utility icons 208, 210, 212, 214, 216, 220, any input mode may be applied in conjunction with any utility.

2B shows an appearance of an incoming communication session 201. The incoming communication session 201 may be an incoming phone call, an incoming instant message, an incoming text message, an incoming request for a web conference or an incoming video conference in this case. The incoming communication session 201 shows an icon 206 representing the requester Karl. Icon 206 may include sub-parts such as name / title 206a and communication modality icon 206b. The user can interact with the incoming communication session 201 by clicking and dragging an aspect icon onto the incoming communication session 201 to accept an incoming video conference request from Karl 206. In this example, the user clicks and drags to the icon for phone aspect 208. The user can select a different icon. The user can also tap an icon via a touch screen or stylus, flick gestures, mouse clicks / moves, voice input, keyboard input, sweep or tap on a touch-sensitive surface, contactless gestures, and / or appropriate user input. Other types of input may be provided for interacting with a communication session, such as any other combination. In the case of a touch, for example, tapping of different periods or pressures may perform different actions. User input may include mouse movements, clicks, right clicks, double clicks, dragging, flicking, hovering, gestures, and the like. The device may be shaken or tilted to receive the accelerometer input or position / direction input indicative of the desired action. The actions may generally involve connecting a utility icon with one or more entities to perform an override, send a message, receive an incoming call, create a communication session, remove a person from the session, and the like.

Although FIG. 2B illustrates an incoming communication session 201, a user can initiate a communication session in a number of different ways. For example, a user may drag a contact from the list of contacts 218 to one of the communication aspect icons 208, 210, 212, 214, 216. The user may also scroll through the list of contacts 218 to locate and select a contact 204 with the identifier 204a or a group of desired contacts, and double-click or tap on the selected group to initiate a communication session. can do. The identifier 204a may be a graphic or icon indicating an available communication mode for the contact (IM only), attendance information (in the office but not available to call), or scheduling information (currently or not currently communicable). Communicable within time). The information in graphical form may include local time, local time of the host of the communication session, and / or biological time. Biological time can be an aspect of content. For example, a person who has been acclimated to the Pacific time zone but is now located in the eastern time zone may accept a telephony communication session at 10 pm even if the people in the other eastern time zone are not. This information can help the user know whether to communicate with the contact. Such information may also be presented in connection with any icon or graphic representing an entity in the communication session. In addition to or in place of this example, other user interface modifications may be used.

2C shows what the user does after accepting an incoming communication session 201. In addition to the icon for Karl 206, a user's own icon 202 (eg, user Frank Grimes) appears in the communication session 201 as an icon 202 connected to Karl 206. Frank's icon 202 is optional and may include sub-parts such as name / title 202a and communication aspect icon 202b. In this case, because the user responded to the incoming request with a telephone icon 208, Frank 202 communicates in the communication session 201 via the telephone indicated by Karl 206 and the smaller telephone icon 202b. do. Karl's icon 206 includes a video icon 206b that can indicate video conferencing performance. Suppose Frank 202 wants to add Max Power 204 from the list of contacts 218 to the communication session 201. The user 202 clicks and drags 252 the icon of Max Power 204 directly from the list of contacts 218 to drop it on the communication session 201. System 100 adds Max Power to the communication session as shown in FIG. 2D.

System 100 can provide an interface to a user such that the user can use a plurality of different connection metaphors to establish or manipulate a communication session. For example, system 100 may display participant icons on a screen, indicate an interconnection between participants, and allow a user to place a mode icon on each interconnect to establish a session. The system 100 may allow a user to place a participant icon on the screen, select a mode, and press a button such as "go" or "connect". The system 100 may place participant icons on the screen, superimpose a communication mode icon on each participant icon, and allow the user to press "go" or "connect". This interface option is illustrative. The actual interface can be implemented with a number of changes.

In one aspect, the participant joins the communication session 201 via a phone call. However, the communication session 201 is neutral for various communication aspects and treats each as if the user wishes to join a phone call or other communication session.

In another aspect, system 100 incorporates the functionality of one or more communication devices. In this case, the display 200 shown in FIG. 2D may represent a computing device 100 (generally as shown in FIG. 1) that includes a display as well as a microphone and a speaker. Such a device may include both (1) a simple telephone that delivers a user's voice to another caller or communication session through a phone call and / or (2) a communication session management system that displays images representing a number of parties or entities involved in the session. It can operate as a mobile device, receive instructions for adding or removing individuals, and manage various parameters associated with the communication session 200.

System 100 receives input via a physical keyboard or on-screen keyboard, mouse, stylus, touchscreen, voice commands and / or single- or multi-touch gestures. Prior to establishing a communication session, system 100 may present a home screen with graphical elements representing communication utilities, such as (208, 210, 212, 214, 216, 220). In one modification, system 100 displays a summary page or a welcome page showing a short summary of the news, a message, a contact, an upcoming calendar event, and / or a configuration option. In another embodiment, system 100 displays a default input mechanism, such as ten numeric pads for dialing telephone numbers.

Display 200 shows communication session 201 of three connected graphical elements or entities 202, 204, 206. The set of graphical elements may include hyperlinks to additional information related to the user associated with the image, caricature, avatar, text and / or graphical element. Any combination of graphical data can be represented to provide information about an individual user, connection mode, status, presence, other mode capabilities, and the like. The text may include name, title, location, bio, phone number, email address, presence status, attendance information, and location. The system can change or create graphical elements based on the contacted party's relationship, appearance, attendance and / or other factors. For example, the element may represent an avatar or a person's face but with eyes closed. This may mean that the person is currently unable to answer or focus on the call. The avatar may represent a person looking far away or looking to the side, or a shaded person at a location such as a sidebar, or some other graphical representation that indicates they cannot answer or call. Can be represented. An active connection to a communication session may include a graphic connection metaphor having overlapping graphic elements, a line connecting graphic elements, a shape connecting graphic elements, a shape having radiation connecting graphic elements, and / or a common of graphic elements. It can be visually represented as an appearance. Overlapping or otherwise grouped graphical elements may represent individuals in one location. In this case, information about the location may be provided. In addition, varying the color, thickness, animation, texture, and / or length of the graphical elements may indicate a relationship or state of entities represented by the graphical elements.

The communication session 201 displayed in FIG. 2D represents real time communication of entities within the session. In this example, a real-time communication is a three-way communication session between Frank Grimes 202, Max Power 204, and Karl 206 shown by lines connecting between respective icons 202, 204, and 206. 201). In Figures 2A-2D Frank 202 is looking at this particular screen and is the host or manager of the communication session 201. Thus, display 200 is a graphical display that the system shows to Frank. Subsequent figures will show the same communication session from the viewpoint of another participant.

Call setup or communication session setup procedures will be discussed next. To establish the communication session 201, a user can drag and drop a contact from a list 218 of contacts or some other selection mechanism to some designated point, such as an empty area or element 202 representing Frank Grimes. The contacts in the list of each participant or contact in the communication session 201 may be a number of associated addresses, phone numbers, such as work phones, home phones, mobile phones, work emails, personal emails, AIM addresses, social networking addresses such as Facebook chat addresses, and the like. , Or may have points of contact. Each participant may have an icon 202b, 204b, 206b or a qualifier indicating the contact mode as well as the party. In this step, the telephone number to be called or another communication address for the alternative mode needs to be identified. The system enables the user to dial through any type of telephone number keypad, selects a number for the user from a list of numbers, or selects an email address type if the user can only be accessed via email, for example. It may represent an interface or menu that makes it possible to do so. The system can have only one phone number for the selected contact and automatically dial that number. The system can also automatically select from the available numbers based on any criteria such as previous history, attendance information, and the like. FIG. 2D illustrates the steps in the process by which user Frank Grimes 202 creates a communication session with Max Power 204 and Karl 206 as shown and described in FIGS. 2A, 2B and 2C.

The communication session 201 is not limited to phone calls. Interface 200 allows management of any communication session mode. When a user initiates a call, instant message, text message, video conference, etc. with another user, system 100 establishes a connection to another party and displays a graphical representation of the communication session with the other party on the screen. The user can add additional parties to the communication session in a similar manner. The user drags the participant's element to the trash can icon 220, provides a flicking action, clicks the X associated with the participant, or, if it is a mobile device with accelerometer, highlights the participant and shakes the device, or Participants can be removed from the communication session by clicking the physical or graphical block button. In one aspect where the communication session is over a telephone, the system 100 may remove the participant from the communication session when the user puts down the telephone receiver. When the participant leaves the communication session 201, the system 100 deletes its icon from the graphical representation of the communication session. It will be appreciated that adding or removing individual participants to or from a communication session may occur through the same drag and drop or other user input.

The graphical elements of FIGS. 2A-2D are icons, but may also include images, text, video, animation, sound, caricatures, and / or avatars. The user can personalize his or her own graphical elements or provide a live image stream from a camera or video camera, for example. In addition, the graphical element may have strings 202a, 204a, 206a of associated text. The string of text may include a name, title, location, phone number, email address, presence status, attendance information, location and / or other available information. The strings of text are separated from the graphic elements as shown in FIGS. 2A-2D but can be associated with each other. Alternatively, system 100 may superimpose a string of text on top of the graphical element or incorporate text as part of the graphical element. All or part of the text and / or graphic elements may be hyperlinks to additional information related to the user associated with the text or graphic element, such as a blog or micro blog, email address, attendance information, and the like.

System 100 may include for each icon 202, 204, 206 a respective graphical sub-element 202b, 204b, 206b indicating a communication mode for each participant. For example, Max Power 204 joins via instant messaging (IM) client 204b, Frank Grimes 202 joins via phone 202b, and Karl 206 joins video conferencing client 206b. The system 100 is mode-neutral, meaning that the system 100 handles each mode of communication equally, such as telephone, cell phone, VoIP, instant messaging, email, text messaging and video conferencing. do. When the user changes from one mode to another, the subelements may change accordingly. For example, if Frank Grimes 202 changes from a regular phone to a cell phone mid-conference, the phone icon 202b may change to a cell phone icon.

Given that the system allows users to communicate in a session in different modes, the system may change the mode to conform to the session. Instant messages from Max Power can be converted to voice for presentation in a teleconference and voice can be converted to text for delivery to Max Power 204 for effective communication across modes.

Graphical elements can convey information about the communication session by changing the type, size, color, border, brightness, position, and the like. For example, a line can convey a relationship between participants. The user can manually trigger a change to their own icon or another user's icon or the system 100 can detect the change event and change the graphical element accordingly. The change event may be based on the contacted party, context, person and / or attendance. For example, when a person is in a call, the system 100 may magnify an icon representing that person. As another example, system 100 can track how much each person is talking in a communication session and move the graphic element up or down based on the total talk time in the communication session.

In another variation, the system 100 may change the links connecting the graphic elements 202, 204, 206 by changing their thickness, length, color, style, and / or by moving the links. These changes include the active party, shared resources, active communication session state, standby communication session state, muted communication session state, held communication session state, contact communication session state, conference call, sidebar conversation, monitored transmission, and not monitored. Non-transmission, selective forwarding, selective breakup of a communication session to multiple communication sessions, and the like. In this way, the user can acquire knowledge of the state of the session, the type of communication that is taking place and other important points about the communication session.

In one aspect, the user provides input such as a gesture (eg, drag and drop, press and drag or any other directed user input using a touch screen) to manipulate and manage a communication session. For example, a user may click the call icon 208, video conference icon 210, IM icon 212, icon button 214, or social media icon 216 to invite another user to join the communication session. have. The user can drag these icons and place them over a contact or participant in the current communication session. For example, if an incoming communication session is in one modality (eg, IM 212), the user drags call icon 208 onto the incoming communication session to accept the incoming communication session but transcode it from IM to the call. can do.

Some basic examples of how a user can interact with such icons are provided below. The disclosure will be developed through exemplary use of respective utility icons 208, 210, 212, 214, 216, and 220. The first example will illustrate the use of the call icon 208. In FIG. 2C, users Karl 206 and Frank 202 are shown in a communication session, but assume that they are by email and not by phone call. Frank 202 may simply want to talk. In this case, Frank 202 may provide an directional input, such as double tapping on call icon 208, which recognizes that the system has a communication session but does not have a new communication mode. Will be instructed to be required. A telephone call is then established between Frank 202 and Karl 206 and optionally graphically shown on screen 200 using a telephone icon, such as 202b.

An example of the use of video icon 210 is provided next in terms of the initial display shown in FIG. 2A. Frank 202 continues to press the video icon 210 with one finger and simultaneously presses the icon for Max Power 204 in the contacts 218 list. System 100 recognizes the two inputs and interprets them as a request to initiate a video conference communication session with Max Power 204. System 100 can retrieve attendance information for Max Power 204 to determine whether Max Power 204 can accept video conference communications. Information 204a may indicate that Max has video conferencing capability and is currently available. If so, system 100 establishes a communication session via video between Max 204 and Frank 202 and updates display 200 accordingly. If not, the system 100 can ask Frank 202 if he wants to select another communication aspect. Frank 202 may then click one or more available utility icons.

An exemplary use of the IM icon 212 is then provided in terms of FIG. 2D. Frank 202 drags Karl 206, who is already a participant, on an IM icon 212 in an existing communication session to establish an IM sidebar with that participant. System 100 creates an additional communication session between Frank 202 and Karl 206 via an IM that is separate from, but concurrent with, the main communication session 201. System 100 may optionally show Max Power 204 a representation of an IM sidebar between Frank 202 and Karl 206.

Also in an exemplary use of the email icon 214 in terms of FIG. 2D, Frank 202 places three fingers over the email icon 214 on the touch screen to send a bulk email to all or some of the participants in the current communication session. You can swipe. System 100 can identify all participants displayed on display 200 and can retrieve an email address available for those participants. If some participants do not have an email address available, the system 100 may intelligently select a suitable substitute, such as IM or SMS, based on general or current attendance information or availability in the current mode. After or while the system 100 collects all email address information, Frank 202 may enter a message in a pop-up window and click Send. The system 100 then sends a message to the intended recipient.

The social networking icon 216 is discussed in terms of FIG. 2D. Frank 202 double-clicks social networking icon 216. In one variation, the system 100 visually identifies which participants are not part of Frank's social network. Frank 202 may then quickly add them to a social network, such as LinkedIn or Facebook, by clicking or pressing the visually identified participants. In another change, Frank 202 once presses social networking icon 216 and once elsewhere, the system 100 may be subject to audio clips, documents, video files, links, text, images or any other data. Post on social network data related to the location of the two tabs. Social media includes websites such as Facebook, Twitter, LinkedIn, MySpace, and the like.

The user flicks the participant icon in the general direction of the trash can icon 220, draws an X over the participant icon or over the entire communication session, and if the device is mobile or by other directed input Interact with the trash can icon 220 by shaking it. System 100 may terminate the communication session, delete the contact, remove the participant from the communication session, or take other action based on user interaction with the trash icon 220. Of course, the trash can icon 220 may use any other graphical image, such as a door or window, reflecting that a person or entity is leaving a communication session. For example, a window or door may be on the display screen and the host may remove the object from the communication session by moving each icon to the window or door. As can be seen, user interaction with the utility icon and at least one entity in a communication session can take many forms, as discussed above. Each example interaction can be applied in a similar manner to other utility icons.

The user can also initiate a communication session by dragging and dropping the appropriate icon on the contact. Alternatively, a user can browse through the contact list 218 and then add the desired contact to the communication session by dragging and dropping the desired contact. The system 100 can then automatically contact the person in a mode that is currently available based on the desired mode, sender preference mode, attendance information, or a mode common to the participants, and allow the person to join the communication session. have. System 100 may also display other information such as calendars, notes, notes, personal attendance information, and time. The user can switch manually and seamlessly from one aspect to another midsession. For example, a user currently close to a webcam and participating in a communication session via a mobile phone can drag the video conference icon into the communication session to switch from the mobile phone to a video conference. The system 100 display may be user configurable.

In these examples, drag and drop is commonly used, but the association of one or more participants (which may include non-personal objects such as people and conferences or calendar items) with selected utility icons (208, 210, 212, 214, 216). Any user input may be provided such as pressing, flicking, etc. with the zester to indicate.

In one aspect, user preferences guide the amount and type of information conveyed by graphical elements and associated text. User preferences can be drawn from the viewer's preferences and the source person's preferences. For example, a viewer sets a preference to display another's email address when available, but the sender sets a preference that never shares the email address. The sender's preference (or the "owner's" preference of the information) may be more important than the preference of the third party.

Several variations of FIGS. 2A-2D have been discussed and now discuss network view 300 of the communication session shown in FIG. 3. The network 302 connects various communication devices 304, 306, 308, 310, 312 and passes information from device to device. Telecommunication networks include plain old telephone service (POTS) networks, asynchronous transfer mode (ATM) networks, world wide web (WWW), integrated service digital networks (ISDN), frame relay networks, Ethernet networks, token ring networks, and any other. It may be one or a combination of suitable wired or wireless networks. The network may include one or more interconnected nodes 314, 316, 318, 320 that perform all or part of the connection and transmission functions that underlie the graphical representation of the communication session on the GUI. Such network nodes 314, 316, 318, 320 may perform all functions in network 302 and operate in conjunction with end user communication devices 304, 306, 308, 312 to manipulate communication sessions. Only display components are shown for devices 304 and 306.

In one aspect, a focused entity, such as node 320, controls the communication session. The centralized entity 320 may exist within and / or communicate over a network. The centralized entity 320 can act as a centralized enterprise intelligence server. In another aspect, communication session control and functionality is distributed to multiple server resources 314, 316, 318, 320 within the network or cloud 302. In addition to centralized and distributed intelligence in the cloud, the network 302 may provide this functionality using intelligent peer-to-peer schemes on endpoints 312, 308, 306, 304. Some changes include providing non-standardization functionality distributed through endpoints and standardization functions on a standards-compliant server. In some aspects, other characteristics of a "system", "device", "communication device", or hardware component that performs a particular step may be interpreted as one or more various devices as endpoints or network elements shown in FIGS. have.

Each communication device 306, 301, 312, 308 of FIG. 3 shows a different aspect or view of the same communication session. For example, the display of device 304 shows the same display of the same participants 202, 204, and 206 as shown in FIG. 2D. The display of device 306 shows the same participant 202, 204, 206 in a view of a communication session that is different from that of device 306. Similarly, devices 308 and 312 show the same participants 202, 204, and 206 in different views that can be tailored to individual participants in a communication session, respectively. Device 304 may represent a host or manager of a communication session, but may also represent someone shown as participating in a call.

In one aspect, the mobile device 308 connects with the base station 310 to connect to the network. The mobile device 308 can create a view of its own communication session or create a duplicate or companion view of the display of another device.

In general, management of a communication session involves a user, such as a user who interfaces with device 304 and provides input to a graphical interface. Input referred to herein involves operational steps of manipulating and managing a communication session. Corresponding instructions are provided to network node 320 or network nodes that actively provide a communication link to various participants. Thus, the network node or nodes may be configured so that operations such as bridging a communication session, removing a person from a session, establishing a sidebar discussion, separating a communication session into several smaller communication sessions, etc., are performed appropriately. It will perform the instructions received from it.

3 may also show a view of a person or entity attempting to contact someone in a communication session. For example, suppose Mary has device 304 and wants to speak with Frank 202. If Mary is in that case, if the permission is granted, she can be provided with a video of Frank's communication session. This may provide a level of change in detail for her communication type, such as who is on the call, the content of the call, and so on. In this way, Mary can be offered an option because she currently knows this. Perhaps she may want IM or email instead of phone. She may ask to join the conference. She may want to send a message to Frank 202 that she has notified that he was busy and that he can call her back in an hour. Displaying a graphic image of Mary attending the communication session of the person with whom she is talking allows her to determine how a more efficient mechanism will best use the next step of communicating with Frank 202.

4 shows a different view 400 of the same communication session shown in FIG. 2D from the perspective of Max Power 204. In this case, Max Power is a modulator, so Max's icon 204 appears to be in a central position relative to the remaining participants' icons 202 and 206. Each participant's icon is associated with text 202a, 204a, and 206a indicating the name and communication mode. The text 202a, 204a, 206a may also represent different data for each person and may include icons representing various types of data such as communication mode, attendance, time information, calendar information, hierarchy information, user information, and the like. Can be. System 100 can place icons based on organizational hierarchy, roles, locations, sequences, or other combinations of parameters.

The interface 400 of FIG. 4 uses a connection line and a central hub 402 and spoke from the participant to the hub to indicate that three participants 202, 204, and 206 are in a communication session. System 100 participates in additional communication sessions, and the display shows additional concurrent sessions at different locations. In some cases, such as instant messaging, a single location includes multiple communication sessions of the same type. For example, multiple IM communication sessions can be displayed as a stack of cards at a single location. The hub 402 of FIG. 4 and the line connection icons in FIG. 2D are also exemplary display configurations for active connection. Other configurations of icons, text, and / or graphical elements may replace those shown herein.

Display 400 may include various controllers, such as title bar 404 and mute button 406, exit button 408, transcription button, and “add participant” button 410. When the user clicks the "Add Participant" button 410, the system 100 may provide a conversation to the user to select one or more participants to add. The title bar 404 may include information such as call duration, call host, and preferred communication mode. When the user clicks the mute button 406, the system 100 can mute the line of the user or the line of another participant. In the case of a participant, clicking the exit button 408 causes the participant to leave the meeting. The host can also highlight one or more participants with a click or gesture and then click Leave 408 to remove them from the meeting. The conference host may also end the communication session for all participants by clicking the exit button 408.

When the user clicks the transfer button (not shown), the system 100 may recognize and transfer the voice using the voice recognition module. System 100 may display the transcription in real time, such as a ticker of text under the user's icon. The system 100 may also prepare a full transcription of the entire communication session and email the full transcription to the selected participant after the communication session ends. The system 100 may transcode audio from a phone call into text for a text messaging session via automatic speech recognition (ASR), and may otherwise transfer via text-to-speech (TTS) conversion. Therefore, Max 204 can communicate with Frank 202 and Karl 206 via IM in different modes in the same session. These differences may be in visual representation in the session display.

Alternatively, the user can browse and select participants from the contact list and drag the desired participants directly into the graphical representation of the meeting. The user can also add the other party to the communication session, invite the other party to the communication session, remove the other party from the communication session, split the communication session, form a sidebar communication session, and merge the two communication sessions. . The sidebar communication session is a concurrent session between two or more participants in the main communication session, but separate from the main communication session. For example, if Max Power 204 is proposing an idea, Frank Grimes 202 and Karl 206 may form a sidebar to discuss the proposed idea even if Max Power does not hear or know the sidebar. In some cases knowing the presence of the sidebar is available to other participants, but the other participants do not know that they are being communicated in the sidebar.

Several modifications of FIG. 4 have been discussed, and now the third view 500 of the communication session 502 between Max Power 204 and Frank Grimes 204 and Karl 206 is another concurrent from the perspective of Karl 206. 5 is shown using a real-time communication session 512 and a current incoming call 514 for Karl 206. The active connection of the communication session 502 is shown connected via triangle 510. The system 100 shown in FIG. 5 displays graphic element overlap, lines connecting graphic elements, forms connecting graphic elements, diverging lines connecting graphic elements, and / or general increases in graphics elements. can do. The system may group or duplicate icons that correspond to individuals in the same location close together. Thus, the visual representation may vary from one "participant" in the communication session to the individual, location, grouping of persons, and the like. This visual image provides the participant with an easy understanding and the ability to graphically easily manage the session.

The display of FIG. 5 shows three separate concurrent communication sessions 502, 512, 514. The first communication session 502 is between Max 204, Frank 202, and Karl 206. Each metadata is shown as 202a, 204a, 206a. The second communication session 512 is a communication session in which Karl is a participant and includes a group from California 504, pole 506, lob 508, lane 524 and a group from Florida 522. Thus, Karl 206 is a concurrent participant in two communication sessions. System 100 displays each communication session individually. In addition to these two communication sessions, system 100 displays incoming communication 514 from John Mah. Incoming communication icon 514 flashes, bounces, pulses, increases, decreases, vibrates, changes color, delivers an audible alert (eg, ringtone), and / or provides some other notification to a user of an incoming call. Can provide. Karl 206 can interact with and manipulate this incoming request in the same manner as other concurrent communication sessions. System 100 does not distinguish between an active communication session and a communication session representing an incoming call. For example, Karl 206 can drag incoming call 514 on top of communication session 512 to aggregate add incoming call to communication session 512 or 502. As another example, Karl 206 may drag and drop incoming communication 514 to the Trash icon to ignore the call, and double-click incoming communication 514 to send the incoming caller (if a call) to voicemail. Or keep pressing to keep the caller waiting.

If Karl 206 accepts incoming communication 514 from John Mah, system 100 creates and displays a new communication session that includes Karl 206 and John Mah (not shown in FIG. 5). System 100 may place a new communication session elsewhere on the display.

System 100 may visually represent an active connection in which graphical elements for an individual overlap in one location. For example, in a second communication session 512, a participant from Florida overlaps with a participant from California. The user can manipulate these duplicate icons to identify or communicate with participants in the communication session.

The display can include listings of contacts 520 and calendar events 522. User interaction with a contact can trigger an expanded view or popup window with more information. The user can then click on a particular contact to see a list of communication modes available for that contact. System 100 initiates an additional communication session with that contact based on the user selection of the available communication modes. System 100 connects and displays the communication session with three existing 502, 512 and newly added John Mah sessions (not shown).

In addition, system 100 may include a search capability. The user can search for contacts, calendar events, email addresses, phone numbers, and the like. This approach can be beneficial to users with a fairly large list of contacts and to find all members of a particular department.

Frequently a contact will include several contacts for a particular communication aspect. For example, one contact may include four telephone numbers, two text message numbers, three email addresses, and the like. In these cases, the system 100 may intelligently select one of the available addresses or numbers for the selected aspect, or the system 100 may present a clear conversation so that the user may select the desired address or number.

In many cases, the user will not have a contact entry for every other communication session participant. To add a communication session participant as a contact, the user can drag and drop the desired icon onto the contact icon. System 100 may automatically place available information about the participant for addition to the contact database.

One possible user input is to split the communication session shown in Figures 6A-2B. The user may divide the communication session into two groups by drawing lines with a mouse drag or finger on the touch screen. System 100 may then divide the communication session into two separate concurrent communication sessions based on the group. In one aspect, the communication session manager may split the communication session for a limited time after which the communication sessions are automatically merged together. For example, the manager might say, "Pros and Cons about Team A, Strategy A. Pros and Cons about Team B, Strategy B. I'll be back in 5 minutes and report on the discussion." The administrator then selects a group and sets the duration for the line or breakout session. A conversation or icon may appear when a communication session is disconnected, which provides options available for managing that separation. System 100 splits the communication session and rejoins them after a set duration. Administrators can indicate additional settings, such as prohibiting sidebar conversations between groups during small group conferences. Administrators can be independent of subgroup meetings and monitor each subgroup through audio, summary and / or real-time text.

6A illustrates the operation of merging two communication sessions into the GUI 600. System 100 displays two separate communication sessions 602, 604. The first communication session 602 includes four participants 602a through 602d, each having a communication style icon in the upper left corner of each icon representing a communication mode such as instant messaging and video conferencing. The second communication session 604 includes three participants 604a through 604c each having a communication style icon such as a telephone on the upper left side. Participant 604c is shown as a stacked group of participants and may represent a group of people who participate from a single location, single company, family, entity or other grouping criteria. The user may click on the central connector hub 606 of the first communication session and then drag or move 608 to drop or place it on or in or near the second communication session 604. This is an example of mouse or touch screen based input, and the user can input the same as using other interface methods. Based on this input, the system 100 merges the first communication session 602 and the second communication session 604. If each communication session 602, 604 is included in the management host, negotiation may occur where one of the two management hosts becomes the host of the combined conference. This example includes a session host, but the session host is not required in any session joining sessions.

6B illustrates a first example of a merged communication session 610. In this first example, system 9100 merges first and second communication sessions 602, 604 with bridge element 612. The system 100 may display a bridge element indicating which communication mode is used to bridge the communication sessions. In this example, the bridging element is a phone form. This method is a very simple method of separating the merged communication sessions to return the first and second communication sessions 602, 604 to the original state shown in FIG. 6A. This graphical method also retains some of the graphical features of the two separate communication sessions initially from FIG. 6A. The host user may provide input such as drawing a line on the touch screen between the user 604a and the hub 606 to instruct the system to separate the communication session into two separate communication sessions shown in FIG. 6A. . The host can click or select specific users and drag or move them to the side. For example, using a mouse or touch pad, the host clicks on user 604c, user 602a, and user 602c (by holding down the shift key and clicking on them to create a highlighted group of participants). You can drag it to the side. This notifies the system 100 to manage the establishment of a separate communication session with such participants to continue the discussion. Appropriate adjustments can be made in these cases for each aspect. For example, if a combination of IM and telephony is used, the text is converted into voice and the voice is converted into text so that communication can occur to each participant.

6C illustrates a second example of a merged communication session 614. In a second example, the system 100 merges the first and second communication sessions 602, 604 without separating or distinguishing between participants based on previous configurations of the communication sessions 602, 604. System 100 may place participant icons to have roles, locations, sequences, and host status. If the first and second communication sessions include a host, the system 100 can choose either communication session to be the host of the merged communication session 614 or two or more hosts are common in the merged communication session 614. You can push it to the state of the host.

The host or other user may detach the merged communication session 612. In the case of a touch-sensitive display, the user draws a line down the middle of the connected graphic element. The system 100 interprets the input and divides the communication session into one communication session of participants whose icons are on one side of the line and another communication session of participants whose icons are on the other side of the line. Often the placement of the participant icons is not exactly aligned depending on how much the user wants to separate the communication session. The user may first drag and rearrange the graphical representation of the communication session and then provide a separate input. Using other forms of input, the user can press or move icons to select them for inclusion in a split operation, and then click the split button or drag the selected icon to a specified partition in the GUI or to a location that exceeds the split threshold distance. have.

In a situation where system 100 stacks a plurality of participant icons, such as stack 604c, a user may perform a pinch action on the touch screen, double click or tap, or provide other input to expand the stack of icons. . The user can then easily select all or some of the participants in the extended stack as part of the detach process. In another variation, the user or host may filter and separate participants in the communication session based on some attribute such as communication style, organization, role, and the like. For example, the host may provide input for selecting session participants who communicate via instant messaging to separate into separate communication sessions.

The visual depiction of concurrent communication sessions facilitates the addition, modification, separation and control of multiple user combinations between different communication sessions and facilitates the participation or dynamic switching between sessions for any user. The system 100 or network node 202 will receive instructions from a client end user device capable of executing instructions that modify the communication experience.

The following describes the example method shown in FIG. For clarity, this method is discussed using the example system 100 shown in FIG. 1 and / or the network node 320 configured to implement the method.

7 illustrates an example method of managing a plurality of concurrent communication sessions via a GUI. System 100 provides a set of connected graphical elements representing the structure of each communication session via a GUI for each communication session in a plurality of concurrent communication sessions, each communication session having at least two communication users, and connected graphics The set of elements is based on the communication mode (702). The communication mode may be one or more of voice over IP (VoIP), telephone, cellular telephone, video conferencing, instant messaging, text messaging, email, presence and web-based. In one aspect, the system 100 displays concurrent communication sessions with normal participants (users) and provides concurrent communication sessions on the GUI as viewed from the point of view of one user. Each participant in the communication session may view their own session. For example, in FIG. 6C, user 604b is separated by a host into smaller communication sessions with users 604a, 602d, and the user of each communication device previews the entire unserviced communication session shown in FIG. 6C. The system can only display separate sessions, including 604b, 604a, 602d. Another session may disappear from the device 604b. Thus, the communication link between the various users is not only adjusted based on the modification of the communication session, but the system automatically adjusts each view of all participants based on the situation of the current communication experience.

System 100 receives user input associated with a set of connected graphical elements, the user input having an action associated with each communication session (704). System 100 may receive user input via a mouse, keyboard, stylus, touch, single touch or multi-motion, voice command, button press, sensed motion in air, and other appropriate human interface. System 100 may receive input via a separate handheld device, such as a remote control, a pointer, or a mobile phone.

System 100 performs an operation based on the received user input (706). This operation may be one individual operation or a combination of sub-operations. This operation involves combining two communication sessions, dividing one communication session into more than one communication session, and dividing the communication session into more than one communication session for a limited period of time, after which the system 100 again divides them into one communication session. It may be an operation of merging into a session.

This operation may be to create a sidebar communication session spanning at least two existing communication sessions. For example, if a user is participating in a telephone conference call and an instant messaging session, the user may create a sidebar communication session through a video conference with one participant from the conference call and another participant from the instant messaging session. As can be seen from the above, the present invention provides various methods of managing concurrent communication sessions.

Embodiments within the scope of the present invention may include tangible and / or long term computer readable storage media including computer executable instructions or data structures stored on such storage media. Such long term computer readable storage media can be any available media that can be accessed by a general purpose or special purpose computer, including the functional design of any of the special purpose processors described above. For example, such long-term computer readable media may include RAM, ROM, EEPROM, CD-ROM, or other optical disk storage, magnetic disk storage, or other magnetic storage devices, or computer executable instructions, data structures, or processor chip designs. It may include any other medium that can be used to contain or store the desired program code means in the form. When information is delivered or provided to a computer via a network or other communication connection (wired, wireless or a combination thereof), the computer recognizes these connections as computer readable media. Thus, such a connection may be referred to as a computer readable medium. Combinations of the above should also be included within the scope of computer-readable media.

Computer-executable instructions include, for example, instructions or data that cause a general purpose computer, special purpose computer, or special purpose processing device to perform a function or group of functions. Computer-executable instructions also include program modules that are executed by the computer alone or in a network environment. Generally, program modules include routines, programs, components, data structures, objects, functions unique to the design of special purpose processors, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code means for performing the steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts that implement the functions described in such steps.

Those skilled in the art will appreciate that the present invention may be utilized in network computing environments having many types of computer system configurations, including personal computers, handheld devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. It will be appreciated that other embodiments may be practiced. Embodiments may also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (by wired link, wireless link, or a combination thereof) over a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

The various embodiments described above are exemplary only and are not intended to limit the scope of the present invention. Those skilled in the art will readily appreciate that various modifications and changes can be made to the principles disclosed herein without following the embodiments and applications illustrated and described herein without departing from the spirit and scope of the invention.

Claims (20)

Receiving a first communication from a first user in a first communication mode,
Receiving a second communication from a second user in a second communication mode that is different from the first communication mode;
Establishing a communication session between the first user and the second user, the communication session causing the first user to communicate with the second user using the first communication mode, and as the second user. Allow the second user to communicate with the first user using the second communication mode;
Presenting, via a graphical user interface, a set of connected graphical elements representing the structure of the communication session, wherein the set of connected graphical elements comprises the first communication mode and the second communication. Based at least in part on the mode
Way.
The method of claim 1,
The first mode of communication includes public switched telephones, Voice over IP (VoIP), private branch switched telephones, cellular telephones, video conferencing, instant messaging, text messaging, email, multimedia and Including one of web-based
Way.
The method of claim 1,
The second communication mode includes one of a public circuit switched telephone, VoIP, private branch switched telephone, cellular telephone, video conferencing, instant messaging, text messaging, email, multimedia and web based.
Way.
The method of claim 1,
Graphic elements associated with the first user and the second user depict at least one of presence, context, and persona information.
Way.
The method of claim 1,
The set of connected graphic elements conveys information about the communication session according to at least one of a graphic element type, a graphic element size, a graphic element color, a border, brightness and position.
Way.
The method of claim 1,
The set of connected graphical elements is based at least in part on the presence information of the first user and the second user.
Way.
The method of claim 1,
The set of connected graphical elements is based at least in part on at least one of context, persona and user.
Way.
The method of claim 1,
At least one of a current communication, a shared resource, an active communication state, a pending communication state, a muted communication state, a held communication state, an unmuted communication state, and a connected communication state Based on, changing links connecting to the set of connected graphical elements.
Way.
The method of claim 8,
Changing the links includes at least one of changing the link thickness, changing the link color, changing the link style, and animating the link.
Way.
As a system,
A processor,
Include memory,
The memory causes the processor to execute when executed by the processor.
Receiving a first communication from a first user in a first communication mode,
Receiving a second communication from a second user in a second communication mode that is different from the first communication mode;
Establishing a communication session between the first user and the second user, the communication session causing the first user to communicate with the second user using the first communication mode, and as the second user. Allow the second user to communicate with the first user using the second communication mode;
Presenting via the graphical user interface a set of connected graphical elements representing the structure of the communication session, the set of connected graphical elements being based at least in part on the first and second communication modes. With internally stored instructions to perform
system.
11. The method of claim 10,
The first communication mode includes one of a public circuit switched telephone, VoIP, private branch switched telephone, cellular telephone, video conferencing, instant messaging, text messaging, email, multimedia and web based.
system.
11. The method of claim 10,
The second communication mode includes one of a public circuit switched telephone, VoIP, private branch switched telephone, cellular telephone, video conferencing, instant messaging, text messaging, email, multimedia and web based.
system.
11. The method of claim 10,
Graphical elements associated with the first user and the second user depict at least one of presence, context, and persona information.
system.
11. The method of claim 10,
The set of connected graphic elements conveys information about the communication session according to at least one of a graphic element type, a graphic element size, a graphic element color, a border, brightness and position.
system.
11. The method of claim 10,
The set of connected graphical elements is based at least in part on the presence information of the first user and the second user.
Way.
A computer readable storage medium,
The computer readable storage medium causes the processor to execute when executed by the processor.
Receiving a first communication from a first user in a first communication mode,
Receiving a second communication from a second user in a second communication mode that is different from the first communication mode;
Establishing a communication session between the first user and the second user, the communication session causing the first user to communicate with the second user using the first communication mode, and as the second user. Allow the second user to communicate with the first user using the second communication mode;
Presenting via the graphical user interface a set of connected graphical elements representing the structure of the communication session, the set of connected graphical elements being based at least in part on the first and second communication modes. With internally stored instructions to perform
Computer-readable storage media.
17. The method of claim 16,
The set of connected graphic elements conveys information about the communication session according to at least one of a graphic element type, a graphic element size, a graphic element color, a border, brightness and position.
Computer-readable storage media.
The method of claim 17,
The set of connected graphical elements is based at least in part on the presence information of the first user and the second user.
Computer-readable storage media.
17. The method of claim 16,
The first communication mode includes one of a public circuit switched telephone, VoIP, private branch switched telephone, cellular telephone, video conferencing, instant messaging, text messaging, email, multimedia and web based.
Computer-readable storage media.
17. The method of claim 16,
The second communication mode includes one of a public circuit switched telephone, VoIP, private branch switched telephone, cellular telephone, video conferencing, instant messaging, text messaging, email, multimedia and web based.
Computer-readable storage media.

Images