US20180284453A1 - Customer interaction system - Google Patents
Customer interaction system Download PDFInfo
- Publication number
- US20180284453A1 US20180284453A1 US15/941,120 US201815941120A US2018284453A1 US 20180284453 A1 US20180284453 A1 US 20180284453A1 US 201815941120 A US201815941120 A US 201815941120A US 2018284453 A1 US2018284453 A1 US 2018284453A1
- Authority
- US
- United States
- Prior art keywords
- customer
- augmented reality
- computer system
- display device
- reality display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000003993 interaction Effects 0.000 title claims description 22
- 230000003190 augmentative effect Effects 0.000 claims abstract description 148
- 238000000034 method Methods 0.000 claims description 44
- 230000006870 function Effects 0.000 claims description 32
- 238000004891 communication Methods 0.000 claims description 9
- 238000012544 monitoring process Methods 0.000 claims description 9
- 230000009471 action Effects 0.000 claims description 6
- 230000008859 change Effects 0.000 claims description 5
- 230000004044 response Effects 0.000 claims description 5
- 239000011521 glass Substances 0.000 abstract description 10
- 238000007726 management method Methods 0.000 description 49
- 230000015654 memory Effects 0.000 description 15
- 238000010586 diagram Methods 0.000 description 14
- 238000011156 evaluation Methods 0.000 description 14
- 238000013507 mapping Methods 0.000 description 14
- 238000010561 standard procedure Methods 0.000 description 14
- 238000004590 computer program Methods 0.000 description 11
- 238000013500 data storage Methods 0.000 description 11
- 238000004422 calculation algorithm Methods 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 230000003068 static effect Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000004033 plastic Substances 0.000 description 2
- 229920003023 plastic Polymers 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000003339 best practice Methods 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 238000012517 data analytics Methods 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 229920001971 elastomer Polymers 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 229910001092 metal group alloy Inorganic materials 0.000 description 1
- 150000002739 metals Chemical class 0.000 description 1
- 230000010399 physical interaction Effects 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000005060 rubber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06398—Performance of employee with respect to a job function
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/01—Customer relationship services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/021—Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Definitions
- the present disclosure relates generally to systems, methods and tools for providing customer service using augmented reality.
- Service industries, sales industries and employees thereof, are responsible for assisting customers and clients who seek out to receive goods and services a particular vendor. Often, it is recognized in the service and sales industries, establishing a relationship with customers can lead to increased trust between the customers and employee and ultimately lead to increased sales.
- One way to increase the relationship between a vendor and the customer is for the salesmen or employee of the vendor to increase their own personal knowledge and facts about the customer in order to be prepared to provide the most knowledgeable advice. Moreover, a salesman with a greater knowledge of the customer may be more successful in offering the right products or services that the customer will appreciate.
- a first embodiment of the present disclosure provides a method for a method for assisting a customer comprising the steps of: detecting, by a computer system, a client device of the customer entering a geofence established by the computer system; monitoring, by the computer system, a location of the computing device within the geofence; retrieving, by the computer system, customer data from a user profile loaded in a memory device of the computing device; overlaying, by the computer system, the customer data onto an augmented reality display device as a function of the location of the computing device being within a visible distance of the augmented reality display; further overlaying, by the computer system, a customer service guide onto the augmented reality display device, guiding how to assist the customer within the visible distance of the augmented display device; and dynamically updating, by the computer system, the customer data as a function of assisting the customer.
- a second embodiment of the present disclosure provides a computer system comprising a processor; a memory device coupled to the processor; an augmented display device placed into wireless communication with the processor, the augmented display device having a heads up display; and a computer readable storage device coupled to the processor, wherein the storage device contains program code executable by the processor via the memory device to implement a method for assisting a customer comprising the steps of: detecting, by a computer system, a computing device entering a geofence established by the computer system; monitoring, by the computer system, a location of the computing device within the geofence; retrieving, by the computer system, customer data from a user profile loaded in a memory device of the computing device; overlaying, by the computer system, the customer data onto an augmented reality display device as a function of the location of the computing device being within a visible distance of the augmented reality display; further overlaying, by the computer system, a customer service guide onto the augmented reality display device, guiding how to assist the customer within the visible distance of the augmented display device; and dynamic
- FIG. 1 depicts a block diagram of an embodiment of a system for assisting a customer.
- FIG. 2 a depicts an isometric view of an embodiment of an augmented reality display device.
- FIG. 2 b depicts a front view of the embodiment of the augmented reality display device of FIG. 2 a.
- FIG. 2 c depicts a side view of the embodiment of the augmented reality display device of FIG. 2 a
- FIG. 3 illustrates an embodiment of an augmented reality display device equipped by a user.
- FIG. 4 depicts a first person view of a user viewing a heads up display (HUD) of an augmented reality device.
- HUD heads up display
- FIG. 5 depicts a first person view of a user viewing an external environment through an embodiment of an augmented reality device.
- FIG. 6 depicts a top-down view of an embodiment of a store implementing a system for assisting a customer consistent with the figures and descriptions of the present disclosure.
- FIG. 7 depicts an embodiment of an algorithm for assisting a customer consistent with the systems, devices, methods and tools described throughout the present disclosure.
- FIG. 8 depicts a block diagram of a computer system able to implement the methods for assisting a customer consistent with the disclosure of the present application.
- the embodiments of the present disclosure leverage computing networks, online shopping systems, data collection and augmented reality systems in order to merge data collected during an online shopping experience by a customer with direct physical interactions that a customer may experience while shopping in a physical store. Employees or salesmen interacting with the customer in the physical store may be able to simultaneously view both the customer and customer data collected about the customer during the customer's online shopping experience.
- the employee or salesmen may be able to target the needs of the customers more efficiently, make more concise recommendations based on the customer's purchasing habits, assist the customer with finding items within the store or ordering items that may not be carried by the store and provide an unprompted status update about a customer's pickup order previously placed online, all the while maintaining proper customer service protocol and eye contact with the customer.
- Embodiments of the disclosed systems may bridge the gap between online shopping and physical shopping through the use of computer applications or programs that may be used by both the customer on the customer's client computing device and be accessible to a computer network maintained by the physical store location.
- the application or program loaded onto the customer's client device may store and save the customer's data as the customer uses the application to perform shopping functions.
- the customer may perform one or more actions using the application, such as browsing and select merchandise for purchase, creating shopping lists or wish lists, scheduling a pharmacy order, creating an order to be picked up at a physical store, rating one products, or any other function that may be available and known by a person skilled in the art.
- the application may save or track the customer's actions in a customer's profile and maintain the customer profile on the application's server which may be responsible for distributing the content of the application to the customer.
- a client device loaded with the shopping application may interact with a physical store's computer network.
- the client device communicating with the store's computer network may divulge the identity of the customer via the customer's profile, allowing for the one or more computer systems on the network to retrieve the customer's data stored by the customer's profile from the application server.
- the customer may set permissions for the store to retrieve and access the customer data generated by the shopping application.
- the retrieval of the customer's profile may be performed as a function of the customer's proximity to the physical store and/or the physical store's network.
- Embodiments of the system may establish a geofence around a store's location, monitoring the presence of client devices entering, exiting or dwelling within the geofence of the store.
- the customer's client device may use a global positioning system (GPS) or a Wi-Fi positioning system (WPS) of the store to geolocate the position of the client device in relation to the store's location.
- GPS global positioning system
- WPS Wi-Fi positioning system
- the client device may be identified to the store's computer network, triggering the computer network of the store to access the customer's profile and retrieve customer data from the application server storing the customer data.
- the geofencing system set up by the store's computer network may transmit the customer data for each customer client device entering the geofence that has the shopping application and profile accessible to the store's computer network to one or more augmented reality display devices.
- Each of the augmented reality display devices may be worn by a sales associate or other employee of the store.
- Embodiments of the augmented reality display devices may take the shape of any computing device, but in the exemplary embodiment the augmented reality device may be in the form of glasses. While wearing the glasses, the store's sales associate or employee may view customer data transmitted over the stores computer network while simultaneously viewing the physical world.
- the augmented reality display device may present the data in the form of augmented reality positioned on a heads up display (HUD) that may display the customer service data of a particular customer when the customer is viewed through the lenses if the augmented reality display device.
- HUD heads up display
- the employee or associate of the store may view customer data stored by the customer's profile, overlaid onto the physical world.
- the sales associate may engage the customer, ask to assist the customer and utilize the customer data being viewed through the augmented reality display device to provide a better customer service experience, by tailoring the interaction to the customer's specific needs based on the customer data displayed by the augmented reality display device.
- the customer service experience may be further enhanced by providing additional supplemental information and guidance to the augmented reality display device of the HUD by the augmented reality display device.
- the computer network of the store or enterprise may have access to additional knowledge bases, databases and data sources beyond the customer data being provided by the application data server of the customer's shopping application.
- the computer network may save and maintain a knowledge base, databases and repositories comprising retail store data describing an ideal set of customer service procedures and protocols for interacting with customers entering the store (standard operating procedures for customer engagement), the types of services offered by the store, employee staffing information and employee assignments.
- the store's computer network may transmit notes, reminders and steps for interacting with customers directly to the augmented reality devices.
- the HUD may further display a list of suggested services that may be applicable to the customer as well as identify opportunities to upsell the client on a particular product or service offered by the store.
- the augmented reality device may be equipped with a recording system such as a camera or microphone for storing the conversation between the store's associate and customer.
- the recorded data may be streamed over the computer network.
- the audio conversations and video recordings may be parsed and analyzed by an analytics or inference engine which may draw conclusions about the conversation between the sales associate and the customer. Based on the conclusions drawn by the analytics module or inference engine, the system may dynamically update the guideline and protocol reminders displayed by the augmented reality device.
- the recording system may store the audio and video recordings for teaching tools or evaluation tools. The recordings may demonstrate how a sales associate should or should not engage with a customer and/or be used to evaluate whether or not the sales associate properly followed customer service guidelines established by the store, enterprise or corporate offices.
- FIG. 1 illustrates a diagram of an embodiment of a system 100 for assisting customers, consistent with the disclosures of this application.
- Embodiments of systems 100 may comprise one or more specialized computer systems 103 , 131 , 143 , 149 , 151 each having a specialized configuration of hardware, software or a combination thereof as depicted in FIGS. 1-6 and as described throughout the present disclosure.
- Embodiments of the computer systems 103 , 131 , 143 , 149 , 151 may further comprise one or more elements of the generic computer system 800 of FIG. 8 , described in detail below.
- the elements of the generic computer system 800 may be integrated into each of the specialized computer systems 103 , 131 , 143 , 149 , 151 described herein.
- Embodiments of the computer systems 103 , 131 , 143 , 149 , 151 may be a specialized computer system which may include one or more processors 116 , specialized hardware or circuitry and/or software loaded in the memory device 114 of the computer systems 103 , 131 , 143 , 149 , 151 .
- the embodiments of the computer systems 103 , 131 , 143 , 149 , 151 may perform functions, tasks and routines relating to the establishment of geofences, identifying the location of each customer via the customer's client device, customer profile and customer data management, transmission and display of customer data, customer service protocols which may be in accordance with a store's standard operating procedures, store services, upselling suggestions, and employee and staffing information which may each be provided to an augmented reality display device.
- the augmented reality display device may be recording and analyzing customer interactions in accordance with the standard operating procedures (SOPs) defining the customer engagement process, and evaluating the customer service interactions for compliance with the SOPs.
- SOPs standard operating procedures
- Embodiments of the computer systems 103 , 131 , 143 , 149 , 151 may be connected and placed in communication with one another as well as additional computer systems or hardware, over a computer network 120 .
- Embodiments of the network 120 may be constructed using wired or wireless connections between each hardware component connected to the network 120 .
- each of the computer systems 103 , 131 , 143 , 149 , 151 incorporated into the network 120 may connect to the network 120 and communicate over the network 120 using a network interface controller (NIC) 122 or other network communication device.
- NIC network interface controller
- Embodiments of the NIC 122 may implement specialized electronic circuitry allowing for communication using a specific physical layer and a data link layer standard, such as Ethernet, Fiber channel, Wi-Fi or Token Ring.
- the NIC 122 may further allow for a full network protocol stack, enabling communication over network 120 to the group of computer systems or other computing hardware devices linked together through communication channels.
- the network 120 may facilitate communication and resource sharing among the computer systems 103 , 131 , 143 , 149 , 151 and additional hardware devices connected to the network 120 , for example a network accessible data repository 153 or other network accessible storage devices connected to the network 120 .
- Examples of network 120 may include a local area network (LAN), home area network (HAN), wide area network (WAN), back bone networks (BBN), peer to peer networks (P2P), campus networks, enterprise networks, the Internet, cloud computing networks and any other network known by a person skilled in the art.
- LAN local area network
- HAN home area network
- WAN wide area network
- BBN back bone networks
- P2P peer to peer networks
- campus networks enterprise networks
- the Internet the Internet
- cloud computing networks any other network known by a person skilled in the art.
- Embodiments of the system 100 may be managed and controlled by a computer management system 103 .
- the computer management system 103 may operate as a central node on the network 120 and may be responsible for creating the geofence around the store, tracking the location of client devices 143 entering the geofence, tracking the locations of augmented reality devices 131 , retrieving customer data stored by the customer's profile 147 , from one or more web servers or application data servers 149 and transmitting the customer data to each augmented reality display device 131 , managing data recorded during the customer interactions between customers and associates, as well as providing supplementary support data to the augmented reality display devices 131 such as inventory data and mapping data for the store.
- Embodiments of the computer management system 103 may include specialized hardware and/or software integrated into the computer management system 103 performing each of the functions of the computer management system relating to geofences, location data, profile management, inventory management, mapping, customer service protocol, recording, associate evaluations and management of augmented reality display devices.
- the specialized components of the computer management system 103 implementing each function or task may be part of a customer interaction module 105 .
- the hardware and/or software components of the customer interaction module 105 may include one or more sub modules in some embodiments.
- modules may include a geofence module 107 , location module 109 , profile module 115 inventory module 117 , augmented display module 119 , mapping module 121 , protocol module 123 , recording module 127 and evaluation module 129 .
- module may refer to a hardware module, software-based module or a module may be a combination of hardware and software resources of a computer system and/or resources remotely accessible to the computer system via the computer network 120 .
- Embodiments of the modules described in this application may be designed to implement or execute one or more particular functions, tasks or routines of the computer system computer management system 103 described herein.
- Embodiments of hardware-based modules may include self-contained components such as chipsets, specialized circuitry and one or more memory devices comprising a memory storage medium (described below).
- a software-based module may be part of a program code or linked to program code or computer code 897 , 898 containing specific programmed instructions loaded into a memory device 114 of the computer management system 103 , and/or a remotely accessible memory device 114 of a network accessible computer system 131 , 143 , 149 accessed remotely over the network 120 .
- the network accessible computer system connected to computer system 103 may be a web server, application server 149 , client device 143 , augmented reality display device 131 or network accessible hardware such as a network repeater 151 a , 151 b . . . 151 n (hereinafter network repeater 151 ), network repository 153 or a storewide database 155 .
- network repeater 151 a network repeater 151 a , 151 b . . . 151 n
- network repository 153 or a storewide database 155 .
- Embodiments of the computer management system 103 may include a geofence module 107 which may be part of the customer interaction module 105 .
- the geofence module 107 may be responsible for performing the tasks or functions of creating, monitoring and deleting geofence locations.
- a geofence may refer to a virtual geographic boundary which may be defined by a GPS, RFID, Wi-Fi, Bluetooth, or other locational positioning technologies.
- a created geofence enables software to trigger a response or event when a computer system enters the geofence, exits the geofence or dwells within the geofence for a predetermined length of time.
- Embodiments of a geofence module 107 may establish a geofence boundary around the perimeter of a store housing the computer network 120 and/or the computer management system.
- Embodiments of the geofences created by the geofence module 107 may be used to trigger the identification of client devices 143 entering a store surrounded by the geofence, initiate the retrieval of identifying customer profile information stored by the client device 143 and further allow for the computer management system 103 to utilize the customer profile information to retrieve customer data from a web server or application server 149 storing the customer data.
- a customer arriving at the store may have a client device 143 , such as a smart phone, cell phone, tablet computer laptop or other mobile computing device with them.
- the client device 143 may be equipped with a shopping application 145 affiliated with the store the customer has arrived at and may store customer data to a profile 147 .
- the customer may set permission to the shopping application 145 to communicate the profile 147 data to the affiliated store. As the customer enters the store, the customer may cross the geofence boundary which may trigger a series of identifying events, namely the connection of the client device to the network 120 and the identification of the customer via the profile 147 loaded onto the memory the of client device 143 's shopping application 145 .
- Embodiments of the computer management system 103 may track the location of client devices 143 as well as augmented reality display devices 131 within range of the network 120 and the geofence.
- the location module 109 may be responsible for keeping track of the movement and position of client devices 143 and augmented reality display devices 131 proximate to the store and within the store.
- location module 109 may collect location data being broadcasted by each client device 143 and/or augmented reality display device 131 .
- Location data collected by the location module 109 may be stored by the computer management system 103 in a local data storage device 118 or remotely on the network 120 in a network accessible data repository 153 .
- Embodiments of the location module 109 may be able to identify the locations of client devices and augmented reality display devices 131 using multiple types of location technologies. Embodiments of the location module 109 may use long range location technologies such as GPS tracking or cell tower triangulation. Long range location technologies may be useful for identifying the location of the customer's client device 143 while the client device 143 is outside of the range of the stores computer network 120 . In the exemplary embodiment of the system of FIG. 1 , the location module 109 may include a GPS tracking module 111 which may communicate with GPS satellites to send and receive coordinates of client devices 143 using the client device's 143 onboard GPS antenna.
- GPS tracking module 111 may communicate with GPS satellites to send and receive coordinates of client devices 143 using the client device's 143 onboard GPS antenna.
- short range location tracking hardware may be incorporated into the computer management system 103 through a wireless tracking module 113 .
- Under the computer network 120 may use wireless tracking or beacons to locate the position of client devices 143 and augmented reality display devices 131 inside a location and/or within a geofence established by the geofence module 107 .
- the short range wireless tracking may include Wi-Fi positioning, Bluetooth, Bluetooth LE, RFID, infrared or other radio wave based systems.
- the locations of client devices 143 and augmented reality display devices 131 may communicate with the network 120 over a Wi-Fi connection using a Wi-Fi positioning system (WPS).
- WPS Wi-Fi positioning system
- the distance between the Wi-Fi waves being sent and received by each client device 143 or augmented reality display device 131 may indicate the distance of each device from the Wi-Fi access point.
- a plurality of network repeaters 151 may be positioned throughout a store or other location. The emission of the Wi-Fi from the access point and each repeater 151 may be used to triangulate the approximate position of the client device 143 or the augmented reality display device 131 interacting with each set of Wi-Fi waves received by the client device 143 or the augmented reality display device 131 .
- FIG. 6 provides an example of using a combination of geofencing and wireless location tracking to identify the positions and movements of customers 401 a , 401 b , 401 c entering and dwelling within a geofence 603 surrounding store 601 .
- each customer 401 a , 401 b , 401 c may be equipped with a client device 143 a , 143 b , 143 c sending and receiving location data to the location module 109 of the computer network 120 .
- Each customer 401 being depicted in the drawing may be considered to be within a different state of the geofence 603 .
- customer 401 a is depicted as entering the geofence 603 .
- the customer 401 a is moving from the exterior side 610 of the geofence 603 across the geofence boundary 603 . While on the exterior side 610 of the geofence 603 , the customer 401 a may be tracked over a long range tracking system such as GPS. As customer 401 's associated client device 143 a enters the range of the network 120 and/or crosses the geofence boundary 603 , the computer management system 103 may switch location tracking modes from the GPS module 111 to the wireless module 113 as the customer's 401 a client device 143 a connects to the network 120 .
- a long range tracking system such as GPS.
- customers 401 b is shown to have been previously inside store 601 which is encompassed by the geofence 603 . While within the boundaries of the geofence 603 , the location of the customer's 401 b client device 143 b may have been tracked by the broadcasting access points of the network 120 delivering location data to the wireless tracking module 113 . As the customer 401 b moved throughout the store 601 , the network's repeaters 151 a , 151 b , 151 c amplifying the signal of the network's 120 wireless signal may use Wi-Fi or another short range wireless signal to position the customer 401 b using the wireless antenna of the client device 143 b .
- each network repeater 151 a , 151 b , 151 c may be placed in a different location throughout the store 601 .
- Each network repeater 151 may emit wireless signals 651 a , 651 b , 651 c from the network repeater 151 antenna.
- the amount of time it takes for the customer's 401 b client device to receive the wireless signal 651 a , 651 b , 651 c from each network repeater may allow for the wireless tracking module 113 to map the position of the customer 401 b within the store.
- the customer's 401 b client device 143 b exits the geofence 603 .
- the event of leaving the geofence 603 may cause the network 120 to switch tracking modes from the wireless tracking mode to a long range tracking mode, such as GPS, as the location module 109 continues to collect location data from customer 401 b.
- customer 401 c equipped with client device 143 c remains within the geofence 603 . While inside the geofence, customer 401 c 's position may be tracked by the wireless network based on the relative position of the customer 401 c to each of the network repeaters 151 positioned throughout the store.
- the wireless signals 651 a , 651 b , 651 c may be emitted from each network repeater 151 at a constant rate.
- the wireless module 113 may calculate the position of customer 401 c based on the timing and order in with the wireless signals 651 of each network repeater reach client device 143 c . As shown in FIG.
- wireless signals 651 c emitted from network repeater 151 c are closest to the client device 143 c .
- the wireless module can determine the customer's 401 c position. As the customer moves throughout the store, the timing of client's device 143 c receiving each set of wireless signals 651 may change, thus a change indicating a change in the customer's 403 c position relative to the emitted signals 651 .
- embodiments of the customer interaction module 105 of system 100 may include a profile module 115 .
- the profile module 115 may be responsible for performing the tasks and functions of managing each of the profiles 147 corresponding to the client device 143 entering the geofences created by the geofence module 107 .
- the profile module 115 may identify the profile 147 loaded onto the client device 143 by receiving profile identification information from the client device 143 and subsequently querying a web server or application server 149 for the profile data corresponding to the identified profile 147 .
- the profile module 115 may load the customer data corresponding to the queried profile 147 into the memory device 114 of the computer management system 103 for transmission of the customer data of the profile to an augmented reality display device 131 via the network 120 by the augmented display module 119 .
- Embodiments of the profile module 115 may, in some embodiments, further format and maintain the customer data of the customer profiles 147 in one or more data repositories 118 , 153 or databases 155 that may be either locally accessible or accessible over the network 120 .
- the profile module 115 may quickly load customer profiles 147 and may periodically update the customer data by regularly checking the web server or application data server 149 , retrieving the updated customer data and transmitting the updated customer data to the augmented reality display device 131 via the augmented display module 119 .
- changes to the customer data may be made by the profile module 115 and requests to alter the customer data stored by the profile 147 on the web server or application server 149 may be updated in accordance with the modified customer data uploaded to the server by the computer management system 103 .
- the customer interaction module 105 may comprise an inventory module 117 .
- the inventory module 117 may perform the task and function of tracking storewide inventory of products available for purchase, the locations of products within the store as well as the inventory of products available at other stores of an enterprise's chain of stores.
- Embodiments of the inventory module 117 store the information about a store's inventory as inventory data in an onboard memory device of the inventory module 117 , a local data storage device 118 or a network accessible storage device, such as the network repository 153 .
- the inventory module 117 may receive queries about the location and availability of inventory at the store from one or more sales associates, employees or customers. In response to a query request about a specific item or product of inventory, the inventory module 117 may query an inventory database, table or other data structure tracking the store's or enterprise's inventory such as the storewide database 155 . The inventory module 117 may return the results of the query to sales associate, employee or customer making the request. For example, a sales associate assisting a customer may receive a question about the availability of a specific product. The sales associate may transmit the query from the sale's associate's augmented reality display device 131 over the network 120 to the computer management system 103 .
- the inventory module may search the inventory database, table or data structure, retrieve the results and transmit the results to the augmented reality display device 131 , allowing for the sales associate to inform the customer of the status of the requested inventory information.
- the request for information about the inventory of the store may be made by a client device 143 connected to the network 120 .
- the inventory module may perform the query, receive the results, but instead of transmitting the results to the augmented reality display device 131 , the inventory module 117 may transmit the results of the inventory query back to the client device 143 .
- Embodiments of the computer management system 103 may further comprise a mapping module 121 .
- the mapping module 121 may create, store, update and transmit one or more mappings of locations, such as the layout of a particular store to the augmented reality display device 131 or client device 143 over the network 120 .
- the mapping module 121 may plot the locations of products carried by the store onto a map viewable to sales associates on the augmented reality display device 131 or directly to the customer's client device.
- the mapping module 121 may use the inventory module's inventory data describing the availability and locations of inventory within a store or enterprise to build the maps.
- the mapping module may plot the locations of the products onto a map or user interface viewable on the HUD 210 of the augmented reality display device 131 or a display device of the customer's client device 143 so that sales associates or customers may view the location of requested products.
- the mapping module 121 and the location module 109 may work together to provide a fully interactive map that may provide the location of the products, location of requester performing the query and tracking the movements of the requestor in real time on a mapping interface tracking the requester' progress as the requester moves through the store toward the product location, or further from the product location.
- the map of the store 407 and accompanying product locations 411 may be provided to an augmented reality display device 131 and displayed on a HUD 210 of the augmented reality display device 131 .
- the map may depict the current location 409 of the sales associate in relation to product locations 411 and track the progress of the sale's associates movement toward the product location 411 .
- the augmented reality display device 131 may utilize the augmented reality of the HUD to more easily identify a specific product 503 amongst the store's inventory. As shown in the example of FIG. 5 , a user of the augmented reality display device 131 may more easily identify a requested product by using the HUD 210 to highlight or accentuate to desired product among other products displayed on the store shelves, allowing for a sales associate to more easily find a product 503 at a much quicker glance.
- the customer interaction module may further comprise a protocol module 123 , which may be responsible for creating, retrieving, storing, updating and transmitting customer service guidelines and SOPs from one or more data sources to the augmented reality display device 131 .
- the customer service guidelines may include custom tailored procedures, rules and suggestions for engaging customers, listing available services, interacting with customers, upselling products or services, providing service suggestions and providing customer service to customers.
- the customer service guidelines may teach sales associates the proper way to greet customers, converse with customers, provide assistance, resolve customer disputes, provide product suggestions, upsell products or services, etc.
- the customer service guidelines and SOPs may vary depending on the data source of the guidelines.
- the customer service guidelines may be stored electronically in the onboard memory of the protocol module 123 , locally to a data storage device 118 of computer management system 103 or may be accessible to the computer management system 103 via the network 120 from a network accessible repository 153 , storewide accessible database 155 or other data source.
- Embodiments of the protocol module 123 may retrieve the customer service guidelines and SOPs from an electronic storage location or data structure and load the customer service guidelines into the memory device 114 of the computer management system 103 .
- the protocol module 123 may transmit situationally appropriate guidelines to a sales associate's HUD 210 as a reminder how to interact with customers or to assist with the sales associate with asking the correct questions of the customer, and to ensure that the sales associate performs the sale's associate's duties in a manner consistent with customer service guidelines and SOPs of the enterprise.
- the customer service guidelines and SOPs presented to the sale's associate's HUD 210 may be general reminders of the business's policies on performing quality customer service.
- the advice provided by the protocol module 123 to the augmented reality display device 131 may be context specific and/or customer specific depending on the customer the sales associate may be interacting with.
- the HUD 210 upon viewing a customer 401 , displays customer service guidelines 413 , advising the sales associate to engage the customer 401 , a reminder of the services offered by the store, tips or reminders to upsell particular products and services, inform the customer on the status of the customer's 401 orders 405 and to assist the customer 401 with the customer's shopping list.
- the customer service advice provided to the sales associates based on the customer service guidelines and SOPs may be dynamically updated as the conversation between the sales associate and customer progresses.
- the protocol module 123 may be equipped with an inference engine 125 .
- the inference engine 125 may receive context specific information about the sales associate's interaction with the customer, and using the interaction data and customer data, the inference engine may draw conclusions about the appropriate customer service guidelines and SOPs to provide to the HUD 210 .
- the inference engine 125 may be a rules-based system that may guide the conclusions drawn by the inference engine 125 .
- Embodiments of the inference engine 125 may draw different types of inferences from different conclusion strategies such as forward chaining and backward chaining.
- a forward chaining strategy occurs where data, such as conversational data recorded by the augmented reality display device, customer data and/or the customer service guidelines, are placed into the memory device 114 of the computer management system 103 or onboard memory of the protocol module 113 .
- rules may be triggered whose conditions match the new data, resulting in the performance of an action.
- the actions may add new data to memory, thus triggering more rules. And so on. This may be referred to called data-directed inference, because inference is triggered by the arrival of new data in working memory.
- a backward chaining methodology allows for the inference engine to know a value of a piece of data by searching for rules whose conclusions mention the particular piece of data.
- the inference engine may test the conditions which may entail discovering the value of more pieces of data. This may also be called goal-directed inference, or hypothesis driven, because inferences may not be performed until the inference engine 125 proves a particular goal.
- Interactions between the customer and sales associate may provide data to the protocol module 123 .
- the inference engine may use the progression of the conversation as data to draw conclusions about providing better customer service to the customer based on the conversation which may be recorded by a recording system 141 on the augmented reality display device 131 and parsed by the inference engine 125 for clues about the conversation.
- the conversational data, customer service data of the customer's profile when viewed in light of the customer service guidelines may allow for the inference engine 125 to draw conclusions on how to better service the customer.
- a sales associate may engage in a conversation with a customer after viewing customer data on a HUD 210 of an augmented reality display device 131 informing the store's associate that the customer's online order is ready for pickup.
- the inference engine may draw the conclusion that the associate should inform the client that the pickup order is ready and thus remind the associate to offer the pickup status to the customer.
- the conversation between the associate and customer may lead into the customer asking about a particular item that the associate may know is not in stock.
- the inference engine may conclude that based on the customer service guidelines, the associate should suggest an alternative to the out of stock item that is available at the store.
- the protocol module 123 may update the advice provided on the HUD 210 to suggest that the associate offer advice on alternative products.
- the protocol module 123 may even transmit a query to the inventory module 117 to identify alternative products available and forward the results to augmented reality display device 131 to display on the HUD 210 .
- Embodiments of the augmented display module 119 may perform the function and task of connecting, interfacing, transmitting and receiving data between the augmented reality display device 131 and the customer interaction module 105 of the computer management system 103 .
- Embodiments of the augmented display module 119 may control the stream of data provided to and received from the augmented reality display device.
- the augmented display module 119 may distribute data to each of the appropriate augmented reality display devices making requests.
- the augmented display module may control the flow of location data for each customer's client device 143 located within the store, the customer data tied to each customer's profile 147 , queries made to the inventory module 117 and mapping module 121 as well as the transmission and storage of audio or visual recordings maintained by the recording module 127 .
- Embodiments of the augmented display module 119 may further track the health and status of each augmented reality display device 131 .
- the augmented display module 119 may ensure that each augmented reality display device 131 is receiving an adequate power supply and is not suffering from a low battery, that the augmented reality display device 131 is maintaining a connection to network 120 and that the augmented reality display device 131 is appropriately located within the geofence created around a particular location.
- the augmented display module 119 may further troubleshoot errors, connectivity issues and errors in the display of the HUD, in order to correct these errors or determine whether maintenance on the augmented reality display device 131 may be needed.
- the computer management system 103 may be equipped with a recording module 127 .
- the recording module 127 may receive and store audio or visual recording created and saved by each of the on-board recording systems 141 of the augmented reality display devices.
- the recordings may be audio recordings recorded by a microphone, video recordings created by a camera device or a combination thereof.
- the recording module may organize and archive each of the recordings created by the augmented reality display devices 131 .
- the recording module 127 may be queried by a user or administrator of the computer management system searching for recordings that may have been previously stored by the recording module 127 , allowing for fast recall and loading of a particular recording by a specific augmented reality display device 131 at a particular moment in time.
- the recording module 127 may tag each recording with a date, time, device id number, and employee registered to the device at the time the recording occurred.
- the recordings archived by the recording module may be further used for evaluation and teaching purposes by an evaluation module 129 .
- Embodiments of the evaluation module may use the recordings for both employee training and the evaluation of employee performance.
- the evaluation module 129 may parse through selected recordings and present the recordings to a user of the computer management system or transmit the recordings to a network accessible computer system for viewing purposes.
- the evaluation module 129 may compare the recordings with the customer service guidelines to ensure that the employee operating the augmented reality display device 131 followed the guidelines while interacting with customers.
- the evaluation module 129 may evaluate the recordings for compliance with the customer service guidelines and assign a grade to the employee's performance.
- the evaluation module 129 may flag a recording for review by the employer or user in charge of reviewing employee conduct.
- the evaluation module 129 may allow for user of the computer management system 103 to remotely access and view the augmented reality display device 131 through the perspective of the sales associate or other user operating the augmented reality display device.
- the evaluation module 129 may allow a user of the computer management system 103 to remotely stream the audio or visual data from the recording system 141 to the computer management system 103 or another selected computer system on the network 120 , allowing for real time viewing of a sales associate's performance as the sales associate interacts with customers using the augmented reality display device 131 .
- FIG. 2 a to FIG. 3 depict an embodiment of the augmented reality display device 131 which may be worn the user 301 of the augmented reality display device 131 .
- the exemplary embodiment of the augmented reality display device 131 may be a pair of glasses comprising a frame 203 , a pair of arms 205 each comprising a hinge and a pair of lenses 207 .
- the frame 203 , arms 205 and lenses may be constructed out of any material known by a person skilled in the art of glasses construction.
- the underlying components of the glasses of the augmented reality display device 131 may be constructed out of various plastics, resins, rubbers, metals or metal alloys, etc.
- the exemplary embodiment of the augmented reality display device 131 is depicted as glasses, this should in no way be limiting to the appearance that the augmented reality display device may take. Glasses are merely one example and the augmented reality display device may take other forms that comprise computer system housed within a housing 201 capable of overlaying images projected by the computer system onto an augmented reality HUD 210 .
- the electrical and computing components of the augmented reality display device 131 may be installed into a housing 201 attached to the frame 203 or arms 205 of the augmented reality display device 131 .
- the computer system components integrated therein may include any of the components described by the computer system 800 of FIG. 8 discussed in detail below, including a processor 891 , memory devices 894 , 895 an input device 892 and an output device 893 (such as the viewable portion of the HUD 210 ).
- Additional specialized hardware and software components that may be integrated into the augmented reality display device 131 may include a display controller 131 , HUD module 135 , network interface controller 122 , profile manager 139 and recording system 141 .
- the display controller 133 may be an integrated circuit that generates a video signal displaying the images, data and graphical interface onto the HUD 210 .
- the display controller 133 may project the data received from the computer management system 103 including graphical text of the customer data 403 , 405 , inventory data, mapping data 407 and protocol data 413 generated using the customer service guidelines.
- the display controller 133 may operate in conjunction with the HUD module 133 which may be a software based component of the augmented reality display device 131 .
- the HUD module 135 may be responsible for the visually relaying the graphical data of the user interface of the operating system of the augmented reality display device 131 or the programs loaded into the memory device of either the augmented reality display device or computer management system onto the physical glass or plastic background of the HUD 210 .
- Embodiments of the profile manager 139 may control the profile information and customer data received from the computer management system 103 . Specifically, the profile manager may ensure that the correct customer data is properly viewed when in a viewable distance to the customer associated with the customer data. The profile manager 139 may control the customer data presentation on the HUD 210 , ensuring that the data relevant to the customer within viewing distance of the augmented reality display device 131 is the data being presented. This may ensure that the HUD does not become overcrowded or display data that is irrelevant due to another customer being nearby, but out of sight from the augmented reality display device 131 .
- the recording system 141 of the augmented reality display device 131 may comprise an onboard camera device, microphone or combination thereof.
- the recording system may be manually activated by the user 301 , remotely activated by the computer management system 103 (for example through the evaluation module 129 ) or automatically engaged as the user 301 engages a customer.
- the recording system may be consistently running and recording data, streaming the recorded data over the network 120 and storing the recorded data for later playback in a data storage device 118 or network accessible repository 153 .
- FIG. 7 represents an embodiment 700 of an algorithm that may be implemented for assisting customers, in accordance with the systems described in FIGS. 1-6 using one or more computer systems defined generically in FIG. 8 below, and more specifically by the specific embodiments depicted in FIGS. 1-6 .
- a person skilled in the art should recognize that the steps of the method described in FIG. 7 may not require all of the steps disclosed herein to be performed, nor does the algorithm of FIG. 7 necessarily require that all the steps be performed in the particular order presented. Variations of the method steps presented in FIG. 7 may be performed in a different order than presented by FIG. 7 .
- the algorithm 700 described in FIG. 7 may describe an embodiment for assisting customers using a combination of geofence technology, location tracking and augmented reality devices.
- the algorithm 700 may initiate in step 701 by creating a geofence having a virtual barrier surrounding a desired location.
- the geofence may be created, maintained and defined by the geofence creation tools integrated into the module 107 of the computer management system 103 .
- the computer management system 103 may use the created geofence to monitor the activity of customers via each customer client device 143 that enters into the geofence.
- the network 120 maintaining the computer management system 103 and comprising the geofence of step 701 may connect the network to the client device 143 of the customer 401 .
- the computer management system 103 may collect the location data of the client device 143 using the location module 109 as the client device 143 changes position while connected to the network, monitoring the client device's location relative to the geofence in step 705 .
- the tracking of the client device 143 may be performed using GPS while in alternative embodiments the location of the client device 143 may have its location tracked by the location module 109 using a wireless technique such as a Wi-Fi positioning system (WPS).
- WPS Wi-Fi positioning system
- step 707 of the algorithm 700 a determination may be made regarding whether or not the client device 143 of a customer has entered the geofence established by the geofence module 107 . If, the virtual barrier of the geofence created in step 701 has not been entered by the client device 143 , the algorithm 700 may simply continue to monitor the location of the client device 143 . However, if the client device 143 has entered the geofence established in step 701 , the algorithm 700 may proceed to step 709 . In step 709 , the computer management system 103 may identify the user profile 147 loaded into the memory of the client device 143 .
- the profile module 115 may in step 711 connect to an application data server 149 storing customer data relating to the profile 147 loaded into the client device 143 .
- the profile module 115 may retrieve customer data stored by the profile 147 and load the customer data into the memory device 114 of the computer management system 103 .
- the customer data collected by the profile module may be transmitted to the augmented reality display device for display 131 onto a HUD 210 of the display device 131 when the view of the HUD 210 comes into a viewing distance of the customer 401 who generated the customer data of the profile 147 . If, in step 715 it is determined that the user 301 of the augmented reality display device 131 is not within viewing distance of the customer/customer's client device 143 , the computer management system 103 may continue to monitor and compare the locations of both the customer's client device 143 and the augmented reality display device 131 to determine when both devices are within viewing distance of one another.
- the augmented reality display device 131 may overlay the customer data onto the HUD of the augmented reality display device 131 within the proximity of the customer, in a manner that may allow for the user 301 of the augmented reality display device 131 to simultaneously view the customer data on the HUD 210 and maintain eye contact with the customer 401 .
- a user 301 of the augmented reality display device 131 may engage a customer in an attempt to assist the customer based on the customer data provided on the HUD 210 of the augmented reality display device.
- the user 301 may help the customer 401 fulfill orders, pickup orders, provide status updates, locate products and inventory.
- the user 301 of the augmented reality display device 131 may amend the customer data stored by the application data server.
- the computer management system may acknowledge that a request for a service or product has been fulfilled by the user 301 or other store employee and the computer management system may update the customer data on the application data server 149 to properly reflect the assistance provided by the user 301 .
- FIG. 8 illustrates a block diagram of a computer system 800 that may be included in the systems of FIGS. 1-6 and for implementing methods for assisting a customer as described in FIG. 7 and in accordance with the embodiments described in the present disclosure.
- the computer system 800 may generally comprise a processor 891 , otherwise referred to as a central processing unit (CPU), an input device 892 coupled to the processor 891 , an output device 893 coupled to the processor 891 , and memory devices 894 and 895 each coupled to the processor 891 .
- the input device 892 , output device 893 and memory devices 894 , 895 may each be coupled to the processor 891 via a bus.
- Processor 891 may perform computations and control the functions of computer 800 , including executing instructions included in the computer code 897 for tools and programs for identifying errors in a multi-threaded application, in the manner prescribed by the embodiments of the disclosure using the systems of FIGS. 1-6 , wherein the instructions of the computer code 897 may be executed by processor 891 via memory device 895 .
- the computer code 897 may include software or program instructions that may implement one or more algorithms for implementing the methods for methods for assisting a customer, as described in detail above.
- the processor 891 executes the computer code 897 .
- Processor 891 may include a single processing unit, or may be distributed across one or more processing units in one or more locations (e.g., on a client and server).
- the memory device 894 may include input data 896 .
- the input data 896 includes any inputs required by the computer code 897 , 898 .
- the output device 893 displays output from the computer code 897 , 898 .
- Either or both memory devices 894 and 895 may be used as a computer usable storage medium (or program storage device) having a computer readable program embodied therein and/or having other data stored therein, wherein the computer readable program comprises the computer code 897 , 898 .
- a computer program product (or, alternatively, an article of manufacture) of the computer system 800 may comprise said computer usable storage medium (or said program storage device).
- Memory devices 894 , 895 include any known computer readable storage medium, including those described in detail below.
- cache memory elements of memory devices 894 , 895 may provide temporary storage of at least some program code (e.g., computer code 897 , 898 ) in order to reduce the number of times code must be retrieved from bulk storage while instructions of the computer code 897 , 898 are executed.
- memory devices 894 , 895 may reside at a single physical location, including one or more types of data storage, or be distributed across a plurality of physical systems in various forms.
- Memory devices 894 , 895 can include data distributed across, for example, a local area network (LAN) or a wide area network (WAN). Further, memory devices 894 , 895 may include an operating system (not shown) and may include other systems not shown in the figures.
- LAN local area network
- WAN wide area network
- stored computer program code 898 may be stored on a static, non-removable, read-only storage medium such as a Read-Only Memory (ROM) device 899 , or may be accessed by processor 891 directly from such a static, non-removable, read-only medium 899 .
- ROM Read-Only Memory
- stored computer program code 897 may be stored as computer-readable firmware 899 , or may be accessed by processor 891 directly from such firmware 899 , rather than from a more dynamic or removable hardware data-storage device 895 , such as a hard drive or optical disc.
- the computer system 800 may further be coupled to an Input/output (I/O) interface 112 and a computer data storage unit (for example a data store, data mart or repository).
- I/O interface 112 may include any system for exchanging information to or from an input device 892 or output device 893 .
- the input device 892 may be, inter alia, a keyboard, joystick, trackball, touchpad, mouse, sensors, beacons, RFID tags, microphones, biometric input device, camera system, timer, etc.
- the output device 893 may be, inter alia, a printer, a plotter, a display device (such as a computer screen or monitor), a magnetic tape, a removable hard disk, a floppy disk, etc.
- the memory devices 894 and 895 may be, inter alia, a hard disk, a floppy disk, a magnetic tape, an optical storage such as a compact disc (CD) or a digital video disc (DVD), a dynamic random access memory (DRAM), a read-only memory (ROM), etc.
- the bus may provide a communication link between each of the components in computer 800 , and may include any type of transmission link, including electrical, optical, wireless, etc.
- the I/O interface 112 may allow computer system 800 to store information (e.g., data or program instructions such as program code 897 , 898 ) on and retrieve the information from a computer data storage unit (not shown).
- Computer data storage units include any known computer-readable storage medium, which is described below.
- computer data storage unit may be a non-volatile data storage device, such as a magnetic disk drive (i.e., hard disk drive) or an optical disc drive (e.g., a CD-ROM drive which receives a CD-ROM disk).
- the present invention may be a method; in a second embodiment, the present invention may be a system; and in a third embodiment, the present invention may be a computer program product. Any of the components of the embodiments of the present invention can be deployed, managed, serviced, etc. by a service provider able to deploy or integrate computing infrastructure with respect identifying errors in a multi-threaded application.
- an embodiment of the present invention discloses a process for supporting computer infrastructure, where the process includes providing at least one support service for at least one of integrating, hosting, maintaining and deploying computer-readable code (e.g., program code 897 , 898 ) in a computer system (e.g., computer 800 ) including one or more processor(s) 891 , wherein the processor(s) carry out instructions contained in the computer code 897 causing the computer system to identify errors in an application.
- a process for supporting computer infrastructure where the process includes integrating computer-readable program code into a computer system including a processor.
- the step of integrating includes storing the program code in a computer-readable storage device of the computer system through use of the processor.
- the program code upon being executed by the processor, implements a method for assisting a customer described in this application.
- the present invention discloses a process for supporting, deploying and/or integrating computer infrastructure, integrating, hosting, maintaining, and deploying computer-readable code into the computer system 800 , wherein the code in combination with the computer system 800 is capable of performing a method of identifying errors in a multi-threaded application.
- a computer program product of the present invention comprises one or more computer readable hardware storage devices having computer readable program code stored therein, said program code containing instructions executable by one or more processors of a computer system to implement the methods of the present invention.
- a computer program product of the present invention comprises one or more computer readable hardware storage devices having computer readable program code stored therein, said program code containing instructions executable by one or more processors of a computer system to implement the methods of the present invention.
- a computer system of the present invention comprises one or more processors, one or more memories, and one or more computer readable hardware storage devices, said one or more hardware storage devices containing program code executable by the one or more processors via the one or more memories to implement the methods of the present invention.
- the present invention may be a system, a method, and/or a computer program product at any possible technical detail level of integration
- the computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention
- the computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device.
- the computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- a non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing.
- RAM random access memory
- ROM read-only memory
- EPROM or Flash memory erasable programmable read-only memory
- SRAM static random access memory
- CD-ROM compact disc read-only memory
- DVD digital versatile disk
- memory stick a floppy disk
- a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon
- a computer readable storage medium is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
- Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network.
- the network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.
- a network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
- Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, configuration data for integrated circuitry, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++, or the like, and procedural programming languages, such as the “C” programming language or similar programming languages.
- the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
- These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
- the computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
- the functions noted in the blocks may occur out of the order noted in the Figures.
- two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Landscapes
- Business, Economics & Management (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- General Physics & Mathematics (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Development Economics (AREA)
- Accounting & Taxation (AREA)
- Theoretical Computer Science (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Optics & Photonics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Game Theory and Decision Science (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- This invention claims priority to U.S. provisional patent application Ser. No. 62/480,949 filed Apr. 3, 2017 entitled “Customer Interaction System”, which is incorporated entirely herein by reference.
- The present disclosure relates generally to systems, methods and tools for providing customer service using augmented reality.
- Service industries, sales industries and employees thereof, are responsible for assisting customers and clients who seek out to receive goods and services a particular vendor. Often, it is recognized in the service and sales industries, establishing a relationship with customers can lead to increased trust between the customers and employee and ultimately lead to increased sales. One way to increase the relationship between a vendor and the customer is for the salesmen or employee of the vendor to increase their own personal knowledge and facts about the customer in order to be prepared to provide the most knowledgeable advice. Moreover, a salesman with a greater knowledge of the customer may be more successful in offering the right products or services that the customer will appreciate.
- A first embodiment of the present disclosure provides a method for a method for assisting a customer comprising the steps of: detecting, by a computer system, a client device of the customer entering a geofence established by the computer system; monitoring, by the computer system, a location of the computing device within the geofence; retrieving, by the computer system, customer data from a user profile loaded in a memory device of the computing device; overlaying, by the computer system, the customer data onto an augmented reality display device as a function of the location of the computing device being within a visible distance of the augmented reality display; further overlaying, by the computer system, a customer service guide onto the augmented reality display device, guiding how to assist the customer within the visible distance of the augmented display device; and dynamically updating, by the computer system, the customer data as a function of assisting the customer.
- A second embodiment of the present disclosure provides a computer system comprising a processor; a memory device coupled to the processor; an augmented display device placed into wireless communication with the processor, the augmented display device having a heads up display; and a computer readable storage device coupled to the processor, wherein the storage device contains program code executable by the processor via the memory device to implement a method for assisting a customer comprising the steps of: detecting, by a computer system, a computing device entering a geofence established by the computer system; monitoring, by the computer system, a location of the computing device within the geofence; retrieving, by the computer system, customer data from a user profile loaded in a memory device of the computing device; overlaying, by the computer system, the customer data onto an augmented reality display device as a function of the location of the computing device being within a visible distance of the augmented reality display; further overlaying, by the computer system, a customer service guide onto the augmented reality display device, guiding how to assist the customer within the visible distance of the augmented display device; and dynamically updating, by the computer system, the customer data as a function of assisting the customer.
-
FIG. 1 depicts a block diagram of an embodiment of a system for assisting a customer. -
FIG. 2a depicts an isometric view of an embodiment of an augmented reality display device. -
FIG. 2b depicts a front view of the embodiment of the augmented reality display device ofFIG. 2 a. -
FIG. 2c depicts a side view of the embodiment of the augmented reality display device ofFIG. 2 a, -
FIG. 3 illustrates an embodiment of an augmented reality display device equipped by a user. -
FIG. 4 depicts a first person view of a user viewing a heads up display (HUD) of an augmented reality device. -
FIG. 5 depicts a first person view of a user viewing an external environment through an embodiment of an augmented reality device. -
FIG. 6 depicts a top-down view of an embodiment of a store implementing a system for assisting a customer consistent with the figures and descriptions of the present disclosure. -
FIG. 7 depicts an embodiment of an algorithm for assisting a customer consistent with the systems, devices, methods and tools described throughout the present disclosure. -
FIG. 8 depicts a block diagram of a computer system able to implement the methods for assisting a customer consistent with the disclosure of the present application. - Although certain embodiments are shown and described in detail, it should be understood that various changes and modifications may be made without departing from the scope of the appended claims. The scope of the present disclosure will in no way be limited to the number of constituting components, the materials thereof, the shapes thereof, the relative arrangement thereof, etc., and are disclosed simply as an example of embodiments of the present disclosure. A more complete understanding of the present embodiments and advantages thereof may be acquired by referring to the following description taken in conjunction with the accompanying drawings, in which like reference numbers indicate like features.
- As a preface to the detailed description, it should be noted that, as used in this specification and the appended claims, the singular forms “a”, “an” and “the” include plural referents, unless the context clearly dictates otherwise.
- Traditionally, a gap has existed between online shopping and shopping in the physical world. In the realm of online shopping, powerful tools exist that allow for users to make purchases remotely, in the comfort of the user's home. Computer systems providing the content to the user as the user shops using the Internet, may utilize data analytics to analyze the user's behavior, track user activity and purchasing habits to allow for suggestions to be made to the user over the online shopping portal. Conversely, in the physical world, vendors, stores, and employees thereof learn about customers' needs and wants through active conversations between the employees and customers. Employees may be taught to engage customers, listen to the customers' needs and then address the needs by offering solutions and assistance based on the active conversation that has occurred.
- Under currently available systems, the separation between the online shopping space and the shopping space of the physical world limits the amount of data and insight an employee or salesmen may have available at their fingertips when meeting a customer for the first time. Currently available systems lack the ability for an employee or sales person to naturally obtain and inconspicuously view customer information collected over the course of the customer's online shopping experience while simultaneously interacting with the customer directly in the physical space of a store. The lack of immediately accessible information about the customer and the customer's preferences may place the salesmen or employee at a disadvantage while first engaging a customer in a physical setting. Being able to access information collected by online shopping systems that have already interacted with the customer in the past would allow for the salesmen in the physical space to better understand the customer, engage the customer and provide quality customer service, in a more efficient manner.
- The embodiments of the present disclosure leverage computing networks, online shopping systems, data collection and augmented reality systems in order to merge data collected during an online shopping experience by a customer with direct physical interactions that a customer may experience while shopping in a physical store. Employees or salesmen interacting with the customer in the physical store may be able to simultaneously view both the customer and customer data collected about the customer during the customer's online shopping experience. By viewing both the customer's data and speaking directly with a customer, the employee or salesmen may be able to target the needs of the customers more efficiently, make more concise recommendations based on the customer's purchasing habits, assist the customer with finding items within the store or ordering items that may not be carried by the store and provide an unprompted status update about a customer's pickup order previously placed online, all the while maintaining proper customer service protocol and eye contact with the customer.
- Embodiments of the disclosed systems may bridge the gap between online shopping and physical shopping through the use of computer applications or programs that may be used by both the customer on the customer's client computing device and be accessible to a computer network maintained by the physical store location. The application or program loaded onto the customer's client device may store and save the customer's data as the customer uses the application to perform shopping functions. For example, the customer may perform one or more actions using the application, such as browsing and select merchandise for purchase, creating shopping lists or wish lists, scheduling a pharmacy order, creating an order to be picked up at a physical store, rating one products, or any other function that may be available and known by a person skilled in the art. As the customer performs each of these functions, the application may save or track the customer's actions in a customer's profile and maintain the customer profile on the application's server which may be responsible for distributing the content of the application to the customer.
- A client device loaded with the shopping application may interact with a physical store's computer network. The client device communicating with the store's computer network may divulge the identity of the customer via the customer's profile, allowing for the one or more computer systems on the network to retrieve the customer's data stored by the customer's profile from the application server. The customer may set permissions for the store to retrieve and access the customer data generated by the shopping application. In some embodiments, the retrieval of the customer's profile may be performed as a function of the customer's proximity to the physical store and/or the physical store's network. Embodiments of the system, may establish a geofence around a store's location, monitoring the presence of client devices entering, exiting or dwelling within the geofence of the store. For example, the customer's client device may use a global positioning system (GPS) or a Wi-Fi positioning system (WPS) of the store to geolocate the position of the client device in relation to the store's location. As the client device's geolocation intersects with the virtual boundary of the store, the client device may be identified to the store's computer network, triggering the computer network of the store to access the customer's profile and retrieve customer data from the application server storing the customer data.
- In some embodiments of the system, the geofencing system set up by the store's computer network may transmit the customer data for each customer client device entering the geofence that has the shopping application and profile accessible to the store's computer network to one or more augmented reality display devices. Each of the augmented reality display devices may be worn by a sales associate or other employee of the store. Embodiments of the augmented reality display devices may take the shape of any computing device, but in the exemplary embodiment the augmented reality device may be in the form of glasses. While wearing the glasses, the store's sales associate or employee may view customer data transmitted over the stores computer network while simultaneously viewing the physical world. The augmented reality display device may present the data in the form of augmented reality positioned on a heads up display (HUD) that may display the customer service data of a particular customer when the customer is viewed through the lenses if the augmented reality display device. When viewing the physical world through the augmented reality display device, the employee or associate of the store may view customer data stored by the customer's profile, overlaid onto the physical world. As the associate or employee of the store comes into viewing distance of the customer (equipped with the client device which may be transmitting geolocation) the sales associate may engage the customer, ask to assist the customer and utilize the customer data being viewed through the augmented reality display device to provide a better customer service experience, by tailoring the interaction to the customer's specific needs based on the customer data displayed by the augmented reality display device.
- In some embodiments of the system, the customer service experience may be further enhanced by providing additional supplemental information and guidance to the augmented reality display device of the HUD by the augmented reality display device. In some embodiments, the computer network of the store or enterprise may have access to additional knowledge bases, databases and data sources beyond the customer data being provided by the application data server of the customer's shopping application. For example, the computer network may save and maintain a knowledge base, databases and repositories comprising retail store data describing an ideal set of customer service procedures and protocols for interacting with customers entering the store (standard operating procedures for customer engagement), the types of services offered by the store, employee staffing information and employee assignments. The store's computer network may transmit notes, reminders and steps for interacting with customers directly to the augmented reality devices. As the store associates and salesmen engage and interact with each customer, reminders of the best practices and guidelines of the stores customer service protocol according to the standard operating procedures may be displayed by the HUD for the store associate to follow. Additionally, as the employee interacts with the customer, the HUD may further display a list of suggested services that may be applicable to the customer as well as identify opportunities to upsell the client on a particular product or service offered by the store.
- In some embodiments, the augmented reality device may be equipped with a recording system such as a camera or microphone for storing the conversation between the store's associate and customer. The recorded data may be streamed over the computer network. In some embodiments of the system, the audio conversations and video recordings may be parsed and analyzed by an analytics or inference engine which may draw conclusions about the conversation between the sales associate and the customer. Based on the conclusions drawn by the analytics module or inference engine, the system may dynamically update the guideline and protocol reminders displayed by the augmented reality device. Moreover, in some embodiments of the system, the recording system may store the audio and video recordings for teaching tools or evaluation tools. The recordings may demonstrate how a sales associate should or should not engage with a customer and/or be used to evaluate whether or not the sales associate properly followed customer service guidelines established by the store, enterprise or corporate offices.
- Referring to the drawings,
FIG. 1 illustrates a diagram of an embodiment of asystem 100 for assisting customers, consistent with the disclosures of this application. Embodiments ofsystems 100 may comprise one or morespecialized computer systems FIGS. 1-6 and as described throughout the present disclosure. Embodiments of thecomputer systems generic computer system 800 ofFIG. 8 , described in detail below. The elements of thegeneric computer system 800 may be integrated into each of thespecialized computer systems - Embodiments of the
computer systems more processors 116, specialized hardware or circuitry and/or software loaded in thememory device 114 of thecomputer systems computer systems - Embodiments of the
computer systems computer network 120. Embodiments of thenetwork 120 may be constructed using wired or wireless connections between each hardware component connected to thenetwork 120. As shown in the exemplary embodiment ofFIG. 1 , each of thecomputer systems network 120 may connect to thenetwork 120 and communicate over thenetwork 120 using a network interface controller (NIC) 122 or other network communication device. Embodiments of theNIC 122 may implement specialized electronic circuitry allowing for communication using a specific physical layer and a data link layer standard, such as Ethernet, Fiber channel, Wi-Fi or Token Ring. TheNIC 122 may further allow for a full network protocol stack, enabling communication overnetwork 120 to the group of computer systems or other computing hardware devices linked together through communication channels. Thenetwork 120 may facilitate communication and resource sharing among thecomputer systems network 120, for example a networkaccessible data repository 153 or other network accessible storage devices connected to thenetwork 120. Examples ofnetwork 120 may include a local area network (LAN), home area network (HAN), wide area network (WAN), back bone networks (BBN), peer to peer networks (P2P), campus networks, enterprise networks, the Internet, cloud computing networks and any other network known by a person skilled in the art. - Embodiments of the
system 100, and functions performed by the computer systems connected to thecomputer network 120 may be managed and controlled by acomputer management system 103. Thecomputer management system 103 may operate as a central node on thenetwork 120 and may be responsible for creating the geofence around the store, tracking the location ofclient devices 143 entering the geofence, tracking the locations ofaugmented reality devices 131, retrieving customer data stored by the customer'sprofile 147, from one or more web servers orapplication data servers 149 and transmitting the customer data to each augmentedreality display device 131, managing data recorded during the customer interactions between customers and associates, as well as providing supplementary support data to the augmentedreality display devices 131 such as inventory data and mapping data for the store. - Embodiments of the
computer management system 103 may include specialized hardware and/or software integrated into thecomputer management system 103 performing each of the functions of the computer management system relating to geofences, location data, profile management, inventory management, mapping, customer service protocol, recording, associate evaluations and management of augmented reality display devices. The specialized components of thecomputer management system 103, implementing each function or task may be part of acustomer interaction module 105. The hardware and/or software components of thecustomer interaction module 105 may include one or more sub modules in some embodiments. These sub modules may include ageofence module 107,location module 109,profile module 115inventory module 117, augmenteddisplay module 119,mapping module 121,protocol module 123,recording module 127 andevaluation module 129. As used herein, the term “module” may refer to a hardware module, software-based module or a module may be a combination of hardware and software resources of a computer system and/or resources remotely accessible to the computer system via thecomputer network 120. - Embodiments of the modules described in this application, whether comprising hardware, software or a combination of resources thereof, may be designed to implement or execute one or more particular functions, tasks or routines of the computer system
computer management system 103 described herein. Embodiments of hardware-based modules may include self-contained components such as chipsets, specialized circuitry and one or more memory devices comprising a memory storage medium (described below). A software-based module may be part of a program code or linked to program code orcomputer code memory device 114 of thecomputer management system 103, and/or a remotelyaccessible memory device 114 of a networkaccessible computer system network 120. For example, in some embodiments the network accessible computer system connected tocomputer system 103 may be a web server,application server 149,client device 143, augmentedreality display device 131 or network accessible hardware such as anetwork repeater network repository 153 or astorewide database 155. - Embodiments of the
computer management system 103 may include ageofence module 107 which may be part of thecustomer interaction module 105. Thegeofence module 107 may be responsible for performing the tasks or functions of creating, monitoring and deleting geofence locations. A geofence may refer to a virtual geographic boundary which may be defined by a GPS, RFID, Wi-Fi, Bluetooth, or other locational positioning technologies. A created geofence enables software to trigger a response or event when a computer system enters the geofence, exits the geofence or dwells within the geofence for a predetermined length of time. Embodiments of ageofence module 107 may establish a geofence boundary around the perimeter of a store housing thecomputer network 120 and/or the computer management system. - Embodiments of the geofences created by the
geofence module 107 may be used to trigger the identification ofclient devices 143 entering a store surrounded by the geofence, initiate the retrieval of identifying customer profile information stored by theclient device 143 and further allow for thecomputer management system 103 to utilize the customer profile information to retrieve customer data from a web server orapplication server 149 storing the customer data. For example, a customer arriving at the store may have aclient device 143, such as a smart phone, cell phone, tablet computer laptop or other mobile computing device with them. Theclient device 143 may be equipped with ashopping application 145 affiliated with the store the customer has arrived at and may store customer data to aprofile 147. The customer may set permission to theshopping application 145 to communicate theprofile 147 data to the affiliated store. As the customer enters the store, the customer may cross the geofence boundary which may trigger a series of identifying events, namely the connection of the client device to thenetwork 120 and the identification of the customer via theprofile 147 loaded onto the memory the ofclient device 143'sshopping application 145. - Embodiments of the
computer management system 103 may track the location ofclient devices 143 as well as augmentedreality display devices 131 within range of thenetwork 120 and the geofence. Thelocation module 109 may be responsible for keeping track of the movement and position ofclient devices 143 and augmentedreality display devices 131 proximate to the store and within the store. In some embodiments of thesystem 100,location module 109 may collect location data being broadcasted by eachclient device 143 and/or augmentedreality display device 131. Location data collected by thelocation module 109 may be stored by thecomputer management system 103 in a localdata storage device 118 or remotely on thenetwork 120 in a networkaccessible data repository 153. - Embodiments of the
location module 109 may be able to identify the locations of client devices and augmentedreality display devices 131 using multiple types of location technologies. Embodiments of thelocation module 109 may use long range location technologies such as GPS tracking or cell tower triangulation. Long range location technologies may be useful for identifying the location of the customer'sclient device 143 while theclient device 143 is outside of the range of thestores computer network 120. In the exemplary embodiment of the system ofFIG. 1 , thelocation module 109 may include aGPS tracking module 111 which may communicate with GPS satellites to send and receive coordinates ofclient devices 143 using the client device's 143 onboard GPS antenna. - Alternatively, for a more precise location tracking, particularly indoors, short range location tracking hardware may be incorporated into the
computer management system 103 through awireless tracking module 113. Under thecomputer network 120 may use wireless tracking or beacons to locate the position ofclient devices 143 and augmentedreality display devices 131 inside a location and/or within a geofence established by thegeofence module 107. In some embodiments, the short range wireless tracking may include Wi-Fi positioning, Bluetooth, Bluetooth LE, RFID, infrared or other radio wave based systems. In the exemplary embodiment, the locations ofclient devices 143 and augmentedreality display devices 131 may communicate with thenetwork 120 over a Wi-Fi connection using a Wi-Fi positioning system (WPS). The distance between the Wi-Fi waves being sent and received by eachclient device 143 or augmentedreality display device 131 may indicate the distance of each device from the Wi-Fi access point. For a more accurate positioning, a plurality of network repeaters 151 may be positioned throughout a store or other location. The emission of the Wi-Fi from the access point and each repeater 151 may be used to triangulate the approximate position of theclient device 143 or the augmentedreality display device 131 interacting with each set of Wi-Fi waves received by theclient device 143 or the augmentedreality display device 131. - Referring to the drawings,
FIG. 6 provides an example of using a combination of geofencing and wireless location tracking to identify the positions and movements ofcustomers geofence 603 surroundingstore 601. As depicted in the drawing, eachcustomer client device location module 109 of thecomputer network 120. Eachcustomer 401 being depicted in the drawing may be considered to be within a different state of thegeofence 603. For example,customer 401 a is depicted as entering thegeofence 603. Thecustomer 401 a is moving from theexterior side 610 of thegeofence 603 across thegeofence boundary 603. While on theexterior side 610 of thegeofence 603, thecustomer 401 a may be tracked over a long range tracking system such as GPS. Ascustomer 401's associatedclient device 143 a enters the range of thenetwork 120 and/or crosses thegeofence boundary 603, thecomputer management system 103 may switch location tracking modes from theGPS module 111 to thewireless module 113 as the customer's 401 aclient device 143 a connects to thenetwork 120. - Conversely,
customers 401 b is shown to have been previously insidestore 601 which is encompassed by thegeofence 603. While within the boundaries of thegeofence 603, the location of the customer's 401b client device 143 b may have been tracked by the broadcasting access points of thenetwork 120 delivering location data to thewireless tracking module 113. As thecustomer 401 b moved throughout thestore 601, the network'srepeaters customer 401 b using the wireless antenna of theclient device 143 b. As shown in the drawing, eachnetwork repeater store 601. Each network repeater 151 may emit wireless signals 651 a, 651 b, 651 c from the network repeater 151 antenna. The amount of time it takes for the customer's 401 b client device to receive thewireless signal wireless tracking module 113 to map the position of thecustomer 401 b within the store. However, ascustomer 401 b exits through thedoor 605 of thestore 601, the customer's 401b client device 143 b exits thegeofence 603. The event of leaving thegeofence 603 may cause thenetwork 120 to switch tracking modes from the wireless tracking mode to a long range tracking mode, such as GPS, as thelocation module 109 continues to collect location data fromcustomer 401 b. - Similar to
customer 401 b, customer 401 c equipped with client device 143 c remains within thegeofence 603. While inside the geofence, customer 401 c's position may be tracked by the wireless network based on the relative position of the customer 401 c to each of the network repeaters 151 positioned throughout the store. The wireless signals 651 a, 651 b, 651 c may be emitted from each network repeater 151 at a constant rate. Thus, thewireless module 113 may calculate the position of customer 401 c based on the timing and order in with the wireless signals 651 of each network repeater reach client device 143 c. As shown inFIG. 6 , it can be see that wireless signals 651 c emitted fromnetwork repeater 151 c are closest to the client device 143 c. Subsequently, depending on the amount of time it takes forwireless waves - Referring back to
FIG. 1 , embodiments of thecustomer interaction module 105 ofsystem 100 may include aprofile module 115. Theprofile module 115 may be responsible for performing the tasks and functions of managing each of theprofiles 147 corresponding to theclient device 143 entering the geofences created by thegeofence module 107. Theprofile module 115 may identify theprofile 147 loaded onto theclient device 143 by receiving profile identification information from theclient device 143 and subsequently querying a web server orapplication server 149 for the profile data corresponding to the identifiedprofile 147. Theprofile module 115 may load the customer data corresponding to the queriedprofile 147 into thememory device 114 of thecomputer management system 103 for transmission of the customer data of the profile to an augmentedreality display device 131 via thenetwork 120 by the augmenteddisplay module 119. - Embodiments of the
profile module 115 may, in some embodiments, further format and maintain the customer data of the customer profiles 147 in one ormore data repositories databases 155 that may be either locally accessible or accessible over thenetwork 120. By storing customer data in one ormore data repositories databases 155, theprofile module 115 may quickly loadcustomer profiles 147 and may periodically update the customer data by regularly checking the web server orapplication data server 149, retrieving the updated customer data and transmitting the updated customer data to the augmentedreality display device 131 via theaugmented display module 119. Furthermore, in some embodiments, changes to the customer data may be made by theprofile module 115 and requests to alter the customer data stored by theprofile 147 on the web server orapplication server 149 may be updated in accordance with the modified customer data uploaded to the server by thecomputer management system 103. - In some embodiments of the
computer management system 103, thecustomer interaction module 105 may comprise aninventory module 117. Theinventory module 117 may perform the task and function of tracking storewide inventory of products available for purchase, the locations of products within the store as well as the inventory of products available at other stores of an enterprise's chain of stores. Embodiments of theinventory module 117 store the information about a store's inventory as inventory data in an onboard memory device of theinventory module 117, a localdata storage device 118 or a network accessible storage device, such as thenetwork repository 153. - The
inventory module 117 may receive queries about the location and availability of inventory at the store from one or more sales associates, employees or customers. In response to a query request about a specific item or product of inventory, theinventory module 117 may query an inventory database, table or other data structure tracking the store's or enterprise's inventory such as thestorewide database 155. Theinventory module 117 may return the results of the query to sales associate, employee or customer making the request. For example, a sales associate assisting a customer may receive a question about the availability of a specific product. The sales associate may transmit the query from the sale's associate's augmentedreality display device 131 over thenetwork 120 to thecomputer management system 103. In response to the query request, the inventory module may search the inventory database, table or data structure, retrieve the results and transmit the results to the augmentedreality display device 131, allowing for the sales associate to inform the customer of the status of the requested inventory information. In an alternative example, the request for information about the inventory of the store may be made by aclient device 143 connected to thenetwork 120. Under such circumstances, the inventory module may perform the query, receive the results, but instead of transmitting the results to the augmentedreality display device 131, theinventory module 117 may transmit the results of the inventory query back to theclient device 143. - Embodiments of the
computer management system 103 may further comprise amapping module 121. Themapping module 121 may create, store, update and transmit one or more mappings of locations, such as the layout of a particular store to the augmentedreality display device 131 orclient device 143 over thenetwork 120. Themapping module 121 may plot the locations of products carried by the store onto a map viewable to sales associates on the augmentedreality display device 131 or directly to the customer's client device. Themapping module 121 may use the inventory module's inventory data describing the availability and locations of inventory within a store or enterprise to build the maps. Once the location of the products has been identified by themapping module 121, the mapping module may plot the locations of the products onto a map or user interface viewable on theHUD 210 of the augmentedreality display device 131 or a display device of the customer'sclient device 143 so that sales associates or customers may view the location of requested products. - In some embodiments, the
mapping module 121 and thelocation module 109 may work together to provide a fully interactive map that may provide the location of the products, location of requester performing the query and tracking the movements of the requestor in real time on a mapping interface tracking the requester' progress as the requester moves through the store toward the product location, or further from the product location. In the exemplary embodiment, the map of thestore 407 and accompanyingproduct locations 411 may be provided to an augmentedreality display device 131 and displayed on aHUD 210 of the augmentedreality display device 131. The map may depict thecurrent location 409 of the sales associate in relation toproduct locations 411 and track the progress of the sale's associates movement toward theproduct location 411. By projecting the locations of products of interest onto themap 407, the sales associate can seamlessly and accurately guide a customer to the products without becoming lost or inadvertently misguide the customer to an incorrect location. - In another example shown in
FIG. 5 , the augmentedreality display device 131 may utilize the augmented reality of the HUD to more easily identify aspecific product 503 amongst the store's inventory. As shown in the example ofFIG. 5 , a user of the augmentedreality display device 131 may more easily identify a requested product by using theHUD 210 to highlight or accentuate to desired product among other products displayed on the store shelves, allowing for a sales associate to more easily find aproduct 503 at a much quicker glance. - Embodiments of the
computer management system 103, the customer interaction module may further comprise aprotocol module 123, which may be responsible for creating, retrieving, storing, updating and transmitting customer service guidelines and SOPs from one or more data sources to the augmentedreality display device 131. The customer service guidelines may include custom tailored procedures, rules and suggestions for engaging customers, listing available services, interacting with customers, upselling products or services, providing service suggestions and providing customer service to customers. For example, the customer service guidelines may teach sales associates the proper way to greet customers, converse with customers, provide assistance, resolve customer disputes, provide product suggestions, upsell products or services, etc. The customer service guidelines and SOPs may vary depending on the data source of the guidelines. Different franchises, store locations and enterprises may have different opinions on how customer service may be implemented and these differences may be codified in the customer service guidelines and SOPs of a particular business. The customer service guidelines may be stored electronically in the onboard memory of theprotocol module 123, locally to adata storage device 118 ofcomputer management system 103 or may be accessible to thecomputer management system 103 via thenetwork 120 from a networkaccessible repository 153, storewideaccessible database 155 or other data source. - Embodiments of the
protocol module 123 may retrieve the customer service guidelines and SOPs from an electronic storage location or data structure and load the customer service guidelines into thememory device 114 of thecomputer management system 103. Theprotocol module 123 may transmit situationally appropriate guidelines to a sales associate'sHUD 210 as a reminder how to interact with customers or to assist with the sales associate with asking the correct questions of the customer, and to ensure that the sales associate performs the sale's associate's duties in a manner consistent with customer service guidelines and SOPs of the enterprise. In some embodiments, the customer service guidelines and SOPs presented to the sale's associate'sHUD 210 may be general reminders of the business's policies on performing quality customer service. In other embodiments, the advice provided by theprotocol module 123 to the augmentedreality display device 131 may be context specific and/or customer specific depending on the customer the sales associate may be interacting with. For example, inFIG. 4 , upon viewing acustomer 401, theHUD 210 displayscustomer service guidelines 413, advising the sales associate to engage thecustomer 401, a reminder of the services offered by the store, tips or reminders to upsell particular products and services, inform the customer on the status of the customer's 401orders 405 and to assist thecustomer 401 with the customer's shopping list. - In some embodiments, the customer service advice provided to the sales associates based on the customer service guidelines and SOPs may be dynamically updated as the conversation between the sales associate and customer progresses. In order to provide and display proper advice on the
HUD 210 of the augmented reality display device, theprotocol module 123 may be equipped with aninference engine 125. Theinference engine 125 may receive context specific information about the sales associate's interaction with the customer, and using the interaction data and customer data, the inference engine may draw conclusions about the appropriate customer service guidelines and SOPs to provide to theHUD 210. Theinference engine 125 may be a rules-based system that may guide the conclusions drawn by theinference engine 125. - Embodiments of the
inference engine 125 may draw different types of inferences from different conclusion strategies such as forward chaining and backward chaining. A forward chaining strategy occurs where data, such as conversational data recorded by the augmented reality display device, customer data and/or the customer service guidelines, are placed into thememory device 114 of thecomputer management system 103 or onboard memory of theprotocol module 113. As the data is analyzed by theinference engine 125, rules may be triggered whose conditions match the new data, resulting in the performance of an action. The actions may add new data to memory, thus triggering more rules. And so on. This may be referred to called data-directed inference, because inference is triggered by the arrival of new data in working memory. Conversely, a backward chaining methodology, allows for the inference engine to know a value of a piece of data by searching for rules whose conclusions mention the particular piece of data. Before using the rules under a backward chaining strategy, the inference engine may test the conditions which may entail discovering the value of more pieces of data. This may also be called goal-directed inference, or hypothesis driven, because inferences may not be performed until theinference engine 125 proves a particular goal. - Interactions between the customer and sales associate may provide data to the
protocol module 123. The inference engine may use the progression of the conversation as data to draw conclusions about providing better customer service to the customer based on the conversation which may be recorded by arecording system 141 on the augmentedreality display device 131 and parsed by theinference engine 125 for clues about the conversation. The conversational data, customer service data of the customer's profile when viewed in light of the customer service guidelines may allow for theinference engine 125 to draw conclusions on how to better service the customer. - For example, a sales associate may engage in a conversation with a customer after viewing customer data on a
HUD 210 of an augmentedreality display device 131 informing the store's associate that the customer's online order is ready for pickup. Based on the customer data, and customer service guidelines, the inference engine may draw the conclusion that the associate should inform the client that the pickup order is ready and thus remind the associate to offer the pickup status to the customer. In another example, the conversation between the associate and customer may lead into the customer asking about a particular item that the associate may know is not in stock. Upon viewing the conversation, the inference engine may conclude that based on the customer service guidelines, the associate should suggest an alternative to the out of stock item that is available at the store. Upon drawing this conclusion, theprotocol module 123 may update the advice provided on theHUD 210 to suggest that the associate offer advice on alternative products. Theprotocol module 123 may even transmit a query to theinventory module 117 to identify alternative products available and forward the results to augmentedreality display device 131 to display on theHUD 210. - Embodiments of the augmented
display module 119 may perform the function and task of connecting, interfacing, transmitting and receiving data between the augmentedreality display device 131 and thecustomer interaction module 105 of thecomputer management system 103. Embodiments of the augmenteddisplay module 119 may control the stream of data provided to and received from the augmented reality display device. For example, theaugmented display module 119 may distribute data to each of the appropriate augmented reality display devices making requests. The augmented display module may control the flow of location data for each customer'sclient device 143 located within the store, the customer data tied to each customer'sprofile 147, queries made to theinventory module 117 andmapping module 121 as well as the transmission and storage of audio or visual recordings maintained by therecording module 127. - Embodiments of the augmented
display module 119 may further track the health and status of each augmentedreality display device 131. For example, theaugmented display module 119 may ensure that each augmentedreality display device 131 is receiving an adequate power supply and is not suffering from a low battery, that the augmentedreality display device 131 is maintaining a connection tonetwork 120 and that the augmentedreality display device 131 is appropriately located within the geofence created around a particular location. Theaugmented display module 119 may further troubleshoot errors, connectivity issues and errors in the display of the HUD, in order to correct these errors or determine whether maintenance on the augmentedreality display device 131 may be needed. - In some embodiments of the
system 100, thecomputer management system 103 may be equipped with arecording module 127. Therecording module 127 may receive and store audio or visual recording created and saved by each of the on-board recording systems 141 of the augmented reality display devices. The recordings may be audio recordings recorded by a microphone, video recordings created by a camera device or a combination thereof. The recording module may organize and archive each of the recordings created by the augmentedreality display devices 131. Therecording module 127 may be queried by a user or administrator of the computer management system searching for recordings that may have been previously stored by therecording module 127, allowing for fast recall and loading of a particular recording by a specific augmentedreality display device 131 at a particular moment in time. Therecording module 127 may tag each recording with a date, time, device id number, and employee registered to the device at the time the recording occurred. - In some embodiments, the recordings archived by the recording module may be further used for evaluation and teaching purposes by an
evaluation module 129. Embodiments of the evaluation module may use the recordings for both employee training and the evaluation of employee performance. Theevaluation module 129 may parse through selected recordings and present the recordings to a user of the computer management system or transmit the recordings to a network accessible computer system for viewing purposes. When parsing through the selected recordings, theevaluation module 129 may compare the recordings with the customer service guidelines to ensure that the employee operating the augmentedreality display device 131 followed the guidelines while interacting with customers. In some embodiments, theevaluation module 129 may evaluate the recordings for compliance with the customer service guidelines and assign a grade to the employee's performance. In other embodiments, theevaluation module 129 may flag a recording for review by the employer or user in charge of reviewing employee conduct. - In alternative embodiments, the
evaluation module 129 may allow for user of thecomputer management system 103 to remotely access and view the augmentedreality display device 131 through the perspective of the sales associate or other user operating the augmented reality display device. Theevaluation module 129 may allow a user of thecomputer management system 103 to remotely stream the audio or visual data from therecording system 141 to thecomputer management system 103 or another selected computer system on thenetwork 120, allowing for real time viewing of a sales associate's performance as the sales associate interacts with customers using the augmentedreality display device 131. - Referring to the drawings,
FIG. 2a toFIG. 3 depict an embodiment of the augmentedreality display device 131 which may be worn theuser 301 of the augmentedreality display device 131. As shown in the figures, the exemplary embodiment of the augmentedreality display device 131 may be a pair of glasses comprising aframe 203, a pair ofarms 205 each comprising a hinge and a pair oflenses 207. Theframe 203,arms 205 and lenses may be constructed out of any material known by a person skilled in the art of glasses construction. For example, the underlying components of the glasses of the augmentedreality display device 131 may be constructed out of various plastics, resins, rubbers, metals or metal alloys, etc. While the exemplary embodiment of the augmentedreality display device 131 is depicted as glasses, this should in no way be limiting to the appearance that the augmented reality display device may take. Glasses are merely one example and the augmented reality display device may take other forms that comprise computer system housed within ahousing 201 capable of overlaying images projected by the computer system onto anaugmented reality HUD 210. - The electrical and computing components of the augmented
reality display device 131 may be installed into ahousing 201 attached to theframe 203 orarms 205 of the augmentedreality display device 131. Within the interior of thehousing 201, the computer system components integrated therein may include any of the components described by thecomputer system 800 ofFIG. 8 discussed in detail below, including aprocessor 891,memory devices input device 892 and an output device 893 (such as the viewable portion of the HUD 210). Additional specialized hardware and software components that may be integrated into the augmentedreality display device 131 may include adisplay controller 131,HUD module 135,network interface controller 122,profile manager 139 andrecording system 141. - The
display controller 133 may be an integrated circuit that generates a video signal displaying the images, data and graphical interface onto theHUD 210. Thedisplay controller 133 may project the data received from thecomputer management system 103 including graphical text of thecustomer data mapping data 407 andprotocol data 413 generated using the customer service guidelines. Thedisplay controller 133 may operate in conjunction with theHUD module 133 which may be a software based component of the augmentedreality display device 131. TheHUD module 135 may be responsible for the visually relaying the graphical data of the user interface of the operating system of the augmentedreality display device 131 or the programs loaded into the memory device of either the augmented reality display device or computer management system onto the physical glass or plastic background of theHUD 210. - Embodiments of the
profile manager 139 may control the profile information and customer data received from thecomputer management system 103. Specifically, the profile manager may ensure that the correct customer data is properly viewed when in a viewable distance to the customer associated with the customer data. Theprofile manager 139 may control the customer data presentation on theHUD 210, ensuring that the data relevant to the customer within viewing distance of the augmentedreality display device 131 is the data being presented. This may ensure that the HUD does not become overcrowded or display data that is irrelevant due to another customer being nearby, but out of sight from the augmentedreality display device 131. - The
recording system 141 of the augmentedreality display device 131 may comprise an onboard camera device, microphone or combination thereof. The recording system may be manually activated by theuser 301, remotely activated by the computer management system 103 (for example through the evaluation module 129) or automatically engaged as theuser 301 engages a customer. In alternative embodiments, the recording system may be consistently running and recording data, streaming the recorded data over thenetwork 120 and storing the recorded data for later playback in adata storage device 118 or networkaccessible repository 153. - The drawing of
FIG. 7 represents anembodiment 700 of an algorithm that may be implemented for assisting customers, in accordance with the systems described inFIGS. 1-6 using one or more computer systems defined generically inFIG. 8 below, and more specifically by the specific embodiments depicted inFIGS. 1-6 . A person skilled in the art should recognize that the steps of the method described inFIG. 7 may not require all of the steps disclosed herein to be performed, nor does the algorithm ofFIG. 7 necessarily require that all the steps be performed in the particular order presented. Variations of the method steps presented inFIG. 7 may be performed in a different order than presented byFIG. 7 . - The
algorithm 700 described inFIG. 7 may describe an embodiment for assisting customers using a combination of geofence technology, location tracking and augmented reality devices. Thealgorithm 700 may initiate instep 701 by creating a geofence having a virtual barrier surrounding a desired location. The geofence may be created, maintained and defined by the geofence creation tools integrated into themodule 107 of thecomputer management system 103. Once created, thecomputer management system 103 may use the created geofence to monitor the activity of customers via eachcustomer client device 143 that enters into the geofence. - In
step 703, thenetwork 120 maintaining thecomputer management system 103 and comprising the geofence ofstep 701 may connect the network to theclient device 143 of thecustomer 401. Accordingly, as a function of the connectivity of theclient device 143 to thenetwork 120, thecomputer management system 103 may collect the location data of theclient device 143 using thelocation module 109 as theclient device 143 changes position while connected to the network, monitoring the client device's location relative to the geofence instep 705. In some embodiments, the tracking of theclient device 143 may be performed using GPS while in alternative embodiments the location of theclient device 143 may have its location tracked by thelocation module 109 using a wireless technique such as a Wi-Fi positioning system (WPS). - In
step 707 of thealgorithm 700, a determination may be made regarding whether or not theclient device 143 of a customer has entered the geofence established by thegeofence module 107. If, the virtual barrier of the geofence created instep 701 has not been entered by theclient device 143, thealgorithm 700 may simply continue to monitor the location of theclient device 143. However, if theclient device 143 has entered the geofence established instep 701, thealgorithm 700 may proceed to step 709. Instep 709, thecomputer management system 103 may identify theuser profile 147 loaded into the memory of theclient device 143. Based on the identification of the user profile, theprofile module 115 may instep 711 connect to anapplication data server 149 storing customer data relating to theprofile 147 loaded into theclient device 143. Theprofile module 115 may retrieve customer data stored by theprofile 147 and load the customer data into thememory device 114 of thecomputer management system 103. - Subsequently, after retrieving the customer data from the web or
application server 149 for the identifiedprofile 147, the customer data collected by the profile module may be transmitted to the augmented reality display device fordisplay 131 onto aHUD 210 of thedisplay device 131 when the view of theHUD 210 comes into a viewing distance of thecustomer 401 who generated the customer data of theprofile 147. If, instep 715 it is determined that theuser 301 of the augmentedreality display device 131 is not within viewing distance of the customer/customer'sclient device 143, thecomputer management system 103 may continue to monitor and compare the locations of both the customer'sclient device 143 and the augmentedreality display device 131 to determine when both devices are within viewing distance of one another. - Likewise, if in
step 715, it is determined by thecomputer management system 103 that the location of theclient device 143 is within viewing distance of the augmentedreality display device 131, instep 719, the augmentedreality display device 131 may overlay the customer data onto the HUD of the augmentedreality display device 131 within the proximity of the customer, in a manner that may allow for theuser 301 of the augmentedreality display device 131 to simultaneously view the customer data on theHUD 210 and maintain eye contact with thecustomer 401. - In
step 721, auser 301 of the augmentedreality display device 131 may engage a customer in an attempt to assist the customer based on the customer data provided on theHUD 210 of the augmented reality display device. Theuser 301 may help thecustomer 401 fulfill orders, pickup orders, provide status updates, locate products and inventory. Upon successful completion of the assisting the customer, instep 723, theuser 301 of the augmentedreality display device 131 may amend the customer data stored by the application data server. The computer management system may acknowledge that a request for a service or product has been fulfilled by theuser 301 or other store employee and the computer management system may update the customer data on theapplication data server 149 to properly reflect the assistance provided by theuser 301. - Referring to the drawings,
FIG. 8 illustrates a block diagram of acomputer system 800 that may be included in the systems ofFIGS. 1-6 and for implementing methods for assisting a customer as described inFIG. 7 and in accordance with the embodiments described in the present disclosure. Thecomputer system 800 may generally comprise aprocessor 891, otherwise referred to as a central processing unit (CPU), aninput device 892 coupled to theprocessor 891, anoutput device 893 coupled to theprocessor 891, andmemory devices processor 891. Theinput device 892,output device 893 andmemory devices processor 891 via a bus.Processor 891 may perform computations and control the functions ofcomputer 800, including executing instructions included in thecomputer code 897 for tools and programs for identifying errors in a multi-threaded application, in the manner prescribed by the embodiments of the disclosure using the systems ofFIGS. 1-6 , wherein the instructions of thecomputer code 897 may be executed byprocessor 891 viamemory device 895. Thecomputer code 897 may include software or program instructions that may implement one or more algorithms for implementing the methods for methods for assisting a customer, as described in detail above. Theprocessor 891 executes thecomputer code 897.Processor 891 may include a single processing unit, or may be distributed across one or more processing units in one or more locations (e.g., on a client and server). - The
memory device 894 may includeinput data 896. Theinput data 896 includes any inputs required by thecomputer code output device 893 displays output from thecomputer code memory devices computer code computer system 800 may comprise said computer usable storage medium (or said program storage device). -
Memory devices memory devices computer code 897, 898) in order to reduce the number of times code must be retrieved from bulk storage while instructions of thecomputer code processor 891,memory devices Memory devices memory devices - In some embodiments, rather than being stored and accessed from a hard drive, optical disc or other writeable, rewriteable, or removable
hardware memory device device 899, or may be accessed byprocessor 891 directly from such a static, non-removable, read-only medium 899. Similarly, in some embodiments, storedcomputer program code 897 may be stored as computer-readable firmware 899, or may be accessed byprocessor 891 directly fromsuch firmware 899, rather than from a more dynamic or removable hardware data-storage device 895, such as a hard drive or optical disc. - In some embodiments, the
computer system 800 may further be coupled to an Input/output (I/O)interface 112 and a computer data storage unit (for example a data store, data mart or repository). An I/O interface 112 may include any system for exchanging information to or from aninput device 892 oroutput device 893. Theinput device 892 may be, inter alia, a keyboard, joystick, trackball, touchpad, mouse, sensors, beacons, RFID tags, microphones, biometric input device, camera system, timer, etc. Theoutput device 893 may be, inter alia, a printer, a plotter, a display device (such as a computer screen or monitor), a magnetic tape, a removable hard disk, a floppy disk, etc. Thememory devices computer 800, and may include any type of transmission link, including electrical, optical, wireless, etc. - The I/
O interface 112 may allowcomputer system 800 to store information (e.g., data or program instructions such asprogram code 897, 898) on and retrieve the information from a computer data storage unit (not shown). Computer data storage units include any known computer-readable storage medium, which is described below. In one embodiment, computer data storage unit may be a non-volatile data storage device, such as a magnetic disk drive (i.e., hard disk drive) or an optical disc drive (e.g., a CD-ROM drive which receives a CD-ROM disk). - As will be appreciated by one skilled in the art, in a first embodiment, the present invention may be a method; in a second embodiment, the present invention may be a system; and in a third embodiment, the present invention may be a computer program product. Any of the components of the embodiments of the present invention can be deployed, managed, serviced, etc. by a service provider able to deploy or integrate computing infrastructure with respect identifying errors in a multi-threaded application. Thus, an embodiment of the present invention discloses a process for supporting computer infrastructure, where the process includes providing at least one support service for at least one of integrating, hosting, maintaining and deploying computer-readable code (e.g.,
program code 897, 898) in a computer system (e.g., computer 800) including one or more processor(s) 891, wherein the processor(s) carry out instructions contained in thecomputer code 897 causing the computer system to identify errors in an application. Another embodiment discloses a process for supporting computer infrastructure, where the process includes integrating computer-readable program code into a computer system including a processor. - The step of integrating includes storing the program code in a computer-readable storage device of the computer system through use of the processor. The program code, upon being executed by the processor, implements a method for assisting a customer described in this application. Thus the present invention discloses a process for supporting, deploying and/or integrating computer infrastructure, integrating, hosting, maintaining, and deploying computer-readable code into the
computer system 800, wherein the code in combination with thecomputer system 800 is capable of performing a method of identifying errors in a multi-threaded application. - A computer program product of the present invention comprises one or more computer readable hardware storage devices having computer readable program code stored therein, said program code containing instructions executable by one or more processors of a computer system to implement the methods of the present invention.
- A computer program product of the present invention comprises one or more computer readable hardware storage devices having computer readable program code stored therein, said program code containing instructions executable by one or more processors of a computer system to implement the methods of the present invention.
- A computer system of the present invention comprises one or more processors, one or more memories, and one or more computer readable hardware storage devices, said one or more hardware storage devices containing program code executable by the one or more processors via the one or more memories to implement the methods of the present invention.
- The present invention may be a system, a method, and/or a computer program product at any possible technical detail level of integration. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
- The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
- Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
- Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, configuration data for integrated circuitry, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++, or the like, and procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
- Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
- These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
- The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
- The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the Figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
- The descriptions of the various embodiments of the present invention have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/941,120 US20180284453A1 (en) | 2017-04-03 | 2018-03-30 | Customer interaction system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762480949P | 2017-04-03 | 2017-04-03 | |
US15/941,120 US20180284453A1 (en) | 2017-04-03 | 2018-03-30 | Customer interaction system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180284453A1 true US20180284453A1 (en) | 2018-10-04 |
Family
ID=63671653
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/941,120 Abandoned US20180284453A1 (en) | 2017-04-03 | 2018-03-30 | Customer interaction system |
Country Status (1)
Country | Link |
---|---|
US (1) | US20180284453A1 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190139438A1 (en) * | 2017-11-09 | 2019-05-09 | General Electric Company | System and method for guiding social interactions |
US20200066040A1 (en) * | 2018-08-21 | 2020-02-27 | Mastercard International Incorporated | Systems and methods for generating augmented reality-based profiles |
US10885530B2 (en) | 2017-09-15 | 2021-01-05 | Pearson Education, Inc. | Digital credentials based on personality and health-based evaluation |
US20210271881A1 (en) * | 2020-02-27 | 2021-09-02 | Universal City Studios Llc | Augmented reality guest recognition systems and methods |
US11151625B2 (en) | 2018-07-24 | 2021-10-19 | John Bruno | Geographical merchant consortium commerce system for contextual commerce |
US20220012868A1 (en) * | 2019-03-22 | 2022-01-13 | Spp Technologies Co., Ltd. | Maintenance support system, maintenance support method, program, method for generating processed image, and processed image |
US11295134B2 (en) * | 2019-07-02 | 2022-04-05 | Truist Bank | User scanning and one-way augmented reality viewing system |
US20220254113A1 (en) * | 2019-10-15 | 2022-08-11 | At&T Intellectual Property I, L.P. | Extended reality anchor caching based on viewport prediction |
US20220327603A1 (en) * | 2019-11-07 | 2022-10-13 | Maplebear Inc. (Dba Instacart) | Messaging interface for managing order changes |
US11798276B2 (en) * | 2021-06-03 | 2023-10-24 | At&T Intellectual Property I, L.P. | Providing information about members of a group using an augmented reality display |
US11816757B1 (en) * | 2019-12-11 | 2023-11-14 | Meta Platforms Technologies, Llc | Device-side capture of data representative of an artificial reality environment |
US20240070763A1 (en) * | 2022-08-30 | 2024-02-29 | Micron Technology, Inc. | Sale of virtual goods based on physical location |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060122917A1 (en) * | 2000-08-14 | 2006-06-08 | Urbanpixel Inc | Real-time collaborative commerce in a multiple browser environment |
US20140164179A1 (en) * | 2012-12-07 | 2014-06-12 | David Geisinger | System and method to optimize in-store customer experience |
US20140258055A1 (en) * | 2008-03-13 | 2014-09-11 | Giftya Llc | System and method for a gift tracker |
US20140279294A1 (en) * | 2013-03-14 | 2014-09-18 | Nordstrom, Inc. | System and methods for order fulfillment, inventory management, and providing personalized services to customers |
-
2018
- 2018-03-30 US US15/941,120 patent/US20180284453A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060122917A1 (en) * | 2000-08-14 | 2006-06-08 | Urbanpixel Inc | Real-time collaborative commerce in a multiple browser environment |
US20140258055A1 (en) * | 2008-03-13 | 2014-09-11 | Giftya Llc | System and method for a gift tracker |
US20140164179A1 (en) * | 2012-12-07 | 2014-06-12 | David Geisinger | System and method to optimize in-store customer experience |
US20140279294A1 (en) * | 2013-03-14 | 2014-09-18 | Nordstrom, Inc. | System and methods for order fulfillment, inventory management, and providing personalized services to customers |
Cited By (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11341508B2 (en) | 2017-09-15 | 2022-05-24 | Pearson Education, Inc. | Automatically certifying worker skill credentials based on monitoring worker actions in a virtual reality simulation environment |
US10885530B2 (en) | 2017-09-15 | 2021-01-05 | Pearson Education, Inc. | Digital credentials based on personality and health-based evaluation |
US11042885B2 (en) | 2017-09-15 | 2021-06-22 | Pearson Education, Inc. | Digital credential system for employer-based skills analysis |
US11983723B2 (en) | 2017-09-15 | 2024-05-14 | Pearson Education, Inc. | Tracking digital credential usage in a sensor-monitored environment |
US20190139438A1 (en) * | 2017-11-09 | 2019-05-09 | General Electric Company | System and method for guiding social interactions |
US11151625B2 (en) | 2018-07-24 | 2021-10-19 | John Bruno | Geographical merchant consortium commerce system for contextual commerce |
US20200066040A1 (en) * | 2018-08-21 | 2020-02-27 | Mastercard International Incorporated | Systems and methods for generating augmented reality-based profiles |
US11087539B2 (en) * | 2018-08-21 | 2021-08-10 | Mastercard International Incorporated | Systems and methods for generating augmented reality-based profiles |
US20220012868A1 (en) * | 2019-03-22 | 2022-01-13 | Spp Technologies Co., Ltd. | Maintenance support system, maintenance support method, program, method for generating processed image, and processed image |
US11295134B2 (en) * | 2019-07-02 | 2022-04-05 | Truist Bank | User scanning and one-way augmented reality viewing system |
US11783581B2 (en) | 2019-07-02 | 2023-10-10 | Truist Bank | User scanning and one-way augmented reality viewing system |
US11798277B2 (en) | 2019-07-02 | 2023-10-24 | Truist Bank | User scanning and one-way augmented reality viewing system |
US11978253B2 (en) | 2019-07-02 | 2024-05-07 | Truist Bank | User scanning and one-way augmented reality viewing system |
US20220254113A1 (en) * | 2019-10-15 | 2022-08-11 | At&T Intellectual Property I, L.P. | Extended reality anchor caching based on viewport prediction |
US20220327603A1 (en) * | 2019-11-07 | 2022-10-13 | Maplebear Inc. (Dba Instacart) | Messaging interface for managing order changes |
US11854066B2 (en) * | 2019-11-07 | 2023-12-26 | Maplebear Inc. | Messaging interface for managing order changes |
US11816757B1 (en) * | 2019-12-11 | 2023-11-14 | Meta Platforms Technologies, Llc | Device-side capture of data representative of an artificial reality environment |
US20210271881A1 (en) * | 2020-02-27 | 2021-09-02 | Universal City Studios Llc | Augmented reality guest recognition systems and methods |
US11798276B2 (en) * | 2021-06-03 | 2023-10-24 | At&T Intellectual Property I, L.P. | Providing information about members of a group using an augmented reality display |
US20240070763A1 (en) * | 2022-08-30 | 2024-02-29 | Micron Technology, Inc. | Sale of virtual goods based on physical location |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20180284453A1 (en) | Customer interaction system | |
US11797904B2 (en) | Generating performance metrics for users within an observation platform environment | |
US11900302B2 (en) | Provisioning and operating an application for structured communications for emergency response and external system integration | |
US10366444B2 (en) | Inventory management | |
US11907884B2 (en) | Moderating action requests and structured communications within an observation platform | |
US11605043B2 (en) | Configuring, deploying, and operating an application for buy-online-pickup-in-store (BOPIS) processes, actions and analytics | |
US20140245140A1 (en) | Virtual Assistant Transfer between Smart Devices | |
US20130286048A1 (en) | Method and system for managing data in terminal-server environments | |
US12051127B1 (en) | Property tour management system | |
US20220292999A1 (en) | Real time training | |
US10909606B2 (en) | Real-time in-venue cognitive recommendations to user based on user behavior | |
US20240259763A1 (en) | Methods and systems for providing context based information | |
US20210209676A1 (en) | Method and system of an augmented/virtual reality platform | |
RU2691223C2 (en) | Personal logic opportunities platform | |
US20160328775A1 (en) | Enhanced information delivery facility | |
US20200043073A1 (en) | Geolocation-capable physical-location recommendation engine | |
CA3038843A1 (en) | Crossover interactive transaction system and method | |
US9571635B2 (en) | Automatic account information retrieval and display | |
CA2965457C (en) | Computer-implemented system and method for providing on-demand expert advice to a consumer | |
US20180189810A1 (en) | Processing user experience feedback in a retail environment to assist corrective action | |
JP7058809B1 (en) | Information processing equipment, provision system, provision method, and provision program | |
WO2015054818A1 (en) | Processing customer information to facilitate vehicle purchasing | |
WO2020145935A1 (en) | Systems and methods for selecting physical stores to fulfill orders | |
TWI461940B (en) | Use the web to get a list of geographic information around the center | |
US20160328725A1 (en) | Systems and methods for presenting store sales data to a mobile electronic device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: WAL-MART STORES, INC., ARKANSAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:IRVIN, LESLIE;BACALLAO, YURGIS MAURO;REEL/FRAME:045394/0107 Effective date: 20170407 Owner name: WALMART APOLLO, LLC, ARKANSAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WAL-MART STORES, INC.;REEL/FRAME:045788/0463 Effective date: 20180226 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |