KR20170099749A - Omni-channel system using augmented reality and control method thereof - Google Patents

Abstract

The present invention relates to an omni-channel system using augmented reality and a control method thereof. The omni-channel system according to the present invention generates a purchasing time point shopping list at home, and provides a predicted shopping list through correction of the generated purchasing time point shopping list to a server. The server provides product price comparison and products 3D panorama image information based on the predicted shopping list to a purchasing terminal. The purchasing terminal displays the product price comparison and the products 3D panorama image information. When an object included in a specific 3D panorama image information of the product is selected, the purchasing terminal displays information related to the selected object or performs a function related to the object. Accordingly, a convenient shopping function for products necessary at home is provided where a user confirms various kinds of information by non-face-to-face interactions between a seller and the user through virtual-reality 3D panorama images, which improve user convenience.

Description

[0001] The present invention relates to an omni-channel system using an augmented reality and an omni-channel system using the augmented reality and control method,

The present invention relates to an omni channel system and a control method thereof using an augmented reality. More particularly, the present invention relates to an omni channel system and a control method thereof, Providing 3D panoramic image information for each product according to the expected shopping list according to the expected shopping list at the server, displaying the 3D panoramic image information for each product at the purchasing terminal, The present invention relates to an omni channel system and a control method thereof, which utilize an augmented reality displaying information related to the selected object or performing a function related to the selected object when an object included in specific 3D panorama image information is selected from the information.

2. Description of the Related Art Generally, a mobile terminal is a device that performs a Global Positioning System (GPS) function and a call function (or a call function) and provides a result of the operation to a user.

These mobile terminals are able to transmit and receive more information in a shorter time and have various functions, but there is a lack of UI (User Interface) for user-oriented convenience in accordance with these functions.

Korean Patent Laid-Open No. 10-2013-0084274 [entitled " 3D virtual reality Internet shopping mall]

An object of the present invention is to provide a method and a system for creating a shopping list according to a purchase point in a home, providing an expected shopping list to a server through modification of the shopping list according to the purchase point, And providing the 3D panoramic image information for each product to the purchasing terminal, and comparing the prices for each product and the 3D panorama image information for each product in the purchasing terminal, and an omni channel system using the augmented reality and a control method thereof.

Another object of the present invention is to provide a 3D panoramic image information providing apparatus and a method of displaying 3D panoramic image information by using an augmented reality which is used for displaying information related to the selected object or performing functions related to the object, System and a control method thereof.

A control method of an omni channel system using an augmented reality according to an embodiment of the present invention is a method of controlling an omni channel system using an augmented reality, Receiving 3D panoramic image information; Displaying the received specific 3D panorama image information by the purchasing terminal; And when the mouse is positioned for a predetermined time on another additional object included in the specific 3D panoramic image information being displayed by the purchasing terminal and the touched state of the other additional object is maintained for a predetermined time And performing a screen switching function with other 3D panorama image information related to the other additional objects when it corresponds to a case where the 3D panorama image information corresponding to the additional object is displayed on the display screen, An additional object for providing an advertisement, an enlarged image, a moving picture, a coupon, donation and comment information, and other 3D panorama image information related to the one or more goods and services may be added.

The present invention provides a method for creating a shopping list for each purchase point in a home, providing an expected shopping list to a server through modification of the shopping list according to the purchase point created at home, 3D panorama image information is provided to the purchasing terminal, and the purchasing terminal displays the price comparison for each product and the 3D panorama image information for each product, thereby providing a convenient shopping function for necessary products at home, .

Further, in the present invention, when an object included in specific 3D panorama image information is selected from 3D panorama image information by product, information related to the selected object is displayed or a function associated with the object is performed, And confirms the customer's comment on the food manufacturing process related to the product, and improves user's convenience by verifying various information from the user in the non-face-to-face relationship between the seller and the user through the 3D panoramic image in a virtual reality There is an effect that can be made.

1 is a block diagram showing the configuration of an omni channel system using an augmented reality according to an embodiment of the present invention.
2 is a diagram illustrating an example of a Point of Purchase (POP) according to an embodiment of the present invention.
3 is a view showing an example of a front end according to an embodiment of the present invention.
4 is a diagram illustrating an example of a banner advertisement according to an embodiment of the present invention.
5 is a diagram illustrating an example of a poster advertisement according to an embodiment of the present invention.
6 is a view showing an example of a signboard according to an embodiment of the present invention.
7 is a flowchart illustrating a method of controlling an omni channel system using an augmented reality according to an embodiment of the present invention.
8 to 10 are views showing screens of a purchasing terminal according to an embodiment of the present invention.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms that can be understood by a person skilled in the art can be properly understood. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. The term "comprising" or "comprising" or the like in the present invention should not be construed as necessarily including the various elements or steps described in the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram showing a configuration of an omni channel system 10 using an augmented reality according to an embodiment of the present invention.

1, the omni channel system 10 includes a purchasing terminal 100, a server 200, a payment server 300, a sales terminal 400, and a store server 500. All of the components of the shopping information providing system 10 shown in FIG. 1 are not essential components, and the shopping information providing system 10 may be implemented by more components than the components shown in FIG. 1, The shopping information providing system 10 may be implemented by a smaller number of components.

The omni-channel in the omnichannel system 10 is a combination of a 'omni' meaning 'all' and a 'channel' indicating a distribution channel. To mobilize. "

That is, the OmniChannel represents a service that enables a consumer to search for and purchase goods (or services) across various routes such as online, offline, and mobile. The omnichannel system 10 is a system for displaying a shopping environment in which characteristics of each distribution channel are combined to make the user feel as if they are using the same store on any channel.

Accordingly, the omni channel system 10 is a system for providing services to consumers at anytime and anywhere by combining off-line and on-line. It is a system that seamlessly organically combines a plurality of shopping channels from a consumer- System.

The purchasing terminal 100 and / or the sales terminal 400 may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a personal digital assistant (PMP) A portable computer, a portable multimedia player, a telematics terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (Wibro) terminal, an IPTV (Internet Protocol Television) terminal, a smart TV, a mobile phone, a mobile phone, a mobile phone, An AV (Audio Video Navigation) terminal, an A / V (Audio / Video) system, a flexible terminal, and the like. Here, the sales terminal 400 and / or the store server 500 may be a POS (Point of Sales) terminal or the like provided in a store.

The purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400 and the store server 500 may be connected to each other via a wired / wireless communication network, And a communication unit for communicating with at least one external terminal. Herein, as a wireless Internet technology, a wireless LAN (WLAN), a wireless broadband (Wibro), a WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) , Long Term Evolution (LTE), Wireless Mobile Broadband Service (WMBS), and the like. In addition, the short distance communication technology may be Bluetooth, Wi-Fi, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee For example, Near Field Communication (NFC), Ultra Sound Communication (USC), Visible Light Communication (VLC), and Bluetooth Low Energy (BLE). The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the communication unit can transmit information to and from an arbitrary terminal through a universal serial bus (USB).

In addition, the communication unit may be a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, a mobile communication system, (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term The payment server 300, the sales terminal 400, the store server 500, and the like on a mobile communication network constructed according to a wireless network And transmits and receives signals.

The purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500 may each include a storage unit. Here, the storage unit may store various user interfaces (UI), a graphical user interface (GUI), and the like.

The storage unit stores data and programs necessary for the purchase terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500 to operate, respectively .

That is, the storage unit stores a plurality of application programs (application programs or application programs) running on the purchase terminal 100, the server 200, the payment server 300, the sales terminal 400, and data and commands for operation of the purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400 and the store server 500 . At least some of these applications may be downloaded from an external server via wireless communication. At least some of these application programs may also be used to provide basic functions of the purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400 and the store server 500 The server 200, the payment server 300, the sales terminal 400 and the store server 500 from the time of shipment from the beginning to the end of the shipment Lt; / RTI > The application programs are stored in the storage unit and installed in the purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400 and the store server 500, respectively, (Or function) of each of the purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400 and the store server 500 by a controller (not shown) Can be driven.

The storage unit may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory -Only Memory). ≪ / RTI > The purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400 and the store server 500 are connected to a web storage operate web storage, or operate in association with the web storage.

The purchase terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500 may each include a display unit. Here, the display unit may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display ), A three-dimensional display (3D display), an electronic ink display (e-ink display), and an LED (Light Emitting Diode). Also, the display unit may be a touch screen.

The purchase terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500 may each include a voice output unit. Here, the audio output unit outputs audio information included in the signal subjected to the predetermined signal processing under the control of the control unit. Here, the audio output unit may include a receiver, a speaker, a buzzer, and the like.

Further, the voice output unit outputs the guidance voice generated by the control unit.

The purchase terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500 may each include a control unit. Here, the control unit performs overall control functions of the purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500.

Also, the control unit may control the purchase terminal 100, the server 200, the payment server 300, the sales terminal 400, and the store server 500 using the programs and data stored in the storage unit. Performs overall control functions. The control unit may include a RAM, a ROM, a CPU, a GPU, and a bus, and the RAM, the ROM, the CPU, and the GPU may be connected to each other via a bus. The CPU accesses the storage unit, performs booting using the O / S stored in the storage unit, and can perform various operations using various programs, contents, and data stored in the storage unit.

The purchasing terminal 100 communicates with the server 200, the payment server 300, the sales terminal 400, the store server 500, and the like.

In addition, the purchasing terminal 100 performs a membership subscription procedure with respect to a user of the purchasing terminal 100 by interlocking with the server 200, respectively.

In addition, when performing the membership registration procedure, the purchasing terminal 100 must complete the authentication function through the authentication means (for example, a mobile phone, a credit card, an IFP, etc.) Can normally be completed.

Also, when an app installed in the purchasing terminal 100 is executed, the purchasing terminal 100 displays an app execution result screen. Here, the application execution result screen may include a shopping list creation item for generating a member information item (or menu / button) for receiving or transmitting member information, a shopping list for each purchase point, an expected shopping list, a final shopping list, A My Page item for managing purchase history information about a product or service purchased through the purchasing terminal 100, and the like. At this time, the purchasing terminal 100 communicates with the server 200 related to the corresponding application in the background state.

In addition, when the member information item is selected from the application execution result screen displayed on the purchasing terminal 100, the purchasing terminal 100 may be configured to receive (or receive) the member information corresponding to the selected member information item Display the member information screen.

Also, the purchasing terminal 100 receives member information according to user input (or user touch). Here, the member information includes a name, an address, a language used, a destination information, a shopping object type (for example, an avatar type, an emoticon type, etc.).

In addition, the purchasing terminal 100 transmits the received member information, identification information of the purchasing terminal 100, and the like to the server 200. [ The identification information of the purchasing terminal 100 includes a mobile directory number (MDN), a mobile IP, a mobile MAC, a SIM (subscriber identity module) card unique information, and a serial number.

Also, the purchasing terminal 100 generates a shopping list according to the point-in-time of purchase (or an optimal shopping list per purchase point). Here, the purchasing terminal 100 may be a representative terminal set (or selected) among a plurality of purchasing terminals included in a community (for example, a family, a workplace, a club, etc.) related to the purchasing terminal 100 . At this time, the shopping list according to the purchase point includes one or more goods and / or services related to the community.

That is, the purchasing terminal 100 generates the shopping list for each purchase point including at least one commodity and / or service recommended by each of the plurality of purchasing terminals included in the community related to the purchasing terminal 100.

At this time, when a preset event occurs, the purchasing terminal 100 may determine the purchase time point including at least one commodity and / or service recommended by each of the plurality of purchasing terminals included in the community related to the purchasing terminal 100 You can also create a separate shopping list. Here, the preset event may be a case where the present day and time are a pre-set shop date and time, a shopping list is requested to be generated at any one of the plurality of purchase terminals included in the community, .

Also, the purchasing terminal 100 may be connected to the purchasing terminal 100 (or at least one of the plurality of purchasing terminals included in the community related to the purchasing terminal 100) within the predetermined period (E. G., Within the last 8 weeks) of at least one of the purchased fresh foods. Here, the fresh cut product (or a fresh cut product) is a product that minimizes the processing and minimizes the processing to maximize the quality of the food Including agricultural products, livestock products, etc.).

Also, the purchasing terminal 100 includes goods and / or services whose prices have been changed (or changed) at the lowest price by interlocking with the server 200 among the items of interest preset by the community related to the purchasing terminal 100 The shopping list according to the purchase point is generated.

The purchasing terminal 100 may also be provided with a predetermined set of preferences representing a predetermined period (or season) (for example, Christmas, Valentine's Day, Children's Day, Parent Day, etc.) And creates the shopping list according to the purchase point including the goods.

In addition, the purchasing terminal 100 generates the shopping list according to the purchasing point including the family anniversary, the event, the travel related goods and / or the service set in advance by the community related to the purchasing terminal 100.

In addition, the purchasing terminal 100 may be provided with goods and / or services associated with the weather within a predetermined period (or within a week including the latest / last purchase date) (for example, (Including related goods, services related to overseas trips, and items related to the ratio of umbrella, loyalty, etc. when the weather within the last week has not been paid, etc.).

In addition, the purchasing terminal 100 may be directly connected to the server 200, for example, within a predetermined rank (for example, within the 10th rank) among the goods or services sold in the country where the purchasing terminal 100 is located, Or a shopping list according to the purchase point including the purchased popular goods and / or services.

Also, the purchasing terminal 100 displays the shopping list according to the created purchase point.

In addition, the purchasing terminal 100 performs a process of modifying or adding the displayed shopping list according to the displayed purchase point according to a user input (or a user selection) Or other expected shopping lists as a result of the modification or addition process). Here, the expected shopping list includes a product name (or a service name), a product unique code (or service specific code), a quantity, a manufacturer name (or a service provider company name), and the like.

Also, the purchasing terminal 100 transmits the generated expected shopping list, the identification information of the purchasing terminal 100, and the like to the server 200. Here, the identification information of the purchasing terminal 100 includes an MDN, a mobile IP, a mobile MAC, a SIM (subscriber identity module) card specific information, a serial number, and the like.

In addition, the purchasing terminal 100 responds to one or more goods and / or services included in the estimated shopping list transmitted from the server 200 in response to the estimated shopping list, identification information of the purchasing terminal 100, One or more 3D panoramic image information related to one or more goods and / or services included in the expected shopping list, and the like, as a result of the price comparison function for each product (and / or service). Here, the 3D panorama image information may be image information related to a plurality of stores selling a specific product or image information related to a store providing a specific service.

For example, with respect to a refrigerator, the purchasing terminal 100 may include 3D panorama image information related to the refrigerator in the department store A, 3D panorama image information related to the refrigerator in the department store B, 3D panorama image information related to the refrigerator in the C- 3D panorama image information of a plurality of stores can be provided from the server for the goods (or one service) of the shop.

In addition, the purchasing terminal 100 may include a function of comparing the prices of one or more products and / or services included in the received expected shopping list with prices of products (and / or services) One or more 3D panoramic image information related to the goods and / or services, and the like. At this time, the purchasing terminal 100 displays the result of the price comparison function by product (and / or service), and displays the result of the price comparison function displayed by the product (and / or service) Display information. When there are a plurality of 3D panoramic image information related to the product and / or service, the purchasing terminal 100 may display the plurality of 3D panoramic image information on a single screen in a thumbnail (or slide) manner have. Here, the price comparison function result of each product (and / or service) may include a product name (or a service name), a product unique code (or a service unique code), a product image (or a service basic image) ), Experiential information on goods / services, evaluation information on goods / services, price information, reservation information, consultation information, and treatment time information.

In addition, a result of performing a specific price comparison with respect to a specific product (or a specific service) is selected from the price comparison function results of one or more goods and / or services displayed on the purchasing terminal 100 by product (and / or service) , The purchasing terminal 100 displays a result of performing the detailed price comparison function on the result of performing the specific price comparison for the selected specific product (or the specific service).

In addition, when specific 3D panoramic image information is selected from one or more 3D panorama image information related to one or more goods and / or services displayed on the purchasing terminal 100, the purchasing terminal 100 determines whether the selected specific goods 3D panorama image information (or 3D panorama image information related to the selected specific product (or service) / specific 3D panorama image information related to the goods (or services) in the actual offline corresponding to the actual goods (or services). Here, the 3D panoramic image information may be image information including a product in an actual offline (or information related to a store / a corresponding service providing the corresponding service in offline) related to the product (or service). In addition, the 3D panorama image information may include at least one of a sales advertisement, an enlarged image, a video (or a video for promotion), a coupon (for example, a discount coupon, a free coupon, etc.) It may be a state including an object for providing information. In addition, the 3D panorama image information may include other additional objects for screen switching, in addition to image information related to a corresponding product or service. At this time, the object (and / or other additional objects) displayed on the purchasing terminal 100 may have a maximum state (or a specific color) with respect to the corresponding object at a predetermined period so as to facilitate the confirmation of the object (Or lighted state) and then repeatedly changing from the lighted state to the maximum state (or lighting state), the flickering effect of the light, the effect of the neon sign, and the effect of changing the color of the light to different colors at predetermined cycles May be applied.

Also, the purchasing terminal 100 displays the 3D panorama image information while moving the corresponding shopping object in the 3D panorama image information according to user input based on the shopping object type in the member information.

In addition, when a predetermined object included in 3D panorama image information related to a specific product displayed on the purchasing terminal 100 is selected, the purchasing terminal 100 displays information related to the selected object, As shown in FIG.

That is, when a sales advertisement, which is a predetermined object included in 3D panorama image information related to a specific product displayed on the purchasing terminal 100, is selected, the purchasing terminal 100 displays information related to the selected sales advertisement . At this time, the sales advertisement includes a point of purchase (POP), a leaflet, a banner, a poster, a signboard, a price tag, and the like.

When a sales advertisement, which is a predetermined object included in the 3D panorama image information related to the specific product displayed on the purchasing terminal 100, is selected, the purchasing terminal 100 determines whether the 3D panomarra image related to the object A plurality of goods (or services) are arranged in a predetermined discount rate order, an accrual rate order, a sales order value, a popularity degree order, and a brand order, and displays the sorted plurality of goods (or services). At this time, the purchasing terminal 100 may display the sorted plurality of goods (or services) by applying the augmented reality function. Also, the purchasing terminal 100 may display only a predetermined number of the plurality of ordered goods (or services).

Here, as shown in FIG. 2, the POP (Point of Purchase) represents an advertisement providing information on goods and / or services on the spot to customers who visited the store.

Also, as shown in FIG. 3, the leaflet (or the shear advertisement / leaflet / flyer advertisement) represents a form of a simple printed matter distributed for advertising or publicity purpose.

Also, as shown in FIG. 4, the banner advertisement is an advertisement provided at a specific location of a store to provide information on a specific product and / or service.

Also, as shown in FIG. 5, the poster billing refers to paper made and adhered to an advertisement and appeals to the viewer. Therefore, the poster billing is made in consideration of characters, figures, and sentences so as to attract attention.

As shown in FIG. 6, the signboard indicates a plate indicating a company name, a shop name, a product name, a service name, and the like related to a store.

In addition, when an enlarged image, which is a predetermined object included in the 3D panorama image information related to a specific product displayed on the purchasing terminal 100, is selected, the purchasing terminal 100 displays the product (s) corresponding to the selected enlarged image object And / or an enlarged image for the service.

For example, the enlarged image may be an internal photograph (or an additional image related to a product) of a product such as a refrigerator or a washing machine, or may be an enlarged photograph of a fresh food, .

In addition, when a moving image (or a promotional video), which is a preset object included in 3D panorama image information related to a specific commodity displayed on the purchasing terminal 100, is selected, the purchasing terminal 100 transmits the selected moving image Or moving picture corresponding to the goods and / or the service corresponding to the moving picture. At this time, the moving picture may include a moving picture related to the product and / or service related to the use of the product (for example, a moving picture about how to use the cosmetics, a moving picture for the clothing example, A moving picture about a cooking method, etc.), and may include characters and / or voice messages.

When a coupon (for example, a discount coupon, a free coupon, etc.), which is a preset object included in 3D panorama image information related to a specific product displayed on the purchasing terminal 100, is selected, Or the service by interlocking with the server 200, and stores and displays the coupon related to the downloaded goods and / or services.

At this time, when there are a plurality of goods (or services) related to coupons as the selected object, the purchasing terminal 100 displays a plurality of coupons, and may download at least one coupon selected from the displayed coupons have.

In addition, when a base, which is a predetermined object included in the 3D panorama image information related to the specific product displayed on the purchasing terminal 100, is selected, Information about detailed information is displayed, and in a plurality of cases, it can be displayed in a state of being arranged in a slide manner.

In addition, when a comment, which is a predetermined object included in the 3D panorama image information related to the specific product displayed on the purchasing terminal 100, is selected, the purchasing terminal 100 transmits the comment of the other commodity and / Or information related to the corresponding goods and / or services (for example, a testimonial of purchase, a review of the service, etc.) registered in the service.

In this manner, the purchasing terminal 100 can display information related to the selected object or perform functions related to the object.

In addition, when another predetermined additional object included in the 3D panorama image information related to the specific product displayed on the purchasing terminal 100 is selected, when the mouse is positioned for a predetermined time on the other additional object, The purchasing terminal 100 performs a screen switching function with other 3D panorama image information related to the other additional objects when the touched state of the 3D object is maintained for a predetermined period of time.

For example, in a state where 3D panorama image information related to a living room in a home is displayed in relation to a real estate in the purchasing terminal 100, a 'kitchen' displayed in a part of the 3D panorama image information related to the living room is referred to as another When an additional object is selected, the purchasing terminal 100 switches the screen from 3D panorama image information related to the living room to 3D panorama image information related to the selected kitchen.

In another example, in the state where the 3D panorama image information related to the agricultural store is displayed on the purchase terminal 100, another additional object " fisheries " displayed in a part of the 3D panorama image information related to the agricultural store If so, the purchasing terminal 100 switches the screen from the 3D panoramic image information related to the agricultural store to the 3D panoramic image information related to the aquaculture store.

Through the execution of the screen switching function, the purchasing terminal 100 according to the present invention can provide the 3D panorama image information while switching to another corner (or other 3D panorama image information) And it is possible to provide continuous shopping.

In addition, the purchasing terminal 100 may check one or more 3D panorama image information related to one or more goods and / or services, perform a price comparison function displayed on the purchasing terminal 100, And finally creates a final shopping list for the selected goods and / or services. Here, the final shopping list includes a finally selected product name (or service name), a product unique code (or a service specific code), a quantity, a manufacturer name (or a service provider company name), and the like.

In addition, the purchasing terminal 100 transmits the generated final shopping list, identification information of the purchasing terminal 100, and the like to the server 200.

In addition, the purchasing terminal 100 performs a payment function for one or more goods and / or services included in the final shopping list by interlocking with the server 200 and the payment server 300. At this time, the purchasing terminal 100 may perform the settlement function by interlocking with the server 200 and the payment server 300 through the simple settlement function.

That is, the purchasing terminal 100 receives a personal identification number (PIN) corresponding to a user input. Here, the PIN number may be a PIN number corresponding to the identified payment card type. Also, the purchasing terminal 100 transmits the PIN number, the identification information of the purchasing terminal 100, and the like to the server 200. At this time, the transmission of the PIN number from the purchasing terminal 100 to the server 200 may be performed in a backgroun state after the connection between the purchasing terminal 100 and the server 200 is established. In addition, the purchasing terminal 100 performs the authentication procedure by interlocking with the server 200 and the payment server 300 with respect to the PIN number transmitted to the server 200. In addition, when the authentication is successfully completed, the purchasing terminal 100 interlocks with the server 200 and the payment server 300 to perform payment for one or more goods and / or services included in the final shopping list Function.

If the payment function fails, the purchasing terminal 100 receives the payment failure information transmitted from the server 200 (or the payment server 300) and displays the received payment failure information.

Also, when the payment function is successful, the purchasing terminal 100 receives the payment function execution result transmitted from the base server 200 (or the payment server 300). Here, the payment function execution result (or payment information) includes goods and service information, settlement date and time information, price information for each order product / service, and quantity information for each order product / service.

Also, the received payment function execution result is displayed.

In addition, when the purchasing terminal 100 has paid for the commodity, the user of the purchasing terminal 100 receives the commodity from the sales terminal 400 (or the store server 500) (Or receive) the merchandise to be delivered through the merchandise store (not shown).

When a plurality of products paid by the purchasing terminal 100 are provided by the plurality of sales terminals 400 (or the plurality of store servers 500), the user of the purchasing terminal 100 may be provided with a plurality of sales terminals (Or a plurality of store servers 500) may be provided for each store.

When the purchasing terminal 100 makes a payment for a service item, the purchasing terminal 100 transmits a service item to a plurality of sales terminals 400 (or the sales terminal 400 / the store server 500 / the server (Or a multi-commodity discount coupon) related to the service item issued from the service provider 200 (e.g.

When a plurality of services paid by the purchasing terminal 100 are provided by a plurality of sales terminals 400 (or a plurality of store servers 500), the purchasing terminal 100 may include a plurality of sales terminals 400 (Or a plurality of store servers 500), respectively.

Also, the purchasing terminal 100 stores a coupon or the like related to the received service item.

Also, the purchasing terminal 100 displays a coupon or the like related to the received service item.

That is, when the multi-commodity discount coupon issuance is requested after the payment of the service item by the purchasing terminal 100, the purchasing terminal 100 determines whether the multi-commodity discount coupon is issued (or delivered / provided) And receives a multi-commodity discount coupon corresponding to the service (or the specific commodity). Here, the multi-commodity discount coupon includes a plurality of service item codes (or a plurality of commodity item codes / commodity codes) related to the specific service (or specific commodity) A plurality of goods and service information in the same category as the specific service or product), a unique number (or a unique number of a multi-product discount coupon), and the like. The multi-commodity discount coupon is formed by grouping a plurality of commodities and service item codes related to the specific commodity and service information into a single code, and the commodity is generated in a barcode form, a QR code form, a string form, or the like. Further, the plurality of goods and service information (or the plurality of goods and services) may include a product name (or service name), a product unique code (or service unique code), a product image Information on experience of the goods / service, evaluation information on the goods / services, information on the location of the store (or providing the service) selling the goods, and the telephone number of the store. At this time, the multi-commodity discount coupon of the string form can be generated by a combination of at least one of numbers, letters, special characters, and symbols. Here, the merchandise item code corresponds to a merchandise unique code (or service unique code) in the merchandise information. In addition, the experience information on the goods / service may include experience information created in the terminal of the member registered in advance in the server 200, information on the multi-product discount coupon related to the product / service provided by the server 200 Experience information created and the like.

In addition, the purchasing terminal 100 receives a free discount coupon, a discount coupon, a gift certificate of a specific shopping mall, a gift certificate of a traditional market, etc., which are additionally provided from the server 200 according to the purchase of the multi-product discount coupon.

Also, the purchasing terminal 100 stores and displays the received multi-commodity discount coupon.

In addition, the purchasing terminal 100 stores and displays the received free discount coupon, discount coupon, gift certificate of a specific shopping mall, gift certificate of a traditional market, and the like.

When a payment function for the service item is performed and the issuance of the multi-commodity discount coupon is requested, the purchasing terminal 100 sets a preset sales quantity range (or a sales / payment amount range) (for example, Or less than 100,000 won, or within 20,000,000 won) of the multi-commodity discount coupon.

In addition, by limiting the quantity or amount of the multi-commodity discount coupons that can be purchased at the purchasing terminal 100, it is possible to prevent fraudulent transactions.

In addition, when the user desires to use the multi-commodity discount coupon stored in the purchasing terminal 100 after receiving the specific commodity and / or the service in the store provided with the sales terminal 400, (Or payment processing) function for the multi-commodity discount coupon stored in the purchasing terminal 100 by interlocking between the payment server 300 and the sales terminal 400. [

When the use processing for the multi-commodity discount coupon stored in the purchasing terminal 100 is completed, the purchasing terminal 100 does not allow the multi-commodity discount coupon stored in the purchasing terminal 100 to be reused (or reused) Dispose of it as much as possible.

If there is a balance of the gift certificate after the payment function is normally performed, the purchase terminal 100 may receive a multi-product discount coupon including the available amount (or balance information) transmitted from the server 200, Or a usable amount (or balance information) transmitted from the server 200 through a printed matter such as a receipt provided to the sales terminal 400. The multi-commodity discount coupon is displayed on the screen of the sales terminal 400. At this time, the usable amount may be an amount of the amount that can be subtracted from the immediately preceding (or previous) usable amount according to the payment function.

Further, after the settlement function is normally completed, the purchasing terminal 100 receives a predetermined point and / or a discount coupon transmitted (or issued) from the sales terminal 400.

In addition, the purchasing terminal 100 displays and stores the received preset points and / or discount coupons.

Also, the purchasing terminal 100 may set the validity period included in the multi-commodity discount coupon as a predetermined period (for example, one month from the validity period, 15 days from the validity period, seven days from the validity period, (3 days from the expiration date, 1 day from the expiration date, etc.), and if the usable amount (or balance) remains in the voucher information, information indicating that the balance of the multi-commodity discount coupon remains, And displays the included information every predetermined period. At this time, information including information indicating that the balance of the multi-commodity discount coupon remains, valid period, and the like may be provided from the server 200.

In addition, the purchasing terminal 100 receives experience information on a specific commodity / service according to a user input of the purchasing terminal 100, evaluation information on a specific commodity / service, and the like.

At this time, the purchasing terminal 100 is configured to receive experiential information, evaluation information, and the like within a preset number of specific goods / services, thereby preventing a large amount of experiential information and evaluation information from being provided by the same user, Information, evaluation information, and the like can be increased.

In addition, the purchasing terminal 100 transmits the experience information on the received goods / service, evaluation information on the goods / services, identification information of the purchasing terminal 100, and the like to the server 200.

The server 200 communicates with the purchasing terminal 100, the payment server 300, the sales terminal 400, the store server 500, and the like.

In addition, the server 200 performs the membership registration procedure for the user of the purchasing terminal 100 by interlocking with the purchasing terminal 100.

In addition, the server 200 performs the membership registration procedure for the user of the sales terminal 400 by interlocking with the sales terminal 400.

In addition, the server 200 may store at least one store on an offline or street store through a plurality of cameras (not shown) included in the server 200, a merchandise, an exhibition merchandise, a POP, a flyer, A first image and a second image including an advertisement, a poster advertisement, a signboard, a price tag, and the like are photographed. Here, the store includes a department store, a shopping mall, an outlet, a restaurant, a hospital, a building (or a building), and the like. At this time, the server 200 confirms position information (for example, GPS position information and the like) of a point at which the first image and the second image are photographed, and transmits the identified position information to the first image (Or interlocked) with the second image and stores the same.

In addition, the server 200 acquires the overlapped region in which the first image and the second image are superimposed on the photographed first image and the second image based on the directionality of the pixel.

In addition, the server 200 generates the preliminary panoramic image by synthesizing the first image and the second image based on the obtained overlapping area. At this time, the server 200 may generate the preliminary panoramic image by synthesizing the photographed first image and the second image by various previously known synthesis methods. At this time, the generated preliminary panoramic image includes (or interlocks / matches) positional information about a first object, a product, a point (or coordinates) included in the preliminary panoramic image, and the like.

That is, the preliminary panoramic image can be used to search (or check) a 3D panoramic image corresponding to not only the image but also position information of an arbitrary terminal (for example, the location information of the purchasing terminal 100) And position information on a first object, a product, a point, and the like included in the panoramic image.

In the embodiment of the present invention, the preliminary panoramic image is generated by combining the first image and the second image on the basis of the obtained overlap region, but the present invention is not limited thereto, The preliminary panoramic image may be generated by synthesizing the photographed first image and the second image by various previously known synthesis methods.

At this time, the server 200 may be based on a first image and a second image photographed through a plurality of cameras (for example, a special device for photographing a 3D panorama image, a plurality of cameras configured by a special vehicle, etc.) The preliminary panoramic image may be generated.

In addition, the server 200 recognizes one or more first objects included in the preliminary panoramic image. Here, the first object may be a store located on the off-line, a POP, a leaflet, a banner advertisement, a poster advertisement, a signboard, a price tag, etc. located on the off-line or located in each store . At this time, the first object in the present invention may include or exclude goods and services provided by each store. In addition, the POP, shear, banner advertisement, poster advertisement, signboard and the like represent a discount event code, and the price tag may represent a product code.

That is, the server 200 recognizes one or more stores included in the preliminary panoramic image, or recognizes POP, flyer, banner advertisement, poster advertisement, signboard, price tag, etc. included in the preliminary panoramic image.

In addition, the server 200 may store sales advertisements, enlarged images, videos (or promotional videos), coupons (including discount coupons, free coupons, etc.), donations, and comments corresponding to the recognized one or more first objects (Or inserts) another object for screen switching and / or another additional object for screen switching to a partial area on the first object in the preliminary panoramic image, or to add (Or inserts) the 3D panorama image to generate a 3D panorama image.

That is, the server 200 adds (or inserts) an object related to the sales advertisement corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image, (Or inserts) them adjacent to each other within a predetermined distance to generate a 3D panoramic image. Here, the sales advertisement includes POP, flyer, banner advertisement, poster advertisement, signboard, price tag, and the like.

In addition, the server 200 may add (or insert) an object for providing a magnified image corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image, The 3D panorama image is generated by adding (or inserting) the objects adjacent to each other within a predetermined distance from the object. Here, the enlarged image may be an internal photograph (or an additional image related to a product) of a product such as a refrigerator or a washing machine, or may be an enlarged photograph of a fresh food.

In addition, the server 200 may add (or insert) an object for providing a moving image (or a promotional movie) corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image Or inserts (or inserts) the objects in a neighborhood within a predetermined distance from the first object to generate a 3D panoramic image. Here, the video (or the video for promotional use) may include a video related to the product and / or service, a video related to the usage of the product (e.g., a video about how to use cosmetics, , Video on tool usage, video on cooking method, etc.), and may include text and / or voice messages.

In addition, the server 200 may add (or insert) an object for providing a coupon corresponding to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image, (Or inserts) the 3D panorama image within a predetermined distance from the 3D panorama image. Here, the coupon is a coupon to which a discount is applied when a corresponding commodity is purchased. In case of a plurality of coupons, the coupon is arranged in order by a slide method, and may be downloaded to the purchasing terminal 100 according to a user's selection.

In addition, the server 200 may add an object for providing goods and / or service information related to the recognized one or more first objects to a partial area on the corresponding first object in the preliminary panoramic image Or inserts (or inserts) the 3D panorama image into the 3D object within a predetermined distance from the first object. Herein, the base displays detailed guide information on base information to be applied when purchasing a corresponding commodity, and may be in a state of being arranged in a slide manner in a plurality of cases.

In addition, the server 200 may add (or insert) an object for providing comment information on a product and / or service related to the recognized one or more first objects to a partial area on the first object in the preliminary panoramic image, ) Or add (or insert) adjacent to the first object within a predetermined distance from the first object to generate a 3D panoramic image. Here, the comment includes information related to the corresponding goods and / or services (for example, a feeling of purchase, a review of the service, etc.) registered in another terminal that purchased the corresponding goods and / or services.

At this time, the object (and / or another additional object) added to the preliminary panoramic image information may be displayed in a state where light (or a specific color) is gradually The effect of repeatedly changing from the light-off state to the maximum state, the flickering effect of the light, the neon sign effect, and the effect of changing the color of the light to different colors at a predetermined cycle may be applied.

As described above, various effects can be applied to objects added to the preliminary panoramic image information and / or other additional objects to facilitate identification in the 3D panoramic image information.

The generated 3D panorama image includes (or interlocks / matches) position information about a first object, a product, a point (or coordinates) included in the 3D panorama image, and the like.

In addition, the server 200 may generate the 3D panoramic image for each language in consideration of language-specific characteristics.

The 3D panoramic image generated according to the embodiment of the present invention includes (or interlocks / matches) position information about a first object, a product, a point (or coordinates) included in the 3D panorama image, and the like.

That is, the 3D panorama image is not only the 3D panorama image but also the 3D panorama image corresponding to the arbitrary terminal (for example, the location information of the purchasing terminal 100) And location information about a first object, a commodity, a point,

Accordingly, when requesting a 3D panorama image corresponding to the position information from the arbitrary terminal, the server 200 selects one of the plurality of 3D panorama image information including position information of one or more objects, products, The 3D panorama image information corresponding to the specific location information requested from the arbitrary terminal can be confirmed and the 3D panorama image information can be provided to the corresponding terminal.

For example, in the server 200, an object corresponding to 123-45 of Gangnam-gu, Gangnam-gu, Seoul, which is the location information of the arbitrary terminal, among the 3D panoramic image information linked with the location information of a plurality of objects and / You can check the included 3D panorama image information.

If there is no object and / or product corresponding to 123-45 Gangnam-gu, Gangnam-gu, Seoul, which is the location information of the arbitrary terminal, among the 3D panoramic image information interlocked with the location information of the plurality of objects and / The server 200 may check the 3D panoramic image information including the object and / or the commodities similar to the position information of the arbitrary terminal (for example, 123-44 or 123-46 in Gangnam-gu, Seoul, Korea) .

When the plurality of 3D panoramic image information is matched with the GPS information configured at predetermined intervals, the server 200 generates the arbitrary 3D panorama image information based on the position information of the arbitrary terminal and the GPS information configured at the predetermined interval It is possible to confirm one 3D panorama image information corresponding to (or similar / related to) the position information of the terminal.

In addition, the 3D panorama image information corresponding to the specific position information among the plurality of 3D panorama image information stored in advance in the server 200 may be applied to the techniques utilized in the map search service.

As described above, the 3D panorama image information generated by the present invention is interlocked with the position information, and the 3D panorama image information, which is stored in advance in the server 200, for specific position information transmitted from an arbitrary terminal, The 3D panorama image information corresponding to the specific location information can be confirmed and the 3D panorama image information can be provided to the terminal that has transmitted the specific location information.

In addition, the server 200 repeatedly performs the preceding steps with a predetermined period (for example, 10 seconds, 1 minute, etc.) to generate a new 3D panorama image.

That is, the server 200 generates a new preliminary panoramic image by synthesizing images photographed in real time through the plurality of cameras at predetermined intervals (for example, 10 seconds, 1 minute, etc.) Recognizes one or more first objects included in the preliminary panoramic image, and adds the first code corresponding to the recognized one or more first objects to the new preliminary panoramic image to generate the new 3D panoramic image.

At this time, when a person is recognized in the generated new preliminary panoramic image, the server 200 acquires (or extracts) the outline of a person in the new preliminary panoramic image, and, in the new preliminary panoramic image, Removing the recognized person, adding a first code corresponding to the recognized one or more first objects and a contour of the acquired (or extracted) person in the new preliminary panorama image from which the person has been removed, And generates an image. Here, the server 200 adds the obtained contour of the person to the position of the person in the new preliminary panorama image.

In this way, when a person is included in the generated new preliminary panoramic image, the server 200 keeps only the outline of the person included in the new preliminary panoramic image for personal information protection, The inner area may be processed as an empty space or replaced with a screen of the immediately preceding preliminary panoramic image generated in the immediately preceding step.

Also, the server 200 confirms the difference between the generated new 3D panorama image and the previously generated 3D panorama image (or the generated new 3D panorama image information and the previously generated 3D panorama image information).

In addition, the server 200 compensates for the identified difference in real time to the 3D panorama image generated in advance and maintains the latest 3D panorama image.

That is, if the generated new 3D panorama image and the previously generated 3D panorama image are the same (or there is no difference), the server 200 generates one or more first objects included in the previously created 3D panorama image, / Or the state of the product is not changed, and the 3D panorama image generated in advance is maintained as the latest 3D panorama image.

When there is a difference between the generated new 3D panorama image and the previously generated 3D panorama image, the server 200 compensates the changed part (or the identified difference) to the 3D panorama image generated in advance (Or reflects) the 3D panorama image to generate a new 3D panorama image that is compensated for the difference between the 3D panorama images to be compared.

If the new 3D panorama image includes a person (or a person is recognized in the new 3D panorama image), the server 200 stores the 3D panorama image generated in the new 3D panorama image, A 3D panoramic image including a contour shaped person may be generated as a newest new 3D panoramic image by adding a contour of a person.

In the case where a person is included in the generated new 3D panoramic image, the server 200 maintains only the outline of the person included in the new 3D panoramic image for personal information protection, The inner area can be processed as an empty space or replaced with a screen of the immediately preceding 3D panorama image generated in the immediately preceding step.

When the new 3D panorama image includes a person, the server 200 processes the person included in the new 3D panorama image, and the contour processed human inside area is displayed on the immediately preceding By displaying a screen of the 3D panoramic image, it is possible to prevent a case where an object, a product or the like in the 3D panoramic image is hidden by the person and is not seen.

At this time, the server 200 may compensate only the difference in the 3D panorama image generated in advance, and replace the generated new 3D panorama image with the new 3D panorama image that is generated in advance, instead of the 3D panorama image generated in advance You may.

In this way, the server 200 can maintain the latest 3D panorama image in real time through background modeling.

Also, the server 200 receives an expected shopping list transmitted from the purchasing terminal 100, identification information of the purchasing terminal 100, and the like.

In addition, the server 200 performs price comparison of one or more goods and / or services included in the received expected shopping list by product (and / or service). At this time, the server 200 may perform a price comparison function (or a service-specific price comparison function) with respect to one or more products and / or services included in the expected shopping list by interworking with a plurality of online shopping malls, Can be performed.

In addition, the server 200 identifies one or more 3D panoramic image information associated with one or more goods and / or services included in the received expected shopping list. Here, the 3D panorama image information may be image information including actual offline merchandise related to a product (or service) (or information related to a store providing the corresponding service in off-line / information related to the corresponding service). In addition, the 3D panorama image information may include at least one of a sales advertisement, an enlarged image, a video (or a video for promotion), a coupon (for example, a discount coupon, a free coupon, etc.) It may be a state including an object for providing information. In addition, the 3D panorama image information may include other additional objects for screen switching, in addition to image information related to a corresponding product or service.

In addition, the server 200 may include a function of comparing prices of one or more goods and / or services included in the estimated shopping list by product (and / or service), one or more products And / or one or more 3D panoramic image information related to the service to the purchasing terminal 100.

Also, the server 200 receives the final shopping list transmitted from the purchasing terminal 100, the identification information of the purchasing terminal 100, and the like.

In addition, the server 200 performs a payment function for one or more goods and / or services included in the final shopping list by interlocking with the purchasing terminal 100 and the payment server 300. At this time, the server 200 may perform the settlement function by interlocking the purchase terminal 100 and the settlement server 300 through the simple settlement function. Here, when there are a plurality of sales terminals 400 (or store servers 500) providing products and / or services included in the final shopping list, the server 200 may include a plurality of sales terminals 400 The store server 500) in a batch manner.

That is, the server 200 receives the PIN number transmitted from the purchasing terminal 100, identification information of the purchasing terminal 100, and the like. Also, the server 200 performs an authentication procedure for the corresponding purchasing terminal 100 based on the received PIN number.

Also, if the authentication procedure is not normally completed, the server 200 generates payment failure information and transmits the generated payment failure information to the purchasing terminal 100.

When the authentication procedure is normally completed, the server 200 interlocks with the purchase terminal 100 and the payment server 300 to perform a payment function for one or more goods and / or services included in the final shopping list .

Also, the server 200 provides the purchase terminal 100 with a result of performing a payment function (or a result of performing a payment function provided from the payment server 300). Here, the payment function execution result (or payment information) includes goods and service information, settlement date and time information, price information for each order product / service, and quantity information for each order product / service.

In addition, the server 200 may store the final shopping list, the payment information, and the like in the sales terminal 400 (or the store server 500) related to the corresponding goods and / or services based on the payment function execution result and the final shopping list. And transmits membership information of the user related to the purchasing terminal 100 as a result of performing the function. Here, the member information includes a name, an address, a language used, a destination information, a shopping object type (for example, an avatar type, an emoticon type, etc.).

At this time, if there are a plurality of sales terminals 400 (or store servers 500) that provide one or more goods and / or services included in the shopping list, the server 200 provides the goods and / (Or information on goods and / or services managed in the store from among the final shopping list) purchased from the purchasing terminal 100 for each store that stores the merchandise and / 400 (or the store server 500), respectively.

In addition, for a specific commodity corresponding to the specific commodity and service information selected by the purchasing terminal 100, the commodity can be set to a predetermined commodity (for example, meat, commodities, , Etc.), the server 200 transmits to the purchase terminal 100 information indicating that the payment function for the specific goods and service information can not be performed (or the payment function failure information) . Herein, the information indicating that the payment function can not be performed includes information indicating that the specific commodity corresponding to the specific commodity and service information corresponds to the commodity that can not be imported.

In addition, when the specific product corresponds to a predetermined (or registered) import clearance prohibited product (for example, meat, commodities, weapons, gas, medicine, etc.), the server 200 terminates the settlement function .

Also, after the settlement function for a specific service (or a specific commodity) is normally completed, the server 200 issues a multi commodity discount coupon corresponding to the specific service (or a specific commodity) to the purchasing terminal 100 Or transmission).

Here, the multi-commodity discount coupon is generated by the server 200.

In other words, after the settlement function is normally completed, the server 200 transmits a service amount corresponding to the specific service (or a specific commodity), a discount amount, an expiration date, a plurality of service items A multi-commodity discount coupon (or a multi-commodity discount coupon) including a code (or a plurality of commodity item codes / a plurality of commodities and service information in the same category as the specific service or commodity), a unique number Discount coupon / multi-commodity and service discount coupon). The multi-commodity discount coupon is formed by grouping a plurality of commodities and service item codes related to the specific commodity and service information into a single code, and the commodity is generated in a barcode form, a QR code form, a string form, or the like. Further, the plurality of goods and service information (or the plurality of goods and services) may include a product name (or service name), a product unique code (or service unique code), a product image Information on experience of the goods / service, evaluation information on the goods / services, information on the location of the store (or providing the service) selling the goods, and the telephone number of the store. At this time, the multi-commodity discount coupon of the string form can be generated by a combination of at least one of numbers, letters, special characters, and symbols. Here, the merchandise item code corresponds to a merchandise unique code (or service unique code) in the merchandise information. In addition, the experience information on the goods / service may include experience information created in the terminal of the member registered in advance in the server 200, information on the multi-product discount coupon related to the product / service provided by the server 200 Experience information created and the like.

Also, the server 200 issues the generated multi-commodity discount coupon to the purchasing terminal 100.

Also, the server 200 may set the quantity (or the sales / payment amount) of the multi-commodity discount coupons that can be purchased from one purchasing terminal 100 in advance.

That is, the server 200 responds to specific goods and services from one purchasing terminal 100 within a preset sales quantity range (or within a sales / payment range) (for example, within 100 or within 20 million won) Quot; multi-commodity discount coupon "

In this way, the server 200 can prevent illegal transactions by restricting the mass purchase of specific goods and services.

In addition, after the settlement function is normally completed, the server 200 transmits a discount coupon, a discount coupon, a gift certificate of a specific shopping mall, a gift certificate of a traditional market, and the like, which are additionally provided upon purchase of the multi- (Or transmits) it to the terminal 100.

If the server 200 desires to use the multi-commodity discount coupon stored in the purchasing terminal 100 after receiving a specific commodity and / or service in the store equipped with the sales terminal 400, (Or payment processing) function for the multi-commodity discount coupon stored in the purchasing terminal 100 by interlocking between the billing server 300 and the sales terminal 400.

Also, the server 200 processes (or switches / changes) the corresponding multi-commodity discount coupon transmitted (or issued) to the purchasing terminal 100 in a use completed state.

In addition, if the balance of the gift certificate exists after the payment function is normally performed, the server 200 transmits a multi-product discount coupon including the available amount (or balance information) to the purchase terminal 100 do. At this time, the usable amount may be an amount of the amount that can be subtracted from the immediately preceding (or previous) usable amount according to the payment function.

In addition, if the balance of the gift certificate exists after the completion of the settlement function, the server 200 transmits the information including the available amount (or balance information) to the purchase terminal 400 through the sale terminal 400 (100).

Further, after the billing function is normally performed, the server 200 transmits a predetermined point and / or a discount coupon to the purchasing terminal 100. [

Also, after the settlement function is normally completed, the server 200 may transmit a preset point and / or a discount coupon to the purchasing terminal 100 through the sales terminal 400.

In addition, according to the use of the multi-commodity discount coupon, the commission can be distributed between the server 200, the payment server 300, and the sales terminal 400.

In addition, the server 200 confirms (or creates) one or more neighboring recommendation information within a predetermined distance from the route on the route guidance information generated by the purchase terminal 100, by interlocking with the purchase terminal 100, can do. Here, the recommendation information may be store information on which the multi-commodity discount coupon can be used. At this time, the server 200 generates the guidance information based on the location information of the purchasing terminal 100 and the store information selected by the purchasing terminal 100 by interlocking with the purchasing terminal 100 It is possible.

Also, the server 200 transmits the confirmed one or more recommendation information, the generated guidance information, and the like to the purchasing terminal 100.

If the validity period included in the multi-commodity discount coupon issued to the purchasing terminal 100 is less than a predetermined period (for example, one month from the validity period, 15 days from the validity period, 7 days from the validity period, (Including one day from the expiration date, etc.), and if the usable amount (or balance) remains in the gift voucher information, the server 200 displays information indicating that the balance of the multi-commodity discount voucher remains, To the purchasing terminal (100).

In addition, the server 200 receives experience information on specific goods / services transmitted from the purchasing terminal 100, evaluation information on specific goods / services, and the like.

In addition, the server 200 interoperates (or matches) the experience information on the received specific goods / services, the evaluation information on the specific goods / services, and the like, and stores the information.

The server 200 may also receive experience information, evaluation information, identification information of the purchasing terminal 100, and the like from the purchase of the specific product or specific service transmitted from the purchasing terminal 100 to the arrival (or coupon issuance) Lt; / RTI >

In addition, the server 200 stores the received experience information, evaluation information, and the like in correspondence with a specific product or a specific service.

The payment server 300 communicates with the purchasing terminal 100, the server 200, the sales terminal 400, the store server 500, and the like.

The settlement server 300 can be connected to the settlement server 300 through the payment terminal 300 and the sales terminal 400 in cooperation with the purchase terminal 100, Function. At this time, when the settlement function is performed, the payment server 300 performs a settlement function for the amount to which the discount amount is applied at the normal value by applying a preset discount amount to the normal amount corresponding to the specific goods and service information.

Also, after the settlement function is normally completed, the settlement server 300 provides the settlement function execution result (or settlement information) to the purchase terminal 100. Here, the payment function execution result (or payment information) includes goods and service information, settlement date and time information, price information for each order product / service, and quantity information for each order product / service.

In addition, when the user desires to use the multi-commodity discount coupon stored in the purchasing terminal 100 after receiving the specific commodity and / or the service in the store provided with the sales terminal 400, (Or payment processing) function for the multi-commodity discount coupon stored in the purchasing terminal 100 by interlocking between the server 100 and the server 200 and the sales terminal 400.

The sales terminal 400 may be a POS (Point of Sales) terminal or the like provided in a store.

In addition, the sales terminal 400 is installed (or installed) in any store.

In addition, the sales terminal 400 performs the membership registration procedure for the user of the sales terminal 400 by interlocking with the server 200.

In addition, when performing the membership registration procedure, the sales terminal 400 must complete the authentication function through the authentication means (for example, mobile phone, credit card, Ipfin, etc.) Can normally be completed.

The sales terminal 400 also communicates with the purchasing terminal 100, the server 200, the payment server 300, the store server 500, and the like.

The sales terminal 400 may be connected to the purchase terminal 100, the server 200, the payment server 300, and the like, Function may be performed.

Also, the sales terminal 400 may receive the payment function execution result (or payment information) according to the payment function execution transmitted from the server 200 or the payment server 300, And the sales quantity of the product discount coupon.

Also, the sales terminal 400 may perform a product inventory management function in the store related to the sales terminal 400 based on the result of the payment function execution, the sales quantity of the multi-commodity discount coupon, and the like.

Also, the sales terminal 400 applies CRM (Custom Relation Management) based on the result of the received payment function, the sales quantity of the multi-commodity discount coupon, And perform marketing functions for the goods or services provided by the store in connection with the service.

As described above, it is possible for the sales terminal 400 to be a tourist visiting the area where the store related to the sales terminal 400 is located for a short period of time only by selling a product or service without any prior publicity or marketing activities, It is possible to grasp the estimated sales and the number of customers to be visited through the multi product discount coupon that is sold, so that it is possible to secure inventory and manpower, thereby improving management efficiency.

In addition, by replacing the advertisement and promotional design pages, which are excessively consumed in online sales, with the 3D panoramic images, the sales terminal 400 can reduce the excessive advertising costs and reduce the cost.

When the sales terminal 400 wants to use the multi-commodity discount coupon stored in the purchasing terminal 100 after receiving a specific commodity and / or service in the store where the sales terminal 400 is provided, Product discount coupon (or the unique number of the corresponding multi-product discount coupon) stored in the purchasing terminal 100 in a QR code form or the like.

That is, when the user of the purchasing terminal 100 having the multi-commodity discount coupon visits the store provided with the sales terminal 400 and purchases one or more commodities to be sold in the corresponding store, When the sales terminal 400 is to perform a payment function through the multi-commodity discount coupon in order to pay a price for the service, the sales terminal 400 transmits the multi- And recognizes the unique number of the product discount coupon (or the information of the multi-product discount coupon). At this time, the sales terminal 400 can recognize the corresponding multi-product discount coupon through a recognition unit (for example, a barcode recognition unit, a QR code recognition unit, etc.) provided in the sales terminal 400.

The sales terminal 400 may also be connected to the purchase terminal 100, the server 200 and the payment server 300 based on the recognized multi-commodity discount coupon (or the unique number of the multi-commodity discount coupon) (Or payment processing) function for the multi-commodity discount coupon stored in the purchasing terminal 100. [

Also, the sales terminal 400 processes (or switches / changes) the corresponding multi-commodity discount coupon transmitted (or issued) to the purchasing terminal 100 in a use completed state.

Also, after the use process (or the payment function) for the multi-commodity discount coupon is completed, the sales terminal 400 displays the use processing result for the corresponding multi-commodity discount coupon. Here, the usage processing result for the multi-commodity discount coupon includes a store name, a store location, a store contact, product and service information, payment date and time information, and price information for each order product / service.

Also, after the use process (or the payment function) for the multi-commodity discount coupon is completed, the sales terminal 400 outputs the use processing result for the multi-commodity discount coupon through a printed matter such as a receipt.

If there is a balance of the multi-commodity discount coupon after the use process (or the payment function execution) for the corresponding multi-commodity discount coupon is completed, the sales terminal 400 transmits the multi- (Or balance information / updated usable amount) in the discount coupon, and the like.

In addition, the sales terminal 400 displays information including the usable amount or the like in the received multi-commodity discount coupon or outputs it through a print such as the receipt.

Further, after the use process (or the payment function) for the corresponding multi-commodity discount coupon is completed, the sales terminal 400 transmits (or issues) a predetermined point and / or a discount coupon to the purchase terminal 100 . Here, the point and / or discount coupon may be included in the usage processing result for the multi-commodity discount coupon or may be included in the receipt to be issued.

The store server 500 communicates with the purchasing terminal 100, the server 200, the payment server 300, the sales terminal 400, and the like.

Also, the store server 500 may be the sales terminal 400 provided in a specific store.

Also, the store server 500 receives the final shopping list transmitted from the server 200, the result of the payment function execution, the member information of the user related to the purchasing terminal 100, and the like.

In addition, the store server 500 delivers the paid merchandise to a courier company (not shown) based on the coupon information included in the member information.

In this way, a shopping list for each purchase point in the home is created, and an expected shopping list is provided to the server through modification of the shopping list according to the purchase point created at home, and the server compares the price list for each product, 3D panorama image information is provided to the purchasing terminal, and the purchasing terminal can display the price comparison for each product and the 3D panorama image information for each product.

Also, when an object included in the specific 3D panorama image information is selected from among the 3D panorama image information for each product, information related to the selected object may be displayed or a function related to the object may be performed.

Hereinafter, a method of controlling an omni channel system using an augmented reality according to the present invention will be described in detail with reference to FIGS. 1 to 10. FIG.

7 is a flowchart illustrating a method of controlling an omni channel system using an augmented reality according to an embodiment of the present invention.

First, the purchasing terminal 100 generates a shopping list (or an optimal shopping list for each point of purchase) according to the point-in-time of purchase. Here, the purchasing terminal 100 may be a representative terminal set (or selected) among a plurality of purchasing terminals included in a community (for example, a family, a workplace, a club, etc.) related to the purchasing terminal 100 . At this time, the shopping list according to the purchase point includes one or more goods and / or services related to the community.

That is, the purchasing terminal 100 generates the shopping list for each purchase point including at least one commodity and / or service recommended by each of the plurality of purchasing terminals included in the community related to the purchasing terminal 100.

At this time, when a preset event occurs, the purchasing terminal 100 may determine the purchase time point including at least one commodity and / or service recommended by each of the plurality of purchasing terminals included in the community related to the purchasing terminal 100 You can also create a separate shopping list. Here, the preset event may be a case where the present day and time are a pre-set shop date and time, a shopping list is requested to be generated at any one of the plurality of purchase terminals included in the community, .

Also, the purchasing terminal 100 may be connected to the purchasing terminal 100 (or at least one of the plurality of purchasing terminals included in the community related to the purchasing terminal 100) within the predetermined period (E. G., Within the last 8 weeks) of at least one of the purchased fresh foods. Here, the fresh cut product (or a fresh cut product) is a product that minimizes the processing and minimizes the processing to maximize the quality of the food Including agricultural products, livestock products, etc.).

Also, the purchasing terminal 100 includes goods and / or services whose prices have been changed (or changed) at the lowest price by interlocking with the server 200 among the items of interest preset by the community related to the purchasing terminal 100 The shopping list according to the purchase point is generated.

The purchasing terminal 100 may also be provided with a predetermined set of preferences representing a predetermined period (or season) (for example, Christmas, Valentine's Day, Children's Day, Parent Day, etc.) And creates the shopping list according to the purchase point including the goods.

In addition, the purchasing terminal 100 generates the shopping list according to the purchasing point including the family anniversary, the event, the travel related goods and / or the service set in advance by the community related to the purchasing terminal 100.

In addition, the purchasing terminal 100 may be provided with goods and / or services associated with the weather within a predetermined period (or within a week including the latest / last purchase date) (for example, (Including related goods, services related to overseas trips, and items related to the ratio of umbrella, loyalty, etc. when the weather within the last week has not been paid, etc.).

In addition, the purchasing terminal 100 may be directly connected to the server 200, for example, within a predetermined rank (for example, within the 10th rank) among the goods or services sold in the country where the purchasing terminal 100 is located, Or a shopping list according to the purchase point including the purchased popular goods and / or services.

For example, the first purchasing terminal 100 may include a first purchasing terminal to a fourth purchasing terminal included in the family community related to the first purchasing terminal (for example, a first purchasing terminal carried by the mother, 2 purchasing terminal, a third purchasing terminal owned by a son, and a fourth purchasing terminal owned by a daughter) and a sixth commodity to a seventh commodity which are fresh foods purchased within the last 8 weeks (For example, beef and milk) at step S710.

Then, the purchasing terminal 100 displays the shopping list according to the created purchase point.

In addition, the purchasing terminal 100 performs a process of modifying or adding the displayed shopping list according to the displayed purchase point according to a user input (or a user selection) Or other expected shopping lists as a result of the modification or addition process). Here, the expected shopping list includes a product name (or a service name), a product unique code (or service specific code), a quantity, a manufacturer name (or a service provider company name), and the like.

Also, the purchasing terminal 100 transmits the generated expected shopping list, the identification information of the purchasing terminal 100, and the like to the server 200. Here, the identification information of the purchasing terminal 100 includes an MDN, a mobile IP, a mobile MAC, a SIM (subscriber identity module) card specific information, a serial number, and the like.

For example, as shown in FIG. 8, the first purchasing terminal displays the shopping list 800 by the first purchase point. In addition, the first purchasing terminal may include a first estimated shopping list including first to sixth goods and seventh goods excluding the third to sixth goods among the shopping lists according to the first purchasing point, . In addition, the first purchasing terminal transmits the generated first expected shopping list, identification information of the first purchasing terminal, etc. to the server 200 (S720).

Then, the server 200 receives an expected shopping list transmitted from the purchasing terminal 100, identification information of the purchasing terminal 100, and the like.

In addition, the server 200 performs price comparison of one or more goods and / or services included in the received expected shopping list by product (and / or service). At this time, the server 200 performs a price comparison function for each product (and / or service) for one or more products and / or services included in the expected shopping list by interworking with a plurality of online shopping malls, can do.

For example, the server 200 performs a price comparison function for each of the first goods, the second goods, and the seventh goods included in the first expected shopping list transmitted from the first purchasing terminal (S730).

In addition, the server 200 identifies one or more 3D panoramic image information associated with one or more goods and / or services included in the received expected shopping list. Here, the 3D panorama image information may be image information including actual offline merchandise related to a product (or service) (or information related to a store providing the corresponding service in off-line / information related to the corresponding service). In addition, the 3D panorama image information may include at least one of a sales advertisement, an enlarged image, a video (or a video for promotion), a coupon (for example, a discount coupon, a free coupon, etc.) It may be a state including an object for providing information. At this time, the sales advertisement includes POP, flyer, banner advertisement, poster advertisement, signboard, price tag, and the like. In addition, the enlarged image may be an internal photograph (or an additional image related to a product) of a product such as a refrigerator or a washing machine, or may be an enlarged photograph of a fresh food. The video (or the video for promotional use) may include a video related to the product and / or the service, a video related to the use of the product (e.g., a video on how to use cosmetics, , Video on tool usage, video on cooking method, etc.), and may include text and / or voice messages. In addition, the coupon is a coupon to which a discount is applied when a corresponding product is purchased. If the coupon is a plurality of coupons, the coupon is arranged in order by a slide method, and may be downloaded to the purchasing terminal 100 according to a user's selection. In addition, the base may be in a state of being arranged in a slide manner in a plurality of cases. In addition, the comment includes information related to the corresponding goods and / or services (for example, a feeling of purchase, a review of the service, etc.) registered in the other terminal from which the corresponding goods and / or services are purchased. In addition, the 3D panorama image information may include other additional objects for screen switching, in addition to image information related to a corresponding product or service.

For example, the server 200 confirms 3D panorama image information for each of the first goods, the second goods, and the seventh goods included in the first expected shopping list transmitted from the first purchasing terminal.

That is, the server 200 stores the eleventh 3D panorama image information related to the first refrigerator in the AA department store and the eleventh 3D panorama image information related to the first refrigerator in the BB department store with respect to the first product (for example, the first refrigerator) And the 13th 3D panoramic image information related to the first refrigerator in the CC mart. In addition, the server 200 stores the 21st 3D panorama image information related to the first washing machine in the AA department store, the 22nd 3D panorama image information related to the first washing machine in the CC mall, Check the image information. In addition, the server 200 stores the 71st 3D panorama image information in the BB department store, the 72nd 3D panorama image information in the CC mart, and the 73rd 3D panorama image in the DD mart for the seventh product (for example, milk) Information is confirmed (S740).

Thereafter, the server 200 may compare the price of one or more goods and / or services included in the estimated shopping list with the price of each product (and / or service) And / or one or more 3D panoramic image information related to the service to the purchasing terminal 100.

For example, the server 200 may store the results of performing the first price comparison function on the first goods included in the first expected shopping list, the eleventh to thirteenth 3D panorama image information, Seventh to thirteenth 3D panoramic image information, a seventh price comparison function execution result for the seventh merchandise included in the first expected shopping list, and a seventh to seventeenth price comparison function execution result for the second merchandise, 3D panorama image information and the like to the first purchasing terminal (S750).

Then, the purchasing terminal 100 responds to one or more goods and / or services included in the expected shopping list transmitted from the server 200 in response to the estimated shopping list, identification information of the purchasing terminal 100, One or more 3D panoramic image information related to one or more goods and / or services included in the expected shopping list, and the like, as a result of the price comparison function for each product (and / or service).

In addition, the purchasing terminal 100 may include a function of comparing the prices of one or more products and / or services included in the received expected shopping list with prices of products (and / or services) One or more 3D panoramic image information related to the goods and / or services, and the like. At this time, the purchasing terminal 100 displays the result of the price comparison function by product (and / or service), and displays the result of the price comparison function displayed by the product (and / or service) Display information. When there are a plurality of 3D panoramic image information related to the product and / or service, the purchasing terminal 100 may display the plurality of 3D panoramic image information on a single screen in a thumbnail (or slide) manner have.

For example, the first purchasing terminal may send a first price comparison function execution result for the first commodity included in the first expected shopping list transmitted from the server 200 in response to the first expected shopping list transmitted previously, The 11th to 13th 3D panorama image information, the second price comparison function execution result and the 21st to 22nd 3D panorama image information on the second goods included in the first expected shopping list, The seventh price comparison function execution result, and the seventeenth through thirteenth 3D panorama image information with respect to the seventh product.

9, the first purchasing terminal may include a first price comparison function execution result (911) related to the received first product (e.g., a first refrigerator) and a second price comparison function execution result The second price comparison function execution result 921 and the 21st to 22nd 3D panorama image information 922 and 923 relating to the second product (for example, the first washing machine), the panorama image information 912, 913, and 914, A seventh price comparison function execution result 931 related to the seventh product (for example, milk), 71 to 73 3D panorama image information 932, 933, 934, and the like are displayed (S760).

When the specific 3D panorama image information is selected from among one or more 3D panorama image information related to one or more goods and / or services displayed on the purchasing terminal 100, the purchasing terminal 100 determines whether the selected specific goods 3D panorama image information (or 3D panorama image information related to the selected specific product (or service) / specific 3D panorama image information related to the goods (or services) in the actual offline corresponding to the actual goods (or services). Here, the 3D panoramic image information may be image information including a product in an actual offline (or information related to a store / a corresponding service providing the corresponding service in offline) related to the product (or service). In addition, the 3D panorama image information may include at least one of a sales advertisement, an enlarged image, a video (or a video for promotion), a coupon (for example, a discount coupon, a free coupon, etc.) It may be a state including an object for providing information. In addition, the 3D panorama image information may include other additional objects for screen switching, in addition to image information related to a corresponding product or service. At this time, the object (and / or other additional objects) displayed on the purchasing terminal 100 may have a maximum state (or a specific color) with respect to the corresponding object at a predetermined period so as to facilitate the confirmation of the object (Or lighted state) and then repeatedly changing from the lighted state to the maximum state (or lighting state), the flickering effect of the light, the effect of the neon sign, and the effect of changing the color of the light to different colors at predetermined cycles May be applied.

For example, when the thirteenth 3D panorama image information 914 relating to the first commodity is selected from a plurality of 3D panorama image information related to the first commodity, the second commodity, and the seventh commodity shown in FIG. 9, 10, the first purchasing terminal displays the thirteenth 3D panorama image information 1000 related to the selected first commodity. 10, the first purchasing terminal includes a first object 1010 and a second object 1020 in a thirteenth 3D panorama image information 1000 related to the first commodity. Herein, the first object 1010 represents additional information related to the first product or an object for performing an additional function, and the second object 1020 represents another 3D panorama image information related to the first product Represents an object for screen switching. In addition, the first object 1010 and the second object 1020 are repeatedly changed from a maximum state (or a lighted state) to a minimum state (or an unlit state), and from a minimum state to a maximum state , It is possible to effectively provide (or guide) that the additional information related to the first product exists (S770).

Thereafter, when a predetermined object included in 3D panorama image information related to a specific product displayed on the purchasing terminal 100 is selected, the purchasing terminal 100 displays information related to the selected object, As shown in FIG.

In addition, when another predetermined additional object included in the 3D panorama image information related to the specific product displayed on the purchasing terminal 100 is selected, when the mouse is positioned for a predetermined time on the other additional object, The purchasing terminal 100 performs a screen switching function with other 3D panorama image information related to the other additional objects when the touched state of the 3D object is maintained for a predetermined period of time.

For example, when the object 1010 related to the enlarged image is selected from the 13th 3D panoramic image information 1000 related to the first product shown in FIG. 10, the first purchasing terminal may display one The enlarged image is displayed. At this time, the first purchasing terminal may display one or more enlarged images related to the first goods on the 13th 3D panorama image information, or may display one or more enlarged images related to the first goods on a new screen have.

10, when the coupon-related object 1010 is selected from among the 13th 3D panoramic image information 1000 related to the first commodity shown in FIG. 10, the first purchasing terminal transmits a coupon related to the first commodity To the corresponding first purchasing terminal.

In another example, when a wine refrigerator is selected (or another additional object 1020 for screen switching among 13th 3D panoramic image information 1000 related to the first product shown in FIG. 10) When the mouse is positioned for a certain period of time / when the touch state of the other additional object is maintained for the predetermined time), the first purchasing terminal transmits another 3D panorama image information related to the other additional object 3D panorama image information for a wine refrigerator similar to a refrigerator (one product)) (S780).

Then, the purchasing terminal 100 confirms one or more 3D panorama image information related to one or more products and / or services and displays the 3D panorama image information on the basis of user selection (or user input) And finally creates a final shopping list for the selected goods and / or services. Here, the final shopping list includes a finally selected product name (or service name), a product unique code (or a service specific code), a quantity, a manufacturer name (or a service provider company name), and the like.

In addition, the purchasing terminal 100 transmits the generated final shopping list, identification information of the purchasing terminal 100, and the like to the server 200.

For example, the first purchasing terminal may store the first goods according to the price information provided by the BB department store among the first price comparison function execution result for the first goods (e.g., the first refrigerator) Selects the second product according to the price information provided by the CCM from the second price comparison function execution result for the second product (for example, the first washer), and selects the seventh product (e.g., The first goods offered by the selected BB department store, the second goods offered by the CC shopping mall, the second goods offered by the second shopping mall, And a seventh merchandise provided by the BB department store. In addition, the first purchasing terminal transmits the generated first final shopping list, identification information of the first purchasing terminal, and the like to the server 200 (S790).

Then, the server 200 receives the final shopping list transmitted from the purchasing terminal 100, the identification information of the purchasing terminal 100, and the like.

In addition, the server 200 performs a payment function for one or more goods and / or services included in the final shopping list by interlocking with the purchasing terminal 100 and the payment server 300. At this time, the server 200 may perform the settlement function by interlocking the purchase terminal 100 and the settlement server 300 through the simple settlement function. Here, when there are a plurality of sales terminals 400 (or store servers 500) providing products and / or services included in the final shopping list, the server 200 may include a plurality of sales terminals 400 The store server 500) in a batch manner.

For example, the server 200 may perform a payment function for the first goods, the second goods, and the seventh goods included in the first end shopping list by interlocking with the first purchasing terminal and the payment server 300 (S800).

Then, the server 200 provides a result of performing the settlement function (or a result of performing the settlement function provided from the settlement server 300) to the purchase terminal 100. Here, the payment function execution result (or payment information) includes goods and service information, settlement date and time information, price information for each order product / service, and quantity information for each order product / service. Also, the purchasing terminal 100 receives and displays the payment function execution result provided from the server 200.

In addition, the server 200 may store the final shopping list, the payment information, and the like in the sales terminal 400 (or the store server 500) related to the corresponding goods and / or services based on the payment function execution result and the final shopping list. And transmits membership information of the user related to the purchasing terminal 100 as a result of performing the function. Here, the member information includes a name, an address, a language used, a destination information, a shopping object type (for example, an avatar type, an emoticon type, etc.).

At this time, if there are a plurality of sales terminals 400 (or store servers 500) that provide one or more goods and / or services included in the shopping list, the server 200 provides the goods and / (Or information on goods and / or services managed in the store from among the final shopping list) purchased from the purchasing terminal 100 for each store that stores the merchandise and / 400 (or the store server 500), respectively.

In addition, the plurality of sales terminals 400 (or the sales terminal 400 / the store server 500) may perform a delivery function based on the member information for one or more goods paid by the purchase terminal 100 .

The sales terminal 400 (or the sales terminal 400 / the store server 500) may correspond to the purchase terminal 100 when the sales terminal 400 has paid for the service item And performs a function of issuing a coupon related to the service item.

For example, the server 200 performs a payment function for the first commodity, the second commodity, and the third commodity by interlocking with the first purchasing terminal and the payment server 300, To the first purchasing terminal. Also, the first purchasing terminal receives the payment function execution result provided from the server 200, and displays the received payment function execution result.

In addition, after the billing function is normally completed, the server 200 transmits to the first sales terminal 400 related to the BB department store providing the first goods and the seventh goods, Information about the second merchandise to the second sales terminal 400 related to the CC mart providing the second merchandise, information on the second merchandise, information on the member of the first purchasing terminal, And so on. In addition, the first sales terminal may store information on the first product and the seventh product based on information on the first product and the seventh product, which are provided from the server 200, And delivers the first commodity and the seventh commodity to the user of the first purchasing terminal by performing a delivery function. In addition, the second sales terminal performs a delivery function for the second goods based on the information about the second goods provided from the server 200, the member information of the first purchase terminal, and the like, And delivers the goods to the user of the first purchasing terminal (S810).

As described above, the embodiment of the present invention creates a shopping list according to a point-in-time at home, provides an expected shopping list to the server through modification of the shopping list according to the point-of-purchase, Comparing the price of each product according to the shopping list, and providing the 3D panoramic image information for each product to the purchasing terminal, displaying the 3D panoramic image information for each product and the price comparison for each product at the purchasing terminal, and providing a convenient shopping function for necessary products at home The convenience of the user can be improved.

As described above, in the embodiment of the present invention, when an object included in specific 3D panorama image information is selected from the 3D panorama image information for each product, information related to the selected object is displayed or functions related to the object are performed In this way, it is possible to conveniently check the physical merchandise in the local store, confirm the food manufacturing process related to the merchandise through the video, check the customer's comment, etc., The convenience of the user can be improved.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention provides a method for creating a shopping list for each purchase point in a home, providing an expected shopping list to a server through modification of the shopping list according to the purchase point created at home, The 3D panorama image information for each product is displayed, and when an object included in the specific 3D panorama image information is selected from the 3D panorama image information for each product, the 3D panorama image information is provided to the purchasing terminal, By displaying the information related to the selected object or by performing functions related to the object, a convenient shopping function for goods necessary at home is provided, and thus various information can be confirmed from the user side in a non-face-to-face manner between the seller and the user through the 3D panoramic image as a virtual reality Improve user's convenience That can kill, can be widely used, etc. panoramic imaging applications, providing shopping information sector, marketing, terminal applications, server applications.

10: Omni Channel System
100: Purchasing terminal 200: Server
300: Payment server 400: Sales terminal
500: Store server

Claims (1)

A control method of an omni-channel system using an augmented reality,
Receiving, by the purchasing terminal, specific 3D panoramic image information associated with one or more goods and services provided from a server;
Displaying the received specific 3D panorama image information by the purchasing terminal; And
When the mouse is positioned for a predetermined time on another additional object included in the specific 3D panoramic image information being displayed and the touched state of the other additional object is held for a predetermined time by the purchasing terminal Performing a screen switching function with other 3D panorama image information related to the other additional object,
An object for providing a sale advertisement, an enlarged image, a video, a coupon, a donation, and comment information to a video including information related to a real offline product or a service provided on the off-line, and another 3D And an additional object for changing the screen to the panoramic image information is added.

Images