CN111913947A - Data integration system of take-out platform - Google Patents
Data integration system of take-out platform Download PDFInfo
- Publication number
- CN111913947A CN111913947A CN202010993671.8A CN202010993671A CN111913947A CN 111913947 A CN111913947 A CN 111913947A CN 202010993671 A CN202010993671 A CN 202010993671A CN 111913947 A CN111913947 A CN 111913947A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- user
- shop
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010354 integration Effects 0.000 title claims abstract description 38
- 238000004140 cleaning Methods 0.000 claims abstract description 10
- 230000000007 visual effect Effects 0.000 claims abstract description 4
- 238000007726 management method Methods 0.000 claims description 24
- 238000000034 method Methods 0.000 claims description 14
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 238000013523 data management Methods 0.000 claims description 3
- 230000004807 localization Effects 0.000 claims description 3
- 238000010200 validation analysis Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/248—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
- G06F16/287—Visualization; Browsing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0631—Resource planning, allocation, distributing or scheduling for enterprises or organisations
- G06Q10/06311—Scheduling, planning or task assignment for a person or group
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/083—Shipping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
- G06Q30/0635—Processing of requisition or of purchase orders
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Quality & Reliability (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Finance (AREA)
- Accounting & Taxation (AREA)
- Tourism & Hospitality (AREA)
- Educational Administration (AREA)
- Computational Linguistics (AREA)
- Game Theory and Decision Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a takeout platform data integration system aiming at the technical problems in the prior art, wherein a user firstly creates an independent shop ID through a user management module, then binds the shop ID registered by the user under a plurality of different takeout platforms with the independent shop ID established in the system for accessing the merchant information of the user on the plurality of different takeout platforms, and performs data integration on data source information of other takeout platforms through a data integration module after the merchant information is accessed, and the integrated data information is processed through a data cleaning module, then is input into a data logic warehouse, displayed through a visual data display module, and backed up and stored through a data backup management module. The integrated data is analyzed, processed and detected to obtain the operation data, and the operation data is provided for the user as a reference.
Description
Technical Field
The invention relates to the technical field of data integration, in particular to a takeout platform data integration system.
Background
At present, the take-out industry develops rapidly, aiming at different fields and different industries, take-out platforms of various different types are provided, such as catering, fresh food, medicines and the like, the same industry can be provided with a plurality of different take-out platforms, a merchant often registers the take-out platforms to receive orders simultaneously in order to increase sales volume, the management is very inconvenient, a plurality of devices are needed to receive order messages from different platforms in real time, the unified management cannot be carried out, the management efficiency is low, the learning cost of the merchant is high, and the requirements of the merchant cannot be met.
Disclosure of Invention
Aiming at the technical problems in the prior art, the invention provides a takeout platform data integration system, which integrates the data integration of merchant versions of various platforms, solves the problems of inconvenient operation and management of different terminals of a user, and analyzes, processes and detects the operation data of the integrated data to provide the operation data for the user as reference.
Therefore, the invention provides a data integration system of a takeout platform, which comprises a user management module, a data integration module and a data integration module, wherein the user management module is used for establishing a system-independent shop ID and binding shop accounts of different platforms of a user under the shop ID so as to acquire merchant information set by the user in shops of different platforms;
the data integration module integrates and integrates the information of the bound shops with different platforms of the user so as to facilitate the data source to be accessed into the system;
the data cleaning module is used for converting, verifying, cleaning and analyzing the initial data integrated by the data integration module;
the data logic warehouse analyzes the shop data indexes through the data logic warehouse, and the data indexes at least comprise various operation indexes, commodity indexes and user behavior indexes;
the visualized data display module displays each data index in real time by using a line chart, a pie chart and a bar chart;
the data backup management module is used for backing up and managing data information in the using process;
the user firstly creates an independent shop ID through a user management module, then the shop ID registered by the user under a plurality of different takeout platforms is bound with the independent shop ID established in the system for accessing the merchant information of the user on the plurality of different takeout platforms, data integration is carried out on data source information of other takeout platforms through a data integration module after the merchant information is accessed, the integrated data information is processed through a data cleaning module, then input into a data logic warehouse, displayed through a visual data display module, and backed up and stored through a data backup management module.
Preferably, the data integration module comprises adding stream analysis to an existing DataStage job, adding DataStage processing to an existing DataStage application, and then creating a DataStage job and the StreaStage application from scratch; the integration process includes the following data flows: Datastage-Streams, Datastage-Streams-Datastage and Streams-Datastage.
Preferably, the data cleansing module includes: the method comprises the steps of graphically and quickly constructing complex conversion and data quality validation operation, reusing the existing operation, locally running DataStage conversion to process HDFS data, establishing a data manager, establishing a data lineage and data management, reducing redundant data infrastructure, supporting Hadoop node labels, and automatically realizing binary localization through the HDFS.
Preferably, the data cleansing module supports Apache 2.6, IOP 4.0, HDP2.2 and CHD 5.3.
Preferably, the merchant information includes a merchant name, a merchant phone, a merchant address, a merchant account number, and merchandise related information.
The invention has the beneficial effects that: the invention provides a data integration system of a takeout platform, which integrates data integration of merchant versions of various platforms, solves the problems of inconvenient operation and management of different terminals of a user, and provides the integrated data for the user as reference after analyzing, processing and detecting operation data.
Drawings
Fig. 1 is a schematic block diagram of the present invention.
Detailed Description
The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.
As shown in fig. 1, the present embodiment discloses a takeaway platform data integration system, which includes:
the system comprises a user management module, a platform management module and a platform management module, wherein the user management module is used for establishing a system independent shop ID and binding shop accounts of different platforms of a user under the shop ID so as to acquire merchant information set by the user in shops of different platforms;
the data integration module integrates and integrates the information of the bound shops with different platforms of the user so as to facilitate the data source to be accessed into the system;
the data cleaning module is used for converting, verifying, cleaning and analyzing the initial data integrated by the data integration module;
the data logic warehouse analyzes the shop data indexes through the data logic warehouse, and the data indexes at least comprise various operation indexes, commodity indexes and user behavior indexes;
the visualized data display module displays each data index in real time by using a line chart, a pie chart and a bar chart;
the data backup management module is used for backing up and managing data information in the using process;
the user firstly creates an independent shop ID through a user management module, then the shop ID registered by the user under a plurality of different takeout platforms is bound with the independent shop ID established in the system for accessing the merchant information of the user on the plurality of different takeout platforms, data integration is carried out on data source information of other takeout platforms through a data integration module after the merchant information is accessed, the integrated data information is processed through a data cleaning module, then input into a data logic warehouse, displayed through a visual data display module, and backed up and stored through a data backup management module.
Preferably, the data integration module comprises adding stream analysis to an existing DataStage job, adding DataStage processing to an existing DataStage application, and then creating a DataStage job and the StreaStage application from scratch; the integration process includes the following data flows: Datastage-Streams, Datastage-Streams-Datastage and Streams-Datastage.
Preferably, the data cleansing module includes: the method comprises the steps of graphically and quickly constructing complex conversion and data quality validation operation, reusing the existing operation, locally running DataStage conversion to process HDFS data, establishing a data manager, establishing a data lineage and data management, reducing redundant data infrastructure, supporting Hadoop node labels, and automatically realizing binary localization through the HDFS.
Preferably, the data cleansing module supports Apache 2.6, IOP 4.0, HDP2.2 and CHD 5.3.
Preferably, the merchant information includes a merchant name, a merchant phone, a merchant address, a merchant account number, and merchandise related information.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (5)
1. A takeaway platform data integration system comprising:
the system comprises a user management module, a platform management module and a platform management module, wherein the user management module is used for establishing a system independent shop ID and binding shop accounts of different platforms of a user under the shop ID so as to acquire merchant information set by the user in shops of different platforms;
the data integration module integrates and integrates the information of the bound shops with different platforms of the user so as to facilitate the data source to be accessed into the system;
the data cleaning module is used for converting, verifying, cleaning and analyzing the initial data integrated by the data integration module;
the data logic warehouse analyzes the shop data indexes through the data logic warehouse, and the data indexes at least comprise various operation indexes, commodity indexes and user behavior indexes;
the visualized data display module displays each data index in real time by using a line chart, a pie chart and a bar chart;
the data backup management module is used for backing up and managing data information in the using process;
the user firstly creates an independent shop ID through a user management module, then the shop ID registered by the user under a plurality of different takeout platforms is bound with the independent shop ID established in the system for accessing the merchant information of the user on the plurality of different takeout platforms, data integration is carried out on data source information of other takeout platforms through a data integration module after the merchant information is accessed, the integrated data information is processed through a data cleaning module, then input into a data logic warehouse, displayed through a visual data display module, and backed up and stored through a data backup management module.
2. The takeaway platform data integration system of claim 1 wherein the data integration module includes adding a streaming analysis to an existing streaming job and adding a streaming process to an existing streaming application, and then creating a streaming job and streaming application from scratch; the integration process includes the following data flows: Datastage-Streams, Datastage-Streams-Datastage and Streams-Datastage.
3. The takeaway platform data integration system of claim 2 wherein said data cleansing module comprises: the method comprises the steps of graphically and quickly constructing complex conversion and data quality validation operation, reusing the existing operation, locally running DataStage conversion to process HDFS data, establishing a data manager, establishing a data lineage and data management, reducing redundant data infrastructure, supporting Hadoop node labels, and automatically realizing binary localization through the HDFS.
4. The takeaway platform data integration system of claim 3 wherein said data cleansing module supports Apache 2.6, IOP 4.0, HDP2.2 and CHD 5.3.
5. A takeaway platform data integration system according to claim 1 wherein merchant information includes merchant name, merchant phone, merchant address, merchant account number and merchandise related information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010993671.8A CN111913947A (en) | 2020-09-21 | 2020-09-21 | Data integration system of take-out platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010993671.8A CN111913947A (en) | 2020-09-21 | 2020-09-21 | Data integration system of take-out platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111913947A true CN111913947A (en) | 2020-11-10 |
Family
ID=73265281
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010993671.8A Pending CN111913947A (en) | 2020-09-21 | 2020-09-21 | Data integration system of take-out platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111913947A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118656429A (en) * | 2024-08-19 | 2024-09-17 | 北京慧博科技有限公司 | Private domain public domain attribute automatic association binding method and system |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101908165A (en) * | 2010-05-17 | 2010-12-08 | 北京中机科海科技发展有限公司 | Geographic information system (GIS)-based industrial cluster information integration service system and method |
| CN102769578A (en) * | 2011-05-04 | 2012-11-07 | 陈宇晓 | System and method for integrating microblog management systems in multiple platforms |
| CN104079538A (en) * | 2013-03-28 | 2014-10-01 | 清华大学 | Microblog aggregation method and system supporting cross-platform interaction |
| CN107248114A (en) * | 2017-06-01 | 2017-10-13 | 世纪禾光科技发展（北京）有限公司 | Electric business loan administration method and system |
| CN107886281A (en) * | 2017-11-30 | 2018-04-06 | 百富计算机技术（深圳）有限公司 | Take out order processing method, apparatus, computer equipment and storage medium |
| CN108494799A (en) * | 2018-04-18 | 2018-09-04 | 家园网络科技有限公司 | data sharing method and system |
| CN109660574A (en) * | 2017-10-10 | 2019-04-19 | 阿里巴巴集团控股有限公司 | Data offering method and device |
| CN110097471A (en) * | 2019-05-07 | 2019-08-06 | 北京字节跳动网络技术有限公司 | User information processing method, device, electronic equipment and computer storage medium |
| CN110413759A (en) * | 2019-07-31 | 2019-11-05 | 杭州凡闻科技有限公司 | A kind of multi-platform user interaction data analysis method and system for from media |
| CN110442638A (en) * | 2019-07-23 | 2019-11-12 | 万达信息股份有限公司 | A kind of the visual information generation method and system of medical data |
-
2020
- 2020-09-21 CN CN202010993671.8A patent/CN111913947A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101908165A (en) * | 2010-05-17 | 2010-12-08 | 北京中机科海科技发展有限公司 | Geographic information system (GIS)-based industrial cluster information integration service system and method |
| CN102769578A (en) * | 2011-05-04 | 2012-11-07 | 陈宇晓 | System and method for integrating microblog management systems in multiple platforms |
| CN104079538A (en) * | 2013-03-28 | 2014-10-01 | 清华大学 | Microblog aggregation method and system supporting cross-platform interaction |
| CN107248114A (en) * | 2017-06-01 | 2017-10-13 | 世纪禾光科技发展（北京）有限公司 | Electric business loan administration method and system |
| CN109660574A (en) * | 2017-10-10 | 2019-04-19 | 阿里巴巴集团控股有限公司 | Data offering method and device |
| CN107886281A (en) * | 2017-11-30 | 2018-04-06 | 百富计算机技术（深圳）有限公司 | Take out order processing method, apparatus, computer equipment and storage medium |
| CN108494799A (en) * | 2018-04-18 | 2018-09-04 | 家园网络科技有限公司 | data sharing method and system |
| CN110097471A (en) * | 2019-05-07 | 2019-08-06 | 北京字节跳动网络技术有限公司 | User information processing method, device, electronic equipment and computer storage medium |
| CN110442638A (en) * | 2019-07-23 | 2019-11-12 | 万达信息股份有限公司 | A kind of the visual information generation method and system of medical data |
| CN110413759A (en) * | 2019-07-31 | 2019-11-05 | 杭州凡闻科技有限公司 | A kind of multi-platform user interaction data analysis method and system for from media |
Non-Patent Citations (1)
| Title |
|---|
| 彭洁: "《信息资源整合技术》", 31 July 2008, 北京：科技文献出版社, pages: 124 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118656429A (en) * | 2024-08-19 | 2024-09-17 | 北京慧博科技有限公司 | Private domain public domain attribute automatic association binding method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Abhishek et al. | Achieving lean warehousing through value stream mapping | |
| CN109146533B (en) | Information pushing method and device | |
| CN107291900B (en) | Information feedback and tracking system | |
| CN108629318B (en) | Shelf display identification method, device and system based on image identification technology | |
| CN111277625A (en) | E-commerce platform order pushing method and system | |
| US20220108357A1 (en) | Retail intelligent display system and electronic displays thereof | |
| US20240153064A1 (en) | Systems and methods for processing vehicle images based on criteria | |
| US20170178149A1 (en) | Method and system for purchase pattern extraction from point of sale data | |
| US20160224934A1 (en) | System, method, and non-transitory computer-readable storage media for use in delivering items to a customer | |
| CN107704357B (en) | Log generation method and device | |
| CN111913947A (en) | Data integration system of take-out platform | |
| CN112001664B (en) | Method, device, equipment and storage medium for generating return tasks | |
| CN111210296A (en) | E-commerce platform management method and system | |
| CN107392712B (en) | Purchase, sales and inventory management system and using method thereof | |
| CN104933601A (en) | Method and device for outputting commodity information | |
| US20190073620A1 (en) | System, method and computer program product for data analysis | |
| CN112989175A (en) | Article pushing method, device, equipment and medium | |
| CN107341632A (en) | A kind of data capture method and device based on user's request | |
| CN111914202A (en) | Multi-platform intelligent automatic publishing method, device, system and terminal | |
| CN111242564A (en) | Method and device for supervising and processing purchase and sale whole process of oil product enterprises | |
| US10217080B1 (en) | Item classification using visible attributes | |
| CN109509036B (en) | Method and device for processing price information | |
| JP2022145854A5 (en) | ||
| CN111612592A (en) | Method and system for quickly finding goods | |
| CN113469791A (en) | Method and device for realizing store diversion distribution based on live broadcast activity |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |