CN106850621A - A kind of method based on container cloud fast construction Hadoop clusters - Google Patents
A kind of method based on container cloud fast construction Hadoop clusters Download PDFInfo
- Publication number
- CN106850621A CN106850621A CN201710066614.3A CN201710066614A CN106850621A CN 106850621 A CN106850621 A CN 106850621A CN 201710066614 A CN201710066614 A CN 201710066614A CN 106850621 A CN106850621 A CN 106850621A
- Authority
- CN
- China
- Prior art keywords
- cluster
- hadoop
- user
- container
- hadoop clusters
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/60—Software deployment
- G06F8/61—Installation
- G06F8/63—Image based installation; Cloning; Build to order
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of method based on container cloud fast construction Hadoop clusters, including：1. the physical server quantity selected is determined according to actual needs, integrally regards these physical servers chosen as a cluster, specify the master nodes of the cluster, and distribute actual deployment node, i.e., as slave nodes；2. for every physical server in cluster installs CentOS7 operating systems；3. yuminstall Installing of Command is used on each master node of the cluster and starts container orchestrating services Kubernetes and network service Flannel；4. MySQL database, mirror image repository service and management door are installed on the master nodes allocated in advance；5. portal interface is managed using keeper's Account Logon, sets up user；Using the user login management door set up, create the cluster environment of the user and build Hadoop clusters.
Description
Technical field
It is particularly a kind of to be based on container cloud fast construction the present invention relates to the establishment technical field of Hadoop clusters
The method of Hadoop clusters.
Background technology
At present, Hadoop clusters are normally based on virtual machine or PC to be built；In the scale of pre-set cluster
（Including host node and from number of nodes etc.）Afterwards, it is necessary to according to default scale set up specified quantity platform virtual machine or purchase refer to
Fixed number amount platform PC；Establish after these servers, it is necessary to by platform installation operation system, and install and build Hadoop clusters and must
The service such as JDK for wanting, specifies good every host name of server, and the SSH between the good every two-server of configuration exempts from close certification；Most
Afterwards, it is necessary to dispose Hadoop in host node, modification is distributed to remaining every server in cluster with postponing；Complete these steps
After rapid, the startup script startup cluster of Hadoop can be just used.
A kind of offer Hadoop services based on OpenStack of Jiangsu Internet of Things Research ＆ Develoment Co., Ltd.'s invention disclosed patent
Method（CN104065716A）In, Hadoop clusters are built using framework as shown below；The system is built be based on first
The cloud platform of OpenStack, and a system control node is set up in addition, it is pre- in selection cloud platform when user needs service
The computing environment of dress and specific configuration, send a request to system control node, using cloud platform Intel Virtualization Technology, set up virtual
The system image of Hadoop has been installed in main frame, startup, is sent by system control node and ordered, and upload configuration file starts
Hadoop is serviced, and by cloud platform internal network interaction message, completes the startup of Hadoop platform.
However, because manufacturer is numerous, release version is numerous, OpenStack has various technical difficult points；First,
OpenStack is also much not enough in integration, autgmentability and stability；Nova, Swift, Cinder and Neutron make respectively
With respective database purchase configuration information, installation and upgrade is wasted time and energy；
Secondly, OpenStack lacks integrality；OpenStack can only provide calculating, storage, three kinds of cloud products of network, if base
In OpenStack it is self-service build Hadoop clusters, it is necessary to get through between OpenStack and Hadoop account, safety, management fortune
Peacekeeping monitoring system, flow is complicated and cumbersome；
Furthermore, OpenStack can not provide service guarantee end to end；User takes " framework " and the group be simply scattered of hand
Build, it is necessary to by hand integrate multi-vendor, multi version function；
Finally, OpenStack lacks general basic version；Downloadable manufacturer's customization version has more than 20 to OpenStack at present,
Client does not know select for which version, less be clear how to carry out group between different editions according to the demand of oneself
Conjunction, mashed up and migration；The above defect result in disclosed this patent of invention of Jiangsu Internet of Things Research ＆ Develoment Co., Ltd.
System is installed and implements time-consuming more long, and it is also higher that lotus root closes property, and the stability of a system cannot also ensure, it is necessary to exclusively carry out system maintenance, or
OpenStack codes are optimized.
Hadoop clusters are built using multiple pc or physical server, cost is of a relatively high, and resource utilization is relatively low；Make
Whole virtualization hardware layer can be provided with virtual machine, but use cost can also be obviously improved, and resource utilization is not equally high；This
Outward, after building Hadoop clusters using PC or virtual machine, if destroying cluster environment when using, it is difficult to pinpoint the problems immediately；Hair
, it is necessary to the environment of destroyed separate unit or multiple servers or virtual machine is rebuild after existing environment is destroyed, treatment and
When property cannot be guaranteed.
The content of the invention
The technical problems to be solved by the invention are the shortcomings for overcoming prior art, there is provided one kind is based on container cloud
The method of fast construction Hadoop clusters.
In order to solve the above technical problems, the present invention provides a kind of based on container cloud fast construction Hadoop clusters
Method, comprises the following specific steps that：
The physical server quantity selected is determined according to actual needs, integrally regards these physical servers chosen as one
Individual cluster, specifies the master nodes of the cluster, and distributes actual deployment node, i.e., as slave nodes；
For every physical server in cluster installs CentOS7 operating systems；
Yum install Installing of Command is used on each master node of the cluster and starts container orchestrating services
Kubernetes and network service Flannel；
MySQL database, mirror image repository service and management door are installed on the master nodes allocated in advance；
Portal interface is managed using keeper's Account Logon, user is set up；Using the user login management door set up, create
The cluster environment of the user simultaneously builds Hadoop clusters.
Technique effect：Compared to building Hadoop clusters based on virtual machine techniques such as OpenStack or VMWare, the present invention
Each container instance in step 3 directly services the cluster environment for carrying out layout user establishment using Kubernetes, it is ensured that clothes
While the stability of business, using the light weight feature of container so that setting up the speed of these cluster servers has very big lifting,
And the system resource shared by every server has also been reduced relative to virtual machine technique, therefore can build more
Hadoop clusters.
Additionally, the present invention has carried out integrated various large data sets group rings including including Hadoop clusters in mirror image warehouse
The fast construction script in border, therefore can in step 6 realize that a key builds Hadoop clusters, optimize Consumer's Experience；
Kubernetes officials provide a series of atomicity api interface, in actually calling, generally require in a certain order
Multiple interfaces are performed successively to complete container instance establishment, container instance destruction etc. in interior operation.
For the practical business demand such as Hadoop cluster environment is built in the present invention, these of Kubernetes are encapsulated
API, there is provided one group of method of process container, that is, it is integrated in the k8Sclient interfaces in management door：
Bottom replaces virtual machine or physical server to provide a user with Hadoop cluster services using Docker container instances
Device environment, carries out network communication, and provide the Docker API of standard between them using flannel；
Kubernetes is by calling the acquisition mirror image interface of Docker API and mirror image warehouse come layout and manipulating bottom appearance
Device, and there is provided one group of REST interface Kubernetes API；
MySQL provides two data manipulation interfaces of cluster management and user management；
Management door calls Kubernetes API to create Hadoop cluster environment by the k8Sclient being internally integrated,
And the cluster environment for calling the cluster management and user management interface of MySQL to record and show each user.
This patent replaces virtual machine or physical server as a result of Docker containers so that every for user
Server overhead in cluster is smaller, creates speed faster, additionally it is possible to build more Hadoop cluster environment；Each
The actually only operation Hadoop services of Docker container instances, each container instance only runs single service in meeting container technique
Specification；And due to the isolation of container, unique user cluster re-creates the cluster for not interfering with other users；Using paddy
Sing the ripe container orchestrating services Kubernetes of release to safeguard the Docker container instances of bottom, it is ensured that whole service
Stability, and trouble node can be had soon found that, quickly realize fault recovery.
The technical scheme that further limits of the invention is：
Further, the foregoing method based on container cloud fast construction Hadoop clusters, stepIn build Hadoop
Cluster is concretely comprised the following steps：
User login management door, clicks on interface and creates Hadoop cluster environment, and management door is sent out to Kubernetes
Establishment cluster server is sent to ask, Kubernetes obtains designated mirror and calls Docker API to create cluster from mirror image warehouse
Container instance, and return to user by managing door by result is created；
User clicks on a key and builds Hadoop clusters, the cluster that management door is directly created to the user in management portal interface
Container instance sends the request for building Hadoop clusters, after cluster container instance receives request, performs built-in building
Hadoop cluster scripts, be automatically performed SSH exempt from close certification, set master and slave nodes, synchronization Hadoop cluster configurations,
Start the actions such as Hadoop services, and result will be built and return to user by managing door.
The foregoing method based on container cloud fast construction Hadoop clusters, management door be based on
The website of ApacheTomcat, has been internally integrated k8Sclient interfaces.
The major function that the k8Sclient interfaces of management portal integration are provided in the present invention is as follows：
Create Namespace（NameSpace）；
Delete Namespace；
Obtain and specify Namespace；
Obtain whole Namespace；
Obtain and specify Node（Node）；
Obtain all Node；
Create Pod（Container group）；
Delete Pod；
Obtain and specify Pod；
Obtain whole Pod；
Obtain the daily record for specifying Pod；
Update Pod information；
Create RC（Copy controller）；
Delete RC；
Obtain and specify RC；
Obtain whole RC；
Update RC information；
Create Service（Service）；
Delete Service；
Obtain and specify Service；
Obtain whole Service；
Update Service information.
Added in mirror image warehouse in the present invention with the large data sets such as fast construction Hadoop faciation close 6 it is self-defined
Mirror image, they complete fire wall is adjusted, clock is synchronous etc. on its basis using the foundation image based on CentOS7
Configurations, are mounted with the JDK softwares related to the various big datas such as Hadoop and service, have also imported the key voluntarily write
The scripts such as deployment script, for users to use, to comprise the following steps that：1. CentOS7 mirror images are based on, ssh etc. are installed required soft
Part and service, JAVA environment is installed and configured, imports Hadoop2.7.1 versions installation kit and simultaneously Hadoop environmental variances are set；
2. Hadoop experimental correlation datas are imported；
3. the key for importing the Hadoop clusters for writing builds script；
4. the API_Server for writing is imported, and is set with master node automatics；
5. Hadoop cluster mirror images are generated.
It is related without finding the big datas such as Hadoop again after user creates the big data cluster specified using our mirror image
Software kit, without carrying out fire wall setting again, the complicated cumbersome preposition property environment configurations such as clock is synchronous, JDK is installed, can
With fast construction Hadoop clusters, the application of big data is absorbed in.
The beneficial effects of the invention are as follows：
The method based on container cloud fast construction Hadoop clusters designed by the present invention can be directed to different users and need
The service plan for providing and customizing is provided；Compared to traditional virtual machine and OpenStack Intel Virtualization Technologies, the method has to be installed
The advantage such as more than deployment simplicity, the number of clusters of resource utilization high, service invariant and offer, it is adaptable to advised by physical server
The medium-sized and small enterprises or the scientific research institutions that are desired with big data scientific research and computing of mould limitation, can substantially reduce them and build and portion
The hardware cost of big data cluster is affixed one's name to, and allows user that related point of big data is conveniently carried out using frameworks such as Hadoop
Analysis is calculated；Additionally, each school can also build tens or up to a hundred using the method on limited several physical servers
Individual cluster environment, to carry out the teaching and experiment of big data related discipline, fills up the talent shortage of big data industry.
Brief description of the drawings
Fig. 1 is by the configuration diagram of Hadoop clusters built in patent CN104065716A；
Fig. 2 is the component drawings of the designed method based on container cloud fast construction Hadoop clusters in the present invention；
Fig. 3 is the timing diagram of the Hadoop clusters built in the present invention.
Specific embodiment
As Figure 2-3, a kind of method based on container cloud fast construction Hadoop clusters that the present embodiment is provided,
Comprise the following specific steps that：
The physical server quantity selected is determined according to actual needs, integrally regards these physical servers chosen as one
Individual cluster, specifies the master nodes of the cluster, and distributes actual deployment node, i.e., as slave nodes；
For every physical server in cluster installs CentOS7 operating systems；
Yuminstall Installing of Command is used on each master node of the cluster and starts container orchestrating services
Kubernetes and network service Flannel；
MySQL database, mirror image repository service and management door are installed on the master nodes allocated in advance；
Portal interface is managed using keeper's Account Logon, user is set up；Using the user login management door set up, create
The cluster environment of the user simultaneously builds Hadoop clusters；Management door is the website based on ApacheTomcat, is internally integrated
K8Sclient interfaces.
StepIn build concretely comprising the following steps for Hadoop clusters：
User login management door, clicks on interface and creates Hadoop cluster environment, and management door is sent out to Kubernetes
Establishment cluster server is sent to ask, Kubernetes obtains designated mirror and calls Docker API to create cluster from mirror image warehouse
Container instance, and return to user by managing door by result is created；
User clicks on a key and builds Hadoop clusters, the cluster that management door is directly created to the user in management portal interface
Container instance sends the request for building Hadoop clusters, after cluster container instance receives request, performs built-in building
Hadoop cluster scripts, be automatically performed SSH exempt from close certification, set master and slave nodes, synchronization Hadoop cluster configurations,
Start the actions such as Hadoop services, and result will be built and return to user by managing door.
Compared to Hadoop clusters are built based on virtual machine techniques such as OpenStack or VMWare, the present invention is straight in step 3
Connect each container instance come in the cluster environment that layout user creates using Kubernetes services, it is ensured that the stability of service
While, using the light weight feature of container so that setting up the speed of these cluster servers has very big lifting, and every clothes
System resource shared by business device has also been reduced relative to virtual machine technique, therefore can build more Hadoop collection
Group.
Additionally, the present invention has carried out integrated various large data sets group rings including including Hadoop clusters in mirror image warehouse
The fast construction script in border, therefore can in step 6 realize that a key builds Hadoop clusters, optimize Consumer's Experience；
Kubernetes officials provide a series of atomicity api interface, in actually calling, generally require in a certain order
Multiple interfaces are performed successively to complete container instance establishment, container instance destruction etc. in interior operation.
For the practical business demand such as Hadoop cluster environment is built in the present invention, these of Kubernetes are encapsulated
API, there is provided one group of method of process container, that is, it is integrated in the k8Sclient interfaces in management door：
Bottom replaces virtual machine or physical server to provide a user with Hadoop cluster services using Docker container instances
Device environment, carries out network communication, and provide the Docker API of standard between them using flannel；
Kubernetes is by calling the acquisition mirror image interface of Docker API and mirror image warehouse come layout and manipulating bottom appearance
Device, and there is provided one group of REST interface Kubernetes API；
MySQL provides two data manipulation interfaces of cluster management and user management；
Management door calls Kubernetes API to create Hadoop cluster environment by the k8Sclient being internally integrated,
And the cluster environment for calling the cluster management and user management interface of MySQL to record and show each user.
This patent replaces virtual machine or physical server as a result of Docker containers so that every for user
Server overhead in cluster is smaller, creates speed faster, additionally it is possible to build more Hadoop cluster environment；Each
The actually only operation Hadoop services of Docker container instances, each container instance only runs single service in meeting container technique
Specification；And due to the isolation of container, unique user cluster re-creates the cluster for not interfering with other users；Using paddy
Sing the ripe container orchestrating services Kubernetes of release to safeguard the Docker container instances of bottom, it is ensured that whole service
Stability, and trouble node can be had soon found that, quickly realize fault recovery.
The major function that the k8Sclient interfaces of management portal integration are provided in the present invention is as follows：
Create Namespace（NameSpace）；
Delete Namespace；
Obtain and specify Namespace；
Obtain whole Namespace；
Obtain and specify Node（Node）；
Obtain all Node；
Create Pod（Container group）；
Delete Pod；
Obtain and specify Pod；
Obtain whole Pod；
Obtain the daily record for specifying Pod；
Update Pod information；
Create RC（Copy controller）；
Delete RC；
Obtain and specify RC；
Obtain whole RC；
Update RC information；
Create Service（Service）；
Delete Service；
Obtain and specify Service；
Obtain whole Service；
Update Service information.
Added in mirror image warehouse in the present invention with the large data sets such as fast construction Hadoop faciation close 6 it is self-defined
Mirror image, they complete fire wall is adjusted, clock is synchronous etc. on its basis using the foundation image based on CentOS7
Configurations, are mounted with the JDK softwares related to the various big datas such as Hadoop and service, have also imported the key voluntarily write
The scripts such as deployment script, for users to use, to comprise the following steps that：
1. CentOS7 mirror images are based on, required software and the services such as ssh is installed, JAVA environment is installed and configured, imported
Hadoop2.7.1 versions installation kit simultaneously sets Hadoop environmental variances；
2. Hadoop experimental correlation datas are imported；
3. the key for importing the Hadoop clusters for writing builds script；
4. the API_Server for writing is imported, and is set with master node automatics；
5. Hadoop cluster mirror images are generated.
It is related without finding the big datas such as Hadoop again after user creates the big data cluster specified using our mirror image
Software kit, without carrying out fire wall setting again, the complicated cumbersome preposition property environment configurations such as clock is synchronous, JDK is installed, can
With fast construction Hadoop clusters, the application of big data is absorbed in.The present embodiment in actual applications, with 9 physical servers
As a example by, it is from 192.168.10.101 to 192.168.10.109 to set ip addresses；
1. the main frame for setting every main frame is entitled from node-101 to node-109, and uses ssh-keygen and ssh-copy-
Id orders are configuration SSH key authentication modes between every two-server, and close login is exempted between realization；
2. it is the host node of Kubernetes to specify node-101, and Kubernetes, Flannel and mirror are installed on that server
As repository service；
3. it is management portal node to specify node-109, and Flannel, MySQL and management door are installed on that server
Tomcat is serviced；
4. remaining 7 server is Kubernetes from node, and Kubernetes and Flannel is installed on these servers
Service；
5. the configuration that Flannel and Kubernetes is serviced on Servers-all is completed using a key deployment script to adjust and start
These services；
6. management door is logged in using default admin's account, create user；
7., using the user login management door for creating, test whether that can create Hadoop cluster environment and a key builds
Hadoop clusters.
Above example is only explanation technological thought of the invention, it is impossible to limit protection scope of the present invention with this, every
According to technological thought proposed by the present invention, any change done on the basis of technical scheme each falls within the scope of the present invention
Within.
Claims (3)
1. a kind of method based on container cloud fast construction Hadoop clusters, it is characterised in that comprise the following specific steps that：
The physical server quantity selected is determined according to actual needs, integrally regards these physical servers chosen as one
Individual cluster, specifies the master nodes of the cluster, and distributes actual deployment node, i.e., as slave nodes；
For every physical server in cluster installs CentOS7 operating systems；
Yum install Installing of Command is used on each master node of the cluster and starts container orchestrating services
Kubernetes and network service Flannel；
MySQL database, mirror image repository service and management door are installed on the master nodes allocated in advance；
Portal interface is managed using keeper's Account Logon, user is set up；Using the user login management door set up, create
The cluster environment of the user simultaneously builds Hadoop clusters.
2. the method based on container cloud fast construction Hadoop clusters according to claim 1, it is characterised in that institute
State stepIn build concretely comprising the following steps for Hadoop clusters：
User login management door, clicks on interface and creates Hadoop cluster environment, and management door sends to Kubernetes
Cluster server request is created, Kubernetes obtains designated mirror and call Docker API to create cluster and holds from mirror image warehouse
Device example, and return to user by managing door by result is created；
User clicks on a key and builds Hadoop clusters, the cluster that management door is directly created to the user in management portal interface
Container instance sends the request for building Hadoop clusters, after cluster container instance receives request, performs built-in building
Hadoop cluster scripts, be automatically performed SSH exempt from close certification, set master and slave nodes, synchronization Hadoop cluster configurations,
Start the actions such as Hadoop services, and result will be built and return to user by managing door.
3. the method based on container cloud fast construction Hadoop clusters according to claim 1, it is characterised in that institute
It is the website based on ApacheTomcat to state management door, has been internally integrated k8Sclient interfaces.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710066614.3A CN106850621A (en) | 2017-02-07 | 2017-02-07 | A kind of method based on container cloud fast construction Hadoop clusters |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710066614.3A CN106850621A (en) | 2017-02-07 | 2017-02-07 | A kind of method based on container cloud fast construction Hadoop clusters |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106850621A true CN106850621A (en) | 2017-06-13 |
Family
ID=59121437
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710066614.3A Pending CN106850621A (en) | 2017-02-07 | 2017-02-07 | A kind of method based on container cloud fast construction Hadoop clusters |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106850621A (en) |
Cited By (43)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107450961A (en) * | 2017-09-22 | 2017-12-08 | 济南浚达信息技术有限公司 | A kind of distributed deep learning system and its building method, method of work based on Docker containers |
| CN107733977A (en) * | 2017-08-31 | 2018-02-23 | 北京百度网讯科技有限公司 | A kind of cluster management method and device based on Docker |
| CN108037977A (en) * | 2017-12-08 | 2018-05-15 | 上海市信息网络有限公司 | Management method, equipment, computer media and the system of virtual machine resource |
| CN108052333A (en) * | 2017-12-11 | 2018-05-18 | 北京紫优能源科技有限公司 | A kind of power scheduling centralized control system standardization Automation arranging method and framework |
| CN108062225A (en) * | 2017-11-27 | 2018-05-22 | 国云科技股份有限公司 | A kind of method of multi-template combination issue application cluster |
| CN108108223A (en) * | 2017-11-30 | 2018-06-01 | 国网浙江省电力公司信息通信分公司 | Container Management platform based on Kubernetes |
| CN108173919A (en) * | 2017-12-22 | 2018-06-15 | 百度在线网络技术（北京）有限公司 | Big data platform builds system, method, equipment and computer-readable medium |
| CN108255968A (en) * | 2017-12-26 | 2018-07-06 | 曙光信息产业(北京)有限公司 | A kind of design method of big data parallel file system |
| CN108549717A (en) * | 2018-04-23 | 2018-09-18 | 泰华智慧产业集团股份有限公司 | The method and system of automatically dispose O＆M Hadoop ecology coil assemblies |
| CN108900651A (en) * | 2018-06-22 | 2018-11-27 | 杭州才云科技有限公司 | Kubernetes and Neutron interconnection method, storage medium, equipment based on multi-tenant environment |
| CN108924217A (en) * | 2018-06-29 | 2018-11-30 | 中山大学 | A kind of distribution cloud system Automation arranging method |
| CN108989091A (en) * | 2018-06-22 | 2018-12-11 | 杭州才云科技有限公司 | Based on the tenant network partition method of Kubernetes network, storage medium, electronic equipment |
| CN109033334A (en) * | 2018-07-20 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer storage medium creating database |
| CN109101342A (en) * | 2018-07-20 | 2018-12-28 | 北京百度网讯科技有限公司 | Distributed job control method for coordinating, device, computer equipment and storage medium |
| CN109144661A (en) * | 2018-07-05 | 2019-01-04 | 杭州电子科技大学 | A kind of deep learning management method based on docker |
| CN109246224A (en) * | 2018-09-25 | 2019-01-18 | 麒麟合盛网络技术股份有限公司 | The containerization dispositions method and device of CDN system |
| CN109271233A (en) * | 2018-07-25 | 2019-01-25 | 上海数耕智能科技有限公司 | The implementation method of Hadoop cluster is set up based on Kubernetes |
| CN109542970A (en) * | 2018-11-27 | 2019-03-29 | 长沙智擎信息技术有限公司 | A kind of large scale scale heterogeneous data managing method based on container |
| CN109542791A (en) * | 2018-11-27 | 2019-03-29 | 长沙智擎信息技术有限公司 | A kind of program large-scale concurrent evaluating method based on container technique |
| WO2019076369A1 (en) * | 2017-10-19 | 2019-04-25 | 北京金山云网络技术有限公司 | Cloud platform deployment method, device, electronic device, and readable storage medium |
| CN109710281A (en) * | 2018-12-28 | 2019-05-03 | 中科曙光国际信息产业有限公司 | The installation method and device of big data platform |
| CN109814881A (en) * | 2017-11-21 | 2019-05-28 | 北京京东尚科信息技术有限公司 | Method and apparatus for disposing data-base cluster |
| WO2019184116A1 (en) * | 2018-03-30 | 2019-10-03 | 平安科技（深圳）有限公司 | Method and device for automatically building kubernetes main node, terminal device and computer-readable storage medium |
| WO2019184164A1 (en) * | 2018-03-30 | 2019-10-03 | 平安科技（深圳）有限公司 | Method for automatically deploying kubernetes worker node, device, terminal apparatus, and readable storage medium |
| CN110333889A (en) * | 2019-07-19 | 2019-10-15 | 浪潮云信息技术有限公司 | The upgrade method and system of container service user's cluster |
| CN110602253A (en) * | 2019-09-30 | 2019-12-20 | 新华三大数据技术有限公司 | Task scheduling method, device and system |
| CN110941474A (en) * | 2018-09-25 | 2020-03-31 | 北京京东尚科信息技术有限公司 | Method, system, equipment and storage medium for sharing computing resources by Hadoop and Kubernetes system |
| CN110941434A (en) * | 2018-09-21 | 2020-03-31 | 中国石油化工股份有限公司 | Seismic processing software deployment method based on container technology |
| WO2020062131A1 (en) * | 2018-09-29 | 2020-04-02 | 北京连云决科技有限公司 | Container cloud management system based on blockchain technology |
| CN111049876A (en) * | 2019-10-18 | 2020-04-21 | 烽火通信科技股份有限公司 | Lightweight telecom cloud edge computing system architecture |
| CN111061503A (en) * | 2018-10-16 | 2020-04-24 | 航天信息股份有限公司 | Cluster system configuration method and cluster system |
| CN111131480A (en) * | 2019-12-30 | 2020-05-08 | 南京德赛尔信息技术有限公司 | Cloud edge cooperative service system for smart power plant |
| CN111274003A (en) * | 2020-03-04 | 2020-06-12 | 山东超越数控电子股份有限公司 | Cluster building method for Docker |
| CN111324371A (en) * | 2020-04-17 | 2020-06-23 | 北京简单一点科技有限公司 | Method for supporting custom environment and task by production line SAAS service plug-in |
| CN111338647A (en) * | 2018-12-18 | 2020-06-26 | 杭州海康威视数字技术股份有限公司 | Big data cluster management method and device |
| CN111371606A (en) * | 2020-02-26 | 2020-07-03 | 山东汇贸电子口岸有限公司 | Method for specifying monitor ip when using look to deploy ceph cluster |
| CN111427949A (en) * | 2019-01-09 | 2020-07-17 | 杭州海康威视数字技术股份有限公司 | Method and device for creating big data service |
| CN111585786A (en) * | 2020-03-30 | 2020-08-25 | 青岛青软实训教育科技股份有限公司 | Realization of secret-free building method of big data cluster |
| CN111897623A (en) * | 2020-06-11 | 2020-11-06 | 新浪网技术(中国)有限公司 | Cluster management method, device, equipment and storage medium |
| CN112698925A (en) * | 2021-03-24 | 2021-04-23 | 江苏红网技术股份有限公司 | Container mixed operation processing method of server cluster |
| CN112882726A (en) * | 2021-01-26 | 2021-06-01 | 西安建筑科技大学 | Hadoop and Docker-based deployment method of environment system |
| US11169856B2 (en) | 2019-01-31 | 2021-11-09 | Hewlett Packard Enterprise Development Lp | Container management |
| CN114553874A (en) * | 2022-02-28 | 2022-05-27 | 北京理工大学 | Hybrid simulation cloud platform and automatic deployment method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105045656A (en) * | 2015-06-30 | 2015-11-11 | 深圳清华大学研究院 | Virtual container based big data storage and management method |
| US20160142868A1 (en) * | 2014-09-03 | 2016-05-19 | CloudLeaf, Inc. | Systems, methods and devices for asset status determination |
| CN106027643A (en) * | 2016-05-18 | 2016-10-12 | 无锡华云数据技术服务有限公司 | Resource scheduling method based on Kubernetes container cluster management system |
-
2017
- 2017-02-07 CN CN201710066614.3A patent/CN106850621A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160142868A1 (en) * | 2014-09-03 | 2016-05-19 | CloudLeaf, Inc. | Systems, methods and devices for asset status determination |
| CN105045656A (en) * | 2015-06-30 | 2015-11-11 | 深圳清华大学研究院 | Virtual container based big data storage and management method |
| CN106027643A (en) * | 2016-05-18 | 2016-10-12 | 无锡华云数据技术服务有限公司 | Resource scheduling method based on Kubernetes container cluster management system |
Non-Patent Citations (1)
| Title |
|---|
| COOLHZZ3: "《基于kubernetes构建Docker集群管理详解》", 《百度文库》 * |
Cited By (61)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107733977A (en) * | 2017-08-31 | 2018-02-23 | 北京百度网讯科技有限公司 | A kind of cluster management method and device based on Docker |
| CN107733977B (en) * | 2017-08-31 | 2020-11-03 | 北京百度网讯科技有限公司 | Cluster management method and device based on Docker |
| CN107450961A (en) * | 2017-09-22 | 2017-12-08 | 济南浚达信息技术有限公司 | A kind of distributed deep learning system and its building method, method of work based on Docker containers |
| WO2019076369A1 (en) * | 2017-10-19 | 2019-04-25 | 北京金山云网络技术有限公司 | Cloud platform deployment method, device, electronic device, and readable storage medium |
| CN109814881A (en) * | 2017-11-21 | 2019-05-28 | 北京京东尚科信息技术有限公司 | Method and apparatus for disposing data-base cluster |
| CN108062225A (en) * | 2017-11-27 | 2018-05-22 | 国云科技股份有限公司 | A kind of method of multi-template combination issue application cluster |
| CN108062225B (en) * | 2017-11-27 | 2021-08-27 | 国云科技股份有限公司 | Method for issuing application cluster by multi-template combination |
| CN108108223B (en) * | 2017-11-30 | 2022-05-24 | 国网浙江省电力公司信息通信分公司 | Kubernetes-based container management platform |
| CN108108223A (en) * | 2017-11-30 | 2018-06-01 | 国网浙江省电力公司信息通信分公司 | Container Management platform based on Kubernetes |
| CN108037977A (en) * | 2017-12-08 | 2018-05-15 | 上海市信息网络有限公司 | Management method, equipment, computer media and the system of virtual machine resource |
| CN108037977B (en) * | 2017-12-08 | 2021-10-29 | 上海市信息网络有限公司 | Virtual computer resource management method, device, computer medium, and system |
| CN108052333A (en) * | 2017-12-11 | 2018-05-18 | 北京紫优能源科技有限公司 | A kind of power scheduling centralized control system standardization Automation arranging method and framework |
| CN108173919A (en) * | 2017-12-22 | 2018-06-15 | 百度在线网络技术（北京）有限公司 | Big data platform builds system, method, equipment and computer-readable medium |
| CN108255968A (en) * | 2017-12-26 | 2018-07-06 | 曙光信息产业(北京)有限公司 | A kind of design method of big data parallel file system |
| WO2019184116A1 (en) * | 2018-03-30 | 2019-10-03 | 平安科技（深圳）有限公司 | Method and device for automatically building kubernetes main node, terminal device and computer-readable storage medium |
| WO2019184164A1 (en) * | 2018-03-30 | 2019-10-03 | 平安科技（深圳）有限公司 | Method for automatically deploying kubernetes worker node, device, terminal apparatus, and readable storage medium |
| CN108549717A (en) * | 2018-04-23 | 2018-09-18 | 泰华智慧产业集团股份有限公司 | The method and system of automatically dispose O＆M Hadoop ecology coil assemblies |
| CN108989091B (en) * | 2018-06-22 | 2022-02-11 | 杭州才云科技有限公司 | Tenant network isolation method based on Kubernetes network, storage medium and electronic equipment |
| CN108900651B (en) * | 2018-06-22 | 2022-03-04 | 杭州才云科技有限公司 | Kubernetes and Neutron docking method based on multi-tenant environment, storage medium and equipment |
| CN108989091A (en) * | 2018-06-22 | 2018-12-11 | 杭州才云科技有限公司 | Based on the tenant network partition method of Kubernetes network, storage medium, electronic equipment |
| CN108900651A (en) * | 2018-06-22 | 2018-11-27 | 杭州才云科技有限公司 | Kubernetes and Neutron interconnection method, storage medium, equipment based on multi-tenant environment |
| CN108924217A (en) * | 2018-06-29 | 2018-11-30 | 中山大学 | A kind of distribution cloud system Automation arranging method |
| CN109144661A (en) * | 2018-07-05 | 2019-01-04 | 杭州电子科技大学 | A kind of deep learning management method based on docker |
| CN109101342B (en) * | 2018-07-20 | 2020-07-10 | 北京百度网讯科技有限公司 | Distributed job coordination control method and device, computer equipment and storage medium |
| CN109101342A (en) * | 2018-07-20 | 2018-12-28 | 北京百度网讯科技有限公司 | Distributed job control method for coordinating, device, computer equipment and storage medium |
| CN109033334A (en) * | 2018-07-20 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of method, apparatus and computer storage medium creating database |
| CN109271233A (en) * | 2018-07-25 | 2019-01-25 | 上海数耕智能科技有限公司 | The implementation method of Hadoop cluster is set up based on Kubernetes |
| CN110941434A (en) * | 2018-09-21 | 2020-03-31 | 中国石油化工股份有限公司 | Seismic processing software deployment method based on container technology |
| CN109246224A (en) * | 2018-09-25 | 2019-01-18 | 麒麟合盛网络技术股份有限公司 | The containerization dispositions method and device of CDN system |
| CN110941474A (en) * | 2018-09-25 | 2020-03-31 | 北京京东尚科信息技术有限公司 | Method, system, equipment and storage medium for sharing computing resources by Hadoop and Kubernetes system |
| WO2020062131A1 (en) * | 2018-09-29 | 2020-04-02 | 北京连云决科技有限公司 | Container cloud management system based on blockchain technology |
| CN113169952B (en) * | 2018-09-29 | 2022-12-02 | 北京连云决科技有限公司 | Container cloud management system based on block chain technology |
| CN113169952A (en) * | 2018-09-29 | 2021-07-23 | 北京连云决科技有限公司 | Container cloud management system based on block chain technology |
| CN111061503A (en) * | 2018-10-16 | 2020-04-24 | 航天信息股份有限公司 | Cluster system configuration method and cluster system |
| CN111061503B (en) * | 2018-10-16 | 2023-08-18 | 航天信息股份有限公司 | Cluster system configuration method and cluster system |
| CN109542970A (en) * | 2018-11-27 | 2019-03-29 | 长沙智擎信息技术有限公司 | A kind of large scale scale heterogeneous data managing method based on container |
| CN109542791A (en) * | 2018-11-27 | 2019-03-29 | 长沙智擎信息技术有限公司 | A kind of program large-scale concurrent evaluating method based on container technique |
| CN111338647A (en) * | 2018-12-18 | 2020-06-26 | 杭州海康威视数字技术股份有限公司 | Big data cluster management method and device |
| CN111338647B (en) * | 2018-12-18 | 2023-09-12 | 杭州海康威视数字技术股份有限公司 | Big data cluster management method and device |
| CN109710281A (en) * | 2018-12-28 | 2019-05-03 | 中科曙光国际信息产业有限公司 | The installation method and device of big data platform |
| CN111427949A (en) * | 2019-01-09 | 2020-07-17 | 杭州海康威视数字技术股份有限公司 | Method and device for creating big data service |
| CN111427949B (en) * | 2019-01-09 | 2023-10-20 | 杭州海康威视数字技术股份有限公司 | Method and device for creating big data service |
| US11169856B2 (en) | 2019-01-31 | 2021-11-09 | Hewlett Packard Enterprise Development Lp | Container management |
| CN110333889A (en) * | 2019-07-19 | 2019-10-15 | 浪潮云信息技术有限公司 | The upgrade method and system of container service user's cluster |
| CN110602253A (en) * | 2019-09-30 | 2019-12-20 | 新华三大数据技术有限公司 | Task scheduling method, device and system |
| CN110602253B (en) * | 2019-09-30 | 2022-04-26 | 新华三大数据技术有限公司 | Task scheduling method, device and system |
| CN111049876A (en) * | 2019-10-18 | 2020-04-21 | 烽火通信科技股份有限公司 | Lightweight telecom cloud edge computing system architecture |
| CN111131480A (en) * | 2019-12-30 | 2020-05-08 | 南京德赛尔信息技术有限公司 | Cloud edge cooperative service system for smart power plant |
| CN111371606A (en) * | 2020-02-26 | 2020-07-03 | 山东汇贸电子口岸有限公司 | Method for specifying monitor ip when using look to deploy ceph cluster |
| CN111274003A (en) * | 2020-03-04 | 2020-06-12 | 山东超越数控电子股份有限公司 | Cluster building method for Docker |
| CN111585786A (en) * | 2020-03-30 | 2020-08-25 | 青岛青软实训教育科技股份有限公司 | Realization of secret-free building method of big data cluster |
| CN111324371A (en) * | 2020-04-17 | 2020-06-23 | 北京简单一点科技有限公司 | Method for supporting custom environment and task by production line SAAS service plug-in |
| CN111324371B (en) * | 2020-04-17 | 2023-12-19 | 北京简单一点科技有限公司 | Method for pipeline SAAS service plug-in to support user-defined environment and task |
| CN111897623A (en) * | 2020-06-11 | 2020-11-06 | 新浪网技术(中国)有限公司 | Cluster management method, device, equipment and storage medium |
| CN111897623B (en) * | 2020-06-11 | 2024-04-19 | 新浪技术（中国）有限公司 | Cluster management method, device, equipment and storage medium |
| CN112882726A (en) * | 2021-01-26 | 2021-06-01 | 西安建筑科技大学 | Hadoop and Docker-based deployment method of environment system |
| CN112882726B (en) * | 2021-01-26 | 2022-11-15 | 西安建筑科技大学 | Hadoop and Docker-based deployment method of environment system |
| CN112698925B (en) * | 2021-03-24 | 2021-06-08 | 江苏红网技术股份有限公司 | Container mixed operation processing method of server cluster |
| CN112698925A (en) * | 2021-03-24 | 2021-04-23 | 江苏红网技术股份有限公司 | Container mixed operation processing method of server cluster |
| CN114553874A (en) * | 2022-02-28 | 2022-05-27 | 北京理工大学 | Hybrid simulation cloud platform and automatic deployment method |
| CN114553874B (en) * | 2022-02-28 | 2023-04-18 | 北京理工大学 | Hybrid simulation cloud platform and automatic deployment method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106850621A (en) | A kind of method based on container cloud fast construction Hadoop clusters | |
| US10827008B2 (en) | Integrated user interface for consuming services across different distributed networks | |
| CN112560244B (en) | Virtual simulation experiment system and method based on Docker | |
| Avetisyan et al. | Open cirrus: A global cloud computing testbed | |
| Kovari et al. | KVM & OpenVZ virtualization based IaaS open source cloud virtualization platforms: OpenNode, Proxmox VE | |
| Saraswat et al. | Cloud computing: Analysis of top 5 CSPs in SaaS, PaaS and IaaS platforms | |
| EP2299360A1 (en) | process for installing a software application and platform operating system | |
| CN107580083A (en) | A kind of method and system of container IP address distribution | |
| CN108829409A (en) | A kind of distributed system quick deployment method and system | |
| CN103699430A (en) | Working method of remote KVM (Kernel-based Virtual Machine) management system based on J2EE (Java 2 Platform Enterprise Edition) framework | |
| CN102088367A (en) | Method for quickly deploying in virtualization environment | |
| CN102882947A (en) | Automation desktop service supply | |
| CN102291445A (en) | Cloud computing management system based on virtual resources | |
| CN107332899A (en) | One kind virtualization cloud computing desktop | |
| CN107733704A (en) | A kind of system and method for the exploration and development cloud based on virtualization and container technique | |
| El-Omari | Cloud IoT as a crucial enabler: a survey and taxonomy | |
| Naranjo et al. | A serverless gateway for event‐driven machine learning inference in multiple clouds | |
| CN114579250B (en) | Method, device and storage medium for constructing virtual cluster | |
| CN113626798A (en) | Application system management platform, method, equipment and medium | |
| Mocevicius | CoreOS Essentials | |
| Katz et al. | Survey and analysis of production distributed computing infrastructures | |
| CN108595169B (en) | Visual programming method, cloud server and storage medium | |
| CN105577807A (en) | Cloud computing data resource scheduling WEB management platform | |
| Ghosh | Cloud computing | |
| Bardhan et al. | Operating system used in cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170613 |