8000 【多元存储】日志存储多元化，不仅限于 MongoDB · Issue #130 · PowerJob/PowerJob · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

【多元存储】日志存储多元化，不仅限于 MongoDB #130

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
KFCFans opened this issue Dec 13, 2020 · 3 comments
Closed

【多元存储】日志存储多元化，不仅限于 MongoDB #130

KFCFans opened this issue Dec 13, 2020 · 3 comments
Assignees
@jjnnzb
Labels
contributors needed Develop the feature and contribute to the project! new feature new feature

Comments

@KFCFans
Copy link
Member
KFCFans commented Dec 13, 2020

需要完成的功能

  1. 抽象 powerjob-server 当前的文件存储层，设计独立接口进行文件的 save / delete / search 等操作
  2. 提供多种具体的实现，比如 MongoDb 和 DB 的实现
  3. 提供可配置的方式供用户选择文件的存储系统（默认 MongodDb）

思路参考

  1. 新建接口，如 DistributeFileService，定义基础操作
  2. 实现 MongoDistributeFileServiceImpl, DbDistributeFileServiceImpl 等
  3. 提供配置允许用户简单切换，可参考 com.github.kfcfans.powerjob.server.common.PowerJobServerConfigKey

注意事项

  1. 接口设计注意扩展性，后端存储实现可以有 HDFS、ElasticSearch 等，可以先不实现，但不能后续无法实现
  2. 使用 DB 作为存储时需要考虑数据库兼容性，必须满足 Spring Data JPA 规范，即可跨数据库平台

建议设计完顶层接口后在 ISSUE 中同步，顶层接口需要先单独 review
@KFCFans KFCFans added new feature new feature contributors needed Develop the feature and contribute to the project! labels Dec 13, 2020
@KFCFans
Copy link
Member Author
KFCFans commented Dec 13, 2020

ES 需求：#112

ES API 可能比较奇怪，如果无法实现可以不用考虑。

@jjnnzb
Copy link
Member
jjnnzb commented Dec 13, 2020

我研究一下这个吧

@jjnnzb jjnnzb self-assigned this Feb 20, 2021
@Jamel-jun
Copy link

使用opentelemetry协议吧，可以考虑下接入云原生方向

@KFCFans KFCFans closed this as completed Aug 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jjnnzb jjnnzb

Labels
contributors needed Develop the feature and contribute to the project! new feature new feature
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@KFCFans @Jamel-jun @jjnnzb
0