8000 metrics: add a candidate set of metrics for measuring db access times. by jmalicevic · Pull Request #79 · cometbft/cometbft · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

metrics: add a candidate set of metrics for measuring db access times. #79

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 9 commits into from

Conversation

jmalicevic
Copy link
Contributor

Original PR: tendermint/tendermint#9774.

This PR addresses #46. It provides a proposed implementation of metrics to measure the DB access times of different Tendermint components.
This is still work in progress. Do not merge!

@jmalicevic jmalicevic requested a review from a team as a code owner January 5, 2023 12:03
@jmalicevic jmalicevic self-assigned this Jan 5, 2023
@jmalicevic jmalicevic added metrics storage wip Work in progress labels Jan 5, 2023
@jmalicevic jmalicevic marked this pull request as draft January 5, 2023 12:03
@github-actions
Copy link

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot added the stale For use by stalebot label Jan 16, 2023
@sergio-mena sergio-mena removed the stale For use by stalebot label Jan 16, 2023
@jmalicevic jmalicevic added this to the 2023-Q2 milestone Mar 27, 2023
@jmalicevic jmalicevic modified the milestones: 2023-Q2, 2023-Q3 Jul 5, 2023
@jmalicevic jmalicevic added the P:storage-optimization Priority: Give operators greater control over storage and storage optimization label Jul 8, 2023
@jmalicevic
Copy link
Contributor Author

Closing as it is superceeded by #1974

@jmalicevic jmalicevic closed this Jan 5, 2024
github-merge-queue bot pushed a commit that referenced this pull request Feb 13, 2024
This PR superceeds #79 with some adjustments to the segments of code
timed as well as bucket sizes. The majority of the code was done by
William in #79. I tried to fine tune the measurements to exclude proto
marshalling/unmarshalling where I think it made sense.

Closes #46 

Blocked on benchmarking to confirm it is measuring what we want.
(follow up) The metrics gave us nice and realistic measurements in our
benchmarks.

<!--

Please add a reference to the issue that this PR addresses and indicate
which
files are most critical to review. If it fully addresses a particular
issue,
please include "Closes #XXX" (where "XXX" is the issue number).

If this PR is non-trivial/large/complex, please ensure that you have
either
created an issue that the team's had a chance to respond to, or had some
discussion with the team prior to submitting substantial pull requests.
The team
can be reached via GitHub Discussions or the Cosmos Network Discord
server in
the #cometbft channel. GitHub Discussions is preferred over Discord as
it
allows us to keep track of conversations topically.
https://github.com/cometbft/cometbft/discussions

If the work in this PR is not aligned with the team's current
priorities, please
be advised that it may take some time before it is merged - especially
if it has
not yet been discussed with the team.

See the project board for the team's current priorities:
https://github.com/orgs/cometbft/projects/1

-->

---

#### PR checklist

- [ ] Tests written/updated
- [ ] Changelog entry added in `.changelog` (we use
[unclog](https://github.com/informalsystems/unclog) to manage our
changelog)
- [ ] Updated relevant documentation (`docs/` or `spec/`) and code
comments

---------

Co-authored-by: Andy Nogueira <me@andynogueira.dev>
Co-authored-by: Anton Kaliaev <anton.kalyaev@gmail.com>
mergify bot pushed a commit that referenced this pull request Feb 22, 2024
This PR superceeds #79 with some adjustments to the segments of code
timed as well as bucket sizes. The majority of the code was done by
William in #79. I tried to fine tune the measurements to exclude proto
marshalling/unmarshalling where I think it made sense.

Closes #46

Blocked on benchmarking to confirm it is measuring what we want.
(follow up) The metrics gave us nice and realistic measurements in our
benchmarks.

<!--

Please add a reference to the issue that this PR addresses and indicate
which
files are most critical to review. If it fully addresses a particular
issue,
please include "Closes #XXX" (where "XXX" is the issue number).

If this PR is non-trivial/large/complex, please ensure that you have
either
created an issue that the team's had a chance to respond to, or had some
discussion with the team prior to submitting substantial pull requests.
The team
can be reached via GitHub Discussions or the Cosmos Network Discord
server in
the #cometbft channel. GitHub Discussions is preferred over Discord as
it
allows us to keep track of conversations topically.
https://github.com/cometbft/cometbft/discussions

If the work in this PR is not aligned with the team's current
priorities, please
be advised that it may take some time before it is merged - especially
if it has
not yet been discussed with the team.

See the project board for the team's current priorities:
https://github.com/orgs/cometbft/projects/1

-->

---

#### PR checklist

- [ ] Tests written/updated
- [ ] Changelog entry added in `.changelog` (we use
[unclog](https://github.com/informalsystems/unclog) to manage our
changelog)
- [ ] Updated relevant documentation (`docs/` or `spec/`) and code
comments

---------

Co-authored-by: Andy Nogueira <me@andynogueira.dev>
Co-authored-by: Anton Kaliaev <anton.kalyaev@gmail.com>
(cherry picked from commit dfd3f6c)

# Conflicts:
#	internal/store/store.go
cometcrafter pushed a commit to graphprotocol/cometbft that referenced this pull request Jun 1, 2024
…ft#3017)… (backport cometbft#74) (cometbft#79)

* perf: Minor speedup to consenus metrics MarkLateVote (backport cometbft#3017) (cometbft#3026)

Minor speedup to metrics MarkLateVote.

I saw the excess string allocation calls, so made a quick PR to remove
it. This saves between .18s-25s from the consensus mutex across this one
hour block sync. (Likely not at all consensus critical) It also appears
in receiving votes

![image](https://github.com/cometbft/cometbft/assets/6440154/61875b0d-b419-4900-a74c-76c65087bca4)

(Saves ToLower(), .String(), .TrimPrefix() and newObject calls. The new
call has comparable complexity to .String())

---

#### PR checklist

- [x] Tests written/updated
- [x] Changelog entry added in `.changelog` (we use
[unclog](https://github.com/informalsystems/unclog) to manage our
changelog)
- [x] Updated relevant documentation (`docs/` or `spec/`) and code
comments
- [x] Title follows the [Conventional
Commits](https://www.conventionalcommits.org/en/v1.0.0/) spec
<hr>This is an automatic backport of pull request cometbft#3017 done by
[Mergify](https://mergify.com).

---------

Co-authored-by: Dev Ojha <ValarDragon@users.noreply.github.com>
Co-authored-by: Anton Kaliaev <anton.kalyaev@gmail.com>
(cherry picked from commit 29dd011)

* Add changelog

(cherry picked from commit 6392e64)

# Conflicts:
#	CHANGELOG.md

---------

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Dev Ojha <dojha@berkeley.edu>
@zrbecker zrbecker deleted the wb/issue-9773 branch February 7, 2025 17:02
@zrbecker zrbecker restored the wb/issue-9773 branch February 8, 2025 21:04
@zrbecker zrbecker deleted the wb/issue-9773 branch February 8, 2025 21:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
metrics P:storage-optimization Priority: Give operators greater control over storage and storage optimization storage wip Work in progress
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

3 participants
0