8000 Debug fetch topic data for compacted topic and sort newest · Issue #4 · tchiotludo/akhq · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Debug fetch topic data for compacted topic and sort newest #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
tchiotludo opened this issue Jan 2, 2019 · 0 comments
Closed

Debug fetch topic data for compacted topic and sort newest #4

tchiotludo opened this issue Jan 2, 2019 · 0 comments
Labels
bug Something isn't working

Comments

@tchiotludo
Copy link
Owner

TBC
When we have a topic compacted, it will show empty data when the 100 first offset is compacted
When you sort by NEWEST, we can potentially miss the last record.

Maybe change the strategy with :

  • Always have a max poll attempt (do handle transaction and uncommitted case, max offset will never be reachable)
  • Control bound (first last offsets or after parameter) to stop consuming
  • Control size (break if > max size)

Special case :

  • sort newest : can have compacted data, so we need to go backward potentially
  • sort oldesst : can have first offset compacted, so page can be empty with data at next offset
@tchiotludo tchiotludo added the bug Something isn't working label Jan 18, 2019
tchiotludo added a commit that referenced this issue Feb 23, 2019
@tchiotludo
Debug fetch topic data for compacted topic and sort newest
ddfb018 
Add unit test for fetch data
Add a standalone KafkaTestCluster app to speedup unit test
Update to kafka 2.1

close #4
ghost pushed a commit that referenced this issue Jun 19, 2020
@goncaloValentim
Merge pull request #4 from polarising-oss/linter
fa79e43 
AKHQ-33 - Add ESLinter support
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tchiotludo
0