10000 Comparing fluent:master...lyhgo:master · fluent/fluent-bit · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: fluent/fluent-bit
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: lyhgo/fluent-bit
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: master
Choose a head ref
  • 2 commits
  • 2 files changed
  • 1 contributor

Commits on Dec 15, 2024

  1. in_kafka: add parser support and improve performance 

    When processing record, the in_kafka plugin lack of
parser ability, This commit added support to
parse payload. It has been tested with kafka.

When processing record, the in_kafka plugin currently
will commit every single message poll from kafka.
which is good at normal case. But with this default
behavier, the performance is strictly limited. This
commit has add auto_commit as an option when
the performance matter more. It has been tested
with kafka. There is a sample benchmark as following.
              topic_size topic_offset time_cost
before  251 MB     506701         1m30s
after     251 MB     506701         10s

Signed-off-by: luoyy8 <luoyy8@lenovo.com>
    luoyy8 committed Dec 15, 2024
    Configuration menu
    Copy the full SHA
    0c03af9 View commit details
    Browse the repository at this point in the history

  2. in_kafka: fix typo of debug log 

    Signed-off-by: luoyy8 <luoyy8@lenovo.com>
    luoyy8 committed Dec 15, 2024
    Configuration menu
    Copy the full SHA
    e97c5e0 View commit details
    Browse the repository at this point in the history
Loading
0