8000 vs gzip & Zophli? · Issue #2 · facebook/zstd · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

vs gzip & Zophli? #2

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
tomByrer opened this issue Jan 25, 2015 · 3 comments
Closed

vs gzip & Zophli? #2

tomByrer opened this issue Jan 25, 2015 · 3 comments

Comments

@tomByrer
Copy link

I'm curious if this is compress web-compatible please?
@Cyan4973
Copy link
Contributor

Hi Tom
I'm not sure to understand your question.
Could you elaborate please ?

@hiirotsuki
Copy link

Allows web servers to dynamically compress content users are asking for, making the packets smaller :)

@Cyan4973
Copy link
Contributor

Yes, the plan is for Zstd to be useful to such application.

That being said, this particular first-day API is still a bit limited.
It will need to mature a bit to live up to this promise.

Fortunately, LZ4 experience will help a lot to reach this point.

Cyan4973 pushed a commit that referenced this issue Jun 21, 2017
@paulcruz74
Merge pull request #2 from paulcruz74/list
8202057 
List
GeorgeLu97 added a commit to GeorgeLu97/zstd that referenced this issue Jun 8, 2018
@GeorgeLu97
# This is a combination of 5 commits.
8a0e016 
# This is the 1st commit message:

Make paramgrill use bench.c benchmarking

# This is the commit message facebook#2:

Minor changes

# This is the commit message facebook#3:

Explicit casting

# This is the commit message facebook#4:

Makefile fix

# This is the commit message facebook#5:

casting, type fix
bmwiedemann added a commit to bmwiedemann/zstd that referenced this issue Oct 31, 2018
@bmwiedemann
pgo: refine facebook#2
22efdfb
Cyan4973 pushed a commit that referenced this issue Jun 5, 2019
@ephiepark
Merge pull request #2 from ephiepark/circleci
f1bf281 
CircleCI : use custom Docker Image with pre-installed dependencies
@ephiepark ephiepark mentioned this issue Jul 23, 2019
Merged
@scottchiefbaker scottchiefbaker mentioned this issue Aug 21, 2019
Closed
@senhuang42 senhuang42 mentioned this issue Nov 4, 2019
Merged
@gima gima mentioned this issue Dec 25, 2019
Closed
@Sanmayce Sanmayce mentioned this issue Jan 24, 2022
Closed
@ShenglongWang ShenglongWang mentioned this issue Jun 8, 2022
Closed
ameisen added a commit to SpriteMaster-Ext/zstd that referenced this issue Oct 2, 2022
@ameisen
Attempt facebook#2.5, but I believe I that I need a private key.
74a5f15
ameisen added a commit to SpriteMaster-Ext/zstd that referenced this issue Oct 2, 2022
@ameisen
Echo Test facebook#2.
4e5e03b
@Sanmayce Sanmayce mentioned this issue Mar 2, 2023
Closed
@sb22bs sb22bs mentioned this issue Mar 21, 2023
Closed
@zhuhan0 zhuhan0 mentioned this issue Mar 28, 2023
Merged
@zh-wen zh-wen mentioned this issue Jun 7, 2023
Closed
terrelln pushed a commit that referenced this issue Feb 28, 2025
@sergey-senozhatsky @terrelln
lib: zstd: export API needed for dictionary support
0727fc5 
Patch series "zram: introduce custom comp backends API", v7.

This series introduces support for run-time compression algorithms tuning,
so users, for instance, can adjust compression/acceleration levels and
provide pre-trained compression/decompression dictionaries which certain
algorithms support.

At this point we stop supporting (old/deprecated) comp API.  We may add
new acomp API support in the future, but before that zram needs to undergo
some major rework (we are not ready for async compression).

Some benchmarks for reference (look at column #2)

*** init zstd
/sys/block/zram0/mm_stat
1750659072 504622188 514355200        0 514355200        1        0    34204    34204

*** init zstd dict=/home/ss/zstd-dict-amd64
/sys/block/zram0/mm_stat
1750650880 465908890 475398144        0 475398144        1        0    34185    34185

*** init zstd level=8 dict=/home/ss/zstd-dict-amd64
/sys/block/zram0/mm_stat
1750654976 430803319 439873536        0 439873536        1        0    34185    34185

*** init lz4
/sys/block/zram0/mm_stat
1750646784 664266564 677060608        0 677060608        1        0    34288    34288

*** init lz4 dict=/home/ss/lz4-dict-amd64
/sys/block/zram0/mm_stat
1750650880 619990300 632102912        0 632102912        1        0    34278    34278

*** init lz4hc
/sys/block/zram0/mm_stat
1750630400 609023822 621232128        0 621232128        1        0    34288    34288

*** init lz4hc dict=/home/ss/lz4-dict-amd64
/sys/block/zram0/mm_stat
1750659072 505133172 515231744        0 515231744        1        0    34278    34278

Recompress
init zram zstd (prio=0), zstd level=5 (prio 1), zstd with dict (prio 2)

*** zstd
/sys/block/zram0/mm_stat
1750982656 504630584 514269184        0 514269184        1        0    34204    34204

*** idle recompress priority=1 (zstd level=5)
/sys/block/zram0/mm_stat
1750982656 488645601 525438976        0 514269184        1        0    34204    34204

*** idle recompress priority=2 (zstd dict)
/sys/block/zram0/mm_stat
1750982656 460869640 517914624        0 514269184        1        0    34185    34204

This patch (of 24):

We need to export a number of API functions that enable advanced zstd
usage - C/D dictionaries, dictionaries sharing between contexts, etc.

Link: https://lkml.kernel.org/r/20240902105656.1383858-1-senozhatsky@chromium.org
Link: https://lkml.kernel.org/r/20240902105656.1383858-2-senozhatsky@chromium.org
Signed-off-by: Sergey Senozhatsky <senozhatsky@chromium.org>
Cc: Nick Terrell <terrelln@fb.com>
Cc: Minchan Kim <minchan@kernel.org>
Cc: Sergey Senozhatsky <senozhatsky@chromium.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
terrelln pushed a commit that referenced this issue Mar 8, 2025
@sergey-senozhatsky
lib: zstd: export API needed for dictionary support
7418f23 
Patch series "zram: introduce custom comp backends API", v7.

This series introduces support for run-time compression algorithms tuning,
so users, for instance, can adjust compression/acceleration levels and
provide pre-trained compression/decompression dictionaries which certain
algorithms support.

At this point we stop supporting (old/deprecated) comp API.  We may add
new acomp API support in the future, but before that zram needs to undergo
some major rework (we are not ready for async compression).

Some benchmarks for reference (look at column #2)

*** init zstd
/sys/block/zram0/mm_stat
1750659072 504622188 514355200        0 514355200        1        0    34204    34204

*** init zstd dict=/home/ss/zstd-dict-amd64
/sys/block/zram0/mm_stat
1750650880 465908890 475398144        0 475398144        1        0    34185    34185

*** init zstd level=8 dict=/home/ss/zstd-dict-amd64
/sys/block/zram0/mm_stat
1750654976 430803319 439873536        0 439873536        1        0    34185    34185

*** init lz4
/sys/block/zram0/mm_stat
1750646784 664266564 677060608        0 677060608        1        0    34288    34288

*** init lz4 dict=/home/ss/lz4-dict-amd64
/sys/block/zram0/mm_stat
1750650880 619990300 632102912        0 632102912        1        0    34278    34278

*** init lz4hc
/sys/block/zram0/mm_stat
1750630400 609023822 621232128        0 621232128        1        0    34288    34288

*** init lz4hc dict=/home/ss/lz4-dict-amd64
/sys/block/zram0/mm_stat
1750659072 505133172 515231744        0 515231744        1        0    34278    34278

Recompress
init zram zstd (prio=0), zstd level=5 (prio 1), zstd with dict (prio 2)

*** zstd
/sys/block/zram0/mm_stat
1750982656 504630584 514269184        0 514269184        1        0    34204    34204

*** idle recompress priority=1 (zstd level=5)
/sys/block/zram0/mm_stat
1750982656 488645601 525438976        0 514269184        1        0    34204    34204

*** idle recompress priority=2 (zstd dict)
/sys/block/zram0/mm_stat
1750982656 460869640 517914624        0 514269184        1        0    34185    34204

This patch (of 24):

We need to export a number of API functions that enable advanced zstd
usage - C/D dictionaries, dictionaries sharing between contexts, etc.

Link: https://lkml.kernel.org/r/20240902105656.1383858-1-senozhatsky@chromium.org
Link: https://lkml.kernel.org/r/20240902105656.1383858-2-senozhatsky@chromium.org
Signed-off-by: Sergey Senozhatsky <senozhatsky@chromium.org>
Cc: Nick Terrell <terrelln@fb.com>
Cc: Minchan Kim <minchan@kernel.org>
Cc: Sergey Senozhatsky <senozhatsky@chromium.org>
Signed-off-by: Andrew Morton <akpm@linux-foundation.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@Cyan4973 @tomByrer @hiirotsuki
0