All Topics
All Topics
Technology
Technology
Design
Design
Programming
Programming
Science
Science
News
News
Gaming
Gaming
Entertainment
Entertainment
Business
Business
Finance
Finance
Sports
Sports
Health
Health
Food
Food
Travel
Travel
Art
Art
Music
Music
Books
Books
Education
Education
Politics
Politics
Personal
Personal
No algorithm. No AI slop. No ads. Just RSS. Pro-human. Indie writers. Real journalism. Open web. Chronological. Hand toasted.

ts_zip: Text Compression Tool Using Large Language Models Achieves High Compression Ratios

By

everlier

4mo ago· 1 min readenNews

Summary

ts_zip is a text compression utility that uses Large Language Models (LLMs) to achieve significantly higher compression ratios than traditional compression tools like xz. The article presents comparative data showing ts_zip achieving compression ratios of 1.142-1.431 bits per byte (bpb) on text files, outperforming xz's 2.551-2.717 bpb. The tool can compress and decompress text files, though the author notes there are some caveats to its use.

Key quotes

· 5 pulled
The ts_zip utility can compress (and hopefully decompress) text files using a Large Language Model.
The compression ratio is much higher than with other compression tools.
The compression ratio is given in bits per byte (bpb).
ts_zip(bytes) (bpb) 21713 1.142
ts_zip(bytes) (bpb) 137477 1.431
Snippet from the RSS feed
The compression ratio is given in bits per byte (bpb).

You might also wanna read