Hello
I have been researching compression in general and different techniques.
I have noticed that general tools such as 7z/rar are relatively poor on files which are mostly repetition.
There is an example of a BMP of 8 colours which repeat through most of the file where the PNG is 5KB and without the 56B header (and even with) RAR is 2KB and 7z is 1KB.
A tool such as DEFLATE can get it to less than 100B, and can shrink it further for its patterns to fit in less bits to around 50B.
I have written an overview for a versatile and adjustable compression tool where its elements can be specifically set for a customized result.
The most effective one will require a lot of calculations and temporary space and the result should be generally just about as compact as a file should get without moving data in advance.
General purpose settings for quicker encoding and much more effective results than common tools such as 7z/rar is possible.
The idea is to be able to have an algorithm created from the text, as I am not familiar with programming languages to develop an algorithm/pseudocode to suit a computer.
Once a working tool can be done, ideally the code can be used to make an ASM port and also a bootable scheduled form to directly process without video/sound etc for more thorough settings on more permanent data like archival/video/audio/asset etc.
It is aimed to be more of a one-off type of tool where it elements can be adjusted for speed/time and be comprehensive on data in the data spectrum (without anything targetting specific data types per se) - it should work on files where compression is possible (which ideally will not be for strings resembling coded data).
Encoding will take its time depending on settings selected. Decoding should generally be quick in general.
If anyone is willing to have a look to assist in an algorithm and a tool I can post the writeup.
Thank.
