Google Groups Home
Help | Sign in
Compression by descent
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  Messages 1 - 25 of 67 - Collapse all   Newer >
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
Ashley Labowitz  
View profile
(4 users)  More options Aug 10 2007, 6:35 pm
Newsgroups: comp.compression
From: Ashley Labowitz <sporecoun...@gmail.com>
Date: Fri, 10 Aug 2007 22:35:15 -0000
Local: Fri, Aug 10 2007 6:35 pm
Subject: Compression by descent
Good day everyone,

I've been programming a technique that allows most, if not all files
to be reduced in size.  It is done using cyclic roots and high-degree
polynomials where the total information content of the coefficients is
smaller (sometimes much smaller) than the original text.

The FAQ has been pointed out to me where it "proves" that not all
files can be compressed by any algorithm, but it seems to me that it
has some mistakes.  They aren't serious, but they are oversights that
prevent it from applying to fractal bits, permutations and sorting the
bytes of the original file.

The gist of this algorithm is that when certain polynomials are
iterated over the complex plain (e.g., like the Mandelbrot set),
information can be encoded in the "ragged" edges of the curve.  I'm
afraid this may have been done before, and I don't want to waste any
work.  Does it ring a bell to anyone?

If someone would like to look at my pseudocode, I would be grateful.

CheeriO,
Ash


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Carmody  
View profile
(8 users)  More options Aug 10 2007, 7:23 pm
Newsgroups: comp.compression
From: Phil Carmody <thefatphil_demun...@yahoo.co.uk>
Date: 11 Aug 2007 02:23:02 +0300
Local: Fri, Aug 10 2007 7:23 pm
Subject: Re: Compression by descent

Ashley Labowitz <sporecoun...@gmail.com> writes:
> Good day everyone,

Well it was a good day...

> I've been programming a technique that allows most, if not all files
> to be reduced in size.

You have not.

> It is done using cyclic roots and high-degree
> polynomials where the total information content of the coefficients is
> smaller (sometimes much smaller) than the original text.

No it's not.

> The FAQ has been pointed out to me where it "proves"

It's not just *called* a proof. It *is* a proof. If you think it's
not a proof, then you are a loon.

> that not all
> files can be compressed by any algorithm, but it seems to me that it
> has some mistakes.  

Ergo you are a loon.

> They aren't serious, but they are oversights that
> prevent it from applying to fractal bits, permutations and sorting the
> bytes of the original file.

> The gist of this algorithm is that when certain polynomials are
> iterated over the complex plain (e.g., like the Mandelbrot set),
> information can be encoded in the "ragged" edges of the curve.  I'm
> afraid this may have been done before, and I don't want to waste any
> work.  Does it ring a bell to anyone?

Yes. I call it "compression by coincidence". You're about the
thousandth loon to pretend its got any merit at all. You won't
be the last.

> If someone would like to look at my pseudocode, I would be grateful.

I wouldn't.

Phil
--
Dear aunt, let's set so double the killer delete select all.
-- Microsoft voice recognition live demonstration


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Ashley Labowitz  
View profile
(2 users)  More options Aug 10 2007, 8:22 pm
Newsgroups: comp.compression
From: Ashley Labowitz <sporecoun...@gmail.com>
Date: Sat, 11 Aug 2007 00:22:20 -0000
Local: Fri, Aug 10 2007 8:22 pm
Subject: Re: Compression by descent
Hello again,

Phil, you are jumping to conclusions.  It turns out that if you place
the bytes to be compressed on a square grid and then iterate a complex
polynomial you can show the fractal edges will naturally follow a
significant number of bytes, allowing those to be removed from the
original entropy.  This is the secret to it working for _all_ files,
not just some special form.  I know the mathematical establishment is
slow to embrace change (and wisely so), but Phil, please don't be
ridiculous.

The difficult part is extracting the roots of high-order polynomials,
but this can be done classically using Newton's method adapted for the
complex plane (I'm working on an extension for quarternions, but
Python is not my strength :( ).  Obviously, fractals only carry as
much information as is in the coefficients of their generating
polynomial, but you might be assuming that they carry infinite
information.  Let me know if this is your mistake.

Here's the twist, fractional bits can be extracted from the _exact_
(or nearly so) value of the roots of the polynomials.  This is the
chief error of the Pigeonhold Principle "proof" of impossibilty.  Of
course, the Pigeonhold Principle is very useful in general, but it is
a mistake to apply it to non-integer sets such as fractional bits.

Any data generated from a deterministic process has a Kolmogorov
Complexity that must be lower than the size of the data as the number
of bits to model goes to infinity.  However, in practice it is
impossible to find this optimal Turing machine in general.  However,
the set of strings that are stochastic or contain purely random
elements are themselves bound to fractal models.

But it is not necessary for you to agree, I've shown the proof to a
number of people and none have succeeded in finding any mistakes in
it.  I'm not doing it for the money, but to help the world.

Best,
Ash


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Fulcrum  
View profile
 More options Aug 10 2007, 8:26 pm
Newsgroups: comp.compression
From: Fulcrum <werner.bergm...@gmail.com>
Date: Fri, 10 Aug 2007 17:26:26 -0700
Local: Fri, Aug 10 2007 8:26 pm
Subject: Re: Compression by descent

> On Aug 11, 12:35 am, Ashley Labowitz <sporecoun...@gmail.com> wrote:
> Good day everyone,

> I've been programming a technique that allows most, if not all files
> to be reduced in size.  It is done using cyclic roots and high-degree
> polynomials where the total information content of the coefficients is
> smaller (sometimes much smaller) than the original text.

One of the better posts this year!.
Phil's post i mean...  ;)

    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Fulcrum  
View profile
 More options Aug 10 2007, 8:35 pm
Newsgroups: comp.compression
From: Fulcrum <werner.bergm...@gmail.com>
Date: Fri, 10 Aug 2007 17:35:45 -0700
Local: Fri, Aug 10 2007 8:35 pm
Subject: Re: Compression by descent
I would also like to nominate this sentence : 'the set of strings that
are stochastic or contain purely random elements are themselves bound
to fractal models'  :)

    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Ashley Labowitz  
View profile
(1 user)  More options Aug 10 2007, 8:45 pm
Newsgroups: comp.compression
From: Ashley Labowitz <sporecoun...@gmail.com>
Date: Sat, 11 Aug 2007 00:45:26 -0000
Local: Fri, Aug 10 2007 8:45 pm
Subject: Re: Compression by descent
Thanks Fulcrum.  It's good that someone can appreciately respond to a
challenge to conventional thinking without taking the easy way out.

On Aug 10, 7:35 pm, Fulcrum <werner.bergm...@gmail.com> wrote:


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
industrial_...@hotmail.com  
View profile
(4 users)  More options Aug 10 2007, 9:01 pm
Newsgroups: comp.compression
From: industrial_...@hotmail.com
Date: Fri, 10 Aug 2007 18:01:53 -0700
Local: Fri, Aug 10 2007 9:01 pm
Subject: Re: Compression by descent
On Aug 10, 5:23 pm, Phil Carmody <thefatphil_demun...@yahoo.co.uk>
wrote:

> Ashley Labowitz <sporecoun...@gmail.com> writes:

> Well it was a good day...

> I have not [deepthroated myself today.]

Yes you have.

> No [my dick isn't a long 12-inch flaccid spaghetti cock].

Yes it is.

> I'm not just *called* a [hairy fatso]. I *am* a fat fascist fucker. If you think i'm
> not, then you are a loon.

I won't argue with you there.

> Ergo I am a loon.

Yup.

> Yes. I call it "wise trolling". You're about the
> thousandth loon to pretend my trolling has any merit at all. You won't
> be the last.

> I wouldn't [take my tylenol without spreading margarine over it.].

> Phil
> --
> Dear aunt, let's set so double the killer delete select all.
> -- Microsoft voice recognition live demonstration

Two words: fuck you.

    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Ashley Labowitz  
View profile
 More options Aug 10 2007, 9:46 pm
Newsgroups: comp.compression
From: Ashley Labowitz <sporecoun...@gmail.com>
Date: Sat, 11 Aug 2007 01:46:50 -0000
Local: Fri, Aug 10 2007 9:46 pm
Subject: Re: Compression by descent
On Aug 10, 8:01 pm, industrial_...@hotmail.com wrote:

> On Aug 10, 5:23 pm, Phil Carmody <thefatphil_demun...@yahoo.co.uk>
> wrote:

I don't think I understand what you mean industrial_...@hotmail.com
but you are being unfair to Phil.

I think it's best if people would evaluate my ideas on their merits.
You can show fractal convergence using criteria known for decades and
at that point, enough accuracy has been achieved.  My implementation
uses 1 nybble for the main coefficient, and builds from that using a
doubly-linked list.  Each block is stored using offsets as follows.
This is from the README file I'll be distributing with my source
code.  I apologize but fixed-width format is needed to properly read
it.

         +---+---+---+---+---+---+---+---+---+---+
         | SEQUENCE  |HD |     COEF      | BYTE  | (ctd.)
         +---+---+---+---+---+---+---+---+---+---+
         | MAIN NUMBER   |   POWER EXP   | MODE  | (ctd.)
         +---+---+---+---+---+---+---+---+---+---+
         | TY| X | Y | Z | TIME  | PERF  | PRIME |
         +---+---+---+---+---+---+---+---+---+---+

With this key:
HD = head
TY = type
X, Y, Z = codes for which roots of -1
TIME = timestamp
PERF = performance characteristic to optimize
PRIME = base of polynomial (not Galois)

The high-precision root extractions can be done in 33 lines of
assembly, or so it seems: I don't have the resources to test this as
well as I'd like.  One other way to model it is to use a network flow
system (or a shortest distance one, which is easily solved with
Dijkstra's algorithm).  I hope you guys wouldn't disagree with
Dijkstra's algorithm... :)

Cheerio,
Ash


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
industrial_...@hotmail.com  
View profile
(1 user)  More options Aug 10 2007, 11:48 pm
Newsgroups: comp.compression
From: industrial_...@hotmail.com
Date: Fri, 10 Aug 2007 20:48:32 -0700
Local: Fri, Aug 10 2007 11:48 pm
Subject: Re: Compression by descent
On Aug 10, 7:46 pm, Ashley Labowitz <sporecoun...@gmail.com> wrote:

> On Aug 10, 8:01 pm, industrial_...@hotmail.com wrote:

> > On Aug 10, 5:23 pm, Phil Carmody <thefatphil_demun...@yahoo.co.uk>
> > wrote:

> I don't think I understand what you mean industrial_...@hotmail.com
> but you are being unfair to Phil.

He was obviously trolling, and I was in a "wanna-see-blue-blood-bleed-
red" mood so I think I officially clunked his ass outta this thread
where he can regurgitate his bullshit on some other forum if he has
nothing to add worth reading to the topic.

To be fair, your idea is kinda vague to me, I don't get the exact
mechanics of your algorithm. Put it in a nutshell: how do you expect
to compress *most* of all possible files? By how much? Are there any
limits, if so, what?

> I think it's best if people would evaluate my ideas on their merits.
> You can show fractal convergence using criteria known for decades and
> at that point, enough accuracy has been achieved.  My implementation
> uses 1 nybble for the main coefficient, and builds from that using a
> doubly-linked list.  Each block is stored using offsets as follows.
> This is from the README file I'll be distributing with my source
> code.  I apologize but fixed-width format is needed to properly read
> it.

Each block contains part of the target file, right?

If you really have the source code, I guess you can work on your idea
with more experienced peoples around this newsgroup, but I doubt
you're covering any new ground (not saying this to be nasty but unless
you can specifically prove any flaws in the counting argument, I don't
think yer gonna get anywhere.) How do you enumerate 4 combos with only
2? A.K.A: How do you compress 00 01 10 or 11 to 0 or 1 (compress all 2
bits to 1) When 0 or 1 can only represent 2 out of the 4 possible
combos?

My theory around this (see posts from 6 months ago) was based on the
nature of "random-appearing data" and that it should have some
distinct feature that "normal, practical" data doesn't and thus should
be able to be comrpessed. But then I realized that "random-appearing
data" makes about 99.99% of all possible files and that the data we
see everyday is a painfully tiny portion (0.0001%) so logically it's
impossible.

The only remaining possible way out of this would be to store data as
"time ticks" where one tick would be an extremely tiny fragment of
time (e.g. 10^-30th of a second.) Simon Jackson I heard is working on
this.

But I'm up for a civilized discussion about your idea, but I request
that you explain with eloquence and simplicity in mind since math
isn't my strength (ironic, isn't it?)


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Carmody  
View profile
(4 users)  More options Aug 11 2007, 5:02 am
Newsgroups: comp.compression
From: Phil Carmody <thefatphil_demun...@yahoo.co.uk>
Date: 11 Aug 2007 12:02:19 +0300
Local: Sat, Aug 11 2007 5:02 am
Subject: Re: Compression by descent

Ashley Labowitz <sporecoun...@gmail.com> writes:
> Hello again,

> Phil, you are jumping to conclusions.  It turns out that if you place
> the bytes to be compressed on a square grid and then iterate a complex
> polynomial you can show the fractal edges will naturally follow a
> significant number of bytes, allowing those to be removed from the
> original entropy.  This is the secret to it working for _all_ files,
> not just some special form.

You are a crank, a loon, a babbling drunk baboon.

> I'm not doing it for the money, but to help the world.

Help comp.compression by turning your computer off.

Phil
--
Dear aunt, let's set so double the killer delete select all.
-- Microsoft voice recognition live demonstration


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
industrial_...@hotmail.com  
View profile
(8 users)  More options Aug 11 2007, 10:13 am
Newsgroups: comp.compression