I agree that these formats have undergone long-term evolutions.
However, their evolution paths somehow allow them to add features that would break backward-readability. Here are the reasons:
Consider the audience and circulation of these files.
1. A turn-key software system that stores images in this format, but is able to import/export any other image formats.
This means nobody would need to be concerned about the internal file format used within this system.
(Early stage of TIFF.)
2. A business user sends a business document to another user in a different company, having already confirmed that the recipient can handle this format.
(The early use of PDF for printing, and TIFF)
3. A company or individual has to make a document available on the web for public download. It is not known whether the audience can handle this format or not.
This situation always require the lowest denominator of technology. In particular:
3.1 If a reader can be downloaded, a link is provided. This is the situation for PDF which lasted from mid-1990s to mid-2000s.
(Remember small-town citizens complaining they couldn't open government website documents?)
3.2 If a file format supports multiple "versions", the lowest version is used when the audience is general public.
Basically, TIFF wasn't even an acceptable choice for the public web. For PDF, only PDF1.4 can be used.
Because WebP is designed to hit the third goal (general web use), it has to provide backward-compatibility for a while until every web browser vendor is committed to adding continuous support for the newer versions of WebP.
Just my two cents. Thanks,
Ryan Wong