Reconstructing A Log File?

[idfubar (Rishi Ugersain Chopra)]

Is there an easy way to reconstruct a Shelve log file? I'm not sure
if anyone else has run into the problem so I thought it best to ask
before attempting to author a script from scratch to do the same...

[lith]

> Is there an easy way to reconstruct a Shelve log file?

What do you mean by reconstruct?

You should be able though to define a shelf that gets activated on
every page you load (this doesn't work for subframes) but that doesn't
actually save the document (set filename to -) and does nothing but
write a log entry.

Regards,
Tom

[idfubar (Rishi Ugersain Chopra)]

On Nov 23, 4:43 am, lith <minil...@gmail.com> wrote:
> > Is there an easy way to reconstruct a Shelve log file?
>
> What do you mean by reconstruct?

Sorry; what I mean by "reconstruct" is to generate a log file when one
has been deleted or otherwise lost. My guess is that it would be
possible to author a script which would allow one to regenerate the
XML log file associated with a given "data" folder; such a script
might also come in handy in the event one wishes to merge two given
"data" folders.

> You should be able though to define a shelf that gets activated on
> every page you load (this doesn't work for subframes) but that doesn't
> actually save the document (set filename to -) and does nothing but
> write a log entry.

Yes, I did see the directions regarding the same but in my particular
case the tutorial written by 'silverwav' (on the MozillaZine forums)
was followed to create a complete browsing history (I had previously
been using Slogger and the directions were fairly consistent with
generating an archive which is similar in nature).

> Regards,
> Tom

[lith]

> My guess is that it would be
> possible to author a script which would allow one to regenerate the
> XML log file associated with a given "data" folder

You could have difficulties to find out the original url from which
the document was downloaded but this depends on the file format you
used to save the web pages. Creating a simple catalog of the files
(except for the original url) in a directory shouldn't be too
difficult but is beyond the scope of the shelve addon.

When I plan to data directories, I don't create monolithic log files
but one file per page and concatenate those files as needed.

[SilverWave]

Hi,

Just a thought...

Trying to recreate a log from the saved data is going to be a lot of
work, I would be more inclined to try to recover the lost log TBH.

In case that is not possible I have had a look at what scripts I have
available but unfortunately they are are all related to migrating and
manipulating one version of the log file to another :-(

For what it is worth I have dumped my old notes here:

http://groups.google.com/group/shelvelogger

The one relating to migration is:

ShelveLogger 4.0 Transition Notes. [updated]

Note that I use Linux and the script is awk.

Looking at your issue you would need search through your data folders,
find the url's and then save it to a new log file.
You have probably lost the original www link and and clipped
information from the original save as well :-(

As I say this looks to be a mammoth task, wishing you the best of
luck.

P.S.

Another thought has just occurred to me... although the log is lost
you could use a search tool like recoll or Google Desktop Search to at
least give you some access to your saved data.

---

SilverwWave


On Nov 27, 1:20 am, "idfubar (Rishi Ugersain Chopra)"