Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

[9fans] Google File System

2 views
Skip to first unread message

matt

unread,
Nov 15, 2002, 6:29:27 PM11/15/02
to
Money and mouth in [im]perfect harmony

attached and http://proweb.net/~matt/p9-4/goofs.c

[I had a nettiquette conundrum here, when does a post get too big to
attach?]

Here's the fs I mentioned the other day.

It started as a look into the Google API which uses SOAP
http://www.google.com/apis/

My eyes started to bleed reading that documentation so I wrote one that
parses the HTML returned from a GET

I've not used it that much but it did save my life already. We lost some
data from the database [don't ask] and I used goofs to retrieve the relevant
pages from google's cache of my site and was able to re-create the data.

I'm pretty sure it does stuff wrong but it seems to work.

to do a search echo the term into the ctl file
you can even add extra options such as site restriction
(you can get quite complicated if you try)

It will break when google changes it's html output


example
% goofs -m /usr/matt/gofs
% echo 'factotum site:www.cs.bell-labs.com' > /usr/matt/gofs/ctl

% ls /usr/matt/gofs/factotum+site:www.cs.bell-labs.com
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/2
..
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/19 [goofs tries to get 50
results]

% ls '/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1'

/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/cached
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/description
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/folder
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/related
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/summary
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/title
/usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/url

% cat /usr/matt/gofs/factotum+site:www.cs.bell-labs.com/1/summary

<b>Factotum</b> and SecStore</a><br><font size=-1> <b>...</b> A process
called <b>factotum</b> is used to hold credentials like passwords<br>
and public/private keypairs and perform cryptographic operations. <b>...</b>
<br>


goofs.c

mark powers

unread,
Nov 16, 2002, 3:04:26 PM11/16/02
to
oof. sorry for the mess, all. that last message wasn't finished and
wasn't meant to go out.

I had to finish the morning coffee before I really understood what
just happened, but it looks like when you have a /bin/myupassend that
listens on stdin, it's that and not marshal itself that's listening
when you're typing a message in a rio window?

I meant to toss that message and start over, but I hit delete and it
got sent anyway. so I experimented, and on one try I got a python
KeyboardInterrupt exception on the terminal. myupassend is python,
because of my odd mail situation.

I should put a KeyboardInterrupt handler in my myupassend, and swear
off emailing while insufficiently caffienated...

ma...@panix.com

unread,
Nov 16, 2002, 3:11:26 PM11/16/02
to
| oof. sorry for the mess, all. that last message wasn't finished and
| wasn't meant to go out.

and, in fact, it *didn't* go out. at least not to the list.

maybe I should just go back to bed.

0 new messages