GSA and github?

[Jonathan]

We've got a private github at our company. Is it reasonable to index
that with our GSA? (I gave it a shot, but there's a robot.txt file
blocking me -- before I get that removed I'd like to know if just
trying to crawl the thing makes any sense.)

[Dave Watts]

I don't know, but here's how I'd find out. Within your browser,
disable JavaScript and set your user-agent to match the GSA's
(gsa-crawler). Then, try browsing it, and see if you're able to get to
everything you'd expect to.

Dave Watts, CTO, Fig Leaf Software
http://www.figleaf.com/
http://training.figleaf.com/

Fig Leaf Software is a Veteran-Owned Small Business (VOSB) on
GSA Schedule, and provides the highest caliber vendor-authorized
instruction at our training centers, online, or onsite.

[Steve King]

Hi Jonathan,

Do you want to index the wiki or the code?

Steve.

> --
> You received this message because you are subscribed to the Google Groups "Google Search Appliance/Google Mini" group.
> To post to this group, send email to Google-Search-...@googlegroups.com.
> To unsubscribe from this group, send email to Google-Search-Applia...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
>

[Jonathan]

Ideally just the wiki, I think. I'm not sure if I can separate that
very easily, though. At the moment, I'd settle for anything.

On Apr 4, 4:11 pm, Steve King <steveat...@gmail.com> wrote:
> Hi Jonathan,
>
> Do you want to index the wiki or the code?
>
> Steve.
>