Identity Cloaker Access Key Generator
Carlito Austin
I am suspicious of sitemap generators. It would be quite possible to offer a free sitemap generator that pinged a scraper every time it was used. I would really like to see a tool in google webmaster tools that allowed you to generate an .xml sitemap and as these are only for search engine use I see no reason name of file could not be randomly generated and it could also delete previous sitemap file. I think the idea of including sitemap reference in robots.txt should be abandoned and all sitemaps submitted via ping to all search engines that use them and random generated file each time a sitemap is created. This would I think stop the scrapers. g1smd Msg#:3332489 10:26 pm on May 6, 2007 (gmt 0)
Howether that dream seems to be well and truely over and shot to pieces at present. I am working with sites scraped to death and have seen clear identity theft as well. So taking a huge slice of humble pie........ webmasterworld where was that pearl script you use for cloaking robots.txt again and can it be applied to sitemaps? I do also want a safe sitemap generator as in many ways can a free sitemap generator also send info to scraper sites without your knowledge. I would trust one from google. incrediBILL Msg#:3332554 12:48 am on May 7, 2007 (gmt 0)
Sitemaps.xml is a serious scraping vulnerability which is one reason I don't use it as the sitemap.xml file is a clear path to crawl without hitting any spider traps so it should be cloaked, no doubt about it. Any time you give scrapers a clear path to avoid honey pots and spider traps they'll use it. With that said, the scrapers can simply scrape a search engine first using "site:mydomain.com" to get the equivalent of a sitemap and avoid your spider traps anyway. That's why even robots.txt should be cloaked because you give the scrapers a list of user agents that you allow to crawl. Assuming you don't also restrict user agents by IP range or reverse DNS, the scrapers just adopt the allowed UA's and slide right through your .htaccess files or other user agent blocking fire walls. However, cloaking sitemap.xml doesn't technically stop anyone else from crawling your site, it just means they have to crawl the old fashioned way. Simply check your log files to see what requested sitemap.xml and was denied every now and then and let anything new that looks worthy crawl your site on the next pass using the sitemaps. Keniki Msg#:3332572 1:13 am on May 7, 2007 (gmt 0)
Forgive me if I am uneducated on the matter, but what's going on? I have never dealt with this type of activity. Will this affect rankings? How can a person address these issues? TheRealTerry Msg#:3332601 1:59 am on May 7, 2007 (gmt 0)
I would use a random name, not the standart naming for the sitemap file or sitemap index like others already suggested. Also perhpas use G alerts to monitor references to your site in general.
Also hopefully you already check your statistics regularly, so now you will also need to check who is accessing the sitemap and if there are signs someone is abusing it just ip ban them through .htaccess or httpd.conf. Cloaking should work too if done well, like the robots file is done here at webmasterworld for example, but then I have a cloaking phobia even when legitimate so I would just look for the bad guys rather and ban them. Keniki Msg#:3332611 2:17 am on May 7, 2007 (gmt 0)
The other very important point is that only genuine SEs should be reading sitemap.xml - human visitors should never pull that URL. As traps go, cross-referencing all requests for that file against approved search engines and then blocking all who aren't on the list from the entire site is fairly foolproof. A better trap might even be to serve those who are unauthorised to read the sitemap.xml file a whole different site of URLs, i.e. changing .html to .htm and using .htaccess to rewrite all those incorrect URLs to a script which feeds them random rubbish interspersed with copyright abuse messages. IanKelley Msg#:3332699 5:16 am on May 7, 2007 (gmt 0)
You're right, even the simplest of scrapers can follow every available link and get your whole site regardless of whether or not there's a sitemap. I think what people are referring to here are scrapers that can be identified because of a common user agent or crawl method. Although I'm not sure having or not having a site map makes a difference even there because if you're checking using .htaccess you're checking every request. They will be just as denied/allowed/redirected visiting somedeeppage.html as they would be visiting index.html. And then of course there are scrapers which look exactly like a legitimate browser and are therefore effectively invisible to most sites.
And excessively scraped sites can struggle in the SERPs. What does that mean? When someone mirrors your content it's possible for your page/site to get hit with a duplicate content penalty. longen Msg#:3332763 7:34 am on May 7, 2007 (gmt 0)
Never say NOTHING can stop scraping just because nothing you use will stop it. You can stop most, if not all, scraping if you have the proper tools running on your server. Sure, scrapers can still snag 1 or 2 pages from my site, as it takes at least 2 pages for my automated tools to detect non-human behavior characteristics. However, after 2-3 pages the door is slammed in their face for most garden variety scrapers, spammers looking for form pages, or email harvesters. For instance, if something other than Google, Yahoo or another whitelisted 'bot actually requests files like robots.txt or sitemap.xml, they are instantly blocked from crawling any additional pages as no human (except nosy ones) ever request such files. If they are downloading .HTML pages and aren't loading other required page components, such as images, CSS, .js or anything else that a browser requires to display my web pages, they are also instantly blocked. Of course there are a few rare bots that do all this, and they tend to do other stupid things themselves which takes a couple of additional page loads to detect and stop. I could go on, but it's completely doable. You should've come to the PubCon session last year about stopping bad bots, we covered it in much detail. incrediBILL Msg#:3333080 5:04 pm on May 7, 2007 (gmt 0)
Ever wondered about those fancy items Traitors, Nuclear Operatives, and other Syndicate operatives get? Look no further. This page lists them out, explains what they do, and tells about the various ways these people get them!
Uplinks are gadgets Traitors, Head Revolutionaries, Spy Thieves, and Nuclear Operatives who choose the Custom Class Uplink option use to obtain gear from the Syndicate. The uplink typically masquerades as some sort of mundane everyday object, and each of these roles gets a different version that might have a different selection of items or even work entirely differently.
The Custom Class Uplink and uplinks used by Traitors and Head Revolutionaries show a list of items you can buy. The currency used is not credits, but a special Syndicate currency with a randomly-chosen name, often referred to by its old name "telecrystals" or just "TC". Regardless of which of these three uplinks you have, you get a grand total of 12 currency, so spend them wisely! If in doubt, press the About button to get a brief description before ordering the item in question.
The Spy Thief uplink is the real odd one out. Instead of displaying a selection of items to buy like the other uplinks, the Spy Thief uplink shows a list of bounties which give Syndicate gear when completed. See the bounty system section for a much more in-depth look.
Usually, the code will be automatically filled in when unlocking the uplink. In the event that you forget your PDA access code or the uplink frequency, use the Notes command to bring it up. It's in the "Commands" tab on your right above the chat. Alternatively, you can enter "Notes" into your text parser/command line near the bottom of the screen.
These are all items that can be bought through uplinks. Some require that the owner be a certain crew job (e.g. Clown, Staff Assistant, etc.), while others don't. Some of these also appear in loadout kits used by nuclear operatives, and some are sold by CARL too, but these all share the common trait of being available through Syndicate uplinks.
The equipment listed below doesn't have any job requirement, i.e. whether the uplink owner is an Engineer or Medical Doctor or whatever doesn't affect if it's available for purchase. That said, depending on the antag role, some items may not be available. Traitor uplinks have access to this entire list, so, for example, a Traitor Head of Personnel and a Traitor Staff Assistant can buy each and every one of the items. Uplinks used by Head Revolutionaries and the nuke op custom class uplink have a much more limited selection. Meanwhile, Spy Thieves can get some (i.e. not all) of these from completing bounties.
You can also right-click any item in the set and choose change appearance (and optionally take it off and put it back on to be safe) to change only its appearance and customize your outfit a bit.
Besides gaining access through mundane locks, there are a number of additional purposes that EMAGs serve, e.g. removing any laws a cyborg may have, scrambling ID cards with random access, hacking automated bots with malicious results, damaging doors that have been welded shut, and shorting out restrictions of certain computers. It also drops the emergency shuttle countdown to 10 seconds, neat!
By default, it starts out with 100 units of ketamine. The target will be knocked out for give or take 2 minutes, though many players will recognize that they have been penned when their vision goes all blurry and they begin yawning... the 30-40 seconds it takes to go into effect are plenty of time to scream for help. That's why it works best in conjunction with a signal jammer.
b37509886e