Google’s Love For Newspapers & How Little They Appreciate It
Let me help you with that, Rupert. I’m going to save you all those potential legal fees plus needing to even speak further about the evil of the Big G with two simple lines. Get your tech person to change your robots.txt file to say this:
User-agent: *
Disallow: /Done. Do that, you’re outta Google. All your pages will be removed, and you needn’t worry about Google listing the Wall St. Journal at all.
User-agent: *
The asterisk (*) or wildcard represents a special value and means any robot.
Disallow:
The Disallow: line without a / (forward slash) tells the robots that they can index the entire site.
I’m pretty sure the newspaper publishers are not going after Yahoo’s bigger-than-Google News platform because most of them are in the Yahoo Newspaper Consortium.
The Newspaper Consortium is comprised of 30 companies that represent nearly 800 local papers—a number that’s equivalent to 32 percent of all U.S. daily circulation and 41% of all U.S. Sunday circulation.
Related posts:
- More Free Advertising Ideas For Newspaper Publishers
- Remaindered Newspaper Links December 5, 2008
- Free Advertising Ideas For Newspaper Publishers
- The Newspaper Publishers’ Dilemma – Is $179 Million the New $890 Million?
- What Newspaper Websites Can Learn from Darren Rowse and ProBlogger – First Impressions