How similar do pages need to be to necessitate a robots text?

Why register for free on WebRadiance?

Welcome to WebRadiance forums! WebRadiance is a place for discussion and help on a large range of web design and development related topics such as HTML, CSS, ASP & .NET, PHP and SEO. It is provided for free, without ads and is a friendly place for beginners and professionals alike. By joining us today you can take part in our rapidly growing community.

Registering enables you to:

have your say by posting new messages and taking part in topics and polls
keep up to date with the latest news and trends in the web design and development world
send private messages to other members
have your questions answered by our knowledgeable community
add a link to your website in our links area
receive emails when someone replies to your posts

Login Name (?)	Password (?)	Email (?)
Display Name (?)	Confirm Password (?)	Confirm Email (?)
Secruity Code (?)
I have read, understood and agree to these rules and conditions (View Terms)

Updated on 4th January 2008

We encourage you to participate in the WebRadiance Community, however as with all social circles, there are a few rules you must abide by in order to maintain your membership within these forums. We are trying to provide the highest quality community experience for our members and following these rules is the best way to maintain a quality environment for everyone.

If we find that you break any of these rules, your account may be disabled and your posting privileges removed.

Section A: Posting & Personal Messaging Rules

You will not post any messages, or links to content, that is obscene, vulgar, sexually-orientated, hateful, threatening, or otherwise violates of any laws
No double posting; keep your question in one section
Posts in a particular forum section and/or thread need to stay on topic
Never make a post simply to increase your post count
DO NOT POST IN ALL CAPS
Be respectful to other members
You will not recruit WebRadiance members for other forums
Individual sub-forums may have additional rules. These will be displayed at the top of each sub-forum

Section B: Spam

Users will not spam the forum through repetitive posting, or its members through the PM system

Section C: Usernames/Accounts

Your member name cannot contain profanity
Your member name cannot contain advertising or a company name that is not your own
Your member name cannot be an attempt to impersonate another member
If restricted/banned, you will not register a new account to obtain freedom to post

Section D: Signatures

One line of text only
In the one line of text, only one external link is allowed
No images are allowed

Section E: Avatars

Images must be suitable for all ages
Images may not be more than 15kb in size

Section F: Advertising

You cannot post with the intention of selling and/or promoting yourself, a product, or another web site
Your member name cannot be a blatant advertisement

Section G: Report Posts

You must not abuse the Report post feature. Blatant abuse will not be tolerated.

Section H: Site/code

Do not attempt to hack the site
Do not post compiled code, but source code is allowed.
Do not attempt to gain access to another member's account or any restricted areas of the web site

Section J: Administrators/Moderators

Members may never request to become an administrator or moderator
Any decision made by one administrator or moderator can be appealed
Any decision made by all of the Administrators is final

Section K: General:

Rules that are considered common sense or implied by the community also apply
These rules can be modified at any time by the administrators, so check back regularly

How similar do pages need to be to necessitate a robots text?,

Options

clubdesign View Member Profile Find Member's Posts	Nov 13 2008, 11:02 AM Post #1
W.R. Private Group: Members Posts: 24 Joined: 10-October 08 From: Barnet EN4, London Member No.: 1,240	nd which page if duplicate (or too similar, dependent on answer to above) should you choose to allow indexing? I'm figuring it would be the page closest to root or in root, or is there a more important factor than this such as links? It's all abaat the knowledge!

sypher View Member Profile Find Member's Posts	Nov 13 2008, 12:04 PM Post #2
the owner3r Group: Administrators Posts: 1,531 Joined: 4-April 06 From: North Wales, UK Member No.: 4	Theres 1000's of pages out there (using feeds, syndication etc) one of the big things right now is sharing information across the web meaning theres going to be hundreds of sites with the same articles. So i wouldnt worry about that. -------------------- sypher design - North Wales Web Design \| Latest Work: - Celtic DEA CSS - Cant See Sh*t

clubdesign View Member Profile Find Member's Posts	Nov 13 2008, 12:20 PM Post #3
W.R. Private Group: Members Posts: 24 Joined: 10-October 08 From: Barnet EN4, London Member No.: 1,240	That's an interesting point, I hadn't thought about that. I was concerned about Google taking less interest in my site by finding pages within the site with almost duplicate content, i.e. almost the same content (product lists and descriptions) but with different 'headlines'. Almost as if these pages should be 301 redirects - do you see what I was meaning. I wasn't talking about similar content to other sites but.... hmmmm. No, wait . Sorry Sypher, can you just reconfirm this in case we do have our lines crossed. I really value your opinion. p.s. please check your inbox for pm + link This post has been edited by clubdesign: Nov 13 2008, 12:29 PM

sypher View Member Profile Find Member's Posts	Nov 13 2008, 02:26 PM Post #4
the owner3r Group: Administrators Posts: 1,531 Joined: 4-April 06 From: North Wales, UK Member No.: 4	What the Search Engine does if it ever finds a page like that, is only serve one page (usually the highest ranked one) to the user. Alot of pages use things like, small caption story click full link to see full story (with the same information appearing). You may of seen when you specifically type in for a certain keyword on google it has the main site (which may contain partial info), and another page indented below which may really fit that user's search. The search engine usually disregards the page with the small amount of info and serve up the page with all of the information. Alot of these small things dont necessarily hurt your ranking, people just try and grab any little thing as an excuse of why things arent working. Just use common sense, search engines hate penalizing sites and really really hate to remove them from the index(when using black hat seo). So they wont penalize websites for most of the small things people say they do, its usually just other factors that have decreased that specific pages SERP ranking. -------------------- sypher design - North Wales Web Design \| Latest Work: - Celtic DEA CSS - Cant See Sh*t

clubdesign View Member Profile Find Member's Posts	Nov 13 2008, 02:43 PM Post #5
W.R. Private Group: Members Posts: 24 Joined: 10-October 08 From: Barnet EN4, London Member No.: 1,240	Great stuff, Sypher - explained like no other!

sypher View Member Profile Find Member's Posts	Nov 13 2008, 02:49 PM Post #6
the owner3r Group: Administrators Posts: 1,531 Joined: 4-April 06 From: North Wales, UK Member No.: 4	No problem! happy to help -------------------- sypher design - North Wales Web Design \| Latest Work: - Celtic DEA CSS - Cant See Sh*t

« Next Oldest · Search Engine Optimization · Next Newest »