Posts Tagged ‘spiders’

Many web designers are so focused on the design part of building a website, that they will unintentionally affect its search engine rankings. It is a total shame to create an attractive website that does not attract any visitors. There is no point to all that beauty if no one can find it. Here are some ordinary design mistakes that should be kept away from whenever possible.

Image Links
If your navigation menu consists of images to form the buttons instead of text, the search engine bots will be confused. It makes it difficult for search engines to spider and index your site. What if you do not have any other option than image links in the navigation bar? Add ALT text to the image links to give meaning to the image. Make sure that you have text links somewhere else on the page as well. The footer is a nice place to have a few more links.

Frames
When using frames in a site, the problem is that most search engines will only see the frame loader page and ignore the rest of the page within. If you do not have any choice but using frames, offer lead-in pages that are not placed in frames. This means that you can put all of your beautiful frame-based pages in other locations.

Splash Intro Pages
Beautiful intro’s or entry pages, often using flash animation, are impressive to human visitors, even though many of them will ‘skip the intro’ quickly to get to where they want to be. For search engines, however, such a introduction is not impressive at all. The spiders will think that this is the index page and will not find it useful at all. Often, the only text on these intro pages is “skip intro”, which does not say much about the rest of the site.

In order to get the top rankings in the SERPs, your will have to help the search engines a little bit. Their spiders will have to find your site, and be able to navigate the site, and read all of your content, before they can rank it. Some graphic elements will affect the accessibility of your website and are better avoided. Surely it does look nice, but who is there to see it if your site does not attract any visitors?

To start with, you need to let search engines come across your website. Search engines use a computer program called Spiders to find new websites. As soon as spiders find your website, they will put it in their databases. However, for brand new websites, it is hard to get found by search engines.

What a lot of webmasters do is to submit their sites to Google and Yahoo by hand, but there really is no need to do that. Here are 5 ideas to get your website indexed by search engines fast:

  1. Include a sitemap.xml file in your root directory. This xml file is like a list of the URLs of all pages of your website. This will help the spiders of the search engines with crawling your website. Once you have uploaded it to your root directory, you should set up an account at Google Webmaster Tools. Here you can submit the sitemap.
  2. There are a few barricades that prevents spiders from reading the content of your site. Get rid of them. If your website is coded in flash or frames, it is hard for spiders to crawl your website. The spiders prefer languages as HTML or PHP. If spiders cannot crawl your website, they won’t be able to index it either and it will not appear in the SERPs
  3. Submit your site to social bookmarking platforms. A good way to get your website detected by search engines is to let them naturally find it. A way to let this happen is to submit your site to social bookmarking sites like Digg, Reddit, and Del.icio.us. Spiders generally visit these sites several times per day. If your site is listed on one or more of the bookmarking sites, chances are high that it will be found and indexed.
  4. Get a link pointing to your site from a website with high PageRank (PR). Getting a high PR backlink to your site certainly helps successful indexing and it is also possible to get good organic rankings on search engines. Directory submissions are one of my preferred ways to get links pointing to a website. Chose directories with high PR and submit your website to them. Some of the popular directories such as Yahoo need payment before you get included, which could be well worth the money.
  5. Write articles and submit to popular article directories. Article marketing is a popular way to get your site noticed by search engines, and it can also attract some traffic to your website. Write an interesting article and include a link in it pointing to your website. Then submit it to popular article directories as WebRaydian and ArticleCube. Spiders are known to visit article directories frequently and once they crawl your article, they will follow the link in it and find your website.

Getting your site crawled by search engine spiders is undeniably a necessity in order to have good rankings in the SERPs. Try some or all of the ideas above and get your site indexed quickly.

  • A New Day, A New SEOmoz
    Posted by randfishIt's been a wild few weeks at the mozplex. Today wrapped up the amazing mozinar with our half-day tools training just in time to launch the new version of SEOmoz. Should we slow down this crazy pace? Nah. If you're feeling a sense of deja vu, don't worry; it's perfectly normal. We're the same old moz, but with a new […]
  • Apple to Take on Google in Showing Immediate Search Results?
    About ten days ago, Rob Ousbey posted a video on his blog showing Google streaming updates to search results as he typed letters into a search box. As he typed out his query, not only did he see a dropdown of suggested queries, but the search results themselves actually changed as he added letters. […]
  • Advanced SEO Course in Dublin this coming July 7-8
    Apologies for my first post in many months being about an advanced SEO course I'm instructing. But if you're on the hunt for advanced SEO training then this may be for you. The course is running on July 7 & 8 in Dublin, and I'm hoping it will offer people some really good insight into applying advanced SEO techniques. Read on if this tickl […]
  • Compare Bing & Google Rankings | Bing SEO Month
    With the merger of Yahoo & Bing as far as search results are concerned (Bing will provide Yahoo with it’s search results in futue), I think it’s time I took Bing SEO more seriously. So in September I’m going to examine the differences and similarities of the two primary search engines, Google and Bing, with [...]If you're one of the hundreds of rece […]
  • SEO Hot Tub – 20th August 2010
    The SEO Hot Tub is not just a way for us to talk about the latest and most important search engine optimisation (SEO) articles, but also a way to share our SEO knowledge and client learning’s. Reading articles from other SEO sources not only keeps you updated with what is going on in the industry, but also drives you to … Read moreSEO Hot Tub – 20th August 2 […]
  • Google now indexes SVG
    Webmaster Level: AllYou can now use Google search to find SVG documents. SVG is an open, XML-based format for vector graphics with support for interactive elements. We’re big fans of open standards, and our mission is to organize the world’s information, so indexing SVG is a natural step.We index SVG content whether it is in a standalone file or embedded dir […]