Digital Reflow
Work with us

Going gaga over Google

By Duncan Hewitt on February 20, 2015

Whenever we have a meeting with a new client or potential client what do you think is the first question we are asked? You got it, “How do I get to the top of Google?” SEO is now so binary, it is either success or failure, top of Google or not and that is the difference between a good reference and a bad one. 

Yes, being top of Google is hugely important for business visibility, building trust with potential customers and generally making your business look awesome. The difficulty is you have two choices, stump up a mega sum of cash that will propel you to the top of the pile or put your thinking cap on, get creative and crawl your way to the peak. 

Let’s start with a little background on the superpower conglomerate that is Google. Google has been scouring the web for our heart’s desires since 1998 and has the largest database of indexed websites, two times more than competitors Yahoo and Bing. 

To explain what an indexed website is.....When you type in your search into Google, whether it be ‘Best dye to use to dye ginger hair’ or ‘What do I do when fire comes out of my genitalia?’ you’re not actually searching the web. Instead, you’re searching Google’s index of the web. The Google index is a long list of all the pages Google has crawled and cached. When someone performs a search, Google pulls out pages from this data and shows them on your screen. Sound simple? Most great ideas are. Over the years Google has grown and evolved, now boasting over 40 billion indexed web pages. In comparison, poor old Bing has a lowly 14 billion. 

The scary thing for you folks is that less than 10% of the entire World Wide Web is indexed. The “Invisible web” is yet to be touched. In order for Google to index your site, it uses programs called ‘Spiders’. Get it? know the score. Those Google fellas aren’t half witty over there in San Francisco. Spider programs are specifically designed to browse the web like people, moving from page to page, link to link trying to find and index every single page on the web. What’s the process called? Crawling. Crawls can happen several times a day or once in six months. 

At Digital Reflow we aren’t known for giving out free advice but a nifty tip for optimising your site – update and change your content on a regular basis and Google will crawl your site more often. It is that simple! 7 most common reasons Google can’t crawl your pages 

  • No or incorrectly configured robots.txtfile
  • A badly configured “.htaccess” file
  • Badly written title, meta tags and author tags
  • Incorrectly configuring URL parameters
  • Low PageRank
  • Connectivity or DNS issues
  • Domain with a bad history
  • If those seven points make as much sense to you like a soup sandwich then that is where we come in. Want to know more? 

Get in touch. Want to know how to help Google crawl more pages? You’ve had enough free advice out of us for one day, get in touch.