I changed how I scrape Google this time to make the list. I only scraped for the past 24 hours. This produced a much smaller list. I talked to one of my visitors a few weeks ago and they said the list was too big to use manually. I know that some of you are trying to manually post to auto approve blogs. My normal lists are far too big for this.
I’m not sure if I’ll keep scraping the past 24 hours and using the links to build my list. I can probably churn out a list every day doing this. It takes well over a week to build a list otherwise. I suppose I could do both. Maybe once a month compile a big list and every day try to get the newest links. I haven’t decided how I’ll do it.
My goal is to build a list that is an effective tool. It may be more useful to have just those sites that were active in the past 24 hours. I can see how an argument could be made for this. I don’t know if there’s more SEO benefit from posting to just the new links as opposed to a whole big list. I suppose we’ll figure this out along the way. You don’t know how something works until you test it out. I by no means claim to be an expert on how these links work. I’m learning right along side many of you.
Download today’s list here.