I’m still unsure about what’s the best method to scrape Google to get these links. I feel like in the end I may be scraping too much to justify the results. I’m going to try something new when building the lists next week. This is all a learning experience right now. I still feel that I’m missing out on quite a few links. I could be wrong about that. I have nothing to prove one way or the other. I suppose that I could buy a current up to date list made by someone else. I could compare their results with mine. I don’t have the money for that now. I wouldn’t learn how they came up with the list. There wouldn’t be much to learn other than comparing numbers. I doubt that would help me make a better list in the long run.
Anyway, the new list can be downloaded here.