17 November 2005 - 23:12Google Sitemap Large Log File Fix

Today I was asked to take a look at an error in the Google Sitemap Tool. The problem was when this Python script was run by Mike, he was getting an malloc error. After some quick searching of the code and some newsgroups, I narrowed the problem to a loop that loops through the log lines. This is NOT a Python error as some in the newsgroups have suggested. There is a simple fix by simply altering the loop to to process each line rather than loading the entire file into memory. If you’re just interested in the patch, it can be found here. Simple instructions can be found here. Read on for the detailed information.