Well, I seem to have conquered the worm, with no new problems with it. I do still seem to be eating bandwidth though, and I’m not sure why – 0.9GB since yesterday tea-time compared with around 2.5GB for a whole month recently. So I’ve set robots.txt to prevent bots from looking for files that no longer exist (thereby creating an unwanted 404), although I can’t believe that that is the whole problem.
Thank goodness I checked my Hotmail and picked up on the warning from 34sp that I’d exceeded my bandwidth allowance, otherwise the bill would be spiralling out of control by now. There must be other people who haven’t checked their mail over the Christmas period who will be in for a shock when they next log in.
separating the wanted from the unwanted