Bigger, Better, Webometrics

The good people at webometrics released an updated list of organisations in Janurary, and finally I’ve got round to writing a harvester for them: 23,000 Universities and other Higher Education establishments.

It’s fortunate that they only update their dataset bi-annually, as it seems to take almost 24 hours to chew its way through all the data!