ScraperWiki

I found this cool service call ScraperWiki.  It allows you to write python, ruby or php scraper as well as a view.  You can make the data public so others can view or private.  You can also make a view for your data!  So I think this is awesome!!!  I think for my Adv. AI class I think we could either use someone else’s data or make a scraper and mine our own data.

I also found Gravatar.  Cool service that allows its users to upload an avatar so that whenever they post to a site that uses Gravatar, their avatar will be used!  Really cool.  The cool part is that you can get the avatar image based on a hash of the user’s email address!  So maybe I could make an email address scraper and use that data to collect users Gravatar images and profiles!  Really crazy all the info that users can put into their profile.  Or I could maybe scrape for gravatar email hashes…  Then directly get the user’s profile…

Not sure what I could do with that data though…  Maybe try and find faces in the gravatar since their avatar may be their face.  This could be useful if I can’t get access to their profile.  Since then I could try and find them on facebook, twitter, etc..

I’ll have to get to you on what it would be good for…  Sounds super creepy though that this could be done.

One thought on “ScraperWiki

Comments are closed.