Skip to content
We Geek Out!

Website mashups using Yahoo! Pipes

hacksmapsmashups

screenshot from Yahoo PipesIn the same way that audio software enables DJs to remix music, combining several songs together to create a new one, modern web technologies allow programmers to mash-up data from websites with relative ease.

When I went looking for a map of ATM locations for my local credit union, I was disappointed to find only an HTML table with a bunch of addresses. Now, I can tell that those are all addresses, and if I were to copy & paste any of them into Google Maps, it would have no problem finding that location on the map. But getting all of them to show up on the same map? A little trickier.

Having recently read an article about mashing up websites with Yahoo Pipes, I decided to try it out for myself. Yahoo! pipes is kind of like sed/awk for RSS feeds, but better. It can read input from various standard web data formats like RSS and CSV. You can then slice and dice, filter, sort, and transform the data however you want by "piping" it through a sequence of widgets before finally spitting it out in another standard web data format.

Instead of relying on a standard data format as input, my Pipe uses the XPath Fetch Page widget to retrive the webpage containing the list of ATM locations mentioned above, and extract the relevant information. That data source widget produces a series of data items, one for each ATM location, but with all the data in a single HTML field. Once the data is extracted, I put it through several transformations, including a couple of regular expressions, to separate the name and location for each item, and finally run each street address through a geocoder which assigns latitude & longitude values to each item. This final location data is then outputted as a standard KML file format, which can be imported into a Google Map for easy viewing.

Austin Telco ATM locations - raw HTML page

Yahoo Pipe: Austin Telco ATM locations

Google Map of Austin Telco ATM locations

*UPDATE: 2012-08-27*

I found a more comprehensive list of Austin Credit Union ATM locations and created a similar Pipe/Map mashup for the whole list.

Data source: Alliance of Austin Credit Unions - ATM locations

Yahoo Pipe: Alliance of Austin Credit Unions - ATM locations (Travis county)

Google Map: Map of Austin Credit Union Alliance ATMs

← All posts