Soon after I published this data, however, I was told by a number of people that the data would be more useful if presented in another format. At first I just started creating a bunch of command line python scripts that would suck in these csv files, and spit them out in different formats. I quickly realized that I could accumulate these scripts and create a quick and dirty web application.

Over a few train rides I created an application called DataIO, and today, I finally got a chance to upload it to Google App Engine. The application is pretty simple to interact with; instructions are located on its front page.

Currently the application can only transpose data and multiply the data set by a given factor. I hope to soon add a jsonp api that will make it trivial to convert a given data set into a format that plays nice with google charts and flot.

The code for this application is hosted at bitbucket.

Just for fun, here is some data from data.topplabs.org, sent through dataIO.

Operating Revenue (transposed and multiplied by 1000000):

http://www.dataio.org/data/f?transpose=true&multiplication_factor=1000000&multiplication_start_row=1

Total Receipts by Agency (transposed and returned in json):

http://www.dataio.org/data/Bt?format=json&transpose=true

Bridges and Tunnels Summary of Total Budgeted Debt Service (multiplied by 100 and returned in csv):

http://www.dataio.org/data/IM?multiplication_factor=100&multiplication_start_row=1&format=csv

I wrote a small python script that takes a wordpress export file and strips out information about categories and tags. It’s a pretty simple script, but I will share it anyway: script