Here are some data sets:

The UCI machine learning repository


Lots of sets such as medical surveys, stock exchange, car sales,  ham/spam and US census data.

Google data:


It also has tons of data. The only problem with it is that most of the interpretation is already done. However, someone could still combine several datasets to answer new questions.

Here are some cool examples of visualization techniques: