Posts

Create a pdf data dictionary from a dataset

Here is some R code you can use to create a pdf data dictionary from a dataset. It's a quick and easy way to get an overview of a dataset. You need to have a latext program like MiKTeX installed to make it work.   You can see the sort of output it produces here . ####################################### # code to produce a pdf data dictionary of a dataset using sweave # # df: the data frame you want to create the data dictionary of # file_loc: the location where you want the resulting report stored # filename: the name you want the report to have # author: the name of the person who created the data dictionary # #######################################     data_dict <- function ( df , file_loc , file_name , author , num_lev = 2 ) { # initiate libraries library ( tools ) library ( ggplot2 ) library ( gplots ) library ( lattice ) library ( sqldf )   #Make some subsidary functions   # initial funtion to print without q...

Big Data from the Summit

Check out my new blog post on big data summit here http://blogs.teradata.com/anz/A-View-from-the-Summit–How-best-to-climb-the-Bi...

Teradata Universe

I will be presenting at TD Universe shortly - see http://www.teradatauniverse.com.au/default

Interested in Big Data?

Interested in Big Data? See my latest article in The Rust Report -    http://www.rustreport.com.au/issues/latestissue/big-data-big-opportunities/

My suggestions on how to improve the lot of indigenous Australians

If you'd like to read my suggestions on how to improve the lot of indigenous Australians, I have a new article just published in Policy Magazine.  See  http://www.cis.org.au/publications/policy-magazine  for details.

Final results in Don’t Get Kicked competition

I’ve finished 111 th out of 588 teams in the Don’t Get Kicked competition on Kaggle (top 20%). Not too bad I think. I used R on a standard laptop to make 27 submissions and obtained a Gini of 0.23975. The leaders took 119 submissions to get 0.26720.

Movin' on up

Now up in top 50 of " Don't Get Kicked " by using  Generalized Boosted Regression Models