R Modeling with huge data

Here is a training course by BI Vendor, Netezza which uses R analytical capabilties. Its using R in the customized appliances of Netezza.

Source-

http://www.netezza.com/userconference/pce.html#rmftfic

R Modeling for TwinFin i-Class

Objective
Learn how to use TwinFin i-Class for scaling up the R language.

Description
In this class, you’ll learn how to use R to create models using huge data and how to create R algorithms that exploit our asymmetric massively parallel (AMPP®) architecture. Netezza has seamlessly integrated with R to offload the heavy lifting of the computational processing on TwinFin i-Class. This results in higher performance and increased scalability for R. Sign up for this class to learn how to take advantage of TwinFin i-Class for your R modeling. Topics include:

  1. R CRAN package installation on TwinFin i-Class
  2. Creating models using R on TwinFin i-Class
  3. Creating R algorithms for TwinFin i-Class

Format
Hands-on classroom lecture, lab exercises, tour

Audience
Knowledgeable R users – modelers, analytic developers, data miners

Course Length
0.5 day: 12pm-4pm Wednesday, June 23 OR 8am-12pm Thursday, June 24 OR 1pm-5pm Thursday, June 24, 2010

Delivery
Enzee Universe 2010, Boston, MA

Student Prerequisites

  • Working knowledge of R and parallel computing
  • Have analytic, compute-intensive challenges
  • Understanding of data mining and analytics

Google: Prediction API and other cool stuff

Google just announced it’s tools Big Query and Prediction API for use with it’s new cloud storage device called Google Storage. With this the computing cycle seems to have come a full circle – from mainframe to desktop/servers to cloud. The Prediction API seems interesting but it, and the other services, are quite clearly dependent on market as well as developer enthusiasm. Me thinks, Google knows a thing or two about Big Data, and this one looks like a revenue positive product from Google ( unless they get REST less and let it languish like other great ideas-like Docs,Wave etc)

Also could be interesting is applications from both R, as well as SAS and SPSS to start using this remote data cloud/server farm 😉

With Storage,Querying and Prediction Analysis- Google is definitely in the Infrastructure as a Service business, but success with these services would be crucial to establish it’s name in the formidably lucrative business analytics and business intelligence fields.

http://code.google.com/apis/predict/

http://code.google.com/apis/bigquery/

http://code.google.com/apis/storage/

Social Media Analysis Toolkit

Here is a comprehensive set of tools I see across various social media channels. They include

  1. Video
  2. Blogs
  3. Newsletter
  4. Twitter
  5. Facebook
  6. Documents
  7. Website
  8. Search Engine (Marketing and Optimization)

Note the use of text mining for sentiment analysis is not covered here- though it can be included at a later date. In about five minutes know how to create a free online social media analysis toolkit for your communications.

How to read blogs in Indonesian and Chinese!

I just discovered the magic of Google Chrome’s Translate tool- it is a one  click operation. So if you want to read blogs in any other language, install Google chrome and tweak the settings accordingly- see below the top of the screenshot ( from the excellent Indonesian R Blog http://enciety.com/community/R/ also available on Twitter at @rcommunity )

Or else if you prefer you old browser you can go to http://translate.google.com/ and copy and paste. Good thing about the Chrome is – even if you dont have admin rights on the machine, it STill installs just fine- and it works faster!

Also see http://mp3.baidu.com/

What do you want to know in data analytics?

I will be posting video responses to the questions asked by you at (using Google Moderator)

http://www.google.com/moderator/#15/e=7217&t=7217.40

So ask and I willl compile the best questions and reply on.

All you want to know in data analytics- What do you want to know in data analytics?

Below-Screenshot of existing questions asked already-

How crowded is the neighborhood?

How crowded is India compared to the United States? Around 11 times. Thats based on number of person per square km.

How crowded is India compared to China? Around 2.5 times.

– Based on the following procedure-

  1. Data Sources – http://bit.ly/densityUN . With Pivotable tables, downloaded the CSV file.
  2. Creating a new spreadsheet in Google Docs, I copied and pasted data in the csv file
  3. Using Gadgets- I inserted the Gadget for Motion Chart which is based on Hans Rosling’s famous Gapminder Bubble Chart.

– Some Thoughts

It is not surprising that most immigration (legal and illegal) occurs from high population density countries with stretched resources to lower density countries with higher levels of living. Generally smaller sized countries like Japan, Singapore, Macau (china) have outlier densities as well.

– Also, the Adobe AIR desktop application by Gapminder is quite the best application for this as well. Speaking of which_ I hope other Linux application developers can learn from Adobe AIR’s way of graphics /data visualization.

Creating a Blog Aggregator for free

I discovered an increasing trend of Blog Aggregators ( Blog Lists have been around for a long time). Several sites come in this category- http://bigdatanews.com/ (which is a GreenPlum /AsterData sponsored site on Big Data) , http://mapreduce.org/ (which is a site on MapReduce that has an inbuilt blog aggregator but is more of a community website – I will explain the difference below) , http://www.r-bloggers.com/ (which is an excellent aggregation of 69 R Bloggers sites that is built by Tal and is currently not sponsored/independent) and http://smartdatacollective.com/ which is sponsored by Teradata and uses http://wordframe.com which is a paid software) and some others like http://www.biblogs.com/ (which is Adsense supported 🙂 ) and http://javablogs.com/Welcome.jspa (an aggregator on Java) (or even http://feministblogs.org/).

CMS Based Blog Aggregator

CMS Based Blog Aggregator/ Community Site

CMS Based Community Site with an inbuilt Blog Aggregator feed

I am noting blog aggregator as a distinct website that pulls in automated content from RSS feeds , may or maynot be moderated, and usually revolves around a certain domain or topic. It is slightly different from community websites which have Lists of Blogs as part of many other features, and boutique collection of blogs like http://www.b-eye-network.com/blogs/index.php

and Intelligent Enterprise ( http://intelligent-enterprise.informationweek.com/blog/index.jhtml) as they have selected authors and have more than Blogs as their featured content including News etc. Since community is a buzz word- many websites claim to be community websites while retaining the look and feel of a CMS- Blog Aggregator.

WordPress Enabled Blog Aggregator

Anyways, if you have a WordPress Installation- you can create a Blog Aggregator for free. Basically there is a wordpress-plugin called FeedWordPress http://wordpress.org/extend/plugins/feedwordpress/

Doing so you can simply addin as many RSS feeds as you like –

(see a screenshot below).

Of course – you can use Twitterfeed to create a Twitter Aggregator/ Fire Hose that simply pulls in Post Titles, and can link them using Facebook-LinkedIn-Twitter apps to your RSS feed of the aggregated website. 🙂

Building a website /content aggregator is just a few clicks away and free for anyone with a website and some passion for a topic. It is really free and painless 🙂