Category: Analytics

Comparing PIG with Hive SQL

In PIG

a = LOAD 'nyse' USING org.apache.hcatalog.pig.HCatLoader();
b = FILTER a BY stock_symbol =='IBM' ;
c = group b all;
d = foreach c generate AVG(b.stock_volume);
dump d;

In SQL (Hive)

select AVG(stock_volume) from nyse where stock_symbol =="IBM"

(from HDP 2.0 Horton Sandbox Example)

Also see

http://www.quora.com/How-can-R-and-Hadoop-be-used-together

 

Installing Scala on CentOS

Scala files are now here http://www.scala-lang.org/files/archive/


wget http://www.scala-lang.org/files/archive/scala-2.10.1.tgz
tar xvf scala-2.10.1.tgz
sudo mv scala-2.10.1 /usr/lib
sudo ln -s /usr/lib/scala-2.10.1 /usr/lib/scala
export PATH=$PATH:/usr/lib/scala/bin
scala -version

 

Writing for kdnuggets.com

I have been writing freelance for kdnuggets.com

Its a great learning for me to be a better writer especially for analytics and programming

These are a list of articles -interviews are in bold and I will keep updating this list when there are new additions

  1. Interview: Ingo Mierswa, RapidMiner CEO on “Predaction” and Key Turning Points June 2014

  2. Guide to Data Science Cheat Sheets 2014/05/12

  3. Book Review: Data Just Right 2014/04/03
  4. Exclusive Interview: Richard Socher, founder of etcML, Easy Text Classification Startup 2014/03/31
  5. Trifacta – Tackling Data Wrangling with Automation and Machine Learning 2014/03/17
  6. Paxata automates Data Preparation for Big Data Analytics 2014/03/07
  7. etcML Promises to Make Text Classification Easy  2014/03/05
  8. Wolfram Breakthrough Knowledge-based Programming Language – what it means for Data Science? 2014/03/02

New Delhi R Meetup March 2014

We had a nice , small and slightly quirky Meetup this weekend in New Delhi. Apart from the weekend traffic that ensured almost everyone was late, and a cieling that started dripping with water – we were in Cafe Coffee Day,CP it was enjoyable meeting with the mix of people present including students, people moving away from SAS, IT people who are R curious- who mostly form the backbone of R Meetups here in New Delhi

I presented on

1) R basics including R Commander

2) Hadoop basics including Hortworks Sandbox

3) Tableau Public basics for visualization

4) Slides from my talk last week of Cloud Computing

Overall with 239 Users, this is growing to be a critical and large piece in the traditionally outsourcing hub of NCR, India. With thousands of SAS license users and programmers in Gurgaon and Noida, we hope we can make a difference in promoting open source awareness.

Screenshot 2014-03-31 14.54.45

Windows 7 Error : Verify that the file exists and that you can access it

This error basically means that the SYSTEM user is not able to execute the file (a .msi installer) in that folder.

Right Click and Change the Security Settings to add SYSTEM

Step 0

Right Click to go to Folder Properties Screenshot 2014-03-26 00.27.50

 

 

 

Step 1 Navigate to Security per0

 

 

 

Step 2 Add System per1

 

Packt gives Buy one , get one free offer on 2000th title release

Got a message from Packt Publishing-

—

Packt Publishing have launched an exciting campaign to coincide with the release of 2000th title. During this offer they are giving all our customers a chance to enjoy our books by giving them a free e-book copy for every purchase – “Buy One, Get One Free”

The campaign began on 18th-Mar-2014 and will continue up until 26th-Mar-2014. Following are the benefits readers can avail during this campaign.

  •     Unlimited purchases during the offer period
  •     Offer is automatically applied at checkout

Interested in free e books , here you go- http://bit.ly/1j26nPN

—

Packt Publishing seems an interesting phenomenon in the traditionally slow to change world of book publishing!