On my second day of bludering about high technology, I came across http://rgrossman.com/2009/05/17/running-r-on-amazons-ec2/ which describes how to run R on Amazon EC2.
I tried it out and have subsequently added some screenshots to this tutorial so as to help you run R. My intention of course was to run a R GUI preferable Revolution Enterprise on the Amazon EC 2- and crunch uhm a lot of data.
Now go through the steps as follows-
0) Logging onto Amazon Console
http://aws.amazon.com/ec2/
Note you need your Amazon Id (even the same id which you use for buying books).
Note we are into Amazon EC2 as shown by the upper tab. Click upper tab to get into the Amazon EC2
2) Choosing the right AMI-
On the left margin, you can click AMI -Images.
Now you can search for the image-
I chose Ubuntu images (linux images are cheaper) and opendata in the search as belows- I get two images.
You can choose whether you want 32 bit or 64 bit image. Thumb rule- 64 bit images are preferable for data intensive tasks.
Click on launch instance in the upper tab ( near the search feature)
2) A pop up comes up, which shows the 5 step process to launch your computing.
Choose the right compute instance- As the screenshot shows- there are various compute instances and they all are at different multiples of prices or compute units.
After choosing the compute instance of your choice (extra large is highlighted)- click on continue-
3) Instance Details-
I did not choose cloudburst monitoring as it has a extra charge- and I am just trying out things.So I simply clicked continue.
4) Add Tag Details- If you are running a lot of instances you need to create your own tags to help you manage them. Advisable if you are running many instances.
Since I am going to run just one- I clicked continue with adding just two things OS and Stats Package.
5) Create a key pair- A key pair is an added layer of encryption. Click on create new pair and name it (note the name will be handy in coming steps)
6)
After clicking and downloading the key pair- you come into security groups. Security groups is just a set of instructions to help keep your data transfer secure. So I created a new security group.
And I added some ways in security group to connect (like SSH using Port 22)
7) Last step- Review Details and Click Launch
8) On the Left margin click on instances ( you were in Images.>AMI earlier)
It will take some 3-5 minutes to launch an instance. You can see status as pending till then.
9) Pending instance as shown by yellow light-
10) Once the instance is running -it is shown by a green light.
Click on the check box, and on upper tab go to instance actions. Click on connect-
you see a popup with instructions like these-
Open the SSH client of your choice (e.g., PuTTY, terminal).
Locate your private key file, decisionstats2.pem
Use chmod to make sure your key file isn’t publicly viewable, ssh won’t work otherwise:
chmod 400 decisionstats.pem
Connect to your instance using instance’s public DNS [ec2-75-101-182-203.compute-1.amazonaws.com].
Example
Enter the following command line:
ssh -i decisionstats2.pem root@ec2-75-101-182-203.compute-1.amazonaws.com
IMPORTANT-
If you are choosing Ubuntu Terminal to connect- you need to change the word root from above to Ubuntu above.
12) To launch R, just type R at the terminal
If all goes well you should be able to see this-
choose to install any custom packages (like
install.packages(‘doSNOW’)
work on R using command line
13) IMPORTANT- After doing your R work, please CLOSE your instance (
Go to LEFT Margin-Instances-Check the check box of instance you are running- on upper tab- Instance Actions- Click Terminate.
Note there are other Amazon Machine Images as well which have R- I found this as well-
Amazon EC2 Ubuntu 8.10 intrepid AMI built by Eric Hammond; Eduardo Leoni added R, many R packages, JAGS, mysql-client and subversion.
| Submitted By: |
Eduardo L Leoni |
| US East AMI ID: |
ami-1b9b7c72 |
| AMI Manifest: |
PolMethImages/imageR64.manifest.xml |
| License: |
Public |
| Operating System: |
Linux/Uni
|
2) You can install Revolution R on 32 bit Ubuntu using sudo apt install revolution-r
Various versions of Revolution R are supported on different versions of Linux
I may be willing to try Red Hat Enterprise Linux on the ec2 with 64 bit AND Revolution Enterprise to see the maximum juice I can get. or you can try it using an image below- It would be interesting if there could be an Amazon Machine Image for that (paid-public and private-academic)
| AMI ID: ami-8ba347e2 |
| Name:– |
| Description:– |
| Source:redhat-cloud/RHEL-5-Server/5.2/x86_64/Beta-2.6.18-92.1.1/RHEL5.2-Server-x86_64-Beta-2.6.18-92.1.1.manifest.xml |
| Owner:432018295444 |
Visibility:Public |
Product Code:54DBF944 |
| State:available |
Kernel ID:aki-89a347e0 |
RAM Disk ID:ari-88a347e1 |
| Image Type:machine |
Architecture:x86_64 |
Platform:Red Hat |
| Root Device Type:instance-store |
Root Device:– |
Image Size:0 bytes |
| Block Devices:N/A – Instance Store |
| Virtualization:paravirtual |
|
3) My ultimate goal is to run a parallel session using all cores on an EC2 instance and a R GUI (like R Commander or Rattle)
4) For sake of running a test- I re did the parallel test I did on my 2 core laptop
but using 68.4 gb Memory and 8 cores (26 Compute Units brrr)
> check <-function(n) {
+ for(i in 1:1000)
+ {
+ sme <- matrix(rnorm(100), 10,10)
+ solve(sme)
+ }
+ }
>
> times <- 100
> system.time(for(j in 1:times ) x <- check(j))
user system elapsed
20.51 0.00 20.66
5) For some reason on Ubuntu 64 bit Amazon image -I cant get Revolution R (even after using sudo apt) , and I am still learning how I can try and get Enterprise Edition fired up on a 64 bit Red Hat Enterprise Linux Amazon AMI (and maybe create an all new Machine Image 😉
Also it prevents me from loogin onto as root, and asks me to login as ubuntu@amazon…. I also wanted to try logging into using my Windows session but kept shuttling between my VM Player Ubuntu session and Windows
7) Hope this was useful. I am thankful to tips from Revolution Blog, R Grossman’s Blog, Creators of the Open Data AMI, Tal’s R Statistics Blog and Cerebral Mastication blog on this
35.965000
-83.920000
It automatically loads packages that you use regularly (like a R GUI -Deducer, Rattle or R Commander), set a CRAN mirror that you mostly use or is nearest for downloading new packages, and set some optional parameters.
DECISION STATS 
