rPython – R Interface to Python

a nice package rPython. http://cran.r-project.org/web/packages/rPython/index.html This package permits calls to Python from R
Not to be confused with Restricted Python (RPython at http://doc.pypy.org/en/latest/coding-guide.html#id1)

statcompute's avatarYet Another Blog in Statistical Computing

View original post

Game Review : Google Ingress

  1. Android Only Game
  2. Uses GIS or Google Maps API/ for geo-caching game
  3. Healthy for you- makes players walk from portals to another. You have to be within 40 m of a portal to recharge,capture of attack it.  Makes you really walk a lot.
  4. Addictive and Immersive with impressive follow up media story.
  5. Can be used as base template for other games , and social experimentation
  6. Uses Points, Badges, Leaderboard of gamification
  7. Encourages direct face to face social interaction
  8. Has in game chat facility
  9. Zero in game currency . So no coiners or cheaters here

http://media.tumblr.com/tumblr_meuh4lKkH61rax78x.png

Things I wish I could Classify — by better and easier Machine Learning

  1. Web Analytics- Which customers are likely to convert and didnt. Which customers are not likely to stay and do. More analytics added to Google Analytics like Web Analytics
  2. Web Analytics Time Series models- web analytics is TS data. More forecasts. Automated Error detection and correction in forecasts
  3. Data Cleaning and Quality- Something like Google Refine (or open refine https://github.com/OpenRefine ) added before every Machine Learning Classification system I see. or software I see.
  4. More API integration- for data from the web, to classification models to the web
  5. Financial Data – Better interfaces and easier analytics. Every Financial Data is basically adding to a classification – Buy Sell Hold.
  6. Sentimental Analysis for the People- Easier to integrate Blog Data (though GA api) and Social Media Data (twitter , google plus, facebook APIs) to give user analytics of his own reputation across multiple social networks.
  7. Dating Website Recommendation Systems

These are a few of my favorite things…that I wish I could classify

And some military spying alogirthms that I wish they de classify because everyone has them- so they can show better ads, or build better internet connected night vision Glasses

classified

Plyrmr- bringing #rstats Plyr to Map Reduce for Hadoop

Just saw this package, it is in testing early release now- Love the thought of Hadley’s Split Apply Combine Package being used for Map Reduce which is conceptually similar in many many ways. I do think though Revolution’s work in R and D needs to be applauded- given by the number of packages they have created- or funded  AND donated( seperate blog post on this?) while RStudio seems more content on building basic blocks for infrastructure , without an adequate Big Data solution for R Studio itself.

Of course usage stats on RevoScaleR , Revolution’s Big Data package are not as transparent or in line with Free as Beer and Free as Speech philosophy that RStudio breathes in.

https://github.com/RevolutionAnalytics/RHadoop/wiki/plyrmr

This R package enables the R user to perform common data manipulation operations, as found in popular packages such as plyr and reshape2, on very large data sets stored on Hadoop. Like rmr, it relies on Hadoop mapreduce to perform its tasks, but it provides a familiar plyr-like interface while hiding many of the mapreduce details. plyrmr provides:

  • Hadoop-capable versions of well known data.frame functions: transform, subset, mutate, summarize, melt, dcast and more from packages base, plyr and reshape2.
  • Simple but powerful ways of applying any function operating on data.frames to Hadoop data sets: do and magic.wand.
  • Simple but powerful ways of aggregating data: group, group.f, gather and ungroup.
  • All of the above can be combined by normal functional composition: delayed evaluation helps mitigating any performance penalty of doing so by minimizing the number of Hadoop jobs launched to evaluate an expression.
  • New data frame functions which are also Hadoop-capable that are more suitable for development than some of the above: select and where.

Algorithms are everywhere

What  is an algorithm anyway?

main-qimg-1f91f9a242623e7994e7484970581d83

As per Wikipedia- http://en.wikipedia.org/wiki/Algorithm

an algorithm  is a step-by-step procedure for calculations. Algorithms are used for calculation, data processing, and automated reasoning.

An algorithm is an effective method expressed as a finite list of well-defined instructions  for calculating a function.  Starting from an initial state and initial input (perhaps empty),  the instructions describe a computation that, when executed, proceeds through a finite  number of well-defined successive states, eventually producing “output” and terminating at a final ending state. The transition from one state to the next is not necessarily deterministic; some algorithms, known as randomized algorithms, incorporate random input

Where do I hear the word algorithm being used?  Or the wat er cooler version- algols

I hear it everywhere- in newspapers  especially GUARDIAN and NEW YORK TIMES  

From search to security: the five most important algorithms in tech

  1. Pagerank – how Google calculates search results
  2. Public key cryptography – keeping credit card data secure
  3. Correcting errors (in CDs)
  4. Protecting passwords (cryptographic hash function)
  5. Perlin noise: generating landscapes in games

In Presentations-

Screenshot from 2013-10-08 10:19:03

But Google NGrams thinks algorithms is flat in books

http://books.google.com/ngrams/graph?content=algorithms&year_start=1990&year_end=2000&corpus=15&smoothing=3&share=

Screenshot from 2013-10-08 10:28:37

and Google Trends think the word is actually declining. But India remains a top user of searching for algorithms Screenshot from 2013-10-08 10:27:03

But algorithms are increasing in ArXiv articles Screenshot from 2013-10-08 10:43:24

and there is a bit of up and down in Algorithms Jobs

What do you think- do you hear the word too much or too little?

Why a shutdown led US default could trigger The Third Opium War

What were  The Opium Wars?

http://en.wikipedia.org/wiki/Opium_Wars

The Opium Wars, also known as the Anglo-Chinese Wars, divided into the First Opium War from 1839 to 1842 and the Second Opium War from 1856 to 1860. These were the climax of disputes over trade and diplomatic relations between China under the Qing Dynasty and the British Empire.

The import of opium into China stood at 200 chests (annual) in 1729,[1] when the first anti-opium edict was promulgated.[2][3] This edict was weakly enforced,[3] and by the time Chinese authorities reissued the prohibition in starker terms in 1799,[4] the figure had leaped; 4,500 chests were imported in the year 1800.[1] The decade of the 1830s witnessed a rapid rise in opium trade,[5] and by 1838 (just before the first Opium War) it climbed to 40,000 chests.[1][5]

Considering that importation of opium into China had been virtually banned by Chinese law, the East India Company established an elaborate trading scheme partially relying on legal markets, and partially leveraging illicit ones. British merchants carrying no opium would buy tea in Canton on credit, and would balance their debts by selling opium at auction in Calcutta. From there, the opium would reach the Chinese coast hidden aboard British ships then smuggled into China by native merchants. In 1797 the company further tightened its grip on the opium trade by enforcing direct trade between opium farmers and the British, and ending the role of Bengali purchasing agents. British exports of opium to China grew from an estimated 15 tons in 1730 to 75 tons in 1773. The product was shipped in over two thousand chests, each containing 140 pounds (64 kg) of opium.[21]

and

British military superiority drew on newly applied technology. British warships wreaked havoc on coastal towns; the steam ship Nemesis was able to move against the winds and tides and support a gun platform with very heavy guns. In addition, the British troops were the first to be armed with modern muskets and cannons, which fired more rapidly and with greater accuracy than the Qing firearms and artillery, though Chinese cannons had been in use since previous dynasties. After the British took Canton, they sailed up the Yangtze and took the tax barges, a devastating blow to the Empire as it slashed the revenue of the imperial court in Beijing to just a fraction of what it had been.

and

Click to access RL34314.pdf

China’s Holdings of U.S. Securities: Implications for the U.S. Economy
Screenshot from 2013-10-08 07:52:20
Notice how Chinese purchases of US Treasury mirror the rise in Opium purchases.
A technical default by US due to internal politics can enhance conflict and stress between China
It offers a great opportunity for the US to virtually cancel the US debt into half, by going into conflict.
The window of opportunity for US military superiority over China is limited- within a decade China would no longer be a generation behind US Aircraft Carriers.
So the US might just make a huge profit because of the shutdown. Still think that Boehner is crazy?
ps- In 1858, about twenty years after the first Opium War, the annual import rose to 70,000 chests (4,480 tons), approximately equivalent to global production of opium for the decade surrounding the year 2000