As part of my research for Python for R Users: A Data Science Approach (Wiley 2016) Here is an interview with Scott Draves, awesome software artist and developer at Beaker Notebook. Beaker Notebook allows you to use multiple languages together in same interface seamlessly ( like Python, R, JS , Scala)
Scott Draves (S) – Two Sigma uses a variety of tools. Some have been developed internally over many years, some are open source like Linux, Java, R, and IPython, and some are commercial such as MATLAB and Excel. Beaker is inspired by all these systems, and many more. It’s a new synthesis on new infrastructure. The design favors ease of use and high quality. Beaker is about working automatically with one click, and also having total programmability.
Jupyter (which was called IPython when we started) is definitely one of our inspirations. If fact Beaker is compatible with it and when you run Python in Beaker, it’s talking to your existing IPython backend. Beaker uses nginx as a reverse proxy to make a collection of backends (one for each language, plus Beaker‘s core server) appear as a single application.
Our roadmap is published on the wiki: https://github.com/twosigma/beaker-notebook/wiki/Roadmap
S- Beaker‘s autotranslation is simpler because it focuses on the data. That means your R and Python code co-exist in independent cells, each in its native syntax, but they can communicate via the Beaker object that is reflected to exist in all languages. By contrast with rpy2, you access R through a Python syntax. For example instead of
in Beaker you can just say
As for auto.arima, let me first note that by coincidence, the #1 google hit for [auto.arima] is a web site that uses a Flame as its banner, ie was made with an algorithm and I open sourced in the early 90s (see below).
AO- Which industries or businesses would most benefit from ability to use Python, R, JS, Scala etc in same notebook
S- The long version: my journey started at Brown University developing fnord a generative GUI and language for mathematical research and teaching, especially calculus and differential geometry. Think curves and surfaces in 3D with sliders. I was also working atIRIS, then I worked for Andries Van Dam in his graphics group and for Thomas Banchoff in the Math dept. Back in 1988-1990 there was a phenomenal network of people to collaborate with and learn from. That’s when I became interested in Open Source, initially through the Emacs text editor and LISP UI, which was the first project that I ever contributed back to.
I did my PhD research at CMU SCS, CS Dept. Early on I had some fortuitous internships, one at SGI working on IRIS Explorer and the other in Tokyo at NTT-Data. It was there, on an unused supercomputer, I generated the first Flames, what became the first Open Source artwork. Later back in Pittsburgh I developed Bomb, an “interactive visual musical instrument” that got me into making projection installations and eventually VJing. I was very lucky to have Peter Lee as my teacher and adviser, he helped me find my voice and also gave me plenty of rope.
My research at CMU culminated in a thesis on Meta-programing for media processing, ie using compilers and types to build low-latency, high-bandwidth systems that are still flexible and allow dynamic experimentation. The thesis document was generated by a markup language implemented in Scheme that compiled and ran my research code, measured its performance results, and generated the graphs, and could generate LaTeX for typesetting, or HTML for the web. That was published in 1997, all open source.
I graduated and went to San Francisco, and worked at Transmeta along with Linus Torvalds on a virtual microprocessor and another startup doing internet streaming media infrastructure (now it was 1999). It was this startup/tech environment of the Bay Area, including Burning Man and the VJ scene that gave birth to the Electric Sheep. It’s been evolving ever since.
Beaker is a notebook-style development environment for working interactively with large and complex datasets. Its plugin-based architecture allows you to switch between languages
- Comparing data mining algorithms in R packages and Python packages for same data(see slides 28 onwards on http://www.slideshare.net/ajayohri/python-for-r-users
- Polyglots for Data Science- most viewed tweet on KDNuggets.com in October 2013 http://www.kdnuggets.com/2013/10/top-tweets-oct7-8.html
- Is there anything like RStudio for Python from http://blog.dominodatalab.com/interactive-data-science/
a Docker container with Beaker and all supported languages built right in . There are experimental Electron versions of Beaker that work like native applications with regular windows and menus instead of running inside a web browser.