Zementis partners with R Analytics Vendor- Revo

Logo for R
Image via Wikipedia

Just got a  PR email from Michael Zeller,CEO , Zementis annoucing Zementis (ADAPA) and Revolution  Analytics just partnered up.

Is this something substantial or just time-sharing http://bi.cbronline.com/news/sas-ceo-says-cep-open-source-and-cloud-bi-have-limited-appeal or a Barney Partnership (http://www.dbms2.com/2008/05/08/database-blades-are-not-what-they-used-to-be/)

Summary- Thats cloud computing scoring of models on EC2 (Zementis) partnering with the actual modeling software in R (Revolution Analytics RevoDeployR)

See previous interviews with both Dr Zeller at https://decisionstats.com/2009/02/03/interview-michael-zeller-ceozementis/ ,https://decisionstats.com/2009/05/07/interview-ron-ramos-zementis/ and https://decisionstats.com/2009/10/05/interview-michael-zellerceo-zementis-on-pmml/)

and Revolution guys at https://decisionstats.com/2010/08/03/q-a-with-david-smith-revolution-analytics/

and https://decisionstats.com/2009/05/29/interview-david-smith-revolution-computing/

strategic partnership with Revolution Analytics, the leading commercial provider of software and support for the popular open source R statistics language. With this partnership, predictive models developed on Revolution R Enterprise are now accessible for real-time scoring through the ADAPA Decisioning Engine by Zementis. 

ADAPA is an extremely fast and scalable predictive platform. Models deployed in ADAPA are automatically available for execution in real-time and batch-mode as Web Services. ADAPA allows Revolution R Enterprise to leverage the Predictive Model Markup Language (PMML) for better decision management. With PMML, models built in R can be used in a wide variety of real-world scenarios without requiring laborious or expensive proprietary processes to convert them into applications capable of running on an execution system.

partnership

“By partnering with Zementis, Revolution Analytics is building an end-to-end solution for moving enterprise-level predictive R models into the execution environment,” said Jeff Erhardt, Revolution Analytics Chief Operation Officer. “With Zementis, we are eliminating the need to take R applications apart and recode, retest and redeploy them in order to obtain desirable results.”

 

Got demo? 

Yes, we do! Revolution Analytics and Zementis have put together a demo which combines the building of models in R with automatic deployment and execution in ADAPA. It uses Revolution Analytics’ RevoDeployR, a new Web Services framework that allows for data analysts working in R to publish R scripts to a server-based installation of Revolution R Enterprise.

Action Items:

  1. Try our INTERACTIVE DEMO
  2. DOWNLOAD the white paper
  3. Try the ADAPA FREE TRIAL

RevoDeployR & ADAPA allow for real-time analysis and predictions from R to be effectively used by existing Excel spreadsheets, BI dashboards and Web-based applications, all in real-time.

RevoADAPAPredictive analytics with RevoDeployR from Revolution Analytics and ADAPA from Zementis put model building and real-time scoring into a league of their own. Seriously!

Pentaho and R: working together

open_source_communism
Image by jagelado via Flickr

I interview Pentaho Co-founder here at https://decisionstats.com/2010/11/14/pentaho/

and recently became aware of the R Pentaho integration.

“R” is a popular open source statistical and analytical language that academics and commercial organizations alike have used for years to get maximum insight out of information using advanced analytic techniques. In this twelve-minute video, David Reinke from Pentaho Certified Partner OpenBI provides an overview of R, as well as a demonstration of integration between R and Pentaho.

http://www.pentaho.com/products/demos/r_project_with_pentaho/

or http://www.pentaho.com/products/demos/showNtell.php

Related-

M.S. in Applied Statistics

http://www.information-management.com/blogs/analytics_business_intelligence_BI_statistics-10019474-1.html

R and BI – Integrating R with Open Source BusinessIntelligence Platforms Pentaho and Jaspersoft

http://www.r-project.org/conferences/useR-2010/abstracts/Reinke+Miller.pdf

Web development with R

http://www.r-project.org/conferences/useR-2010/slides/Ooms.pdf

In-database analytics with R

http://www.r-project.org/conferences/useR-2010/slides/Hess+Chambers_1.pdf

R role in Business Intelligence Software Architecture

http://www.r-project.org/conferences/useR-2010/slides/Colombo+Ronzoni+Fontana.pdf

Open Source Compiler for SAS language/ GNU -DAP

A Bold GNU Head
Image via Wikipedia

I am still testing this out.

But if you know bit more about make and .compile in Ubuntu check out

http://www.gnu.org/software/dap/

I loved the humorous introduction

Dap is a small statistics and graphics package based on C. Version 3.0 and later of Dap can read SBS programs (based on the utterly famous, industry standard statistics system with similar initials – you know the one I mean)! The user wishing to perform basic statistical analyses is now freed from learning and using C syntax for straightforward tasks, while retaining access to the C-style graphics and statistics features provided by the original implementation. Dap provides core methods of data management, analysis, and graphics that are commonly used in statistical consulting practice (univariate statistics, correlations and regression, ANOVA, categorical data analysis, logistic regression, and nonparametric analyses).

Anyone familiar with the basic syntax of C programs can learn to use the C-style features of Dap quickly and easily from the manual and the examples contained in it; advanced features of C are not necessary, although they are available. (The manual contains a brief introduction to the C syntax needed for Dap.) Because Dap processes files one line at a time, rather than reading entire files into memory, it can be, and has been, used on data sets that have very many lines and/or very many variables.

I wrote Dap to use in my statistical consulting practice because the aforementioned utterly famous, industry standard statistics system is (or at least was) not available on GNU/Linux and costs a bundle every year under a lease arrangement. And now you can run programs written for that system directly on Dap! I was generally happy with that system, except for the graphics, which are all but impossible to use,  but there were a number of clumsy constructs left over from its ancient origins.

http://www.gnu.org/software/dap/#Sample output

  • Unbalanced ANOVA
  • Crossed, nested ANOVA
  • Random model, unbalanced
  • Mixed model, balanced
  • Mixed model, unbalanced
  • Split plot
  • Latin square
  • Missing treatment combinations
  • Linear regression
  • Linear regression, model building
  • Ordinal cross-classification
  • Stratified 2×2 tables
  • Loglinear models
  • Logit  model for linear-by-linear association
  • Logistic regression
  • Copyright © 2001, 2002, 2003, 2004 Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA

    sounds too good to be true- GNU /DAP joins WPS workbench and Dulles Open’s Carolina as the third SAS language compiler (besides the now defunct BASS software) see http://en.wikipedia.org/wiki/SAS_language#Controversy

     

    Also see http://en.wikipedia.org/wiki/DAP_(software)

    Dap was written to be a free replacement for SAS, but users are assumed to have a basic familiarity with the C programming language in order to permit greater flexibility. Unlike R it has been designed to be used on large data sets.

    It has been designed so as to cope with very large data sets; even when the size of the data exceeds the size of the computer’s memory

    WPS Version 2.5.1 Released – can still run SAS language/data and R

    However this is what Phil Rack the reseller is quoting on http://www.minequest.com/Pricing.html

    Windows Desktop Price: $884 on 32-bit Windows and $1,149 on 64-bit Windows.

    The Bridge to R is available on the Windows platforms and is available for free to customers who
    license WPS through MineQuest,LLC. Companies and organizations outside of North America
    may purchase a license for the Bridge to R which starts at $199 per desktop or $599 per server

    Windows Server Price: $1,903 per logical CPU for 32-bit and $2,474 for 64-bit.

    Note that Linux server versions are available but do not yet support the Eclipse IDE and are
    command line only

    WPS sure seems going well-but their pricing is no longer fixed and on the home website, you gotta fill a form. Ditt0 for the 30 day free evaluation

    http://www.teamwpc.co.uk/products/wps/modules/core

    Data File Formats

    The table below provides a summary of data formats presently supported by the WPS Core module.

    Data File Format Un-Compressed
    Data
    Compressed
    Data
    Read Write Read Write
    SD2 (SAS version 6 data set)
    SAS7BDAT (SAS version 7 data set)
    SAS7BDAT (SAS version 8 data set)
    SAS7BDAT (SAS version 9 data set)
    SASSEQ (SAS version 8/9 sequential file)
    V8SEQ (SAS version 8 sequential file)
    V9SEQ (SAS version 9 sequential file)
    WPD (WPS native data set)
    WPDSEQ (WPS native sequential file)
    XPORT (transport format)

    Additional access to EXCEL, SPSS and dBASE files is supported by utilising the WPS Engine for DB Filesmodule.

    and they have a new product release on Valentine Day 2011 (oh these Europeans!)

    From the press release at http://www.teamwpc.co.uk/press/wps2_5_1_released

    WPS Version 2.5.1 Released 

    New language support, new data engines, larger datasets, improved scalability

    LONDON, UK – 14 February 2011 – World Programming today released version 2.5.1 of their WPS software for workstations, servers and mainframes.

    WPS is a competitively priced, high performance, highly scalable data processing and analytics software product that allows users to execute programs written in the language of SAS. WPS is supported on a wide variety of hardware and operating system platforms and can connect to and work with many types of data with ease. The WPS user interface (Workbench) is frequently praised for its ease of use and flexibility, with the option to include numerous third-party extensions.

    This latest version of the software has the ability to manipulate even greater volumes of data, removing the previous 2^31 (2 billion) limit on number of observations.

    Complimenting extended data processing capabilities, World Programming has worked hard to boost the performance, scalability and reliability of the WPS software to give users the confidence they need to run heavy workloads whilst delivering maximum value from available computer power.

    WPS version 2.5.1 offers additional flexibility with the release of two new data engines for accessing Greenplum and SAND databases. WPS now comes with eleven data engines and can access a huge range of commonly used and industry-standard file-formats and databases.

    Support in WPS for the language of SAS continues to expand with more statistical procedures, data step functions, graphing controls and many other language items and options.

    WPS version 2.5.1 is available as a free upgrade to all licensed users of WPS.

    Summary of Main New Features:

    • Supporting Even Larger Datasets
      WPS is now able to process very large data sets by lifting completely the previous size limit of 2^31 observations.
    • Performance and Scalability Boosted
      Performance and scalability improvements across the board combine to ensure even the most demanding large and concurrent workloads are processed efficiently and reliably.
    • More Language Support
      WPS 2.5.1 continues the expansion of it’s language support with over 70 new language items, including new Procedures, Data Step functions and many other language items and options.
    • Statistical Analysis
      The procedure support in WPS Statistics has been expanded to include PROC CLUSTER and PROC TREE.
    • Graphical Output
      The graphical output from WPS Graphing has been expanded to accommodate more configurable graphics.
    • Hash Tables
      Support is now provided for hash tables.
    • Greenplum®
      A new WPS Engine for Greenplum provides dedicated support for accessing the Greenplum database.
    • SAND®
      A new WPS Engine for SAND provides dedicated support for accessing the SAND database.
    • Oracle®
      Bulk loading support now available in the WPS Engine for Oracle.
    • SQL Server®
      To enhance existing SQL Server database access, a new SQLSERVR (please note spelling) facility in the ODBC engine.

    More Information:

    Existing Users should visit www.teamwpc.co.uk/support/wps/release where you can download a readme file containing more information about all the new features and fixes in WPS 2.5.1.

    New Users should visit www.teamwpc.co.uk/products/wps where you can explore in more detail all the features available in WPS or request a free evaluation.

    and from http://www.teamwpc.co.uk/products/wps/data it seems they are going on the BIG DATA submarine as well-

    Data Support 

    Extremely Large Data Size Handling

    WPS is now able to handle extremely large data sets now that the previous limit of 2^31 observations has been lifted.

    Access Standard Databases

    Use I/O Features in WPS Core

    • CLIPBOARD (Windows only)
    • DDE (Windows only)
    • EMAIL (via SMTP or MAPI)
    • FTP
    • HTTP
    • PIPE (Windows and UNIX only)
    • SOCKET
    • STDIO
    • URL

    Use Standard Data File Formats

    Viva Libre Office

    WordPerfect 5.1 for DOS.
    Image via Wikipedia

    The Document Foundation is happy to announce the release candidate of
    LibreOffice 3.3.1. This release candidate is the first in a series of
    frequent bugfix releases on top of our LibreOffice 3.3 product. Please
    be aware that LibreOffice 3.3.1 RC1 is not yet ready for production
    use, you should continue to use LibreOffice for that.

    http://listarchives.documentfoundation.org/www/announce/msg00028.html

    Following is the list of changes against LibreOffice 3.3:

    Key changes at a glance:

    * Numerous translation updates
    * new mimetype icons for LibreOffice – explained here:
    http://luxate.blogspot.com/2011/01/not-even-included-but-already-improved.html
    * quite a few crasher fixes

    Detailed change log:

    * translation updates
    * Removed old/unmaintained icon themes
    * Fix for https://bugzilla.novell.com/show_bug.cgi?id=664516: Don’t
    use a reference or the default formula string will be changed
    * Install bash completion for oo* wrappers when enabled
    (https://bugzilla.novell.com/show_bug.cgi?id=665402)
    * Build fix: get the stlport compat workaround working for gcc 4.6.0
    * Build fix: no ddraw.h or ddraw.lib in the June 2010 DirectX SDK,
    removed usage
    * Windows installer: padded nologobanner.bmp, new size is 102×58
    * removed gd – Gaelic, ky – Kirghiz, pap – Papiamento, ti – Tigrinya,
    ms – Malay, ps – Pashto, ur – Urdu. UI localization does not exist
    in these languages. So it makes no sense to ship packages.
    * Build fix: pass thru PYTHON, found by configure. Will be used by
    filter/source/config/fragments/makefile.mk.
    * Upgraded libwpd (WordPerfect filter) to 0.9.1
    * Fixed BrOffice Windows start menu branding
    * Removed language code ‘kid’. kid is not Koshin, but key id pseudo
    language which is good for debugging UI but should no be included
    in the product
    * Added ca_XV and ast language/local name and description
    * Fixed incorrect page number in page preview mode
    (https://bugs.freedesktop.org/show_bug.cgi?id=33155). When the
    window is large enough to show several ‘Page X’ strings,
    the page number was not properly incremented.
    * Fixed incorrect import of cell attributes from Excel
    documents. When a cell with non-default formatting attribute starts
    with non-first row in a column, the filter would incorrectly apply
    the same format to all the cells above it if they didn’t have any
    formats.
    * Ubuntu: fix for lp#696527 – enable human icon theme in LibreOffice
    * Fix for https://bugzilla.redhat.com/show_bug.cgi?id=673819 crash on
    changing position of drawing object in header.
    * Changed OpenOffice.org to LibreOffice in nsplugin
    * Added Occitan dictionary
    * Added Ukrainian dictionaries
    * Fix window focus for langpack installation on Mac –
    https://bugs.freedesktop.org/show_bug.cgi?id=33056
    * Added/modified NLPsolver translations from Pootle
    * Fix for https://bugzilla.novell.com/show_bug.cgi?id=655763
    * Fix for RTF export crasher
    (https://bugzilla.novell.com/show_bug.cgi?id=656503)
    * Use LibreOffice as product name for EPS Creator header
    * Parse svg ‘color’ property (fixes
    https://bugs.freedesktop.org/show_bug.cgi?id=33551)
    * Use double instead of float in writerfilter import
    * Build fix: use PYTHON as passed through by set_soenv.in.
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33237 remove
    debug line
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33237 – fixes
    ole object import for writer (docx)
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33249
    rename OOo -> LibO on Getting Support Page
    * Fix ooxml import: handle css::table::BorderLine in addition to
    css::table::BorderLine2 That means that table cell properties are
    correctly set on import again.
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33258
    wikihelp: Improve the check for existence of the localized help.
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33994 – fixes
    several crashes around config UNO API
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=30879
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=32872
    Implementation names weren’t matching with xcu.
    * Fix: don’t pushback and process a corrupt extension
    * Fix: wikihelp – do not check for existence of the localized
    help. In case we do not have the help installed, it is up to the
    online service to decide the fallback in case a language version is
    not available.
    * Fix README: change su urpmi to sudo urpmi for Mandriva section
    * Fix README formatting –
    https://bugs.freedesktop.org/show_bug.cgi?id=32741 – using CRLF
    instead of LF on WIN platform
    * Fix README: word wrap at column 75 for better readability
    * Build fix: KDE3 library search order
    (https://bugs.freedesktop.org/show_bug.cgi?id=32797). Use LINKFLAGS
    instead of STDLIBS.
    * Start using technical.dic instead of oracle.dic
    (https://bugs.freedesktop.org/show_bug.cgi?id=31798)
    * Build fix: add explicit QRegion* for clipRegion to fix compile of
    kde backend
    * Cleanup: removed obsolete m_bSingleAltPress
    * Remove the menu when Left Alt Key was pressed for GTK
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33459: use
    year of era in long format for zh_TW by default
    * Fix wrong collation for Catalan language
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=31271 wrong
    line break with “(”
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=32561 – crash
    when iterating over the database types.
    * Default currency for Estonia should be Euro – fixes
    https://bugs.freedesktop.org/show_bug.cgi?id=33160
    * Avoid a pointless GetHelpText() call in the toolbox. Fixes
    https://bugs.freedesktop.org/show_bug.cgi?id=33315. GetHelpText()
    can be quite heavy, see
    https://bugs.freedesktop.org/show_bug.cgi?id=33088.
    * Paint toolbar handle positioned properly
    (https://bugs.freedesktop.org/show_bug.cgi?id=32558)
    * Build fix: move cxxabi.h after stl headers to workaround gcc 4.6.0
    and stlport
    * Fix for https://bugs.freedesktop.org/show_bug.cgi?id=33355
    manipulate also the C runtime’s environment
    * Fix for CTL/Other Default Font #i25247#, #i25561#, #i48064#,
    #i92341#
    * RTF export crasher
    (https://bugzilla.novell.com/show_bug.cgi?id=656503)
    * Fixed an infinite loop in RTF exporter
    * UI: translations need more space on word count dialog, made space
    for it.
    * Fix for https://bugzilla.novell.com/show_bug.cgi?id=660816 improve
    formfield checkbox binary export (and import)

    Again a BIG Thank You!

    Again whats Libre Office

    What does LibreOffice give you?

    Writer is the word processor inside LibreOffice. Use it for everything, from dashing off a quick letter to producing an entire book with tables of contents, embedded illustrations, bibliographies and diagrams. The while-you-type auto-completion, auto-formatting and automatic spelling checking make difficult tasks easy (but are easy to disable if you prefer). Writer is powerful enough to tackle desktop publishing tasks such as creating multi-column newsletters and brochures. The only limit is your imagination.

    Calc tames your numbers and helps with difficult decisions when you’re weighing the alternatives. Analyze your data with Calc and then use it to present your final output. Charts and analysis tools help bring transparency to your conclusions. A fully-integrated help system makes easier work of entering complex formulas. Add data from external databases such as SQL or Oracle, then sort and filter them to produce statistical analyses. Use the graphing functions to display large number of 2D and 3D graphics from 13 categories, including line, area, bar, pie, X-Y, and net – with the dozens of variations available, you’re sure to find one that suits your project.

    Impress is the fastest and easiest way to create effective multimedia presentations. Stunning animation and sensational special effects help you convince your audience. Create presentations that look even more professional than the standard presentations you commonly see at work. Get your collegues’ and bosses’ attention by creating something a little bit different.

    Draw lets you build diagrams and sketches from scratch. A picture is worth a thousand words, so why not try something simple with box and line diagrams? Or else go further and easily build dynamic 3D illustrations and special effects. It’s as simple or as powerful as you want it to be.

    Base is the database front-end of the LibreOffice suite. With Base, you can seamlessly integrate your existing database structures into the other components of LibreOffice, or create an interface to use and administer your data as a stand-alone application. You can use imported and linked tables and queries from MySQL, PostgreSQL or Microsoft Access and many other data sources, or design your own with Base, to build powerful front-ends with sophisticated forms, reports and views. Support is built-in or easily addable for a very wide range of database products, notably the standardly-provided HSQL, MySQL, Adabas D, Microsoft Access and PostgreSQL.

    Math is a simple equation editor that lets you lay-out and display your mathematical, chemical, electrical or scientific equations quickly in standard written notation. Even the most-complex calculations can be understandable when displayed correctly. E=mc2.

    LibreOffice also comes configured with a PDF file creator, meaning you can distribute documents that you’re sure can be opened and read by users of almost any computing device or operating system.

    Download LibreOffice now and try it out today.

    http://www.libreoffice.org/features/

     

    Lyx Releases 2

    Ubuntu Login
    Image via Wikipedia

    Lyx releases new version- now if only there was a SIMPLE way to put R code in a Lyx existing text class (having tried Sweave and sweaved myself into knots ! 😦

    and I hope Ubuntu Linux 10.10  netbook fixes the curious case of disappearing menu bar in Lyx

    see https://bugs.launchpad.net/ubuntu/+source/indicator-appmenu/+bug/619811

    (Hint start Lyx using from the terminal:
    QT_X11_NO_NATIVE_MENUBAR=1 lyx)

    Latest News from the

    http://www.lyx.org/News#item2

    We are pleased to announce the release of LyX 1.6.9

     

    Beta Release: LyX 2.0.0 beta 4 released.

    February 6, 2011

    We are pleased to announce the fourth public pre-release of LyX 2.0.0.
    Except usual bugfixing we fixed random crashes connected with the new background export and compilation feature.

    As far as new features is considered it is now possible

    • to set the table width,
    • customize the language package per document,
    • export LyX files as a single archive containing linked material (e.g. images) directly via export menu.

     

    Since this is most probably the last beta release we also added convertor for old (1.6) preference files which are automatically checked on the startup now.

     

    SAS to R Challenge: Unique benchmarking

    Flag of Town of Cary
    Image via Wikipedia

    An interesting announcemnet from Revolution Analytics promises to convert your legacy code in SAS language not only cheaper but faster. It’ s a very very interesting challenge and I wonder how SAS users ,corporates, customers as well as the Institute itself reacts

    http://www.revolutionanalytics.com/sas-challenge/

    Take the SAS to R Challenge

    Are you paying for expensive software licenses and hardware to run time-consuming statistical analyses on big data sets?

    If you’re doing linear regressions, logistic regressions, predictions, or multivariate crosstabulations* there’s something you should know: Revolution Analytics can get the same results for a substantially lower cost and faster than SAS®.

    For a limited time only, Revolution Analytics invites you take the SAS to R Challenge. Let us prove that we can deliver on our promise of replicating your results in R, faster and cheaper than SAS.

    Take the challenge

    Here’s how it works:

    Fill out the short form below, and one of our conversion experts will contact you to discuss the SAS code you want to convert. If we think Revolution R Enterprise can get the same results faster than SAS, we’ll convert your code to R free of charge. Our goal is to demonstrate that Revolution R Enterprise will produce the same results in less time. There’s no obligation, but if you choose to convert, we guarantee that your license cost for Revolution R Enterprise will be less than half what you’re currently paying for the equivalent SAS software.**

    It’s that simple.

    We’ll show you that you don’t need expensive hardware and software to do high quality statistical analysis of big data. And we’ll show that you don’t need to tie up your computing resources with long running operations. With Revolution R Enterprise, you can run analyses on commodity hardware using Linux or Windows, scale to terabyte-class data problems and do it at processing speeds you would never have thought possible.

    Sign up now, and we will be in touch shortly.

    Take the challenge

     

    —————————-

    SAS is a registered trademark of the SAS Institute, Cary, NC, in the US and other countries.

    *Additional statistical algorithms are being rapidly added to Revolution R Enterprise. Custom development services are also available.

    **Revolution Analytics retains the right to determine eligibility for this offer. Offer available until March 31, 2011.