Month: February 2011

Open Source Compiler for SAS language/ GNU -DAP

A Bold GNU Head
Image via Wikipedia

I am still testing this out.

But if you know bit more about make and .compile in Ubuntu check out

http://www.gnu.org/software/dap/

I loved the humorous introduction

Dap is a small statistics and graphics package based on C. Version 3.0 and later of Dap can read SBS programs (based on the utterly famous, industry standard statistics system with similar initials – you know the one I mean)! The user wishing to perform basic statistical analyses is now freed from learning and using C syntax for straightforward tasks, while retaining access to the C-style graphics and statistics features provided by the original implementation. Dap provides core methods of data management, analysis, and graphics that are commonly used in statistical consulting practice (univariate statistics, correlations and regression, ANOVA, categorical data analysis, logistic regression, and nonparametric analyses).

Anyone familiar with the basic syntax of C programs can learn to use the C-style features of Dap quickly and easily from the manual and the examples contained in it; advanced features of C are not necessary, although they are available. (The manual contains a brief introduction to the C syntax needed for Dap.) Because Dap processes files one line at a time, rather than reading entire files into memory, it can be, and has been, used on data sets that have very many lines and/or very many variables.

I wrote Dap to use in my statistical consulting practice because the aforementioned utterly famous, industry standard statistics system is (or at least was) not available on GNU/Linux and costs a bundle every year under a lease arrangement. And now you can run programs written for that system directly on Dap! I was generally happy with that system, except for the graphics, which are all but impossible to use,  but there were a number of clumsy constructs left over from its ancient origins.

http://www.gnu.org/software/dap/#Sample output

  • Unbalanced ANOVA
  • Crossed, nested ANOVA
  • Random model, unbalanced
  • Mixed model, balanced
  • Mixed model, unbalanced
  • Split plot
  • Latin square
  • Missing treatment combinations
  • Linear regression
  • Linear regression, model building
  • Ordinal cross-classification
  • Stratified 2×2 tables
  • Loglinear models
  • Logit  model for linear-by-linear association
  • Logistic regression

    • Copyright © 2001, 2002, 2003, 2004 Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA

    sounds too good to be true- GNU /DAP joins WPS workbench and Dulles Open’s Carolina as the third SAS language compiler (besides the now defunct BASS software) see http://en.wikipedia.org/wiki/SAS_language#Controversy

     

    Also see http://en.wikipedia.org/wiki/DAP_(software)

    Dap was written to be a free replacement for SAS, but users are assumed to have a basic familiarity with the C programming language in order to permit greater flexibility. Unlike R it has been designed to be used on large data sets.

    It has been designed so as to cope with very large data sets; even when the size of the data exceeds the size of the computer’s memory

    Related Articles

    WPS Version 2.5.1 Released – can still run SAS language/data and R

    However this is what Phil Rack the reseller is quoting on http://www.minequest.com/Pricing.html

    Windows Desktop Price: $884 on 32-bit Windows and $1,149 on 64-bit Windows.

    The Bridge to R is available on the Windows platforms and is available for free to customers who
    license WPS through MineQuest,LLC. Companies and organizations outside of North America
    may purchase a license for the Bridge to R which starts at $199 per desktop or $599 per server

    Windows Server Price: $1,903 per logical CPU for 32-bit and $2,474 for 64-bit.

    Note that Linux server versions are available but do not yet support the Eclipse IDE and are
    command line only

    WPS sure seems going well-but their pricing is no longer fixed and on the home website, you gotta fill a form. Ditt0 for the 30 day free evaluation

    http://www.teamwpc.co.uk/products/wps/modules/core

    Data File Formats

    The table below provides a summary of data formats presently supported by the WPS Core module.

    Data File Format Un-Compressed
    Data    		 Compressed
    Data
    Read Write Read Write
    SD2 (SAS version 6 data set)
    SAS7BDAT (SAS version 7 data set)
    SAS7BDAT (SAS version 8 data set)
    SAS7BDAT (SAS version 9 data set)
    SASSEQ (SAS version 8/9 sequential file)
    V8SEQ (SAS version 8 sequential file)
    V9SEQ (SAS version 9 sequential file)
    WPD (WPS native data set)
    WPDSEQ (WPS native sequential file)
    XPORT (transport format)

    Additional access to EXCEL, SPSS and dBASE files is supported by utilising the WPS Engine for DB Filesmodule.

    and they have a new product release on Valentine Day 2011 (oh these Europeans!)

    From the press release at http://www.teamwpc.co.uk/press/wps2_5_1_released

    WPS Version 2.5.1 Released 

    New language support, new data engines, larger datasets, improved scalability

    LONDON, UK – 14 February 2011 – World Programming today released version 2.5.1 of their WPS software for workstations, servers and mainframes.

    WPS is a competitively priced, high performance, highly scalable data processing and analytics software product that allows users to execute programs written in the language of SAS. WPS is supported on a wide variety of hardware and operating system platforms and can connect to and work with many types of data with ease. The WPS user interface (Workbench) is frequently praised for its ease of use and flexibility, with the option to include numerous third-party extensions.

    This latest version of the software has the ability to manipulate even greater volumes of data, removing the previous 2^31 (2 billion) limit on number of observations.

    Complimenting extended data processing capabilities, World Programming has worked hard to boost the performance, scalability and reliability of the WPS software to give users the confidence they need to run heavy workloads whilst delivering maximum value from available computer power.

    WPS version 2.5.1 offers additional flexibility with the release of two new data engines for accessing Greenplum and SAND databases. WPS now comes with eleven data engines and can access a huge range of commonly used and industry-standard file-formats and databases.

    Support in WPS for the language of SAS continues to expand with more statistical procedures, data step functions, graphing controls and many other language items and options.

    WPS version 2.5.1 is available as a free upgrade to all licensed users of WPS.

    Summary of Main New Features:

    • Supporting Even Larger Datasets
      WPS is now able to process very large data sets by lifting completely the previous size limit of 2^31 observations.
    • Performance and Scalability Boosted
      Performance and scalability improvements across the board combine to ensure even the most demanding large and concurrent workloads are processed efficiently and reliably.
    • More Language Support
      WPS 2.5.1 continues the expansion of it’s language support with over 70 new language items, including new Procedures, Data Step functions and many other language items and options.
    • Statistical Analysis
      The procedure support in WPS Statistics has been expanded to include PROC CLUSTER and PROC TREE.
    • Graphical Output
      The graphical output from WPS Graphing has been expanded to accommodate more configurable graphics.
    • Hash Tables
      Support is now provided for hash tables.
    • Greenplum®
      A new WPS Engine for Greenplum provides dedicated support for accessing the Greenplum database.
    • SAND®
      A new WPS Engine for SAND provides dedicated support for accessing the SAND database.
    • Oracle®
      Bulk loading support now available in the WPS Engine for Oracle.
    • SQL Server®
      To enhance existing SQL Server database access, a new SQLSERVR (please note spelling) facility in the ODBC engine.

    More Information:

    Existing Users should visit www.teamwpc.co.uk/support/wps/release where you can download a readme file containing more information about all the new features and fixes in WPS 2.5.1.

    New Users should visit www.teamwpc.co.uk/products/wps where you can explore in more detail all the features available in WPS or request a free evaluation.

    and from http://www.teamwpc.co.uk/products/wps/data it seems they are going on the BIG DATA submarine as well-

    Data Support 

    Extremely Large Data Size Handling

    WPS is now able to handle extremely large data sets now that the previous limit of 2^31 observations has been lifted.

    Access Standard Databases

    Use I/O Features in WPS Core

    • CLIPBOARD (Windows only)
    • DDE (Windows only)
    • EMAIL (via SMTP or MAPI)
    • FTP
    • HTTP
    • PIPE (Windows and UNIX only)
    • SOCKET
    • STDIO
    • URL

    Use Standard Data File Formats

    Related Articles

    OK Cupid Data Visualization- Flow Chart to your Heart

    Quite appropriate on a V Day, OK Cupid remains quite innovative how they use data (in this questionnaire data)

    Related Articles

    QGIS and R

    Logo graphic for the Quantum GIS free software...
    Image via Wikipedia

    Qgis is Quantum GIS http://www.qgis.org/

    Quantum GIS (QGIS) is a user friendly Open Source Geographic Information System (GIS) licensed under the GNU General Public License. QGIS is an official project of the Open Source Geospatial Foundation (OSGeo). It runs on Linux, Unix, MacOSX, and Windows and supportsnumerous vector, raster, and database formats and functionalities.

    Learn more about QGIS

    Quantum GIS provides a continously growing number of capabilities provided by core functions and plugins. You can visualize, manage, edit, analyse data, and compose printable maps

    Also you can use both Qgis and R through Python (!!!)

    http://www.qgis.org/wiki/HomeRange_plugin#Home-range_analyses_in_QGIS_using_R_through_Python

    Interesting app for webs (sometimes better suited than some R map packages)

    https://plugins.qgis.org/plugins/HomeRange_plugin/

    Based on a Google Summer of Code _

     Also

    https://sites.google.com/site/eospansite/introqgis_r

    and

    HomeRange_plugin

    http://hub.qgis.org/projects/quantum-gis/wiki/HomeRange_plugin

     

    Also read-

    http://blog.qgis.org/node/51

    Related Articles-

    R Graphs Resources

    https://rforanalytics.wordpress.com/r-graphs-resources/

    Using R from other Software

    https://rforanalytics.wordpress.com/using-r-from-other-software/

    and

    Visualize NHL Play-by-Play using Tableau Public and R

    http://brocktibert.wordpress.com/2011/02/13/visualize-nhl-play-by-play-using-tableau-public-and-r/

    Related Articles

    Protovis a graphical toolkit for visualization

    I just found about a new data visualization tool called Protovis http://vis.stanford.edu/protovis/ex/

    Protovis composes custom views of data with simple marks such as bars and dots. Unlike low-level graphics libraries that quickly become tedious for visualization, Protovis defines marks through dynamic properties that encode data, allowing inheritance, scales and layouts to simplify construction.

    Protovis is free and open-source and is a Stanford project. It has been used in web interface R Node (which I will talk later )

    http://squirelove.net/r-node/doku.php

    Conventional

    While Protovis is designed for custom visualization, it is still easy to create many standard chart types. These simpler examples serve as an introduction to the language, demonstrating key abstractions such as quantitative and ordinal scales, while hinting at more advanced features, including stack layout.

    Custom

    Many charting libraries provide stock chart designs, but offer only limited customization; Protovis excels at custom visualization design through a concise representation and precise control over graphical marks. These examples, including a few recreations of unusual historical designs, demonstrate the language’s expressiveness.

     

     

    Try Protovis today 🙂 http://vis.stanford.edu/protovis/

    It uses JavaScript and SVG for web-native visualizations; no plugin required (though you will need a modern web browser)! Although programming experience is helpful, Protovis is mostly declarative and designed to be learned by example.

    Related Articles

    Happy Valentine Day

    Image source-http://www.icondrawer.com/free.php

    HAPPY VAL&TINE  DAY

    Related Articles