More Advanced SAS Modeling Procs

A special thanks to Peter Flom ( www.peterflom.com )for suggesting the following –

5) Proc NLMIXED

PROC NLMIXED can be viewed as generalizations of the random coefficient models fit by the MIXED procedure. This generalization allows the random coefficients to enter the model nonlinearly, whereas in PROC MIXED they enter linearly. With PROC MIXED you can perform both maximum likelihood and restricted maximum likelihood (REML) estimation, whereas PROC NLMIXED only implements maximum likelihood. This is because the analog to the REML method in PROC NLMIXED would involve a high dimensional integral over all of the fixed-effects parameters, and this integral is typically not available in closed form. Finally, PROC MIXED assumes the data to be normally distributed, whereas PROC NLMIXED enables you to analyze data that are normal, binomial, or Poisson or that have any likelihood programmable with SAS statements.

http://aerg.canberra.edu.au/envirostats/bm/SASHelp/stat/chap46/sect4.htm

6) Proc Glimmix

PROC GLIMMIX fits statistical models to data with correlations or nonconstant variability and where the response is not necessarily normally distributed. These generalized linear mixed models (GLMM), like linear mixed models, assume normal (Gaussian) random effects. Conditional on these random effects, data can have any distribution in the exponential family. The binary, binomial, Poisson, and negative binomial distributions, for example, are discrete members of this family. The normal, beta, gamma, and chi-square distributions are representatives of the continuous distributions in this family.

Some PROC GLIMMIX features are:

  • Flexible covariance structures for random effects and correlated errors
  • Programmable link and variance functions
  • Bias-adjusted empirical covariance estimators
  • Univariate and multivariate low-rank smoothing
  • Joint modeling for multivariate data

Besides including performance enhancements and various fixes, the production release of the GLIMMIX procedure provides numerous additional features. These include:

  • ODS statistical graphics to display LS-means and confidence limits
  • Analysis of Means
  • Odds ratios
  • Custom hypotheses concerning LS-means with the LSMESTIMATE statement
  • New multiplicity adjustments
  • Beta regression

www2.sas.com/proceedings/sugi30/196-30.pdf

http://support.sas.com/rnd/app/da/glimmix.html

3) Proc QUANTREG

www.stat.uiuc.edu/~x-he/ENAR-Tutorial.pdf

Ordinary least squares regression models the relationship between one or more covariates X and the conditional mean of the response variable Y given X=x. Quantile regression extends the regression model to conditional quantiles of the response variable, such as the 90th percentile. Quantile regression is particularly useful when the rate of change in the conditional quantile, expressed by the regression coefficients, depends on the quantile. The main advantage of quantile regression over least squares regression is its flexibility for modeling data with heterogeneous conditional distributions. Data of this type occur in many fields, including biomedicine, econometrics, and ecology.

Some PROC QUANTREG features are:

  • Implements the simplex, interior point, and smoothing algorithms for estimation
  • Provides three methods to compute confidence intervals for the regression quantile parameter: sparsity, rank, and resampling.
  • Provides two methods to compute the covariance and correlation matrices of the estimated parameters: an asymptotic method and a bootstrap method
  • Provides two tests for the regression parameter estimates: the Wald test and a likelihood ratio test
  • Uses robust multivariate location and scale estimates for leverage point detection
  • Multithreaded for parallel computing when multiple processors are available

4) Proc Catmod-

http://www.uidaho.edu/ag/statprog/sas/workshops/catmod/outline.html

Categorical data with more than two factors are referred to as multi-dimensional distributions. Procedure CATMOD will be used for analyses concerning such data. PROC CATMOD may also be used to analyze one-and two-way data structures , however it is an effective means to approach more complex data structures.

PROC CATMOD utilizes a different technique to do categorical analysis than the ‘Pearson type’ chi-square. The analysis is based on a transformation of the cell probabilities. This transformation is called the response function. The exact form of the response function depends on the data type and it is normally motivated by certain theoretical considerations. SAS offers many different forms of response functions and even allows the user to specify their own, however, the most common (default) is the Generalized Logit. This function is defined as:

Generalized Logit = LOG(pi/pk),
where pi is the ith cell probability and pk is the last cell probability. The ratio of pi/pk is called an odds ratio and the log of the odds ratio is just a comparison of the ith category to the last, on a log scale. The logit can be rewritten as:
Generalized Logit = LOG(pi) – LOG(pk).
It should be noted that if there are k categories, then there will be only k-1 response functions since the kth one will be zero.

SAS Modeling Procs

Well, so you want to be a SAS Modeler. Or atleast get a job as a junior one , and then learn on the job (we all did). Here are some SAS Procs you need to brush up on-

1) Proc Reg – Continuous Regression.

2) Proc Logistic –Logistic Regression.

3) Proc Probit –Categorical regressors also included in this.

4) Proc GLM –General Linear Models based on OLS. PROC GLM handles models relating one or several continuous dependent variables to one or several independent variables. The independent variables may be either classification variables, which divide the observations into discrete groups, or continuous variables.Proc GLM is the preferred procedure for doing univariate analysis of variance , multivariate analysis of variance , and most types of regression. :Note there is a Proc Anova also.

5) Proc Mixed –The PROC MIXED was specifically designed to fit mixed effect models. It can model random and mixed effect data.PROC MIXED has three options for the method of estimation. They are: ML (Maximum Likelihood), REML (Restricted or Residual maximum likelihood, which is the default method) and MIVQUE0 (Minimum Variance Quadratic Unbiased Estimation). ML and REML are based on a maximum likelihood estimation approach. They require the assumption that the distribution of the dependent variable (error term and the random effects) is normal. ML is just the regular maximum likelihood method,that is, the parameter estimates that it produces are such values of the model parameters that maximize the likelihood function. REML method is a variant of maximum likelihood estimation; REML estimators are obtained not from maximizing the whole likelihood function, but only that part that is invariant to the fixed effects part of the linear model. In other words, if y = Xb + Zu + e, where Xb is the fixed effects part, Zu is the random effects part and e is the error term, then the REML estimates are obtained by maximizing the likelihood function of K’y, where K is a full rank matrix with columns orthogonal to the columns of the X matrix, that is, K’X = 0. I

6) Proc Genmod-PROC GENMOD uses a class statement for specifying categorical (classification) variables, so indicator variables do not have to be constructed in advance, as is the case with, for example, PROC LOGISTIC. Interactions can be fitted by specifying, for example, age*sex. The response variable or the explanatory variable can be character  while PROC LOGISTIC requires explanatory variables to be numeric.

7) Proc Corr-CORR procedure computes correlation coefficients between variables. It can also produce covariances.

8) Proc Anova-PROC ANOVA handles only balanced ANOVA designs

Required reading http://en.wikipedia.org/wiki/Regression_analysis

SAS Online Doc

Additional Reading-

http://www.pauldickman.com/teaching/sas/genmod_logistic.php

http://www.psych.yorku.ca/lab/sas/sasanova.htm

Project Management Certification (PMP)

Some resources for getting the PMP certification (based on a Linkedin Question)- This is a useful not too expensive and not very very tough certification for professionals who manage projects (and don’t we all !)

Online Websites-

Providers- http://tel.occe.ou.edu/cgi-bin/PMI_Provider/repsearch.cgi

The main website –http://www.pmi.org/Pages/default.aspx

Credentials-http://www.pmi.org/CareerDevelopment/Pages/Obtaining-Credential.aspx

Some white papers –http://www.globalknowledge.com/training/whitepaperlist.asp?pageid=502&wpcat=7&sort=&country=United+States

An additional book-http://www.amazon.com/PMP-Exam-Prep-Fifth-Passing/dp/1932735003

The main book – PMBOK

The detailed answers on the Linkedin site are much more helpful- Try it.

http://www.linkedin.com/answers/management/business-analytics/MGM_ANA/207457-6691344

Project Management Tools:Alternatives to MS Project

Some popular and free project management tools are –

1) Trac –http://trac.edgewall.org/

2) Dotproject http://www.dotproject.net/

3) OpenProj –http://sourceforge.net/projects/openproj/

4) DreamTeam –http://dreamfactory.com/solutions/dreamteam/amazon

5) Bugzilla –http://www.bugzilla.org/

6) Liquid Planner –http://www.liquidplanner.com/

7) Basecamp http://www.basecamphq.com/

8) Rally Software http://www.rallydev.com/

9) Gantt Charts in Google Apps

http://googleenterprise.blogspot.com/2008/07/spreadsheet-gadgets-free-collaborative.html

10) Some more alternatives from another good blog (http://woork.blogspot.com/)

http://woork.blogspot.com/2008/03/resources-on-line-for-project.html

11) Assembla www.assembla.com

Cloud Computing (Cooler and Lower)

The changes in Google Docs means that cloud computing now enables you to imbed web like objects in mundane spreadsheets (for free) and also allows you to backup your Google Docs using the Google Gears application.The Google gadgets are also nifty like displaying Gannt charts.

http://gears.google.com/?platform=win

You can collaborate on a spreadsheet on the internet also

With these changes- Google Docs is more than a big alternative to Windows Office- especially thanks to much lower initial  costs, and zero maintainace costs. Also with the offline Google Gears backup,you do have access to your data even without the internet, it allows you to de facto create a cloud version of Windows OS -My Briefcase .

Not 100 % of the data or office documents within an organization need to reside locally. Yet System administrators continue to resist Google docs (because well you don’t need system administrators once you totally get into this cloud computing business).

Of course, Google will need to address privacy and ownership issues, which given its battles with retail data will cast a cloud on it’s cloud for the corporate version of the retail services.

Monetizing my Linked In network

This are the stats of my linked in network.

Now having 3219 contacts is clearly more valuable than 32 contacts. But the quality of contacts is important as well.I manage two groups on Linkedin ,Decision Stats and Creative Destruction, have got 1 job , lots of CXO level contacts , got ideas for two websites (including this one), been interviewed once for a website (www.analyticbrdige.com) and get increasing numbers of recruiter calls everyday. But how do I convert this value into a number.

So whats the true economic value of my Linked In network.

1) Lets assume each contact has a minimum value of 10 cents. This is to remove duplication and negate the effect of Linkedin Open Networkers or LIONs.

2) Lets assume each CXO level contact is worth 5 dollars.Thats about 300 CXO networkers.

3)Lets assume each recruiter is worth 1 $. Thats about 500 recruiters.

4) Going forward regional contacts – Lets put the value of a Bay Area contact at 2$ while New York Contact at 1.1 $. New York contacts are less helpful when it comes to technology.

Well, doing the maths I come to a value of 6500 USD or a utility value of around 2 $ per contact. Now compare this with Linkedin ‘s valuation which is at 1 billion for 25 million people. Thats 40 USD per unique contact.

So my calculation assumes a duplication of 40/2 =20 times atleast. Which is reasonable. This assumes of course that LI gets the same value for each contact that I do, which may or may not be true.

So whats the value of your Linkedin Network today. 🙂

Joomla 1.5

Joomla 1.5 is a terrific CMS release. I did some work for half an hour, and the results are here. Its almost as easy to use as WordPress (note almost) and quite powerful in content customization.

https://decisionstats.com/joomla15/