Tag: analysis

R Oracle Data Mining

Here is a new package called R ODM and it is an interface to do Data Mining via Oracle Tables through R. You can read more here http://www.oracle.com/technetwork/database/options/odm/odm-r-integration-089013.html and here http://cran.fhcrc.org/web/packages/RODM/RODM.pdf . Also there is a contest for creative use of R and ODM.

R Interface to Oracle Data Mining

The R Interface to Oracle Data Mining ( R-ODM) allows R users to access the power of Oracle Data Mining’s in-database functions using the familiar R syntax. R-ODM provides a powerful environment for prototyping data analysis and data mining methodologies.

R-ODM is especially useful for:

  • Quick prototyping of vertical or domain-based applications where the Oracle Database supports the application
  • Scripting of “production” data mining methodologies
  • Customizing graphics of ODM data mining results (examples: classification, regression, anomaly detection)

The R-ODM interface allows R users to mine data using Oracle Data Mining from the R programming environment. It consists of a set of function wrappers written in source R language that pass data and parameters from the R environment to the Oracle RDBMS enterprise edition as standard user PL/SQL queries via an ODBC interface. The R-ODM interface code is a thin layer of logic and SQL that calls through an ODBC interface. R-ODM does not use or expose any Oracle product code as it is completely an external interface and not part of any Oracle product. R-ODM is similar to the example scripts (e.g., the PL/SQL demo code) that illustrates the use of Oracle Data Mining, for example, how to create Data Mining models, pass arguments, retrieve results etc.

R-ODM is packaged as a standard R source package and is distributed freely as part of the R environment’s Comprehensive R Archive Network ( CRAN). For information about the R environment, R packages and CRAN, see www.r-project.org.

and

Present and win an Apple iPod Touch!
The BI, Warehousing and Analytics (BIWA) SIG is giving an Apple iPOD Touch to the best new presenter. Be part of the TechCast series and get a chance to win!

Consider highlighting a creative use of R and ODM.

BIWA invites all Oracle professionals (experts, end users, managers, DBAs, developers, data analysts, ISVs, partners, etc.) to submit abstracts for 45 minute technical webcasts to our Oracle BIWA (IOUG SIG) Community in our Wednesday TechCast series. Note that the contest is limited to new presenters to encourage fresh participation by the BIWA community.

Also an interview with Oracle Data Mining head, Charlie Berger https://decisionstats.wordpress.com/2009/09/02/oracle/

My latest creation

I have just teamed up to create my latest venture called Kush Cognitives (Kush is my son). The firm is gonna make websites, build statistical analysis and offer social media offerings. It’s my latest venture and it merges all my previous ones and skills. After almost 3 years of working on and off with multiple people, this one is with a friend in the US.

Over the years (since 2007) I have made http://virtua-analytics.com (defunct), Swarajya Analytics Private Limited (www.swanplc.com – now sold) and now Kush Cognitives. I have gone through the models of proprietorship and corporation and now partnership.

Kush Cognitives is hosted at Decisionstats.com (as our flagship website) and we have shifted the blog to Decisionstats.Wordpress.com

We are aiming at the startups and small and medium segments first, but we retain capabilities for bigger clients as well. Lesser Bullshit and More Bang for your Buck.

So wish us luck- and if you need any social media advice, statistical analysis to be done, or technical matters of creating websites-This also includes training customization in R , SAS  , and statistical software but from a more practical point of view from a user angle. We are able to cater to both US and Indian clients.

give us a buzz at http://decisionstats.com

regards

Ajay Ohri

Image Courtesy-michelangelo

SAS Sentiment Analysis wins Award

From Business Wire, the new Sentiment Analysis product by SAS Institute (created by acquisition Teragram ) wins an award. As per wikipedia

http://en.wikipedia.org/wiki/Sentiment_analysis

Sentiment analysis or opinion mining refers to a broad (definitionally challenged) area of natural language processing, computational linguistics and text mining. Generally speaking, it aims to determine the attitude of a speaker or a writer with respect to some topic. The attitude may be their judgment or evaluation (see appraisal theory), their affective state (that is to say, the emotional state of the author when writing) or the intended emotional communication (that is to say, the emotional effect the author wishes to have on the reader).

It was developed by Teragram. Here is another Sentiment Analysis tool from Stanford Grad school at http://twittersentiment.appspot.com/search?query=sas

See-

Sentiment analysis for sas

–

Image Citation-

http://threeminds.organic.com/2009/09/five_reasons_sentiment_analysi.html

Read an article on sentiment analysis here at http://www.nytimes.com/2009/08/24/technology/internet/24emotion.html

And the complete press release at http://goo.gl/iVzf`

–SAS Sentiment Analysis delivers insights on customer, competitor and organizational opinions to a degree never before possible via manual review of electronic text. As a result, SAS, the leader in business analytics software and services, has earned the prestigious Communications Solutions Product of the Year Award fromTechnology Marketing Corporation (TMC).

“SAS has automated the time-consuming process of reading individual documents and manually extracting relevant information”

“SAS Sentiment Analysis has shown benefits for its customers and it provides ROI for the companies that use it,” said Rich Tehrani, CEO, TMC. “Congratulations to the entire team at SAS, a company distinguished by its dedication to software quality and superiority to address marketplace needs.”

Derive positive and negative opinions, evaluations and emotions

SAS Sentiment Analysis’ high-performance crawler locates and extracts sentiment from digital content sources, including mainstream websites, social media outlets, internal servers and incoming news feeds. SAS’ unique hybrid approach combines powerful statistical techniques with linguistics rules to improve accuracy to the detailed feature level. It summarizes the sentiment expressed in all available text collections – identifying trends and creating graphical reports that describe the expressed feelings of consumers, partners, employees and competitors in real time. Output from SAS Sentiment Analysis can be stored in document repositories, surfaced in corporate portals and used as input to additional SAS Text Analytics software or search engines to help decision makers evaluate trends, predict future outcomes, minimize risks and capitalize on opportunities.

“SAS has automated the time-consuming process of reading individual documents and manually extracting relevant information,” said Fiona McNeill, Global Analytics Product Marketing Manager at SAS. “Our integrated analytics framework helps organizations maximize the value of information to improve their effectiveness.”

SAS Sentiment Analysis is included in the SAS Text Analytics suite, which helps organizations discover insights from electronic text materials, associate them for delivery to the right person or place, and provide intelligence to select the best course of action. Whether answering complex search-and-retrieval questions, ensuring appropriate content is presented to internal or external constituencies, or predicting which activity or channel will produce the best effect on existing sentiments, SAS Text Analytics provides exceptional real-time processing speeds for large volumes of text.

SAS Text Analytics solutions are part of the SAS Business Analytics Framework, backed by the industry’s most comprehensive range of consulting, training and support services, ensuring customers maximum return from their IT investments.

Recognizing vision

The Communications Solutions Product of the Year Award recognizes vision, leadership and thoroughness. The most innovative products and services brought to the market from March 2008 through March 2009 were chosen as winners of this Product of the Year Award and are published on the INTERNET TELEPHONY and Customer Interaction Solutions websites.

Holiday Fun: Analyzing Facebook Privacy for Ads

So you got a Facebook ID and ticked it in a hurry AND added in your work info. Bad Choice. Even small advertisers like me ( with 225 fans for Decisionstats) can see aggregate numbers of work info BEFORE even advertising.
This can lead to hilarious results-

See Screenshots below- AND note the numbers

1) 400 US females > age 18 work at IBM, SAP, Oracle or Microsoft AND are interested in Women

2) 2940 US females or males > age 18 work at IBM, SAP, Oracle or Microsoft AND are interested in Women

3) 480 US females > age 18 work at IBM, SAP, Oracle or Microsoft AND are interested in Men AND are married

4) 440 US males > age 18 work at IBM, SAP, Oracle or Microsoft AND are interested in Men

5) 40 US males > age 18 work at IBM, SAP, Oracle or Microsoft AND are interested in Men AND are married

[tweetmeme=”decisionstats”]

Interested in males/females while giving out your work info AND your marital status. I hope these are ahem False Positives but seriously do you think these are violations of privacy or not.

Ps- i decided not to advertise after seeing the err statistics.
pps- This is meant to showcase lax ad related privacy for professionals rather than any individual preference or judgment.

FaceBook loses out to Google Driven Initiative…?

These are early days , but almost all the top Facebook application games like Triumph, Dope Wars Online etc are starting to get versions on MySpace and hi5. This basically means that the Facebook era of exclusive applications may face a threat from the open source applications of Google driven APIs that enable developers to make games that transcend all social networks.

This space is heating up, and the latecomers to the social networking party might just Facebook as the harbinger of Web 2.0 crash just as NetScape was to Web1.0 crash.

Speaking of which, the Mozilla Firefox browser is Beta Stage for Version 3. Yes…it is a cool one….and Yes the Force is Strong within Google despite the share price..:)

Why Expensive Oil is Good for your Mortgage

Here is an analysis of US Income, thanks to Gapminder , another company acquired by Google Inc http://preview.tinyurl.com/37n6qe

us-incomes.GIF

US Income has risen steadily ,despite the Korean War,Vietnam War ,Cold War,Iraq War(s),Oil Shock(s),Japanese Imports, Chinese Imports, Indian Outsourcing.

The simple reason is that a flexible economy is more efficient at using capital than any other economy and the US continues to show the maximum readiness to deal with crisis urgently and with flexibility . Take the sub prime crisis in which the Fed is effectively financing the mortgage debts by its revenues (by sale of Treasuries) to the rest of the World.

Now ,coming back to the title- Why expensive oil is good for you ?

Well ,one thing, Arab terrorists don’t get even a fraction of Oil money. In 50 years of continuous oil revenue, hundreds of billions have been invested by Arab countries in the US financial system , which continues to be the safest and most reliable system in the world. The 9/11 attacks cost only 1 million dollars, and money to terrorists is not an issue because of the much less cost in buying truck bombs, etc..

Well , if Oil rises to 104 Dollars a barrel, where do you think the Arabs will invest those dollars- estimated to be 1-2 trillion of additional global liquidity. Would you prefer Arab countries to have enough money to feed and educate their populations or would you want them to be unstable , with lesser money. Same is the effect of extra money on Russia. Well fed populations are less likely to be frustrated and resort to desperate attacks.

The answer is those dollars are likely to flow back into the US financial system giving Wall street more liquidity than the Fed can give, Arabs and Russians more pride and less frustration, and the banks are less likely to foreclose if they themselves have money in the bank.

Remember banks want to make profits and that can happen if you pay their loans for longer tenures.

Thus expect banks to reduce mortgage payments by increasing tenure, rather than foreclose too eagerly and invite political scrutinies and backlash.

And the Arabs may just save the day for the US financial system.

This is an example of Adam Smith’s invisible hand… Think about that.

(Subscribe to this website by the link on the right)

A new free way for Company Analysis

Interactive Data:
Putting Technology to Work for American Investors

What is Interactive Data? (From SEC site)

Put simply, interactive data means using technology to provide investors with quicker access to the information they want, in a format they can most easily use. Today, publishers of financial information offer a wealth of data about stocks, bonds and mutual funds. Unfortunately, investors seeking financial information direct from the source must often attempt to read lengthy corporate annual reports or mutual fund prospectuses. Even if these documents are online, they are often digital blobs with limited search capability.xbrlinfy.PNG

From Zdnet story

The Financial Explorer site uses interactive charts and diagrams, including
“atomic models,” to represent data such as current assets, long-term
investments, and goodwill.

The SEC’s new Financial Explorer site is a tool that enables users to
manipulate raw data derived from XBRL, or extensible business reporting
language.

Users can also compare earnings, expenses, cash flows, assets, and
liabilities for companies in the same industry.

“XBRL is fast becoming the universal language for the exchange of business
information and it is the future of financial reporting,” said SEC Chairman
Christopher Cox in a statement. “With Financial Explorer or another XBRL
viewer, investors will be able to quickly make sense of financial
statements.”

And after all that knowledge , here is a cool site to analyze companies.