Here is a revised version of the Custom Search Engine that I first talked of last year- this year it now includes Business Intelligence Sites.
Try it out and let me know of you want to help create a customized Data Mining Engine- Note it already has 800 plus analytics and Business Intelligence Sites.
I got much better results than Google when searching for R, but thats to be expected 🙂
Note this is what I was trying to write in previous post. Also credit is due to http://lixiaoxu.lxxm.com/rwebfriend/
Some pending news and posts- It appears that the company SAP is moving closer to major acquisitions. This includes launching more and more applications that are analytical in nature as well coming together in an alliance with hardware major Teradata. Teradata off course is a very close partner to SAS Institute. So could SAP and SAS and or Terdata be moving closer to a major announcement on BI and BA merging.
The open source database movement with Hadoop is the one which can be the real game changer in the managed database industry and AsterData is the company to watch here.
However R with its modular extensions is a different paradigm in language developement and SAS no longer has the nimbleness or flexibity in creating such apps- at the same time it has lost a fair deal of credibility in the young academia (due to R) as well cost sensitive consumers (due to WPS)
The succession issue of Jim Goodnight continues to be the biggest problem for SAS Institute- Jim is not getting younger and his second line is not expected to be of the same class as the Sall/ Goodnight partnership. Of all the major companies in software, Jim Goodnight stood alone in remaining private and thus managed to escape distractions of share prices while building up the franchise. Surviving oil shocks, cold wars, three recessions Mr Goodnight has cared for his local community as well despite being active in SAS and fending off sustained attempts by open source languages.
. An automatic partner for Mr Goodnight should have been Google or even Google Labs with the Brin/Page duo being the top data miners ( commerically) of this generation as Sall/Goodnight were 30 years ago.
SAP may spend a lot of its cash but the supply chain paradigm is best served by SaaS and exemplified by Salesforce.com and Force.com developers.
As the ancient Chinese said- May you live in interesting times.
Just got news from the Chicago school of analytics, or the company known as SPSS. they have decided to lauch two more PASW products and you can see this from the release itself.
SPSS Inc. and the value of Predictive Analytics.
This week we announced PASW Data Collection 5.6 feedback management and survey research software, and PASW Collaboration & Deployment Services 4, our integrated platform to share, manage, automate and integrate analytic assets directly into business processes.
PASW Data Collection 5.6 (formerly Dimensions)
* The use of surveys to capture “Voice of the Customer” across multiple touch-points is integral to bringing data about people’s attitudes into analytical decision-making to improve customer intimacy.
* PASW Data Collection 5.6 supports the entire survey lifecycle — from authoring to managing the data collection process to survey reporting and analysis — supporting global, multichannel research and feedback collection.
* New functionality includes data entry capabilities, an enhanced authoring interface suitable for the novice and the research professional, and new phone-based interviewing capabilities designed to shape the modern survey research call center. This release also further extends the enterprise readiness of the data collection platform with enhancements to performance and security.
You can read the press release at http://www.spss.com/press/template_view.cfm?PR_ID=1088
PASW Collaboration and Deployment Services 4 (formerly Predictive Enterprise Services)
* The platform automates analytical processes for greater consistency and control, and deploys results to business users, consumers or directly into operational systems to reduce customer churn, improve marketing campaigns or identify cases of fraud.
* PASW Collaboration and Deployment Services 4 provides the foundation to integrate analytics into key business processes, so the right decisions are made and the best actions are taken on a consistent, repeatable basis.
* New functionality includes enhanced collaboration capabilities that provide more options for publishing analytical results; enhancements to the Automation Service with additional integration options; and a Real-time Scoring Service to deploy analytical scores into existing applications.
You can read the full press release at http://www.spss.com/press/template_view.cfm?PR_ID=1087
In my continuing coverage of KXEN, the plucky company that has managed to revolutionize analytics automation and social network analysis- Here is an interview with KXEN’s Vice President Bruno Delahaye.
Ajay – What is the best feature you like in KXEN. – both as a company and as a product.
Bruno- Well actually what I like the most about KXEN is the will to make a difference. This is true at different levels of course: each individual within the company is trying to make things happen. For employees at KXEN this is not just a job: they want to change the game! The product side is naturally cascading from this. We are not simply recoding existing algorithms like some of our competitors are doing, instead we are looking in every domain of predictive and descriptive analytics where we can deliver higher value to our customers. When customers, thanks to the automation we provide, come back to us stating that they manage to increase their modeling productivity by 10 or even 50 compared to their previous modeling process we really think that what we provide is changing the game. Also, the fact that we have well over 500 customers globally today is proving that our customers recognize this as well!
Ajay : What areas has KXEN been most suitable for ? Biggest success story so far.
Bruno- KXEN has been very successful for 2 types of customers. We have been very successful in companies with mature Data Mining practices, companies that have realized that they need to move from a fully hand crafted approach to a more industrialized one in order to answer business requirements. As an example, lots of large companies run 10s of marketing campaigns per month and actually use data mining for only 1 or 2 at best… once organizations have understood the power of Data Mining they certainly want to target each campaign. Only KXEN can provide the level of automation required for this. On the other side, new data mining users (either new companies or new departments in a company) are also very eager to use KXEN. The learning curve with KXEN is so quick that it enables them to use their existing team (the ones that are aware of the business issues) and make them run within few days successful churn management programs or rebuild their customer segmentation in a reliable manner.
If you were expecting figures here, some Vodafone entities are claiming that they reduce churn in some customer segments by more than 10% by implementing KXEN. Unicredit in Austria mentioned that due to KXEN they gained an additional 50m€ per season….as you can guess the success of our customers always brighten our days.
Ajay : What areas would you rather not recommend KXEN? What other software would you recommend in those cases ?
Bruno- Well, I would recommend to use KXEN in every area of course, nevertheless where we have been less successful so far is with companies where time pressure to deliver analysis is lower. Basically, research departments tend to use more softwares like SAS EM or SPSS Clementine that are more methods/algorithms oriented rather than results oriented.
Ajay : What is the biggest challenge you have faced while introducing KXEN to a wider audience.
Bruno- The bigger challenge we have is in building domain expertise, it is indeed very difficult to build knowledge of our teams at the same time in Customer Lifecycle Analytics, in HRM, SCM… that is where building a confident relationship with the customer is so important. We have to prove to our prospect very early in the discussions that with KXEN they will make significant steps forward! This is also where our partner are so important to us. KXEN works with international as well as local partners with specific expertise to help our customers make the best possible use of the KXEN Data mining software to insure a high and fast ROI.
Ajay -Do you think the text mining as well as the Data Fusion approach can work for online web analytics, search engines or ad targeting?
Bruno- The data fusion approach is certainly one that makes sense for online web analytics. Analyzing the sequence of events rather than just taking into account whether an event occurs is actually a very powerful way to predict customer behavior or in this case the next click or the next action that is going to be made. I am not in this case claiming that everything has to be real-time as this could be the cause of the creation of weak or even unreliable/non stable models. Instead what we recommend our customer to do is to split the learning part that can be made off-line from the deployment that needs to be done real-time.
Ajay- Describe the relationships of KXEN with other members of the business intelligence community in terms of alliances.
Bruno- KXEN is a very good complement to BI vendors. We are actually partnering with several Data warehouse Vendors. For Data warehouse, the equation is quite simple they allow customers to structure and store the data but to provide real ROI, solutions need to be plugged on top of them. Setting a Data warehouse if you do not use the stored data is just another cost, what KXEN does is enabling to take advantage of the data asset to build customer segments that you will use to define your marketing mix, or simply target your customer either for cross-selling, up-selling or retention/loyalty purposes. The same is valid for credit scoring, fraud detection….
Case Study- Assume I have 50000 leads daily on a Car buying website. How would KXEN help me in scoring the model (as compared to other online based scoring solutions). Is it technically possible for me to install KXEN on Windows/ Other instances in remote computing like Amazon EC2 and not a server sitting somewhere.
The key difference, I believe, is that with KXEN you will indeed be able to do this even if you are not a data mining expert, if you want to use the results of yesterday’s campaigns to rebuild a model and if you can only afford to spend 10 minutes on this task every day. At the end of the day what we allow our users is to answer their business questions within the time frame they have rather than trying to convince them that they do not really need to do so many analysis for their business to run successfully
Ajay- And that was Bruno, VP, EMEA, KXEN. His profile can be seen here
http://www.linkedin.com/in/brunodelahaye
Bruno Delahaye manages KXEN’s operations for Continental Europe, Middle East, Africa and South America at KXEN. He is responsible for identifying and managing key partnership opportunities and developing the overall strategy for new partnerships.
For more on KXEN please go to http://www.kxen.com, you may need to regsiter to download their properietary white papers on Structural Risk Management or Text Mining.
Conflict of Interest Disclaimer-I am a consultant to KXEN as a social media consultant. Chairman Roger Hadaad was one of the first Chairman of a major corporation to agree to give interview to this small blog.
Valuation of future cash flows is an inexact science- too often it relies either on flat historical numbers (we grew by 5% last year so next year we will grow by 10%)
To add to the fun is the agency conflict, manager’s priorities (in terms of stock options encashment) is different from owner’s priorities.
These are some ways you can track companies for analysis-
1) Make a Google Alert on Company Name
2) Track if there is sudden and sustained spike in activity – it may be that company may be on road show seeking like minded partners, investors or mergers.
3) Watch for sudden drop in news alerts- it may mean radio silence or company may be in negotiations
4) Watch how company starts behaving with traditional antagonists…….
The easiest word thrown in the melee is ethics, copyright violations or payments delayed.
I am pasting an extract by a noted and renowned analyst in the business intelligence field-
Curt Monash
His Professional opinion on SAP
SAP’s NetWeaver Business Warehouse software will soon run natively on Teradata’s database for high-end data warehousing and BI (business intelligence), the vendors announced Monday.
SAP and its BusinessObjects BI subsidiary already had partnerships and product integrations with Teradata. But the vendors’ many joint customers have been clamoring for more, and native Business Warehouse support is the answer, said Tim Lang, vice president of product management for Business Objects.
SAP expects the new capability to enter beta testing in the fourth quarter of this year, with general availability in the first quarter of 2010, according to a spokesman.
Under the partnership, SAP will be handling first-line support, according to Lang. Pricing was not available.
The announcement drew a skeptical response from analyst Curt Monash of Monash Research, who questioned how deeply SAP will be committed to selling its customers on Teradata versus rival platforms.
“Business Objects has long been an extremely important partner for Teradata. But SAP’s most important DBMS partner is and will long be IBM, simply because [IBM] DB2 is not Oracle,” Monash said.”
Credit-
http://www.infoworld.com/d/data-management/sap-and-teradata-deepen-data-warehousing-ties-088
and here are some words from Curt Monash’s personal views on SAP
Typical nonsense from SAP
Below, essentially in its entirety, is an e-mail I just received from SAP, today, January 3. (Emphasis mine.)
Thank you for attending SAPs 4th Annual Analyst Summit in Las Vegas. We hope you found the time to be valuable. To ensure that we continue meeting your informational needs, please take a few moments to complete our online survey by using the link below. We ask that you please complete the survey before December 20. We look forward to receiving your feedback.
What makes this typical piece of SAP over-organization particularly amusing is that I didn’t actually attend the event. I was planning to, but after considerable effort I think I finally made it clear to VP of Analyst Relations Don Bulmer that I was fed up with being lied to* by him and his colleagues. In connection with that, we came to a mutual agreement, as it were, that I wouldn’t go.
*and lied about
Obviously, administrative ineptitude and dishonesty are two very different matters, united only by the fact that they both are characteristics of SAP, particularly its analyst relations group. Having said that, I should hasten to add that there are plenty of people at SAP I still trust. If Peter Zencke or Lothar Schubert tells me something, I expect it to be true. And it’s not just Germans; I feel the same way about Dan Rosenberg or Andrew Cabanski-Dunning, to name just a couple non-German SAP guys.
But I have to say this — both SAP’s ethics and its internal business processes are sufficiently screwed up as to cast doubt on SAP’s qualifications to “run the world’s best-run businesses.”
Source:
Journalism ethics off course makes sure that journalists don’t get renumerance or have to compulsorily declare benefits openly.This is not true for online journalism as it is still evolving.
Curt Monash is the grand daddy of all Business Intelligence Journalists- he has been doing this and seen it all since 1981 ( I was 4 years old then).
Almost incorruptible and therefore much respected his Monash report remains closely watched.
Some techniques to thwart Business Intelligence journalists is off course tactics of
1) Fear
2) Uncertainity
3) Doubt
by planting false leaks, or favoring more pliable journalists than the ones who ask difficult questions.
Another way is to use Search Engine Optimization so the Google search is rendered ineffective for diificult journalists for people to read them.
Why did I start this thread?
Well it seems the Business Intelligence world is coming to a round of consolidations and mergers. So will the trend of mega vendors first mentioned by M Fauschette here lead to a trend of mega journalist agencies as well- like a Fox News for all business intelligence journalists to report and get a share of the booty.
The Business Intelligence companies have long viewed analyst relationships as an unnecessary and uncontrollable marketing channel which they would like to see evolve.
Television Ratings can be manipulated for advertising similarly can you manipulate views, page views, clicks on a website for website advertisement.The catch is Google Trends may just give you the actual picture, but you can lie low by choosing not to submit or ping google during initial days and then we the website is big enough in terms of viewers or contributing bloggers can then safely ping Google as the momentum would be inertial in terms of getting bigger and bigger.
Here are some facts as per companies-
1) For SAS Institute
a) WPS is launching its Desktop software which enables SAS language users to migrate seamlessly at 1/10 th of the cost of SAS Base and SAS Stat. It will include Proc Reg and Proc Logistic in this and have a huge documentation.
b) R – open source software is increasingly powerful to manipulate data. SAS/IML tried offering a peace hand but they would need to reconcile with the GPL conditions for R- so if it is a plugin the source code is open and so on
c) Inference of R may be acquired by SAS to get a limited liability stake in a R based user platform.
d) Traditional Rival SPSS ( the two have dunked it out in analytics since 40 years) has a much better GUI and launched a revamped brand PASW. They are no longer distracted with a lawsuit which curiously accused them of stock manipulation and were found innocent.
e) Jim Goodnight has been dominating the industry since 1975 and has managed to stay private despite three recessions and huge inducements ( a wise miove given the mess in the markets in 2008). After Jim who will lead SAS with as much wisdom is an open question. Jim has refused Microsoft some years back, and is still very much in command despite being isolated in terms of industry alliances he remains respected. Pressure on him to rush into a merger would may just backfire.
f) The politics of envy- SAS is hated by many analytics people just as in some corners people hate America- it is because it is number 1, and been there too long.Did you mention anti-trust investigations . Well WPS is based out of UK and the European Union takes competition much more seriously.
g) Long time grudges – SAS is disliked despite its substantial R and D investments, the care it takes of its employees, and local community. Naturally people who are excluded or were excluded at some point of time have resentments.
h) SAS ambitions in Business Intelligence where curiously it is not that expensive and is actually more efficient than other players. The recent salvo fired by Jim Davis declaring business analytics as better than business intelligence- a remark much resented by cricket loving British journalist, Peter J Thomas
http://peterthomas.wordpress.com/category/business-intelligence/sas-bi-ba-controversy/
Intellectuals can carry huge grudges for decades ( Newton and Liebnitz) or Me with people who delay my interviews.
Teradata
1) Teradata has been a big partner with both SAS and SAP. It has also been losing ground recently in the same scenario SAS will shortly face.
It was also spun off in 2007-8 by the parent company NCR
http://it.toolbox.com/blogs/infosphere/against-the-flow-ncr-unacquires-teradata-13842
So will SAS buy Teradata
Will SAP Buy Teradata
Will SAS merge with Teradata and acquired by SAP while reaching a compromise with both WPS and R Project.
Will SAS call the bluff, make sincere efforts with the GPL and academic community to reconcile, give away multiple SAS Base and SAS Stat licenses in colleges and universities (like Asia, India, China) by expanding their academic program globally, start offering more coverage to JMP at a reduced price, make a trust for succession.
I dont know. All I know is I like writing code and poetry. Any code that gets the job done.
Any poem that I want to write ( see scribd books on the right)
One of the most brilliant mathematics students of all time was a person named Sergey Brin. Today at 36 years old, and more billions than he ever cares for- he should ponder his mother’s wish for him to see him complete his Phd is more important or is his own indispensability to Google. The Google share price having fallen by 50 % over the past one year, what more could it fall.
An year or two is all it takes, and with his genetic tendency to Alzheimer’s disease – time is running out for Sergey Brin to leave the board room for the classrooms he left one decade ago. If Google cannot take one year without him, then Google is not as stable as we think.
What if Einstein started opening startups, or Fermi decided joining Board room was important than theorems- Where would we all be ?
In any case, this is a Facebook cause –
http://apps.facebook.com/causes/281925/8347178
Positions
1. Non Abusive
2. Scientific Debate
3. Science versus Commerce
4. Should a brilliant scientist be seduced by money?
5. If all teachers become businessmen, what will happen to the children
Edit
Category:
Public Advocacy – Philanthropy Volunteerism and Public Benefit
Also see Mr Brin’s academic paper-
DECISION STATS 