Book Extract – Movies in a Austin Mall

On the second last in Austin, I had nothing much to do. I headed out for the nearby movie theatre in the GateWay Mall near Austin Arboretum. It was Friday afternoon and the traffic was just about to pick up for the multiplex theater. I bough two tickets  , one for Max Payne ( in the afternoon ) and the other for the new Oliver Stone Presidential Movie , W ( based on George W Bush).

The tickets cost some 7 $ and 9 $ , and that seemed a lot compared to the Indian multiplexes that cost around 150 rs or 3 $. Thanks to this I decided to fore go my boss’s advice on eating pop corn or sodas ( mostly Coke). Instead I would just grab a bite in the evening social.

On entering the movie theatre – I was really astounded. I mean the theater was BIG, it had some 20 odd screens. Easily the biggest theater I even went to- but that point would be lost if you see the new upcoming theatres in India. For the first fifteen minutes I actually went up and down the place looking for the screen which I was supposed to be seated in. Finally I found the place.

Max Payne starred the Oscar winning actor Mark Wahlberg ( of the Departed and  Marky Mark fame) so I was hoping to watch a decent all male violent action standard Hollywood movie. The theatre hall was a bit deserted , which is understandable for an afternoon flick and there were some couples ( looking like teenagers) giggling and murmuring in the edges of the back rows. That was something that is now universal and so I turned attention to the screen. 

The movie was preceded by a song by Kid Rock , which mixed Nascar racing Iraq War glimpses and good old rock into a heady recruitment song called ” The Warrior”. I could see the middle class kids in front of me, especially the male ones, nod their heads to the catchy tune.Heck, I would have signed up for the National Guard , bu the time the song ended.

Fortunately, the movie began, and we settled down to watch Mark Wahlberg, one fine young actor of the male violent genre get into his role of an avenging detective on the run, while paired with a beautiful girl. The plot was as predictable as a Bollywood movie with none of the song and dances unfortunately.

Max Payne lived up to its name. It pained me to the maximum extent. After watching the bizarre tale (it’s based on a video game)  the audience and I couldn’t help but rushing out for a breath of fresh air – as if eager to leave the countless explosions behind us. As I brushed against one white teenager, he looked at me and said- ” Man, best movie I ever saw”. That sardonic comment almost made up for the time wasted.

I walked back to the Hyatt Austin Arboretum. I bumped into the front desk lady, Paris , who was nice ,pleasant  and around 40 sh. ” So how was the movie and which movie did you see ?”.

“Max Payne-dd”  I said, stressing the D a bit too loud. ” But that’s a terrible movie, said Paris. My son watched it yesterday and it’s all weird”. 

“Great, I thought. There goes 7 dollars.

I am watching “W” next, I told Paris. ” Now that’s an interesting movie, said the front desk lady. ” Best of Luck”.

I was thinking of taking a plateful of turkey ( no religion aggravating beef , no stomach aggravating ham) and a beer glass from the free 5 o clock social, but it turned out to be Friday with no social for that day. The quantity of food served and wasted in America had ceased amazing me a week back. 

After a brief rest, I went back for the seven O Clock and the Nine dollar movie.

Now a bit of background about W. The time of watching this movie was October 2008, the atmosphere was charged up with Obama and McCain in a fierce battle to be the inheritor of crisis-es from the current United States President.Texas , Austin is almost all white , with a smattering of Hispanic people ( who mostly do the lower end jobs – it seemed like an agreement to divide labor not unlike our caste system in India).

George W Bush was a popular Texas two time Governor until 1999, and the state of Texas is considered a red state ( it mostly votes Republican – who have a red color). The tendency of the media to paint the country red, blue,purple,white,black,yellow ( but fortunately not brown) led to a feverish charged up atmosphere.

I went in the hall with trepidation- half expecting to be lynched if the movie turned bad.

What followed was sheer Hollywood magic as George W Bush’s Yale University classmate delivered a subtle yet powerful movie. 

To be continued-

This is an extract from the book ” Flying with the Cougars” . I am publishing extracts as an experiment. All rights and copying rights reserved with Ajay Ohri.

R for Recession

Here is how you can use R ( the software) to beat recession.

A new plugin just came out by Li for WordPress pages for R Web Interfaces.

http://lixiaoxu.lxxm.com/rwebfriend/

You can also do R analysis straight from the Web here –

 

http://pbil.univ-lyon1.fr/Rweb/

 

Using R for The Web Interfaces ( http://cran.r-project.org/doc/FAQ/R-FAQ.html#R-Web-Interfaces) ,hosting them on a cloud environment ,using encryption and compression through the Ohri Framework ( see http://www.decisionstats.com/?p=217)

you can extend the use of R for not only scoring models as Zementis (www.zementis.com ) currently does , but also building them online .

All you would need is Ubuntu Linux (www.ubuntu.com) , and a fast web connection.

Thats it- No fast servers, No Windows Licenses, No Analytical Licenses at all needed.

And someone to build all the above- any takers ?

 

Note- I retain authorship of the idea- Ohri framework .

 

IDEA_

1) Use encryption and compression software on data

2) Upload compressed data to R Web Interface Server hosted on cloud computer

3) R Web Interface decompresses and decrypts the data before executing the statistical analysis using appropriate package.

4) View Analysis online or download graphics

5) Encrypt and compress scored data ( in case of regression scoring for propensity scoring or risk modeling)

6) Download scored data and decrypt and decompress.

You can cut the download and use the web for straight online scoring , but that would require a private cloud.

Life's Little Instruction Book……………………

 


 Have a firm handshake. 
 Look people in the eye. 
 Sing in the shower. 
 Own a great stereo system. 
 If in a fight, hit first and hit hard. 
 Keep secrets. 
 Never give up on anybody. Miracles happen everyday. 
 Always accept an outstretched hand. 
Be brave. Even if you’re not, pretend to be. No one can tell the 
difference. 
 Whistle. 
 Avoid sarcastic remarks. 
 Choose your life’s mate carefully. From this one decision will come 90 
per cent of all your happiness or misery. 
 Make it a habit to do nice things for people who will never find out. 
 Lend only those books you never care to see again. 
 Never deprive someone of hope; it might be all that they have. 
 When playing games with children, let them win. 
 Give people a second chance, but not a third. 
 Be romantic. 
 Become the most positive and enthusiastic person you know. 
 Loosen up. Relax. Except for rare life-and-death matters, nothing is 
as important as it first seems. 
 Don’t allow the phone to interrupt important moments. It’s there for 
your convenience, not the caller’s. 
 Be a good loser. 
 Be a good winner. 
 Think twice before burdening a friend with a secret. 
 When someone hugs you, let them be the first to let go. 
 Be modest. A lot was accomplished before you were born. 
 Keep it simple. 
Beware of the person who has nothing to lose. 
 Don’t burn bridges. You’ll be surprised how many times you have to 
cross the same river. 
 Live your life so that your epitaph could read, No Regrets 
 Be bold and courageous. When you look back on life, you’ll regret the 
things you didn’t do more than the one’s you did. 
 Never waste an opportunity to tell someone you love them. 
 Remember no one makes it alone. Have a grateful heart and be quick to 
acknowledge those who helped you. 
Take charge of your attitude. Don’t let someone else choose it for 
you. 
Visit friends and relatives when they are in hospital; you need only 
stay a few minutes. 
 Begin each day with some of your favorite music. 
 Once in a while, take the scenic route. 
 Send a lot of Valentine cards. Sign them, ‘Someone who thinks you’re 
terrific.’ 
Answer the phone with enthusiasm and energy in your voice. 
Keep a note pad and pencil on your bed-side table. Million-dollar 
ideas sometimes strike at 3 a.m. 
 Show respect for everyone who works for a living, regardless of how 
trivial their job. 
 Send your loved ones flowers. Think of a reason later. 
 Make someone’s day by paying the toll for the person in the car behind 
you. 

 Become someone’s hero. 
 Marry only for love. 
 Count your blessings. 
 Compliment the meal when you’re a guest in someone’s home. 
 Wave at the children on a school bus. 
 Remember that 80 per cent of the success in any job is based on your 
ability to deal with people. 
 Don’t expect life to be fair.
Source-(From a email sent )

Life’s Little Instruction Book……………………

 


 Have a firm handshake. 
 Look people in the eye. 
 Sing in the shower. 
 Own a great stereo system. 
 If in a fight, hit first and hit hard. 
 Keep secrets. 
 Never give up on anybody. Miracles happen everyday. 
 Always accept an outstretched hand. 
Be brave. Even if you’re not, pretend to be. No one can tell the 
difference. 
 Whistle. 
 Avoid sarcastic remarks. 
 Choose your life’s mate carefully. From this one decision will come 90 
per cent of all your happiness or misery. 
 Make it a habit to do nice things for people who will never find out. 
 Lend only those books you never care to see again. 
 Never deprive someone of hope; it might be all that they have. 
 When playing games with children, let them win. 
 Give people a second chance, but not a third. 
 Be romantic. 
 Become the most positive and enthusiastic person you know. 
 Loosen up. Relax. Except for rare life-and-death matters, nothing is 
as important as it first seems. 
 Don’t allow the phone to interrupt important moments. It’s there for 
your convenience, not the caller’s. 
 Be a good loser. 
 Be a good winner. 
 Think twice before burdening a friend with a secret. 
 When someone hugs you, let them be the first to let go. 
 Be modest. A lot was accomplished before you were born. 
 Keep it simple. 
Beware of the person who has nothing to lose. 
 Don’t burn bridges. You’ll be surprised how many times you have to 
cross the same river. 
 Live your life so that your epitaph could read, No Regrets 
 Be bold and courageous. When you look back on life, you’ll regret the 
things you didn’t do more than the one’s you did. 
 Never waste an opportunity to tell someone you love them. 
 Remember no one makes it alone. Have a grateful heart and be quick to 
acknowledge those who helped you. 
Take charge of your attitude. Don’t let someone else choose it for 
you. 
Visit friends and relatives when they are in hospital; you need only 
stay a few minutes. 
 Begin each day with some of your favorite music. 
 Once in a while, take the scenic route. 
 Send a lot of Valentine cards. Sign them, ‘Someone who thinks you’re 
terrific.’ 
Answer the phone with enthusiasm and energy in your voice. 
Keep a note pad and pencil on your bed-side table. Million-dollar 
ideas sometimes strike at 3 a.m. 
 Show respect for everyone who works for a living, regardless of how 
trivial their job. 
 Send your loved ones flowers. Think of a reason later. 
 Make someone’s day by paying the toll for the person in the car behind 
you. 

 Become someone’s hero. 
 Marry only for love. 
 Count your blessings. 
 Compliment the meal when you’re a guest in someone’s home. 
 Wave at the children on a school bus. 
 Remember that 80 per cent of the success in any job is based on your 
ability to deal with people. 
 Don’t expect life to be fair.
Source-(From a email sent )

Indian Marriage Economics

On a much deserved break from analyzing numbers and economies , the family and I headed out to a neighbour’s wedding. This is November , and peak time in the Indian Marriage season. However I could not help but noticing the folowing things while at the wedding-

  1. People in Indian weddings mostly wear clothes of all colors , unlike the West where Black is worn by the Groom and his men , while the Bride wears white. Here almost all ladies are festooned in rainbow colored silks and flash golden (real and fake) jewellry. This has a noticeable effect on Gold prices ( almost all imported in India) and clothes ( almost totally made in India and exported too)
  2. Thanks to municipal regulations – weddings in the capital ,Delhi have to me only in community halls and licensed wedding halls. Weddings in farmhouses are banned. This has led to huge shortage of wedding spaces in the capital area, leading to almost all open air weddings being conducted in the sub urbs. The shortage of wedding places is due to lack of planning by urban planners from the pre liberalized India, whoi could not figure out the annual growth rate of population in Delhi  would also lead to an annual growth rate of weddings in Delhi.
  3. There are 365 days in an year but Indian weddings can only be made in certain auspicious days as per the collective Hindu priestdom , which though much impoverished today , earns principally during the wedding times . This also leads to shortage of space in Wedding season and hence an artificial price hike in the booking of marriage spaces. During lean season ( apparently Planet Shani or Saturn has something to do with it in Hindu astrology), the wedding spaces and caterers do lookout for Muslim ,Sikh and Christian weddings ( together 15 % of India’s population- numbers for Delhi not updated). No link has been found in either Hindu priests or the wedding planners but some cartelization seems a possibilty as they gain from the artifical shortage of days on which you can get married. Co relation however is not causation.
  4. If you disbelive this – my own wedding got postponed by 2 months while I waited for the planets to get back on track.
  5. The various vendors and sub contractors in an Indian wedding are
    1. Horse Minder and Horse ( Hindu Grooms come riding on a Horse. Very romantic but quite painful I assure you for the groom. The pain seems delibrate as India has the lowest rate of divorces and re marriages.
    2. Caterer of Food ( Seperate Charges for Vegetarian and Non Vegetarian with Non Vegetarian food quite expensive.)Food is generally charged per plate with a minimum committment. Charges can range on a median of 400 Rs per plate. Thats 8 dollars a plate ( Rupee got depreciated again)
    3. Tent Chap – One who puts up the big tent
    4. Flower People – Literally Flower people
    5. Wedding Space rent
    6. Clothes ( Specialized Saree sellers loved by women and universally hated by the men who have to pay for the sarees and cant make out the difference between dark blue and ..mauve.
    7. Jewellers- India remians the largest importer of Gold. It has the highest per capita gold consumption. Part of the culture. Funnily it makes sense to keep money in Gold and hand it down from generation to generation.
    8. Music Dj – who plays the Indian Bollywood songs and in Northern Urban India a lot of Punjabi music
    9. Photographers and Video graphers
    10. Very few professional wedding planners for most middle class weddings. This is thanks to the Indian penchant for saving money and also because of economic reason ( see below)
  6. Enormous money is pumped in Indian weddings compared to the Indian per capita income ( 800 USD PER YEAR ). It makes the weddings more memorable. Adds to the pain so people stay married and avoid divorces.

Thats all for this week. The Dow has crashed again, the rupee has crossed 50 per dollar, Oil has fallen below 50 USD, and US congress is now re thinking on the auto bailout.Gold prices internationally remain confused and Indian inflation fell to 8.9 %. Indian bankers continue to ask for a rate cut while the central bankers continue to smile like the Buddha.

Recessions come and go but as long as people get married again and again life continues.

Happy Thanksgiving !!

SQL and Hadoop: What is this cloud thing

Here is a very good ,in fact brilliant post from Joe Hellerstein, a Professor of Computer Science at UC Berkeley at http://radar.oreilly.com/2008/11/the-commoditization-of-massive.html

It explains the difference between the two databases type.

 

Enterprise IT camp tends to favor relational databases and the SQL language, while the web upstarts have rallied around the MapReduce programming model popularized at Google, and cloned in open source as Apache Hadoop. Hadoop is in wide use at companies like Yahoo! and Facebook, and gets a lot of attention in tech blogs as the next big open source project. But if you mention Hadoop in a corporate IT shop you are often met with blank stares — SQL is ubiquitous in those environments

 

Setting aside the trash talk, the usual cases made for the two technologies can be summarized as follows:

Relational Databases

  • multipurpose: useful for analysis and data update, batch and interactive tasks
  • high data integrity via ACID transactions
  • lots of compatible tools, e.g. for loading, management, reporting, data visualization and mining
  • support for SQL, the most widely-used language for data analysis
  • automatic SQL query optimization, which can radically improve performance
  • integration of SQL with familiar programming languages via connectivity protocols, mapping layers and user-defined functions

MapReduce (Hadoop)

  • designed for large clusters: 1000+ computers
  • very high availability, keeping long jobs running efficiently even when individual computers break or slow down
  • data is accessed in "native format" from a filesystem — no need to transform data into tables at load time
  • no special query language; programmers use familiar languages like Java, Python, and Perl
  • programmers retain control over performance, rather than counting on a query optimizer
  • the open-source Hadoop implementation is funded by corporate donors, and will mature over time as Linux and Apache did

Hadoop is still relatively young, and by all reports much slower and more resource intensive than Google’s MapReduce implementation.

What I liked about the article was explaining Hadoop in simple terms to corporate SQL types like me.

It’s interesting how Hadoop would be configured on the NVidia Tesla supercomputer ( at 10000 USD)

 

– Update – Mathematica is already being modified for the GPU versus CPU system, and there was an interesting discussion in R _help list today on this.

Mathematica is launching a version working with Nvidia GPUs. It is claimed that it’d make it
~10-100x faster!
http://www.physorg.com/news146247669.html

Laptops and SuperComputers

The One Laptop per Child project is having its annual give get one promotion. Basically you pay 400 $ , you get one XO laptop free and another XO laptop is donated in your name in a devleoping country. For the technically minded ,here is a great review of the XO laptop at http://www.bunniestudios.com/blog/?p=218

 

On a slightly different scale is the NVidia GPU ( as opposed to CPU powered computers). They are available here at http://www.nvidia.com/object/wtb_notebooks.html

These and the forthcoming series of NVidia powered GPus are going to give extremely high speeds within a price range of 10,000 USD. How high is the speed ?

Well here is a case study from the NYT "

Techniscan Medical Systems of Salt Lake City has turned to Nvidia’s graphics processors to speed up a three-dimensional breast scanning device that could be used for cancer detection if the machine received regulatory approval. Techniscan must turn tens of gigabytes of raw data generated by transmitting pulses of energy through a breast submerged in water into medical image files that consume just 100 megabytes. This whole process used to take a couple of hours using Intel’s processors and now takes just 15 minutes with Nvidia’s hardware."

 

And here is finally your desktop supercomputer, the Tesla from Nvidia.

http://www.nvidia.com/object/personal_computing.html

"Get your own supercomputer. Experience cluster level computing performance—up to 250 times faster than standard PCs and workstations—right at your desk. The NVIDIA® Tesla™ Personal Supercomputer is based on the revolutionary NVIDIA® CUDA™ parallel computing architecture and powered by up to 960 parallel processing cores."

Now data mining and analytics people love processing power. With this much processing power  it can be quite a lot of fun !

So if you deal with data more than 1 Gb at a time or have more than 10 Pcs, or 2 servers, try the Tesla.

Tesla Architecture

  • Massively-parallel many-core architecture
  • 240 scalar processor cores per GPU
  • Integer, single-precision and double-precision floating point operations
  • Hardware Thread Execution Manager enables thousands of concurrent threads per GPU
  • Parallel shared memory enables processor cores to collaborate on shared information at local cache performance
  • Ultra-fast GPU memory access with 102 GB/s peak bandwidth per GPU
  • IEEE 754 single-precision and double-precision floating point
  • Each Tesla C1060 GPU delivers 933 GFlops Single Precision and 78 GFlops Double Precision performance

Software Development Tools

  • C language compiler, debugger, profiler, and emulation mode for debugging
  • Standard numerical libraries for FFT (Fast Fourier Transform), BLAS (Basic Linear Algebra Subroutines), and CuDPP (CUDA Data Parallel Primitives)

Product Details

  • 3 or 4 Tesla C1060 Computing Processors with 4GB of dedicated memory per GPU
  • 2.33 GHz+ Quad-core AMD Phenom or Opteron, — OR — Quad-core Intel Core 2 or Xeon
  • Minimum system memory: 12 GB for 3 Tesla C1060s and 16 GB for 4 Tesla C1060s (at least 4GB per Tesla C1060)
  • 12GB+ system memory (at least 4GB per Tesla C1060)
  • 1200-1350 Watt Power supply
  • Acoustics < 45dbA

Supported Platforms

  • Microsoft® Windows® XP 64-bit and 32-bit (64-bit recommended)
  • Linux® 64-bit and 32-bit (64-bit recommended)
    • Red Hat Enterprise Linux 4 and 5
    • SUSE 10.1, 10.2 and 10.3

Source-http://www.nvidia.com/object/tesla_supercomputer_tech_specs.html