Thursday, 18 December 2008

Chasing SRK

Last month my cousins were over from the UK. So as part of the Mumbai tour, we hung outside Mannat - Shah Rukh Khan's villa at Bandstand- for a dekko. To no avail - all we got was overhearing one security guy telling another that "Saab abhi nikala hai. Dhyaan rakhna".

We did however get a peak at his fleet of BMWs from the gate of the complex (the one on the side road which leads up to Mount Mary Church). This led rise to us discussing the newspaper report that SRK's cars are all BMWs numbered 555.

Moving on from Bandstand, we went off for dinner and a drive later along Carter Road around 11:30 pm.

Suddenly a vehicle zoomed past us - and my cousin quite casually mentioned - "Hey there's a silver BMW ending in 555 - Didnt you say SRK drives in one of those?"

"Oh is it really him?"

"Let's follow that car"

So we revved up behind the car - honking off a rickshaw and everything else that appeared in between. Getting closer - we saw the car led by a Gypsy with blinking lights and 3 security guys. Also the BMW was a 7-series sedan - so good chances that this was SRK's car with him in it.










We caught up soon enough (or rather they got bogged down in the traffic on Perry Road) and we finally stopped at the red signal - parked parallel to this car. My wife and cousins waved and danced like true mad fans - yelling "Shah Rukh Shah Rukh" - hoping he'll pull down the dark windows and wave back.

Well - the story ends on that disappointing note. After probably observing us for some time (and ensuring we're just crazy fans and not a threat - sure the security recorded my car number as well) the BMW and Gypsy cars cut through the red signal and drove off. We thought of following but noticed the 2 traffic policemen standing just ahead of the signal.

We drove back home all hugely disappointed - "Arrey Hum Bhi Santrowale hai *" so he could have allowed us a smile or a wave.

* - SRK is the brand ambassador for Hyundai Santro and the tagline for the earlier ads was Arrey Santrowale hai

And were we behind the wrong car?
Luckily a quick Google search on the car number MH 02 AU 555 solved that one. I got the photo below on a blog site.



Tuesday, 16 December 2008

The Sachin Effect - Ind v England Chennai 2008

The day after Sachin Tendulkar did it. Helped India chase down 387 and hit a boundary on 99 to make a century as well as the winning runs.

As the last 4 was hit, Anil - my Code Red* partner-in-crime instantly messaged me - "Abhi 2 action point jyaada mila to bhi chalega"

Yes - that's the effect Sachin has on us. The feel-good factor when he plays well and India wins.
What's happened for Indian cricket on Dec 15th 2008 is the sort of thing you feel you'll never get to watch ever. SRT batting a fourth innings century and India winning the game.
Come on - break Lara's 400* too before you retire !

  • Congrats also to Yuvraj who stopped hitting the boundaries at 80* and leaving enough runs for SRT to get to his hundred.
  • Thanks to Monty Panesar and Swann for not bowling 4 wides to finish the match - and actually leaving 4 runs for India to bat at the end.
  • Congrats to the people(match referee?) who selected Sehwag for the deserved Man-of-the-Match and didnt get senti enough to give it to Sachin
  • The emotional scenes when all the ground staff swamped SRT after the game ended. Truly touching.
  • Poignant that Sachin dedicated his innings to Mumbai - as his RBS ad affirms "I play for India now more than ever"

And finally this classic comment on the BBC forum during the chase
"my beloved England are heading for another disappointing flat ending. We couldn't kill off a half dead runover cat with a placard in it's hand saying "do us a favour mate and kill me off"..


(*Note - My current project is in a spot of bother, hence Code Red)

Tuesday, 25 November 2008

Simultaneous Solaris T2000 core dumps on local zones

Issue:

Our applications run on Sun T2000 servers which are configured with 4 or 5 Local zones on each Global Zone.

17th November 05:00 there was an issue on one Global Zone which caused 5 separate and simultaneous core dumps to get created on the server. One core in each Local zone.




Impact:
The 5 processes which crashed on each Local zone were

LZ 15 – core created by the wlshell java process. Low impact
LZ 27 – one core created by wlshell java processes. Low impact.
LZ 25 – core created by HM server java process. Was manually restarted today. Medium impact
LZ 26 – core created by PA server java process. This was automatically restarted by the HM. High impact.
LZ 37 – core created by HM server java process. Was manually restarted today. Medium impact




All 5 crashes above were in Library=/platform/sun4v/lib/libc_psr.so.1

Each core exits with a hs_err_.log file - which contains the foll details

An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : 10 occurred at PC=0xFF2709F0
Function=_memset+0x70
Library=/platform/sun4v/lib/libc_psr.so.1

Current Java thread:
at java.lang.Thread.start(Native Method)
- locked <0xf1f3a378> (a java.util.logging.LogManager$Cleaner)
at java.lang.Shutdown.runHooks(Shutdown.java:126)
at java.lang.Shutdown.sequence(Shutdown.java:165)
at java.lang.Shutdown.exit(Shutdown.java:210)
- locked <0xf5998498> (a java.lang.Class)
at java.lang.Runtime.exit(Runtime.java:90)
at java.lang.System.exit(System.java:715)
at ConsoleScriptRunner.main(ConsoleScriptRunner.java:64)


Investigations


1. Seems to be running out of swap at the time of the crash. Memory: 31.9G real, 4.0G free, 37.7G swap in use, 2.4G swap free
Update: added 50 G swap on 19/11 - Memory: 31.9G real, 3.4G free, 38.0G swap in use, 52.8G swap free


2. Application Support is identifying what the wlshell process does – it seems to be a Weblogic server monitoring script running every 10 minutes under cron.


3. Library=/platform/sun4v/lib/libc_psr.so.1 Are there any known issues with this library on solaris 10 or T2000? Support to query SUN


The libc_psr libraries implement platform-specific, optimized versions of block copy and move routines from libc, such as memcpy(). On UltraSPARC machines, these routines are coded in assembler, and use block load and store ASI's, prefetch, and other tricks for better performance.


Root Cause

Sun identified that the issue was related to known bugs in JDK 142_03 and running an old version of libc_psr.so

The ( a) type error as seen in hs_err_pid6216_18111030.log the error was a know java bug with the j2sdk1.4.2_03 and the bug is identified as :


Bug ID: 4927116 fixed in 1.4.2_04 Synopsis Regression: 1.4.2 JVM core dumps in ClassLoader.defineClass0()

Actions

1. Immediate action is to upgrade to JDK 142_18

2. Also identified that all 5 core dumps were created by sh scripts running under crontab. Further analysis showed that there were cron jobs running every 15 mins on each of the zones - and this puts a load on system resources especially around memory consumption in the JVM and sufficient unhanded exceptions between the java virtual machine and the operating system could cause the then dead locked JVM to terminate .


Thus the 2nd resolution was to offset the start time of each cron job - to try and ensure no two jobs run on the same Global Zone at the same time.


Old Timings:

0,15,30,45 * * * * /export/home/Handlers.sh > /tmp/Handcheck
0,15,30,45 * * * * /export/home/Average_response_time.sh > /tmp/Avgcheck
0,15,30,45 * * * * /export/home/Msg_In_and_Out_count.sh > /tmp/Mescheck
0 0,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23 * * * /log/zipper.sh


New Timings:

1,16,31,46 * * * * /export/home/Handlers.sh > /tmp/Handcheck
2,17,32,47 * * * * /export/home/Average_response_time.sh > /tmp/Avgcheck
3,18,33,48 * * * * /export/home/Msg_In_and_Out_count.sh > /tmp/Mescheck
4 0,2,4,6,8,10,12,14,16,18,20,22 * * * /log/zipper.sh


Also knocking off unnecessary cron jobs from the box to reduce the load.

Wednesday, 22 October 2008

Car journey to Shirdi



We travelled to Shirdi last weekend - took my own car along for a good self-driven road trip.

The road is quite straightforward - from Mumbai take the Eastern Express Highway to Thane and Bhiwandi. This is the NH3 to Nashik, but we took a route avoiding Nashik. Left from home at 7:30 am.
First stop was for snacks at Manas Resorts Igatpuri at around 10:30 am. The resort has been nicely done-up and looks a good spot for a weekend getaway a la Fariyas.







7 km after Igatpuri is the town of Ghoti which has a bypass road to Sinnar, which avoids Nashik completely. There is a board on the highway pointing to a right turn to Ghoti. The off-road leads through a market for about 2 kms, but ask for directions to Sinnar/Shirdi if confused. It leads to a railway crossing and a toll booth later - and then the bypass road smoothens out.
This route was a scenic drive through some unspoiled lands. The photos show the windmills and lakes seen along the Ghoti-Sinnar bypass road. Another advantage was no high-speed overtakers on this route, since the road is well-hidden. There are no boards informing you of this route, and you get 60 kms of peaceful leisurely driving.

At Sinnar, you rejoin the SH10 which is a straight road to Shirdi. Back to the superfast buses and crazy drivers. We reached Shirdi at 2:15 pm and quickly found a hotel for ourselves.
The Hotel Sai Baba International - which is right opposite the main gate of the temple complex. The rooms were adequate, 3 star hotel with clean facilities.




Road distances:
Andheri East - 0 Km
Ghatkopar on EEH - 13 Km
Shahapur - 74 Km
Igatpuri - 124 Km
Ghoti - 131 Km
Sinnar - 190 Km
Shirdi - 250 Km

The journey took 7 hours on the way out, but we spent 1.5 hours in breaks.
The return was quicker since we knew the route well, 6 hours in all including lunch at Foodplaza beyond Igatpuri (Avoidable!) .

Tuesday, 14 October 2008

St Alphonsa canonized


There's been lots of news recently over Sr. Alphonsa - a Catholic nun from Bharananganam, in Kottayam district, Kerala being proclaimed a Saint on Oct 12th 2008. She will now be known as St Alphonsa of the Immaculate Conception. This is newsworthy since she is the second saint from India and the first woman.
Many would have expected Mother Teresa to be the first woman from India - but things dont move so fast in the Vatican - St Alphonsa has been canonized 62 years after her death.


I was watching the news on Sunday - CNNIBN I think it was - an over-excited reporter outside Mahim church had found a Kerala-ite lady who "had actually been to the church of St Alphonsa" and was asked in true AajTak style - "How do you feel about it?" "Kaise mehsoos ho raha hai"types.

As over-the-top as that was - it truly hit me then how proud a moment it was for people like myself and my family - those who have a small (and I mean really small) association with this saint, the town and the church. Bharananganam is a town 4 kms away from my mom's native place of Edamattom in Kottayam district, Kerala. My mom has in fact studied in the same convent school attached to this church - and when she was a student, there was the buzz around the church and convent - that of Sr Alphonsa - the recently passed away nun who led a simple and pious life. She was a model for all other girls to follow and this was part of the school's christian studies too.

Sr Alphonsa was beatified by Pope John Paul II on his India visit in 1986. [Beatification is the penultimate step in the process of sainthood]. This led to the mass following there is now - the hope that she will be declared a saint one day - and that she will intercede and miracles can happen. Throughout my childhood, we used to regularly visit the church on each visit to Kerala. This has continued till today - and is one of the things we do without fail.

I think the difference now that she has become a Saint - means Christians from all over India and even abroad will now make this a pilgrimage place. Similar to St Francis Xaviers church in Goa and Vailankanni in Tamil Nadu. So the roads have been widened, the town painted. On my last visit, the church had been restored and the gardens had been replanted completely. The church becomes a pilgrimage centre and the town prospers too. Since this is in Kottayam, a visit to the church might soon be added on tour itineraries along with the Kumarakom lake and houseboat rides.
I do hope things remain as they were - small and simple. Not turning into the commercial circus most religious places become.


Well time will tell.