Archive for February, 2013

మహా మాఘి

February 24, 2013

విన్నపమాలకించు రఘువీర! నహిప్రతి లోకమందు నా
కన్న దురాత్ముడున్, బరమకారుణికోత్తమ వేల్పులందు నీ
కన్న మహాత్ముడున్ బతితకల్మషదూరుడు లేడు  నాకు వి
ద్వన్నుత నీవె నాకు గతి, దాశరథీ కరుణాపయోనిధీ

vinnapamAlakincu raghuvIra nahiprati lOkamandu nA
kanna duraatmuDun baramakAruNikOttama vElpulandu nI
kanna mahAtmuDun batitakalmashadUruDu lEDu vi
dvannuta nIve nAku gati dASarathI karuNApayOnidhI

శ్రీ రామదాసు యొక్క ఇదే భావాన్ని శ్రీ కృష్ణ శతక కర్త ఇలా

రఘునాయక నీ రూపము
లఘుమతితో దలప గలనే లక్ష్మీ రమణా
అఘముల బాపుము దయతో
రఘురాముడవైన లోక రక్షక, కృష్ణా!

O RaghuNAyaka, dASarathI, SrI rAmA! there is no one better than you( Thou – is the real self, Atma) in compassion (karuNa) and who can cleance the aghamu (sins) of devotee. At the same time there is no one who is a great sinner than me (me here represents the ignorant ahamkAra, ego which thinks itself as atma or soul) over here. Thy grace, thy name is the only path for me to cleance me of my sins (of ahamkAra and Ignorance)

Past post on this subject: http://nonenglishstuff.blogspot.in/2011/02/blog-post_18.html

mahA mAghi on 25th February 2013. Let the grace of Lord be on one and all and bad impacts of past bad deeds be removed for all those who surrender to Lord.

Advertisements

Data agility in Master Data Management

February 22, 2013
Recently, I came across few master data management implementations and database performance problems related to them. 
What is master data management (MDM): It is a set of processes to centralize the management of “master data” i.e, the reference data for a given business. It typically consists of Customers, Agents, and Products for an insurance company.  Typically an MDM instance focuses on one data domain. If we focus on Customer domain the implementation is called as Customer Data Integration or when the domain is Products it is called as Product Information Management.
When it comes to Insurance industry, even though the “customer centricity” has been the latest trend, traditionally it has been a “agent” driven business. So, one key subject area for MDM is “Agent Data” which actually sells “Products” to “Customers”. For generalization we can call this as “Channel Master Data.” So we have three subject areas to deal with in a multi-domain-MDM implementation.
The processes include:
1.       Data acquisition (Input)
2.       Data standardization, duplicate removal, handling missing attributes (Quality)
3.       Data mining, analytics and reporting  (Output)
The industry tools have standard data and process models for customers and products to achieve the required functionality of MDM. We can adopt some customer model to model the agent domain or keep both in a “party” domain.
The problem with multi-domain MDM:
Here comes the problem. When it comes to agent domain, the customer requirement states “get me the agent and his top n customers acquired” or “get me the agent and his top n products sold”
In a renowned MDM product an SQL query need to join 20+ tables (involving some outer joins) to achieve the requirement and even after caching all the tables in-memory the processing for each agent id is taking 20+ seconds on an Oracle 11.2 database on a decent production sized hardware. 
a)      Dynamically querying for such data and building the structure of data into target structure puts more load/ adds latency to the screen. SLA is not met.
b)      Pre-populating the data with a periodic refresh in a materialized view does not make the data current to the real-time.
As we can’t have both requirements of getting the data in 2sec and it is to be current in traditional design, we need to design a hybrid approach.

Any ideas or experience in this are welcome. Have anyone implemented a MDM solution on a NoSQL database yet?

“Progression” as it were!

February 21, 2013

SrI nandana nAma samvatsara mAgha Sukla EkAdaSi – bhIshma EkAdaSi marks another circumambulation of the tiny self on this Earth around the universal self – Sun.   

The seed of life on earth is Sun, the food that sustains life here is Sun, one who devours life on Earth is Sun as well. There is no way that the universality/unity of Sun’s nature is no way distinct from the diversified picture seen here on the Earth with huge variety of ecosystems in the water, on the land and in the air. Forests, rivers, societies, countries, cultures, wants, needs, fights, wars, construction and destruction everything appear to happen only due to the light of Sun and only to the subtle life force that acts in the Eye of the being witnessing all these things.

In this modern world, all the confusion seems to be caused by two misconceptions.

1.       You only live once

2.       It’s my life

Life is eternal and it animates multiple bodies across multiple worlds depending on each one’s desires and actions. Only due to unconditional compassion of Lord a being appears at a suitable place for a suitable period of time to enjoy/suffer the results of its own thoughts/words/deeds. Lord gives innumerable chances to any being to realize the ultimate and “human form” is the best suited to do so. To born as a man is a great privilege earned through the compassion of God.  So, the misconception of “You only live once” causes unnecessary hurry to enjoy things and results in over consumption and over production causing a lot of damage to the “nature” of God.

All life is connected wherever it is. The air that we breathe is not bounded by any boundaries. The light we take for Sun is neither bounded, the water which flows as rivers is all due to the Sun’s heat that evaporates the water in the oceans and makes them as clouds. But everything is bound by the law of karma – one should be responsible for all the thoughts, words and deeds performed by him/her. All the results of such things resulting harm for another being beyond the allowance granted by God will have to be paid for. The legislation established by the Lord is unfailing and applies to each being equally here. So, the misconception of “It’s my life” causes harm to other beings and ultimately to the individual.

Life is eternal and connected. Living a simple, pious life leads to ultimate good for the individual leading him directly towards the highest knowledge of one-ness of everything.

“vAsudEvaH sarvam iti” is the right knowledge leading one to highest eternal bliss.

Om tat sat

భీష్మాచార్యుని చివరి ఉపదేశం

February 18, 2013

ప్రాణానుత్స్రష్టుమిచ్చామి తత్రానుజ్ఞాతుమర్హథ
సత్యేషు యతితవ్యం వః సత్యం హి పరమం బలం

అనృశంస్యపరైర్భావ్యం  సదైవ నియతాత్మభిః
బ్రహ్మణ్యైర్ధర్మశీలైశ్చ తపోనిత్యైశ్చ భారతాః

బ్రహ్మణాశ్చైవ తే నిత్యం ప్రాజ్ఞాశ్చైవ విశేషతః
ఆచార్యా ఋత్విజశ్చైవ పూజనీయా జనాధిప 

— అనుశాసనిక పర్వము 167 అధ్యాయము 49, 50, 52 శ్లోకాలు, భీష్మ పితామహుడు తనచుట్టూ ఉన్న భారతులతో

प्राणानुत्स्रष्टुमिच्छामि तन्मानुज्ञातुमर्हथ .
सत्ये प्रयतितव्यं वः सत्यं हि परमं बलम ..

आनृशंस्यपरैर्भाव्यं सदैव नियतात्मभिः .
ब्रह्मण्यैर्धर्मशीलैश्च तपोनीत्यैश्च भारत ..

ब्राह्मणाश्चैव ते नित्यं प्राज्ञाश्चैव विशेषतः .
आचार्या ऋत्विजश्चैव पूजनीया नराधिप ..

O Bharatas! (bha – light , rata – rejoice!)  I would want to bring up my life force away from this body; let me do so.

You should always protect the TRUTH as TRUTH alone is the highest power. You should be self-controlled, and be devoid of cruelty. Always protect Vedas, follow the dharma and always engage yourself in the tapas (of following swadharma)

O King! you should always revere brahmaNas, especially the wise-menAcAryas (those who teach by practicing) and Ritvijas (those who make you perform your duties as per the sAstra) and seek their guidance. 

— Bhishma AsThami today….(From anuSasana parva, 167th Adhyaya)

— The English meaning is my own translation from mahamahOpAdhyAya pullela SrI rAmaCandrudu gAri mahAbhArata sAra sangrahamu nunchi

రథ సప్తమి

February 16, 2013

నమస్సవిత్రే జగదేక చక్షుషే
జగత్ప్రసూతిస్థితినాశ హేతవే
త్రయీమయాయ త్రిగుణాత్మధారిణే
విరిఞ్చి నారాయణ శంకరాత్మనే
namassavitrE jagadEka cakshushE
jagatprasUtisthitinASa hEtavE
trayImayAya triguNAtmadhAriNE
viri~nci nArAyaNa SankarAtmanE

namaH = I bow down
savitrE = to savita (Sun the light giving God)
jagat-Eka-chkshushE = The only EYE of this world (who makes everything visible on the Earth world)
jagat prasUti, sthiti, nASa hEtavE = the primal cause behind “bringing out”, “sustaining” and “merging back” of the world appearances
triyI-mayAya = spread across the vedic triyI (Rk, yajur, sAma)
triguNAtma dhAriNE = one who holds three guNas – sattva, rajas, tamas [ sattva – the very being that sustains the earth its orbit. Rajas and Tamas are like light and heat of SUN which creates and devours all the life on the Earth ]
virinci – nArAyaNa – Sankara -AtmanE = one who is the SINGLE soul of “Creator Brahma”, “Lord nArAyaNa – the sustainer” and “Sankara – the transformer”

— ratha saptami very auspicious day for praying Sun God tomorrow mAgha Suddha saptami AdivAram

Measure, Metric and Key Performance Indicator (KPI)

February 15, 2013
In a BI project it is very important to design the system to confidently visualize the indicators that matter for business. Even senior BI professionals sometime get confused with the terms like measure, metric and KPI.
This post is to give some simple definitions for the hierarchy of KPIs:
Measure: is something that is measured like value of an order. Number of items on the order or lines of code or the number of defects identified during the unit testing. Measures are generally captured during the regular operations of the business. These are the lowest granularity of the FACT in the star schema.
Metric: What is metric? Metrics are generally derived from one or more measures. For example the defect density is the number of defects for 1000 lines of code in a COBOL program. It is derived from lines of code and number of defects measures. A metric can also be max, min, average of a single measure. Generally metrics are computed or derived based on the underlying facts / measures.
Performance Indicator: brings in the business context into the metric. For example reduction of defect density after introducing more rigorous review process (review effectiveness) could be a performance indicator in a software development context. In this case it reduces the rework effort of fixing the unit test bugs and re-testing thereby improving the performance of a software development organization.
A careful selection of KPIs and presenting them with suitable granularity to the right level of management users within the business makes a BI project be successful.
Bringing the data / measures from multiple sources into a star schema is typically ETL cycle of the warehouse. Once the data is refreshed, incrementally summarizing and computing all the metrics is the next stage. Finally visualizing the KPIs is the art of dash boarding.
I have seen several BI projects having problems mixing up all the three steps; trying to clean data during loading, trying to summarize the data into metrics during ETL or trying to summarize during the reporting phase causing multiple performance problems. A good design should try to keep the stages independent of each other and take care of issues like missing refreshes and duplicate refreshes from feeding source systems. Also need to consider parallelization of tasks to take advantages of multiple cores of processors and large clusters of computing resources.

శారదా భుజంగ ప్రయాత స్తోత్రం

February 14, 2013
(Photo from Sringeri.net)
 
జ్వలత్-కాంతి-వహ్నిం జగన్మోహనాంగీం
భజే మానస-అంభోజ-సుభ్రాంత-భృంగీం
నిజ-స్తోత్ర-సంగీత-నృత్య-ప్రభాంగీం
భజే శారదాంబాం అజస్రం మదంబాం
 
I praise mother SAradAMba, my mother eternal, shining with all the true essense of literature, music and dance (all fine arts), who roams around the lotus of mind like a bee (what roams around in the mind is knowledge!), who is a bright flame of fire (jnAnAgni – that can destroy ignorance / avidya) at the same time who can delude the whole world! (for those who mis-understand the world as an independent reality!)
 

SrI panchami tomorrow  (link to past posts) – http://nonenglishstuff.blogspot.in/2011/02/blog-post_08.html

http://nonenglishstuff.blogspot.in/2012/01/blog-post_28.html

Full stotra on stutimandal – http://www.stutimandal.com/gif_adi/sarasvati_bhujangam.htm

వృద్ధి – మోహం

February 10, 2013

సుప్రజ్ఞమపి చేచ్చూరమృద్ధిర్మోహయతే నరం
వర్తమానః సుఖే సర్వో ముహ్యతీతి మతిర్మమ

—- నహుషుడు యుధిష్ఠిరునితో, వనపర్వం 181 వ అధ్యాయం 30 వ శ్లోకం

suprajnamapi cEcchuuramRddhirmOhayatE naraM
vartamAnaH sukhE sarvO muhyatIti matirmama

— Nahusha to yudhishThira in mahAbhArata, vanaparvam, 181 adhyAyam 30 SlOkam.

However virtuous, How brave one is, prosperity (or growth i.e., vRddhi) deludes a person.
One who is going through the phase of happiness and enjoyments will be deluded is my (Nahusha’s) opinion.

Background: Nahusha was a virtuous king. Due to some unforeseen circumstances King of Gods (Indra) went into exile. All the gods selected Nahusha as the Indra due to his virtuous nature. Nahusha became Indara and started ruling the kingdom of Gods. In due course, Nahusha’s growth deluded his senses and he desired SacIdEvi, Queen of Indra also to be his wife.

Queen SacI went to Lord Brahma and requested for a upAya (technique / solution) to the problem. Brahma told her to ask Nahusha to come to her on a palanquin carried by the Rishis (realized sages). As the palanquin is being carried, Sage AgasThya was walking slow. Being deluded by desire, Nahusha kicked maharshi Agasthya saysing “Sarpa, Sarpa” (meas go fast, go fast)

Sage Agasthya thought Nahusha is not suitable anymore for the kingdom of Gods and cursed him to be a sarpa (a serpent that crawls). Hence Nahusha become a python and living on the Earth. As Nahusha requested for release from the curse to Sage, Agasthya told him “you will be released when dharmarAja, yudhisThira rightly answers your questions in dvApara yuga.

So, when BhIma is captured by Nahusha in python form, King Dharmaraja came to rescue BhIma. During the process of Nahusha – yudhishThira samvAda (discussion between Nahusha and YudhishThira) this verse appears.

— Today is an auspicious day of Pushya amAvasya (new moon day) with AdivAra (sunday) during the mahA kumbha mEla time.

Remembering Sage AgashThya, Nahusha and YudhisThira today and chanting Aditya hRdaya stotram, giving arghya to pitRdevas (manes) are highly meritorious activities for today. And they keep us grow without delusion.

Cloud Computing workshop slides

February 8, 2013

Cloud Computing – Foundations, Perspectives and Challenges workshop slides.

Present to BITES state level faculty development program at Mangalore today to around 60 faculty members from regional engineering colleges. 

Cloud prasad chitta_8th_feb2013 from Prasad Chitta

Few thoughts on Data Preparation for #Analytics

February 1, 2013
It is Friday and it is time for a blog post.
Typical analysis project spends 70% (- 80%) of time in preparing the data. Achieving the right Data quality and right format of data is a primary success factor of success of an analytic project.
What makes this task very knowledge intensive and why is a multifaceted skill required to carry out this task?
I will give a quick/simple example of how the “Functional knowledge” other than the technical knowledge is important in the preparation of the data. There is a functional distinction between missing data and non-existing data.
For example consider a customer data set. If the customer is married and the age of spouse is not available this is missing data. If customer is single, age of spouse is non-existing. In the data mart these two scenarios need to be represented differently so that the analytic model behaves properly.
Dealing with the missing data (data imputation techniques) within the data set while preparing the data impacts on the results of the analytical models.
Dr. Gerhard Svolba of SAS has written extensively on Data Preparation as well as Data Quality (for Analytics) and this presentation gives more details on the subject.
I have made a blog post earlier dealing with these challenges in the “Big data” world – http://technofunctionalconsulting.blogspot.in/2012/10/data-munging-in-big-data-world.html