A colleague recently told me, “NIRF rankings announcements are coming up. We will have a gala event, like last year, with tremendous publicity. These rankings are becoming our Oscars.” His remark crystallized for me some of my concerns with the NIRF (National Institute of Ranking Framework) ranking of higher education institutions. I believe rankings should be replaced by ratings, and these should be done by an independent agency.

Rankings accentuate competition. They anoint champions of tennis tournaments, winners of beauty pageants, fastest athletes in track races. Competitors not only want to win, some also want others to do poorly. Because they identify winners from a competitive choice set, rankings amplify zero-sum dynamics.

Academic contexts are not zero-sum settings. The best of academic institutions collaborate with their peers and build shared strengths. Ranking them competitively weakens the motivation to cooperate.

Rankings magnify the winner to the exclusion of everyone else. You might recall “Moonlight” won the Oscar for Best Film last month. How many of the eight other films nominated for Best Film can you recall? Because of asymmetric rewards, those being ranked go to extraordinary lengths to be highly ranked. This leads to two distortions in behavior: focus on measurements rather than goals, and susceptibility to herd mentality.

Since rankings are high-powered rewards, those being evaluated focus on what is being measured even to the possible exclusion of what is important. When schoolteachers were evaluated and rewarded based on their students’ test scores, although the students’ test taking abilities improved, their creative abilities, social skills, and love for learning declined.

Rankings reduce performance on multiple dimensions to a single ordinal number. When all are being measured on the same metrics with the same weights, ranking sensitive subjects eschew differentiation, and avoid experimentation and innovation.

Some higher education institutions are tailoring their strategy narrowly, others might be gaming in their reporting, with the objective of improving their NIRF rankings. When an institution reports area dedicated to sports in square feet rather than square yards, is it due to an honest error, or desire to raise NIRF score? I heard the director of a reputed institution justify to their alumni focus on activities, not because of their institutional value, but because they would improve rankings.

Since rankings raise the stakes, evaluators must ensure that criteria and measurement are robust. Although National Board of Accreditation (NBA) is valiantly administering NIRF, the mix of criteria remains fluid. For example, should research output of management institutions be recognized only if it is management research, or should it also include work done in core disciplines, such as economics, statistics, and psychology?

One of the criteria used to evaluate management institutes in 2016 measured their commitment to Massively Open Online Courses (MOOCs). MOOCs are valuable to education in India. However, given their high fixed cost and increasing returns to scale, MOOCs should be offered from only a few platforms. Making it a ranking criterion influences all institutions to invest in MOOCs, risking socially inefficient investments in subscale offerings.

Evaluation systems must be built on broad consensus on appropriate criteria and their weightages, as well as audit capability to ensure submissions are correct. Whether this can be done by a body subsidiary to Ministry of Human Resources Development (MHRD) is an open question.

Although it operates as an independent body, membership of various authorities of NBA suggests significant influence of the government, especially MHRD, on its operations. This leads to a concern of potential conflict of interests.

The shadow of NIRF rankings can induce overly compliant behavior from academic institutions. Even if entirely aboveboard in its actions, MHRD’s ability to influence rankings might be seen as compromising the independence of academic administrators.

So, what’s the way forward? Evaluating higher education institutions and publicizing how they stand on various criteria is useful. Education is an experience good whose quality is not easily understood by the public. A reliable, independent evaluation is socially beneficial.

The approach to evaluating academic institutions should be to rate, not rank them. Academic institutions should be measured against yardsticks, not against one another. Their evaluation should be akin to how hospitals, hotels, or professional bodies are measured, not how competitive sports events, pageant competitions, or horse races are conducted.

Ratings may create less buzz, but are more aligned to what the government is trying to achieve: encourage academic institutions to accomplish high quality standards and oversee the institutions in a way that differentiates between them based on quality.

To my knowledge, nowhere else in the world are rankings or ratings of academic institutions conducted by government bodies. To prevent politicking, and avoid even the appearance of conflict of interests, ratings should be done by a neutral, third party that is at a clear arm’s length from the government, as also from the institutions being ranked, and is seen as capable in evaluation and audit. This will only increase public trust in the ratings.

7 Responses to “Rate, Don’t Rank Academic Institutions”

  1. vapaokefijduw

    Cyst, [URL= – kamagra wo bestellen[/URL – student vigorous assumptions periosteum, iatrogenic, [URL= – levitra[/URL – cannabis hospitals, argued hyperlipidaemia, progression [URL= – northwest pharmacy canada[/URL – baby requesting pharmacy online cialis tropics, complaining canadian pharmacy cialis 20mg stones; usa viagra pharmacy [URL= – zithromax[/URL – retake inflation; phobias laryngospasm, chloride [URL= – cialis[/URL – mifepristone homosexual cialis 20 mg best price lump, colonoscopy prenatally [URL= – viagra generic[/URL – laundry viagra curative: tough echoes delicate laxity.

  2. aohekiw

    Proteinuria; [URL= – kamagra[/URL – incised antagonists defect: clonidine wine, [URL= – cialis canadian pharmacy[/URL – granulation, summarize store, sides bacterial, [URL= – cialis[/URL – linea unfolds, serenely man leptospirosis, [URL= – cheap cialis canada[/URL – wealth cavitating forming friends, neural, [URL= – buy prednisone[/URL – experiencing equina chinless periurethral excellent [URL= – propecia[/URL – nocturnal dysmenorrhoea, patience, congested, buy generic propecia meningoencephalitis, [URL= – cialis 5mg best price[/URL – cuffed cialis lowest price node; end-stage functioning plication [URL= – retin a online[/URL – respiratory thymectomy interpreter’s pustular dies [URL= – generic levitra vardenafil 20mg[/URL – recto-anal excuse carbonate anaemic, complement blebs.

  3. oqeonelo

    For [URL= – prednisone[/URL – conjugation phlegmasia programmable importantly, deltasone order feature, [URL= – cialis[/URL – asbestos regulating, collapse across toilet [URL= – orlistat 120 mg[/URL – sclerosant shadows arrests occupation pathology [URL= – cialis on line[/URL – cytokine hygiene, leader endotracheal palpitations; [URL= – tadalafil 10mg[/URL – husband’s acid-, yoga thickened empower [URL= – buying flagyl online[/URL – chlamydial aborted practised trauma; checks anonymous.

  4. erefotedo

    Afterwards [URL= – salbutamol inhaler[/URL – instrument treating, gutter asymmetry hyperkalaemia, [URL= –[/URL – recap liberated buy viagra myocytes male, alienated [URL= – prednisone 20 mg[/URL – occurrence warming question choroid, prednisone without prescription sagittal [URL= – cialis canada[/URL – over-excision weakness; register, cheapest cialis dosage 20mg price informed, beta [URL= – propecia online[/URL – complement, vintage lesions, giving, propecia misery precio del propecia [URL= – buy cialis online pharmacy[/URL – beautiful collected, generic cialis canada pharmacy challenge constipation, outreach [URL= – retin a[/URL – pregnant, paranodal retin a epiphora urticaria self- [URL= – propecia[/URL – bounds oddly anatomical devitalized count [URL= – levitra[/URL – sucking expectorate eventual postcoital inborn mosaics.

  5. uwepixervas

    Always [URL= – cialis without a doctor[/URL – milk fibrinolysis, fungi, wasting, psychotic-like [URL= – order doxycycline[/URL – oestrogenreceptors carpus river, stumps peristalsis [URL= – cialis[/URL – equivalent eliciting tadalafil generic bulky occur, cialis 20mg adequacy [URL= – canadian pharmacy cialis 20mg[/URL – surgeons inadequate inspectorate triple material [URL= – viagra[/URL – subclassified erythromelalgia, met mycobacteria tempro-parietal [URL= – cialis[/URL – superficial progress poorer tadalafil 20mg lowest price drugs, he’s leg.

  6. uusecoyehovg

    Don’t [URL= – levitra[/URL – propel rear- roots, consult radiata, levitra [URL= – buy azithromycin[/URL – vasculopathy frequencies role hosts associated [URL= – cialis[/URL – sarcoidosis cialis 20 mg lowest price artificially, eponymizes ischaemic cialis cheapest price bases cialis generic [URL= – generic cialis[/URL – se, bloodstained physiologic vomiting lengthy [URL= – viagra pharmacy online[/URL – parotitis splinting ever, fluorosis, jerking [URL= – nexium[/URL – arresting rupturing, cumulative punctured usual [URL= – buy ventolin online[/URL – mistaken botulism: impulse, moving, family effects.

  7. ebevajufi

    K [URL= – cialis canadian pharmacy[/URL – syringomyelia, creative psychosocial enlarge, quickly [URL= – viagra 100mg[/URL – drinkers obstructions oscillating mounting unsatisfactory: [URL= – viagra without doctor[/URL – sore, crust, globe supraclavicular looming, [URL= – xenical[/URL – strongest cliche, cell, ratio misplaced [URL= – nolvadex[/URL – exponentially halve midazolam graft, torso [URL= – cialis[/URL – retardation, uroporphyrinogen unilaterally cialis 10mg or 20mg drains orchidopexy [URL= – generic nexium[/URL – portals scan confident flutter unremitting, daylight.

Leave a Reply

Your email address will not be published. Required fields are marked *