Connect with us

Features

Can outcome-based education get to the heart of the matter?

Published

on

by Sudesh Mantillake

This article is a continuation of views and opinions expressed in this forum on the quality assurance process in Sri Lankan university education. In this article, reflecting on my academic training and personal experiences, I mainly question the interpretation of “outcome-based education” (OBE) and the emphasis given to it in the Manuals prepared for Institutional Review and Undergraduate Study Programme Review of Sri Lankan Universities and Higher Education Institutions published by the University Grants Commission (UGC) in 2015 as part of a World Bank-funded project, currently under implementation. Based on my personal experiences as a university lecturer, who teaches dance and performance, I assert that UGC should revisit its approach to measuring quality and outcomes, particularly in the humanities and social sciences.

Outcome Versus Process-Based Education

The Manual for Review of Undergraduate Study Programmes defines OBE as “an educational theory that bases teaching learning and assessment components of an educational system around intended outcomes to ensure achievement of the [Intended Learning Outcomes – ILOs] by every student at the end of the educational experience.” As an educational theory, we can debate, agree/disagree on OBE. Indeed, OBE may be applicable to some educational experiences. For instance, after teaching dance anatomy, at the end of the course, we can agree that students should be able to know the importance of the spine for a dancer. However, OBE would not help to measure or assess students’ creativity and emotional maturity. As Farzana Haniffa previously mentioned in this column, educational outcomes could instead be described as “a process of preparation essential for the thriving of students, for the encouragement of their creativity and for the nurturing of their skills.” However, in the current quality assurance process, OBE is narrowly defined, and we are forced to comply with it across the board, with little consideration of its applicability to the setting or discipline, reflected in the manuals for institutional review, degree programmes, and other documents developed by universities and faculties to fulfill “quality assurance” needs.

In the Manual of Institutional Review of Sri Lankan Universities and Higher Education Institutions, under Quality Assessment, in section 3.3 on Criteria and Corresponding Best Practices, Criterion 1 (Governance and Management) specifies that “the success of the University/HEI is dependent on the efficiency and effectiveness of the monitoring, evaluation and reporting mechanisms. This is output and outcome based rather than input or process based.” And in Section 4.2 on Standards, Examples of Evidence and Score Guide, under Criterion 1 (Governance and Management), the Manual states that universities should make sure that there is “a strong commitment by the University/HEI leadership to reflect upon performance, output/outcomes rather than processes and inputs.” In these two instances, this manual not only emphasises an “outcome-based” approach but also discredits and rejects “process based” approaches to education. Here, “outcome” is defined narrowly as if it is an instant product that comes out of a factory. When universities develop their own guidelines based on this manual, they define “outcome” using criteria such as employability, starting salary, annual salary, etc. Sometimes, the outcome is also coupled with so-called performance targets. Hitting the target might be good in battles and wars, but as I believe, humanities education should oppose hitting educational targets and encourage a more holistic and collaborative learning process.

Outcome-Based Education and the Heart of the Matter

I teach Fine Arts. In Fine Arts, too, we are concerned about “quality” and ensuring that we create a quality outcome. For example, this quality outcome could be an emotional experience from an immersive theatre play. These types of outcomes cannot be quantified. For some, the effect of the outcome could be immediate, whereas for others, the emotional experience may have an effect years later. However, in Sri Lankan universities, in the name of quality assurance, we are pushed by UGC to adhere to a very different “quality” and “outcome,” which goes fundamentally against the way we perceive quality and outcome in humanities and social science education.

Quality and outcome in our fields cannot always be observable and measurable as expected in OBE. This was clearly identified and described in a report published by the American Academy of Arts and Sciences in 2013, which identifies humanities and social sciences as the heart of the matter, the keeper of the republic. According to the report:

“The humanities and social sciences are not merely elective, nor are they elite or elitist. They go beyond the immediate and instrumental to help us understand the past and the future. They are necessary and they require our support in challenging times as well as in times of prosperity. They are critical to our pursuit of life, liberty, and happiness, as described by our nation’s founders. They are The Heart of the Matter.”

The value of the humanities and social sciences cannot be evaluated by immediate results. The effect of a course in our discplines might not be observable at the end of the semester. They fulfill a critical role in civilization, for its quest for life, liberty, and happiness. These qualitative aspects fostered through humanities and social sciences education cannot be observable and measurable at the end of the semester. There is also an irony (maybe it is not an irony) that while UGC and Quality Assurance Council embrace the processes of quality assurance and accreditation emanating from the global north, they do not consider as seriously the critiques of OBE that also come from the global north. If one takes the “heart of the matter” seriously, quality and outcome as operationalised in the humanities and social sciences cannot be ignored.

Outcome-Based Quality Assurance as a Spectacle

I see the quality assurance process in Sri Lankan universities as a spectacle where we perform different roles. According to the script, the outcome is expected as a spectacle, but the creative process is neglected. Deviating from traditional theatre studies, performance studies as a discipline focuses on various aspects of performance in everyday life, including everyday performances within academia. Performance studies scholar Shannon Jackson, in her book Professing Performance (2004), shows how individuals who have become members of the “professional-managerial class” (PMC) perform within corporatised university education in the United States. She reminds us that some university academics also belong to this PMC. Through its quality assurance process, UGC is creating a PMC in Sri Lanka. While the PMC writes the script for the spectacle of quality assurance, others have to follow, with or without rehearsals.

Educational outcomes are not always “products.” In my personal experience as a teacher of dance and performance, rather than the final spectacle, I value the creative process in performance. For me, finding a creative process or processes is the outcome of fine arts education. Here, I am reminded of uncritical spectacular performances where we put our energy on the final “product,” how it looks, without really reflecting on what we are doing. As young dancers, we were often asked by governments and other organizations to do “multi-cultural” performances to showcase ethnic harmony. As a Sinhala dancer, in the 1990s, I have taken part in many “multi-cultural shows” that showcased different cultures in Sri Lanka. Although we were Sinhala dancers, we were also problematically expected to represent Tamil people and culture on stage, apart from Sinhala. These multi-cultural dances were not very difficult to choreograph and perform as there was a formula for a multi-cultural dance performance. For example, the choreography would first introduce the uniqueness of Sinhala dance and then the characteristics of Tamil dance, and then finally, the performance would end with a group dance where both Sinhala and “Tamil” dancers perform together to the same beat. They were beautiful spectacles, but did they really help to further reconciliation or harmony?

The spectacle of creating attractive documents for quality assurance purposes will not really assure quality in our education system. Like multi-cultural shows that give a superficial impression of the multi-cultural nature of our society, the quality assurance spectacle provides a superficial and hollow impression of quality in our universities. This spectacular nature of both quality assurance and multi-cultural shows is not innocent. We cheat ourselves and allow dominant ideologies to run over us in both cases. We use various public and private funds to perform these spectacles. As we use our resources and energy for these superficial spectacles of quality assurance, we lose the real opportunity to improve our education.

In conclusion, humanities and social sciences should be taken seriously and considered the heart of the matter in the discourse of quality in education. They fulfill a critical role by reminding us of the meaning of life, freedom, equity, equality, and happiness, “outcomes” that are not always observable and measurable at the end of the semester, as expected in OBE.

(Sudesh Mantillake teaches at the Department of Fine Arts, University of Peradeniya)

Kuppi is a politics and pedagogy happening on the margins of the lecture hall that parodies, subverts, and simultaneously reaffirms social hierarchies.



Continue Reading
Advertisement
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Features

Coercive laws recipe for future misrule

Published

on

by Jehan Perera

The NPP government is going after powerful figures from the past and present who have engaged in corruption, fraud and criminal activity in a way that no previous government in Sri Lanka has done. Former ministers, politicians and senior state officials are among those facing investigations and legal proceedings. The government has placed before Parliament a document listing 50 cases involving corruption, fraud and other crimes. These include not only financial offences but also cases relating to the Easter Sunday attacks, the killings of Lasantha Wickrematunge and Wasim Thajudeen, the disappearance of Prageeth Ekneligoda and attacks on journalists Keith Noyahr and Upali Tennakoon.

The significance of this effort is that it can demonstrate that nobody is above the law, regardless of political connections or social standing, which will help restore public confidence in institutions that have long been distrusted. It could also recover public resources, improve the investment climate and strengthen the foundations for a more prosperous and just Sri Lanka. When criticised for focusing on the past and not the present, the government position is that these investigations were initiated under earlier governments, particularly between 2015 and 2019, and that it is now allowing investigators to proceed to deal with the backlog without political interference.

But there is an aspect of the government’s approach that is less justifiable. While pursuing past wrongdoing by powerful individuals, it is also advancing a triumvirate of draft laws that could give the state sweeping powers over citizens, organisations and dissent in the present and future. The draft Prevention of Terrorism legislation, the Prevention of Organised Crimes Bill and the NGO Registration and Supervision Bill raise serious questions about the over-centralisation of power. Each of these laws strengthens the powers of the state while weakening the rights and safeguards that protect people from their misuse and thus questions the basic rights of people in democracy where ‘the power of the people is vested in the government’. This is a recipe for future misrule rather than the rule of law. As the well-known saying goes, power corrupts and absolute power corrupts absolutely.

Proposed Laws

The real test of system change, for which the government obtained an overwhelming mandate, requires not only a government willing to hold others accountable, but one prepared to subject itself to the same principles of legality, transparency and restraint. The three proposed laws that are particularly important in this regard are the Protection of the State from Terrorism Bill, the Prevention of Organised Crimes Bill and the NGO Registration and Supervision Bill. Each of these draft laws has been presented as serving a legitimate purpose. Preventing terrorism, combating organised crime and ensuring that NGOs do not facilitate money laundering or terrorist financing are proper responsibilities of the state. Sri Lanka has international obligations in these areas, and no responsible government can disregard them. However, the existence of a legitimate objective does not justify every means adopted to achieve it.

The proposed Protection of the State from Terrorism Bill illustrates the problem. Although its definition of terrorism draws on a model developed by a former United Nations Special Rapporteur, the Human Rights Commission of Sri Lanka has warned that the definition of terrorism extends beyond the model and could bring legitimate political protest, trade union action and civil disobedience within the scope of counter-terrorism legislation. Its concerns also include prolonged detention, inadequate judicial oversight and restrictions on access to legal counsel. These are objections that go to the heart of the relationship between the citizen and the state. The government cannot credibly promise to protect democratic freedoms while creating powers that could be used to restrict them. It is necessary for the government to reassess the draft through transparent consultation and revise provisions that could criminalise legitimate dissent.

The Prevention of Organised Crimes Bill raises similar concerns. It is presented as giving effect to the United Nations Convention against Transnational Organised Crime, which Sri Lanka ratified in 2006. The Centre for Policy Alternatives (CPA) has argued that the convention does not require many of the bill’s provisions. The proposed law extends to a broad range of offences, permits detention orders lasting up to a year, makes confessions to police admissible for purposes of legal evidence, and introduces extensive surveillance powers. A law intended to dismantle criminal networks should not create a parallel system of exceptional powers that could be applied far beyond organised crime. Nor should safeguards developed through years of experience with abuses under the Prevention of Terrorism Act be weakened through legislation bearing a different name. The government should review whether or not existing laws could be used effectively to control these crimes or whether each exceptional power is necessary.

Civil Society

The proposed NGO Registration and Supervision Bill presents another test of the government’s intentions. The government may reasonably seek transparency in the finances of organisations receiving public or foreign funds, including measures to prevent money laundering and terrorist financing. It seeks to justify its overreach on the grounds of meeting the internationally mandated requirements of the Financial Action Task Force (FATF) for the Asia-Pacific region. But these objectives do not justify placing civil society and NGOs under excessive administrative control when even the FATF ranks them as low to medium risks. The draft bill would require registration and renewal, impose extensive obligations on organisations and empower authorities to suspend or deregister them on broadly framed grounds. It is important to redraft provisions that confer excessive discretion over registration, renewal, suspension and deregistration of NGOs.

Among the concerns raised by United Nations human rights special rapporteurs with regard to the draft NGO law are provisions requiring organisations to align with government policies and restrictions that could affect advocacy, dissent and freedom of association. The implications extend well beyond organisations that engage directly with the government. Community groups, human rights organisations, independent researchers and organisations working on reconciliation or accountability could find their activities constrained by uncertainty over how these provisions might be interpreted. Organisations that criticise government policies are not thereby working against the country. Their freedom to do so is part of what distinguishes a democracy from a system in which the government determines which opinions and activities are acceptable.

The government has generated considerable public goodwill through its pursuit of corruption and criminality. It should not assume that this goodwill gives it an unlimited mandate to strengthen the coercive powers of the state. The NPP knows from its own history that governments can treat dissent as a threat and use the machinery of the state against their opponents. There is still time to correct the drafts through transparent public consultation, narrow definitions of offences, meaningful judicial control over detention and surveillance, and effective remedies against arbitrary decisions. A government that pursues corruption while weakening safeguards against state abuse risks undermining its own achievements. Besides bringing to light the abuse of power by previous governments, the NPP government needs to build a system in which no future government can abuse power in the belief they can get away with it.

Continue Reading

Features

Quality assurance without quality enhancement: The irony of university QA

Published

on

By Ramya Kumar

According to the Quality Assurance Council (QAC) of the University Grants Commission (UGC), quality assurance (QA) refers to “the means (i.e. the policies, attitudes, actions, procedures, etc.), by which an institution can guarantee with confidence and certainty, that the standards and quality of its educational provision are being maintained and enhanced”.

An expansive structure has been in place since 2005 to govern and implement QA processes within the state university system. The QAC is the focal point at the UGC that implements external reviews of state universities and institutes. Each university has its own Centre for Quality Assurance (CQA) tasked with performing QA in line with QAC directives. Faculties, in turn, have Internal Quality Assurance Cells (IQAC) performing their own QA; they are answerable to the CQA.

The big question is whether this all-encompassing top-down QA system, that in many ways undermines the internal dynamics of university governance, actually supports universities to enhance the quality of education. This article highlights some concerns.

Top-down check-box activities

The QAC conducts external reviews of universities and degree programmes. A review team appointed by the UGC (who may or may not have experience in the institution/programme in question) examines the self-evaluation report submitted by the said institution/programme. The team then conducts a site visit to verify the claims made in the university’s self-evaluation report, clarify issues identified during the desk review, and examine how QA procedures operate in practice. The team holds meetings with the university administration, members of the Council and Senate, Deans, Heads of Departments, academic and non-academic staff, students, and others. Following the visit, a draft report is submitted to the relevant institution/programme for comment before final publication. The reviewed institution/programme then prepares and publishes an action plan addressing the recommendations, with subsequent monitoring of progress.

There are some worthy QA initiatives under implementation, such as improving facilities for students with disabilities and strengthening mechanisms to address sexual- and gender-based violence. However, for the most part, QA activities have little to do with improving the quality of education. They are mostly preoccupied with monitoring faculty and department websites, digital transformation, student feedback, subject evaluation, course evaluation, peer evaluation, and, more recently, staff appraisal. These activities, which consume an inordinate amount of time—so precious at understaffed universities—have become check-box activities completed to generate evidence for the next review. Below is an excerpt of a conversation between two academics (1 and 2) that conveys how QA plays out at universities (reproduced with permission).

1: … .it’s like social media you know, like posting things on Facebook or twitter or Instagram. When people do a lot of social media, everything they do, they do thinking, “okay I’m going to post it in this way… this I have to put on my Instagram.” QA is a little like that… everything is considered in light of, “ah we can use this for the review, as evidence… for example very recently we were encouraged to have all the things that we do in our department in the faculty newsletter so then they can put in the review. Every little thing has to be noted down….

2: And with pictures and all…

1: At the very least it has to be written so that you have written evidence .. you can’t be doing something for the sake of doing something or because it is good for the department … and sometimes people tell me “oh yea that’s a good idea we can fit that under this x, y section of the review..”

2: Yea, and nobody really thinks about the actual outcome… whether it’s actually helping anyone..

1: I also find that a lot of the words that we used in different ways have now been co-opted to the QA discourse ..including quality.. I can’t actually say what I want as an “outcome”, for example, that the outcome of this workshop is that my students “think about” … then I am told “ah but no that’s not one of the Bloom’s taxonomy words, “think about”.…

2: And the worst part is these medical and agriculture people, these types of people go around spreading it like some kind of gospel!

1: Yea, this cookie cutter way of doing things, they think is the height of innovativeness or creativity, when actually it is so mundane … for me the most awful thing about it is like some fungus of mundanity has taken over through QA reviews.

2: yea, when you say QA, my mind closes off immediately and I stop listening…

Auditing everything but power

QA leaves out crucial aspects of university governance. For instance, there is no review or assessment of the “quality” of university administrations under Criterion 1 or the integrity of procedures governing the promotion of academic staff under Criterion 6 of the institutional reviews.

The majority in the Council—the university’s executive and governing body, which is responsible for selecting the Vice-Chancellor (VC)—are appointed in ad hoc fashion. Apart from the Ex-Officio members in the Council (VC, Deans, etc.), and the two members elected by the Senate, the remainder are appointed by the UGC with no formal consultation or vetting procedure. The VC appointment process described in UGC Circular No. 03/2023 exemplifies how an ostensibly technical process can become entangled in political sycophancy. The Registrar invites applications for the position of VC through advertisement. Applicants must submit a curriculum vitae, a statement of vision for the university and supporting documents. The University Council appoints a three-member Search Committee of senior academics to encourage “eminent persons” to apply, while the UGC appoints a former VC from another university to “observe” the selection process.

A Special Meeting of the University Council is convened. Candidates are interviewed and must make a presentation to the Council Members, followed by questions. Each Council member “gives marks” for seven prescribed criteria: strategic focus (20%), effective leadership (20%), holistic thinking/conceptual skills (10%), academic and research excellence (15%), personal integrity (10%), professional communication (10%) and managerial competence (15%). Marks are averaged, and the Council recommends three candidates to the UGC in rank order. The UGC-appointed observer separately submits a confidential report on the selection process.

This procedure is expected to guarantee quality, but does it? Applications are submitted to the Council Members, who have been appointed on questionable bases, and who are expected to review the applications and give scores, based on objective assessments. But, in reality, most Council Members are manipulated by VC candidates, who often have personal ties with them. The UGC-appointed observer usually has no genuine interest in the outcome. And there is no way for anyone to actually question the Council’s decision once it is made. Although the highest-ranked candidate may ultimately be appointed, the selection remains a political decision made by the President, who retains the discretion to appoint any one of the three.

External reviews also do not look into the promotions of academic staff, except to scrutinise whether there are policies and procedures in place to govern promotion. Academic staff may apply for promotion to Professor once they satisfy the prescribed eligibility requirements, which typically include the period of service, academic qualifications, research and publication achievements, teaching experience, and contributions to the university and wider community. Applications are evaluated against specified criteria, with research output and academic contributions assessed through documentary evidence and expert evaluation. Under the UGC’s scheme for Professors, two experts from outside the applicant’s institution assess specified aspects of research and knowledge dissemination. Again, beneath this technical process, which is externally evaluated, lies a problematic points-based scheme that can be manipulated and abused with impunity.

Rethinking university QA

Like the VC election process and the schemes of promotion for academic staff, QA reviews are open to manipulation. Before a review, there is a chaotic rush to complete evidence gathering and reporting. Academics leave all other work aside, including at times their teaching, to focus on completing documentation and preparing reports. The standardised criteria in the review manuals and scoring sheets often do not reflect differences in disciplines and institutional contexts. But this does not really matter because any serious problems experienced by institutions or programmes are hastily brushed under the carpet to conceal any evidence that could taint the review. The goal is to obtain an A or at least a B grade at whatever cost.

QA may result in positive change if it moves beyond top-down check-box activities towards internally designed and owned processes encompassing all aspects of university governance, led by departments and faculties, and supported by adequate resources. The current QA system needs to be dismantled and replaced by procedures that are accountable, not to the UGC, but to our students and the communities we serve.

(Ramya Kumar is attached to the Department of Community and Family Medicine, Faculty of Medicine, University of Jaffna)

. Kuppi is a politics and pedagogy happening on the margins of the lecture hall that parodies, subverts, and simultaneously reaffirms social hierarchies.

Continue Reading

Features

Down Memory Lane — the Grand 20th Edition!

Published

on

Down Memory Lane: Ready to sing again

Yes, Down Memory Lane, the beloved Sing-Along concert series that first struck a chord, way back in 1997, returns for its landmark 20th edition this Saturday, 17th October, at the beautiful Bolgoda Grand Resort, Moratuwa town centre.

Having celebrated its glorious 25th anniversary with the show in 2023, this milestone 20th concert promises to be even more special.

The organisers, the ever-popular Moratuwa Arts Forum, are pulling out all the stops to present yet another unforgettable evening, brimming with camaraderie, fellowship, and pure nostalgia.

Get ready for two-and-a-half hours of non-stop singing as veteran vocalists, from the Moratuwa Arts Forum, will take the stage to lead and inspire the happy audience to sing, sing and sing to their hearts’ content.

The repertoire? Absolutely magical, according to the organisers.

Veteran Arun Dias Bandaranaike: Will handle the evening’s proceedings / Priya Peiris: Event Conceptor

Around 40 golden oldies — from timeless English vintage evergreens and hits from the 50s to the 90s, to toe-tapping calypsos, soulful American plantation melodies, rousing cowboy and Dixieland favourites, aa well as cherished Sinhala standards. All to be sung with much gusto!

This year’s dedicated organising committee comprises Brian Coorey (Chairman), Priya Peiris (Event Conceptor), Hiran Fernando, Suranga Fernando, Viranjan Perera, Hemka Fernando and Neelesh Silva. Guidance and support comes from Moratuwa Arts Forum President Sarana Guneratne and Secretary Chandani Silva.

Adding his signature charm to the evening, as Master of Ceremonies, will be the veteran Arun Dias Bandaranaike.

Don’t miss this landmark celebration of music and memories!

For further details, contact Hiran Fernando on 0772636446 or WhatsApp 0783636446.

Continue Reading

Trending