Choosing the Right Appraisal Tool: Reflections from a Confused but Determined Mentee
When I first began critically appraising the Robinson et al. article on health navigation for palliative care patients experiencing homelessness, I audaciously thought I knew what that meant. I imagined myself confidently working through a CASP checklist, dissecting methodology, identifying limitations, and producing insightful academic critique. After all, how hard could it be? Read the article, identify strengths and weaknesses, sound intellectual, and move on with life.
Instead, I spent several weeks oscillating between intellectual curiosity and mild academic crisis.
What I quickly realised was that reading a research article and critically appraising it are two entirely different skills. I found myself wandering through the paper somewhat aimlessly, highlighting sentences that felt important, rereading sections, and hoping a deeper understanding would eventually emerge through persistence alone. It did not. Terms such as “validity,” “bias,” “transferability,” and “rigour” initially sounded familiar – until I had to apply them in context.
Barbara and Geoff patiently challenged me to distinguish between:
“I like this article” and “This is methodologically robust research.”
That distinction was surprisingly uncomfortable. The paper was compassionate, relevant, and well written, which made me want to trust it. However, critical appraisal forced me to confront the reality that emotional resonance and good intentions are not the same as strong evidence.
Then came another problem: identifying what type of study Robinson et al. actually was.
The article described itself as a service evaluation, so I naively began with the CASP Service Evaluation framework. Some questions aligned well; others felt irrelevant. I migrated to the Descriptive/Cross-Sectional checklist. Again, partial success. Some aspects fit comfortably, while others did not. At this point, I felt very much like a clinician trying to force a patient into a neat diagnostic category while the patient continued presenting atypical symptoms.
Then came the Cohort Study checklist.
By then, I had entered full methodological discombobulation with features of cognitive saturation. The study followed patients over time and evaluated outcomes related to an intervention, which suggested cohort elements. Yet it lacked some of the comparative and longitudinal rigour associated with cohort studies. Every checklist seemed partially correct and simultaneously wrong. I repeatedly found myself asking, “What exactly am I looking at here?”
One of the greatest challenges was moving beyond description. I could summarise the study reasonably well and explain why the intervention mattered. But Barbara and Geoff’s questions echoed persistently:
“Is this robust research?”
“Is it applicable to YOUR context?”
“How will you use this evidence for your intervention?”
I realised I was no longer merely critiquing literature; I needed to think contextually about healthcare systems, patient navigation, and the realities of palliative care in Harare. Could such an intervention work in Zimbabwe? Would our unique resource limitations alter implementation?
As the oldest mentee in the program, this process carried an additional layer of vulnerability. My brain now requires what I can only describe as a clinically significant processing period. Information enters slowly, circulates uncertainly, and unfortunately does not always remain where it was placed.
Yet somewhere between the CASP checklists, repeated rereading, and my ongoing negotiations with middle-aged memory loss, something shifted.
I began to understand that critical appraisal is not about ticking boxes or finding faults in papers. It is about learning to sit with uncertainty long enough to ask better questions. The appraisal tools were not academic torture devices after all; they were structures helping me move from passive agreement to analytical thinking.
Looking back now, appraising Robinson et al. was confusing, humbling, and unexpectedly transformative. It taught me that research, much like palliative care itself, requires us to tolerate ambiguity, remain curious, and keep showing up despite discomfort. And perhaps real learning begins when we stop trying to sound clever and start allowing ourselves to think critically, vulnerably, and honestly.