This commentary discusses a set of lessons learned from the work of the A360 Project – a well-resourced, multi-country and multi-year initiative working to improve adolescent sexual and reproductive health (ASRH)—that organizations and agencies that provide technical and financial support to implement ASRH programs could use to inform their work. It responds to the growing consensus that it is important to draw out and share not only what has worked, but also what has not, in ASRH programs, so that others can build on this learning. In other words, it responds to an imperative for learning and sharing [1, 2].
Independent interim and final evaluations of the A360 Project included process, outcome and costing analyses, and are available in the public arena [3, 4]. These reports describe how A360 performed in relation to its objectives, provide plausible explanations for where it performed well and where it did not, identified gaps between proposed and actual performance, and suggested possible ways of addressing them. A360 staff who oversaw the execution of the Project, and the outcome evaluation team have published their findings in peer-reviewed journals [5, 6]. A360 reported on the achievements of the Project, the opportunities it used, and the challenges it faced, while the evaluation team pointed out precisely where the Project’s performance did or did not achieve its targets and discussed the reasons for the same.
This commentary does not seek to reiterate the findings of the evaluation reports and the peer-reviewed journal publications. Instead, its intended audience is the wider ASRH community – researchers, programmers, and technical and financial supporters – and the opportunity to use the learnings generated bythis well-resourced, multi-country, multi-year Project. The commentary cites specific evaluation findings and proposes “dos” and “don’ts” for future programming backed by research evidence, and practical experience.
All three authors of this commentary were members of a technical advisory group (TAG) established by A360 to provide support and guidance to the design and implementation of the Project. Each of us have over 25years ofASRH work experience in low- and middle-income countries (LMICs). All three of us have reviewed A360’s plans and reports (prioritizing the findings of the mid-term and final evaluations) and have met with A360 staff on numerous occasions. We believe that we have a sound understanding of the Project’s efforts.
We have prepared this commentary with great appreciation for the significant investment in ASRHmade by the donors and the implementers. We have empathy for all who contributed to the Project goal of improving the SRH of adolescent girls by increasing their contraceptive use. Our aim is not to criticize any individual or organization; rather, we believe that A360’s efforts are relevant to many other ASRH programs and projects that are grappling with many of the same questions and challenges tackled by the Project, namely, to translate innovative ideas into action, while being responsive to differing social, cultural, and economic contexts. We hope that our suggested dos and don’ts will help those working in—and supporting – ASRH work in LMICs design and execute better projects and programs.
We begin with some information on the context in which A360 was conceived and operationalized, and about the Project itself. We then present comments and observations that were provided to A360 in our role as the Technical Advisory Group. We wrap up by discussing our three main reflections onfuture directions for ASRH programming.
The context in which A360 was conceived
There has been keen awareness of the need to address adolescent pregnancy and childbearing around the world for over 50years [7]. The consequences of adolescent pregnancy and childbearing and their effect on the ability of countries to achieve key health, social and development outcomes were acknowledged as a global priority at the 1994 International Conference on Population and Development (ICPD). This public attention enabled international organizations and local champions to press governments to pay attention to ASRH and to mobilize resources to implement programs and policies. Six years later, the Millennium Development Goals (MDG) were announced, and Goal 5 (to reduce maternal mortality) and Goal 6 (to prevent HIV infection and HIV-related mortality) provided new impetus for ASRH programs and policies. However, the MDGs initially paid little attention to adolescents despite advocacy from United Nations agencies and international organizations that noted more robustprogrammatic and policy attention to adolescents and young people was needed to achieve these two goals [8].
By the start of the second decade of the 2000s, clear evidence had accrued of the nature and scale of SRH risks andproblems faced by adolescents, as well as an improved understanding of the determinants of those problems. These included their lack of access to evidence-based information and education as well as counseling and health services, yet there was still limited global and country level investment in ASRH. ASRH champions from the global to the local levels worked together to raise the alarm that make the case of omitting adolescents from programs designed to achieve MDGGoals 5 and 6 had significant implications not only for the health and wellbeing of adolescents, but also for efforts to reduce maternal and child morbidity and mortality [8].
UN agencies and partners began to formulate responses; for example, UNAIDS called for a global effort to address HIV in adolescents, and the Global Fund for AIDS, Tuberculosis and Malaria dedicated resources to enablecountries to develop programs to prevent HIV infection in adolescent girls in sub-Saharan Africa; Girls Not Brides advocated for child marriage to be prioritized on the global agenda; and UNESCO and UNAIDS jointly supported regional commitments to provide adolescents with SRH information and services in Latin American and Eastern and Southern Africa [9]. Nevertheless, ASRH advocates and program implementers remained frustrated, impatient, and even outraged that adolescents stillwere not adequately benefiting from the significant investments in and actions to achieve the MDGs. It was in this climate of urgency that A360 was conceived [8, 9].
Technical and funding agencies began to look for new – and disruptive—ways to analyze problems in context, yield new insights, and pursue innovation while centering on the real-life experiences of clients and end-users [10]. One such methodology believed to show significant promise to improveASRH, and specifically adolescent contraceptive use, was human centered design (HCD). A number of agencies have endorsed – and even required—the use of HCD methodologies in their awards, and A360 was one such investment, supported by the Bill and Melinda Gates Foundation (BMGF) and the Children’s Investment Fund Foundation (CIFF).
About A 360
A360 was designed by Population Services International (PSI), the Center for the Developing Adolescent, IDEO, and Society for Family Health Nigeria with thegoal ofincreasing voluntary uptake of modern contraception among unmarried and married adolescent girls in Ethiopia, Northern Nigeria, Southern Nigeria, and Tanzania, “…reimagining and redefining the way sexual and reproductive health (SRH) programs are designed and delivered for adolescent girls and young women” [11]. The first phase of A360 was implemented from 2016–2020.
A360 eschewedstandard programming design efforts, instead adopting an approach driven by principles of HCD, with adolescents,young people and adults from a range of disciplines collaborating to envision, design, and implement what were anticipated to be more responsive, sustainable, and scalable SRH programs that successfully increased adolescent contraceptive use. A360’s designers hypothesized that “a fusion of disciplines, prioritizing meaningful engagement of young people…would catalyze novel and successful approaches…” leading to population level changes in modern contraceptive prevalence rates (mCPR) among adolescents in the four project geographies. HCD was central to A360’s design aspirations, championed as an innovative methodology generating new insights to improve adolescent contraceptive use, as perhaps not previously revealed by traditional methods of inquiry and design [3].
A360’s donors were careful to dedicate significant resources for evaluation to examine implementationefforts and measure the effect of HCD-generated solutions on adolescent contraceptive use. ITAD coordinated the evaluation and conducted process evaluations at midline and endline, while the London School of Tropical Medicine and Hygiene (LSTMH) conducted the outcome evaluation. Avenir Health undertook a cost-effectiveness analysis.
The 2018 midline reported impressive increases in the numbers of contraceptive adoptersFootnote 1 and adolescent girls, their families, and communities expressed satisfaction with A360’s activities. With what appeared to be highly persuasive findings in hand, A360 began disseminating their experiences, although it wasstill too soon to know if there was any outcome level evidence that could be attributed to A360 (e.g., increases in adolescent mCPR or decreases inadolescent childbearing). Given persistently high rates of unmet need for contraception among adolescents, A360 was likely optimistic about these preliminary results. Some urged caution, however, citing significant weaknesses in health systems, as well as provider biases against providing adolescents with contraception, which would likely pose challenges to A360’s ability to sustain and advance what appeared to be promising approaches [3].
The midline evaluation suggested that A360 should alsodevelop strategies to address the “harmful community myths, misconceptions and stigma around contraception for adolescent girls.” In response, A360 implemented “light touch” community engagement approaches and activities which included aspirational messaging, life skills education, and vocational skills development provided by community mobilizers and educators. These activities were proposed as a way to encourage adolescent girls to visit health facilities where they could alsothen learn about contraception. A360 considered that such activities could “circumnavigate…stigma,” by avoiding direct reference to contraception, and could mitigate negative attitudes among community members and providers that could limit adolescent contraceptive uptake and sustained use. Less emphasis on contraception was also thought to encourage adolescent attendance at A360 organized events, especially those that highlighted entrepreneurship and employment [3]. The final evaluation observed, however, that these activities only appeared to “attract more than empower” adolescent girls [4].
“(A)lthough A360 succeeded in reaching…girls with modern contraception in often innovative ways, the evaluation cannot definitively conclude that A360 revolutionized ASRH programming in the way it was initially designed to do” [4].
The endline findings did not reflect the midline’s optimistic tone, with results described as a “mixed bag.” The process evaluation reported that there had been more adolescent contraceptive adopters than initially projected, and that adolescent girls and communities liked the activities implemented by A360. In contrast, the outcome evaluation revealedthat the changes in adolescentmCPR were limited and inconsistent across the project sites. An increase in mCPR was detected only in Oromia, Ethiopia, which reported a five percent increase among married adolescents, but in Nasarawa and Ogun States in Nigeria there was no change in adolescent mCPR, and in Ilemela, Tanzania (where A360 had added a vocational and life skills interventions) there was a nine percent decrease, even though girls cited approval of the skills development activities [4]. It is also important to note that in Ethiopia, A360 was implemented on the heels of a national program which had already achieved population level increases in adolescent contraceptive use [4].
Insights from A 360’s evaluations that have wider relevance
The TAG originally identified 10 insights culled from A 360’s evaluation reports that appear to have limited the ability of the Project to achieve more significant contraceptive use results among adolescents. Although the evaluations were specific to A360, it is our collective opinion that the findings mirrored the decisions and actions of many other projects. This includes the tendency to implement interventions thatwhile popular, have been shown to be ineffective, and to deliver proven interventions in ways that compromise their effectiveness [12, 13].
In Table1 (below) we share our observations on nine of the 10 insights that we gleaned from the evaluation reports (the tenth was related to cost, which this commentary does not address). Against each insight, we describe what we believe to be specific limitations of A360’s approach and categorize these actions as “do not.” We then suggest alternative responses to the insight that are based on evidence and research as well as the TAG members’ collective expertise in ASRH and categorize these as “do.” We believe these observations have relevance for the entire ASRH community as it continues to develop and implement programs to improve contraceptive use among sexually active adolescents, as well as other priority adolescent health initiatives.
