The difference between being flexible and adaptive

70 views
Skip to first unread message

Arnaldo Pellini

unread,
Jun 2, 2020, 3:13:51 AM6/2/20
to Adaptive Development | #AdaptDev
Hi, I have a quick question for you. This has come up in a conversation I have had with a manager of an adaptive programme who was unsure as to whether her programme was being flexible or adaptive.

What do you think is or are the key differences between a flexible programme and an adaptive programme? Are there any differences?

Best wishes, 
Arnaldo

rick davies

unread,
Jun 2, 2020, 3:46:46 AM6/2/20
to Arnaldo Pellini, Adaptive Development | #AdaptDev
Hi Arnaldo

The distinction between being flexible and adaptive could be seen as having some connection with the distinction others have made between risk and uncertainty 

 Two different types of scenarios can be considered:
  1. Scenarios where some probabilities can be assigned - this can be dealt with as a risk
  2. Scenarios where it is not possible to do so – this has to be dealt with as an uncertainty

Identifiable risks: in scenarios where risks are identifiable, a specific strategy may be appropriate and needed to respond to each different scenario of this kind. These different kinds of scenarios may vary not only in terms of their estimated likelihood but possibly also on other criteria that may have consequences that can be forfended e.g desirability. Developing such specific strategies could be described as being 'adaptive '

Uncertainties: For scenarios are characterised by uncertainty.  what is needed are more generalised and robust strategies.  Here is a useful idea from Sandra Mitchell’s book Unsimple Truths: Science Complexity and Policy (2009).

Rather than maximise expected utility, Popper, Lempert and Bankes (2002:423) recommend identifying and adopting what they called the most robust strategies. These strategies might not have been the best possible option available as any one outcome but their satisfactory outcomes occur in the largest range of future contingencies. Robustness analysis requires one to consider models take into account what we do know without pretending that we have precise probability assignments for what we don’t know. Rather it analyses a range of diverse but possible scenarios and the ways in which a policy decision today would play out in each of them. As they put it, a key insight from scenario-based planning is that multiple highly differentiated views of the future can capture the information we have about the future better than any single best estimate” p93 [underlining added]

The development of more generalised and robust strategies could be described as being 'flexible '

Regarding the options for identifiable risks and for uncertainties, there may be some science that is relevant here, to do with “bet-hedging” strategies  – a particular evolutionary strategy found where there is a high level of environmental unpredictability.

The difference between adaptive plasticity and bet-hedging is that plastic norms of reaction result in the expression of an optimal phenotype over a range of environments, whereas bet-hedging expresses a single phenotype (that may be a fixed level of diversification) that is neither optimal nor a failure across all environments(Simons, 2011)

For more, see this Wikipedia article on bet-hedging in biology 


Rick Davies (Dr), Monitoring and Evaluation Consultant, Cambridge, United Kingdom | UK. Websites: http://www.mande.co.uk  and http://richardjdavies.wordpress.com/ | Twitter: @MandE_NEWS | rick....@gmail.com Skype: rickjdavies


--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adaptdev+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/adaptdev/ed673cec-e2e3-4078-afcb-e7d8f67dcb9f%40googlegroups.com.

Nilima Gulrajani

unread,
Jun 2, 2020, 7:35:42 AM6/2/20
to rick davies, Arnaldo Pellini, Adaptive Development | #AdaptDev
Hi Arnaldo:

I don’t think there are any hard and fast rules here as flexibility and adaptiveness are clearly conceptual cousins.   In an article I co-authored with Dan Honig, we suggest adaptiveness is related to ‘context sensitivity'.  Flexibility is what allows organisations to adjust, redirect and feedback to changing circumstances.  I’m attaching the article to this email but in case it doesn’t come through you can also find it here:
  

While I don’t draw the same analytical distinction that Rick does, I share his view of the value in analytically exploring the relationship between risk/uncertainty and flexibility.  In another article co-authored with Linnea Mills, we suggest that risk management balances between the demands of flexibility and accountability, and highlight this with the empirical case of Sida’s work in fragile states.  Our implicit view is adaptiveness offers a larger conceptual frame than flexibility, with flexibility providing the means towards the ends of adaptiveness.   That being said, I’m sure we use these terms interchangeably throughout the report.



I hope this is of some help.

Best wishes,

Nilima Gulrajani, PhD
Senior Research Fellow (on leave)
Overseas Development Institute
Visiting Fellow
University of Toronto

Honig and Gulrajani .pdf

Marcus Jenal

unread,
Jun 2, 2020, 7:48:40 AM6/2/20
to Nilima Gulrajani, rick davies, Arnaldo Pellini, Adaptive Development | #AdaptDev
Dear all

While I agree with what has been said so far, I’d like to throw in a curveball. From the conceptualisation of resilience, there are three aspects to resilience: persistence, adaptation and transformation. Adaptability would obviously be linked with adaptation. It would be interesting to discuss a possible conceptual linking of flexibility to persistence. Here my thoughts:

Something that is flexible bounces back, like a rubber band. The idea behind persistence is to bounce back and continue as before. Flexible boundaries, according to Dave Snowden, are useful to a certain extend, but they can break if overstretched - which is when adaptability and transformation are needed to remain resilient. 

Nor sure if that makes sense or is at all helpful.



Best wishes,

Marcus Jenal
m...@mesopartner.com

Mobile: +44 7950 434548
Blog | LinkedIn Ι Twitter Ι Skype






Follow Mesopartner

— Subscribe to our newsletter and receive updates and event notifications.

— For experienced practitioners: Join our Mesopartner Summer Academy, 5-9 July 2021 in Berlin, Germany.


--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adaptdev+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/adaptdev/A71F2B38-2E78-4D9E-92FC-7A6DEE3119F0%40gmail.com.
<Honig and Gulrajani .pdf>




--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adaptdev+u...@googlegroups.com.

Chris Roche

unread,
Jun 2, 2020, 8:05:38 AM6/2/20
to Nilima Gulrajani, rick davies, Arnaldo Pellini, Adaptive Development | #AdaptDev
I quite like this Arnaldo

Adaptability is a willingness to confront or change your own ideas and preconceptions. Flexibility is more a willingness to “meet others halfway” procedurally,” according to a piece in Forbes.  https://www.forbes.com/sites/williamcraig/2019/03/26/8-skills-leaders-will-need-in-tomorrows-workplace/#4d04f0c136da

So I think a number of programs & organisations have found ways to be flexible in that they can adjust procedurally, but fewer are able to do the double or triple loop learning to truly question the mental models which lie behind how they tend to work, and shift these substantially.

A point made by my colleague Lisa Denney in this piece https://devpolicy.org/walking-the-adaptive-talk-20180911/

Best

Chris
_____________________________________________

Chris Roche

Professor of Development Practice,

Director of the Institute for Human Security and Social Change,

Deputy Director (Impact), Developmental Leadership Program.


La Trobe University, Victoria 3086, Australia 

 

C.R...@latrobe.edu.au

Phone +61 (0)3 9479 2061

Mobile: 0408 617 305

 




On 2 Jun 2020, at 9:36 pm, Nilima Gulrajani <nilim...@gmail.com> wrote:


--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adaptdev+u...@googlegroups.com.
On 2 Jun 2020, at 03:46, rick davies <rick....@gmail.com> wrote:

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adaptdev+u...@googlegroups.com.
<Honig and Gulrajani .pdf>

Charlotte Ornemark

unread,
Jun 2, 2020, 8:10:04 AM6/2/20
to rick davies, Arnaldo Pellini, Adaptive Development | #AdaptDev
Hi, 
Arnaldo’s question: "What do you think is or are the key differences between a flexible programme and an adaptive programme? Are there any differences?” 

There seems to be a false dichotomy in the way this question is being asked. Surely you need programme flexibility in order to be adaptive. “Rigorous adaptation” has been used as a term to indicate that adaptation is intentional and planned rather than being random, at someone’s (maybe a project manager's or funder’s) whim. All that is good and makes sense. But whose learning (and rigour) is important for locally driven change? Ours, or those with the highest stake in the change processes? 

The distinction between “high level of uncertainty = flexible programming”, and “high probability of different risk/mitigation scenarios = intentional adaptation” is helpful and interesting, but it seems to overlook that you may need both. 

Take the presumably somewhat less complex (and more 'complicated' in the realm of Snowden) issue of malaria prevention as an example. One initiative we evaluated some time back in Kenya noticed that the distribution of bed nets in one rural district led to a drop in prevalence rates among men, but not as much among women. Why? It turned out that women got up before sunrise to put on the hot water “for my husband’s bath” and to prepare breakfast for the family. The need to go outside and be next to water (where mosquitoes bred) before sunrise increased women's risk. The distributed bed nets did little to change these embedded gender patterns. This was clearly just one of several compounded risk factors. Yet, if women stopped getting up early to serve their families, they feared being beaten by their husbands. One more tangible risk (being beaten) outweighed the seemingly less consequential risk of being bitten by mosquitos (even if it led to malaria).

Adaptive programming would (I believe) in this example involve women themselves in monitoring gender patterns that might put them at higher risk, and support a facilitated dialogue on ways of distributing risks of doing daily chores more equitably. A flexible program would allow for this type of adaptation in programming to happen – even if what was being suggested by women/men in different communities and contexts would not be a uniform answer to ‘roll out’ everywhere (or ‘at scale’). Rather than aiming for ‘solutions at scale’ (which we really need to stop chasing!), it would allow for ‘localization at scale’ based on adaptive ways of doing programming. Also, it would be at whatever time or pace considered most important for those who experience the problem (not for us as implementers). Our own implementation response (with quarterly ‘pause and reflect sessions’ and what-not-adaptive-measures, rigorously planned) must surely be secondary to the emerging needs for learning on the ground, whenever and however implementation lessons emerge. That seems to combine being both flexible and adaptive, with one facilitating the other. 

Very best, 

Charlotte


--
Charlotte Ørnemark
International consultant
Tracking learning for social change
Skype:  live:charlotteornemark


rick davies

unread,
Jun 2, 2020, 8:13:39 AM6/2/20
to Nilima Gulrajani, Arnaldo Pellini, Adaptive Development | #AdaptDev
Hi Nilma and all

Re " , with flexibility providing the means towards the ends of adaptiveness

Many years ago, James March, an organisational theorist, wrote about the importance of "organisational slack". That is, the value of having more resources available than immediately needed, = some "flexibility" enabling some "adaptiveness" . Whereas prioritising efficiency would suggest the need to have the least level of surplus resources. But high efficiency = high vulnerability to shocks

regards, rick


Rick Davies (Dr), Monitoring and Evaluation Consultant, Cambridge, United Kingdom | UK. Websites: http://www.mande.co.uk  and http://richardjdavies.wordpress.com/ | Twitter: @MandE_NEWS | rick....@gmail.com Skype: rickjdavies

Silva Ferretti

unread,
Jun 2, 2020, 2:35:14 PM6/2/20
to rick davies, Nilima Gulrajani, Arnaldo Pellini, Adaptive Development | #AdaptDev
I liked a comment to the post
(it is comment number 3)
The comment stresses the difference among "responsive" and "adaptable", which might also be relevant for this discussion.
"What drives adaptation is completely different to what drives responsiveness. The key thing about responsiveness is that it is driven by major unforeseeable changes, events or national or international crises that are just overwhelming and are impossible to ignore, such as the adoption of federalism in Nepal – and now Covid-19. By contrast, adaptation is about responding (changing course, adding new activities, dropping failing ones) out of deliberate reflection and choice – and doing so within the financial year, bypassing the all too often straitjacket of donor work planning and budgeting requirements.

Niki Palmer

unread,
Jun 3, 2020, 2:44:53 PM6/3/20
to Silva Ferretti, rick davies, Nilima Gulrajani, Arnaldo Pellini, Adaptive Development | #AdaptDev
Hi all

And Arnaldo, lots of really interesting perspectives here. I'd like to offer something quite basic into the mix, from the perspective of spending many years working for a bilateral donor and an IFI. Also I note that your question refers to managing a programme, by which I assume you mean a financing vehicle for a particular intervention.

I've found that a flexible programme framework is one that can move money around from one element to another, in reaction to changing circumstances without having to ask for permission to do so. In other words, the programme can respond to an overall goal or objective through a number of different, pre-approved methods. On the other hand an adaptive programme is one that doesn't have a pre-approved route to reach a goal. The theory of change for an adaptive programme is not preconditioned, but allowed to develop as circumstances evolve using what can be a number of different analytical approaches. Adaptive programmes still tend to have a goal or objective in mind, but accept that there may be more than one route to get there, and that at programme inception we don't yet understand which route is best. 

Hence the reason that flexible is still more acceptable to many traditional donors than adaptive. Flexibility can be easier in terms of accountability to the public. On the other hand there has been a slow shift towards programming that is more adaptive, including through evolving adaptive M&E practices and adjusting the 'set' nature of a theory of change. I believe USAID now has some very interesting approaches in this regard. I have also admired the Asia Foundation's approach to adaptive programming. 

I confess that my programming experience is a few years old now and there are sure to be considerable advances in what can be done. But like everything else there are real world constraints to consider, not least in terms financial reporting. Hope this is useful!

With best wishes,
Niki 

Claire Devlin

unread,
Jun 3, 2020, 3:20:41 PM6/3/20
to Niki Palmer, Silva Ferretti, rick davies, Nilima Gulrajani, Arnaldo Pellini, Adaptive Development | #AdaptDev
Hi all,

I liked this explanation from David Booth in a publication from a former employer, Christian Aid 

  "A common confusion is to identify adaptive working with having the flexibility to amend outputs in the light of changed circumstances. This kind of flexibility is of course desirable when working in highly volatile country contexts. However, it is not the same thing as the purposeful experimentation and course correction that is required because of complexity. A limitation of what might be called the flexible blueprint approach – as in the design of many of the traditional programmes funded by the World Bank, bilateral donors and NGOs – is that they may ‘flex’ in response to changes in external circumstances, but they do not learn. They do not change course in a decisive way when it becomes clear their initial strategies are not working. "  

Just throwing it into the mix!
Claire

John Hoven

unread,
Jun 3, 2020, 10:55:31 PM6/3/20
to Niki Palmer, Adaptive Development | #AdaptDev, Arnaldo Pellini, Nilima Gulrajani, Silva Ferretti, rick davies
Niki says, “an adaptive programme is one that doesn't have a pre-approved route to reach a goal. The theory of change for an adaptive programme is not preconditioned, but allowed to develop as circumstances evolve using what can be a number of different analytical approaches.“

Niki, can you provide a link to any article or report that shows someone doing this? Or that offers advice on how and why to do it?

John Hoven


Arnaldo Pellini

unread,
Jun 4, 2020, 3:42:49 AM6/4/20
to Adaptive Development | #AdaptDev
Hi Rick, thnak you very much for this. You response is really interesting as it rather different than some of the comments I have got by asking the question on Twitter. The opinion was that flexibility is an element of being adaptive and that flexibility or being flexible refers mainly to a single initiative or intervention (eg an activity within a project) while being adaptive is a capability of an organisation or a whole project /programme. Your link with risks and uncertainty being a different viewpoint

Arnaldo Pellini

unread,
Jun 4, 2020, 3:46:50 AM6/4/20
to Adaptive Development | #AdaptDev
Dear Nilima, thank you very much for this. Your point on 'adaptiveness offers a larger conceptual frame than flexibility, with flexibility providing the means towards the ends of adaptiveness' resonates with the responses I have received from a limited pol I have done with colleagues and friends on Twitter.  One response was slightly different and was posed as a question: do we need to differentiate between flexibility and adaptability?


On Tuesday, June 2, 2020 at 10:13:51 AM UTC+3, Arnaldo Pellini wrote:

Niki Palmer

unread,
Jun 5, 2020, 3:56:45 PM6/5/20
to John Hoven, Adaptive Development | #AdaptDev, Arnaldo Pellini, Nilima Gulrajani, Silva Ferretti, rick davies
Here's the strategy testing adaptive approach I mentioned in the second link below. Called here a 'highly flexible approach' The first link might also be interesting for this group. It would be really great to hear from anyone who works for the Asia FOundation on how strategy testing has worked out in practice....



Best,
Niki
(Independent Consultant)

Devon Ysaguirre

unread,
Jun 5, 2020, 4:02:05 PM6/5/20
to Niki Palmer, John Hoven, Adaptive Development | #AdaptDev, Arnaldo Pellini, Nilima Gulrajani, Silva Ferretti, rick davies
I have been similarly interested in learning more about the Asia Foundation’s approach and echo an interest in learning about how it has worked in practice.

Thanks,
Devon (Democracy Fund)


On Jun 5, 2020, at 3:56 PM, Niki Palmer <niki....@gmail.com> wrote:



John Hoven

unread,
Jun 5, 2020, 8:53:23 PM6/5/20
to Niki Palmer, Adaptive Development | #AdaptDev, Arnaldo Pellini, Nilima Gulrajani, Silva Ferretti, rick davies
Here is a key excerpt from the article Niki cited. Has anyone seen this approach in another project, or is this a first?

Ladner, Debra. "Strategy testing: an innovative approach to monitoring highly flexible aid programs." Working Politically in Practice Series–Case Study No 3 (2015).

p. 5: To meet the learning and accountability needs of programs that are working on complex problems and likely to repeatedly change, the Foundation has developed Strategy Testing.... The first step in the ST process is developing a working theory of change... The initial TOC sets out the team’s ‘best guess’ about the most likely path to change. Since this first TOC is based on the team’s initial understanding of the problem and its context, they recognize that the TOC is likely incomplete and will evolve over time as the team builds relationships, gathers new information, experiments, and, most importantly, reflects on what is working and what is not.

John Hoven

unread,
Jun 5, 2020, 10:53:31 PM6/5/20
to Niki Palmer, Adaptive Development | #AdaptDev, Arnaldo Pellini, Nilima Gulrajani, Silva Ferretti, rick davies
> Here is a key excerpt from the article Niki cited. Has anyone seen this approach in another project, or is this a first?

Also, has anyone seen this approach since this article was published in 2015?

John Hoven


Nicola Nixon

unread,
Jun 5, 2020, 11:29:28 PM6/5/20
to Devon Ysaguirre, Niki Palmer, John Hoven, Adaptive Development | #AdaptDev, Arnaldo Pellini, Nilima Gulrajani, Silva Ferretti, rick davies, Meghan Nalbo, Gobie Rajalingam, Gopa Thampi, Jane Sail - Consultant, Kim McQuay, Jaime Faustino, Christine Bantug

Hi everyone,

 

Thanks so much for asking about our adaptive programming approaches in TAF! I’ve followed bits and pieces of this conversation during the week and have greatly enjoyed it. I had been trying to find a little headspace to chime in and now it seems I must get on with it and do so!

 

Firstly, while the original Strategy Testing approach (to which enormous credit goes to Debra Ladner, also I believe on this list!) described it as a highly flexible approach, that was in a time before everything and anything described itself as ‘flexible, adaptive and iterative’ and, as we know, threatened to oversimplify and dilute a burgeoning new practice within the world of DDD. Within TAF a few years later we see Strategy Testing as a method for Adaptive Programming (not simply flexible approaches to program implementation). Like you all, we have debated the distinction between flexible and adaptive. In our internal guidance document, we define adaptive programming as: ‘An approach to development programming in complex and fluid environments that enables teams to adapt strategies, activities and theories of change so that the program may achieve its overarching goal.’

 

Like the comment below that highlights adaptation to the context, this distinguishes between adaptive programming and, say, being flexible to the needs and demands of donors. We have also found it useful to clarify a little further and we refer to ‘purposeful and meaningful’ adaptation. Our guidance note developed last year states: “Tools and techniques used across TAF allow for purposeful adaptation – where there are processes around decision-making. Systems are used to carve out sufficient time for reflection and document the resulting insights on a day-to-day basis or at regular intervals of two to three months. Most commonly in TAF, Strategy Testing is used for this purpose. Other tools TAF has at its disposal enable meaningful adaptation – where decision-making is evidence not simply opinion-based. Changes of course draw on evidence of the context such as that derived from action research, stakeholder analyses and political economy analyses (of the 21st century variety).”

 

Secondly, to your question on how it has worked in practice there is an awful lot that can be said and said better than I, so I have copied in some colleagues who are well into a number of years of practice and may wish to elaborate further. To give you a relatively quick overview:

 

  • Some of our country offices – Philippines, Myanmar, Nepal, Sri Lanka, Timor-Leste, in particular – have been practicing Strategy Testing (or a variation) for quite a few years now in a dedicated fashion. To build learning across TAF from these offices we have an internal community of practice with the tongue-in-cheek name of The Adapters, with membership extending to twelve country offices throughout Asia. We convene every six months to share learning across our teams and, on the last occasion in Kathmandu in January, also with external partners. We aim to hold an online session in June.
  • We’ve learnt a lot from these sessions and are continuing to do so (and yes, we should put something out into the world on our reflections! it is on our to-do list, believe me!)

 

    • Structured reflection sessions at regular intervals are extremely useful to build a consensus view on new program directions; can be facilitated to allow for robust discussion on challenges and failures; and most importantly can enable programs to grasp new opportunities that present themselves in the operating environment/political economy and to change course. They can also allow for robust discussion on the program outcomes and theory of change and their ongoing validity – which, for me, is at the heart of an adaptive rather than simply flexible, approach. Attention needs to be paid to who joins the sessions at which intervals to get the most out of them, what information and evidence feeds into them (so discussion relies on more than opinions in the room). Some offices operate with concentric circles of reflection that engage donors and implementing partners in those and build a shared understanding.
    • The planning and carrying out of these sessions can be resource intensive, as is the data collection for them (which in some offices involves digitized applications or simpler methods for tracking key events, engagements and policy changes). As a process, those offices who use them have found them to support greater program effectiveness.
    • The process of the sessions is insufficient as a basis for adaptive programming. Some of our offices complement strategy testing by building everyday reflection into the team environment, so that it isn’t business-as-usual for three months followed by epiphany! These practices are along the lines of everyday PEA. One office has integrated a more formal PEA into the strategy testing process to strengthen the analytic frame within which they reflect every six months.
    • Our last reflection session in January focused on two related themes – building adaptive teams (rather than trying to hire them in) and resourcing the time needed for trust building. In terms of the former, we have been extremely happy to see that in some of our offices where significant time and effort has gone into building team confidence and a great working environment, with processes in place for strategy testing and adaptation, the teams have been in the right mind to creatively adapt their programs to support Covid response quickly, enthusiastically and effectively. I’ve copied our Nepal Country Rep, Meg, above, who is particularly focused on this theme at the moment with her team there.
    • And on the last point of trust-building – given the resource intensive nature of some of these activities, combined with the long-term realization that thinking and working politically requires a great deal of engagement with partners (government and non-government), where trust is crucial to fostering long-term sustainable change – we posed ourselves the question of how can we make the argument more strongly (to donors and the community at large) that we need to resource a great deal of stakeholder engagement (or relationship management, for want of a better term) that may or may not lead decisively or immediately to an outcome. Where we continue to exist in a world of governance programming focused on outputs such as policy documents, handbooks or guidelines produced, websites developed, apps created or workshops held, it is difficult to work within a value-for-money frame where trust-building takes up such a lot of time. It is a question we are continue to work on.

 

Again, thanks for asking! I hope you find some of that helpful or interesting. Happy to engage separately if anyone wants to follow up on any of the above. And as I say, colleagues copied above might enjoy partaking of this conversation as well.

 

Wishing you all a lovely weekend.

 

Nicola

 


 

cidimage001.jpg@01D6029B.66281E60

 

Nicola Nixon (Dr.)

Regional Director, Governance

Lakeside Green Building, 5th floor

33 Truc Bach Street, Ba Dinh,

Hanoi, Vietnam

Mob: +84 93 453 9848 
Tel: 84 (243) 943-3263 | nicola...@asiafoundation.org

skype: nicola.nixon | www.asiafoundation.org

______________________________________

 

 

1.       Scenarios where some probabilities can be assigned - this can be dealt with as a risk

2.       Scenarios where it is not possible to do so – this has to be dealt with as an uncertainty

John Hoven

unread,
Jun 6, 2020, 8:26:17 AM6/6/20
to Nicola Nixon, Adaptive Development | #AdaptDev, Arnaldo Pellini, Christine Bantug, Devon Ysaguirre, Gobie Rajalingam, Gopa Thampi, Jaime Faustino, Jane Sail - Consultant, Kim McQuay, Meghan Nalbo, Niki Palmer, Nilima Gulrajani, Silva Ferretti, rick davies
Nicola Nixon says that The Asia Foundation’s guidance note developed last year states: “Tools and techniques used across TAF allow for purposeful adaptation ... on a day-to-day basis or at regular intervals of two to three months. Most commonly in TAF, Strategy Testing is used for this purpose.“

Does this mean that the recommended practice now is, that the Theory of Change evolves on a day-to-day basis at the start of a project when so much is still undiscovered, and the project has not yet committed to a specific plan of action; and that later in the life of the project, the pace of learning and adaptation slows down to regular intervals of two to three months?

That makes sense, in contrast to the practice reported in the 2015 article: “Approximately 4 months after developing the initial TOC, the team conducts its first ST exercise, which is then repeated approximately every 3 to 4 months.”

John Hoven

Susanna Campbell

unread,
Jun 6, 2020, 12:38:08 PM6/6/20
to John Hoven, Nicola Nixon, Adaptive Development | #AdaptDev, Arnaldo Pellini, Christine Bantug, Devon Ysaguirre, Gobie Rajalingam, Gopa Thampi, Jaime Faustino, Jane Sail - Consultant, Kim McQuay, Meghan Nalbo, Niki Palmer, Nilima Gulrajani, Silva Ferretti, rick davies
Dear All:

Thank you for this fascinating conversation. In my book - Global Governance and Local Peace: Accountability and Performance in International Peacebuilding - I make the distinction between adaptation and learning. Adaptation refers to changing (either your aim, your program design, or the way it is implemented) without information about whether you are achieving your aim. Learning, on the other hand, refers to "action to align the project/program aims with outcomes" and requires information about the gap between aims and outcomes. You can adapt without learning, but you cannot learn without adapting. I find that better programming (particularly in uncertain and conflict-affected contexts) results from learning, not adaptation.

I summarize this argument in this piece that I wrote for Mercy Corps on the implementation of the Global Fragility Act, and in this piece that Dan Honig, Sarah Rose, and I wrote for CGD on accountability and the Global Fragility Act. 

I also have several copies of my Global Governance and Local Peace book sitting around my office. If it would be helpful for your work, please let me know. I can send a free book to the first three people who email me (please email me individually, not via this list). 

Wishing you all a good weekend,
Susanna


On Sat, Jun 6, 2020 at 8:26 AM John Hoven <jho...@gmail.com> wrote:

External Email: Use caution with links and attachments.



--

Prof. Susanna P. Campbell

Assistant Professor
School of International Service (SIS)
American University, Washington, DC
(202) 885-1428
@SusannaCampbell
google scholar profile
www.susannacampbell.com 
 

Book
Global Governance and Local Peace: Accountability and Performance in International Peacebuilding, Cambridge University Press, 2018.


Recent pieces

Creating an Accountability Framework that Serves the Global Fragility Act's Mission (with D. Honig and S. Rose), Center for Global Development, January 10, 2020.

Foreign Assistance and Accountability in Fragile States (with G. Ingram), Brookings Institution, January 29, 2020.

Book Review Roundtable: A Savage Order, Texas National Security Review, February 5, 2020.

Pedro Prieto Martín

unread,
Jun 8, 2020, 10:31:01 AM6/8/20
to Adaptive Development | #AdaptDev
Hi all!
I think this is the longest thread ever in the AdaptDev group! 
There's nothing as productive as a good and compelling question. Thanks Arnaldo (and everybody else)!!

I just wanted to add some nuances to the reflections started by Charlotte, which explained how some degree of flexibility is a precondition to be adaptive, and talked about "adaptive rigour". 
Flexibility is clearly not the only precondition: you also need to sense well both the programme's context (external) complexity and the evolution of the institutional (internal) constraints and opportunities, in order to be able to react to them; you also need a capacity to reflect and learn from that sensing; and finally, you need a willingness and capacity to turn the learning (or at least, informed beliefs) into improved plans for action.

So the difference between programmes that are just flexible and those that aim to be adaptive probably lies in the way adaptive programmes voluntarily "constrain" or "channel" their available flexibility, on all those levels, by intentionally using monitoring and management processes that enable enhanced sensing and reflections, while reserving enough capacity to be able to act on the learning. Hence the notion of "adaptive rigour".

The distinction between "passive adaptive management" and "active adaptive management" developed in the 'socio-ecological systems management' field can be useful here.
Extending it slightly we could think of the following levels of "adaptiveness" in development programmes:

- Forced adaptation, where programmes are adapted on a case by case basis, exceptionally, once it becomes obvious that the original plans are not working at all (this is what happened with so many Covid-19 impacted programmes: finding flexibility where none or very few was planned);

- Flexible programming (aka 'Adaptive Management lite'): a stripped-down version of adaptive management that resembles ad hoc contingency planning more than it does planned ‘learning while doing’. It almost always neglects to develop testable hypotheses as the basis for management actions.

- Passive Adaptive Management uses regular monitoring and reflection activities to detect new challenges and, when needed, adjusts plans to remain on track toward achieving the desired outcomes, with the support from operational functions; 

- Active Adaptive Management, finally, recognises the need for systematic experimentation to validate assumptions and plans for a regular upgrading of the programme's strategies; it considers learning and the reduction of uncertainty derived from imperfect knowledge as one of the key objectives of the programme’s management effort.


(typology inspired by Frohlich, M.F.; Jacobson, C.; Fidelman, P. and Smith, T.F. (2018) ‘The relationship between adaptive management of social-ecological systems and law: a systematic review’, Ecology and Society 23.2, http://doi.org/10.5751/ES-10060-230223 ).

Kind regards,
Pedro
To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

Pedro Prieto Martín

unread,
Jun 8, 2020, 11:21:55 AM6/8/20
to Adaptive Development | #AdaptDev
Hi John,
On the different paces at which learning and adaptation need to happen... I think the disaggregation of "adaptive management" into "adaptive governance", "adaptive programming" and "adaptive delivery" which researchers from Itad & Oxfam developed during the last year (mostly as part of their analysis of adaptive programmes within the Action for Empowerment and Accountability research programme) is really illuminating.

You can see their thinking evolving from their first case study about Pyoe Pin in Myanmar (Green and Christie), through the case study about PERL (Punton and Burge), the case study on Tanzania (Green and Guijt) and then into the publication that summarizes the learning from 3 cases (Green and Christie)This synthesis paper includes a very nice diagram that links the three adaptive dimensions.

However, as part of a piece of research on "Adaptive management in SDC" that we (Prieto-Martin, Apgar and Hernandez) conducted last year, we proposed a further iteration of the diagram (that adds an additional box to increase clarity)! 
We all love iterating and cross-fertilizing, don't we? :-) 

Anyway: since an image is worth a thousand words, here you have it:

AG-AP-AD.PPM.png


This diagram suggests that sensing, reflecting, adapting... needs to happen, normally, at different speeds, corresponding to the main levels of operation of the programme. (To some extent, you could link these different levels with single-loop, double-loop and triple-loop learning).


However, if the level of ignorance/uncertainty is very high, as is the case (as you suggested) during the inception period for a programme or also when changes are happening very quickly in the operating context, you would need to accelerate the rhythm at which you sense-reflect-adapt throughout the levels depicted in the diagram.


Best,

Pedro




On Saturday, June 6, 2020 at 1:26:17 PM UTC+1, John Hoven wrote:
Nicola Nixon says that The Asia Foundation’s guidance note developed last year states: “Tools and techniques used across TAF allow for purposeful adaptation ... on a day-to-day basis or at regular intervals of two to three months. Most commonly in TAF, Strategy Testing is used for this purpose.“

Does this mean that the recommended practice now is, that the Theory of Change evolves on a day-to-day basis at the start of a project when so much is still undiscovered, and the project has not yet committed to a specific plan of action; and that later in the life of the project, the pace of learning and adaptation slows down to regular intervals of two to three months?

That makes sense, in contrast to the practice reported in the 2015 article: “Approximately 4 months after developing the initial TOC, the team conducts its first ST exercise, which is then repeated approximately every 3 to 4 months.”

John Hoven
On Fri, Jun 5, 2020 at 11:29 PM Nicola Nixon <nicol...@asiafoundation.org> wrote:

Hi everyone,

 

Thanks so much for asking about our adaptive programming approaches in TAF! I’ve followed bits and pieces of this conversation during the week and have greatly enjoyed it. I had been trying to find a little headspace to chime in and now it seems I must get on with it and do so!

 

Firstly, while the original Strategy Testing approach (to which enormous credit goes to Debra Ladner, also I believe on this list!) described it as a highly flexible approach, that was in a time before everything and anything described itself as ‘flexible, adaptive and iterative’ and, as we know, threatened to oversimplify and dilute a burgeoning new practice within the world of DDD. Within TAF a few years later we see Strategy Testing as a method for Adaptive Programming (not simply flexible approaches to program implementation). Like you all, we have debated the distinction between flexible and adaptive. In our internal guidance document, we define adaptive programming as: ‘An approach to development programming in complex and fluid environments that enables teams to adapt strategies, activities and theories of change so that the program may achieve its overarching goal.’

 

Like the comment below that highlights adaptation to the context, this distinguishes between adaptive programming and, say, being flexible to the needs and demands of donors. We have also found it useful to clarify a little further and we refer to ‘purposeful and meaningful’ adaptation. Our guidance note developed last year states: “Tools and techniques used across TAF allow for purposeful adaptation – where there are processes around decision-making. Systems are used to carve out sufficient time for reflection and document the resulting insights on a day-to-day basis or at regular intervals of two to three months. Most commonly in TAF, Strategy Testing is used for this purpose. Other tools TAF has at its disposal enable meaningful adaptation – where decision-making is evidence not simply opinion-based. Changes of course draw on evidence of the context such as that derived from action research, stakeholder analyses and political economy analyses (of the 21st century variety).”

 

Secondly, to your question on how it has worked in practice there is an awful lot that can be said and said better than I, so I have copied in some colleagues who are well into a number of years of practice and may wish to elaborate further. To give you a relatively quick overview:

 

  • Some of our country offices – Philippines, Myanmar, Nepal, Sri Lanka, Timor-Leste, in particular – have been practicing Strategy Testing (or a variation) for quite a few years now in a dedicated fashion. To build learning across TAF from these offices we have an internal community of practice with the tongue-in-cheek name of The Adapters, with membership extending to twelve country offices throughout Asia. We convene every six months to share learning across our teams and, on the last occasion in Kathmandu in January, also with external partners. We aim to hold an online session in June.
  • We’ve learnt a lot from these sessions and are continuing to do so (and yes, we should put something out into the world on our reflections! it is on our to-do list, believe me!)

 

    • Structured reflection sessions at regular intervals are extremely useful to build a consensus view on new program directions; can be facilitated to allow for robust discussion on challenges and failures; and most importantly can enable programs to grasp new opportunities that present themselves in the operating environment/political economy and to change course. They can also allow for robust discussion on the program outcomes and theory of change and their ongoing validity – which, for me, is at the heart of an adaptive rather than simply flexible, approach. Attention needs to be paid to who joins the sessions at which intervals to get the most out of them, what information and evidence feeds into them (so discussion relies on more than opinions in the room). Some offices operate with concentric circles of reflection that engage donors and implementing partners in those and build a shared understanding.
    • The planning and carrying out of these sessions can be resource intensive, as is the data collection for them (which in some offices involves digitized applications or simpler methods for tracking key events, engagements and policy changes). As a process, those offices who use them have found them to support greater program effectiveness.
    • The process of the sessions is insufficient as a basis for adaptive programming. Some of our offices complement strategy testing by building everyday reflection into the team environment, so that it isn’t business-as-usual for three months followed by epiphany! These practices are along the lines of everyday PEA. One office has integrated a more formal PEA into the strategy testing process to strengthen the analytic frame within which they reflect every six months.
    • Our last reflection session in January focused on two related themes – building adaptive teams (rather than trying to hire them in) and resourcing the time needed for trust building. In terms of the former, we have been extremely happy to see that in some of our offices where significant time and effort has gone into building team confidence and a great working environment, with processes in place for strategy testing and adaptation, the teams have been in the right mind to creatively adapt their programs to support Covid response quickly, enthusiastically and effectively. I’ve copied our Nepal Country Rep, Meg, above, who is particularly focused on this theme at the moment with her team there.
    • And on the last point of trust-building – given the resource intensive nature of some of these activities, combined with the long-term realization that thinking and working politically requires a great deal of engagement with partners (government and non-government), where trust is crucial to fostering long-term sustainable change – we posed ourselves the question of how can we make the argument more strongly (to donors and the community at large) that we need to resource a great deal of stakeholder engagement (or relationship management, for want of a better term) that may or may not lead decisively or immediately to an outcome. Where we continue to exist in a world of governance programming focused on outputs such as policy documents, handbooks or guidelines produced, websites developed, apps created or workshops held, it is difficult to work within a value-for-money frame where trust-building takes up such a lot of time. It is a question we are continue to work on.

 

Again, thanks for asking! I hope you find some of that helpful or interesting. Happy to engage separately if anyone wants to follow up on any of the above. And as I say, colleagues copied above might enjoy partaking of this conversation as well.

 

Wishing you all a lovely weekend.

 

Nicola

 


 

cidimage001.jpg@01D6029B.66281E60

 

Nicola Nixon (Dr.)

Regional Director, Governance

Lakeside Green Building, 5th floor

33 Truc Bach Street, Ba Dinh,

Hanoi, Vietnam

Mob: +84 93 453 9848 

Tel: 84 (243) 943-3263 | nicola.nixon@asiafoundation.org

skype: nicola.nixon | www.asiafoundation.org

______________________________________

 

 

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.

To unsubscribe from this group and stop receiving emails from it, send an email to adap...@googlegroups.com.

John Hoven

unread,
Jun 8, 2020, 1:09:59 PM6/8/20
to Pedro Prieto Martín, Adaptive Development | #AdaptDev
Pedro, your article confirms the problem that motivated my question about the pace of learning — that is, operational plans are predetermined (based on assumptions, research, and lessons learned from other contexts), and operational teams try to adapt within that strait-jacket:

“Adaptive delivery refers to the day-to-day operation of the programmes ... while continuously questioning whether or not the plans still work in the current situation, and what adaptations may be required.... Adaptive delivery is not always informing adaptive programming — processes of reflection and adaptation at higher levels are slow and can be cumbersome.” ("Adaptive management in SDC" pp. 32,37)

You say, “if the level of ignorance/uncertainty is very high, as is the case (as you suggested) during the inception period for a programme ... you would need to accelerate the rhythm at which you sense-reflect-adapt throughout the levels depicted in the diagram.”

I agree. But that triggers the question, How rapidly can a Theory of Change evolve throughout the levels depicted in the diagram? That diagram suggests learning measured in months rather than days. 

I would also replace “sense-reflect-adapt” with “articulate ToC - focus on key causal links - gather information - confirm or reject causal links - revise ToC.” The latter sequence is more firmly grounded in evidence and analysis, and it can be measured in days rather than months. 

John Hoven

Tel: 84 (243) 943-3263 | nicola...@asiafoundation.org

skype: nicola.nixon | www.asiafoundation.org

______________________________________

 

 

John Hoven

unread,
Jun 11, 2020, 7:07:46 PM6/11/20
to Pedro Prieto Martín, Adaptive Development | #AdaptDev

I’d like to try to pull together some of the ideas in this conversation. I’ll sort them roughly into two categories, which I will discuss in two separate posts. The two categories are “varied contexts” and “changing contexts.” “Varied contexts” relates to differences among contexts, while “changing contexts” relates to changes over time within a particular context.

 

I’ll start with “varied contexts.” It helps to sort this category into two subcategories:

 

-        Statistical context (e.g., villages or market systems that can be adequately described with a quantitative database)

-        Unique context (e.g., villages or market systems characterized by uniquely human desires, capabilities, and relationships)

                                                             

This is an important distinction, because they are analyzed very differently. Statistical contexts can be studied with statistical models and controlled scientific experiments. Unique contexts cannot, because there is no control group for comparison. Qualitative methods are designed specifically for these contexts. One branch of qualitative analysis focuses on testing hypotheses of cause-and-effect in a one-of-a-kind situation. That is especially relevant for localized development and peacebuilding projects.

 

I see two principal strategies for adapting to a unique context:

 

-        Transfer responsibility to local stakeholders (“locally led” development and peacebuilding).

-        Learn and analyze context-specific desires, capabilities, and relationships at the start of a project, and use this to identify problems and opportunities that can be addressed.

 

The first of these two strategies is fairly common. The second one is rare, but some comments in this conversation suggest that people are beginning to think about it. (Debra Ladner: “The initial TOC sets out the team’s ‘best guess’ about the most likely path to change. Since this first TOC is based on the team’s initial understanding of the problem and its context, they recognize that the TOC is likely incomplete and will evolve over time as the team builds relationships, gathers new information, experiments, and, most importantly, reflects on what is working and what is not.” Pedro Prieto Martin: “if the level of ignorance/uncertainty is very high, as is the case … during the inception period for a programme ... you would need to accelerate the rhythm at which you sense-reflect-adapt...”)


John Hoven

John Hoven

unread,
Jun 11, 2020, 7:08:47 PM6/11/20
to Pedro Prieto Martín, Adaptive Development | #AdaptDev

This posting relates to “changing contexts.” It helps to sort this category into two subcategories:

 

-        Predictably changing contexts (e.g., due to the change of seasons, frequent droughts or floods, or the end of a development project)

-        Unpredictably changing contexts (e.g., a hurricane or violent conflict)

 

The attributes of predictably changing contexts can be learned at the start of a project. The appropriate methods will depend on whether this is a “statistical context” or “unique context” – but, in either case, the project can be designed appropriately at the start, rather than over time as the predictable changes occur. (Susanna Campbell: “Learning … refers to "action to align the project/program aims with outcomes" and requires information about the gap between aims and outcomes… I find that better programming (particularly in uncertain and conflict-affected contexts) results from learning, not adaptation.”)

 

Resilience for unpredictably changing contexts may be a project goal. One strategy is to build on local capabilities that have evolved to cope with these uncertainties. Another is to strengthen market systems, because profit-seeking makes them inherently resilient. A third (suggested by Rick Davies) is to identify a range of possible scenarios, and build local capabilities that yield satisfactory outcomes in the largest range of future contingencies. Marcus Jenal adds, “There are three aspects to resilience: persistence, adaptation, and transformation.”

 

Another source of unpredictability arises from a project’s failure to understand the context at the start of the project, or later, and instead just muddle through. This is not the result of an unpredictably changing context. Pedro Prieto Martin suggests the following levels of ‘adaptiveness’ in development programs:

-        Forced adaptation, where programmes are adapted … once it becomes obvious that the original plans are not working at all.

-        Flexible programming … resembles ad hoc contingency planning more than it does planned ‘learning while doing’.

-        Passive Adaptive Management uses regular monitoring and reflection activities to detect new challenges and, when needed, adjusts plans to remain on track toward achieving the desired outcomes, with the support from operational functions;

-        Active Adaptive Management, finally, recognizes the need for systematic experimentation to validate assumptions and plans for a regular upgrading of the programme’s strategies; it considers learning and the reduction of uncertainty derived from imperfect knowledge as one of the key objectives of the programme’s management effort.

 John Hoven

Philip Smith

unread,
Jul 2, 2020, 4:30:53 AM7/2/20
to Adaptive Development | #AdaptDev
Thanks everyone for this thread, and thanks John for this summary - this has all been very insightful! I am trying to make some connections here between the ideas/theory expressed here and tools...

As I read John's second strategy here - "learn and analalze context-specific desires, capaciities, and relationships at the start of a project, and use this to identify problems and opportunities that can be addressed." - I was a bit suprised to here that you think it is rare (well, ok, maybe not that suprised!). My reaction is because this is exactly what I think Outcome Mapping tries to do in a systematic way (a tool which I'm sure most of you know has been around for a while!) something like this...

1. Map out the actors in the local system and try to understand motivations and drivers of the different actors (Everyday Political Analysis can also be a good additional tool here)
2. Make a consious boundary choice about what parts of this system you can actually influence (boundary partners)
3. build a theory of change based upon the behavioural and relational changes we initially believe are needed in order for there to be a meaningul shift in how the system operates (outcome challenges and progress markers)
4. Develop strategies (a theory of action) to try and influence the desired behavioural change (strategies)
5. Observe, journal and reflect together on actual behaviour changes and use this to update strategies (our experiments in behavioural change) and the theory of required behavioural change to match what we are learning.

When done close to the ground ( Transfer responsibility to local stakeholders) then I have found that OM can really help teams to build the kind of nuanced picture of behavioural and relational change needed to identify the real "problems and opportunities that can be addressed". 

Now this is starting to sound like a sales pitch for OM ... but I am more fishing for reactions. Do others see a close connection here?

I think OM really helps to operationalise the "adaptive delivery" part of the chain. But perhaps the area of required innovation is more in terms of creating the organisational space for adaptive delivery to operate, so that these kind of projects don't need to be"schizophrenic" - trying to justify and legitimise their action research approach in relation to a "straight-jacket" of non-adaptive program planning and/or organisational and contractual systems. (the parts to the left of Pedro's diagram).

Phil Smith



On Friday, 12 June 2020 01:07:46 UTC+2, John Hoven wrote:

I’d like to try to pull together some of the ideas in this conversation. I’ll sort them roughly into two categories, which I will discuss in two separate posts. The two categories are “varied contexts” and “changing contexts.” “Varied contexts” relates to differences among contexts, while “changing contexts” relates to changes over time within a particular context.

 

I’ll start with “varied contexts.” It helps to sort this category into two subcategories:

 

-        Statistical context (e.g., villages or market systems that can be adequately described with a quantitative database)

-        Unique context (e.g., villages or market systems characterized by uniquely human desires, capabilities, and relationships)

                                                             

This is an important distinction, because they are analyzed very differently. Statistical contexts can be studied with statistical models and controlled scientific experiments. Unique contexts cannot, because there is no control group for comparison. Qualitative methods are designed specifically for these contexts. One branch of qualitative analysis focuses on testing hypotheses of cause-and-effect in a one-of-a-kind situation. That is especially relevant for localized development and peacebuilding projects.

 

I see two principal strategies for adapting to a unique context:

 

-        Transfer responsibility to local stakeholders (“locally led” development and peacebuilding).

-        Learn and analyze context-specific desires, capabilities, and relationships at the start of a project, and use this to identify problems and opportunities that can be addressed.

 

The first of these two strategies is fairly common. The second one is rare, but some comments in this conversation suggest that people are beginning to think about it. (Debra Ladner: “The initial TOC sets out the team’s ‘best guess’ about the most likely path to change. Since this first TOC is based on the team’s initial understanding of the problem and its context, they recognize that the TOC is likely incomplete and will evolve over time as the team builds relationships, gathers new information, experiments, and, most importantly, reflects on what is working and what is not.” Pedro Prieto Martin: “if the level of ignorance/uncertainty is very high, as is the case … during the inception period for a programme ... you would need to accelerate the rhythm at which you sense-reflect-adapt...”)


John Hoven


On Mon, Jun 8, 2020 at 1:09 PM John Hoven <jho...@gmail.com> wrote:
Pedro, your article confirms the problem that motivated my question about the pace of learning — that is, operational plans are predetermined (based on assumptions, research, and lessons learned from other contexts), and operational teams try to adapt within that strait-jacket:

“Adaptive delivery refers to the day-to-day operation of the programmes ... while continuously questioning whether or not the plans still work in the current situation, and what adaptations may be required.... Adaptive delivery is not always informing adaptive programming — processes of reflection and adaptation at higher levels are slow and can be cumbersome.” ("Adaptive management in SDC" pp. 32,37)

You say, “if the level of ignorance/uncertainty is very high, as is the case (as you suggested) during the inception period for a programme ... you would need to accelerate the rhythm at which you sense-reflect-adapt throughout the levels depicted in the diagram.”

I agree. But that triggers the question, How rapidly can a Theory of Change evolve throughout the levels depicted in the diagram? That diagram suggests learning measured in months rather than days. 

I would also replace “sense-reflect-adapt” with “articulate ToC - focus on key causal links - gather information - confirm or reject causal links - revise ToC.” The latter sequence is more firmly grounded in evidence and analysis, and it can be measured in days rather than months. 

John Hoven

Tel: 84 (243) 943-3263 | nicola.nixon@asiafoundation.org

skype: nicola.nixon | www.asiafoundation.org

______________________________________

 

 

Christine Kalume

unread,
Jul 2, 2020, 5:03:35 AM7/2/20
to Philip Smith, Adaptive Development | #AdaptDev
Hi Phil, 

Just a quick reaction to add my thanks for the thread and to agree 

When done close to the ground ( Transfer responsibility to local stakeholders) then I have found that OM can really help teams to build the kind of nuanced picture of behavioural and relational change needed to identify the real "problems and opportunities that can be addressed". 


I'm part of a.. Very small.. community-level social enterprise and we've found OM has worked for us.. it also helped us identify what we hope is a real innovation that combines a long term business model and outcomes with short term gains needed for young people in our community... but we're yet to resource the idea to pilot it. 

Chris


Tel: 84 (243) 943-3263 | nicola...@asiafoundation.org

skype: nicola.nixon | www.asiafoundation.org

______________________________________

 

 

<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid

John Hoven

unread,
Jul 2, 2020, 8:20:24 AM7/2/20
to Christine Kalume, Adaptive Development | #AdaptDev, Philip Smith
Phil and Chris, do you agree with this statement from an ILAC/CGIAR Brief on Outcome Mapping?

Outcome mapping does not help a team identify program priorities. It is appropriate and useful only when a program has already chosen its strategic direction and wants to chart its goals, partners, activities and progress towards anticipated results.

--
You received this message because you are subscribed to the Google Groups "Adaptive Development | #AdaptDev" group.
To unsubscribe from this group and stop receiving emails from it, send an email to adaptdev+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/adaptdev/CANENNAuUvoz-RVqe00oC_5ec5ZvNyJFP-rSkf%2B6%3DdgE-Mh3cFg%40mail.gmail.com.

Christine Kalume

unread,
Jul 2, 2020, 9:03:21 AM7/2/20
to John Hoven, Adaptive Development | #AdaptDev, Philip Smith
Thanks John.. Not a straight answer.. we used it when we were pretty clear on what our priorities were because the work was embedded in the community. So in that sense this criticism might hold. But I've also seen it used very effectively for designing work with stakeholders in a refugee camp setting.. I know it really worked for the broad team and the resulting work went well. But I wasn't involved directly myself. I'd be interested in what others think.. And I'll read the document. 

Chris

Philip Smith

unread,
Jul 2, 2020, 10:11:06 AM7/2/20
to John Hoven, Christine Kalume, Adaptive Development | #AdaptDev
Hi again,

Interesting quote ...and hey, who am I to argue with one of the fathers of outcome mapping!! :)

I think this is tricky though, it depends on what you mean by priorities. Outcome Mapping does assume that you have a local system in mind that you want to be a part of changing (e.g. systems of gender exclusion, non-fulfilment of indigenous rights, resilience to drought, dysfunctional education). 

In my experience it helps projects think beyond their intrenched boundaries of “what is in the system” by getting them to challenge this boundaries by asking those involved in design to think more broadly about who is a part of the system they want to change. Priorities for the program are then made in terms of which actors are most strategic to try and influence, and which actors we feasibly have the ability to influence/walk alongside. 

Priorities in OM are actor-focused. Any thematic priorities (which system to try and change) need to have already been made (any one else from the OM community want to weigh in here?!). To me this is a challenge of two different perspectives on our complex world - people and issues. Both perspectives have there affordances and constraints, but I usually prefer an actor focus as it is less abstract!

Phil

John Hoven

unread,
Jul 4, 2020, 12:27:20 PM7/4/20
to Philip Smith, Adaptive Development | #AdaptDev, Christine Kalume
The comments in this thread highlight the need to adapt to the specific context. If we do that, we will surely adapt to changes in that context. Moreover, we will do so rapidly (day by day, not just semiannually) and responsively (in response to small changes in the context, not just hurricanes and clear failures in the project design). 

That’s hard to do, if the project’s theory of change is based on prior assumptions and lessons learned from other contexts. To avoid that, this blog excerpt highlights the need to design the theory of change at the moment that meaningful local engagement begins:

Was the intervention concept/framing/objective/theory of change – and the budget and work plan – already generated before meaningful local engagement began? If the answer is yes, the prospects for authentic engagement, localization, and likely sustainability, are already poor.“
Has anyone seen a theory of change that evolves rapidly when meaningful local engagement begins?

John Hoven

Pedro Prieto Martín

unread,
Jul 6, 2020, 1:27:07 PM7/6/20
to Adaptive Development | #AdaptDev
Dear John, 
Apologies for my very late response.
Being confined with two small toddlers... kept me totally out of the game till now, that the nursery reopened! :-)
I was planning to answer you in private, but given that the thread got active again... I think it is better to write you in the open.
Please see my comments below, highlighted in red.

Best,
Pedro

On Monday, June 8, 2020 at 6:09:59 PM UTC+1, John Hoven wrote:
Pedro, your article confirms the problem that motivated my question about the pace of learning — that is, operational plans are predetermined (based on assumptions, research, and lessons learned from other contexts), and operational teams try to adapt within that strait-jacket:

“Adaptive delivery refers to the day-to-day operation of the programmes ... while continuously questioning whether or not the plans still work in the current situation, and what adaptations may be required.... Adaptive delivery is not always informing adaptive programming — processes of reflection and adaptation at higher levels are slow and can be cumbersome.” ("Adaptive management in SDC" pp. 32,37)

You say, “if the level of ignorance/uncertainty is very high, as is the case (as you suggested) during the inception period for a programme ... you would need to accelerate the rhythm at which you sense-reflect-adapt throughout the levels depicted in the diagram.”

I agree. But that triggers the question, How rapidly can a Theory of Change evolve throughout the levels depicted in the diagram? That diagram suggests learning measured in months rather than days.

The diagram suggests that learning and adjustments happen daily, weekly, monthly, biannually... in short: at different speeds for the different levels and actors. And I would say it is good that it is so, as faster is not always necessarily better!

A good ToC ultimately should refer not to our "limited, naive understanding" of the context, but to the context's systemic, emergent and dynamic properties: how the system reacts to (and frequently, against) your strategies and actions.

These are rarely things that you can prototype in a couple of days, to quickly validate whether or not your ideas seem to be right or wrong.
If a ToC is well framed, you will need to be patients to be able to assess if its key assumptions are good.

For sure, it is worth to prototype and validate everything that you can, as soon as you can, to remove as much "stupidities" as possible (which, as you indicated, are normally the result of the ToC being designed (initially) by remote "experts" who mostly ignore what really counts). But beyond that, you need to be willing to dance with the system at the rhythms it dictates.

So... while you could be changing your operational plans (which are hopefully inspired and directed by your ToC) quite quickly, you wouldn't expect radical changes to the ToC to be applied very frequently.
One of the objectives of a ToC is to facilitate the high-level alignment among the different organizations and stakeholders involved in an intervention. It, therefore, needs to be kept at the right abstraction level.
If you need to reinvent the ToC every couple of days... either it was not mature enough (just a "very-early-draft-of-a-concept-for-a-ToC"), or it is too detailed.

 
I would also replace “sense-reflect-adapt” with “articulate ToC - focus on key causal links - gather information - confirm or reject causal links - revise ToC.”
Sure, that's generally ok. For cases where ToC are used you could have more specific language. Though I would expect "revise ToC" not to be the final step. It is action what needs to change, not just diagrams! :-)

Terms like sense, assess, reflect, adapt, etc. are meant to be more generally applicable. But what really matters are the ideas behind the terms, which can then be applied to different situations.

 
The latter sequence is more firmly grounded in evidence and analysis, and it can be measured in days rather than months. 

As I said, faster is not always better.
While some people or some of the orgs involved in an action may be able to move fast for a while, this is rarely the case for all of them.
When many actors are involved in an intervention, delays happen all the time, and slack and buffers are required to advance.

See, for example, how much time it took me to answer to your message!! :-)

So... I personally think it is better not to aim for maximum speed but for sustained and reliable improvement where all relevant actors keep aligned.
  

John Hoven

John Hoven

unread,
Jul 8, 2020, 7:56:16 AM7/8/20
to Pedro Prieto Martín, Adaptive Development | #AdaptDev
Pedro said:
while you could be changing your operational plans (which are hopefully inspired and directed by your ToC) quite quickly, you wouldn't expect radical changes to the ToC to be applied very frequently.
One of the objectives of a ToC is to facilitate the high-level alignment among the different organizations and stakeholders involved in an intervention. It, therefore, needs to be kept at the right abstraction level.
If you need to reinvent the ToC every couple of days... either it was not mature enough (just a "very-early-draft-of-a-concept-for-a-ToC"), or it is too detailed.

Let’s apply this to a context-specific project. 

For example, consider a project to support agriculture in the informal-quality sector (seeds are locally grown, low-cost, and adapted to local conditions; crop quality varies, with low- and high-quality product going to different end users). This sector is much more context-specific than agrifood for supermarkets and export markets (which demand consistent crop quality, and therefore standardized seeds and growing methods). 

For this context-specific project, a nonspecific  “very-early-draft-of-a-concept-for-a-ToC” is a way to begin. This draft ToC evolves, as the project team and local partners discover a desired goal (what is doable and worth doing in this particular local context) and a way to achieve it (a causal chain leading to the desired goal). As Pedro suggests, this draft ToC may be revised every couple of days at first, and less frequently as the ToC matures. 

To facilitate alignment across different local contexts, the “very-early-draft” may identify categories of potential context-specific issues. To facilitate alignment between local teams and higher-level managers and donors, project contracts may specify processes for communication and decision-making while the context-specific ToC evolves in response to localized learning. 

John Hoven
Reply all
Reply to author
Forward
0 new messages