Skip to main content

funder_partner: PPPLab

The Scaling Scan — launch of 3rd edition

How many times have we seen innovative ideas launched into the marketplace, seeming to offer answers to key problems, only to see them fail to make the impact that we expected? In the modern world, having a great idea is not enough to ensure market success. Even when new products, processes or technologies have been carefully and successfully tested in trials and studies, the process of scaling and launching them often leads to disappointing results.

History of the Scaling Scan

“The Scaling Scan is a necessary breakthrough for those connected with meaningful impact. The Scaling Scan is accessible, practical, grounded in the reality, and most importantly, a watershed rethinking the ‘bigger is better’ logic of scaling.”

 

Rob McLean, CIMMYT scaling coordinator senior program specialist in Policy and Evaluation at IDRC and author of “Scaling Impact”

The Scaling Scan was developed to improve this process and ensure that new innovations have the best chance of success. Traditionally, scaling an innovation has often resulted in “linear” thinking, where the project team focuses on the advantages of their new product and relies on these for launch. The Scaling Scan encourages teams to broaden their thinking into areas within the overall private and public sector environments where they may have less experience, but which can greatly help or hinder the success of new ideas. It looks at 10 “ingredients” to consider, discuss, and develop strategies to address — ranging from end-user financing and business cases to national strategies and regulations.

The first version of the Scaling Scan was launched in 2017 following cooperation between scaling expert Lennart Woltering at CIMMYT and the Public Private Partnership Lab (PPPLab), a research consortium based in the Netherlands. A second, updated version was released the following year. The tool has been implemented through workshops held around the world, with trained moderators to encourage discussion, share ideas and develop expertise. These discussions resulted in five action steps:

  • Evaluation of realistic targets for the scaling — is the team’s thinking too ambitious, or alternatively, has the analysis identified further opportunities?
  • Consideration of the impact on other areas of concern — for example, the environment or social dynamics (such as gender roles and relations).
  • Identification of weak areas of expertise that hold back scaling — for example poor access to finance or lack of evidence that would convince others to join the cause.
  • New and better-informed directions for project management, taking into consideration their own capacities, networks, and power.
  • Identification of knowledge and expertise that would be of benefit to the scaling team.

More than 1,200 participants attended the workshops that were held in English, Spanish and French. Half of the workshops were held in Africa, with the rest divided between Asia and North and South America, including 11 in Mexico. In 2022, an online version was made available through the launch of a new website, https://scalingscan.org/ with support from the Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) and the One CGIAR Mitigate initiative. This has further increased the availability of and access to scaling information.

“The Scaling Scan pushes users to go beyond a narrow focus on scaling an innovation. It is a great tool that enables practical thinking about the multiple pathways to impact at scale and the range of stakeholders that need to be considered in scaling process.”

 

Kelly Hayley Price, DRC senior evaluation officer

3rd edition Scaling Scan Launch                    

On September 14, 2023, the 3rd edition of the Scaling Scan will be launched. With the support of GIZ, FAO, Alliance, and SNV, the tool has been enhanced to include some changes inspired by discussions at the workshops. There is increased consideration of gender roles and how these might affect, or be affected by, a scaling program. Likewise, the impact of climate change is also included. In terms of usability, the Scaling Scan has been adapted to make it more accessible to use without a moderator, meaning that users will be able to benefit even if they have difficulty getting to a workshop. It has also been designed to make it easier to customize the Scaling Scan to fit one’s own needs, rather than requiring the standard version used in workshops.

To find out more about the Scaling Scan, please visit https://scalingscan.org/, or email e.valencia@cgiar.org for more information.

Scaling Scan website launched

The Scaling Scan website has been launched offering the latest news, manuals, videos, trainings, a directory of consultants, and a forum to engage with peers and experts on how to use the Scaling Scan tool to support scaling processes.

The website, which was developed by Lennart Woltering, scaling advisor with the International Maize and Wheat Improvement Center (CIMMYT), and the Scaling team in CIMMYT, builds on the success of the Scaling Scan, a user-friendly tool designed for anyone to learn about scaling: appreciate that context is king, that innovations don’t scale alone, and that collaboration is key for success

“The idea behind the Scaling Scan has always been to make it accessible to users of all levels, to bring the discussion on scaling to the ground and therefore, just like the tool, the materials on the site are available in English, French, and Spanish,” said Woltering.

It features materials used in training programs and workshops by CIMMYT’s scaling team over the past five years, repurposing them neatly for users around the world to assess the scalability of their own pilot projects and innovations. The website also includes a forum where users can engage in conversations, exchange information, and ask experts and other users questions and advice related to scaling. The platform also acts as a conversation space, allowing users around the world to share their experiences with the Scaling Scan, ask questions, and learn from each other. This has the added benefit of helping the Scaling Scan team understand on the ground needs so that they can create more user-friendly content.

“The demand for Scaling Scan workshops has been overwhelming, within CIMMYT, the CGIAR, but also with development organizations like Catholic Relief Services and GIZ and the private sector and we realized that we should bank much more on its biggest asset: accessibility. So, in 2022 we started with trainings for facilitators and the website serves as the platform for them to draw inspiration, materials, and methodologies how to apply the Scaling Scan in their context,” said Woltering.

Scaling is a process that aims to achieve sustainable change at scale. This means that not only should many people benefit from a new technology, but the results of a particular project should carry over beyond its immediate context and transform communities for the better.

It’s a complex process, and there is no one single recipe or blueprint. The Scaling Scan can, however, give direction to scaling new projects and highlight key factors scaling teams need to look out for

“The Scaling Scan aims to provide a framework for people to understand how much they should scale, and what else should be taken into consideration, in addition to the technology, for the next steps in their scaling process,” said CIMMYT Scaling Coordinator Eva Marina Valencia Leñero. “It also intends to show that scaling is not only about focusing on where the innovation is ready or mature, but also whether there are enabling conditions – what we call scaling ingredients – surrounding this innovation that managers have to plan for if they want their innovation to last in the long-term.”

“Considering that the core of the tool was developed at a kitchen table with three people over two days with no funding, it is amazing that the tool has served more than 2,000 people in the last five years,” said Woltering. With support from GIZ, the Scaling Scan is now being digitized which allows for the development of different versions, for example one with more emphasis on social inclusion or on climate mitigation for the One CGIAR Low-Emission Food Systems (MITIGATE+) Initiative. The lessons from over five years of applying the Scaling Scan from rural areas in Honduras to Bangladesh are currently being written up.

The democratization of innovation

When the Norwegian Red Cross hired Kristian Wengen and his consulting firm Tinkr to launch a “Scaling for Success” initiative, he found himself at a crossroads. From international aid projects aiming to address the UN Sustainable Development Goals (SDGs) to private companies seeking to expand their market, everyone was talking about the challenges of scaling up – expanding and sustaining successful programs to reach a greater number of people – but there were few clear paths to solutions.

Wengen worked with CIMMYT to adapt the Scaling Scan. (Photo: Kristian Wengen)

The Scaling Scan has solutions to offer

But when Wengen came across a project using a tool called the Scaling Scan that identifies and analyzes 10 critical elements for assessing the scalability of any pilot project, he knew he had found a way forward. He was excited, but also worried because the project using the Scaling Scan had concluded.

Concerned he would lose access to the best tool he had found by far, Wengen connected with Lennart Woltering, who created the Scaling Scan for the International Maize and Wheat Improvement Center (CIMMYT) in collaboration with a Dutch-supported project on private-public partnerships called the PPPLab. Woltering and Wengen began a dialogue regarding repurposing the Scaling Scan for Wengen’s context.

“What I like about the Scaling Scan is that it works on a very detailed level to produce systemic results,” said Wengen. “It brings a simple approach to the complex problems of scalability, which allow organizations to achieve efficient solutions, regardless of their geographic or demographic context.”

The Scaling Scan focuses attention on discrete components – from finance and business cases to technology and skills – which are necessary to successfully scale an innovation. But it also spurs insight into how each of these necessary ingredients complement each other as a project prepares to successfully transition, reproduce, and expand.

Wengen believes the most effective work of the Scaling Scan happens in team conversations, and it helps deliver clear feedback that can form the basis of discussions that go straight to the heart of the matter. While the challenges of scaling an innovation are complex, the Scaling Scan cuts through the noise and focuses attention on solving the most important problems, whether related to leadership, collaboration, or public sector governance.

Scaling the Scaling Scan

In their conversations, Wengen and Woltering identified opportunities for improving the Scaling Scan. For example, Wengen is building a digitized, web-based version that, like the original Scaling Scan, will be freely available. He calls it a scorecard, a smaller version which capitalizes on the ability of the Scan to promote productive dialogue that moves a project forward. “I am thrilled to help broaden the reach of the Scaling Scan, as making it available for a much wider audience will democratize innovation,” Wengen said.

“Kristian’s adaptations are exactly how I designed the Scaling Scan to work,” said Woltering. “I wanted it to be straightforward enough to be useful across a broad range of business and development applications and flexible enough to be tailored to the specific needs of a particular region, culture, or marketplace.” Seeing how Wengen has utilized the Scaling Scan across a variety of markets has spurred Wennart to develop the Scaling Scan website, where other interested practitioners can download the tool and share their own innovations. “The Scaling Scan truly has utility across the broadest geographies and socioeconomic ranges,” said Wennart.

Wengen is hoping his scaling scorecard will help drive success in a new collaboration he is undertaking with Innovation Norway, a state-owned organization that helps Norwegian businesses grow and export promising products and services. Wengen believes his scorecard will add immense value to a diverse set of projects ranging from business management software helping bakeries reduce waste and increase profits to zero-carbon ocean-going ships and virtual medical training systems.

This kind of transfer and growth shows that even the Scaling Scan itself can be scaled up from the tropics to the Arctic Circle, and Woltering can’t wait to see where the next successful adaptation will spring up.

Breaking Ground: Lennart Woltering is a catalyst for achieving sustainable impact at scale

In Lennart Woltering’s first job working on agricultural water management with the International Crops Research Institute for the Semi-Arid Tropics (ICRISAT) in Niger, he observed a phenomenon that would influence his career path. Although drip irrigation involved huge benefits in terms of yields and productivity, adoption was low all across Africa. This fact made Woltering frustrated and interested.

In his second job at the biggest management consulting firm of Germany focused on international development, he was awarded a contract by the German development agency GIZ to lead a team on a demand-supply match for innovations from the CGIAR. Here he found that uptake of many innovations that showed superior performance over alternatives was limited and largely confined to the pilot project environment. When a few years later GIZ and the International Maize and Wheat Improvement Center (CIMMYT) advertised a Scaling Advisor position, Woltering knew this was the job for him.

Scaling is the process of expanding beneficial technologies and practices over geographies, and across institutions and levels to impact large numbers of people. This sounds very abstract, and Woltering is now supporting colleagues to make sense of the what, why and how of scaling in their specific contexts. The GIZ and CIMMYT contract modality does not force him to work on one project alone, but allows him to support a broad range of projects and programs to achieve more sustainable impact, within and beyond CIMMYT.

Changing mindsets

There is a modus operandi of doing projects in the most efficient way to meet targets, then moving on to the next project. Success is often measured by the number of beneficiaries reached at the last day of that project. However, this is often at the expense of important “systems work” such as building lasting relationships, developing organizational capacities and improving the enabling environment rather than finding holes in it. CIMMYT’s mission and vision are focused on social impact, hence the outcomes of our work are more important than our outputs. We cannot assume that adoption of an innovation leads directly to positive impacts — we have the responsibility to abide by the principles of “do no harm” and “leave no one behind.” Scaling is a process that should be part of the design of projects from the beginning.

Woltering keeps asking himself, “What happens when the project stops tomorrow? Do local actors have the capacities and desire to take responsibility of the scaling process once the project is over? What models of collaboration can survive the project?” He observes a strong underestimation of the importance of context for an innovation to be successful. Woltering’s guiding principle is “10% is the innovation and 90% is the context.”

Lennart Woltering discusses scaling strategies during a workshop at CIMMYT. (Photo: Maria Boa Alvarado/CIMMYT)

The Scaling Scan

The first thing Woltering did at CIMMYT was visit the country offices and projects in Africa and Asia, to understand how colleagues give meaning to scaling and to identify opportunities and challenges. He saw that in every context there was a different bottleneck to scaling — government policies, the value chain, but hardly ever the technology. The common denominator among these situations was that there was always a weakest link. If that problem was solved, teams would encounter the next weakest link. He identified a need to think strategically about project elements from the beginning of the project.

Woltering came across a paper by PPPLab that mentioned ten scaling ingredients, or ten conditions for scaling to be successful. He got in touch with them to see how this could be useful for CIMMYT and the CGIAR. “How can we make this fluffy concept of scaling that people don’t understand into something meaningful?”

This idea became the Scaling Scan, developed by PPPLab and CIMMYT. The tool helps practitioners to analyze what they want to scale, while trying to keep the process as simple as possible. The Scaling Scan helps teams to come up with a realistic ambition and identify bottlenecks from the start. It highlights what project teams need to pay attention to on the journey to reach scale.

“One thing that immediately becomes clear is that impact at scale requires a much broader range of skills and disciplines than what any one organization can bring. The Scaling Scan and an associated partnership tool we developed helps teams to recognize what type of collaborations are necessary along the way. It is very encouraging to get emails from organizations like Catholic Relief Services and ILRI that they are using the Scaling Scan on their own,” says Woltering.

Participants in the scaling workshop stand for a group photo with the trainers. (Photo: CIMMYT)

Progress towards impact

For many decades, CGIAR focused only on research, but in the last 20 years, it expanded to focus on what actually happens with those research outputs.

CIMMYT has always been working on things we now call scaling, in the sense of having a positive impact and changing people’s lives for the better. However, how that happened in that specific context has never been integrated systematically in the design, implementation nor the learning. “Scaling is finally getting recognized as a science but also as an art, and it is great to work on both fronts with scientists and project managers,” says Woltering.

There is a global community of practice on scaling with donors, implementers and practitioners. Five years ago, there were ten members and now the agriculture working group has members of more than sixty different organizations (including USAID, IFAD, CGIAR, CRS). CIMMYT is not only leading this community, but also set up a CGIAR-wide task force and a CIMMYT internal task force on scaling.

The COVID-19 crisis has shown that we need sustainable change at scale, and short term and one-off solutions will not do. This has only accelerated a trend of funders and implementers shifting to a more systemic approach. “CIMMYT is at the forefront of this wave which makes it a very exciting time to be working on this,” said Woltering.

Scaling up research for development in CGIAR

An overview of the proposed ILRI scaling process. (Graphic: ILRI)
An overview of the proposed ILRI scaling process. (Graphic: ILRI)

“Agricultural research for development is increasingly being held accountable to demonstrate that research goes beyond successful pilots,” said Iain Wright, deputy director general of research and development at the International Livestock Research Institute (ILRI).

In a bid to scale impact of its research outputs, ILRI has recently undertaken a systematic review of the scaling tools and processes available to help guide and improve the organization’s efforts.

The Scaling Scan has been incorporated into a new scaling framework for ILRI projects and for the CGIAR Research Program on Livestock (Livestock CRP). The Scaling scan, developed in 2017 by the International Maize and Wheat Improvement Center (CIMMYT) in collaboration with PPPLab at SNV, is one of three tools that have been identified as most suitable for the ILRI and CGIAR operational contexts.

“ILRI’s scaling framework applies the Scaling Scan and the USAID Scaling Pathway methodology before diving deep using the RTB/Wageningen Scaling Readiness methodology,” explained CIMMYT Scaling Coordinator Maria Boa. “It’s exciting because it aligns some of the best available tools to scale impact with a systems view.”

Designed for use by anyone involved in pro-poor and sustainable development programs looking to scale impact, the CIMMYT Scaling scan is found to be user-friendly and quick to help project implementation teams understand and define their scaling ambitions and asses their scaling environment. Though it is often applied as part of annual project review meetings, the tool can in fact be used at any stage of a project’s lifecycle. This helps stakeholders understand the multiple dimensions of scaling and the significant role nontechnical factors play in a scaling mindset.

CIMMYT shared lessons on how the methodology can be applied in a workshop setting and the Livestock CRP team has already used these to organize two workshops around improving productivity and incomes in Uganda’s pig value chain. The workshops, held in November 2019 and February 2020, brought together value chain actors, CRP researchers and project staff to better understand the multiple dimensions of scaling, develop realistic scaling goals, and identify key bottlenecks and opportunities using the Scaling Scan.

Read more on ILRI’s website:
ILRI adopts new framework for scaling up livestock research for development

It’s time to change the system, not just the technology

Society faces enormous challenges in the transition to sustainable rural development. We are unlikely to make this transition unless we move away from the 20th-century paradigm that sees the world as a logical, linear system focused on “scaling up” the use of technologies to reach hundreds of millions of smallholders.

In a new article published this week on NextBillion, Lennart Woltering of CIMMYT contends that “farming communities are unlikely to continue using a new practice or technology if the surrounding system remains unchanged, since it is this very system that shaped their conventional way of farming.”

Woltering calls on the research for development community to work towards producing deeper system change and offers some key considerations for moving in the right direction.


Read the full article:
‘Pilots Never Fail, Pilots Never Scale’: Why the Global Development Community Needs a More Realistic Approach to Reaching Billions

Download the infographic:
Sustainable systems change at scale: Not “scaling up” but getting “down to earth”

Scaling Scan: A simple tool for big impact

Eleven years ago this week, Apple Inc. released the iPhone. While it was not the first smartphone on the market, industry experts often credit the iPhone’s groundbreaking design with the launch of the mobile revolution. The device, its competitors and the apps that emerged with them have changed how over two billion people interact with the world on a daily basis.

The success of this revolution, however, goes far beyond the actual technology. At the International Maize and Wheat Improvement Center (CIMMYT) outside Mexico City, scaling expert Lennart Woltering points to a smartphone lying on his desk.

“We have to remember that this phone is just hardware. It is useless if you don’t have a network connection or an outlet in your house with electricity,” he says.

Woltering joined CIMMYT last year as part of the German Development Cooperation’s effort to aid the scaling-up of agricultural innovations. New, improved seeds, small-scale machinery and conservation practices can all play a role in achieving several of the Sustainable Development Goals, but Woltering says many other non-technological factors, such as markets and policies, can prevent these innovations from having significant impact.

Roadside vendor sells roasted maize cobs in Kenya. (Photo: P.Lowe/CIMMYT)
Roadside vendor sells roasted maize cobs in Kenya. (Photo: P.Lowe/CIMMYT)

“Many research institutes and nongovernmental organizations tend to focus on technology as the solution for everything,” he says. “But we find that 9 out of 10 cases, limiting factors have more to do with financing not being available to people, or poor policies that are hampering the adoption of technology.”

For example, CIMMYT has many initiatives in South Asia to promote conservation agriculture. Adopting no-till practices can help reduce erosion and improve soil health for better yields, but farmers who make this transition often need access to a different kind of machinery, such as the Happy Seeder, to plant their seeds. If government subsidies exist for conventional rototillers but not for the Happy Seeder, it is difficult to persuade farmers to make that economic sacrifice.

“It is a completely different ballgame in the real world, and you have to be honest about whatever fake reality you created in your project,” says Woltering.

Projects are designed in a very controlled way. They have a fixed budget and a fixed end date, and they are often shielded from the social and economic complexities that can propel or hinder an innovation from scaling.

“So if a donor says, ‘We want two million people to be reached,’ well, how are you going to do that? That’s where the Scaling Scan can help,” says Woltering.

Extension agents in Mexico use the Scaling Scan. (Photo: L. Woltering/CIMMYT)
Extension agents in Mexico use the Scaling Scan. (Photo: L. Woltering/CIMMYT)

The Scaling Scan helps an individual analyze, reflect on, and sharpen one’s scaling ambition and approach through a series of questions and prompts. It focuses on ten scaling ‘ingredients’ that need to be considered (e.g. knowledge and skills, public sector governance, awareness and demand) to reach the desired outcome.

The Scaling Scan helps you figure out what exactly is required, what is possible, and what bottlenecks exist that you need to address in your strategy,” Woltering says.

Woltering collaborated with The PPPLab, a consortium of four Dutch institutes, to release the first version of the Scaling Scan last year. They tested it with project teams in the Netherlands, Mexico, India, Nepal and Kenya, and based on the feedback, they are now releasing a second version, which is available here.

In the trials with the first Scaling Scan, some teams realized the results they wanted to achieve were too ambitious given the circumstances. For other teams, it helped them clarify exactly what they wanted to achieve.

“Having a project objective is not enough to internalize the main goal,” says Woltering. “It also changes over time, especially if it’s a long-term project. The scaling scan can be good for an annual checkup.”

Woltering emphasizes that successful scaling requires multidisciplinary collaboration.

“If you only have a team of agronomists, you will not reach a scale of millions you want to achieve. If you only have a team of policy experts, you will not succeed,” he says. “There are professionals that can really help and add value to what we are doing.”

“It’s hard to get an agronomist and an economist in the same room together, but we’re not going to change the world if we don’t work together with others who have their specific specialty or expertise,” he says.

The Scaling Scan also includes a responsibility check through some very simple but strategic questions.

“Every system has its pros and cons – some people benefit, some do not. Some have power, some do not,” says Woltering. “So what does it mean if your innovation goes to scale? Maybe there’s a whole new power dimension.”

Successfully scaling something may have unintended consequences. There are always tradeoffs and resistance to change. Woltering says the responsibility check can help actors in the development sector to think through these questions and consider what the possible outcomes could be.

For more explanation on how and when to use the tool, we invite you to download the Scaling Scan (also available in Spanish) which contains detailed practical information. We recommend the Excel sheet (also available in Spanish) to have the average scores and results generated automatically. A condensed, two-page PDF is also available.

This work is supported by the German Development Cooperation (GIZ) and led by the International Maize and Wheat Improvement Center (CIMMYT).