Abstract
Participatory approaches have gained recognition in scientific research, particularly in modeling human-environmental interactions and social-ecological systems (SES). Despite this achievement, a lack of in-depth understanding prevails to which degree, and at which scales and levels, participation takes place during the modeling cycle. Furthermore, information on the linkages between the level of the participating stakeholders and the modeling level of agents and environmental processes remains scarce. To shed light on this research gap, we conducted a systematic review including 79 relevant studies focusing on social-ecological systems within agricultural or forestry domains. Results reveal that participation was mostly carried out at lower spatial levels (local and regional) while stakeholders commonly originated from one spatial level, mainly the study area. Agent behavior was mainly simulated at a single spatial level. The number of studies modeling multi- and cross-scale levels or integrating participation was small. In rare cross-level modeling cases, local-level agents were predominately simulated as an aggregate at higher levels. We found that stakeholders most commonly participated in model parameterization and calibration, but rarely in model results communication. Participation was also relatively strong in model design, development and validation. This can be explained by the need of scientists for model input or to improve the transparency of the modeling process. To address these gaps in future studies, we recommend to model agents operating at their “real-world” level, while capturing interactions between agents across different scales, rather than (dis)aggregate agent behaviors to a single level. Furthermore, participation should go beyond fulfilling the mere scientific requirement of model development, and should be used to enhance the applicability and relevance of SES models.
References
Allain, S., Plumecocq, G., & Leenhardt, D. (2020). Linking deliberative evaluation with integrated assessment and modelling: A methodological framework and its application to agricultural water management. Futures, 120, 102566. https://doi.org/10.1016/j.futures.2020.102566
Andersson, L., Wilk, J., Graham, L. P., & Warburton, M. (2013). Design and test of a model-assisted participatory process for the formulation of a local climate adaptation plan. Climate and Development, 5(3), 217–228. https://doi.org/10.1080/17565529.2013.812955
Arnette, A., Zobel, C., Bosch, D., Pease, J., & Metcalfe, T. (2010). Stakeholder ranking of watershed goals with the vector analytic hierarchy process: Effects of participant grouping scenarios. Environmental Modelling & Software, 25(11), 1459–1469. https://doi.org/10.1016/j.envsoft.2009.10.009
Arnstein, S. R. (1969). A Ladder Of Citizen Participation. Journal of the American Institute of Planners, 35(4), 216–224. https://doi.org/10.1080/01944366908977225
Ayllón, D., Railsback, S. F., Gallagher, C., Augusiak, J., Baveco, H., Berger, U., Charles, S., Martin, R., Focks, A., Galic, N., Liu, C., van Loon, E. E., Nabe-Nielsen, J., Piou, C., Polhill, J. G., Preuss, T. G., Radchuk, V., Schmolke, A., Stadnicka-Michalak, J., . . . Grimm, V. (2021). Keeping modelling notebooks with TRACE: Good for you and good for environmental research and management support. Environmental Modelling & Software, 136, 104932. https://doi.org/10.1016/j.envsoft.2020.104932
Barnaud, C., Trebuil, G., Dumringrojwatthana, P., & Marie, J. (2008). Area study prior to companion modelling to integrate multiple interests in upper watershed management of Northern Thailand. Southeast Asian Studies, 45(4), 559–585. https://www.jstage.jst.go.jp/article/tak/45/4/45_kj00004868618/_article/-char/ja/
Basco-Carrera, L., Warren, A., van Beek, E., Jonoski, A., & Giardino, A. (2017). Collaborative modelling or participatory modelling? A framework for water resources management. Environmental Modelling & Software, 91, 95–110. https://doi.org/10.1016/j.envsoft.2017.01.014
Berkhoff, K. (2008). Spatially explicit groundwater vulnerability assessment to support the implementation of the Water Framework Directive – a practical approach with stakeholders. Hydrology and Earth System Sciences, 12(1), 111–122. https://doi.org/10.5194/hess-12-111-2008
Bhave, A. G., Mishra, A., & Raghuwanshi, N. S. (2014). Evaluation of hydrological effect of stakeholder prioritized climate change adaptation options based on multi-model regional climate projections. Climatic Change, 123(2), 225–239. https://doi.org/10.1007/s10584-014-1061-z
Bhave, A. G., Mittal, N., Mishra, A., & Raghuwanshi, N. S. (2016). Integrated Assessment of no-Regret Climate Change Adaptation Options for Reservoir Catchment and Command Areas. Water Resources Management, 30(3), 1001–1018. https://doi.org/10.1007/s11269-015-1207-4
Binder, C. R., Hinkel, J., Bots, P. W. G., & Pahl-Wostl, C. (2013). Comparison of Frameworks for Analyzing Social-ecological Systems. Ecology and Society, 18(4), 26. https://doi.org/10.5751/ES-05551-180426
Braasch, M., García-Barrios, L., Cortina-Villar, S., Huber-Sannwald, E., & Ramírez-Marcial, N. (2018). TRUE GRASP: Actors visualize and explore hidden limitations of an apparent win-win land management strategy in a MAB reserve. Environmental Modelling & Software, 105(4), 153–170. https://doi.org/10.1016/j.envsoft.2018.03.022
Bremer, L. L., Mandle, L., Trauernicht, C., Pascua, P., McMillen, H. L., Burnett, K., Wada, C. A., Kurashima, N., Quazi, S. A., Giambelluca, T., Chock, P., & Ticktin, T. (2018). Bringing multiple values to the table: assessing future land-use and climate change in North Kona, Hawaiʻi. Ecology and Society, 23(1), 33. https://doi.org/10.5751/ES-09936-230133
Carmona, G., Varela-Ortega, C., & Bromley, J. (2013). Participatory modelling to support decision making in water management under uncertainty: Two comparative case studies in the Guadiana river basin, Spain. Journal of Environmental Management, 128, 400–412. https://doi.org/10.1016/j.jenvman.2013.05.019
Cash, D. W., Adger, W. N., Berkes, F., Garden, P., Lebel, L., Olsson, P., Pritchard, L., & Young, O. (2006). Scale and Cross-Scale Dynamics: Governance and Information in a Multilevel World. Ecology and Society, 11(2), 8. http://www.ecologyandsociety.org/vol11/iss2/art8/
Castella, J. C., Boissau, S., Trung, T. N., & Quang, D. D. (2005). Agrarian transition and lowland–upland interactions in mountain areas in northern Vietnam: application of a multi-agent simulation model. Agricultural Systems, 86(3), 312–332. https://doi.org/10.1016/j.agsy.2004.11.001
Celio, E., Koellner, T., & Grêt-Regamey, A. (2014). Modeling land use decisions with Bayesian networks: Spatially explicit analysis of driving forces on land use change. Environmental Modelling & Software, 52, 222–233. https://doi.org/10.1016/j.envsoft.2013.10.014
Chan, T., Ross, H., Hoverman, S., & Powell, B. (2010). Participatory development of a Bayesian network model for catchment-based water resource management. Water Resources Research, 46(7), W07544. https://doi.org/10.1029/2009WR008848
Corrigan, & Nieuwenhuis (2019). Evaluating Goal Programming as a Backcasting Tool to Assess the Impact of Local Stakeholder Determined Policies on the Future Provision of Ecosystem Services in Forested Landscapes. Forests, 10(5), 386. https://doi.org/10.3390/f10050386
D'Aquino, P., Le Page, C., Bousquet, F., & Bah, A. (2003). Using Self-Designed Role-Playing Games and a Multi-Agent System to Empower a Local Decision-Making Process for Land Use Management: The SelfCormas Experiment in Senegal. Journal of Artificial Societies and Social Simulation, 6(3), 5. https://www.jasss.org/6/3/5.html
Delmotte, S., Barbier, J. M., Mouret, J. C., Le Page, C., Wery, J., Chauvelon, P., Sandoz, A., & Lopez Ridaura, S. (2016). Participatory integrated assessment of scenarios for organic farming at different scales in Camargue, France. Agricultural Systems, 143, 147–158. https://doi.org/10.1016/j.agsy.2015.12.009
Delmotte, S., Couderc, V., Mouret, J. C., Lopez-Ridaura, S., Barbier, J. M., & Hossard, L. (2017). From stakeholders narratives to modelling plausible future agricultural systems. Integrated assessment of scenarios for Camargue, Southern France. European Journal of Agronomy, 82, 292–307. https://doi.org/10.1016/j.eja.2016.09.009
Delzeit, R., Klepper, G., Zabel, F., & Mauser, W. (2018). Global economic–biophysical assessment of midterm scenarios for agricultural markets—biofuel policies, dietary patterns, cropland expansion, and productivity growth. Environmental Research Letters, 13(2), 25003. https://doi.org/10.1088/1748-9326/aa9da2
Dietz, J., Treydte, A. C., & Lippe, M. (2023). Exploring the future of Kafue National Park, Zambia: Scenario-based land use and land cover modelling to understand drivers and impacts of deforestation. Land Use Policy, 126, 106535. https://doi.org/10.1016/j.landusepol.2023.106535
Do, T. H., Vu, T. P., Catacutan, D., & van Nguyen, T. (2021). Governing Landscapes for Ecosystem Services: A Participatory Land-Use Scenario Development in the Northwest Montane Region of Vietnam. Environmental Management, 68(5), 665–682. https://doi.org/10.1007/s00267-020-01378-2
Dressler, G., Groeneveld, J., Hetzer, J., Janischewski, A., Nolzen, H., Rödig, E., Schwarz, N., Taubert, F., Thober, J., Will, M., Williams, T., Wirth, S. B., & Müller, B. (2022). Upscaling in socio-environmental systems modelling: Current challenges, promising strategies and insights from ecology. Socio-Environmental Systems Modelling, 4, 18112. https://doi.org/10.18174/sesmo.18112
Dupas, R., Parnaudeau, V., Reau, R., Jeuffroy, M. H., Durand, P., & Gascuel-Odoux, C. (2015). Integrating local knowledge and biophysical modeling to assess nitrate losses from cropping systems in drinking water protection areas. Environmental Modelling & Software, 69, 101–110. https://doi.org/10.1016/j.envsoft.2015.03.009
Dupont, H., Gourmelon, F., Rouan, M., Le Viol, I., & Kerbiriou, C. (2016). The contribution of agent-based simulations to conservation management on a Natura 2000 site. Journal of Environmental Management, 168, 27–35. https://doi.org/10.1016/j.jenvman.2015.11.056
Eitzinger, A., Binder, C. R., & Meyer, M. A. (2018). Risk perception and decision-making: Do farmers consider risks from climate change? Climatic Change, 151(3-4), 507–524. https://doi.org/10.1007/s10584-018-2320-1
Elsawah, S., Filatova, T., Jakeman, A. J., Kettner, A. J., Zellner, M. L., Athanasiadis, I. N., Hamilton, S. H., Axtell, R. L., Brown, D. G., Gilligan, J. M., Janssen, M. A., Robinson, D. T., Rozenberg, J., Ullah, I. I. T., & Lade, S. J. (2019). Eight grand challenges in socio-environmental systems modeling. Socio-Environmental Systems Modelling, 2, 16226. https://doi.org/10.18174/sesmo.2020a16226
Esse, C., Santander-Massa, R., Encina-Montoya, F., los Ríos, P. de, Fonseca, D., & Saavedra, P. (2019). Multicriteria spatial analysis applied to identifying ecosystem services in mixed-use river catchment areas in south central Chile. Forest Ecosystems, 6(1), 25. https://doi.org/10.1186/s40663-019-0183-1
FAO. (2020). Global Forest Resources Assessment 2020. https://doi.org/10.4060/ca9825en
Feinerer, I., Hornik, K., & Meyer, D. (2008). Text Mining Infrastructure in R. Journal of Statistical Software, 25(5). https://doi.org/10.18637/jss.v025.i05
Ferguson, L., Chan, S., Santelmann, M., & Tilt, B. (2017). Exploring participant motivations and expectations in a researcher-stakeholder engagement process: Willamette Water 2100. Landscape and Urban Planning, 157, 447–456. https://doi.org/10.1016/j.landurbplan.2016.08.014
Ferreira, R., Souza Cabral, L. de, Lins, R. D., Pereira e Silva, G., Freitas, F., Cavalcanti, G. D., Lima, R., Simske, S. J., & Favaro, L. (2013). Assessing sentence scoring techniques for extractive text summarization. Expert Systems with Applications, 40(14), 5755–5764. https://doi.org/10.1016/j.eswa.2013.04.023
Filatova, T., Verburg, P. H., Parker, D. C., & Stannard, C. A. (2013). Spatial agent-based models for socio-ecological systems: Challenges and prospects. Environmental Modelling & Software, 45(11), 1–7. https://doi.org/10.1016/j.envsoft.2013.03.017
Fischer, J., Gardner, T. A., Bennett, E. M., Balvanera, P., Biggs, R., Carpenter, S., Daw, T., Folke, C., Hill, R., Hughes, T. P., Luthe, T., Maass, M., Meacham, M., Norström, A. V., Peterson, G., Queiroz, C., Seppelt, R., Spierenburg, M., & Tenhunen, J. (2015). Advancing sustainability through mainstreaming a social–ecological systems perspective. Current Opinion in Environmental Sustainability, 14, 144–149. https://doi.org/10.1016/j.cosust.2015.06.002
Forni, L., Escobar, M., Cello, P., Marizza, M., Nadal, G., Girardin, L., Losano, F., Bucciarelli, L., Young, C., & Purkey, D. (2018). Navigating the Water-Energy Governance Landscape and Climate Change Adaptation Strategies in the Northern Patagonia Region of Argentina. Water, 10(6), 794. https://doi.org/10.3390/w10060794
Fouqueray, T., Latune, J., Trommetter, M., & Frascaria-Lacoste, N. (2022). Interdisciplinary modeling and participatory simulation of forest management to foster adaptation to climate change. Environmental Modelling & Software, 151, 105338. https://doi.org/10.1016/j.envsoft.2022.105338
Fraternali, P., Castelletti, A., Soncini-Sessa, R., Vaca Ruiz, C., & Rizzoli, A. E [A. E.] (2012). Putting humans in the loop: Social computing for Water Resources Management. Environmental Modelling & Software, 37, 68–77. https://doi.org/10.1016/j.envsoft.2012.03.002
Fulton, E. A., Boschetti, F., Sporcic, M., Jones, T., Little, L. R., Dambacher, J. M., Gray, R., Scott, R., & Gorton, R. (2015). A multi-model approach to engaging stakeholder and modellers in complex environmental problems. Environmental Science & Policy, 48, 44–56. https://doi.org/10.1016/j.envsci.2014.12.006
García-Álvarez, D., Lloyd, C. D., van Delden, H., & Camacho Olmedo, M. T. (2019). Thematic resolution influence in spatial analysis. An application to Land Use Cover Change (LUCC) modelling calibration. Computers, Environment and Urban Systems, 78, 101375. https://doi.org/10.1016/j.compenvurbsys.2019.101375
Garcia-Gonzalo, J., Palma, J., Freire, J., Tomé, M., Mateus, R., Rodriguez, L., Bushenkov, V., & Borges, J. G. (2013). A decision support system for a multi stakeholder’s decision process in a Portuguese National Forest. Forest Systems, 22(2), 359. https://doi.org/10.5424/fs/2013222-03793
Garedew, E., Sandewall, M., & Soderberg, U. (2012). A dynamic simulation model of land-use, population, and rural livelihoods in the Central Rift Valley of Ethiopia. Environmental Management, 49(1), 151–162. https://doi.org/10.1007/s00267-011-9783-4
Gaube, V., Kaiser, C., Wildenberg, M., Adensam, H., Fleissner, P., Kobler, J., Lutz, J., Schaumberger, A., Schaumberger, J., Smetschka, B., Wolf, A., Richter, A., & Haberl, H. (2009). Combining agent-based and stock-flow modelling approaches in a participative analysis of the integrated land system in Reichraming, Austria. Landscape Ecology, 24(9), 1149–1165. https://doi.org/10.1007/s10980-009-9356-6
Gaydos, D. A., Petrasova, A., Cobb, R. C., & Meentemeyer, R. K. (2019). Forecasting and control of emerging infectious forest disease through participatory modelling. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 374(1776), 20180283. https://doi.org/10.1098/rstb.2018.0283
Giordano, R., Passarella, G., Uricchio, V. F., & Vurro, M. (2007). Integrating conflict analysis and consensus reaching in a decision support system for water resource management. Journal of Environmental Management, 84(2), 213–228. https://doi.org/10.1016/j.jenvman.2006.05.006
Gonzalez-Redin, J., Luque, S., Poggio, L., Smith, R., & Gimona, A. (2016). Spatial Bayesian belief networks as a planning decision tool for mapping ecosystem services trade-offs on forested landscapes. Environmental Research, 144(Pt B), 15–26. https://doi.org/10.1016/j.envres.2015.11.009
González-Rosell, A., Blanco, M., & Arfa, I. (2020). Integrating Stakeholder Views and System Dynamics to Assess the Water–Energy–Food Nexus in Andalusia. Water, 12(11), 3172. https://doi.org/10.3390/w12113172
Gray, S., Jordan, R., Crall, A., Newman, G., Hmelo-Silver, C., Huang, J., Novak, W., Mellor, D., Frensley, T., Prysby, M., & Singer, A. (2017). Combining participatory modelling and citizen science to support volunteer conservation action. Biological Conservation, 208, 76–86. https://doi.org/10.1016/j.biocon.2016.07.037
Gray, S., Voinov, A., Paolisso, M., Jordan, R., BenDor, T., Bommel, P., Glynn, P., Hedelin, B., Hubacek, K., Introne, J., Kolagani, N., Laursen, B., Prell, C., Schmitt Olabisi, L., Singer, A., Sterling, E., & Zellner, M. (2018). Purpose, processes, partnerships, and products: Four Ps to advance participatory socio-environmental modeling. Ecological Applications, 28(1), 46–61. https://doi.org/10.1002/eap.1627
Gray, S. A., Gray, S [Stefan], Kok, J. L. de, Helfgott, A. E. R., O'Dwyer, B., Jordan, R., & Nyaki, A. (2015). Using fuzzy cognitive mapping as a participatory approach to analyze change, preferred states, and perceived resilience of social-ecological systems. Ecology and Society, 20(2). https://doi.org/10.5751/ES-07396-200211
Grimm, V., Railsback, S. F., Vincenot, C. E., Berger, U., Gallagher, C., DeAngelis, D. L., Edmonds, B., Ge, J., Giske, J., Groeneveld, J., Johnston, A. S., Milles, A., Nabe-Nielsen, J., Polhill, J. G., Radchuk, V., Rohwäder, M. S., Stillman, R. A., Thiele, J. C., & Ayllón, D. (2020). The ODD Protocol for Describing Agent-Based and Other Simulation Models: A Second Update to Improve Clarity, Replication, and Structural Realism. Journal of Artificial Societies and Social Simulation, 23(2), Article 7. https://doi.org/10.18564/jasss.4259
Haapasaari, P., Mäntyniemi, S., & Kuikka, S. (2012). Baltic Herring Fisheries Management: Stakeholder Views to Frame the Problem. Ecology and Society, 17(3). https://doi.org/10.5751/ES-04907-170336
Halbe, J., & Adamowski, J. (2019). Modeling sustainability visions: A case study of multi-scale food systems in Southwestern Ontario. Journal of Environmental Management, 231, 1028–1047. https://doi.org/10.1016/j.jenvman.2018.09.099
Henríquez-Dole, L., Usón, T. J., Vicuña, S., Henríquez, C., Gironás, J., & Meza, F. (2018). Integrating strategic land use planning in the construction of future land use scenarios and its performance: The Maipo River Basin, Chile. Land Use Policy, 78, 353–366. https://doi.org/10.1016/j.landusepol.2018.06.045
Hewitt, R., van Delden, H., & Escobar, F. (2014). Participatory land use modelling, pathways to an integrated approach. Environmental Modelling & Software, 52, 149–165. https://doi.org/10.1016/j.envsoft.2013.10.019
Holzhauer, S., Brown, C., & Rounsevell, M. (2019). Modelling dynamic effects of multi-scale institutions on land use change. Regional Environmental Change, 19(3), 733–746. https://doi.org/10.1007/s10113-018-1424-5
Huber, R., Bakker, M., Balmann, A., Berger, T., Bithell, M., Brown, C., Grêt-Regamey, A., Xiong, H., Le, Q. B., Mack, G., Meyfroidt, P., Millington, J., Müller, B., Polhill, J. G., Sun, Z., Seidl, R., Troost, C., & Finger, R. (2018). Representation of decision-making in European agricultural agent-based models. Agricultural Systems, 167, 143–160. https://doi.org/10.1016/j.agsy.2018.09.007
Inam, A., Adamowski, J., Prasher, S., Halbe, J., Malard, J., & Albano, R. (2017). Coupling of a distributed stakeholder-built system dynamics socio-economic model with SAHYSMOD for sustainable soil salinity management – Part 1: Model development. Journal of Hydrology, 551, 596–618. https://doi.org/10.1016/j.jhydrol.2017.03.039
Jong, K. de, Panja, D., Karssenberg, D., & van Kreveld, M. (2022). Scalability and composability of flow accumulation algorithms based on asynchronous many-tasks. Computers & Geosciences, 162, 105083. https://doi.org/10.1016/j.cageo.2022.105083
Jong, K. de, Panja, D., van Kreveld, M., & Karssenberg, D. (2021). An environmental modelling framework based on asynchronous many-tasks: Scalability and usability. Environmental Modelling & Software, 139, 104998. https://doi.org/10.1016/j.envsoft.2021.104998
Jordan, R., Gray, S., Zellner, M., Glynn, P. D., Voinov, A., Hedelin, B., Sterling, E. J., Leong, K., Olabisi, L. S., Hubacek, K., Bommel, P., BenDor, T. K., Jetter, A. J., Laursen, B., Singer, A., Giabbanelli, P. J., Kolagani, N., Carrera, L. B., Jenni, K., & Prell, C. (2018). Twelve Questions for the Participatory Modeling Community. Earth's Future, 6(8), 1046–1057. https://doi.org/10.1029/2018EF000841
Kassa, H., Campbell, B., Sandewall, M., Kebede, M., Tesfaye, Y., Dessie, G., Seifu, A., Tadesse, M., Garedew, E., & Sandewall, K. (2009). Building future scenarios and uncovering persisting challenges of participatory forest management in Chilimo Forest, Central Ethiopia. Journal of Environmental Management, 90(2), 1004–1013. https://doi.org/10.1016/j.jenvman.2008.03.009
Kelly, R. A., Jakeman, A. J., Barreteau, O., Borsuk, M. E., Elsawah, S., Hamilton, S. H., Henriksen, H. J., Kuikka, S., Maier, H. R., Rizzoli, A. E [Andrea Emilio], van Delden, H., & Voinov, A. A. (2013). Selecting among five common modelling approaches for integrated environmental assessment and management. Environmental Modelling & Software, 47, 159–181. https://doi.org/10.1016/j.envsoft.2013.05.005
Kleemann, J., Celio, E., Nyarko, B. K., Jimenez-Martinez, M., & Fürst, C. (2017). Assessing the risk of seasonal food insecurity with an expert-based Bayesian Belief Network approach in northern Ghana, West Africa. Ecological Complexity, 32, 53–73. https://doi.org/10.1016/j.ecocom.2017.09.002
Kok, K., & van Delden, H. (2009). Combining two approaches of integrated scenario development to combat desertification in the Guadalentín watershed, Spain. Environment and Planning B: Planning and Design, 36(1), 49–66. https://doi.org/10.1068/b32137
Koo, H., Kleemann, J., & Fürst, C. (2019). Impact assessment of land use changes using local knowledge for the provision of ecosystem services in northern Ghana, West Africa. Ecological Indicators, 103, 156–172. https://doi.org/10.1016/j.ecolind.2019.04.002
Koo, H., Kleemann, J., & Fürst, C. (2020). Integrating Ecosystem Services into Land-Use Modeling to Assess the Effects of Future Land-Use Strategies in Northern Ghana. Land, 9(10), 379. https://doi.org/10.3390/land9100379
Kopainsky, B., Huber, R., & Pedercini, M. (2015). Food Provision and Environmental Goals in the Swiss Agri-Food System: System Dynamics and the Social-ecological Systems Framework. Systems Research and Behavioral Science, 32(4), 414–432. https://doi.org/10.1002/sres.2334
Köstner, B., Wenkel, K. O., Berg, M., Bernhofer, C., Gömann, H., & Weigel, H. J. (2014). Integrating regional climatology, ecology, and agronomy for impact analysis and climate change adaptation of German agriculture: An introduction to the LandCaRe2020 project. European Journal of Agronomy, 52, 1–10. https://doi.org/10.1016/j.eja.2013.08.003
Kotir, J. H., Brown, G., Marshall, N., & Johnstone, R. (2017). Systemic feedback modelling for sustainable water resources management and agricultural development: An application of participatory modelling approach in the Volta River Basin. Environmental Modelling & Software, 88, 106–118. https://doi.org/10.1016/j.envsoft.2016.11.015
Kozicka, M., Jones, S. K., Gotor, E., & Enahoro, D. (2022). Cross-scale trade-off analysis for sustainable development: linking future demand for animal source foods and ecosystem services provision to the SDGs. Sustainability Science, 17(1), 209–220. https://doi.org/10.1007/s11625-021-01082-y
Lastra-Bravo, X. B., Hubbard, C., Garrod, G., & Tolón-Becerra, A. (2015). What drives farmers’ participation in EU agri-environmental schemes? Results from a qualitative meta-analysis. Environmental Science & Policy, 54, 1–9. https://doi.org/10.1016/j.envsci.2015.06.002
Lê, S., Josse, J., & Husson, F. (2008). FactoMineR: An R Package for Multivariate Analysis. Journal of Statistical Software, 25(1). https://doi.org/10.18637/jss.v025.i01
Lippe, M., Hilger, T., Sudchalee, S., Wechpibal, N., Jintrawet, A., & Cadisch, G. (2017). Simulating Stakeholder-Based Land-Use Change Scenarios and Their Implication on Above-Ground Carbon and Environmental Management in Northern Thailand. Land, 6(4), 85. https://doi.org/10.3390/land6040085
Lippe, M., Rummel, L., & Günter, S. (2022). Simulating land use and land cover change under contrasting levels of policy enforcement and its spatially-explicit impact on tropical forest landscapes in Ecuador. Land Use Policy, 119, 106207. https://doi.org/10.1016/j.landusepol.2022.106207
Lippe, M., Thai Minh, T., Neef, A., Hilger, T., Hoffmann, V., Lam, N. T., & Cadisch, G. (2011). Building on qualitative datasets and participatory processes to simulate land use change in a mountain watershed of Northwest Vietnam. Environmental Modelling & Software, 26(12), 1454–1466. https://doi.org/10.1016/j.envsoft.2011.07.009
Lusiana, B., van Noordwijk, M., Suyamto, D., Mulia, R., Joshi, L., & Cadisch, G. (2011). Users’ perspectives on validity of a simulation model for natural resource management. International Journal of Agricultural Sustainability, 9(2), 364–378. https://doi.org/10.1080/14735903.2011.582362
MacLeod, M., & Nagatsu, M. (2023). Participatory modeling in sustainability science: the road to value-neutrality. Philosophy of Science, 1–13. https://doi.org/10.1017/psa.2023.33
Maeda, E. E., Haapasaari, P., Helle, I., Lehikoinen, A., Voinov, A., & Kuikka, S. (2021). Black Boxes and the Role of Modeling in Environmental Policy Making. Frontiers in Environmental Science, 9, Article 629336. https://doi.org/10.3389/fenvs.2021.629336
Malawska, A., Topping, C. J., & Nielsen, H. Ø. (2014). Why do we need to integrate farmer decision making and wildlife models for policy evaluation? Land Use Policy, 38, 732–740. https://doi.org/10.1016/j.landusepol.2013.10.025
Mallampalli, V. R., Mavrommati, G., Thompson, J., Duveneck, M., Meyer, S., Ligmann-Zielinska, A., Druschke, C. G., Hychka, K., Kenney, M. A., Kok, K., & Borsuk, M. E. (2016). Methods for translating narrative scenarios into quantitative assessments of land use change. Environmental Modelling & Software, 82, 7–20. https://doi.org/10.1016/j.envsoft.2016.04.011
Mamitimin, Y., Feike, T., & Doluschitz, R. (2015). Bayesian Network Modeling to Improve Water Pricing Practices in Northwest China. Water, 7(10), 5617–5637. https://doi.org/10.3390/w7105617
Maness, T., & Farrell, R. (2004). A multi-objective scenario evaluation model for sustainable forest management using criteria and indicators. Canadian Journal of Forest Research, 34(10), 2004–2017. https://doi.org/10.1139/X04-075
Máñez Costa, M. (2011). A participatory framework for conservation payments. Land Use Policy, 28(2), 423–433. https://doi.org/10.1016/j.landusepol.2010.09.003
Marques, S., Bushenkov, V. A., Lotov, A. V., Marto, M., & Borges, J. G. (2020). Bi-Level Participatory Forest Management Planning Supported by Pareto Frontier Visualization. Forest Science, 66(4), 490–500. https://doi.org/10.1093/forsci/fxz014
Martínez-Falero, E., González-García, C., García-Abril, A., & Ayuga-Téllez, E. (2018). Validation of a Methodology for Confidence-Based Participatory Forest Management. Forests, 9(7), 399. https://doi.org/10.3390/f9070399
Mendoza, G. A., & Prabhu, R. (2006). Participatory modeling and analysis for sustainable forest management: Overview of soft system dynamics models and applications. Forest Policy and Economics, 9(2), 179–196. https://doi.org/10.1016/j.forpol.2005.06.006
Metcalf, S. S., Wheeler, E., BenDor, T. K., Lubinski, K. S., & Hannon, B. M. (2010). Sharing the floodplain: Mediated modeling for environmental management. Environmental Modelling & Software, 25(11), 1282–1290. https://doi.org/10.1016/j.envsoft.2008.11.009
Micha, E., Roberts, W., Ryan, M., O’Donoghue, C., & Daly, K. (2018). A participatory approach for comparing stakeholders’ evaluation of P loss mitigation options in a high ecological status river catchment. Environmental Science & Policy, 84, 41–51. https://doi.org/10.1016/j.envsci.2018.02.014
Mitter, H., Kirchner, M., Schmid, E., & Schönhart, M. (2014). The participation of agricultural stakeholders in assessing regional vulnerability of cropland to soil water erosion in Austria. Regional Environmental Change, 14(1), 385–400. https://doi.org/10.1007/s10113-013-0506-7
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ (Clinical Research Ed.), 339, b2535. https://doi.org/10.1136/bmj.b2535
Mongruel, R., Prou, J., Ballé-Béganton, J., Lample, M., Vanhoutte-Brunier, A., Réthoret, H., Pérez Agúndez, J. A., Vernier, F., Bordenave, P., & Bacher, C. (2011). Modeling Soft Institutional Change and the Improvement of Freshwater Governance in the Coastal Zone. Ecology and Society, 16(4): 15. https://doi.org/10.5751/ES-04294-160415
Moraine, M., Grimaldi, J., Murgue, C., Duru, M., & Therond, O. (2016). Co-design and assessment of cropping systems for developing crop-livestock integration at the territory level. Agricultural Systems, 147, 87–97. https://doi.org/10.1016/j.agsy.2016.06.002
Müller, B., Hoffmann, F., Heckelei, T., Müller, C., Hertel, T. W., Polhill, J. G., van Wijk, M., Achterbosch, T., Alexander, P., Brown, C., Kreuer, D., Ewert, F., Ge, J., Millington, J. D., Seppelt, R., Verburg, P. H., & Webber, H. (2020). Modelling food security: Bridging the gap between the micro and the macro scale. Global Environmental Change, 63, 102085. https://doi.org/10.1016/j.gloenvcha.2020.102085
Nidumolu, U. B., Lubbers, M., Kanellopoulos, A., van Ittersum, M. K., Kadiyala, D. M., & Sreenivas, G. (2016). Engaging farmers on climate risk through targeted integration of bio-economic modelling and seasonal climate forecasts. Agricultural Systems, 149, 175–184. https://doi.org/10.1016/j.agsy.2016.09.011
Nidumolu, U. B., Vankeulen, H., Lubbers, M., & Mapfumo, A. (2007). Combining interactive multiple goal linear programming with an inter-stakeholder communication matrix to generate land use options. Environmental Modelling & Software, 22(1), 73–83. https://doi.org/10.1016/j.envsoft.2005.11.004
Pereira, L. M., Davies, K. K., Belder, E., Ferrier, S., Karlsson‐Vinkhuyzen, S., Kim, H., Kuiper, J. J., Okayasu, S., Palomo, M. G., Pereira, H. M., Peterson, G., Sathyapalan, J., Schoolenberg, M., Alkemade, R., Carvalho Ribeiro, S., Greenaway, A., Hauck, J., King, N., Lazarova, T., Ravera, F., Chettri, N., Cheung, W.W.L., Hendriks, R.J.J., Kolomytsev, G., Leadley, P., Metzger, J.-P., Ninan, K.N., Pichs, R., Popp, A., Rondinini, C., Rosa, I., Vuuren, D., Lundquist, C. J. (2020). Developing multiscale and integrative nature–people scenarios using the Nature Futures Framework. People and Nature, 2(4), 1172–1195. https://doi.org/10.1002/pan3.10146
Pissonnier, S., Lavigne, C., & Le Gal, P. Y. (2017). A simulation tool to support the design of crop management strategies in fruit tree farms. Application to the reduction of pesticide use. Computers and Electronics in Agriculture, 142, 260–272. https://doi.org/10.1016/j.compag.2017.09.002
Pluchinotta, I., Pagano, A., Giordano, R., & Tsoukiàs, A. (2018). A system dynamics model for supporting decision-makers in irrigation water management. Journal of Environmental Management, 223, 815–824. https://doi.org/10.1016/j.jenvman.2018.06.083
Pope, A. J., & Gimblett, R. (2015). Linking Bayesian and agent-based models to simulate complex social-ecological systems in semi-arid regions. Frontiers in Environmental Science, 3, 55. https://doi.org/10.3389/fenvs.2015.00055
Portoghese, I., D'Agostino, D., Giordano, R., Scardigno, A., Apollonio, C., & Vurro, M. (2013). An integrated modelling tool to evaluate the acceptability of irrigation constraint measures for groundwater protection. Environmental Modelling & Software, 46, 90–103. https://doi.org/10.1016/j.envsoft.2013.03.001
R Development Core Team. (2024). A language and environment for statistical computing. https://www.r-project.org/
Reckling, M., Bergkvist, G., Watson, C. A., Stoddard, F. L., & Bachinger, J. (2020). Re-designing organic grain legume cropping systems using systems agronomy. European Journal of Agronomy, 112, 125951. https://doi.org/10.1016/j.eja.2019.125951
Reed, M. S., Vella, S., Challies, E., Vente, J. de, Frewer, L., Hohenwallner‐Ries, D., Huber, T., Neumann, R. K., Oughton, E. A., Del Sidoli Ceno, J., & van Delden, H. (2018). A theory of participation: what makes stakeholder and public engagement in environmental management work? Restoration Ecology, 26(S1). https://doi.org/10.1111/rec.12541
Reid, R. S [R. S.], Nkedianye, D., Said, M. Y., Kaelo, D., Neselle, M., Makui, O., Onetu, L., Kiruswa, S., Kamuaro, N. O., Kristjanson, P., Ogutu, J., BurnSilver, S. B., Goldman, M. J., Boone, R. B., Galvin, K. A., Dickson, N. M., & Clark, W. C. (2016). Evolution of models to support community and policy action with science: Balancing pastoral livelihoods and wildlife conservation in savannas of East Africa. Proceedings of the National Academy of Sciences of the United States of America, 113(17), 4579–4584. https://doi.org/10.1073/pnas.0900313106
Riddell, G. A., van Delden, H., Maier, H. R., & Zecchin, A. C. (2019). Exploratory scenario analysis for disaster risk reduction: Considering alternative pathways in disaster risk assessment. International Journal of Disaster Risk Reduction, 39, 101230. https://doi.org/10.1016/j.ijdrr.2019.101230
Roberts, M., Byg, A., Faccioli, M., Novo, P., & Kyle, C. (2021). Stakeholder perceptions of public good provision from agriculture and implications for governance mechanism design. Journal of Environmental Planning and Management, 64(2), 289–307. https://doi.org/10.1080/09640568.2020.1763274
Roetter, R. P., van den Berg, M., Laborte, A. G., Hengsdijk, H., Wolf, J., van Ittersum, M., van Keulen, H., Agustin, E. O., Thuc Son, T., Xuan Lai, N., & Guanghuo, W. (2007). Combining farm and regional level modelling for Integrated Resource Management in East and South-east Asia. Environmental Modelling & Software, 22(2), 149–157. https://doi.org/10.1016/j.envsoft.2005.07.015
Ronner, E., Descheemaeker, K., Marinus, W., Almekinders, C., Ebanyat, P., & Giller, K. E. (2018). How do climbing beans fit in farming systems of the eastern highlands of Uganda? Understanding opportunities and constraints at farm level. Agricultural Systems, 165, 97–110. https://doi.org/10.1016/j.agsy.2018.05.014
Salgado, M., & Gilbert, N. (2013). Agent Based Modelling. In T. Teo (Ed.), Handbook of Quantitative Methods for Educational Research (pp. 247–265). SensePublishers. https://doi.org/10.1007/978-94-6209-404-8_12
Salliou, N., Barnaud, C., Vialatte, A., & Monteil, C. (2017). A participatory Bayesian Belief Network approach to explore ambiguity among stakeholders about socio-ecological systems. Environmental Modelling & Software, 96, 199–209. https://doi.org/10.1016/j.envsoft.2017.06.050
Salliou, N., Vialatte, A., Monteil, C., & Barnaud, C. (2019). First use of participatory Bayesian modeling to study habitat management at multiple scales for biological pest control. Agronomy for Sustainable Development, 39(1), 7. https://doi.org/10.1007/s13593-018-0553-z
Sandker, M., Campbell, B. M., Nzooh, Z., Sunderland, T., Amougou, V., Defo, L., & Sayer, J. (2009). Exploring the effectiveness of integrated conservation and development interventions in a Central African forest landscape. Biodiversity and Conservation, 18(11), 2875–2892. https://doi.org/10.1007/s10531-009-9613-7
Schlüter, M., Müller, B., & Frank, K. (2019). The potential of models and modeling for social-ecological systems research: The reference frame ModSES. Ecology and Society, 24(1), 31. https://doi.org/10.5751/ES-10716-240131
Scholes, R. J., Reyers, B., Biggs, R., Spierenburg, M. J., & Duriappah, A. (2013). Multi-scale and cross-scale assessments of social–ecological systems and their ecosystem services. Current Opinion in Environmental Sustainability, 5(1), 16–25. https://doi.org/10.1016/j.cosust.2013.01.004
Schulze, J., Müller, B., Groeneveld, J., & Grimm, V. (2017). Agent-Based Modelling of Social-Ecological Systems: Achievements, Challenges, and a Way Forward. Journal of Artificial Societies and Social Simulation, 20(2), 8. https://doi.org/10.18564/jasss.3423
Seidl, R. (2015). A functional-dynamic reflection on participatory processes in modeling projects. Ambio, 44(8), 750–765. https://doi.org/10.1007/s13280-015-0670-8
Sheppard, S. R., & Meitner, M. (2005). Using multi-criteria analysis and visualisation for sustainable forest management planning with stakeholder groups. Forest Ecology and Management, 207(1-2), 171–187. https://doi.org/10.1016/j.foreco.2004.10.032
Sherrouse, B. C., & Semmens, D. J. (2014). Validating a method for transferring social values of ecosystem services between public lands in the Rocky Mountain region. Ecosystem Services, 8, 166–177. https://doi.org/10.1016/j.ecoser.2014.03.008
Smetschka, B., & Gaube, V. (2020). Co-creating formalized models: Participatory modelling as method and process in transdisciplinary research and its impact potentials. Environmental Science & Policy, 103, 41–49. https://doi.org/10.1016/j.envsci.2019.10.005
Solana-Gutiérrez, J., Rincón, G., Alonso, C., & García-de-Jalón, D. (2017). Using fuzzy cognitive maps for predicting river management responses: A case study of the Esla River basin, Spain. Ecological Modelling, 360, 260–269. https://doi.org/10.1016/j.ecolmodel.2017.07.010
Steger, C., Hirsch, S., Cosgrove, C., Inman, S., Nost, E., Shinbrot, X., Thorn, J. P., Brown, D. G., Grêt-Regamey, A., Müller, B., Reid, R. S [Robin S.], Tucker, C., Weibel, B., & Klein, J. A. (2021). Linking model design and application for transdisciplinary approaches in social-ecological systems. Global Environmental Change, 66, 102201. https://doi.org/10.1016/j.gloenvcha.2020.102201
Sterling, E. J., Betley, E., Sigouin, A., Gomez, A., Toomey, A., Cullman, G., Malone, C., Pekor, A., Arengo, F., Blair, M., Filardi, C., Landrigan, K., & Porzecanski, A. L. (2017). Assessing the evidence for stakeholder engagement in biodiversity conservation. Biological Conservation, 209, 159–171. https://doi.org/10.1016/j.biocon.2017.02.008
Sterling, E. J., Zellner, M., Jenni, K. E., Leong, K., Glynn, P. D., BenDor, T. K., Bommel, P., Hubacek, K., Jetter, A. J., Jordan, R., Olabisi, L. S., Paolisso, M., & Gray, S. (2019). Try, try again: Lessons learned from success and failure in participatory modeling. Elementa: Science of the Anthropocene, 7, Article 9. https://doi.org/10.1525/elementa.347
Stigter, T. Y., Varanda, M., Bento, S., Nunes, J. P., & Hugman, R. (2017). Combined Assessment of Climate Change and Socio-Economic Development as Drivers of Freshwater Availability in the South of Portugal. Water Resources Management, 31(2), 609–628. https://doi.org/10.1007/s11269-015-0994-y
Thompson, J. R., Plisinski, J. S., Lambert, K. F., Duveneck, M. J., Morreale, L., McBride, M., MacLean, M. G., Weiss, M., & Lee, L. (2020). Spatial Simulation of Codesigned Land Cover Change Scenarios in New England: Alternative Futures and Their Consequences for Conservation Priorities. Earth's Future, 8(7), e2019EF001348. https://doi.org/10.1029/2019EF001348
Thorn, J. P. R., Klein, J. A., Steger, C., Hopping, K. A., Capitani, C., Tucker, C. M., Nolin, A. W., Reid, R. S [Robin S.], Seidl, R., Chitale, V. S., & Marchant, R. (2020). A systematic review of participatory scenario planning to envision mountain social-ecological systems futures. Ecology and Society, 25(3), 6. https://doi.org/10.5751/ES-11608-250306
Tidwell, V. C., Passell, H. D., Conrad, S. H., & Thomas, R. P. (2004). System dynamics modeling for community-based water planning: Application to the Middle Rio Grande. Aquatic Sciences, 66(4), 357–372. https://doi.org/10.1007/s00027-004-0722-9
Troost, C., Huber, R., Bell, A. R., van Delden, H., Filatova, T., Le, Q. B., Lippe, M., Niamir, L., Polhill, J. G., Sun, Z., & Berger, T. (2023). How to keep it adequate: A protocol for ensuring validity in agent-based simulation. Environmental Modelling & Software, 159, 105559. https://doi.org/10.1016/j.envsoft.2022.105559
Uthes, S., Piorr, A., Zander, P., Bieńkowski, J., Ungaro, F., Dalgaard, T., Stolze, M., Moschitz, H., Schader, C., Happe, K., Sahrbacher, A., Damgaard, M., Toussaint, V., Sattler, C., Reinhardt, F. J., Kjeldsen, C., Casini, L., & Müller, K. (2011). Regional impacts of abolishing direct payments: An integrated analysis in four European regions. Agricultural Systems, 104(2), 110–121. https://doi.org/10.1016/j.agsy.2010.07.003
van Dam, A. A., Kipkemboi, J., Rahman, M. M., & Gettel, G. M. (2013). Linking Hydrology, Ecosystem Function, and Livelihood Outcomes in African Papyrus Wetlands Using a Bayesian Network Model. Wetlands, 33(3), 381–397. https://doi.org/10.1007/s13157-013-0395-z
van Delden, H., & Hagen-Zanker, A. (2009). New Ways of Supporting Decision Making: Linking Qualitative Storylines with Quantitative Modelling. In D. Z. Sui, W. Tietze, P. Claval, Y. Gradus, S. O. Park, H. van der Wusten, S. Geertman, & J. Stillwell (Eds.), The GeoJournal Library. Planning Support Systems Best Practice and New Methods (Vol. 95, pp. 347–367). Springer Netherlands. https://doi.org/10.1007/978-1-4020-8952-7_17
van Delden, H., Seppelt, R., White, R., & Jakeman, A. J. (2011). A methodology for the design and development of integrated models for policy support. Environmental Modelling & Software, 26(3), 266–279. https://doi.org/10.1016/j.envsoft.2010.03.021
van Delden, H., van Vliet, J., Rutledge, D. T., & Kirkby, M. J. (2011). Comparison of scale and scaling issues in integrated land-use models for policy support. Agriculture, Ecosystems & Environment, 142(1-2), 18–28. https://doi.org/10.1016/j.agee.2011.03.005
Vayssières, J., Vigne, M., Alary, V., & Lecomte, P. (2011). Integrated participatory modelling of actual farms to support policy making on sustainable intensification. Agricultural Systems, 104(2), 146–161. https://doi.org/10.1016/j.agsy.2010.05.008
Vervoort, J. M., Rutting, L., Kok, K., Hermans, F. L., Veldkamp, T., Bregt, A. K., & van Lammeren, R. (2012). Exploring Dimensions, Scales, and Cross-scale Dynamics from the Perspectives of Change Agents in Social-ecological Systems. Ecology and Society, 17(4). https://doi.org/10.5751/ES-05098-170424
Voinov, A., & Bousquet, F. (2010). Modelling with stakeholders☆. Environmental Modelling & Software, 25(11), 1268–1281. https://doi.org/10.1016/j.envsoft.2010.03.007
Voinov, A., Jenni, K., Gray, S., Kolagani, N., Glynn, P. D., Bommel, P., Prell, C., Zellner, M., Paolisso, M., Jordan, R., Sterling, E., Schmitt Olabisi, L., Giabbanelli, P. J., Sun, Z., Le Page, C., Elsawah, S., BenDor, T. K., Hubacek, K., Laursen, B. K., Jetter, A., Basco-Carrera, L., Singer, A., Young, L., Brunacini, J., Smajgl, A. (2018). Tools and methods in participatory modeling: Selecting the right tool for the job. Environmental Modelling & Software, 109, 232–255. https://doi.org/10.1016/j.envsoft.2018.08.028
Voinov, A., Kolagani, N., McCall, M. K., Glynn, P. D., Kragt, M. E., Ostermann, F. O., Pierce, S. A., & Ramu, P. (2016). Modelling with stakeholders – Next generation. Environmental Modelling & Software, 77, 196–220. https://doi.org/10.1016/j.envsoft.2015.11.016
Vukomanovic, J., Skrip, M., & Meentemeyer, R. (2019). Making It Spatial Makes It Personal: Engaging Stakeholders with Geospatial Participatory Modeling. Land, 8(2), 38. https://doi.org/10.3390/land8020038
Walz, A., Lardelli, C., Behrendt, H., Grêt-Regamey, A., Lundström, C., Kytzia, S., & Bebi, P. (2007). Participatory scenario analysis for integrated regional modelling. Landscape and Urban Planning, 81(1-2), 114–131. https://doi.org/10.1016/j.landurbplan.2006.11.001
Wyrwoll, P. R., Grafton, R. Q., Daniell, K. A., Chu, H. L., Ringler, C., Le Lien, T. H., Khoi, D. K., Do, T. N., & Tuan, N. D. A. (2018). Decision-Making for Systemic Water Risks: Insights From a Participatory Risk Assessment Process in Vietnam. Earth's Future, 6(3), 543–564. https://doi.org/10.1002/2017EF000777
Zagaria, C., Schulp, C. J., Kizos, T., Gounaridis, D., & Verburg, P. H. (2017). Cultural landscapes and behavioral transformations: An agent-based model for the simulation and discussion of alternative landscape futures in East Lesvos, Greece. Land Use Policy, 65, 26–44. https://doi.org/10.1016/j.landusepol.2017.03.022
Zorrilla-Miras, P., Mahamane, M., Metzger, M. J., Baumert, S., Vollmer, F., Luz, A. C., Woollen, E., Sitoe, A. A., Patenaude, G., Nhantumbo, I., Ryan, C. M., Paterson, J., Matediane, M. J., Ribeiro, N. S., & Grundy, I. M. (2018). Environmental Conservation and Social Benefits of Charcoal Production in Mozambique. Ecological Economics, 144, 100–111. https://doi.org/10.1016/j.ecolecon.2017.07.028
Zupko, R., & Rouleau, M. (2019). ForestSim: Spatially explicit agent-based modeling of non-industrial forest owner policies. SoftwareX, 9(1), 117–125. https://doi.org/10.1016/j.softx.2019.01.008
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Copyright (c) 2025 Markus Meyer, Yue Dou, Hedwig van Delden, Thanh Thi Thi Nguygen, Melvin Lippe