TY - JOUR
T1 - IDEAcology
T2 - An interface to streamline and facilitate efficient, rigorous expert elicitation in ecology
AU - Courtney Jones, Stephanie K.
AU - Geange, Sonya R.
AU - Hanea, Anca
AU - Camac, James
AU - Hemming, Victoria
AU - Doobov, Ben
AU - Leigh, Andrea
AU - Nicotra, Adrienne B.
N1 - Publisher Copyright:
© 2023 The Authors. Methods in Ecology and Evolution published by John Wiley & Sons Ltd on behalf of British Ecological Society.
PY - 2023/8
Y1 - 2023/8
N2 - Here, we demonstrate how IDEAcology aids in preparing for and implementing a structured expert elicitation using the IDEA protocol, an iterative quantitative expert elicitation framework. Expert judgement is used to inform decision-making on environmental assessment and management when imminent decisions are required, and quantitative data are absent or uninformative. Structured elicitation protocols can help improve the final judgements derived from experts, but they can also be administratively heavy and time-consuming, requiring manual collation of experts' estimates and rationales, construction and dissemination of summary plots for discussion and collating final estimates post-discussion. These challenges highlight the need for a centralised portal that enables synchronous access by all contributors, real-time structured facilitation of discussion, whether in person or online, and streamlined data management. To meet this need, we developed the IDEAcology interface (www.ideacology.com) to support data collation, summary, interactions and ultimately the deployment of structured expert elicitation using the IDEA protocol. The IDEAcology interface is designed to be a central portal for scientists and practitioners to easily implement structured expert elicitation projects, while also facilitating data management by providing a reliable and efficient way for elicitation managers to design and run an elicitation, and for experts to input, visualise and cross-examine estimates. The key advantages that IDEAcology provides include an easy-to-use interface with synchronous access to a single platform, reducing logistic difficulties, facilitating transparent discussion, improving the accuracy of estimates, enabling fast and efficient reporting by providing analysis-ready data outputs and lastly, flexibility in the types of elicitation questions that can be accommodated in the interface.
AB - Here, we demonstrate how IDEAcology aids in preparing for and implementing a structured expert elicitation using the IDEA protocol, an iterative quantitative expert elicitation framework. Expert judgement is used to inform decision-making on environmental assessment and management when imminent decisions are required, and quantitative data are absent or uninformative. Structured elicitation protocols can help improve the final judgements derived from experts, but they can also be administratively heavy and time-consuming, requiring manual collation of experts' estimates and rationales, construction and dissemination of summary plots for discussion and collating final estimates post-discussion. These challenges highlight the need for a centralised portal that enables synchronous access by all contributors, real-time structured facilitation of discussion, whether in person or online, and streamlined data management. To meet this need, we developed the IDEAcology interface (www.ideacology.com) to support data collation, summary, interactions and ultimately the deployment of structured expert elicitation using the IDEA protocol. The IDEAcology interface is designed to be a central portal for scientists and practitioners to easily implement structured expert elicitation projects, while also facilitating data management by providing a reliable and efficient way for elicitation managers to design and run an elicitation, and for experts to input, visualise and cross-examine estimates. The key advantages that IDEAcology provides include an easy-to-use interface with synchronous access to a single platform, reducing logistic difficulties, facilitating transparent discussion, improving the accuracy of estimates, enabling fast and efficient reporting by providing analysis-ready data outputs and lastly, flexibility in the types of elicitation questions that can be accommodated in the interface.
KW - IDEA protocol
KW - expert judgement
KW - interface
KW - platform
KW - quantitative estimates
KW - structured expert elicitation
UR - http://www.scopus.com/inward/record.url?scp=85163068655&partnerID=8YFLogxK
U2 - 10.1111/2041-210X.14017
DO - 10.1111/2041-210X.14017
M3 - Article
SN - 2041-210X
VL - 14
SP - 2019
EP - 2028
JO - Methods in Ecology and Evolution
JF - Methods in Ecology and Evolution
IS - 8
ER -