Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios
The Delphi-based scenarios (DBS) development implies the assumption of different choices, through the gathering of information and the assessment of alternative resolutions (Panpatte and Takale, 2019). During the last decades, the spread of environmental hazards has increased quickly, much to reques...
সংরক্ষণ করুন:
| প্রধান লেখক: | , , |
|---|---|
| বিন্যাস: | Online |
| ভাষা: | ইংরেজি |
| প্রকাশিত: |
Firenze University Press, Genova University Press
2023
|
| বিষয়গুলি: | |
| অনলাইন ব্যবহার করুন: | ONIX_20230803_9791221501063_97 |
| ট্যাগগুলো: |
কোনো ট্যাগ নেই, প্রথমজন হিসাবে ট্যাগ করুন!
|
| _version_ | 1869528355095707648 |
|---|---|
| author | Calleo, Yuri Di Zio, Simone Pilla, Francesco |
| author_browse | Calleo, Yuri Di Zio, Simone Pilla, Francesco |
| author_facet | Calleo, Yuri Di Zio, Simone Pilla, Francesco |
| author_sort | Calleo, Yuri |
| collection | Directory of Open Access Books |
| description | The Delphi-based scenarios (DBS) development implies the assumption of different choices, through the gathering of information and the assessment of alternative resolutions (Panpatte and Takale, 2019). During the last decades, the spread of environmental hazards has increased quickly, much to request different responses in order to develop a sustainable future for humanity planning the present (McMichael and Lindgren, 2011). Since the DBS is a creative process (Nowack et al., 2011), different figures are selected to make choices, including academics, stakeholders and citizens. However, one of the main challenges remains the measurement of expertise, in fact, during the process, the experts should be assessed based on their competences in order to avoid any conflict in the final results and, eventually, weigh their answers. In recent years, some contributions adopted the self-assessments for the experts’ evaluation (Sossa et al., 2019), but many issues still remain (such as strong subjectivity and cognitive biases which produce over or underestimation). We develop a new method to estimate the expertise by using Natural Language Processing to acquire information, extracting the contributions of experts in each topic. First, starting from a draft list of selected experts, we identify the category of reference (e.g., academia, industry, local authority, citizens etc.). We build a data repository with the personal pages (URLs) of each expert to then use Python to extract from the URLs, the number of contributions related to a keyword, different for each category (e.g., publications for academics, reports and projects for stakeholders etc.). Finally, we proceed adopting a coefficient of production with a weighted sum of the results. To practically demonstrate our approach, we applied this method to a cohort of known experts, part of the “Smart control of the climate resilience” (SCORE) H2020 European project to estimate their expertise in specific areas. |
| format | Online |
| id | doab-20.500.12854ir-112090 |
| institution | Directory of Open Access Books |
| language | eng |
| publishDate | 2023 |
| publishDateRange | 2023 |
| publishDateSort | 2023 |
| publisher | Firenze University Press, Genova University Press |
| publisherStr | Firenze University Press, Genova University Press |
| record_format | ojs |
| spelling | doab-20.500.12854ir-1120902025-07-17T10:01:34Z Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios Calleo, Yuri Di Zio, Simone Pilla, Francesco future scenarios Delphi expertise assessment thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences The Delphi-based scenarios (DBS) development implies the assumption of different choices, through the gathering of information and the assessment of alternative resolutions (Panpatte and Takale, 2019). During the last decades, the spread of environmental hazards has increased quickly, much to request different responses in order to develop a sustainable future for humanity planning the present (McMichael and Lindgren, 2011). Since the DBS is a creative process (Nowack et al., 2011), different figures are selected to make choices, including academics, stakeholders and citizens. However, one of the main challenges remains the measurement of expertise, in fact, during the process, the experts should be assessed based on their competences in order to avoid any conflict in the final results and, eventually, weigh their answers. In recent years, some contributions adopted the self-assessments for the experts’ evaluation (Sossa et al., 2019), but many issues still remain (such as strong subjectivity and cognitive biases which produce over or underestimation). We develop a new method to estimate the expertise by using Natural Language Processing to acquire information, extracting the contributions of experts in each topic. First, starting from a draft list of selected experts, we identify the category of reference (e.g., academia, industry, local authority, citizens etc.). We build a data repository with the personal pages (URLs) of each expert to then use Python to extract from the URLs, the number of contributions related to a keyword, different for each category (e.g., publications for academics, reports and projects for stakeholders etc.). Finally, we proceed adopting a coefficient of production with a weighted sum of the results. To practically demonstrate our approach, we applied this method to a cohort of known experts, part of the “Smart control of the climate resilience” (SCORE) H2020 European project to estimate their expertise in specific areas. 2023-08-08T05:13:49Z 2023-08-08T05:13:49Z 2023-08-03T15:06:10Z 2023 chapter ONIX_20230803_9791221501063_97 2704-5846 https://library.oapen.org/handle/20.500.12657/74901 9791221501063 https://directory.doabooks.org/handle/20.500.12854/112090 eng Proceedings e report open access image/png image/jpeg Attribution 4.0 International Attribution 4.0 International https://library.oapen.org/bitstream/20.500.12657/74901/1/9791221501063-29.pdf https://library.oapen.org/bitstream/20.500.12657/74901/1/9791221501063-29.pdf Firenze University Press, Genova University Press 10.36253/979-12-215-0106-3.29 10.36253/979-12-215-0106-3.29 74113d79-2268-4658-88bb-6e8757c543b0 ASA 2022 Data-Driven Decision Making 9791221501063 6 Florence open access |
| spellingShingle | future scenarios Delphi expertise assessment thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences Calleo, Yuri Di Zio, Simone Pilla, Francesco Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios |
| title | Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios |
| title_full | Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios |
| title_fullStr | Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios |
| title_full_unstemmed | Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios |
| title_short | Chapter A Natural Language Processing approach to measure expertise in the Delphi-based scenarios |
| title_sort | chapter a natural language processing approach to measure expertise in the delphi based scenarios |
| topic | future scenarios Delphi expertise assessment thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences |
| topic_facet | future scenarios Delphi expertise assessment thema EDItEUR::J Society and Social Sciences thema EDItEUR::J Society and Social Sciences |
| url | ONIX_20230803_9791221501063_97 |
| work_keys_str_mv | AT calleoyuri chapteranaturallanguageprocessingapproachtomeasureexpertiseinthedelphibasedscenarios AT diziosimone chapteranaturallanguageprocessingapproachtomeasureexpertiseinthedelphibasedscenarios AT pillafrancesco chapteranaturallanguageprocessingapproachtomeasureexpertiseinthedelphibasedscenarios |