Decision support based on performance data using the analytic hierarchy process without expert judgement
DOI:
https://doi.org/10.14488/BJOPM.1882.2024Keywords:
AHP, Technical Performance, Decision without Experts, Defense ProcurementAbstract
Goal: This article proposes a decision model based on the Analytic Hierarchy Process that allows carrying out the evaluation of alternatives in a multicriteria problem, without expert judgement.
Design / Methodology / Approach: The algorithm is based on AHP. The novelty is the transformation of a performance data matrix into pairwise evaluation matrices, instead of using experts’ judgement.
Results: The algorithm was applied in a defense procurement problem for the choice of a light 4x4 vehicle for amphibious operations. The results allowed ranking the 17 models based on catalog data.
Limitations of the investigation: the algorithm depends on the availability of catalog data, not always available in open sources in the defense industry.
Practical implications: Decision support involves several activities in Operations Management and AHP has been frequently applied to solve problems in this sector. The proposed algorithm allows performing deterministic or probabilistic evaluations, depending on the degree of uncertainty and precision involving the systems’ performance data. These assessments are composed of scenarios to facilitate decision making.
Originality / Value: AHP typically uses experts for pairwise judgments. However, human judgment is subject to outcomes that involve bias and cognitive distortions. Few studies have modeled the AHP without experts, even so they used human judgment in some part of the process. The approach proposed here does not require human judgment and returns two different results, based on the database precision. This new approach gives decision makers a different perspective and can alter the final choice.
Downloads
References
Abastante, F., Corrente, S., Greco, S., Ishizaka, A. and Lami, I.M. (2019), "A new parsimonious AHP methodology: assigning priorities to many objects by comparing pairwise few reference objects", Expert Systems with Applications, Vol. 127, pp. 109–120.
Abatecola, G., Caputo, A. and Cristofaro, M. (2018), "Reviewing cognitive distortions in managerial decision making: toward an integrative co-evolutionary framework", Journal of Management Development, Emerald Publishing Limited, Vol. 37, No. 5, pp. 409–424, doi: https://doi.org/10.1108/JMD-08-2017-0263.
Agápito, A. de O., Vianna, D.S., Candido, L.A., Meza, E.B.M. and Vianna, M. de F.D. (2015), "Utilização do método de análise hierárquica (ahp) como ferramenta de auxílio multicritério no processo de decisão de priorização de projetos de ciência, tecnologia e inovação na Amazônia azul", XVIII Simpósio de Pesquisa Operacional e Logística Da Marinha, Marinha do Brasil, Rio de Janeiro-RJ, pp. 1–10.
Ali, Y., Asghar, A., Muhammad, N. and Salman, A. (2017), "Selection of a fighter aircraft to improve the effectiveness of air combat in the war on terror: Pakistan Air Force-a case in point", International Journal of the Analytic Hierarchy Process, Vol. 9, No. 2, pp. 244–273.
Almeida, A.T. de. (2013), Processo de Decisão Nas Organizações: Construindo Modelos de Decisão Multicritério, 1st ed., Editora Atlas S.A., São Paulo.
Alrasheedi, K.G., Dewan, A. and El-Mowafy, A. (2023), "Using Local Knowledge and Remote Sensing in the Identification of Informal Settlements in Riyadh City, Saudi Arabia", Remote Sensing, MDPI, Vol. 15, No. 15, p. 3895.
Assis, S.R. de, Gavião, L.O., Kostin, S. and Lima, G.B.A. (2022), "Prioritizing flight simulators of the Brazilian Air Force by the analytic hierarchy process and hypothesis tests", Brazilian Journal of Operations & Production Management, Vol. 19, No. 4, pp. 1–19.
Balusa, B.C. and Gorai, A.K. (2019), "Sensitivity analysis of fuzzy-analytic hierarchical process (FAHP) decision-making model in selection of underground metal mining method", Journal of Sustainable Mining, Elsevier, Vol. 18, No. 1, pp. 8–17.
Barroso, D. (2022), "Método AHP (Analytic Hierarchy Process-Gaussiano) na determinação de aquisição de um aparelho celular", Revista Eletrônica Ciência & Tecnologia Futura, Vol. 1, No. 1.
Bimo, E.A., Prabawa, E., Sembiring, E.K., Ramsi, O., Sjamsoeddin, S., Yusgiantoro, P. and Midhio, I.W. (2022), "The Application of AHP and PESTEL-SWOT analysis on the study of military amphibious aircraft acquisition decision making in Indonesia", Technium Social Sciences Journal, Vol. 27, pp. 837–853.
Brazil. (2009), C 20-1 - Glossário de Termos e Expressões Para Uso No Exército, 4th ed., Exército Brasileiro, Brasília, DF.
Brazil. (2015), MD35-G-01 - Glossário Das Forças Armadas, 5th ed., Ministério da Defesa - Estado-Conjunto das Forças Armadas, Brasília-DF.
Breen, L., Hannibal, C., Huatuco, L.H., Dehe, B. and Xie, Y. (2020), "Service improvement in public sector operations–A European comparative analysis", European Management Journal, Elsevier, Vol. 38, No. 3, p. 489.
Bulut, E., Duru, O., Keçeci, T. and Yoshida, S. (2012), "Use of consistency index, expert prioritization and direct numerical inputs for generic fuzzy-AHP modeling: A process model for shipping asset management", Expert Systems with Applications, Elsevier, Vol. 39, No. 2, pp. 1911–1923.
Camilo, J.A.P., Gavião, L.O. and Kostin, S. (2020), "Priorização de projetos do segmento espacial por processo de análise hierárquica", Revista Brasileira de Estudos de Defesa, Vol. 7, No. 1.
Carnell, R. (2022), "Package ‘triangle’: Distribution Functions and Parameter Estimates for the Triangle Distribution", R Core Team, Columbus.
Chang, D.-Y. (1996), "Applications of the extent analysis method on fuzzy AHP", European Journal of Operational Research, Elsevier, Vol. 95, No. 3, pp. 649–655.
Chawla, V.K., Chhabra, D., Gupta, P. and Naaz, S. (2021), "Evaluation of green operations management by fuzzy analytical hierarchy process", Materials Today: Proceedings, Elsevier, Vol. 38, pp. 274–279.
Clowney, P., Dever, J. and Stuban, S. (2016), "Department of Defense Acquisition Program TERMINATIONS: Analysis of 11 Program Management Factors.", Defense Acquisition Research Journal: A Publication of the Defense Acquisition University, Vol. 23, No. 3.
Connors, S.C., Rovery, M. and Hawkes, J. (2019), IHS Jane’s Land Warfare Platforms: Artillery & Air Defence, IHS Jane’s, IHS Global Limited.
Dehghan-Manshadi, B., Mahmudi, H., Abedian, A. and Mahmudi, R. (2007), "A novel method for materials selection in mechanical design: combination of non-linear normalization and a modified digital logic method", Materials & Design, Elsevier, Vol. 28, No. 1, pp. 8–15.
Evans, G.W., Biles, W.E. and Bae, K.-H.G. (2019), Analytics, Operations, and Strategic Decision Making in the Public Sector, IGI Global.
Franck, R. and Udis, B. (2017), "Quarrelsome committees in US defense acquisition: the KC-X case", Defence and Peace Economics, Taylor & Francis, Vol. 28, No. 3, pp. 344–366.
Gavião, L.O. (2023), "Performance-based AHP. Version 3.0", Zenodo.org, Niteroi.
Gavião, L.O., Meza, L.A., Lima, G.B.A., Sant’Anna, A.P. and Soares de Mello, J.C.C.B. (2017), "Improving discrimination in efficiency analysis of bioethanol processes", Journal of Cleaner Production, Vol. 168, pp. 1525–1532, doi: 10.1016/j.jclepro.2017.06.020.
Gavião, L.O., Sant’Anna, A.P., Garcia, P.A. de A., Silva, L.C., Kostin, S. and Lima, G.B.A. (2021), "Multi-criteria decision support to criminology by Graph Theory and Composition of Probabilistic Preferences", Pesquisa Operacional, SciELO Brasil, Vol. 41, pp. 1–44.
Gavião, L.O., Sant’Anna, A.P., Lima, G.B.A., de Almada Garcia, P.A., Kostin, S. and Asrilhant, B. (2020), "Selecting a cargo aircraft for humanitarian and disaster relief operations by multicriteria decision aid methods", IEEE Transactions on Engineering Management, IEEE, Vol. 67, No. 3, pp. 631–640.
Gholz, E. and Sapolsky, H.M. (2021), "The many lines of defense: The political economy of US defense acquisition", Journal of Global Security Studies, Oxford University Press, Vol. 6, No. 1, pp. 1–10.
Hamurcu, M. and Eren, T. (2020), "Selection of Unmanned Aerial Vehicles by Using Multicriteria Decision-Making for Defence", Journal of Mathematics, Hindawi, Vol. 2020.
Hilbert, M. (2012), “Toward a synthesis of cognitive biases: how noisy information processing can bias human decision making.”, Psychological Bulletin, American Psychological Association, Vol. 138 No. 2, p. 211.
Ho, W. and Ma, X. (2018), “The state-of-the-art integrations and applications of the analytic hierarchy process”, European Journal of Operational Research, Elsevier, Vol. 267 No. 2, pp. 399–414.
Kadish, R.T., Abbott, G., Cappuccio, F., Hawley, R., Kern, P. and Kozlowski, D. (2006), Defense Acquisition Performance Assessment Report, Office of the Deputy Secretary of Defense, Washington, DC.
Kim, J.-H. and Lee, H.-J. (2019), “A study on selection of R&D supervision institution of weapon systems using Delphi and AHP”, Journal of the Korea Academia-Industrial Cooperation Society, The Korea Academia-Industrial cooperation Society, Vol. 20 No. 10, pp. 179–186.
Kozłowska, J., Benvenga, M.A. and Nääs, I. de A. (2023), “Investment Risk and Energy Security Assessment of European Union Countries Using Multicriteria Analysis”, Energies, MDPI, Vol. 16 No. 330, pp. 1–28.
Kvålseth, T.O. (2017), “Coefficient of variation: the second-order alternative”, Journal of Applied Statistics, Taylor & Francis, Vol. 44 No. 3, pp. 402–415.
Liu, C.H. and Lin, C.-W.R. (2016), “The Comparative of the AHP Topsis Analysis Was Applied for the Commercialization Military Aircraft Logistic Maintenance Establishment”, International Business Management, Vol. 10 No. 4, pp. 6428–6432.
Lovallo, D.P. and Sibony, O. (2006), “Distortions and deceptions in strategic decisions”, McKinsey Quarterly, MCKINSEY & CO INC, Vol. 1, p. 18.
Maser, S.M. and Thompson, F. (2011), Mitigating Spirals of Conflict in DOD Source Selections, Defense Acquisition University, Fort Belvoir.
Millard, S.P. (2013), EnvStats: An R Package for Environmental Statistics, 2nd ed., Springer, Seattle.
Pereira, R.C.A., da Silva Jr, O.S., de Mello Bandeira, R.A., Dos Santos, M., de Souza Rocha Jr, C., Castillo, C.D.S., Gomes, C.F.S., et al. (2023), “Evaluation of smart sensors for subway electric motor escalators through AHP-Gaussian method”, Sensors, MDPI, Vol. 23 No. 8, pp. 1–24.
Pomerol, J.-C. and Barba-Romero, S. (2012), Multicriterion Decision in Management: Principles and Practice, Springer, New York.
Radnor, Z.J. and Barnes, D. (2007), “Historical analysis of performance measurement and management in operations management”, International Journal of Productivity and Performance Management, Emerald Group Publishing Limited, Vol. 56 No. 5/6, pp. 384–396.
Saaty, T.L. (1980), “The Analytic Hierarchy Process-Planning, Priority Setting, Resource Allocation”, McGraw-Hill, Basel.
Salgado, F.A.S. (2021), Proposta de Modelo Para Seleção de Navios de Pesquisa Antártica Por Método AHP-TOPSIS e Planejamento Baseado Por Capacidades, Brazilian War College.
Sant’Anna, A.P. (2015), Probabilistic Composition of Preferences, Theory and Applications, 1st ed., Springer, New York.
Dos Santos, M., de Araújo Costa, I.P. and Gomes, C.F.S. (2021), “Multicriteria decision-making in the selection of warships: a new approach to the AHP method”, International Journal of the Analytic Hierarchy Process, Vol. 13 No. 1, pp. 147–169.
Schery, C.A.D., Vignon, Y.R., Caiado, R.G.G., Santos, R.S., Congro, M., Corseuil, E.T. and Roehl, D. (2023), “BIM critical factors and benefits for public sector: from a systematic review to an empirical fuzzy multicriteria approach”, Brazilian Journal of Operations & Production Management, Vol. 20 No. 3, p. 1837.
Shannon, C.E. (1949), “Communication theory of secrecy systems”, Bell System Technical Journal, Wiley Online Library, Vol. 28 No. 4, pp. 656–715.
Shen, Y., Chen, D., Zhang, M. and Zuo, T. (2022), “Fuzzy Comprehensive Safety Evaluation of Pipeline Disaster in China-Russia Crude Oil Permafrost Region Based on Improved Analytic Hierarchy Process-Entropy Weight Method”, Advances in Materials Science and Engineering, Hindawi, pp. 1–10.
Shi, D., Guo, Y., Gu, X., Feng, G., Xu, Y. and Sun, S. (2022), “Evaluation of the ventilation system in an LNG cargo tank construction platform (CTCP) by the AHP-entropy weight method”, Building Simulation, Springer, pp. 1–18.
Silva, A.C., Belderrain, M.C.N. and Pantoja, F.C.M. (2010), “Prioritization of R&D projects in the aerospace sector: AHP method with ratings”, Journal of Aerospace Technology and Management, SciELO Brasil, Vol. 2, pp. 339–348.
da Silva, L.M., Lopes, F.R.R., Abreu, C.G.S., Lima, G.B.A., Fortes, M.Z. and de Araujo, F.O. (2022), “Identification of critical success factors for implementing sustainable public lighting management in cities: literature-based applications”, Brazilian Journal of Operations & Production Management, Vol. 19 No. 4, p. 1562.
Simplício, R., Gomes, J. and Romão, M. (2017), “Projects selection and prioritization: a Portuguese Navy pilot model”, Procedia Computer Science, Elsevier, Vol. 121, pp. 72–79.
Soares, L. de M.B., dos Santos, R.N. and dos Santos, M. (2022), “AHP-Gaussian aligned with Value Focused Thinking for strategical decision making in Brazilian Airforce load plane purchasing”, XXIII International Symposium of Mathematical Methods Applied to Sciences.
Subramanian, N. and Ramanathan, R. (2012), “A review of applications of Analytic Hierarchy Process in operations management”, International Journal of Production Economics, Elsevier, Vol. 138 No. 2, pp. 215–241.
Szűts, A. and Krómer, I. (2015), “Developing a fuzzy analytic hierarchy process for choosing the energetically optimal solution at the early design phase of a building”, Acta Polytechnica Hungarica, Vol. 12 No. 3, pp. 25–39.
Vats, G. and Vaish, R. (2014), “Selection of optimal sintering temperature of K0. 5Na0. 5NbO3 ceramics for electromechanical applications”, Journal of Asian Ceramic Societies, Elsevier, Vol. 2 No. 1, pp. 5–10.
Wei, H. and Shi, J. (2022), “Contractor Selection for Defense Acquisition with Advanced Many-to-One Stable Matching Model”, 2022 41st Chinese Control Conference (CCC), IEEE, pp. 1872–1878.
Wu, J., Chen, X. and Lu, J. (2022), “Assessment of long and short-term flood risk using the multi-criteria analysis model with the AHP-Entropy method in Poyang Lake basin”, International Journal of Disaster Risk Reduction, Elsevier, Vol. 75, p. 102968.
Yue-ming, H., Dan, F., Hong-yan, Z. and Yuan, L. (2020), “Efficiency evaluation of intelligent swarm based on AHP entropy weight method”, Journal of Physics: Conference Series, Vol. 1693, IOP Publishing, p. 12072.
Yuna, Q.I. and Lei, W. (2021), “Application of AHP-entropy weight method in hazards susceptibility assessment in mountain town”, Bulletin of Surveying and Mapping, No. 6, p. 112.
Zeleny, M. (1982), Multi Criteria Decision Making, McGraw-Hill, New York.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 Luiz Octávio Gavião, Gilson Brito Alves Lima, Pauli Adriano de Almada Garcia, Leandro da Silva Teixeira
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors must have a written permission from any third-party materials used in the article, such as figures and graphics. The permission must explicitly allow authors to use the materials. The permission should be submitted with the article, as a supplementary file.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after BJO&PM publishes it (See The Effect of Open Access).
