Decision making based on Item Response Theory b parameter in ensemble rankings

Authors

DOI:

https://doi.org/10.51359/2317-0115.2022.256869

Keywords:

decision-making, item response theory, ensemble, classification

Abstract

Decision-making based on the aid of computerized systems is a complex task and  the  target  of  many  adjustments  to  avoid  classification  errors.  Evaluating  the classifications by the hits of the algorithms and associating these hits with the Difficulty parameter (b) of the IRT in agreement with the Kappa statistics provides greater security to  the  user  of  computerized  systems.  In  this  evaluation  between  the  undersample  and oversample groups, it was possible to select specific groups of cluster algorithms basedon the 5% confidence interval and agreement intensity greater than 0.9968, identifying Perfect agreement (0.48%) in the SMOTE groups.

Author Biographies

Paulo Fernando Leite Filho, Centro de Informática - UFPE

Candidato a doutor no Centro de Informáticada UFPE

Silvio Barros Melo, Centro de Informática - UFPE

Professor Doutor do CIn - UFPE

References

BAKER, F. B.; KIM, S.-H. The Basics of Item Response Theory. Statistics for Social and Behavioral Sciences, Springer International Publishing. Cham, Switzerland. p. 188. 2017.

BURGGRÄF, P.; WAGNER, J.;KOKE, B.; BAMBERG, M. Performance assessment methodology for AI-supported decision-making in production management. Procedia CIRP, v. 93, p. 891–896. 2020.

DOUZAS, G.; RAUCH, R.; BACAO, F. G-SOMO: An oversampling approach based on self-organized maps and geometric SMOTE. Expert Systems with Applications, v. 183, n. March, p. 115230. 2021.

HATHALIYA, J. J.; TANWAR, S. An exhaustive survey on security and privacy issues in Healthcare 4.0. Computer Communications, v. 153, n. September 2019, p. 311–335. 2020

LA TORRE, J. DE; DENG, W. Improving person-fit assessment by correcting the ability estimate and its reference distribution. Journal of Educational Measurement, v. 45, n. 2, p. 159–177. 2008.

LIN, W. C.; TSAI, C. F.; HU, Y. H.; JHANG, J. S..Clustering-based undersampling in class-imbalanced data. Information Sciences, v. 409–410, p. 17–26. 2017.

MOHAMMADI BIDHANDI, H. . Capacity planning for a network of community health services. European Journal of Operational Research, v. 275, n. 1, p. 266–279. 2019.

MOHEDANO-MUNOZ, M. A.; ALIQUE-GARCÍA, S.; RUBIO-SÁNCHEZ, M. RAYA, L. SANCHEZ, A. Interactive visual clustering and classification based on dimensionality reduction mappings: A case study for analyzing patients with dermatologic conditions. Expert Systems with Applications, v. 171, n. January, p. 114605. 2021.

MORAES, J. V. C.; REINALDO, J. T.S.; FERREIRA-JUNIOR, M.; FILHO, T. S.;PRUDÊNCIO, R. B.C. Evaluating regression algorithms at the instance level using item response theory. Knowledge-Based Systems, v. 240, p. 108076. 2022.

MUNOZ, S. R.; BANGDIWALA, S. I. Interpretation of Kappa and B statistics measures of agreement. Journal of Applied Statistics, 1 fev. v. 24, n. 1, p. 105–112. 1997.

PURI, A.; GUPTA, M. K. Improved Hybrid Bag-Boost Ensemble with K-Means-SMOTE-ENN Technique for Handling Noisy Class Imbalanced Data. Computer Journal,v. 65, n. 1, p. 124–138. 2022.

TAHIR, M. A.; KITTLER, J.; YAN, F. Inverse random under sampling for class imbalance problem and its application to multi-label classification. Pattern Recognition, v. 45, n. 10, p. 3738–3750. 2012.

TANG, W.; YANG, Y.; ZENG, L.; ZHAN, Y.. Optimizing MSE for clustering with balanced size constraints. Symmetry, v. 11, n. 3. 2019.

WOTEKI, C. E.; KINEMAN, B. D. C Hallenges and a Pproaches To R Educing. Review Literature And Arts Of The Americas, 2003. n. June, p. 82–89. 2003.

WU, X.; LI, P.; HU, X. Learning from concept drifting data streams with unlabeled data. Neurocomputing,v. 92, p. 145–155. 2012.

ZHENG, Y.; CHEON, H.; KATZ, C. M. Using Machine Learning Methods to Develop a Short Tree-Based Adaptive Classification Test: Case Study With a High-Dimensional Item Pool and Imbalanced Data. Applied Psychological Measurement, v. 44, n. 7–8, p. 499–514. 2020.

ZHOU, Q.; SUN, B.; SONG, Y.; LI, S.. K-means Clustering Based Undersampling for Lower Back Pain Data. ACM International Conference Proceeding Series, p. 53–57. 2020.

Published

2022-12-19

Issue

Section

Artigos