An ICT Performance Evaluation Model based on Meta-Synthesis Approach
Subject Areas : IT Strategy
Khatrehe Bamary
1
,
Mohammad Reza Behboudi
2
*
,
Tayebeh Abbasnjad
3
1 - Department of Industrial and Public Management, Faculty of Management, Accounting and Economics, University of Hormozgan
2 - Department of Industrial and Public Management, Faculty of Management, Accounting and Economics, University of Hormozgan
3 - Department of Industrial and Public Management, Faculty of Management, Accounting and Economics, University of Hormozgan
Keywords: Information and Communication Technology, Meta-synthesis, ICT Performance evaluation, Strategic, Quality, Sustainability,
Abstract :
Information and Communication Technology (ICT) is one of the key determinants for today’s organizational success. Therefore, companies spend a significant amount of money each year on ICT, while not being sure that they will get a good result. The purpose of this study is to identify the dimensions and indicators of ICT performance evaluation and suggesting a model for assessing it in organizations. This research is mainly a qualitative study with a meta-synthesis approach which uses the seven-stage qualitative method of Sandelowski and Barroso to systematically review the literature to find sub-indices (codes), indices (themes) and dimensions (categories) of ICT performance evaluation. The search of scientific databases with appropriate keywords found 516 articles, among them, 89 articles were chosen finally and used for analysis. Moreover, a questionnaire has been designed and answered by ICT experts and managers to determine the importance of each of the indicators of the model. Based on data analysis, the proposed ICT performance evaluation model has three dimensions: strategic, quality, and sustainability. The strategic dimension includes indicators of organization strategy, IT strategy, and alignment. The quality dimension includes maturity, and performance indicators; and finally, the sustainability dimension includes environmental, economic, and social indicators. For each of these indicators detailed list of sub-indices (104), which are substantial for evaluation of ICT performance in organizations, were identified and explained.
[1] J. L. García-Alcaraz, V. Martínez-Loya, J. R. Díaz-Reza, J. Blanco-Fernández, E. Jiménez-Macías, and A. J. G. Lopez. “Effect of ICT integration on SC flexibility, agility and company’ performance: the Mexican maquiladora experience” Wireless Networks, Vol. 26, No.7, 2020, pp. 4805-4818.
[2] M. Arslandere, İ. Tuncer, and A. D. A. Serkan. “The Impact of ICT Use in Promotional Activities on Export Performance: An Empirical Investigation”, Business & Management Studies: An International Journal, Vol. 8, No.2, 2020, pp. 2384 – 2413.
[3] A. Rimmimgton, G. Dickens, and C. Pasqire. “Impact of Information and Communication Technology (ICT) on construction projects”, Organization, technology & management in construction: an international journal, Vol. 7, No.3, 2015, pp. 1367-1382.
[4] X. Chaojun, Y. Wei, H. Chenlin, and S. Congying. “Design and Validation of School ICT Monitoring & Evaluation Framework: A Case Study”, American Journal of Education and Information Technology. Vol. 4, No.2, 2020, pp. 78.
[5] T. B. Gyamerah. “Using e-learning to improve the performance of first year nursing students in ICT”. GSJ, Vol. 8, No.6, 2020, pp.-250-257.
[6] I. Apulu, and A. Latham."An Evaluation of the Impact of Information and Communication Technologies: Two Case Study Examples". International Business Research, Vol. 3, No. 4, 2011, pp. 3-9.
[7] M. Okumu Ujunju, G. Wanyembi, and F. Wabwoba." Evaluating the Role of Information and Communication Technology (ICT) Support towards Processes of Management in Institutions of Higher Learning", (IJACSA) International Journal of Advanced Computer Science and Applications, Vol. 3, No.7, 2012, pp. 55-58.
[8] A. M. Sayaf, M. M. Alamri, M. A. Alqahtani and W. M. Al-Rahmi. "Information and Communications Technology Used in Higher Education: An Empirical Study on Digital Learning as Sustainability". Sustainability, Vol. 13, No. 13, 2021.
[9] H. Toya, and M. Skidmore. "Information/communication technology and natural disaster vulnerability", Economics Letters, 2015, pp. 143-145.
[10] A. André." The Information Technology Revolution in Health Care", In: André A. (eds) Digital Medicine. Health Informatics. Springer, Cham, 2019.
[11] S. Dutta, and B. Bilbao-Osorio. “The Global Information Technology Report 2015”, World Economic Forum, Vol. 1, No.1, 2015, pp. 200-42.
[12] K. Milis, and R. Mercken. “The use of the balanced scorecard for the evaluation of information and communication technology projects”, International Journal of Project Management, Vol. 22, No.2, 2004, pp. 87-97.
[13] S. Haanappel, R. Drost, F. Harmsen,, S. Brinkkemper, and J. M. Versendaal. “A framework for IT performance management”, Available from www: http://www. Cs. Uu. Nl/research/ techreps /repo/CS, 2011(006).
[14] J. Becker, R. Knackstedt, and J. Pöppelbuß, "Developing maturity models for IT management", Business & Information Systems Engineering, Vol.1, No.5, 2009, pp. 213-222.
[15] J. McKay, P. Marshall, and L. Smith. “Steps towards effective IT governance: strategic IS planning, evaluation and benefits management”, PACIS 2003 Proceedings, 65.
[16] E. H. Arribas, and P. S. Inchusta. “Evaluation models of information technology in Spanish companies: a cluster analysis”, Information & Management, Vol. 36, No.3, 1999, pp. 151-164.
[17] A. Albadvi, A. Keramati, and J. Razmi. “Assessing the impact of information technology on firm performance considering the role of intervening variables: organizational infrastructures and business processes reengineering”. International Journal of Production Research, Vol. 45, No.5, 2007, pp. 2697-2734.
[18] B. C. Stahl. “Information technology, responsibility, and anthropology”, In Proceedings of the 35th Annual Hawaii International Conference on System Sciences. IEEE, 2002, pp.1-10.
[19] K. L. Kraemer & J. N. Danziger, "The impacts of computer technology on the worklife of information workers". Social Science Computer Review, Vol. 8, No. 4, 1990, pp. 592-613.
[20] C. A. Gorse, & S. Emmitt. Investigating interpersonal communication during construction progress meetings: challenges and opportunities. Engineering, Construction and Architectural Management., Vol .10, No. 2, 2003, pp 233-245.
[21] O. Zizlavsky. “The balanced scorecard: Innovative performance measurement and management control system”, Journal of technology management & innovation, Vol. 9, No.3, 2014, pp. 210-222.
[22] N. Y. Wijayanti, W. Setiawan, and R. A. Sukamto. “Performance Assessment of IT Governance with Balanced Score Card and COBIT 4.1 of Universitas Pendidikan Indonesia”, Journal of Physics: Conference Series, Vol. 812, No. 1, 2017, p. 012072. IOP Publishing.
[23] M. Uii, H. Gusaptono, M. Effendi and N. Charibaldi. “The Information Technology (IT) Adoption Process and E- Readiness to Use within Yogyakarta Indonesian Small Medium Enterprises (SME)”, International Journal of Information and Communication Technology Research, Vol. 2, No. 1, 2012, pp. 1-12.
[24] F. Salehi1, B. Abdollahbeigi1 and S, Sajjady. “Impact of Effective IT Governance on Organizational Performance and Economic Growth in Canada”, Asian Journal of Economics, Finance and Management, Vol. 3, No. 2, 2021, pp, 14-19.
[25] M. Simonsson, and P. Johnson. “Defining IT governance-a consolidation of literature”, The 18th conference on advanced information systems engineering, Vol. 6, 2006, pp, 1-19.
[26] P. Weill, and J. W. Ross. “IT governance on one page”. No 349, 2004, pp, 1-18. Available at SSRN: https://ssrn.com/abstract=664612.
[27] B. Tuttle, and S. D. Vandervelde. “An empirical examination of CobiT as an internal control framework for information technology”, International Journal of Accounting information systems, Vol. 8, No.4, 2007, pp. 240-236.
[28] I. Arfyanti1, N. Nursobah, R. Rajiansyah.“IT Governance Of Senayan Library Management System (Slims) Library and Archives Department Of East Kalimantan Province Using COBIT 5.0”, Jurnal Ilmiah MATRIK, Vol. 23, No.2, 2021, pp. 159-166.
[29] G. Ridley, J.Young, and P. Carroll. “COBIT and its Utilization: A framework from the literature”, 37th Annual Hawaii International Conference on System Sciences, Proceedings of the IEEE, 2004, pp, 1-8.
[30] R. P. Dhaniawaty, and E. Susilawati. “The Evaluation of Information Technology Investment Management using the Domain of Portfolio Management (PM) Val IT Framework 2.0 in PT. XYZ. IOP Conference Series”, Materials Science and Engineering Vol. 407, No. 1, 2018, p. 012129. IOP Publishing.
[31] M. Kozina, and D. Popovic. “VAL IT framework and ICT benefits”, Central European Conference on Information and Intelligent Systems. Faculty of Organization and Informatics Varazdin. 2010, pp. 221.
[32] S. Sahibudin, M. Sharifi, and M. Ayat. “Combining ITIL, COBIT and ISO/IEC 27002 in order to design a comprehensive IT framework in organizations”, Second Asia International Conference on Modelling & Simulation (AMS). 2008, pp. 749-753.
[33] M. B. Al Mourad and M. Hussain, "The Impact of Cloud Computing on ITIL Service Strategy Processes," International Journal of Computer and Communication Engineering vol. 3, no. 5, 2014, pp. 367-371.
[34] M. Marrone, F. Gacenga, A. Cater-Steel, and L. Kolbe. “IT service management: A cross-national study of ITIL adoption”, CAIS, 34, 49.
[35] M. H. Koniyo "Identification of components for evaluation e-government governance framework according to regional government characteristics" The 5th Annual Applied Science and Engineering Conference. vol. 1098, No. 5, 2021, pp. 1-8.