Abstract
This research introduces a fusion architecture that integrates balanced scorecards (BSCs) and network data envelopment analysis (NDEA) to conduct a performance evaluation task from multiple perspectives. The architecture is able to capture the dynamics of production processes and sub-processes, uncover some of the components behind successful business practices, and shed light on needed actions for decision makers. Furthermore, the architecture not only can support decision makers to plan for improvement, but also equip them with forecasting ability. To enhance its forecasting quality, this study goes beyond quantitative ratios and extends them to qualitative ratios (i.e., readability: the complexities of disclosure) borrowed from computational linguistics. The results indicate that a poor readability score is highly associated with bad operations. Finally, to enlarge the mechanism’s applicable fields, the study executes the genetic algorithm (GA) to extract the inherent decision logics and represents them in a human-readable manner. The mechanism, examined by real cases, is a promising alternative for performance evaluation and forecasting.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Akbar S, Rehman S, Liu J, Shah SZA (2017) Credit supply constraints and financial policies of listed companies during the 2007–2009 financial crisis. Res Int Bus Financ 42:559–571
Alhamdoosh M, Wang D (2014) Fast decorrelated neural network ensembles with random weights. Inf Sci 264:104–117
Amado CAF, Santos SP, Marques PM (2012) Integrating the data envelopment analysis and the balanced scorecard approaches for enhanced performance assessment. Omega 40:390–403
Amado CAF, Santos SP, São José JMS (2018) Measuring and decomposing the gender pay gap: a new frontier approach. Eur J Oper Res 271:357–373
Banker RD, Chang H, Pizzini M (2011) The judgmental effects of strategy maps in balanced scorecard performance evaluations. Int J Account Inf Syst 12:259–279
Barnett A, Leoffler K (1979) Readability of accounting and auditing messages. J Bus Commun 16:49–59
Barakat N, Bradley AP (2010) Rule extraction from support vector machines: a review. Neurocomputing 1–3:178–190
Basso A, Casarin F, Funari S (2018) How well is the museum performing? A joint use of DEA and BSC to measure the performance of museums. Omega 81:67–84
Beattie V (2014) Accounting narratives and the narrative turn in accounting research: Issues, theory, methodology, methods and a research framework. The Brit Account Rev 46:111–134
Breiman L (2001) Random forests. Mach Learn 45:5–32
Bisoi R, Dash PK, Mishra SP (2019) Modes decomposition method in fusion with robust random vector functional link network for crude oil price forecasting. Appl Soft Comput 80:475–493
Blanco, B., Dhole, S. (2017). Financial statement comparability, readability and accounting fraud. working paper. University of Adelaide
Cabral I, Grilo A, Gonçalves-Coelho A, Mourão A (2016) An agent-based model for analyzing the impact of business interoperability on the performance of cooperative industrial networks. Data Knowl Eng 105:107–129
Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong TL (2019) (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int J Mach Learn Cyber 10(8):2131–2142
Cao W, Wang X, Ming Z, Gao J (2018) A review on neural networks with random weights. Neurocomputing 275:278–287
Charnes A, Cooper WW, Rhodes E (1978) Measuring the efficiency of decision making units. Eur J Oper Res 2:429–444
Chang TM, Hsu MF (2018) Integration of incremental filter-wrapper selection strategy with artificial intelligence for enterprise risk management. Int J Mach Learn Cyber 9(3):477–489
Chen Y, Miao D, Wang R (2010) A rough set approach to feature selection based on ant colony optimization. Pattern Recognit Lett 31(3):226–233
Cui S, Yin Y, Wang D, Li Z, Wang Y (2021) A stacking-based ensemble learning method for earthquake casualty prediction. Appl Soft Comput 101:107038
Chia A, Hoon HS (2000) Adopting and creating balanced scorecards in singapore based companies. Singapore Manage Rev 22:1–15
Chien MS, Lawler JS, Uen JF (2010) Performance-based pay, procedural justice and job performance for R&D professionals: Evidence from the Taiwan high-tech sector. Int Journal Hum Resour Manag 21:2234–2248
Cook WD, Zhu J, Gongbing B, Yang F (2010) Network DEA: additive efficiency decomposition. Eur J Oper Res 207:1122–1129
Davis S, Albright T (2004) An investigation of the effect of the balanced scorecard implementation on financial performance. Manage Account Res 15:135–153
Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30
Dorigo M, Maniezzo V, Colorni A (1996) The Ant system: optimization by a colony of cooperating agents. IEEE Trans Syst Man Cybern B 26(1):29–41
Dridi A, Atzeni M, Reforgiato Recupero D (2019) FineNews: fine-grained semantic sentiment analysis on financial microblogs and news. Int J Mach Learn Cyber 10:2199–2207
Fare R, Grosskopf S (1996) Productivity and intermediate products: a frontier approach. Econ Lett 50:65–70
Farquad MAH, Bose I (2012) Preprocessing unbalanced data using support vector machine. Decis Support Syst 53:226–233
Fourati H, Maaloul R, Chaari L (2021) A survey of 5G network systems: challenges and machine learning approaches. Int J Mach Learn Cyber 12:385–431
Gajzler M (2010) Text and data mining techniques in aspect of knowledge acquisition for decision support system in construction industry. Technol Econ Dev Econ 16:219–232
Geng R, Bose I, Chen X (2015) Prediction of financial distress: an empirical study of listed Chinese companies using data mining. Eur J Oper Res 241:236–247
Ghalayini AM, Noble JS (1996) The changing basis of performance measurement. Int J Oper Prod Manag 16(8):63–80
Gopal J, Sangaiah AK, Basu A, Gao XZ (2018) Integration of fuzzy DEMATEL and FMCDM approach for evaluating knowledge transfer effectiveness with reference to GSD project outcome. Int J Mach Learn Cyber 9(2):225–241
Hajek P, Olej V, Myskova R (2014) Forecasting corporate financial performance using sentiment in annual reports for stakeholders’ decision-making. Technol Econ Dev Econ 20:721–738
Hamamura J (2019) Unobservable transfer price exceeds marginal cost when the manager is evaluated using a balanced scorecard. Adv Account 44:22–28
Hsieh LH, Lin LH (2010) A performance evaluation model for international tourist hotels in Taiwan—an application of the relational network DEA. Int J Hosp Manag 29:14–24
Hsu MF, Chang TM, Lin SJ (2020) News-based soft information as a corporate competitive advantage. Technol Econ Dev Econ 26(1):48–70
Hu KH, Lin SJ, Hsu MF, Chen FH (2020) A dynamic network-based decision architecture for performance evaluation and improvement. J Intell Fuzzy Syst 39(3):4299–4311
Huang YP, Yen MF (2019) A new perspective of performance comparison among machine learning algorithms for financial distress prediction. Appl Soft Comput 83:105663
Huang A, Zang A, Zheng R (2014) Evidence on the information content of text in analyst reports. Account Rev 89:2151–2180
Hu X, Pedrycz W, Wang D (2019) Fuzzy rule-based models with randomized development mechanisms. Fuzzy Sets Syst 361:71–87
Houck M, Speaker PJ, Fleming AS, Riley RA Jr (2012) The balanced scorecard: Sustainable performance assessment for forensic laboratories. Sci Justice 52:209–216
Jensen R, Shen Q (2005) Fuzzy-rough data reduction with ant colony optimization. Fuzzy Sets Syst 149(1):5–20
Kaplan RS, Norton DP (1992) The balanced scorecard-measures that drive performances. Harv Bus Rev 70:71–79
Kao C, Hwang SN (2008) Efficiency decomposition in two-stage data envelopment analysis: an application to non-life insurance companies in Taiwan. Eur J Oper Res 185:418–429
Ko ASO, Lee SF (2000) Implementing the strategic formulation framework for the banking industry of Hong Kong. Manag Audit J 15:469–477
Lamming RC, Johnsen TE, Zheng J, Harland CM (2000) An initial classification of supply networks. Int J Opera Prod Manage 20:675–691
Lang M, Stice-Lawrence L (2015) Textual analysis and international financial reporting: Large sample evidence. J Account Econ 60:110–135
Lacave C, Diez FJ (2004) A review of explanation methods for heuristic expert systems. Knowl Eng Rev 19:133–146
Li F (2008) Annual report readability, current earnings, and earnings persistence. J Account Econ 45:221–224
Li Y, Wang YZ, Cui Q (2015) Evaluating airline efficiency: an application of virtual frontier network SBM. Transport Res E Logist Transport Rev 81:1–17
Liu P, Wang X, Yin L, Liu B (2020) Flat random forest: a new ensemble learning method towards better training efficiency and adaptive model size to deep forest. Int J Mach Learn Cyber 11:2501–2513
Lin R, Li Z (2020) Directional distance based diversification super-efficiency DEA models for mutual funds. Omega 97:10209
Lozano S (2015) Alternative SBM model for network DEA. Comput Ind Eng 82:33–40
Lo K, Ramos F, Rogo R (2017) Earnings management and annual report readability. J Account Econ 63:1–25
Mavi RK, Saen RF, Goh M (2019) Joint analysis of eco-efficiency and eco-innovation with common weights in two-stage network DEA: a big data approach. Technol Forecast Soc Chang 144:553–562
Mariani MM, Visani F (2019) Embedding eWOM into efficiency DEA modelling: an application to the hospitality sector. Int J Hosp Manag 80:1–12
Martens D, Baesens B, Gestel TV (2009) Decompositional rule extraction from support vector machines by active learning. IEEE Trans Knowl Data Eng 21:177–190
Mirdehghan SM, Fukuyama H (2016) Pareto-Koopmans efficiency and network DEA. Omega 61:78–88
Nowak-Brzezińska A, Wakulicz-Deja A (2019) Exploration of rule-based knowledge bases: a knowledge engineer’s support. Inf Sci 485:301–318
Ni D, Xiao Z, Lim MK (2020) A systematic review of the research trends of machine learning in supply chain management. Int J Mach Learn Cyber 11:1463–1482
Otley D (1999) Performance management: a framework for management control systems research. Manage Account Res 10:363–382
Pawlak Z (1982) Rough sets. Int J Comput Inf Sci 11(5):341–356
Pawlak Z (1997) Rough set approach to knowledge-based decision support. Eur J Oper Res 99(1):48–57
Paradi JC, Rouatt S, Zhu H (2011) Two-stage evaluation of bank branch efficiencyusing data envelopment analysis. Omega 39:99–109
Pao YH, Phillips SM, Sobajic DJ (1992) Neural-net computing and the intelligent control of systems. Int J Control 56:263–289
Ramberg R (1996) Construing and testing explanations in a complex domain. Comput Hum Behav 12:29–48
Rodriguez JJ, Kuncheva LI, Alonso CJ (2006) Rotation forest: a new classifier ensemble method. IEEE Trans Pattern Anal Mach Intell 28:1619–1630
Sainaghi R, Phillips P, Corti V (2013) Measuring hotel performance: Using a balanced scorecard perspectives’ approach. Int J Hosp Manag 34:150–159
Salleb-Aouissi, A., Vrain, C., Nortet, C., Kong, X., Rathod, V., Cassard, D. (2013) QuantMiner for Mining Quantitative Association Rules. J Mach Learn Res 3153−3157.
Sharma A, Rani R (2020) Drug sensitivity prediction framework using ensemble and multi-task learning. Int J Mach Learn Cyber 11:1231–1240
Shafiee M, Lotfi FH, Saleh H (2014) Supply chain performance evaluation with data envelopment analysis and balanced scorecard approach. Appl Math Model 38:5092–5112
Shen YC, Chen PS, Wang CH (2016) A study of enterprise resource planning (ERP) system performance measurement using the quantitative balanced scorecard approach. Comput Ind 75:127–139
Sueyoshi T, Yuan Y, Li A, Wang D (2017) Methodological comparison among radial, non-radial and intermediate approaches for DEA environmental assessment. Energy Econ 67:439–453
Scardapane S, Wang D, Uncini A (2018) Bayesian random vector functional-link networks for robust data modeling. IEEE Trans Cyber 48:2049–2059
Tavana M, Khalili-Damghani K, Santos Arteaga FJ, Hosseini A (2019) A fuzzy multi-objective multi-period network DEA model for efficiency measurement in oil refineries. Comput Ind Eng 135:143–155
Tone K, Tsutsui M (2009) Network DEA: A slacks-based measure approach. Eur J Oper Res 197:243–252
Wanke P, Barros C (2014) Two-stage DEA: an application to major Brazilian banks. Expert Syst Appl 41:2337–2344
Wang Y, Wang D, Ye X, Wang Y, Yin Y, Jin Y (2019) A tree ensemble-based two-stage model for advanced-stage colorectal cancer survival prediction. Inf Sci 474:106–124
Wang X, Yang J, Teng X, Xia W, Jensen R (2007) Feature selection based on rough sets and particle swarm optimization. Pattern Recognit Lett 28(4):459–471
Wu HY (2012) Constructing a strategy map for banking institutions with key performance indicators of the balanced scorecard. Eval Program Plan 35:303–320
Yang L, Xu Z (2019) Feature extraction by PCA and diagnosis of breast tumors using SVM with DE-based parameter tuning. Int J Mach Learn Cyber 10(3):591–601
Zhang L, Suganthan PN (2016) A survey of randomized algorithms for training neural networks. Inf Sci 364:146–155
Zhang C, Zhou Y, Guo J, Wang G, Wang X (2019) Research on classification method of high-dimensional class-imbalanced datasets based on SVM. Int J Mach Learn Cyber 10(7):1765–1778
Zhou L, Lu D, Fujita H (2015) The performance of corporate financial distress prediction models with features selection guided by domain knowledge and datamining approaches. Knowl-Based Syst 85:52–61
Acknowledgements
The author would like to thank the Ministry of Science and Technology, Taiwan, R.O.C. for financially supporting this work under contracts MOST. No.106-2410-H-034-011-MY3, No.108-2410-H-034-056-MY2 and No.109-2410-H-034-034-MY2.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
No conflict of interest exists in the submission of this manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations
Rights and permissions
About this article
Cite this article
Hsu, MF., Lin, SJ. A BSC-based network DEA model equipped with computational linguistics for performance assessment and improvement. Int. J. Mach. Learn. & Cyber. 12, 2479–2497 (2021). https://doi.org/10.1007/s13042-021-01331-7
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s13042-021-01331-7