Measuring the Performance of Information Systems: A Functional Scorecard.

Author List: Chang, Jerry Cha-Jan; King, William R.;
Journal of Management Information Systems, 2005, Volume 22, Issue 1, Page 85-115.
This study develops an instrument that may be used as an information systems (IS) functional scorecard (lSFS). It is based on a theoretical input--output model of the IS function's role in supporting business process effectiveness and organizational performance. The research model consists of three system output dimensions--systems performance, information effectiveness, and service performance. The "updated paradigm" for instrument development was followed to develop and validate the ISFS instrument. Construct validation of the instrument was conducted using responses from 346 systems users in 149 organizations by a combination of exploratory factor analysis and structural equation modeling using LISREL. The process resulted in an instrument that measures 18 unidimensional factors within the three ISFS dimensions. Moreover, a sample of 120 matched-paired responses of separate CIO and user responses was used for nomological validation. The results showed that the ISFS measure reflected by the instrument was positively related to improvements in business processes effectiveness and organizational performance. Consequently, the instrument may be used for assessing IS performance, for guiding information technology investment and sourcing decisions, and as a basis for further research and instrument development.
Keywords: functional scorecard; information systems performance measurement; instrument development; structural equation modeling
Algorithm:

List of Topics

#263 0.251 instrument measurement factor analysis measuring measures dimensions validity based instruments construct measure conceptualization sample reliability development develop responses assess use
#124 0.150 validity reliability measure constructs construct study research measures used scale development nomological scales instrument measurement researchers developed validation discriminant results
#240 0.140 systems information management development presented function article discussed model personnel general organization described presents finally computer-based role examined functional components
#93 0.094 performance results study impact research influence effects data higher efficiency effect significantly findings impacts empirical significant suggest outcomes better positive
#69 0.087 process business reengineering processes bpr redesign paper research suggests provide past improvements manage enable organizations regarding focal cycle creating issues
#148 0.075 productivity information technology data production investment output investments impact returns using labor value research results evidence spillovers industries analysis gains
#1 0.068 organizational organizations effectiveness factors managers model associated context characteristics variables paper relationships level attention environmental technological based maturity organization's relationship
#162 0.059 structural modeling scale equation implications economies large future framework perspective propose broad scope resulting identified leading analyzed second interviews analysis