Testing the Validity of Maturity Model for E-Government Implementation in Indonesia

The research was conducted to empirically validate
the proposed maturity model of e-Government implementation,
composed of four dimensions, further specified by 54 success factors
as attributes. To do so, there are two steps were performed. First,
expert’s judgment was conducted to test its content validity. The
second, reliability study was performed to evaluate inter-rater
agreement by using Fleiss Kappa approach. The kappa statistic
(kappa coefficient) is the most commonly used method for testing the
consistency among raters. Fleiss Kappa was a generalization of
Kappa in extensions to the case of more than two raters (multiple
raters) with multi-categorical ratings. Our findings show that most
attributes of the proposed model were related to their corresponding
dimensions. According to our results, The percentage of agree
answers given by the experts was 73.69% in dimension A, 89.76% in
B, 81.5% in C and 60.37% in D. This means that more than half of
the attributes of each dimensions were appropriate or relevant to the
dimensions they were supposed to measure, while 85% of attributes
were relevant enough to their corresponding dimensions. Inter-rater
reliability coefficient also showed satisfactory result and interpreted
as substantial agreement among raters. Therefore, the proposed
model in this paper was valid and reliable to measure the maturity of
e-Government implementation.

• Darmawan Napitupulu
• Dana Indra Sensuse
• Aniati Murni

• E-Government
• Model
• Maturity
• Validity
• Reliability Kappa.

[1] Yildiz, M. (2007). E-government research: Reviewing the literature,
limitations, and ways forward. Government information quarterly, 24(3),
646-665
[2] United Nations, & American Society for Public Administration (ASPA)
(2002). Benchmarking e-Government: A global perspective. New York:
United Nations
[3] Tung, L.L., Rieck, O., 2005. Adoption of electronic government services
among business organizations in Singapore. Journal of Strategic
Information Systems 14 (4), 417–440
[4] Ke, W., Wei, K.K., 2004. Successful e-government in Singapore.
Communications of the ACM 47 (6), 95–99
[5] Valdez et al., 2011. Conception, development and implementation of an
e-Government maturity model in public agencies. Government
Information Quarterly 28, Elsevier, 176-181
[6] Andersen, K. V., & Henriksen, H. Z. (2006). E-Government maturity
models: Extension of the Layne and Lee model. Government
information quarterly, 23(2), 236-248
[7] Cresswell, A., Pardo, T., & Canestraro, D. (2006). Digital capability
assessment for e-Government: A multi-dimensional approach. In M. A.
Wimmer, H. J. Scholl, Å. Grönlund, & K. V. Andersen (Eds.), EGOV
2006, Lecture notes in computer science, Vol. 4084 (pp. 293—304).
Berlin: Springer-Verlag
[8] Wimmer, M., & Tambouris, E. (2002). Online one-stop government: A
working framework and requirements. In R. Traunmüller (Ed.),
Information systems: The eBusiness challenge (pp. 117-130). Boston:
Kluwer Academic Publishers
[9] Suhono H. Supangkat, 2006. Strategy Framework of e-Government
Implementation. Proceeding Indonesia ICT National Conference, ITB
[10] Gupta B. et al. 2008. Adoption of ICT in a government organization in a
developing country: An empirical study. Journal of Strategic
Information System 17, 140-154
[11] Lam, W., 2005. Barriers to e-government integration. Journal of
Enterprise Information Management 18 (5/6), 511–530
[12] Bhatnagar, S., 2000. Social implications of information and
communication technology in developing countries: lessons from Asian
success stories. Electronic Journal on Information Systems in
Developing Countries 1 (4), 1–9
[13] Gilbert, D., Balestrini, P., Littleboy, D., 2004. Barriers and benefits in
the adoption of e-government. The International Journal of Public Sector
Management 17 (4/5), 286–301
[14] Grant, G., Chau, D., 2005. Developing a generic framework for egovernment.
Journal of Global Information Management 13 (1), 1–29
[15] Zhang, J., Dawes, S.S., Sarkis, J., 2005. Exploring stakeholders’
expectations of the benefits and barriers of e-government knowledge
sharing. Journal of Enterprise Information Management 18 (5/6), 548–
567
[16] Tolbert, C.J., Mossberger, K., 2006. The effects of e-government on
trust and confidence in government. Public Administration Review 66
(3), 354–369
[17] Prattipati, S.N., 2003. Adoption of e-governance: differences between
countries in the use of online government services. Journal of American
Academy of Business 3 (1/2), 386–401
[18] http://www.waseda.jp/eng/news12/130326_egov.html
[19] Misra, D.C., 2006. World e-government ranking by Waseda University
Institute of e-government. Retrieved from:
<http://www.digitaldivide.net/news/view.php?HeadlineID=955>
[20] Lee, S.M., Tan, X., Timi, S., 2005. Current practices of leading egovernment
countries. Communications of the Association for
Computing Machinery 48 (10), 99–104
[21] Chen, Y.N., Chen, H.M., Huang, W., Ching, R.K.H., 2006. EGovernment
strategies in developed and developing countries: an
implementation framework and case study. Journal of Global
Information Management 1 (14), 23–46
[22] Darmawan Napitupulu & Dana Indra Sensuse, 2014. The Critical
Success Factors Study for e-Government Implementation, International
Journal of Computer Application, Vol 89, No. 16, March 2014
[23] http://unpan3.un.org/egovkb/Portals/egovkb/Documents/un/2014-
Survey/E-Gov_Complete_Survey-2014.pdf
[24] http://pegi.layanan.go.id/download/tabel_pegi_2012/PeGI%20Provinsi%
202012.jpg
[25] Bullen, C.V. and J.F. Rockart, 1981. A primer on critical success factors.
Research Report. Sloan School of Management, Massachusetts Institute
of Technology, USA. CISR No. 69
[26] Straub, D., Boudreau, M-C, & Gefen D., 2004. Validation Guidelines
For IS Positivist Research, Communication of the Association for
Information System, Vol. 13, pp. 380-427
[27] Lopez de Castro B. et al. 2013. Testing the validity of the International
Atomic Energy Agency (IAEA) safety culture model. Elsevier. Accident
Analysis and Prevention 60, 231-244
[28] Fleiss, J.L. (1971). Measuring nominal scale agreement among many
raters. Psychological Bulletin, 76, 378-382.
[29] Wen-Yu Hsu, 2014. Examining the diagnostic criteria for Internet
addiction : Expert validation, Journal of the Formosan Medical
Association xx, 1-5, Elsevier Science Direct
[30] Viera J. Anthony et al. 2005.Understanding Interobserver Agreement :
The Kappa Statistic, Family Medicine, Research Series
[31] Landis JR, Koch GG. The measurement of observer agreement for
categorical data. Biometrics 1977;33:159-74.
[32] Cohen J. A coefficient of agreement for nominal scales. Educational and
Psychological Measurement 1960;20:37-46.
[33] Darmawan Napitupulu & Dana Indra Sensuse, 2014. Toward Maturity
Model For E-Government Implementation Based on Success Factors,
International Conference Advanced Computer Science and Information
Systems (ICACSIS), University of Indonesia.