Measuring Creativity in Die Products for Technological Education
Creative design requires new approaches to assessment
in vocational and technological education. To date, there has been little
discussion on instruments used to evaluate dies produced by students
in vocational and technological education. Developing a generic
instrument has been very difficult due to the diversity of creative
domains, the specificity of content, and the subjectivity involved in
judgment. This paper presents an instrument for measuring the
creativity in the design of products by expanding the Consensual
Assessment Technique (CAT). The content-based scale was evaluated
for content validity by 5 experts. The scale comprises 5 criteria:
originality; practicability; precision; aesthetics; and exchangeability.
Nine experts were invited to evaluate the dies produced by 38 college
students who enrolled in a Product Design and Development course.
To further explore the degree of rater agreement, inter-rater reliability
was calculated for each dimension using Kendall's coefficient of
concordance test. The inter-judge reliability scores achieved
significance, with coefficients ranging from 0.53 to 0.71.
[1] S. Q. Xie, H. Huang, and Y. L. Tu, "A WWW-Based Information
Management System for Rapid and Integrated Mould Product
Development," Int. j. adv. manuf. technol., vol. 20, no. 1, pp. 50-57, 2002.
[2] Y. K. Leung, K. L. Choy, and C. K. Kwong, "A real-time hybrid
information-sharing and decision support system for the mould industry,"
J. high technol. managem. res., vol. 21, no. 1, pp. 64-77, 2010.
[3] L. Slack, What is product design? Mies, Switzerland: RotoVision, 2006.
[4] A. O. o. M. o. Education. (2003). White paper of creative education.
Available:
http://www.creativity.edu.tw/modules/wfsection/article.php?articleid=19
5
[5] W. Niu, "A Comparison of Mainland China, Taiwan, Hong Kong, and
Singapore," in The international handbook of creativityed, J. C. Kaufman
and R. J. Sternberg, Eds., Cambridge, UK: Cambridge University Press,
2006, pp. 374-394.
[6] J. A. Plucker, "Generalization of creativity across domains: Examination
of the method effect hypothesis," J. creat. behav., vol. 38, no. 1, pp. 1-12,
2004.
[7] J. A. Plucker, "The (relatively) generalist view of creativity," in Creativity
across domains: Faces of the museed, J. C. Kaufman and J. Baer, Eds.,
Mahwah, NJ: Erlbaum, 2005, pp. 307-312.
[8] J. Baer, Creativity and divergent thinking: A task-specific approach.
Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.
[9] P. J. Silvia, J. C. Kaufman, and J. E. Pretz, "Is Creativity
Domain-Specific? Latent Class Models of Creative Accomplishments
and Creative Self-Descriptions," Psychology of Aesthetics, Creativity,
and the Arts, vol. 3, no. 3, pp. 139-148, 2009.
[10] R. J. Sternberg, "Domain-Generality Versus Domain-Specificity of
Creativity," in Milieus of Creativityed, P. Meusburger, J. Funke, and E.
Wunder, Eds.: Springer Netherlands, 2009, pp. 25-38.
[11] R. E. Peterson, "Establishing the creative environment in technology
education," Technol. teach., vol. 61, no. 4, pp. 7-10, 2001.
[12] S. D. Johnson and J. Daugherty, "Quality and Characteristics of Recent
Research in Technology Education," J. technol. educ., vol. 20, no. 1, pp.
16-31, 2008.
[13] K. W. M. Siu, "Nurturing All-round Engineering and Product Designers,"
Int. J. Technol. Des. Educ., vol. 13, no. 3, pp. 243-254, 2003.
[14] J.-S. Horng, "The research on creative culinary products," in 12th Asia
Pacific Tourism Association and 4th ApacCHRIE Joint Conference,
HuaLian, Taiwan., 2006, pp. 2156-2168.
[15] H.-G. Hsu, M.-H. Lai, D.-G. Chen, P.-Y. Chan, and T.-M. Chang, "The
development of technical creativity test of electronic and electric cluster
for high school student," Psychological Testing, vol. 55, no. 2, pp.
407-434, 2008.
[16] J.-S. Horng and L. Lin, "The Development of a Scale for Evaluating
Creative Culinary Products," Creat. res. j., vol. 21, no. 1, pp. 54-63,
2009/02/09 2009.
[17] A. K. Palaniappan, Cultural Influences on Creativity and Academic
Achievement. Kuala Lumpur: In.Reach, 2007.
[18] A. Furnham and V. Bachtiar, "Personality and intelligence as predictors
of creativity," Pers. individ. differ., vol. 45, no. 7, pp. 613-617, 2008.
[19] F. Barron, "The disposition toward originality," The Journal of
Abnormal and Social Psychology, vol. 51, no. 3, p. 478, 1955.
[20] Y. Li, J. Wang, X. Li, and W. Zhao, "Design creativity in product
innovation," Int. j. adv. manuf. technol., vol. 33, no. 3, pp. 213-222, 2007.
[21] M. D. Mumford, "Where have we been, where are we going? Taking
stock in creativity research," Creat. res. j., vol. 15, no. 2-3, pp. 107-120,
2003.
[22] M. D. Mumford, "Taking stock in taking stock," Creat. res. j., vol. 15, no.
2-3, pp. 147-151, 2003.
[23] R. K. Sawyer, Explaining creativity: The science of human innovation.
Oxford, New York: Oxford University Press, 2006.
[24] J. E. Ormrod, Educational Psychology: Developing Learners, 7 ed.:
Pearson, 2011.
[25] T. M. Amabile, Creativity in context: Update to" The social psychology of
creativity.". Boulder , CO: Westview Press, 1996.
[26] G. R. Oldham and A. Cummings, "Employee creativity: Personal and
contextual factors at work," Acad. Manage. J., vol. 39, no. 1, pp. 607-634,
1996.
[27] C. E. Shalley, "Effects of coaction, expected evaluation, and goal setting
on creativity and productivity," Acad. Manage. J., vol. 38, no. 1, pp.
483-503, 1995.
[28] J. Zhou, "Feedback valence, feedback style, task autonomy, and
achievement orientation: Interactive effects on creative performance," J.
Appl. Psychol., vol. 83, no. 2, pp. 261-276, 1998.
[29] J. Adair, Leadership for innovation: how to organize team creativity and
harvest ideas. London: Kogan Page Ltd, 2007.
[30] T. M. Amabile, "The social psychology of creativity: A componential
conceptualization," J. Pers. Soc. Psychol., vol. 45, no. 2, pp. 357-376,
1983.
[31] J. Baer, "Performance Assessments of Creativity: Do They Have
Long-Term Stability?," Roeper rev., vol. 17, no. 1, pp. 7-11, 1994.
[32] J. Baer, J. C. Kaufman, and C. A. Gentile, "Extension of the Consensual
Assessment Technique to Nonparallel Creative Products," Creat. res. j.,
vol. 16, no. 1, pp. 113-117, 2004.
[33] J. C. Kaufman, J. Baer, J. C. Cole, and J. D. Sexton, "A comparison of
expert and nonexpert raters using the Consensual Assessment
Technique," Creat. res. j., vol. 20, no. 2, pp. 171-178, 2008.
[34] S. Carson, "Creativity and mental illness," presented at the Invitational
Panel Discussion Hosted by Yale-s Mind Matters Consortium, New
Haven, CT, 2006.
[35] T. M. Amabile, "Social psychology of creativity: A consensual
assessment technique," J. Pers. Soc. Psychol., vol. 43, no. 5, pp.
997-1013, 1982.
[36] R. Dineen, E. Samuel, and K. Livesey, "The promotion of creativity in
learners: theory and practice," Art, design & communication in higher
education, vol. 4, no. 3, pp. 155-172, 2005.
[37] J. C. Kaufman, J. Baer, and C. A. Gentile, "Differences in gender and
ethnicity as measured by ratings of three writing tasks," J. creat. behav.,
vol. 38, no. 1, pp. 56-69, 2004.
[38] T. M. Amabile, B. A. Hennessey, and B. S. Grossman, "Social influences
on creativity: The effects of contracted-for reward," J. Pers. Soc.
Psychol., vol. 50, no. 1, pp. 14-23, 1986.
[39] R. Conti, H. Coon, and T. M. Amabile, "Evidence to support the
componential model of creativity: Secondary analyses of three studies,"
Creat. res. j., vol. 9, no. 4, pp. 385-389, 1996.
[40] J. Ruscio, D. M. Whitney, and T. M. Amabile, "Looking inside the
fishbowl of creativity: Verbal and behavioral predictors of creative
performance," Creat. res. j., vol. 11, no. 3, pp. 243-263, 1998.
[41] X. Caroff and M. Besançon, "Variability of creativity judgments," Learn.
individ. differ., vol. 18, no. 4, pp. 367-371, 2008.
[42] S. J. Dollinger, "Creativity and conservatism," Pers. individ. differ., vol.
43, no. 5, pp. 1025-1035, 2007.
[43] J. Kasof, C. Chen, A. Himsel, and E. Greenberger, "Values and
creativity," Creat. res. j., vol. 19, no. 2-3, pp. 105-122, 2007.
[44] J. C. Kaufman, C. A. Gentile, and J. Baer, "Do Gifted Student Writers and
Creative Writing Experts Rate Creativity the Same Way?," Gift. child q.,
vol. 49, no. 3, pp. 260-265, 2005.
[45] M. Garaigordobil, "Intervention in Creativity With Children Aged 10 and
11 Years: Impact of a Play Program on Verbal and Graphic-Figural
Creativity," Creat. res. j., vol. 18, no. 3, pp. 329-345, 2006.
[46] S. P. Besemer, "Creative Product Analysis to Foster Innovation," Des.
manage. j., vol. 11, no. 4, pp. 59-64, 2000.
[47] S. J. Dollinger, K. K. Urban, and T. A. James, "Creativity and Openness:
Further Validation of Two Creative Product Measures," Creat. res. j., vol.
16, no. 1, pp. 35-47, 2004/03/01 2004.
[48] D. H. Cropley, J. C. Kaufman, and A. J. Cropley, "Measuring Creativity
for Innovation Management," J. Technol. Manag. Innov., vol. 6, no. 3, pp.
13-30, 2011.
[49] D. H. Cropley and A. J. Cropley, "Engineering creativity: A systems
concept of functional creativity," in Creativity across domains: Faces of
the museed, J. C. Kaufman and J. Baer, Eds., Hillsdale, NJ: Lawrence
Erlbaum, 2005, pp. 169-185.
[50] G. Rubera, A. Ordanini, and D. Mazursky, "Toward a contingency view
of new product creativity: Assessing the interactive effects of
consumers," Marketing Letters, vol. 21, no. 2, pp. 191-206, 2010.
[51] D. J. Sheskin, Handbook of parametric and nonparametric statistical
procedures, 3 ed. Boca Raton, Florida: Chapman and Hall/CRC, 2003.
[52] N. Le├│n, "Putting TRIZ into product design," Des. manage. j., vol. 14, no.
2, pp. 58-64, 2003.
[53] H. Christiaans and K. Venselaar, "Creativity in design engineering and
the role of knowledge: Modelling the expert," Int. J. Technol. Des. Educ.,
vol. 15, no. 3, pp. 217-236, 2005.
[1] S. Q. Xie, H. Huang, and Y. L. Tu, "A WWW-Based Information
Management System for Rapid and Integrated Mould Product
Development," Int. j. adv. manuf. technol., vol. 20, no. 1, pp. 50-57, 2002.
[2] Y. K. Leung, K. L. Choy, and C. K. Kwong, "A real-time hybrid
information-sharing and decision support system for the mould industry,"
J. high technol. managem. res., vol. 21, no. 1, pp. 64-77, 2010.
[3] L. Slack, What is product design? Mies, Switzerland: RotoVision, 2006.
[4] A. O. o. M. o. Education. (2003). White paper of creative education.
Available:
http://www.creativity.edu.tw/modules/wfsection/article.php?articleid=19
5
[5] W. Niu, "A Comparison of Mainland China, Taiwan, Hong Kong, and
Singapore," in The international handbook of creativityed, J. C. Kaufman
and R. J. Sternberg, Eds., Cambridge, UK: Cambridge University Press,
2006, pp. 374-394.
[6] J. A. Plucker, "Generalization of creativity across domains: Examination
of the method effect hypothesis," J. creat. behav., vol. 38, no. 1, pp. 1-12,
2004.
[7] J. A. Plucker, "The (relatively) generalist view of creativity," in Creativity
across domains: Faces of the museed, J. C. Kaufman and J. Baer, Eds.,
Mahwah, NJ: Erlbaum, 2005, pp. 307-312.
[8] J. Baer, Creativity and divergent thinking: A task-specific approach.
Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.
[9] P. J. Silvia, J. C. Kaufman, and J. E. Pretz, "Is Creativity
Domain-Specific? Latent Class Models of Creative Accomplishments
and Creative Self-Descriptions," Psychology of Aesthetics, Creativity,
and the Arts, vol. 3, no. 3, pp. 139-148, 2009.
[10] R. J. Sternberg, "Domain-Generality Versus Domain-Specificity of
Creativity," in Milieus of Creativityed, P. Meusburger, J. Funke, and E.
Wunder, Eds.: Springer Netherlands, 2009, pp. 25-38.
[11] R. E. Peterson, "Establishing the creative environment in technology
education," Technol. teach., vol. 61, no. 4, pp. 7-10, 2001.
[12] S. D. Johnson and J. Daugherty, "Quality and Characteristics of Recent
Research in Technology Education," J. technol. educ., vol. 20, no. 1, pp.
16-31, 2008.
[13] K. W. M. Siu, "Nurturing All-round Engineering and Product Designers,"
Int. J. Technol. Des. Educ., vol. 13, no. 3, pp. 243-254, 2003.
[14] J.-S. Horng, "The research on creative culinary products," in 12th Asia
Pacific Tourism Association and 4th ApacCHRIE Joint Conference,
HuaLian, Taiwan., 2006, pp. 2156-2168.
[15] H.-G. Hsu, M.-H. Lai, D.-G. Chen, P.-Y. Chan, and T.-M. Chang, "The
development of technical creativity test of electronic and electric cluster
for high school student," Psychological Testing, vol. 55, no. 2, pp.
407-434, 2008.
[16] J.-S. Horng and L. Lin, "The Development of a Scale for Evaluating
Creative Culinary Products," Creat. res. j., vol. 21, no. 1, pp. 54-63,
2009/02/09 2009.
[17] A. K. Palaniappan, Cultural Influences on Creativity and Academic
Achievement. Kuala Lumpur: In.Reach, 2007.
[18] A. Furnham and V. Bachtiar, "Personality and intelligence as predictors
of creativity," Pers. individ. differ., vol. 45, no. 7, pp. 613-617, 2008.
[19] F. Barron, "The disposition toward originality," The Journal of
Abnormal and Social Psychology, vol. 51, no. 3, p. 478, 1955.
[20] Y. Li, J. Wang, X. Li, and W. Zhao, "Design creativity in product
innovation," Int. j. adv. manuf. technol., vol. 33, no. 3, pp. 213-222, 2007.
[21] M. D. Mumford, "Where have we been, where are we going? Taking
stock in creativity research," Creat. res. j., vol. 15, no. 2-3, pp. 107-120,
2003.
[22] M. D. Mumford, "Taking stock in taking stock," Creat. res. j., vol. 15, no.
2-3, pp. 147-151, 2003.
[23] R. K. Sawyer, Explaining creativity: The science of human innovation.
Oxford, New York: Oxford University Press, 2006.
[24] J. E. Ormrod, Educational Psychology: Developing Learners, 7 ed.:
Pearson, 2011.
[25] T. M. Amabile, Creativity in context: Update to" The social psychology of
creativity.". Boulder , CO: Westview Press, 1996.
[26] G. R. Oldham and A. Cummings, "Employee creativity: Personal and
contextual factors at work," Acad. Manage. J., vol. 39, no. 1, pp. 607-634,
1996.
[27] C. E. Shalley, "Effects of coaction, expected evaluation, and goal setting
on creativity and productivity," Acad. Manage. J., vol. 38, no. 1, pp.
483-503, 1995.
[28] J. Zhou, "Feedback valence, feedback style, task autonomy, and
achievement orientation: Interactive effects on creative performance," J.
Appl. Psychol., vol. 83, no. 2, pp. 261-276, 1998.
[29] J. Adair, Leadership for innovation: how to organize team creativity and
harvest ideas. London: Kogan Page Ltd, 2007.
[30] T. M. Amabile, "The social psychology of creativity: A componential
conceptualization," J. Pers. Soc. Psychol., vol. 45, no. 2, pp. 357-376,
1983.
[31] J. Baer, "Performance Assessments of Creativity: Do They Have
Long-Term Stability?," Roeper rev., vol. 17, no. 1, pp. 7-11, 1994.
[32] J. Baer, J. C. Kaufman, and C. A. Gentile, "Extension of the Consensual
Assessment Technique to Nonparallel Creative Products," Creat. res. j.,
vol. 16, no. 1, pp. 113-117, 2004.
[33] J. C. Kaufman, J. Baer, J. C. Cole, and J. D. Sexton, "A comparison of
expert and nonexpert raters using the Consensual Assessment
Technique," Creat. res. j., vol. 20, no. 2, pp. 171-178, 2008.
[34] S. Carson, "Creativity and mental illness," presented at the Invitational
Panel Discussion Hosted by Yale-s Mind Matters Consortium, New
Haven, CT, 2006.
[35] T. M. Amabile, "Social psychology of creativity: A consensual
assessment technique," J. Pers. Soc. Psychol., vol. 43, no. 5, pp.
997-1013, 1982.
[36] R. Dineen, E. Samuel, and K. Livesey, "The promotion of creativity in
learners: theory and practice," Art, design & communication in higher
education, vol. 4, no. 3, pp. 155-172, 2005.
[37] J. C. Kaufman, J. Baer, and C. A. Gentile, "Differences in gender and
ethnicity as measured by ratings of three writing tasks," J. creat. behav.,
vol. 38, no. 1, pp. 56-69, 2004.
[38] T. M. Amabile, B. A. Hennessey, and B. S. Grossman, "Social influences
on creativity: The effects of contracted-for reward," J. Pers. Soc.
Psychol., vol. 50, no. 1, pp. 14-23, 1986.
[39] R. Conti, H. Coon, and T. M. Amabile, "Evidence to support the
componential model of creativity: Secondary analyses of three studies,"
Creat. res. j., vol. 9, no. 4, pp. 385-389, 1996.
[40] J. Ruscio, D. M. Whitney, and T. M. Amabile, "Looking inside the
fishbowl of creativity: Verbal and behavioral predictors of creative
performance," Creat. res. j., vol. 11, no. 3, pp. 243-263, 1998.
[41] X. Caroff and M. Besançon, "Variability of creativity judgments," Learn.
individ. differ., vol. 18, no. 4, pp. 367-371, 2008.
[42] S. J. Dollinger, "Creativity and conservatism," Pers. individ. differ., vol.
43, no. 5, pp. 1025-1035, 2007.
[43] J. Kasof, C. Chen, A. Himsel, and E. Greenberger, "Values and
creativity," Creat. res. j., vol. 19, no. 2-3, pp. 105-122, 2007.
[44] J. C. Kaufman, C. A. Gentile, and J. Baer, "Do Gifted Student Writers and
Creative Writing Experts Rate Creativity the Same Way?," Gift. child q.,
vol. 49, no. 3, pp. 260-265, 2005.
[45] M. Garaigordobil, "Intervention in Creativity With Children Aged 10 and
11 Years: Impact of a Play Program on Verbal and Graphic-Figural
Creativity," Creat. res. j., vol. 18, no. 3, pp. 329-345, 2006.
[46] S. P. Besemer, "Creative Product Analysis to Foster Innovation," Des.
manage. j., vol. 11, no. 4, pp. 59-64, 2000.
[47] S. J. Dollinger, K. K. Urban, and T. A. James, "Creativity and Openness:
Further Validation of Two Creative Product Measures," Creat. res. j., vol.
16, no. 1, pp. 35-47, 2004/03/01 2004.
[48] D. H. Cropley, J. C. Kaufman, and A. J. Cropley, "Measuring Creativity
for Innovation Management," J. Technol. Manag. Innov., vol. 6, no. 3, pp.
13-30, 2011.
[49] D. H. Cropley and A. J. Cropley, "Engineering creativity: A systems
concept of functional creativity," in Creativity across domains: Faces of
the museed, J. C. Kaufman and J. Baer, Eds., Hillsdale, NJ: Lawrence
Erlbaum, 2005, pp. 169-185.
[50] G. Rubera, A. Ordanini, and D. Mazursky, "Toward a contingency view
of new product creativity: Assessing the interactive effects of
consumers," Marketing Letters, vol. 21, no. 2, pp. 191-206, 2010.
[51] D. J. Sheskin, Handbook of parametric and nonparametric statistical
procedures, 3 ed. Boca Raton, Florida: Chapman and Hall/CRC, 2003.
[52] N. Le├│n, "Putting TRIZ into product design," Des. manage. j., vol. 14, no.
2, pp. 58-64, 2003.
[53] H. Christiaans and K. Venselaar, "Creativity in design engineering and
the role of knowledge: Modelling the expert," Int. J. Technol. Des. Educ.,
vol. 15, no. 3, pp. 217-236, 2005.
@article{"International Journal of Business, Human and Social Sciences:64892", author = "Ching-Yi Lee and Dyi-Cheng Chen and Bo-Yan Lai and Chin-Pin Chen", title = "Measuring Creativity in Die Products for Technological Education", abstract = "Creative design requires new approaches to assessment
in vocational and technological education. To date, there has been little
discussion on instruments used to evaluate dies produced by students
in vocational and technological education. Developing a generic
instrument has been very difficult due to the diversity of creative
domains, the specificity of content, and the subjectivity involved in
judgment. This paper presents an instrument for measuring the
creativity in the design of products by expanding the Consensual
Assessment Technique (CAT). The content-based scale was evaluated
for content validity by 5 experts. The scale comprises 5 criteria:
originality; practicability; precision; aesthetics; and exchangeability.
Nine experts were invited to evaluate the dies produced by 38 college
students who enrolled in a Product Design and Development course.
To further explore the degree of rater agreement, inter-rater reliability
was calculated for each dimension using Kendall's coefficient of
concordance test. The inter-judge reliability scores achieved
significance, with coefficients ranging from 0.53 to 0.71.", keywords = "Design education, die creative product, vocational
and technological education, Consensual Assessment Technique
(CAT).", volume = "6", number = "12", pages = "3771-5", }
