This study proposes a learning cycle and a comprehensive research framework that integrates Bloom’s taxonomy: the cognitive domain (cognitive load), affective domain (attitude and motivation) and psychomotor domain (implementation of science, technology, engineering, arts, and math [STEAM] activities) to explore the relationship between these learning domains and learning intention. The proposed innovative mediated-moderation model includes second-order factors derived from the technology acceptance model (TAM) (perceived usefulness, perceived ease of use, and perceived enjoyment), the attention, relevance, confidence and satisfaction (ARCS) model, and cognitive load (mental load and mental effort) to explain the continuous learning intention of STEAM education.
A teaching material was designed for the STEAM activity, and an empirical experiment was subsequently conducted. The empirical experiment of STEAM activities with our design teaching material (micro:bit with artificial intelligence-based concept) was conducted at a university and an elementary school; a total of 145 questionnaire survey data were collected after the activities. University student participants were 20–24 years old and the elementary school student participants were at the K5–K6 level. The results showed that perceived usability directly influenced learning intention and strengthened the relationship between learning attitudes and intention. The ARCS plays a critical moderating role that positively influenced perceived usability and strengthened its effects on learning attitudes. Regarding the mediating effects, cognitive load negatively influenced perceived usability.
The findings of this study revealed that critical factors affect students’ learning attitudes and intentions regarding STEAM education. The theoretical and educational implications of these findings were proposed to future instructors.
Recently, the concepts of STEAM (science, technology, engineering, arts, and math) have been examined to determine the benefits of enhancing the cognitive domain of learning of memory, reaction time, and innate intelligence (Pabalan et al., 2018); psychomotor domain of physical measure, coordination, and skill (Ariyanto et al., 2019); and affective domain of self-confidence, self-motivation, collaboration, personal grooming, and time administration (Ramma et al., 2018). In cognitive domain studies, several previous studies examined the effects of STEAM in enhancing creative thinking (Bassachs et al., 2020; Land, 2013), career decision-making (Abe & Chikoko, 2020), cognitive structures for engineering design thinking (Lin, Chai, et al., 2021; Lin, Wu, et al., 2021), and cognitive appraisals and boredom (Ekatushabe et al., 2021). The psychomotor domain refers to skills parallel with physical growth and development to implement a specific task (Gülen et al., 2019). In the psychomotor domain, the relationship between STEAM education and learning performances, such as excitement, manual control, skill, fitting situations, and creating improvement, has been examined in previous studies (Bassachs et al., 2020; Marín-Marín et al., 2021). In the affective domain, several previous studies adopted the technology acceptance model (TAM) to explain the attitude toward continuous learning intention (Haji et al., 2017; Huang & Liu, 2021; Wu & Chen, 2017), and motivations for STEAM education (Conradty & Bogner, 2020). Thus, considering technology usage in enhancing self-directed learning (Curran et al., 2019), learning motivation (Dunn et al., 2019), and skill improvement (Radhamani et al., 2021), more theoretical and empirical research is essential to discover the influence of the ARCS (attention, relevance, confidence, and satisfaction) motivation model (Keller, 2009). Technology usage in STEAM education also has the benefits of decreasing cognitive load (mental load and mental effort) and improving students’ learning intentions (Cheng, 2017; Costley & Lange, 2017).
In addition, previous educational studies have provided evidence of the benefits of STEAM education in student learning (Gao et al., 2020), design thinking (Lin, Chai, et al., 2021; Lin, Wu, et al., 2021), and professional development (Shernoff et al., 2017). However, artificial intelligence (AI) application and needs represent the increasing trend of education because it advances the learners’ capabilities of learning analytics, which may increase their workplace competitiveness (Zawacki-Richter et al., 2019). However, the integration of the above TAM concepts and AI application functions in the education process has not been well examined (Gülhan & Şahin, 2018).
Bloom (1956) proposed a taxonomy of learning domains that identified three domains of educational activities: the cognitive, affective, and psychomotor domains. Recently, Bloom's taxonomy concepts have been widely used in many education studies, such as those applied in science and technology courses, measuring learning outcomes (Zorluoglu et al., 2019), social studies curriculum (Koc et al., 2020), and estimating the objects in information technology and software course curricula (Ocak et al., 2020). In other words, Bloom’s taxonomy is a useful guide to help educators develop curricula. The three critical attributes are as follows: first, the cognitive domain focuses on mental skills that involve the knowledge and development of intellectual skills (Bloom, 1956). The affective domain concerns growth in feelings or emotional status, such as attitude or motivation (Krathwohl et al., 1973). The psychomotor domain is related to physical skills (Simpson, 1972). Accordingly, based on Bloom’s taxonomy (1956), the learner learns new knowledge (cognitive domain), attitudes (affective domain), and skills (psychomotor) in a learning activity.
This paper proposes a STEAM learning cycle that reveals four phases (cognitive, psychomotor, and affective domains, and continuous learning intention) for successful STEAM learning.
In the first phase, a learner starts to learn knowledge (cognitive domain), and the high/low level of cognitive load will affect the learner’s outcome of implementation of steam activity in the next psychomotor domain phase (Fig. 1). First, from the cognitive domain viewpoint, cognitive development can be seen as the resource allocation of the knowledge development process (Lu et al., 2020; Yafie et al., 2020). In the second phase (psychomotor domain), a heavy cognitive load may negatively affect learning performance because individuals cannot handle the complexity and the infinity of the abundant information at once as an input (Kozlovskiy et al., 2021). In the third phase (affective domain), the successful implementation experience of STEAM activity in the second phase would increase the positive attitude and enhance the motivation towards continuous learning intention in the fourth phase. Continuous learning intention refers to the learners’ willingness to engage or attend STEAM activity in the future. The definition of continuance intention is derived from a previous study (Dai et al., 2020) that denotes the intention of students to continue learning STEAM after the teaching activity. The same idea has been adopted in learning intention assessment of AI-enabled application (Fu et al., 2020) and MOOC (Dai et al., 2020). In the fourth phase, a high level of STEAM continuous learning intention motivates the learner to start the next phase in the STEAM learning cycle. The successful implementation of STEAM activity positively triggers the learners’ affective domains, such as attitude and motivation toward continuous learning intention in the future.
Previous STEAM studies focus on the relationship between Bloom’s cognitive domain (such as six layers of cognitive domain) and learning performance. Most STEAM studies have focused on developing engineering design thinking, teachers’ perceptions (Margot and Kettler 2019), and the cognitive domain applied in learning performance (Fletcher, 2018; Gao et al., 2020). However, few studies have integrated affective factors in the affective domain and examined how to apply them in STEAM education. Affective domain assessment for STEAM is one of the most important assessments for STEM education (Gao et al., 2020). A previous study investigated attitudes, beliefs, motivation, and interest towards the intention of disciplines in STEM. The well-designed STEM activity not only increased students’ knowledge bust, but also their affective intention for STEM (Apedoe et al., 2008).
The STEAM learning activity’s emphasis on learning-by-doing usually requires learners to finish a specific task that takes a longer time to assimilate new things learned and apply them to daily life practices (Gao et al., 2020; Wahono et al., 2020). Therefore, affective factors such as attitude or motivation for enhancing learners’ patience to successfully complete learning tasks need to be clarified. In the psychomotor domain, learning objectives focus on behavioral changes and skill development. Skills denote the ability to physically manipulate or instruments to complete a specific task. We believe that the assessment of the psychomotor domain, such as implementing STEAM activity, also plays a critical role in continuous learning intention in STEAM education. Thus, this study proposes a comprehensive research framework that integrates Bloom’s (1956) taxonomy: cognitive domain (cognitive load), affective domain (attitude and motivation), and psychomotor domain (implementation of STEAM activity) to explore the relationship between these learning domains and learning intention. We adopted cognitive load factors from cognitive load theory to the cognitive domain, attitude factors (perceived attitude and learning intention) from TAM and motivation factors from Keller’s (1983) ARCS theory to the affective domain, and implemented micro:bit with AI learning activity for skill training assessment in the psychomotor domain to develop a comprehensive assessment framework for STEAM learning intention. The research framework is illustrated in Fig. 2. Micro:bit is an embedded system based on the Advanced RISC Machine (ARM) architecture, designed by the British Broadcasting Corporation (BBC) for use in computer education in the UK (https://en.wikipedia.org/wiki/Micro_Bit).
Previous studies have considered the factors of active online interaction and collaboration to improve students’ learning performance in STEM education (Barrett et al., 2020; Granić & Marangunić, 2019; Huang & Liu, 2021). However, several gaps in the existing literature need to be addressed. First, the critical factors influencing students’ learning intentions and attitudes toward STEAM education are unclear. Second, only a few education studies have examined the multi-perspectives that include cognitive, affective, and psychomotor domains affecting the attitude and learning intention toward STEAM education. With the increasing attention in STEAM education development and application, these unsolved issues have become critically important and need to be addressed further. Therefore, this study introduces a new theoretical model (Fig. 2) that integrates the above-mentioned multi-learning domains to explain how and why these factors affect STEAM learners’ learning intention in order to address these research gaps. Therefore, this study aims to explore the latent factors that can enhance STEAM continuous learning intention. These not only contribute to the research on learning motivation factors of learners, but also improve the application of TAM, cognitive load theory, and ARCS theory in STEAM education. Furthermore, the moderation effect analysis allows this study to provide new insights for STEAM educators in evaluating and improving teaching activities.
The TAM theory was proposed to explore the behavior of user acceptance of information service systems based on the social psychology perspective (Mu & Jong, 2018; Zhang et al., 2019). Davis’s TAM proposes that perceived usefulness effects significantly influence users’ attitudes and behavioral intentions (Davis, 1989). The TAM theory, one of the most popular and important theoretical models regarding technology acceptance, provides a fundamental background for understanding individuals’ perception of specific technology acceptance behavior of intention, such as massive open online courses’ (MOOCs) continuance intention (Wu & Chen, 2017). Considering the adoption of TAM in Web 2.0 and technologies in education, students’ and teachers’ perceived usefulness of the technologies had a positive impact on their attitudes toward the intention of using Web 2.0. However, contrary to the original TAM, in a later TAM, perceived ease of use had no significant influence on perceived usefulness (Gyamfi, 2017).
The TAM has been adopted in STEM education studies to explore the effects of perceived usefulness, ease of use, and fun as predictors of behavioral intention and perceived attitude (Mutambara & Bayaga, 2021; Shiau et al., 2018). The TAM combined with innovation diffusion theory (IDT) has been applied to examine the innovation diffusion of OpenStreetMap in STEM education. The results suggested that STEM students’ perception of the usefulness of technology and their perceived attitude toward it leads to their intention to continue using the technology (Shiau et al., 2018). In STEM education in rural areas, the relationship between perceived usefulness and attitude is a critical factor in determining the acceptance of action learning (Mutambara & Bayaga, 2021). Davis (1989) showed that perceived ease of use affects attitude because if users find the system difficult to use, it creates user barriers and affects users’ behavioral intentions and attitudes. Additionally, the relationship between the perceived usefulness of technology and intention to use was investigated by studying highly immersive virtual reality systems. However, the research results showed that the perceived usefulness of the system has a weak influence on the intention to use the system (Quaid et al., 2020). Perceived usefulness and attitude are critical for MOOCs’ continuance intention; however, it was found that perceived ease of use does not influence attitude (Wu & Chen, 2017). Therefore, we created a second-order construct, perceived usability, that combined the three major constructs of TAM—perceived usefulness, perceived ease of use, and perceived enjoyment—to explore the relationship between perceived usability, attitude, and intention. Thus, the following hypotheses were proposed:
Perceived usability has a positive and significant effect on attitude.
Attitude has a positive and significant effect on intention.
Perceived usability has a positive and significant effect on intention.
Cognitive load theory was first proposed by a cognitive psychologist based on empirical research on short-term memory ability (Sweller et al., 1998b). Cognitive load has been widely applied in education research since Sweller and colleagues (Sweller et al., 1998b) applied cognitive load to the field of teaching (Chen & Huang, 2020). Cognitive load consists of two constructs: mental load and mental effort. The higher the perception of learners’ mental load, mental effort, or task difficulty, the higher the perceived cognitive load for the learning process (Paas, 1992).
The relationship between cognitive load and learning performance has been examined in several previous studies (Chen & Huang, 2020; Liu et al., 2021). Regarding the effect of STEAM-based mobile learning on learning achievement and cognitive load, the research results showed that the learning effectiveness of the experimental group (game-based learning system) was superior to that of the control group, and that the experimental group (game-based system) generated a lower cognitive load than that of the control group (transportation vehicles) (Chen & Huang, 2020). Regarding the effect of cognitive load on learning with augmented reality (AR), learning with 3D technology, and traditional learning, the research results found that the AR group performed better than the 3D and traditional groups in their knowledge improvement, and the AR group students had the lowest cognitive load among the three groups. These results suggest that integrating AR in experiments that help students construct knowledge by providing a virtual–real fusion environment significantly reduces the cognitive capacity that students need to allocate to deal with learning tasks (Liu et al., 2021). Thus, most of the studies that focus on cognitive load theory examine the difference between the experimental and control groups through t-tests, and only a few studies directly explore the connection between cognitive load and STEAM learning intentions.
Additionally, a previous study aimed to identify the factors affecting higher education students’ behavioral intention toward learning management systems via the TAM, including perceived usefulness and perceived ease of use, and external factors, including self-efficacy, enjoyment, subjective norms, satisfaction, interactivity, and control. The research results confirmed that the relationships between the influencing factors provided insight into students’ behavioral intentions toward the use of learning systems (Findik-Coşkunçay et al., 2018). Therefore, based on the above-mentioned studies, we believe that cognitive load is negatively correlated with learning performance and intention. Additionally, learning intention is positively affected by perceived usefulness, perceived ease of use, and perceived enjoyment. Cognitive load plays a critical role in augmented reality (AR) continuous learning intention. A previous study showed that less cognitive load, stronger motivation, and more positive attitudes towards learning intention in AR (Cheng, 2017). High-quality instructional design enhances the level of germane cognitive load and continuous learning intention (Costley & Lange, 2017). A previous study examined the relationship between perceived cognitive load, motivation, attitudes, perceived usefulness, and learning intention in AR learning. Motivation factors mediated the relationship between learners’ cognitive load and learning intention (Cheng, 2017). Thus, the following hypothesis was proposed to examine the connection between cognitive load and STEAM learning intention:
Cognitive load has a negative and significant effect on perceived usability.
The ARCS model was developed by John Keller to provide an instructional model to explain how to motivate learners and ensure the continuity of motivation during the teaching activity (Keller, 1983). This model has been widely applied in evaluating the motivation of e-learning and digital teaching material design areas in recent decades (Karakış et al., 2016). The ARCS model includes four components: attention, relevance, confidence, and satisfaction (Keller, 1983). Students’ attention can be attracted in two ways: (1) perceptual arousal: using amazing or remarkable points of interest to attract students’ interest, and (2) inquiry arousal: stimulating students’ curiosity by posing challenging questions or problems to be solved (Keller, 2009). Relevance aims to establish relevance regarding the target knowledge in order to increase learners’ motivation. Confidence describes the relationship between learners’ expectations of success and confidence levels during the learning process. Confidence helps learners understand their likelihood of successful learning and helps them avoid feeling that they cannot finish the learning objectives. Satisfaction aims at learning to be rewarding or satisfying, as a form of achievement. Learners should be satisfied with what they achieve during their learning activities (Keller, 2009). The ARCS theory argues that learners’ motivation can be increased if the teaching material satisfies the above-mentioned four components.
The ARCS theory has proven to be an effective tool for enhancing learner motivation and performance (Jason Bond Huett, 2006). The ARCS motivation model was used to investigate the effects of computer-assisted instructional materials designed for the ASSURE model (an instructional system) on students’ performance and attitudes in mathematics classes. The research results showed that computer-assisted instructional materials have a positive impact on students’ attitudes toward computer-assisted instruction and enhance their academic achievement (Karakış et al., 2016). Keller’s (1983) ARCS model was used to examine the effects of the four components on students’ attitudes toward the use of gamification for competency development in higher education in Spain. The study revealed that perceived attention, perceived relevance, and perceived confidence directly and positively influence students’ attitudes toward using online educational video games to develop competencies (Galbis-Córdoba et al., 2017). A previous study adopted the ARCS model to examine the influence of the gamified learning approach on science learning, achievement, and motivation by using a context-aware mobile learning environment. The ARCS model explains and verifies the effects of the four components on students’ motivation and learning achievement (Su & Cheng, 2015). For the problem-based learning (PBL) method, the ARCS model has been used to explore the relationship between learning motivation and entrepreneurial attitudes by focusing on the impact of the PBL method on the learning motivation of entrepreneurial attitudes (Munawaroh, 2020). Thus, the following hypotheses were proposed:
ARCS has a positive and significant effect on attitude.
Affective domain assessment for STEAM is one of the most popular assessments for STEM education (Gao et al., 2020). A previous study investigated attitudes, beliefs, motivation, and interest towards the intention of disciplines in STEM. The well-designed STEM activity not only increased students’ knowledge, but also increased their affective intention in STEM (Apedoe et al., 2008). The STEM program activities can help students increase their intention and factor in the ARCS model, such as confidence, to improve STEM knowledge and skills. The students’ confidence in success in STEM strengthened the effects of perceived usability and attitude (Musavi et al., 2018). The ARCS motivation model reveals the key motivation factors adopted to explain the relationship between learners’ perceived usability and improvement of learning attitudes (Chang et al., 2019). Thus, the following hypotheses of moderation effects are proposed:
Perceived usability positively moderates the relationship between attitude and intention.
ARCS positively moderates the relationship between perceived usability and attitude.
This study proposed a conceptual research framework that includes three second-order factors derived from TAM (perceived usefulness, perceived ease of use, and perceived enjoyment), ARCS (attention, relevance, confidence, satisfaction), and cognitive load (mental load and mental effort) to explain the continuous learning intention of STEAM education. The proposed conceptual research framework is illustrated in Fig. 3 to address the research objectives.
In this study, elementary and university students were recruited in the classroom after their learning activities. The participants voluntarily participated in the questionnaire survey. Similar participant selection and statistical methods were adopted in a previous study (Mutambara & Bayaga, 2021). A non-probability voluntary response self-selection sampling method was adopted to recruit students following the sampling procedure in a previous empirical study of undergraduate students (Barrett et al., 2021). The present study used two STEAM teaching activities to collect survey data. The data collection period was from February to May 2021, and 145 questionnaire responses were collected, yielding 141 valid responses. Participation in the questionnaire survey was voluntary (84 undergraduate students and 57 elementary students), and the participants completed the questionnaire after STEAM teaching activities.
We developed STEAM learning materials for elementary and college students that suited their level, although the experimental equipment used was the same. Since the goal of this study was to investigate participants’ continuous learning intention and not the effectiveness of their learning, to collect more samples and encourage more students to participate, we invited these two groups of students to verify our research model. The learning materials used in the study were micro bit and AI neural network programming, which has never been taught to elementary school or college students. The learning activity was designed to be more difficult for college students than for elementary school students. Primarily, the learning materials and activities were designed keeping in mind the difficulty that college students and elementary school students could accept.
We conducted two similar STEAM activities and used the same questionnaire to collect survey data after the STEAM activities in the university and elementary school. The two versions of STEAM activities have the same learning topic with different learning materials: a difficult one for college students and an easier one for elementary students. The participants voluntarily participated in the questionnaire survey. University student participants were 20–24 years old and the elementary school student participants were at the K5–K6 level. Participants from the K5–K6 level were selected because their knowledge level fits the teaching of AI-based knowledge for the syllabus in elementary school. We conducted STEAM learning activities on undergraduate and elementary students because we hoped our research results could have better interpretive results that would be suitable for university and elementary students. The instructions were the same for both the elementary and university students.
This study integrates three major theories—TAM, cognitive load theory, and ARCS theory—into the proposed STEAM research framework. The research framework consists of 11 constructs that include the learning intention of STEAM as the main construct and a second-order construct. The first part of the main construct was derived from TAM, which included perceived usefulness, perceived ease of use, perceived enjoyment, attitude, and intention. This study created a second-order construct, namely perceived usability, which includes three constructs (perceived usefulness, perceived ease of use, and perceived enjoyment) derived from TAM (Davis, 1989; Davis et al., 1989; Kanchanatanee et al., 2014; Teo, 2009; Weng et al., 2018). The cognitive load theory construct is divided into two sub-constructs: mental effort and mental load (Chen & Huang, 2020). The ARCS theory construct consists of four sub-constructs: attention, relevance, confidence, and satisfaction (SAT) (Karakış et al., 2016; Keller, 1983, 2009; Lin, Chai, et al., 2021). The model constructs, definitions, and references are listed in Table 1.
The experimental procedure was conducted over two weeks and organized into the following two procedural stages:
(1) Orientation and teaching
The development of the teaching activities in this study followed the 6E model, wherein the teaching objectives, STEAM knowledge content, and AI concepts were considered. In this model, the teacher plays the role of a guide, while the students are guided by the teacher or the teaching students on how to complete the tasks and produce the learning outcomes at each stage. The teacher taught students how to finish an AI-based STEAM game. The students must have the ability to design their own AI-based STEAM game by retraining the neural network with their own photos.
(2) Data collection instrument
Participants were asked to complete an online questionnaire designed by the authors of this study. Researchers were available on site to resolve any query of the participants regarding the questionnaire items.
The questionnaire used in this study included items from the following scales: TAM scale, cognitive load, and ARCS scale. The TAM scale elements used in this study were derived from the scale developed by (Mutambara & Bayaga, 2021), including three major concepts: perceived usefulness, perceived ease of use, and perceived enjoyment. The cognitive load scale, which includes mental load and mental effort, was developed by (Chen & Huang, 2020; Hwang et al., 2013) based on the concepts of cognitive load proposed by Sweller and colleagues (Sweller, 1988; Sweller et al., 1998a). The ARCS scale, which includes items measuring attention, relevance, confidence, and satisfaction of respondents, was developed by (Li et al., 2018) based on Keller’s proposed ARCS theory (Keller, 1983, 2009). Thus, an instrument consisting of 24 items (TAM scale), 8 items (cognitive load scale), and 20 items (ARCS scale) rated on a 7-point Likert scale ranging from 1 (“strongly disagree”) to 7 (“strongly agree”) was proposed in this study. Detailed information on each item is presented in Appendix A. The data were imported into the PLS-SEM software to calculate reliability, validity, and structural model estimation. PLS-SEM has been used in education assessment (Olmedo Moreno et al., 2014) and STEM education (Badri et al., 2016; Shiau et al., 2018).
This study adopted confirmatory factor analysis (CFA) to assess the measurement model in terms of convergent validity and reliability (Findik-Coşkunçay et al., 2018). Table 2 summarizes the mean, standard deviation, standardized factor loadings, Cronbach’s alpha, composite reliability (CR), rho_A, average variance extracted (AVE), and variance inflation factor (VIF). All factor loadings were above 0.60 and at a significance level of p < 0.001, which revealed convergent validity (Liu, 2020). Each observed variable must have a factor loading > 0.7 to provide adequate convergent validity (Hair et al., 2006). The Cronbach’s alpha coefficients for each construct were as follows: perceived usability (0.96), perceived usefulness (0.95), perceived ease of use (0.91), perceived enjoyment (0.90), attitude (0.93), intention (0.89), cognitive load theory (0.94), mental effort (0.90), mental load (0.88), ARCS (0.97), attention (0.93), relevance (0.89), confidence (0.93), and satisfaction (0.90). They all satisfied the criterion of alpha > 0.7 (Dörnyei & Taguchi, 2009). The CR values of all constructs were greater than the suggested minimum of 0.7, all rho_A values were greater than 0.9, and all AVE values were greater than 0.5. All constructs in the measurement model satisfied the reliability criterion, and rho_A values of three constructs (intention, mental load, and relevance) were slightly lower than 0.9. This study used VIF to examine whether multicollinearity existed. The results demonstrated that all VIF values were acceptable (VIF < 5), indicating that the study data had no serious multicollinearity (Galeazzo et al., 2021). Because the factor loadings of item 5 of relevance, and items 2 and 3 of satisfaction did not have adequate VIF values (< 5) on the related latent variables, these items were extracted from the model. Therefore, all values exceeded the minimum threshold, indicating that the constructs were explained (Hair et al., 2006, 2016).
Perceived usability has a positive and significant effect on attitude.
ARCS positively moderates the relationship between perceived usability and attitude.
Perceived usability has a positive and significant effect on intention.
Cognitive load has a negative and significant effect on perceived usability.
ARCS has a positive and significant effect on attitude.
Perceived usability positively moderates the relationship between attitude and intention.
ARCS positively moderates the relationship between perceived usability and attitude.
Perceived usability strengthens the positive relationship between attitude and intention. The relationship of “learning attitude → learning intention” is stronger when perceived usability is high; the relationship of “learning attitude → learning intention” is weaker when perceived usability is low. In other words, in the case of a high level of perceived usability, the intention of STEAM learning may be enhanced by a higher awareness of usability. Conversely, when learners’ awareness of usability is low, the effect of attitudinal enhancement of STEAM learning intention is lower. Therefore, teachers should consider how to design STEAM teaching materials to enhance students’ cognitive usability and attitudes, which in turn will enhance their learning intentions.
According to the results of the ARCS moderating effect (see Fig. 8), the degree of positive influence (slope) of “ARCS theory” on the relationship between perceived usability and attitude at different levels (high and low) is significantly different.
Perceived ARCS strengthens the positive relationship between perceived usability and attitude. When learners’ perceived ARCS values were high, the “perceived usability → attitude” relationship was stronger; when the perceived ARCS values were low, the “perceived usability → attitude” relationship was weaker. In other words, when learners perceive a high level of ARCS regarding STEAM materials, the “perceived usability → attitude” relationship may be enhanced by the higher ARCS. Conversely, when learners perceive a low level of ARCS, the effect of perceived usability on learning attitudes is lower. Therefore, teachers should focus on designing instruction and/or instructional materials for ARCS to solve the particular motivational problem to enhance learners’ perceived usability (Chang et al., 2019) and improve their learning attitudes.
The multi-group analysis allows us to test if our two types of student data groups have significant differences in their group-specific parameter estimates (e.g., outer weights, outer loadings and path coefficients) of our research structural model. The partial least squares multi-group analysis (PLS-MGA) method is a non-parametric significance test for the difference of group-specific results that builds on PLS-SEM bootstrapping results (Matthews, 2017). The PLS-GMA result showed that all hypotheses in our structural model have no significant difference between elementary student group and university group as shown in Table 7. Therefore, our research result can be interpreted as generalization for both elementary and university students.
Table 7 Multi-group analysis by PLS-MGA methodIn this study, perceived usability (perceived usefulness, perceived ease of use, and perceived enjoyment) strongly and positively dominated learning attitudes and learning intentions. Additionally, positive learning attitudes influence STEAM learning intentions (Barrett et al., 2021; Mutambara & Bayaga, 2021; Shiau et al., 2018). The research results confirmed the relationship in Davis’s TAM constructs (Davis, 1989; Davis et al., 1989) that were applied to explain the behavioral intention of STEAM education (Mutambara & Bayaga, 2021; Su, 2019). This may be because the higher the learners’ perceived usability regarding STEAM education, the stronger their attitude toward their learning intention, in line with Bloom’s (1956) affective domain argument (Krathwohl et al., 1973).
Surprisingly, this study found two significant moderating effects that were observed in only a few previous studies. Perceived usability moderated the relationship between learning attitudes and learning intentions. The moderation effect provides further information that a high level of perceived usability strongly enhances the attitude toward the intention of STEAM learning than that of a low level of perceived usability. ARCS motivation further strengthens the positive relationship between perceived usability and learning attitude. Additionally, the research results showed two mediation effects for STEAM learning attitude and learning intention.
A previous study stated that in a highly competitive education system, using SEM analysis is not only helpful in understanding both the consequences and sequences of learning performance, but also provides a boosted understanding of individual learning processes, which are simultaneously shown as a set of complex learning environments within individuals and a meaning of moderate or mediate effects (Horng et al., 2020; Sam Liu, 2017). The results show that cognitive load enables learners to easily understand and implement the STEAM task, which extends the findings of Weng et al. (2018), who found that cognitive load is driven by inherent complexity and deters valuable cognitive resources towards tasks irrelevant to learning.
The research results provide sufficient evidence to other educators in Asia, especially regarding the lack of student attention in the digital era, which disturbs students’ engagement with digital education. This study found that in ARCS and perceived usability, the influence of students’ learning attention was mediated by learning attitudes. A similar observation was made regarding ARCS; that is, ARCS positively significantly influenced perceived usability and strengthened its effects on learning attitudes. Our research results supported ARCS learning, which reflects several critical characteristics of STEAM, including cross-domain and hands-on learning, life application, problem solving, and sense learning, and applied such concepts to an AI-based task (Li et al., 2018). Thus, these findings should help educators recognize the importance of AI-based education and ‘playfulness’ in learning, and help them combine AI concepts with their teaching strategies to enhance students’ learning attitudes and explore learning opportunities. The findings of this study have various implications for helping students become familiar with micro:bit and AI-based learning that assists them in developing their abilities, skills, and beliefs to predict their future careers (Zhu et al., 2019). The potential theoretical and educational implications are explained in the following section.
This study makes several valuable contributions to the literature. First, while previous research on AI-based course design has been conducted in Western countries because of more advanced technology and widely accepted AI concepts, this has not been the case in Asian regions because of the lack of development in technology and economic support, most higher education institutions still remain in the transitional education phase (Adukaite et al., 2017). In the current education scenario, implementing AI concepts for education and gamified learning could not only encourage students’ participation and engagement, but also add value to the literature on education (Tan & Cheah, 2021). This is especially the case for research design in higher education institutions, where current research on TAM of STEAM instruction is sparse (Maskeliūnas et al., 2020), specifically affecting the benefits of digital learning. Second, this study provides new perspectives for demonstrating how to use AI and digital learning in formal educational environments that have limited technological infrastructure, but which could be interesting and enjoyable despite this limitation by adjusting students’ attitudes toward learning intention. Third, this study incorporated a modified integrated model of the mediation–moderation mechanism. In the mediation mechanism, learning attitudes acted as mediating variables. This mediating effect was examined using the bootstrapping technique, which extends the existing education literature (Loughlin-Presnal & Bierman, 2017). The most critical aspect of this study is the use of second-order factors derived from ARCS and the use of perceived usability as a moderating variable, which has not been used in previous digital learning and education studies.
Further, the mediated-moderation model provides more meaningful and insightful information for the education literature (Horng et al., 2020). Therefore, the modified integrated model used in this study makes a critical contribution to the digital learning education literature and provides a foundational reference for future studies, while adding value to the existing research.
Moreover, several educational implications of the study results were identified for educators. First, samples were collected from undergraduates and elementary students in Taiwan. It provides sufficient evidence to other educators in Asia, especially regarding the lack of student attention in the digital era that disturbs students’ engagement with digital education (Huang et al., 2006). To harness the positive impact of AI and implement gamification learning design to develop students’ intention for learning, educators need to educate students on how to use micro and AI learning tools to enhance their learning interest (Mutambara & Bayaga, 2021). Second, this study found that in ARCS and perceived usability, the influence of students’ learning attention was mediated by learning attitudes. Micro:bit and AI-based lessons may not only improve students’ attitudes to increase the effectiveness of ARCS motivational strategies, but also help improve students’ ability to work in an AI-empowered society in the future (Li & Moore, 2018). Third, the findings also provide insights into cognitive theory and extend the education design of micro- and AI-based curricula. The findings of this study have various implications, from helping students become familiar with micro- and AI-based learning that assists them in developing their abilities, skills, and beliefs to predicting their future careers (Zhu et al., 2019). In this study, cognitive load was negatively correlated with learning performance and intention. This result supports instructors’ efforts to guide students in navigating unfamiliar STEAM learning processes, as this unfamiliarity might contribute to learning pressure, consequently decreasing learning performance. Thus, in order to enhance students’ learning and decrease their cognitive load, educators should design motivation incentive mechanisms to attract students’ interest along with less cognitive load to enhance their learning achievement.
Despite the contributions of this study, several limitations remain to be addressed. First, due to time limitations and lack of sufficient course support, the present study included a sample of students from only one region of Taiwan. A previous study suggested that collected data from different regions provide meaningful and accurate predictions of student learning behavior (Horng et al., 2020). Thus, future research may extend the results of the present study by including students from different regions in Taiwan (e.g., South, North, Middle, and offshore islands of Taiwan). Second, the cultural background of the study was another concern. In the “Western” education system, teachers dedicate a significant amount of time and shoulder responsibilities to guide students to include self-determination in their learning, which is different than the “Eastern” education system (Koul & Fisher, 2005). Thus, future studies may collect samples from different cultural backgrounds and provide a comparative study to extend the findings of this study. Third, the long-standing unsolved problem of AI-based education in STEM studies and employability needs to be considered with other possible variables to examine the hypotheses in future studies (Chu et al., 2019).
STEAM (STEM+Sanat) etkinliklerinin 7. sınıf öğrencilerinin akademik başarı, STEAM tutum ve bilimsel yaratıcılıklarına etkisi. Journal of Human Sciences, 15(3), 1675–1699. https://j-humansciences.com/ojs/index.php/IJHS/article/view/5430
The authors would like to thank the Ministry of Science and Technology, Taiwan, for financial support (MOST 108-2511-H-142-007-MY2; MOST 110-2511-H-142 -008 -MY2; 110-2511-H-006-012-MY3).
