Produced with Scholar

EDS: General Field Literature Review

Project Overview

Project Description

This 5,000-7,000 word literature review will eventually be submitted for your general field examination and will be refined to become a part of a chapter in your dissertation. You will create another part of this chapter in the "special field examination," coming up as course/step 2, so be sure that your literature review covers the broad shape of the field, not the specialized area you will be addressing in your dissertation work.

The literature review should not merely be descriptive—it should be analytical and critical, supported by the literature. What theories are associated with this general field?  What are the main issues arising in this general field? What are the main challenges to be addressed? What are the questions being asked by the intellectual and practical leaders in the field? What are the findings?  What are the absences or gaps in our knowledge? What work needs to be done?

Icon for Instructional Design Best Practices and Guidelines in Online Higher Education Courses

Instructional Design Best Practices and Guidelines in Online Higher Education Courses

Word Version

Jessie_Mundo_Special_Field_Instructional_Design_20240319.docx

 

Note to Reviewers and Change Notes

3/19/24

I have made the following revisions:

General Field

  1. Renamed the general field
  2. Revised the introduction to include the elements for further review that are explored in the special field literature review
  3. Expanded the section focused on the history of instructional design

Special Field

  1. Revised the introduction to provide more clarity on the focus of my special field review and connected it to the general field literature review
  2. Moved the short section focused on the history of instructional design to the general field review
  3. Added a subsection on Course Design Evaluation under Online Course Design Best Practices
  4. Revised my introduction to the theory, trying to show a connection between instructional design and the theories explored
  5. Provided more context for the studies mentioned in the literature review
  6. Revised the gaps and conclusion sections
  7. Corrected the APA formatting of the references in CG Scholar

2/27/24

I added my special field to Scholar and I attached the updated Word Document.

12/5/23

I have made the following revisions to the general field literature review based on the thorough feedback I received from Dr. Francis on 10/30/23.

  • Changed the focus of the review from instructional design best practices and guidelines in online higher education courses to instructional design in online higher education courses
  • Added a section focused on the history of online learning in higher education with a subsection on the effects of COVID 19 on online learning in higher education
  • Expanded the area focused on instructional design
  • Removed the best practices section (focusing on this in the special field review)
  • Restructured the learning theories section to focus on theories associated with online learning
  • Added context for studies cited in the review and expanded on the methodologies the applied
  • Removed acronyms

10/18/23

For this revision, my primary focus was on improving my writing in the voice of the literature throughout the paper. I also focused on correcting the following elements:

  • Chapter-based numbering of tables and figures
  • Implemented more evidence-based verbs
  • Tried to reduce generalizations and added context for studies when first introducing them 
  • Revised APA in-text citations, especially narrative citations when the source has already been introduced in that paragraph
  • Replaced secondary sources where I was able to access the primary source

Title Page [PLACEHOLDER]

INSTRUCTIONAL DESIGN IN ONLINE HIGHER EDUCATION COURSES

 

BY

JESSIE LYANNE MUNDO GONZÁLEZ

 

DISSERTATION

Submitted in partial fulfillment of the requirements

for the degree of Doctor of Education in Education Policy, Organization & Leadership

in the Graduate College of the

University of Illinois Urbana-Champaign, [year of conferral]

 

Urbana, Illinois

 

 

 

Doctoral Committee:

Add one member per line

Professor William Cope, Chair

Professor Mary Kalantzis,

 

Abstract [PLACEHOLDER]

Table of Contents [PLACEHOLDER]

Chapter 1: Introduction

Chapter 2: Literature Review

Part 1: General Field: Instructional Design in Online Higher Education Courses

This literature review explores online course design in the higher education setting. It analyzes online learning in higher education, online learning theories, and instructional design in higher education. The question this literature review attempts to answer is, how is instructional design implemented in online courses in higher education programs? A review of literature showed that there is an increased focus surrounding the development and implementation of online course design guidelines by instructional designers and surrounding the evaluation of online courses. The review found that the field of online course design is rapidly evolving, with individuals and organizations developing their own set of guidelines and best practices. The review identified that the implementation of online course design guidelines in higher education programs by instructional designers can be inconsistent. The special field literature review explores the roles and responsibilities of instructional designers and their perceived best practices in the field of instructional design.

Introduction

This literature review explores online course design in the higher education setting. It analyzes online learning in higher education, online learning theories, and instructional design in higher education. The question this literature review attempts to answer is, how is instructional design implemented in online courses in higher education programs? A review of literature showed that there is an increased focus surrounding the development and implementation of online course design guidelines by instructional designers and surrounding the evaluation of online courses. The review found that the field of online course design is rapidly evolving, with individuals and organizations developing their own set of guidelines and best practices. The review identified that the implementation of online course design guidelines in higher education programs by instructional designers can be inconsistent. The special field literature review explores the roles and responsibilities of instructional designers and their perceived best practices in the field of instructional design.

Online Programs in Higher Education

A review of the literature on online learning in higher education programs by Lewis (2021) found that providing online course offerings has become a standard across higher education. According to EducationUSA (2022), there are close to 4,000 accredited higher education institutions in the United States, and a study by Gallagher and Palmer (2020) focused on an analysis of online course offerings in higher education institutions found that 2,500 institutions were offering online programs. Lewis identified the quality of online courses as a contributing factor of online student retention. Meanwhile, Ossiannilsson et al. (2015) evaluated over 40 quality standards models for online education and determined that there are many models for quality assurance that higher education institutions can adopt to meet their needs. Furthermore, through the development and validation of an online course design elements (OCDE) instrument, Martin et al. (2021) determined that the intentional design and structure of an online course has an impact on student learning and engagement. Similarly, Conceição (2021) analyzed online learning design focused on the user experience of adult learners and found that the design and accessibility of the online courses has implications for educators, instructional designers, and learners.

Effects of COVID-19 on Higher Education Online Programs

The literature reviewed explored the effects of the COVID-19 on higher education online programs. Ossiannilsson et al. (2015) conducted a global review of quality models in online education which revealed that before the COVID-19 pandemic, it was expected that by the year 2030 an estimated 414.2 million students would be in higher education programs or courses around the world, due in part to the accessibility of online education. Lewis (2021) evaluated the challenges in online higher education academic programs which concluded that many of the students estimated to enroll in online higher education programs were expected to be adult learners due to their life responsibilities. However, a study by UNESCO et al. (2021) with data from 143 countries focusing on education amid the COVID-19 pandemic revealed that 94% of countries had implemented some type of remote learning modality as a direct response to the COVID-19 pandemic, expediting the move to remote learning. Further research by Kucuk-Avci et al. (2022) on the effects of the COVID-19 pandemic on remote higher education argued that the shift to remote learning as a result of the COVID-19 pandemic was emergency remote teaching which is not the same as intentional distance or online education. Through a bibliometric analysis of the emerging research, they determined that online learning experienced a 60% growth in higher education after the pandemic. Kucuk-Avci et al. identified the purpose of emergency remote teaching as an effort to minimize physical space as opposed to online education where the focus is on minimizing psychological space while facilitating teaching and learning. Likewise, after conducting an evaluation on the differences between emergency remote learning and online teaching, Hodges et al., (2020) identified the goal of emergency remote teaching as a means of providing short-term access to instructional resources. They found evidence that effective online instruction needs to be planned and requires the development of an ecosystem for community building and providing learner support.

Adult Learners

A systematic review of the literature on adult learning in online spaces by Abedini et al. (2021) showed increased educational opportunities for adult learners due to advancements in the digital era. Abedini et al. define adult learning as a knowledge making process that happens as a response to the experiences that an individual has been exposed to, thus making it a lifelong learning phenomenon. The literature reviewed discussed the differences in characteristics between child and adult learners and the theories that explain adult learning in a formal education setting. Amponsah (2020) conducted a qualitative case study with 21 adult students (between the ages of 27 and 54) to evaluate the learning styles of adult learners in higher education and concluded that the different learning styles of adult learners impacts their outcomes in online educational environments. Likewise, Williamson and Stevenson (2022) analyzed adult learning principles and determined that there are differences in the characteristics of adult learners. In addition, Abedini et al. led a comprehensive review of the literature on adult learning and adult learners in online learning communities and concluded that adult learners are self-directed and intrinsically motivated when learning life-relevant skills. Furthermore, considering the characteristics and needs of adult learners, Hajdu et al. (2022) analyzed the motivators of 27 adult learners through a motivated strategies for learning questionnaire. They proposed that an understanding of the factors that drive adult learners is essential for successful adult education programs.

The literature reviewed on adult learning theories showed an increased focus on andragogy as a prominent and influential adult learning theory. In 1978, Malcolm Knowles proposed andragogy as a learning theory to explain the needs of adult learners (Amponsah, 2020). Knowles (1980) proposed four basic principles for andragogy to define the adult learner:

  1. Self-concept: adult learners are independent and self-directed
  2. Experience-centered: adult experiences are fundamental for the construction of knowledge
  3. Professional outcome: adult learners are driven by the purpose of the educational experience
  4. Problem-centered: adult learners want to acquire practical and applicable skills

Knowles subsequently added a fifth principle, self-motivation, and expanding on adult learning theory (Abedini et al., 2021), Merriam (2008) synthesized consequent research on adult learners and proposed the inclusion of an additional assumption of the adult learner: goal-orientedness.

Although Knowles’s work was crucial in the conceptualization of adult learning, the literature reviewed discussed the opportunities afforded by andragogy as well as its limitations. For example, Merriam and Caffarella (1999) analyzed different models of adult learning and outlined andragogy’s scrutiny by researchers including the question of whether or not it qualifies as a theory and if so, is it a learning theory or a teaching theory. They also found that researchers strongly critique the isolated nature of the learner in andragogy, calling for awareness of their sociohistorical context. Similarly, Abedini et al.’s (2021) review of the literature on adult learning emphasized how andragogy does not account for the collaborative factors that might influence adult learners nor does it focus on learning itself, rather it focuses on the characteristics of the learners. Furthermore, Amponsah (2020) studied adult learning styles and proposed that they be accounted for in adult learning theories in addition to learner characteristics. Consequently, Williamson and Stevenson (2022) evaluated adult learning principles through an online boot camp course with nearly 300 participants which led to their critique of andragogy as having a restrictive focus on the learner and recommended that it expand to consider the implications of student-teacher interactions in their learning.

As previously stated, Abedini et al. (2021) and Williamson and Stevenson (2022) concluded that self-directed learning is a significant factor that drives adult learning in the online environment; however, research by Amponsah (2020) on adult learners in higher education suggests that adult learners have many different characteristics that should be accounted for in the design of online courses including problem-solving, curiosity, cautious observation, logical reasoning, and analytical traits. Amponsah and Abedini et al. recognize that with an increased accessibility to higher education in an online format, it is important to understand how adult learners navigate those courses and determine if change or an adaptation to the frameworks and theories is needed to make learning more accessible and suited for the learners. Henschke (2011) explored emerging research in the field and suggested that andragogy should evolve from Knowles’s original proposition, while proposing that analyses of adult learning should incorporate other adult learning theories.

Learning Theories and Frameworks

Siemens (2004) conducted a review of learning theories for the digital age in the beginning of the 21st Century which Samuel and Conceição (2022) expanded on, and both of their research determined that it is a general consensus among researchers that the best practices, guidelines, and approaches used by individuals, agencies, or institutions follow instructional design frameworks and those frameworks are modeled after or influenced by learning theories. Bélanger (2011) reviewed the literature on adult learning and learning theories and proposed that a factor impacting theorists when conceptualizing how learning is defined is the theoretical alignment of the researcher and the theoretical framework used in the study. Ertmer and Newby (2013) expanded on that notion by comparing key features of cognitivism, behaviorism, and constructivism and proposing that the cognitive processing requirements of the learner be considered before a learning theory and its associated instructional strategies are selected.

Further research by Picciano (2017) sought to develop an integrated model for online education based on existing theories and frameworks and concluded that most learning theories derive from behaviorism, cognitivism, and social constructivism. Schofield (2019) further contributed to this notion through an analysis of diverse theoretical positions on learning where it was determined that an individual’s approach towards the learning process is highly dependent on their theoretical position. Siemens analyzed the role of learning theories in the digital age and observed that online learning was categorized as a subset of learning in general. However, Siemens also identified the need for a new theory related to online learning. Anderson (2011) argued against the need for a new theory, suggesting instead an integrated theories approach towards online learning and development.

Formal, Non-Formal, and Informal Learning

In addition to the varying definitions for learning informed by the different theoretical frameworks as referenced previously, the literature reviewed discussed two types of learning: formal and informal. While conducting a study to validate non-formal and informal learning in higher education, Souto-Otero (2021) reviewed the literature on the different types of learning and established that formal learning is by design and occurs through education, which is composed of learning communities, a curriculum, and pedagogy. Furthermore, the literature reviewed showed agreement in the definition of formal learning. Carraro and Trinder (2021) explored language learner’s perceptions of online formal learning environments and adopted Stevens’s definition where formal learning is connected to a learning institution and course outcomes. Chatterjee and Parra (2022) examined formal and informal learning through a qualitative case study in a technology course and defined formal learning as goal oriented and structured with the objective of earning a grade. Similarly, through a study that explored learning motivation of adult learners, Hajdu et al., (2022) defined formal learning as a structured process conducive to some type of qualification. Likewise, Souto-Otero conducted a validation analysis of the different types of learning and established formal learning as intentional and a process aligned with defined learning objectives leading to a certification or degree. However, through an assessment of the characteristics of formal, informal, and non-formal learning, Johnson and Majewska (2022) acknowledged the disadvantage of formal education in its inability to accurately capture and describe what is happening in the learning environment or how the curriculum is being implemented by educators and received by learners.

In contrast, a review of the literature by Carraro and Trinder (2021) led to their determination that informal learning takes place outside of the structured learning activities that are planned for in the context of education, and students are not intentionally engaging with it. Research conducted by Chatterjee and Parra (2022) examining formal and informal learning through a qualitative case study in a technology course established the definition of informal learning as implicit and unplanned. Similarly, Souto-Otero (2021) defined informal learning as unintentional from the learner’s point of view, taking place anywhere at any moment throughout their daily life activities, and not structured around predetermined learning objectives. However, Johnson and Majewska (2022), through an evaluation of the characteristics of formal, informal, and non-formal learning, added to that definition that informal learning is context dependent and they raised doubts regarding its effectiveness for the acquisition of conceptual content. They discussed the implications of not having a set curriculum, claiming that it can lead to suboptimal learning outcomes in students.

Additionally, the literature reviewed discussed the emergence of a third form of learning emerging in literature, non-formal learning. Johnson and Majewska (2022) defined non-formal learning as a type of learning that results from the interaction of elements of formal and informal learning. Likewise, Souto-Otero (2021) defined non-formal learning as integrated in planned learning activities but not planned for in the learning outcomes, however they described it as intentional for the learner. The European Centre for the Development of Vocational Training (Cedefop) defines this type of learning as intentional from the student’s perspective but going outside the bounds of the planned learning activities of educational institutions (Souto-Otero, 2021). However, the literature reviewed determined that non-formal and informal learning are ubiquitous and more conducive to lifelong learning (Abedini et al., 2021; Carraro & Trinder, 2021; Hajdu et al., 2022). Johnson and Majewska developed a model illustrating the relationship between learning, education, and the curriculum and identifying where formal, non-formal, and informal learning fall between them (see Figure 2.1 below). For the purpose of this literature review, we focus on adult learning and learning theories in a formal higher education setting.

Figure 2.1

Formal, Informal, and Non-Formal Learning Model

Formal, Informal, and Non-Formal Learning Model. Johnson and Majewska (2022)

 

Theories Associated with Online Learning

In the literature reviewed on learning theories, the discussion focused on three theories: behaviorism, cognitivism, and constructivism. In addition, through a synthesis of learning theories, Schofield (2019) identified and discussed nativism as an important learning theory. Schofield’s review of the literature synthesized nativism as a theory that proposes that learning is an innate phenomenon in human beings and intelligence is biologically predetermined. Yet, Schofield argued that nativism rejects the effects that context and the environment might have on knowledge and skill acquisition, thus reducing the transformative power of education. This literature review focuses on discussing behaviorism, cognitivism, and constructivism. Schofield described the focus of behaviorism on the individual’s exposure to different stimuli, while Picciano’s (2017) discussion of theoretical frameworks added that behaviorism in learning focuses on observable actions, paying particular attention to the student’s response to external stimuli. Clark (2018a) synthesized the literature focused on behaviorism and further added that for educational behaviorists, learning takes place when target behaviors are acquired. Furthermore, Bélanger (2011) concluded that “at a pedagogical level, behaviourists emphasize the importance of establishing gradual operational learning objectives, from simple to complex tasks, with a view to the predicted set of behavioural outcomes” (p. 19). Yet, Schofield argued that psychological functions are not accounted for in education through the behaviorist approach, thus the acquisition and replication or lack of behaviors are the only measure of learning.

Subsequently, cognitivism emerged from psychologists Jean Piaget and Robert Gagné as they recognized the importance of cognition in learning and proposed the stages of cognitive development and the conditions of learning respectively, which implied that learning goes beyond observable behaviors (Clark, 2018b). However, after a review and synthesis of the literature, Clark proposed that cognitivism kept education teacher-centered by requiring teachers to design instructional opportunities that promote the conditions of learning and guide students through the stages of cognitive development. Schofield (2019) reviewed the literature on learning theories and concluded that constructivism emerged following cognitivism, and it is thought to have derived from Piaget’s stages of cognitive development, which proposes that learning is contextual and that learners create meaning and knowledge by making connections to their context and their environment. Clark (2018c) observed that this claim is supported by Vygotsky’s social development theory and the zone of proximal development, which place the responsibility of learning the knowledge making process on the learner as opposed to the teacher. However, Siemens (2004) openly questioned the limitations of learning theories in the digital era when knowledge acquisition is not linear. Taking into account the existing learning theories, Anderson (2011) conducted an analysis of the affordances of the Web in online education and suggested that with the increasing changes of the Web it is too soon to construct a theory for online learning. Nonetheless, the literature reviewed discusses theories and frameworks developed for online education.

Transactional Distance Theory

A theory for online or distance education is transactional distance developed by Dr. Michael G. Moore in the 1970s (Samuel & Conceição, 2022). Transactional distance theory emerged from efforts to define distance education (Moore, 1997). Moore proposed three dimensions of distance learning in the transactional distance theory: instructional dialogue, course structure, and learner autonomy. Moore described the dimensions as the following:

  1. Instructional dialogue: Moore defined instructional dialogue as a positive interaction between parties. However, Moore acknowledged the role that educational philosophies, the environment, personalities, and the design of the course have in the development of instructional dialogue. Moore recognized that the most important factor is the medium used for communication while arguing that with the rapid development of distance education more focus should be placed on the design of courses, the training of course designers, and the different learning styles.
  2. Course structure: Moore defined course structure as the design/implementation of learning objectives, teaching approaches, and assessment types. It represents, according to Moore, the level of rigidity or flexibility in a course. Moore acknowledged that over structuring or a lack of structure in a course both impact opportunities for dialogue and learner autonomy.
  3. Learner autonomy: Moore defines learner autonomy as the degree to which a learner is capable of engaging with the instructional content without the need for guidance or supervision from the educator. Previous research supports the hypothesis that autonomous learners are more successful in programs with lower levels of dialogue and structure, however Moore stressed that additional research is required to add validity to this claim.

Samuel & Conceição (2022) discussed the theories informing online course design and argued that consequent research in the field supports the notion that these dimensions laid the foundation for future research into different aspects and elements of online course design and instructional design frameworks.

Community of Inquiry

Garrison et al. (2000) developed a framework to determine what constitutes a valuable learning experience through the use of discussions in the online environment, they named it the community of inquiry (CoI) model; the model is shown in Figure 2.2. The CoI model is composed of cognitive presence, social presence, and teaching presence in computer mediated communications and computer conferences used for educational purposes (Garrison et al., 2000). Şen-Akbulut et al. (2022) conducted a study to validate a sub-dimension of the CoI framework where they established cognitive presence as the learner’s knowledge construction in online communities through cognitive engagement, social presence as the learners’ participation in the online learning community, and teaching presence as the design and support of the learners’ social and cognitive presence which is conducive to learning.

Figure 2.2

Community of Inquiry Framework

Community of Inquiry Framework. Garrison et al. (2000)

The community of inquiry framework addresses all three dimensions of the transactional distance theory (instructional dialogue, course structure, and learner autonomy) and accounts for the psychosocial components of learning (Samuel & Conceição, 2022). In an effort to operationalize the community of inquiry framework, Arbaugh et al. (2008) carried out an empirical study and developed a quantitative instrument that evaluates the relationships between the community of inquiry framework and online course variables. Their study validated the 34-item community of inquiry survey as a tool that measures teaching, social, and cognitive presence; however, they acknowledged the fact that it did not account for emerging technologies and their use in role in education.

Şen-Akbulut et al. (2022) observed that the community of inquiry framework has been validated through numerous studies, yet research shows that it does not account for how technology is used. This was established through early studies of online learning effectiveness conducted by Swan (2003) who analyzed the community of inquiry framework and determined that more extensive research was needed into the use of more complex online learning environments. Attempting to expand the community of inquiry framework, Şen-Akbulut et al. proposed the addition of technology elements under each dimension to account for its use and its impact in the overall learner’s experience. Through a study conducted during the 2020-2021 fall term, they developed an extended community of inquiry survey with sub-dimensions and items that account for the technological components of online education within the three foundational dimensions of the community of inquiry framework. They collected data from 653 undergraduate and graduate students at two public, English-speaking universities in Turkey while instruction was taking place fully online as a means of validating the survey. Their study validated the expanded community of inquiry survey as an instrument that can help educators and instructional designers select the best tools for the online learning environment, however they acknowledged limitations in their study’s sample as being limited and proposed that the survey would benefit from further evaluation.

Although the community of inquiry framework is widely accepted and continues to be used (Şen-Akbulut et al., 2022), Anderson (2011) highlights a significant limitation in the model, stating that “the community, however, binds learners in time, and thus forces regular sessions – or at least group-paced learning. Community models are also generally more expensive simply because they cannot scale up to serve larger numbers of students” (p. 61). According to Anderson, online learning theories should allow for independent learning and instead of dictating a format that is constrained by time and location as is required with the collaborative activities under the community of inquiry framework.

Connectivism

Siemens (2004) contended that the most prominent learning theories and frameworks referred to during the development of learning environments failed to account for technology and its impact in learning. Recognizing the importance and implications of technology on learning, he introduced connectivism as an online learning theory that incorporated networked learning. He founded this on the belief that the foundations of knowledge and information flow are rapidly increasing and changing. Siemens proposed eight principles of connectivism, stressing the importance of having access to new knowledge about the digital era. Siemens’s eight principles are illustrated in Figure 2.3. Ultimately, Siemens proposed that connectivism not only impacts learning, but it has implications for management and leadership, the news and media, knowledge management, and instructional design.

Figure 2.3

Siemen’s Eight Principles of Connectivism

Siemen’s Eight Principles of Connectivism. Siemens (2004)

Through further research on existing theories and frameworks of online education, Picciano (2017) acknowledged the fact that “Connectivism is particularly appropriate for courses with very high enrollments and where the learning goal or objective is to develop and create knowledge rather than to disseminate it” (p. 175).

Anderson's Model of Online Learning

Anderson (2011) argued that the best affordance of the World Wide Web for education was not its increase in the ease of access to content but its interactions and communications capability. Consequently, he sought to define a comprehensive theory for online education, building upon the tenets of the community of inquiry framework and connectivism, and ultimately developed a model of online learning for researchers to expand upon. The model emerged after Anderson recognized the increasing affordances of the internet on learning and suggested that it was too soon to define a theory for online learning. The model is illustrated in Figure 2.4. Anderson determined what has been established by other theorists, that researchers and practitioners often consider online education as a subset of learning and as a subset of distance education. Thus, his model attempts to capture all forms of interaction which he deemed as foundational to an online learning theory. These are interactions between students, teachers, the learning content, and the online educational environment.

Figure 2.4

Anderson’s Model of Online Learning

Anderson's Model of Online Learning. Anderson (2011)

Based on his model, Anderson proposed that meaningful learning can be achieved if the course designer creates a space that is either learner, content, community, or assessment centered, or ideally all at once. Anderson claimed that an online learning theory could encompass existing theories and frameworks except for those that account for in-person interactions in the traditional classroom. However, Picciano (2017) contends that this proposition, excluding face-to-face interactions and blended/hybrid models, complicates the development of a general theory for online education and “is problematic for those who see online education as a subset of education in general” (p. 179). He also argued against Anderson’s claim that self-study and independent work are incompatible with community-based frameworks.

Collaborativism

Expanding on computer-mediated communication (CMC) and Siemen’s (2004) networked learning, Harasim (2017) proposed the theory of collaborativism, previously known as online collaborative learning theory (OCL), which Harasim developed in 2012. Harasim argued in favor of collaboration and peer-to-peer knowledge building in online learning environments using the affordances of the internet. The basis of collaborativism, which derived from social constructivism, is that collaboration leads to knowledge construction through three phases: 1) idea generating, 2) idea organizing, and 3) intellectual convergence (Picciano, 2017). Picciano proposed that unlike previous theories, collaborativism views the instructor as a moderator or facilitator, placing the responsibility of knowledge building and sharing on the students and their group interactions. Furthermore, Picciano argued that due to the importance of the instructor’s role, collaborativism, unlike connectivism, is not suited for high-enrollment courses but rather smaller online learning environments. Through a review of the literature, Picciano concluded that the singularities of the theories regarding online learning environments become important when trying to identify commonalities within online learning theories.

Picciano’s Multimodal Model for Online Education

Consequently, in an attempt to build a common integrated theory for online learning, Picciano (2017) proposed an integrative model for online education and developed the Multimodal Model for Online Education. Picciano adapted Bosch’s Blending with Pedagogical Purpose Model, developed in 2016 and driven by pedagogical approaches (See Figure 2.5), while drawing parallels between the community of inquiry framework, connectivism, collaborativism, and Anderson’s Online Learning Model to ultimately develop an integrated model centered around the learning community.

Figure 2.5

Bosch’s Blending with Pedagogical Purpose Model

Bosch’s Blending with Pedagogical Purpose Model

Picciano recognized the importance of community, self-paced activities, and other components of existing online and general learning theories and questioned whether Bosch’s model could be expanded or modified through the integration of other learning theories, thus resulting in a general model for online education. Through a review of the literature on online learning theories, he proposed the Multimodal Model for Online Education. The model is shown in Figure 2.6. The purpose of Picciano’s model is to integrate existing learning theories and online learning frameworks.

Figure 2.6

Picciano’s Multimodal Model for Online Education

Picciano’s Multimodal Model for Online Education. Picciano (2017)

Picciano (2017) placed the learning community at the center of his model and incorporated elements that Anderson (2011) had considered incompatible, such as self-study and the community. Picciano provided examples of use for the model and made the claim that the model can be used throughout different modes of online learning environments. Picciano also suggested that behaviorists, cognitivists, and connectivists could adapt the model to meet their needs. However, Picciano acknowledged the limitations and suggested that more research is necessary on the implementation of his model to assess how it meets the needs and demands of various learning theories.

Learner-Centered Principles

After researching online learning experiences, Conceição (2021) concluded that, as a field, online course design is seeing a shift in focus from teaching strategies and instructional content to a more learner-centered approach. Likewise, Ralston-Berg and Braatz (2021) conducted an analysis of online course design and argued that online course design benefits from providing a holistic experience in online programs for the students and focusing on learner-centered approaches. Conceição proposes the use of learner-centered principles, focused on learner characteristics, as a framework to develop online learning experiences that are meaningful for the adult learner. Through a review of the literature, Conceição and Howles (2021) argued that previous research has supported the belief that learner characteristics have an impact on the cognitive, behavioral, emotional, and social dimensions of learning. The learner characteristics identified by Conceição are prior knowledge, motivation, self-regulation, self-directedness, self-efficacy, and identity. Figure 2.7 shows Conceição’s proposed model for online facilitative strategies with learner-centered principles at the core and professional development as an underlying component for instructors and course designers working with online adult learners.

Figure 2.7

Online Facilitative Strategies

Online Facilitative Strategies Conceição (2021)

 

Instructional Design

The literature reviewed synthesized the history and evolution of instructional design as a field in education. Molenda (2022) conducted a review of the origins of technology in education and concluded that the field of educational technology is composed of experts from diverse disciplines which makes it difficult to establish a shared history. However, Molenda describes instructional design as a construct previously known as instructional systems design that “represents a synthesis of developments that arose from different fields of study – especially industrial training protocols, military systems analysis, behavioral psychology, and pedagogical research” (p. 66). Reiser (2001) explored the history of instructional design and concluded that its origins trace back to the emergence of audiovisual training in the military during World War II where psychologists and educators were collaborating to help develop training materials. Furthermore, instructional systems design emerged in the 1970s from a request by the US Department of Defense to a team in Florida State University to develop procedures that would improve Army training programs (Molenda, 2022). Likewise, Briggs (1982) identified the origins of the techniques of instructional design in the military but recognized that instructional designers have come to be present in a wide range of settings including universities and school systems. The success of military training programs led organizations to training programs and instructional design as a system with structured processes (Martinez, 2023). Furthermore, in the 1980s, the use of microcomputers for training and educational purposes led to an increase of instructional design outside of the educational sector which has increased with the technological innovations of the 21st-Century (Sharif & Cho, 2015).

Instructional Design in Higher Education

The literature reviewed has shown that between the years 2000 and 2022, the research focused on instructional design in higher education has been on the rise (Pollard & Kumar, 2022). Stephens et al. (2022) traced the origins of instructional design to the 1940s during World War II as a collaboration between psychologists and educators to develop military training programs. Bennett and Albrecht (2021) analyzed the role of the instructional designer and found that the demand for instructional designers has increased with a higher demand for online education. Smith and Ragan (2005) define instruction as “the intentional facilitation of learning toward identified learning goals” (p. 4) and instructional design as “the systematic and reflective process of translating principles of learning and instruction into plans for instructional materials, activities, information resources, and evaluation” (p. 4). Tracey and Boling (2013) defined design as a problem solving systemic process based on theory and represented by models. Tracey et al. (2023) later defined instructional design as “a process, where designers follow step by step procedures to create instruction to solve a performance problem” (p. 2054). Through a systematic review of the literature in instructional design models and frameworks, Abuhassna and Alnawaiha (2023) established that instructional design uses learning theory and follows a systematic approach towards facilitating pedagogical and technological solutions. They argued in favor of instructional design as a discipline that bridges the gap between instructors, students, and technology. Furthermore, Bennett and Albrecht (2021) made the claim that instructional designers are critical to higher education institutions.

Online Course Design

The level of consistency in online course design, particularly interface design, was a prominent topic of discussion in the literature reviewed. In a review of the existing literature focusing on interactivity in asynchronous online courses in the early 2000s, Swan (2003) established that learners’ interactions with a course’s interface can positively or negatively impact their learning; and consistency in the design of an online course or courses that are part of an online program is conducive to learning. Sun et al. (2008) sought to understand online learner satisfaction and surveyed 295 online students utilizing the same online learning system across 16 different courses at two public higher education institutions in Taiwan to evaluate the factors influencing learner satisfaction. They based their study on 6 dimensions of perceived online learner satisfaction. They found that course quality is one of seven critical factors impacting student satisfaction and the most concerning for online courses. The other six factors they found to be critical to student satisfaction in online learning are learner computer anxiety, the instructor’s attitude towards online learning, course flexibility, the learners’ perceived usefulness of the content, the perceived ease of use of the technology, and diversity in assessments. Furthermore, a review of the literature conducted by Li and Lajoie (2021) supports the notion that the learning environment is significant because it can either promote or constrain interactions, learning strategies, and teaching styles.

Principles of online learning and their importance in course design were discussed throughout the literature. Chickering and Gamson (1987) proposed the “Seven Principles for Good Practice in Undergraduate Education” in an effort to improve teaching.

  1. Increase interaction between instructors and students
  2. Increase cooperation among students
  3. Increase students´ active learning
  4. Prompt feedback given to students
  5. Facilitate students´ time on task
  6. Communicate expectations
  7. Adapt to students with diverse talents and ways of learning

Subsequently, a study by Chickering and Ehrmann (1996) focused on the application of the seven principles utilizing technology acknowledged the need for revisions to include online learning. They proposed the following revisions to the seven principles.

  1. Contacts between students and faculty
  2. Reciprocity and cooperation among students
  3. Active learning techniques
  4. Prompt feedback
  5. An emphasis on time on task
  6. Communication of high expectations
  7. Respect for diverse talents and ways of learning

Furthermore, researchers continued to adapt and expand the seven principles (Swan, 2003). Keeton et al. (2002) analyzed existing research and case studies on adult learning in higher education. They revised the seven principles and proposed the eight principles outlined below to represent the practices that they found to have the biggest positive impact on learners.

  1. Make learning goals and one or more paths to them clear
  2. Use deliberate practice and provide prompt constructive feedback
  3. Provide an optimal balance of challenge and support that is tailored to the individual students’ readiness and potential
  4. Broaden the learners’ experience of the subject matter
  5. Elicit active and critical reflection by learners on their growing experience base
  6. Link inquiries to genuine problems or issues of high interest to the learners to enhance motivation and accelerate their learning
  7. Develop learners’ effectiveness as learners early in their education
  8. Create an institutional environment that supports and encourages inquiry

As part of a study focused on the design and facilitation of online learning experiences, Conceição (2021) reviewed studies on the topic and acknowledged that previous studies had an increased focus on the students’ interactions with the course content, their peers, and the course instructor, while emerging studies explore course design, the role of the instructional designer, and the implications these might have on the learner experience. Furthermore, Ralston-Berg and Braatz (2021) conducted an analysis of online course design structure and recommendations from existing research and determined that the inconsistent design of courses in an online program can lead to frustration of the learners and increased cognitive fatigue. They propose implementing program-level consistency in the interface design of online courses to benefit the learners, educators and instructional designers. According to their evaluation, program-level consistency in the interface design of online courses benefits the learners by allowing them to focus on the learning content, the learning activities, and the message communicated by the educator. They also propose that educators benefit from it by being able to focus on the development of instructional material and pedagogy. Finally, they suggest that it benefits the instructional designers by allowing them to place all their time and effort on the design of learning activities and implementation of instructional design best practices.

Course Design Guidelines

The literature reviewed discussed various online course design guidelines. A comparative document analysis of 12 online learning standard documents conducted by Martin et al. (2017) determined that education institutions adapt course design standards to meet their specific needs. Similarly, Bolliger and Martin (2021) conducted an analysis of critical design elements by surveying 222 instructional designers and instructors. Their study suggests that course developers select the design standards and rubrics that they most align with. Through a grounded theory study, Baldwin, Ching, and Friesen (2018) interviewed 14 instructors at public four-year colleges and universities who worked in the development of online courses in an effort to identify how instructors, with no instructional design training, approach the online course design process. The researchers found that instructors designing online courses do not tend to intentionally adhere to and utilize formal models and rubrics for instructional design, with many instructors revealing that they were unaware of the existence of formal instructional design models. They also found that instructors begin by establishing learning outcomes (objectives) or referencing content from an existing on ground version of the course and they chunk the content and structure it into units, weeks, or modules. However, their study showed that instructors are limited by the functionality of the learning management system, and they rely on student feedback for iterations to the course design. Baldwin, Ching, and Friesen developed an informal design process that closely mirrors the analyze, design, development, implementation, and evaluation (ADDIE) instructional systems design framework, validating its use in instructional design. This study helped bridge the gap between theory and practice, however, Baldwin, Ching, and Friesen recognized that the sample size does not allow for generalizations, necessitating further research.

Gaps in the Literature

Recent efforts have prioritized the development of guidelines and rubrics to promote consistency and quality in online courses across the globe with significant research in the field of online course design, online course development, and instructional design (Baldwin, Ching, & Hsu, 2018; Martin et al., 2021; Ossiannilsson et al., 2015). Research conducted by Ossiannilsson et al. (2015) did not evaluate the use of the standards or how different online higher education programs adhere to them. It would be beneficial to explore how higher education online programs who employ instructional designers independently or through online program management companies establish and implement online course design guidelines. There is also a gap in the identification of the best practices that serve as a foundation for the guidelines. Furthermore, Martin et al. (2021) also identified a need for well-established best practices that align with the course design guidelines and how they translate to the practice of online course design. Different organizations have established their own best practices and guidelines, but there is a need for broad, evidence-based best practices that can be referred to by practitioners, regardless of their location or organization. The field would also benefit from a study of practitioners who are not members of professional organizations.

Conclusion

This literature review has revealed that online course design is still an emerging and evolving field. The theories and frameworks that guide instructional design are rooted in learning theories while attempting to develop new theories that account for the complexities of online learning and online course design. Those theories, old and new, inform the development of instructional design guidelines and best practices that are meant to set global quality standards in online education. With the increase in enrollment of adult learners in online higher education programs, it becomes increasingly important to establish consistent standards that course designers can follow. It is also important to understand how instructional designers interpret and implement the standards and guidelines to assess if revisions are necessary or if new guidelines should be developed.

Part 2: Special Field: Instructional Design Best Practices and Guidelines in Online Higher Education

Introduction

Based on findings in the general field literature review which identified inconsistencies on how instructional designers implement online course design guidelines in online higher education programs, this literature review explores the roles and responsibilities of instructional designers, the use of instructional design frameworks, and the perceived best practices and their implementation and evaluation in higher education programs. It also analyzes engagement theory and its use in instructional design. The review of the literature revealed inconsistencies in the perceived roles and responsibilities of instructional designers based on the instructional designer’s area of employment as well as a gap in the research focused on the use and implementation of proposed course design best practices, guidelines, and quality rubrics by instructional designers.

Engagement Theory and Instructional Design

The literature reviewed explored instructional design and online course design through engagement theory and its implication on the educational aspect of instructional design. Engagement has been identified as a major contributing factor in learning and academic achievement (Joshi et al., 2022). However, Huang et al. (2022) argue that measuring and defining engagement is a complex task due to the evolving nature of student engagement and the factors that influence it. Skinner and Pitzer (2012) defined engagement as the behavioral manifestations of motivation. Kearsley and Shneiderman (1998) developed engagement theory as a response to their experiences teaching through technology-based environments and distance environments. Landa (1983) described learning theories as being descriptive, explaining how people learn, and instructional theories as being prescriptive, proposing or providing guidance on what should be done to produce the desired learning outcomes. However, Kearsley and Shneiderman describe engagement theory as a conceptual framework that was not developed from existing theoretical frameworks in learning and education, but it does draw parallels between constructivism and situated learning theories. They describe the focus of engagement theory on technology-based or technology facilitated learning. According to Kearsley and Shneiderman, the main premise of engagement theory is that meaningful engagement with learning activities must occur through interactions with peers and worthwhile tasks for effective learning to occur. They propose collaboration, project-based learning, and non-academic activities (learning tasks connected to the real world) as the ways to achieve engagement.

Lee and Hannafin (2016) identified engagement as a key component of learner-centered principles and proposed the Own it, Learn it, Share it framework (see Figure 2.8) as a way of representing the relationship between student-centered learning theories, design assumptions, and guidelines in an effort to increase student engagement in learning environments through instructional design. They argued that integrating self-determination theory, constructivism, and constructionism enhanced student engagement by focusing on the constructs of autonomy, scaffolding, and the audience. Cheng (2021) conducted an evaluation of the Own it, Learn it, Share it framework and identified learning theories and instructional theories as important theoretical foundations in instructional design. However, Cheng identified a gap in the form of a dissociation between theory and the practice of instructional design.

Figure 2.8

Own it, Learn it, Share it Framework

There is an abundance of research centered around engagement, and the literature reviewed discussed various dimensions of engagement in online learning. However, the literature reviewed did not agree on a definition for engagement or what learner engagement looks like in practice. Bodily et al. (2017) explored the literature surrounding online learner engagement and contended that there is no common definition or agreement amongst researchers for the meaning of engagement when it is referred to in the literature. Similarly, Spiker (2021) conducted an auto ethnographic study to define student engagement based on an analysis of the literature which revealed that there is no clear definition for engagement in the literature. Furthermore, Spiker recognized that tools and efforts to define engagement often follow a behavioral approach, yet Spiker argues that engagement extends beyond the observable. Likewise, through a study that explored online student engagement and course design, Tualaulelei et al. (2022) argued that definitions of engagement tend to favor behavioral processes. However, they propose that socioculturally informed definitions of engagement are better suited for online student engagement. Zhoc et al. (2019) questioned the inconsistency in the use of the term engagement; however, they suggest that engagement is often conceptualized within three models: a behavioral model, an emotional model, or a cognitive model. Furthermore, they propose a five-factor model for student engagement in higher education, focused on the psychological investment of students. Their model includes 1) academic engagement, 2)cognitive engagement, 3) social engagement with peers, 4) social engagement with teachers, and 5) affective engagement. The dimensions of engagement are explored in this literature review.

The literature reviewed explored definitions of engagement which discussed learning environments, learning activities, positive academic outcomes, and teacher-student and peer-peer interactions. Through a study that analyzed the implications of utilizing the term engagement in education, Fredricks, et al. (2004) argued that engagement is a multifaceted term often conceptualized through behavioral, emotional, and cognitive constructs. Additionally, Joshi et al. (2022) evaluated online learning engagement through a cross-sectional survey administered to 402 students and proposed that social engagement, in addition to behavioral, cognitive, and emotional engagement are high in the online learning environment. Synthesizing the literature on engagement, Heilporn et al. (2022) propose that “student engagement is rooted in action and results from interactions between students and the context” (p. 1659). Conversely, Kordostrami and Seitz (2022) define engagement as a set of practices and strategies that promote a safe space for participation, foster a learning community, and encourage a positive attitude in the course. As part of an autoethnographic study with an in-person undergraduate class, Spiker (2021) acknowledged that defining the term is challenging, with definitions for engagement often being circular and dependent on who is taking or being given ownership of engagement in the context under evaluation. Spiker adds that it is common practice for researchers to define engagement based on the context and purpose of their study. Tualaulelei et al. (2022) argue that the theoretical framework used in a particular study will directly impact how researchers interpret and analyze engagement. This was supported by a review of the literature conducted by Lin, Zaman, et al. (2023) who determined that the way in which researchers study and make sense of student engagement is affected by their selected theoretical frameworks.

Bodily et al. (2017) argue that defining engagement is critical given that engagement has been identified as a contributing factor for completion rates in courses, including online programs with Helme and Clarke (2001) adding that “shortcomings in defining and operationalizing engagement limit the usefulness of the results of many studies in the area” ( p. 137). Axelson and Flick (2011) conducted a study attempting to define student engagement, and proposed that one of the definitions of the word “engage,” when used as a verb, is to occupy the attention of; thus, engagement becomes the act of one’s attention being occupied, placing the responsibility of engagement on the instructor or learning task as they strive to occupy the attention of the learner. Meanwhile, other researchers define learner engagement as the effort and commitment put in by learners towards their learning, placing the responsibility of engagement on the learner (Kahn et al., 2017). Furthermore, Guo et al. (2023) link engagement to learners’ interactions with their learning environment. Meanwhile, Zhoc et al. (2019) take a psychological approach towards defining engagement and describe it as the learner’s psychological investment towards their learning. They attribute the popularity of engagement research in higher education to the National Survey of Student Engagement (NSSE) and argue that it is one of the most prevalent surveys that attempts to understand student engagement. Axelson and Flick argued that the National Survey of Student Engagement, developed in the 1980s by National Center for Higher Education Management Systems, became a benchmarking tool in higher education. They question the usefulness of the National Survey of Student Engagement given that it defines engagement as a behavior that students can be observed doing, yet they argue that engagement extends beyond observable behaviors into cognitive and emotional areas. Chen et al. (2010) explored the impact of online learning tools on college-level student engagement, utilizing data from the National Survey of Student Engagement, and argued there was a positive relationship between learning technology, student engagement, and learning outcomes. According to Kahn et al. (2017), the National Survey of Student Engagement takes into consideration collaborative learning, active learning, student and faculty interactions, academic rigor, and school environment, most of which are behavioral traits, as factors that influence engagement. Furthermore, Spiker (2021) conducted an auto ethnographic study and described engagement as observable behaviors where students are actively participating. However, after analyzing the data from the study, Spiker argued that engagement transcends observable behaviors and is a shared responsibility between students and educators.

The concept of student engagement can be traced back to the 1930s with educational psychologist Ralph Tyler researching education environments and student outcomes (Axelson & Flick, 2011). Expanding on Tyler’s research, Pace (1980) explored the quality of student effort and developed the College Student Experiences Questionnaire (CSEQ). Pace’s research led to Astin’s exploration of the quality and quantity of a student’s physical and psychological involvement in their college experience, which is attributed as the origin of what we know as modern engagement research (Axelson & Flick, 2011). Astin (1984) researched student involvement and developed the Student Involvement Theory. Astin regarded student involvement as a common objective for institutions, faculty, and students, and he acknowledged resemblances between the construct of student involvement and the psychological construct of motivation (Astin, 1984; Richmond, 1896).

According to Astin (1984), student involvement is the mental and physical energy students put into their coursework. Thus, coupled with more recent efforts to define and study engagement, learner engagement is considered to be multidimensional, encompassed by the behavioral, emotional, and cognitive dimensions of the learner, while engagement in higher education incorporates the learner’s social characteristics (Heilporn et al., 2022). Furthermore, Zhoc et al. (2019) argue that there are notable inconsistencies in the terminology used across studies of engagement, and there is significant variation in the conceptualization of student engagement in different focus areas, particularly school engagement and higher education engagement. Additionally, Li and Xue (2023) propose that each focus area of learner engagement can be analyzed through the different dimensions of engagement and the factors that influence it. Axelson and Flick (2011) advocate for more research centered on engagement in higher education, concluding that definitions of engagement are abstract and additional research is needed to better understand the relationship between learning and engagement in the higher education setting.

Dimensions of Engagement

The literature reviewed explored learner engagement in higher education through the dimensions of behavioral, cognitive, emotional, and social engagement. Fredricks et al. (2004) conducted a review of the research on school engagement and argued that the dimensions of engagement are interconnected, as is often the research within them. Redmond et al. (2018) evaluated online engagement in higher education and proposed a fifth dimension, collaborative engagement, to be used when analyzing higher education engagement in online environments. They proposed the online engagement framework (see Figure 2.9) comprising the five dimensions they argue are key for successful engagement in online learning and teaching environments. Their framework emerged from a social constructionist perspective.

Figure 2.9

Online Engagement Framework

Redmond et al. propose that the dimensions of engagement are interrelated and describe the online engagement framework as a tool for designers to evaluate online student engagement. Li and Xue (2023) further compartmentalized learner engagement in higher education by categorizing the dimensions of engagement into campus engagement and class engagement. They argued that campus engagement focuses on the social components of engagement while class engagement focuses on the behavioral, cognitive, and emotional components of engagement. This literature review explores each dimension of engagement to gain a better understanding of the underlying theories that are at play in the study of learner engagement in higher education.

Behavioral Engagement

Finn (1993) conducted a study for the Department of Education that evaluated student engagement in school and proposed that behavioral engagement is best observed and quantified through student participation in the learning environment. According to Skinner and Belmont (1993), “behavioral engagement refers to participation in the learning environment (e.g., concentration, attention, persistence) and adherence to classroom rules” (as cited in Li, Valiente, et al., 2022, p. 16). Astin (1984) explored student involvement and argued that involvement is a key component of behavioral engagement. Fredricks et al. (2004) also identified student involvement as a common trait associated with behavioral engagement in the literature reviewed surrounding student engagement. Furthermore, Fredricks et al. proposed that behavioral engagement is crucial for positive academic outcomes. Li, Valiente, et al. (2022) add that behavioral engagement has traits and characteristics that are considered more accessible for observation and measurement in the learning environment. Zhoc et al. (2019) considered those observable behaviors and their accessibility for studies are considered a key strength of the behavioral approach. In an interview with Richmond (1986), Astin described student involvement as a common objective for institutions. Furthermore, through their analysis of online engagement in higher education, Redmond et al. (2018) propose that student involvement is linked to academic performance, participation, autonomy and agency through the learning process, and the students’ actions in the academic environment.

Finn (1989) categorized behavioral engagement into four levels that range from behaviors exhibited in the classroom to behaviors in the student community and academic institution that take self-initiative, such as joining clubs and participating in extracurricular activities (as cited in Fredricks et al., 2004, p. 62). Yet, Fredricks et al. (2004) argue that most definitions of behavioral engagement fail to make a distinction between the different types of academic behaviors that can be exhibited by students. Behavioral engagement was identified as a primary predictor of learners’ levels of cognitive, emotional, and social engagement (Joshi et al., 2022), and it is often considered a prerequisite for academic success (Li, Valiente, et al., 2022).

Cognitive Engagement

There are varying definitions for cognitive engagement in the literature. However, through a study that measured learners’ cognitive engagement in online learning, Guo et al. (2023) propose that a student’s investment and interactions are a key component of cognitive engagement. Helme and Clarke (2001) argued that cognitive engagement had gained a level of popularity in research that defining was not considered necessary by some researchers. However, in their study on identifying cognitive engagement, they defined it as the students’ active mental involvement in learning tasks or their task-specific thinking in the classroom. Fredricks et al. (2004) propose that cognitive engagement be defined through the merging of three tracks of research, one that focuses on psychological investment in learning, another that focuses on strategic learning and cognition, and another that focuses on self-regulated learning and the specificity of cognitive processes. However, Pilotti et al. (2017) explored cognitive engagement in the online classroom and argued that investment in online learning activities, particularly discussion prompts, is positively related to cognitive engagement. Redmond et al. (2018) describe cognitive engagement as the “active process of learning” (p. 191). In this sense, Joshi et al. (2022) describe cognitive engagement as interactive and demanding of higher-order thinking skills from students. Cognitive engagement in learning then refers to the learner’s ability to self-regulate, their disposition to make the necessary effort to master ideas and skills, and their willingness to apply learning strategies which make up their investment in learning (Helme & Clarke (2001); Fredricks, et al., 2004; Pilotti et al., 2017; Redmond et al., 2018). Furthermore, after analyzing the literature on cognitive engagement, Li and Jolie (2021) made the claim that an abundance of researchers agree that cognitive engagement is context-specific and varies across learners and environments.

In a study to identify cognitive engagement in a mathematics classroom, Helme and Clarke (2001) found that there are three interconnected factors impacting the learner’s cognitive engagement: the task at hand, the learning environment, and the individual, which all manifest through behavioral and linguistic indicators that make identifying cognitive engagement possible. They propose that the learning task acts as the conduit for cognitive engagement, and factors such as the complexity, difficulty, familiarity, meaningfulness, and intrinsic interest of a task were found to influence cognitive engagement. Furthermore, Li and Lajoie (2021) propose that the structure of a task (well vs ill-structured) also impacts students’ cognitive engagement. Lin, Wang, and Meng (2022) establish that cognitive engagement can be both deep and superficial. However, analyzing learner engagement in blended environments, Huang et al. (2022) found that a learner’s level of cognitive engagement increases with tasks that have high-value attributes. They define high-value as “the learners’ perception of interest, usefulness, importance and cost of a task” (p. 12).

The learning environment created by classroom culture, peer-peer and learner-teacher interactions, the learning strategies, and the teaching styles has a significant impact on cognitive engagement (Helme & Clarke, 2001). Furthermore, Guo et al. synthesized the literature on cognitive engagement and propose that “cognitive engagement is more active and deeper during the learning process when learners are continuously interacting with peers, which in turn produces and constructs knowledge with a higher level of meaning and enables deep cognitive processing” (Chen & Pedersen, 2012; Galikyan & Admiraal, 2019; Redmond et al., 2022; as cited in Guo et al., 2023, p. 2). And, Redmond et al. (2018) made the claim that learners who are psychologically invested in the learning task work at a deeper cognitive level and have shown to prefer challenges and go beyond the basic requirements of the task at hand.

Furthermore, Helme and Clarke (2001) proposed that each individual learner possesses characteristics and traits that impact their cognitive engagement (e.g. skills, goals, needs, values). The learner's perception of control and self-regulation are additional contributing factors to their cognitive engagement (Helme & Clarke, 2001). Research by Huang et al. (2022) suggests that learner autonomy leads to higher levels of cognitive engagement. Thus, reinforcing Fredrick et al.’s argument that a learner’s cognitive engagement is their psychological investment in a learning task. However, through a study that explored cognitive engagement beyond behavioral indicators, Zhang et al. (2021) argue that although cognitive engagement refers to psychological involvement, the common observable indicators do not adequately measure the development and depth of cognitive engagement of students. They propose evaluating the quality of students’ contributions in the online learning community in addition to the observable indicators. However, in a study on learner engagement during the COVID-19 pandemic, Joshi et al. (2022) found that cognitive engagement is one of the main contributing factors for behavioral engagement and it has the highest impact on each of the other dimensions of engagement.

Emotional Engagement

The literature surrounding emotional engagement approached this dimension through affective characteristics in the learning environment which, according to Fredricks et al. (2004) can be positive or negative and include things such as attitudes, enjoyment, frustration, interest, and values. They propose that a learner’s sense of belonging to an institution and their inclination to complete coursework contributes to emotional engagement. However, upon conducting further research and evaluating the effects of instructional strategies on engagement, Heilporn et al. (2022) determined that the sense of belonging exhibited by learners and its connection to coursework is specific to the course. Joshi et al. (2022) described emotional engagement as affective characteristics that may produce positive emotions which in turn increase engagement. Redmond et al. (2018) determined that displays of positive emotional engagement occur when there is a value of learning, acquiring knowledge and skills, and an enjoyment for success. Joshi et al. also found that emotional engagement has the highest impact on the other dimensions of engagement, and it is often linked to learner motivation in the academic setting. Research conducted by Fredricks et al. and Joshi et al. supports that characteristics considered as part of emotional engagement such as values and interest overlap with motivational research constructs.

Some research organizations like the National Research Council & Institute of Medicine refer to motivation and engagement interchangeably (Fredricks et al., 2004). However, Fredricks et al. (2004) argue that definitions arising from the field of emotional engagement research are more general and less focused on domains and activities unlike definitions in the field of motivational research. Furthermore, Heilporn et al. (2022) propose conceptualizing emotional and cognitive engagement into a single emotional-cognitive dimension to better explore the correlation between psychological investment and interests. However, the literature reviewed focusing on student engagement explored emotional and cognitive engagement as separate yet correlated dimensions. Through a descriptive analysis of the Higher Education Student Engagement Scale, Zhoc et al. (2019) described emotional engagement as affective characteristics that impact motivation which leads to observable behaviors. Similarly, Joshi et al. (2022) argued that emotional engagement enhanced student motivation. In effect, research by Joshi et al. (2022) determined that social engagement is significantly affected by emotional engagement, and emotional engagement can positively impact the cognitive and behavioral dimensions of engagement.

Social Engagement

The initial literature explored focusing on engagement did not account for a social dimension. Fredricks et al. (2004) categorized belonging as a trait of emotional engagement; however, further research determined that the sense of belonging to a community in the educational setting is a characteristic of social engagement, furthering the distinction between course and community belonging made evident through studies on emotional engagement (Heilporn et al., 2022). Redmond et al (2018) argue that social engagement is significant for community building and creating a sense of belonging in the online learning space. Furthermore, Zhoc et al. (2019) proposed approaching social engagement through two dimensions: social engagement with peers, and social engagement with teachers. The main differentiator they propose is that peer-peer engagement occurs within and outside the classroom while learner-instructor engagement is limited to the education environment. Heilporn et al. (2022) explored the effects of instructional strategies on engagement in the online learning environments and advocated for the classification of social engagement as a separate dimension of engagement when evaluating engagement in higher education in the online space.

Huang et al. (2022) established that social engagement leads to meaningful learning. Likewise, a study conducted by Joshi et al., (2022) determined that social engagement is a main contributing factor for all other dimensions of engagement, but it is particularly important for cognitive and behavioral engagement. Furthermore, through a study evaluating engagement in online discussions, Liu et al. (2023) found that positive social engagement leads to higher cognitive engagement in students and proposed combining both dimensions of engagement into the social-cognitive dimension.

Collaborative Engagement

Specifically focused on online engagement in higher education, Redmond et al. (2018) propose a conceptual higher education online engagement framework for engagement consisting of the previously discussed dimensions of engagement and adding an additional dimension, collaborative engagement. They define collaborative engagement as the relationships and networks between learner-learner, learner-instructor, learner-institution, and learner-industry, all of which emerge to assist group or peer learning. Furthermore, collaborative engagement in education is defined as a group process that depends on the sociocultural context of the learning environment (Kong & Lai, 2023). Collaborative engagement is derived from social engagement, while social engagement focuses on building community, developing relationships, and establishing a sense of belonging, collaborative engagement focuses on the group interactions that arise within the social settings, specifically in online higher education settings (Redmond et al., 2018).

Engagement in Higher Education

Zhoc et al. (2019) argue that the literature on engagement in higher education is primarily approached from a behavioral perspective. Similarly, Li and Xue (2023) observed that learner engagement in higher education has been linked to learning outcomes and observable behaviors. However, It wasn’t until 1999, as a result of the publication of A Nation at Risk in 1983, that a tool for measuring engagement emerged–the National Survey of Student Engagement (Axelson & Flick, 2011). The National Survey of Student Engagement measures engagement through a behavioral approach, classifying student behavior as a learned response (Spiker, 2021). Spiker (2021) criticized the National Survey of Student Engagement for its behavioral approach to engagement and lack of consideration of the emotional dimension of engagement. Zhoc et al. (2019) identified the behavioral approach of the National Survey of Student Engagement as measuring the effects of observable variables of engagement in higher education. As a result, other tools to measure engagement in higher education emerged such as the Higher Education Student Engagement Scale (HESES) (Zhoc et al., 2019).

In a study to develop and validate the Higher Education Student Engagement Scale, Zhoc et al. (2019) determined that students’ sense of belonging, which is attributed to emotional engagement, directly impacts social engagement; thus, the Higher Education Student Engagement Scale takes a psychological approach towards engagement in higher education. However, in an effort to develop a comprehensive framework to evaluate engagement in higher education in an online setting, Redmond et al. (2018) propose belonging in a learning community as an attribute of the social dimension of engagement. They describe the learning community as the development of relationships between student-student and student-instructor. Similarly, studying learner engagement in an undergraduate course, Chatterjee (2022) proposed the use of the Communities of Inquiry (CoI) framework to approach learner engagement in formal and informal settings. The Communities of Inquiry framework is composed of three elements: cognitive presence, social presence, and teaching presence Chatterjee (2022).

Furthermore, Zhoc et al. (2019) proposed five dimensions of student engagement in higher education including academic, cognitive, social with peers, social with teachers, and affective. Heilporn et al. (2022) argue that these proposed dimensions of student engagement in higher education align with the dimensions of engagement. According to Heilporn et al. the academic dimension is behavioral engagement, the affective dimension is emotional engagement, and the social with peers’ dimensions incorporates elements of the collaborative dimension of engagement. Redmond et al. (2018) argue that an increasing number of online learners are non-traditional and require different forms of engagement in the online learning environment. They proposed the online engagement framework as a tool for instructional designers to follow when developing online courses in higher education.

Instructional Design Models and Frameworks

A variety of instructional design models and frameworks were analyzed as part of the literature review on instructional design which referred back to student engagement. They argue that traditional instructional systems design processes need improvement. Through the development of the third edition of the Instructional Design Competencies Standards, Richey et al. (2001) argued that before the 21st-Century, the literature on instructional design, which gained popularity in the late 1970s focused on applying a systematic approach; thus practitioners developed systematic design models and principles. Pollard and Kumar (2022) analyzed 50 articles as part of a literature review focused on instructional design in higher education between the years 2000 and 2020 where they found evidence that the implementation of instructional design models is not universal. They argue that degree and training programs should be updated to reflect current research and practices. Ralston-Berg and Braatz (2021) examined the course design structure and interface of online courses and argued in favor of program design standards. They suggest that it would positively impact learners and educators alike.

An instructional system design (ISD) process, developed by the US Department of Defense, evolved into a design model known as the Interservice Procedures for Instructional Systems Development (IPISD); the model underwent variations through different professional fields, but they typically included elements of analyze, design, develop, implement, and evaluate, giving way to the ADDIE framework (Molenda, 2022). A model that emerged from ADDIE and that is considered to be easier to implement for new instructional designers is the Dick and Carey model (Figure 2.10) (Edmonds et al., 1994). Branch and Merrill (2012) studied the characteristics of instructional design models through a review of the literature and interpreted the Dick and Carey model as a linear variation of ADDIE with linear opportunities for iteration. Edmonds et al. (1994) compared instructional design models and made the claim that the Dick and Carey model is more suited for a novice instructional designer due to its step-by-step descriptions of the process. The Dick and Carey model identifies the learning outcomes, determines the instructional approaches suited for meeting the learning outcomes, and then conducts formative and summative evaluations (Dikmen, 2019). Dikmen (2019) studied the implementation of the Dick and Carey model in an online course for 6th grade students and emphasized that the model assigns the role of initiating and managing communications to the instructor. Based on their research, they argued in favor of the Dick and Carey model and suggested that instructional designers implement it as a way of increasing the academic achievement of students.

Figure 2.10

Dick and Carey Model

Nonetheless, Abuhassna and Alnawaiha (2023) analyzed 31 research publications as part of a systematic review of the literature on instructional design models and frameworks and made the claim that the most often used instructional design approaches include ADDIE, universal design for learning, and the instructional design framework. They suggest building a comprehensive learning design framework based on fundamental design concepts identified by instructional designers. This is supported by the findings of McDonald (2023) who conducted an ethnographic case study with eight instructional designers and suggests that instructional design encompasses tasks that are not captured by instructional design models. Furthermore, through a review of the literature on instructional design models, Jung et al. (2019) determined that research has shown that the development of e-learning content in some environments has focused on reducing time and costs of the development process and has not considered the learner’s needs.

ADDIE

Through an analysis of the characteristics of instructional design models, Branch and Merrill (2012) observed that most instructional design models produced after the 1970s contain some element of ADDIE (Figure 2.11). ADDIE follows a waterfall methodology (Wolverton & Hollier, 2022). The steps of ADDIE include analysis, design, development, implementation, and evaluation (Alsaleh, 2020). Each step is described as follows:

  • Analysis: The instructional designer identifies the gap, problem, or need, its cause, and determines possible solutions.
  • Design: The instructional designer establishes the educational goals, determines a sequence for learning, selects the educational strategies and instructional technology, and defines the assessment tools.
  • Development: The instructional designer produces prototypes and iterations of the final product.
  • Implementation: The instructional designer adds the product to the live environment and gathers data on the product.
  • Evaluation: The instructional designer evaluates the efficiency of the product, using data collected through the implementation phase. If necessary, revisions are made to the product.

Figure 2.11

ADDIE Instructional Design Model

Alsaleh (2020) conducted an action research study with 77 teachers that completed an ADDIE training program where ADDIE was identified as the standard model for instructional design. ADDIE is based on a systematic product development concept and is a highly effective tool in instructional design (Branch & Merrill, 2012). They identified its iterative nature as one of its biggest strengths. Yet, Allen and Merril (2018) argue that ADDIE loses sight of the learner experience and criticize it for being a slow process. Jung et al. (2019) found criticism of ADDIE in the literature reviewed on instructional design due to its systematic, constraining, linear, and time-consuming nature. This was supported through a study by Petherbridge et al. (2022) which interviewed 33 instructional designers to explore the impacts of COVID-19 on their practice and found evidence that some instructional designers stray from the processes of models such as ADDIE when they are working under time constraints. However, results from a multimethod study by Klein and Kelly (2018) which analyzed 393 job announcements pertinent to instructional design and interviewed 20 instructional design project managers suggests that ADDIE continues to be a favored model in the instructional design field. Nonetheless, they voice concern with the possibility of instructional designers being stuck in the status quo with regards to ADDIE. An agile alternative to ADDIE that emerged in the field is the Successive Approximation Model (SAM) (Molenda, 2022).

Successive Approximation Model

The Successive Approximation Model (see Figure 2.12), was developed by Allen and Sites in 2012 as an agile alternative to the ADDIE model (Wolverton & Hollier, 2022). Allen and Sites (2012) proposed that the iterative nature of the Successive Approximation Model allows for the design and development of engaging learning products in a flexible manner. They argued that models like ADDIE do not produce consistent quality products and struggle to manage constraints, however the Successive Approximation Model addresses those two concerns through its short work cycles and iterative design. The model is composed of three key phases – preparation, iterative design, and iterative development – and subphases (Allen & Sites, 2012). Jung at al. (2019) conducted a mixed methods study exploring the use of the Successive Approximation Model and their research indicates that it is effective in allowing rapid agile revisions and accommodating the evolving needs of the learner.

Figure 2.12

Successive Approximation Model

In an interview, Allen argued in favor of the Successive Approximation Model because he considers it to be a more natural approach to developing learning experiences and it promotes creativity (Brustin, 2013). Allen and Merrill (2017) further argue that the use of the Successive Approximation Model is more cost-effective to implement because its preparation phase makes it time-efficient. Through a case study which interviewed three instructional designers and one director of distance learning and collected comments from students in the online courses, Wolverton and Hollier, (2022) studied the implementation of the Successive Approximation Model and are in agreement that the model’s continuous feedback and evaluation cycle make it a better alternative when there are time constraints. Although the Successive Approximation Model is a novel alternative to ADDIE, Jung et al. (2019) identified a gap in the amount of empirical research focused on the implementation of the model in real-life scenarios.

Backwards Design

A model that emerged as a means to provide guided and meaningful learning opportunities is backwards design (Figure 2.13) developed by Wiggins and McTighe in 1998 (Wiggins & McTighe, 2005). Wiggins and McTighe (2005) questioned the traditional approach of lesson planning where the lesson topic guides the design of the instructional activities. They proposed the backwards design model as an education-specific solution that identifies the expected outcomes and assessment methods at the beginning of the design process and works backwards in the design of the lessons to ensure that the goals are met and students are equipped to succeed in the assessments. Their proposed model has three stages: 1) identify desired results, 2) determine acceptable evidence, 3) plan learning experiences and instructions.

Figure 2.13

Backwards Design Model

Emory (2014) explored the use of backwards design as a way of strengthening the development of curriculum models in nursing programs and claimed that utilizing backwards design could lead to authentic learning and it could better prepare students for licensing examinations in the field. Similarly, through a study that explored the effects of backwards design on students’ intrinsic motivation, Alenezi (2015) determined that when utilizing backwards design students can perceive the learning content as relevant and valuable, thus engaging with it meaningfully in the course. Mills and Williams (2019) explored the use of backwards design in 37 sections of a first-year writing course where they gathered empirical evidence from 178 students which suggests that instructors and students deeply engage with the learning content when lessons are designed using the backwards design model. However, McCreary (2022) takes issue with the instrumentalization of the educational process that happens when utilizing backwards design. McCreary argues that valuable learning opportunities might get overlooked because they do not align with the learning outcomes; they suggest that instructors design spaces where students can make connections between what they are learning and the world and that students be given the opportunity to reflect on what they already know and what they bring to the classroom.

Usability Framework

The literature reviewed also identified a framework focused on the user experience (usability) of instructional design products. Through a study that explored the link between student usability and instructional design best practices, Ngampornchai et al. (2021) identified that the quality of online courses is traditionally measured through instructional or pedagogical principles. They described instructional design principles as being concerned with learning theories and strategies. However, they argue that usability, that is the users’ experience navigating the course and the ease with which they can complete tasks in that environment, is essential for high quality instructional design because poor usability can decrease effective learning. Koohang and du Plessis (2004) conducted research on usability in e-learning and instructional design and they found evidence that usability has a positive effect on student learning in the online environment and, when ignored, can prevent learning. They argue that usability cannot be excluded from instructional design frameworks and proposed a usability framework for instructional design (see Figure 2.14) focused on the properties of usability that they identified as essential for instructional design. The properties fall under two paradigms: looks great and works well. Under looks great is the presentation property and under works well are the properties of navigation, communicative enablement, technical functionality, and learner support.

Figure 2.14

E-Learning Usability Properties Framework

Further researchers sought to develop evaluations for usability and the instructional design of a course. Landa argued that establishing flow through a visual hierarchy when designing online courses is an important component as it gives students a sense of direction (Landa, 2018). In an attempt to develop a usability evaluation method for e-learning applications, Zaharias and Poylymenakou (2009) attributed poor instructional design features and usability of online training and corporate courses to the high attrition rates of online learning programs. They proposed an E-Learning usability Evaluation Questionnaire based on a usability and instructional design framework that they developed. Their proposed framework has five usability attributes and seven instructional design attributes. The usability attributes include navigation, learnability, accessibility, consistency, and visual design. The instructional design attributes include interactivity/engagement, content and resources, media use, learning strategies design, feedback, instructional assessment, and learner guidance and support. Phillips et al. (2016) implemented Zaharias and Poylymenakou’s framework in an online course to evaluate whether usability and instructional design were a factor on student stress and motivation. They had previously identified hindrance stress, which interferes with the learning process, and challenge stress, which nurtures learning and promotes cognitive processes, as two factors expected to be impacted by instructional design and usability. Phillips et al. collected data from 20 students and determined Zaharias and Poylymenakou’s framework for usability evaluation was effective in identifying hindrance stress of students in an online course. In a subsequent study, Sandoval et al. (2016) adapted the E-Learning usability Evaluation Questionnaire for higher education by adding two criteria: assessment and instructor presence. They tested the adapted questionnaire with 520 students enrolled in online courses and argued that the use and results from the questionnaire can help improve online course design and user experience. Ngampornchai et al. (2021) studied online course usability with 12 college students enrolled in one of three different versions of an online course. Their data suggested that instructional design principles and usability principles be integrated for an optimal course design. They evaluated the students’ perception of course components recommended by instructional frameworks. The components are: including the homepage, learning objectives, having an orientation module (sometimes called “Module 0” or “Getting Started”), and having an instructor self-introduction (e.g., written introduction, greeting audio, video introduction). They also explored student navigation of the online course and found evidence that students favor courses that follow instructional design principles. Furthermore, they argue that the study reinforced the importance of inclusive course design.

Roles and Responsibilities of the Instructional Designer

The roles and responsibilities of instructional designers, which have been found to vary based on setting and the nature of their projects, were explored in the literature reviewed. Cheng (2021) described the core of instructional design as creative problem solving. The International Board of Standards for Training, Performance, and Instruction (IBSTPI) states that “instructional designers prepare courses and other learning materials. They analyze the needs for the materials, then plan and develop those materials to address the needs” (2021). Richey et al. (2001) identified four roles for the instructional designer: analyst, evaluator, e-learning specialist, and project manager. Through an evaluation of project management tactics in an instructional design team, Kalvin (2021) described instructional designers as individuals from diverse backgrounds who can and must adapt to multiple roles. Kalvin established a project management checklist for instructional designers and described the role of the instructional designer as conditional on the project phase with responsibilities that include project management, content writing, graphic design, web development, consultation, and learning management system administration among other tasks that might be required for a particular project. Likewise, Petherbridge et al., (2022) interviewed 33 instructional designers from multiple job sectors to explore how the COVID-19 pandemic impacted their practice and they determined that an increased demand of instructional design teams caused a shift in the role of instructional designers and increased their responsibilities which are dependent on the nature of their project (remote, hybrid, and face-to-face learning environments). Furthermore, Ritzhaupt and Kumar (2015) interviewed eight instructional designers working in higher education regarding their knowledge and skills requirement for the job and argued that the primary differentiating factor for instructional designers in higher education is their need to train faculty for teaching with technology and their need to be educated in learning theories and processes.

Koszalka, et al. (2013) revised the instructional designer competencies for the International Board of Standards for Training, Performance, and Instruction in 2012 through which they proposed that instructional designers demonstrate their understanding of instructional design practice through systemic thinking practices in their daily tasks. However, Pollard and Kumar (2022) examined 76 sources as part of a literature review on instructional design in higher education between the years 2000 to 2022 and argued that the roles and responsibilities of instructional designers go beyond systematic processes. They suggest that instructional designers perform roles and have responsibilities such as developing instructional materials, engaging with program and course quality standards, providing support for the online learning software, managing partnerships, and acting as problem solvers for the subject matter experts. Furthermore, they identified as a challenge the disconnect that exists between the training for the perceived role of the instructional designer as a systematic one and the actual responsibilities it entails. Additionally, after a review of the literature and an analysis of roundtable discussion with instructional designers, Bennett and Albrecht (2021) determined that the roles and responsibilities of instructional designers are inconsistent across different instructional design positions. They argued that instructional designers working in higher education institutions have additional responsibilities such as quality assurance, consulting, and researching the subject at hand. Through their review they identified the setting of the instructional designer as a factor that determines their role and responsibilities with any given project and they argue that the job responsibilities and requirements can vary drastically between educational institutions. Ritzhaupt and Kumar (2015) add to this argument that the unit within the institution in which the instructional designer works further impacts their roles and responsibilities. It is worth looking into the training instructional designers receive and how it addresses the varying roles and responsibilities of the profession.

Instructional Design Training

The literature reviewed explored the training instructional designers receive and its correlation to their roles and responsibilities. Sharif and Cho (2015) identified a gap in the literature focused on instructional design training with their being an increased focus on how to train instructional designers versus what to train designers on and how to continue their professional development. Richey et al. (2001), as part of the International Board of Standards for Training, Performance, and Instruction, explored the history of instructional design and argued that when the field of instructional design started to gain traction, many instructional designers received their instructional design training on the job. However, Larson (2008) administered an Instructional Design Career Environments Survey to 53 instructional design professionals who graduated before 1994 and 95 professionals who graduated between 1994 and 2004, and the study found that, for both groups, 70% of instructional design professionals had a degree in instructional or educational technology. Yet, Larson recognized the limitations for generalizations of the study due to the small sample size. In 1986 the International Board of Standards for Training, Performance, and Instruction (2021) proposed four domains composed of a set of competencies in which instructional designers should be skilled at. The competencies are labeled as essential and advanced. The domains were revised in 2000 and by Koszalka et al. (2013) in 2012. Koszalka et al. conducted an extensive review of the existing literature on instructional design and consulted over 1,000 instructional design professionals and suggested the addition of a fifth domain for the instructional design competencies. The five domains are professional foundations, design and development, evaluation and implementation, management, and managerial. Richey et al. (2001) conducted an evaluation of the competencies and determined that they reflect the complexity of the field, emphasizing that instructional designers are expected to master essential competencies but not necessarily advanced ones. However, Richey et al. also suggested that with the increasing technological advances instructional designers in the 21st-Century were met with a continuous need of re-tooling to adequately meet new and evolving professional demands. However, Larson (2005) explored the literature on instructional design professionals and argued that the competency requirements for instructional designers vary and are primarily based on their career environment. Larson identified the vast difference between the culture and value system of educational institutions and work settings as a challenge in the training of instructional designers.

Larson and Locke (2008) explored the literature focused on the practice and preparation of instructional designers, they analyzed the mission statement of eight associations related to instructional design, and they compared the instructional design competencies established by the International Board of Standards for Training, Performance and Instruction and the Association for Educational Communications and Technology, arguing that training programs vary based on the theoretical alignment of the training institution and their practice expectation for students upon completing the training. Alselah (2020) identified problem-solving as a characteristic of instructional design and suggested that instructional designers are trained to follow systemic procedures to find effective and efficient solutions for the educational problem. However, McDonald (2023) observed the everyday tasks of instructional designers through a case study with eight instructional designers at a high research activity university in the United States which provided evidence that everyday tasks not part of systemic procedures are an important part of instructional design and should be included in training programs. McDonald identified a gap between everyday tasks and the attention placed on formal processes and methods, suggesting that the field of instructional design integrate those tasks into the training curricula and existing instructional design models. However, Devaughn and Stefaniak (2020) analyzed the literature on employment of instructional designers and argued that the instructional designer is expected to be formally trained in instructional design processes and methods.

The literature reviewed also identified gaps between the training expectations of instructional designers from employers and their training programs. Klein and Kelly (2018) analyzed 393 job announcements and found that the most sought-after competencies for instructional designers were 1) instructional design, 2) instructional technology, 3) communication and interpersonal, 4) management, and 5) personal skills with advanced position placing higher emphasis on communication and management. They suggest that training programs dedicate more resources towards the development of soft skills that are more difficult to acquire and develop on the job. Likewise, through an analysis of perceptions of the collaborative relationship between instructional designers and subject matter experts, Richardson et al. (2018) identified a gap in the literature between the collaborative nature of instructional design partnerships and its expectations and the training of that competency that instructional designers receive. They suggested the inclusion of guidelines for the development of a collaborative relationship in instructional design training programs. Furthermore, through a qualitative study, Devaughn and Stefaniak (2020) identified evaluation of work through formative or summative evaluations as an expectation from employers for instructional designers. They mapped the curriculum of 16 instructional design programs and conducted interviews with faculty and postgraduates from master’s and PhD programs, revealing a gap in the inclusion of evaluation methods in the instructional design process, with most programs emphasizing the design phase. They identified lack of time and limited faculty experience as contributing factors for this training and knowledge gap.

Devaughn and Stefaniak (2020) argue that the process of evaluation allows stakeholders to determine whether objectives were met and allow for revisions where necessary. This is reflected through the 2012 Instructional Design Competencies with the addition of the evaluation and implementation domain. The models, frameworks, and competencies of instructional design reflect the training and skills expected of instructional designers (Koszalka et al., 2013). However, Tracey and Boling (2013) questioned the increased focus on models and systemic processes used for training in instructional design after they analyzed training content in the field. They identified a gap between the training content in the field of instructional design and the actual tasks instructional designers perform. Kuo and Fitzpatrick (2022) argue that the process of instructional design in higher education goes beyond the solving of an instructional problem. They identified one of the goals of instructional design in higher education as being able to produce a replicable, self-sustaining course that meets quality standards. Furthermore, Pollard and Kumar (2022) identified a gap regarding faculty perspective in instructional design. They argue that there is a lack of research on the perspective of faculty towards instructional design in higher education and the partnership with instructional designers to develop online courses.

Online Course Design Best Practices

Course evaluation instruments have been developed as a response to newer models and theories of online learning that emerged after the Communities of Inquiry framework (Samuel & Conceição, 2022). Having identified course quality as a contributing factor for student retention in online courses through a review of the literature, Lewis (2021) proposed the use of best practices during course design to increase course quality. However, Grant (2021) analyzed the literature on best practices and techniques for online course design and argued that there are no formal agreed upon best practices or guidelines that course designers follow. The best practices for online course design identified through Lewis’s experience in online education include having a course overview, having appropriate and measurable objectives, supporting diverse learners and their needs through culturally inclusive content, meeting accessibility requirements, engaging learners through diverse activities, providing inclusive instructions, and being consistent with the interface experience. Lewis provides detailed best practices for online course design that align with the best practices identified by Baldwin, Ching, and Hsu (2018).

Subsequently, based on the online course design best practices identified by Baldwin, Ching, and Hsu (2018), Martin et al. (2021) set out to develop and validate a best practices online course design elements (OCDE) instrument for the use of faculty and instructional designers. The design elements in the OCDE instrument developed by Martin et al. are the common design components identified by Baldwin, Ching, and Hsu. Martin et al. developed a 38-item Likert-scale OCDE instrument with five categories: 1) overview, 2) content presentation, 3) interaction and communication, 4) assessment and evaluation, and 5) learner support. Their validation process included 222 participants: 101 online higher education instructors and 121 instructional designers. Their study validated the OCDE instrument as a method to address the critical elements identified by Baldwin, Ching, and Hsu and follow best practices when designing an online course. They also found that OCDE score is related to the level of expertise of the instructor or instructional designer, proposing that it is an important factor to consider when evaluating course design, best practices, and quality standards.

Following the results from Martin et al. (2021), Bolliger and Martin (2021) analyzed the frequency of use by instructors and recommended use made by instructional designers of the design elements identified as critical for student experience and for the student’s outcome in the online course. Utilizing the OCDE instrument, they found that instructors place higher value on student-student interactions than instructional designers, while instructional designers place a higher value than course instructors on providing accommodations for learners with disabilities and including self-assessments, meaning that educators and instructional designers might focus or prioritize different types of design elements based on how they perceive their importance. Nonetheless, there was a high level of agreement between both groups throughout the OCDE instrument, suggesting that it is a tool with agreed upon best practices in online course design. However, this study focused on participants from two professional international organizations concentrating on information technology professionals and learning design and instructional technologies. Through a reflexive evaluation of the online course design process at the University of South Carolina, Grant (2021) outlined a set of best practices to follow. Grant identified having consistent structure for each learning unit (e.g., introduction, list of materials, discussion), incorporating rich media elements, making the media accessible, and using templates for consistency as some of the best practices online course designers should adhere to. However, although supported by previous research, these best practices are a result of personal experience.

Course Design Evaluation

Conceição (2021) suggested that online course development occurs as a collaboration between the course instructor or subject matter expert (SME) and an instructional designer. Through a study analyzing six national evaluation instruments for online course design in higher education, Baldwin, Ching, and Hsu (2018) established that institutions favor the development of their own standard evaluation instruments and determined that different institutions emphasize different design elements. Furthermore, Bolliger and Martin (2021) conducted an analysis of online course design elements considered critical by educators and instructional designers who work as course designers and concluded that course designers prioritize different design elements in the development of online courses. Furthermore, Martin et al. (2017) proposed that these rubrics are meant to be used as tools that promote consistency while enhancing the quality of online courses and helping create a positive learning experience. Through a large scale evaluation of the quality standards for online courses in Embry-Riddle Worldwide, a branch of the institution that offers online as well as traditional, blended, and hybrid courses, Herron et al. (2012) established that educators and instructional designers benefit from course design standards; however they do not adhere to one rubric, rather the institution’s course design quality standards are derived from multiple existing evaluation criteria designed by other leaders in the field. In summary, the literature reviewed concluded that the institutions and organizations under evaluation adapt different standards and rubrics to meet their needs, and the literature reviewed surrounding online course design is heavily focused on case studies and course design standards specific to the organizations conducting the evaluations.

Ossiannilsson et al. (2015), on behalf of the International Council for Open and Distance Education (ICDE), conducted the first global analysis of online education standards in higher education, reviewing over 40 quality standards guidelines. Their analysis determined that most quality standards allow institutions the flexibility to adapt them as needed. However, they found varying deficiencies in all guidelines pertaining to transferability across programs, an unspecified level of maturity of the program their use is intended for, inconsistent areas of review and available feedback. They propose the mainstreaming of online education quality standards, contextualizing quality systems, including professional development opportunities for quality reviewers, communicating and promoting the standards, assisting institutions in the development of a quality management system, differentiating standards for the different types of courses and services offered through online programs, using learning analytics to share emerging best practices, supporting audits and benchmarking of quality standards, promoting research in the field of online education quality, and supporting the implementation of quality guidelines in different modes of teaching.

Subsequently, in an effort to further identify common elements in global standards for online learning, Martin et al. (2017) conducted a comparative study, analyzing 12 existing documents for online learning standards at a global scale, expanding on the study conducted by Ossiannilsson et al. (2015). The 12 documents they analyzed were Quality on the Line: Benchmarks for Success in Internet Based Distance Education (2000), Online Learning Consortium Quality Scorecard (2005), Blackboard Exemplary Course Rubric (2000), Quality Matters 2014, 5th Edition, CHEA Institute for Research and Study of Accreditation and Quality Assurance (2002), Open eQuality Learning Standards (2004), NADEOSA 2005 Revision of 1996 Document, ACODE 2014 Revision of 2007 document, Asian Association of open Universities (n.d.), ECBCheck 2012, UNIQUe 2011, and the International Organization for Standardization (n.d.). They found instructional analysis, design, and development as the most focused on topics while faculty support and satisfaction and policies and planning were the least focused on. Although this study identified common elements in online course design standards at a global scale, it did not explore whether those standards were being implemented or how they were being implemented nor by whom.

Furthermore, Baldwin, Ching, and Hsu (2018) conducted a statewide and national analysis of six evaluation instruments (rubrics) for higher education focusing on online course design. The six evaluation instruments were Blackboard’s Exemplary Course Program Rubric, California Community Colleges’ Online Education Initiative (OEI) Course Design Rubric, The Open SUNY Course Quality Review Rubric (OSCQR), Quality Matters (QM) Higher Education Rubric, Illinois Online Network’s Quality Online Course Initiative (QOCI), and California State University Quality Online Learning and Teaching (QOLT) evaluation instrument. Although each instrument has distinct criteria and elements, the researchers identified 12 evaluation criteria present in all six evaluation instruments and determined that those criteria set the basis for the best practices to be followed during the course design process. The criteria focus on interface design, content alignment, collaboration and interaction, setting clear expectations, and providing support resources. This study, similar to Ossiannilsson et al. (2015) and Martin et al. (2017), did not explore the implementation of the evaluation instruments or their use by online course designers. Furthermore, research conducted by Baldwin, Ching, and Hsu argued that some of the instruments that were included in the studies have not been validated.

Gaps in the Literature

Considering the implications of engagement theories on instructional design, the literature reviewed agrees that the intentional use of design elements, considering the layout and navigation within a course and following a design framework is important for visual and cognitive information processing. While the literature proposes various rubrics and frameworks (Samuel & Conceição, 2022), there is little insight into their application and impact in the field. Research conducted by Ossiannilsson et al. (2015) explored quality models in online education, but it did not evaluate the use of the standards or how different online higher education programs adhere to them. Therefore, it would be beneficial to explore how higher instructional designers determine which frameworks to follow and how they integrate recommended course design best practices. There is also a gap in research regarding the perceived best practices of online course design by instructional designers. Thus, the field would benefit from more research in this area to identify which frameworks are implemented in practice by instructional designers and how the best practices align to the frameworks. The identification of a common approach implemented in higher education would aid in the standardization of best practices and instructional design training guidelines, and it could possibly lead to the development of a more practical instructional design model.

Conclusion

There is substantial literature focused on instructional design with engagement playing an important factor on the development and implementation of frameworks and best practices. However, the literature reviewed has revealed that the field is rapidly evolving and the research is catching up. Considering the rapid growth of online programs in higher education and the partnerships of higher education institutions with instructional designers who help develop the online courses and programs, it becomes increasingly important to establish consistent development guidelines and standards.

Chapter 3: Theory and Methodology

Chapter 4: Findings

Chapter 5: Conclusions


References

Abedini, A., Abedin, B., & Zowghi, D. (2021). Adult learning in online communities of practice: A systematic review. British Journal of Educational Technology, 52(4), 16663-1694. https://doi.org/10.1111/bjet.13120

Abuhassna, H., & Alnawaiha, S. (2023). Instructional design made easy! Instructional design models, categories, frameworks, educational context, and recommendations for future work. European Journal of Investigation in Health, Psychology and Education, 13, 715-735. https://doi.org/10.3390/ejihpe13040054

Alenezi, H. (2015). Learning as the prize: Enhancing students’ intrinsic motivation through backwards design. The International Journal of Pedagogy and Curriculum, 23(1), 1-7. https://doi.org/10.18848/2327-7963/CGP/v23i01/48893

Allen, M. W. & Merrill, M. D. (2017). SAM and Pebble-in-the-Pond: Two alternatives to the ADDIE model. In Reiser & Dempsey (Eds.), Trends and Issues in Instructional Design and Technology (3rd ed., pp. 31-41). Pearson.

Allen, M. W. & Sites, R. (2012). Leaving ADDIE for SAM: An agile model for developing the best learning experiences. Association for Talent Development.

Alsaleh, N. (2020). The effectiveness of an instructional design training program to enhance teachers’ perceived skills in solving educational problems. Educational Research and Reviews, 15(12), 751-763. https://eric.ed.gov/?id=EJ1280098

Amponsah, S. (2020). Exploring the dominant learning styles of adult learners in higher education. International Review of Education, 66, 531-550. https://link.springer.com/article/10.1007/s11159-020-09845-y

Anderson, T. (2011). Towards a theory of online learning. In T. Anderson (Ed.), The theory and practice of online learning (2nd ed.) (pp. 45-74). AU Press. https://www.aupress.ca/app/uploads/120146_99Z_Anderson_2008-Theory_and_Practice_of_Online_Learning.pdf

Arbaugh, J. B., Cleveland-Innes, M., Diaz, S. R., Garrison, D. R., Ice, P., Richardson, J. C., & Swan, K. P. (2008). Developing a community of inquiry instrument: Testing a measure of the Community of Inquiry framework using a multi-institutional sample. The Internet and Higher Education, 11(3-4), 133-136. https://doi.org/10.1016/j.iheduc.2008.06.003

Astin, A. W. (1984). Student involvement: A developmental theory for higher education. Journal of College Student Development, 40(5), 518-529. https://www.researchgate.net/publication/220017441_Student_Involvement_A_Development_Theory_for_Higher_Education

Axelson, R. D., & Flick, A. (2011). Defining student engagement. Change, 43(1), 38-43. https://www.jstor.org/stable/23568219

Baldwin, S. J., Ching, Y.-H., & Hsu, Y.-C. (2018). Online course design in higher education: A review of national and statewide evaluation instruments. TechTrends, 62(1), 46–57. https://doi.org/10.1007/s11528-017-0215-z

Baldwin, S. J., Ching, Y.-H., & Friesen, N. (2018). Online course design and development among college and university instructors: An analysis using grounded theory. Online Learning, 22(2), 157-171. https://doi.org/10.24059/olj.v22i2.1212

Bélanger, P. (2011). Three main learning theories. In, Theories in adult learning and education (pp. 17-34). Verlag Barbara Budrich. https://doi.org/10.2307/j.ctvbkjx77.6

Bennett, L., Albrecht, A. (2021). Analyzing the instructional designer role: A new framework to improve efficacy and dynamic partnerships. Distance Learning, 18(4), 7-18. https://www.infoagepub.com/products/distance-learning-vol-18-4

Blakey, C. H. (2021). Student engagement: Perspectives of online students in higher education (Publication No. 28548166) [Doctoral dissertation, The University of Alabama]. ProQuest Dissertations and Theses Global.

Bodily, R., Graham, C. R., & Bush, M. D. (2017). Online learner engagement: Opportunities and challenges with using data analytics. Educational Technology, 57(1), 10-18. https://www.jstor.org/stable/44430535

Bolliger, D. U., & Martin, F. (2021). Critical design elements in online courses. Distance Education, 42(3), 352-372. https://doi.org/10.1080/01587919.2021.1956301

Branch, R. M. & Merrill, M. D. (2012). Characteristics of instructional design models. In R.A. Reiser & J.V. Dempsey (Eds.), Trends and issues in instructional design and technology (3rd ed., pp. 8-16). Pearson.

Briggs, L. J. Instructional design: present strengths and limitations, and a view of the future. Educational Technology, 22(10), 18-23. https://www.jstor.org/stable/44423735

Brustin J. (2013). Michael W. Allen. T+D: Better Performance Through Workplace Learning, 67(9), 68. https://proxy2.library.illinois.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=bsh&AN=89970897&site=ehost-live&scope=site

Carraro, K., & Trinder, R. (2021). Technology in formal and informal learning environments: Student perspectives. Global Journal of Foreign Language Teaching, 11(1), 39-50. https://doi.org/10.18844/gjflt.v11i1.5219

Chatterjee, S., & Parra, J. (2022). Undergraduate students engagement in formal and informal learning: Applying community of inquiry framework. Journal of Educational Technology, 50(3), 327-355. https://doi.org/10.1177/00472395211062552

Chen, P. D., Lambert, A. D., & Guidry, K. R. (2010). Engaging online learners: The impact of Web-based learning technology on college student engagement. Computers & Education, 54(4), 1222-1232. https://doi.org/10.1016/j.compedu.2009.11.008

Cheng, Z. (2021). Leveraging theories in instructional design: a reflective response to OLSit framework. Educational Technology Research and Development, 69(1), 109-112. https://doi.org/10.1007/s11423-020-09932-9

Chickering, A. W., & Gamson, Z. F. (1987). Seven principles for good practice in undergraduate education. AAHE Bulletin, 39(7), 3–7. https://files.eric.ed.gov/fulltext/ED282491.pdf

Clark, K. R. (2018a). Learning theories: Behaviorism. Radiologic Technology, 90(2), 172-175. PMID: 30420574.

Clark, K. R. (2018b). Learning theories: Cognitivism. Radiologic Technology, 90(2), 172-175. PMID: 30420575.

Clark, K. R. (2018c). Learning theories: Constructivism. Radiologic Technology, 90(2), 172-175. PMID: 30420576.

Conceição, S. C. O. (2021). Setting the stage for facilitating online learning. New Directions for Adult and Continuing Education, 2021(169), 7-13. https://doi.org/10.1002/ace.20410

Conceição, S. C.O., & Howles, L. L. (2021). Designing the online learning experience: Evidence-based principles and strategies. Stylus.

DeVaughn, P. & Stefaniak, J. (2020). An exploration of how learning design and educational technology programs prepare instructional designers to evaluate in practice. Educational Technology Research & Development, 68(6), 3299-3326. https://doi.org/10.1007/s11423-020-09823-z

Dikmen, C. H. (2019). The effect of web-based instruction designed by Dick and Carey model on academic achievement, attitude and motivation of students’ in science education. Journal of Learning and Teaching in Digital Age, 4(1), 34-40. https://eric.ed.gov/?id=EJ1325215

Edmonds, G. S., Branch, R. C., & Mukherjee, P. (1994). A conceptual framework for comparing instructional design models. Educational Technology Research and Development, 42(4), 55-72. https://www.jstor.org/stable/30220096

EducationUSA. (2022). The U.S. educational system. United States Department of State. https://educationusa.state.gov/experience-studying-usa/us-educational-system

Emory, J. (2014). Understanding backward design to strengthen curricular models. Nurse Educator, 39(3), 122-125. https://doi.org/10.1097/NNE.0000000000000034

Ertmer, P. A., & Newby, T. J. (2013). Behaviorism, cognitivism, constructivism: Comparing critical features from an instructional design perspective. Performance Improvement Quarterly, 26(2), 43-71. https://doi.org/10.1002/piq.21143

Finn, J. D. (1993). School engagement and students at risk. Department of Education, National Center for Educational Statistics. https://files.eric.ed.gov/fulltext/ED362322.pdf

Foley, G. (2004). Dimensions of adult learning. McGraw-Hill Education.

Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59-109. https://www.jstor.org/stable/3516061

Gallagher, S., & Palmer, J. (2020). The pandemic pushed universities online. The change was long overdue. Harvard Business Review. https://hbr.org/2020/09/the-pandemic-pushed-universities-online-the-change-was-long-overdue

Garrison, D. R., Anderson, T., & Archer, W. (2000). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2-3), 87-105. https://doi.org/10.1016/S1096-7516(00)00016-6

Grant, M. M. (2021). Asynchronous online course designs: Articulating theory, best practices, and techniques for everyday doctoral education. Impacting Education: Journal on Transforming Professional Practice, 6(3), 35-46. https://doi.org/10.5195/ie.2021.191

Guo, L.., Du, J., & Zheng, Q. (2023). Understanding the evolution of cognitive engagement with interaction levels in online learning environments: Insights from learning analytics and epistemic network analysis. Journal of Computer Assisted Learning, 1, 1-18. https://doi-org.proxy2.library.illinois.edu/10.1111/jcal.12781

Gurjar, N. & Bai, H. (2023). Assessing culturally inclusive instructional design in online learning. Educational Technology Research & Development, 71(3), 1253-1274. https://doi.org/10.1007/s11423-023-10226-z

Hajdu, F., Barizsne Hadhazi, E., & Kotsis, A. (2022). Study on learning motivation of master’s students in master’s course in leadership and organizations at the University of Debrecen. Annals of the University of Oradea, Economic Science Series, 31(1), 404-413. https://doi.org/10.47535/1991auoes31(1)038.

Harasim, L. (2017). Learning theory and online technologies (2nd ed.). Routledge. https://doi.org/10.4324/9781315716831

Heilporn, G., Lakhal, S., & Belisle, M. (2022). Examining the effects of instructional strategies on student engagement in blended online courses. Journal of Computer Assisted Learning, 38, 1657-1673. https://doi.org/10.1111/jcal.12701

Helme, S., & Clarke, D. (2001). Identifying cognitive engagement in the mathematics classroom. Mathematics Educational Research Journal, 13(2), 133-153. https://doi.org/10.1007/BF03217103

Henschke, J. A. (2011). Considerations regarding the future of andragogy. Adult Learning, 22(1), 34-37. https://doi-org.proxy2.library.illinois.edu/10.1177/104515951102200109

Herron, R. I., Holsombach-Ebner, C., Shomate, A. K., & Szathmary, K. J. (2012). Large scale quality engineering in distance learning programs. Journal of Asynchronous Learning Networks, 16(5), 19–35. https://files.eric.ed.gov/fulltext/EJ1000088.pdf

Hodges, C., Moore, S., Lockee, B., Trust, T. & Bond, A. (2020). The difference between emergency remote teaching and online learning. EDUCAUSE. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remoteteaching-and-online-learning

Huang, M., Kuang, F., & Ling, Y. (2022). EFL learners’ engagement in different activities of blended learning environment. Asian-Pacific Journal of Second and Foreign Language Education, 7(1), 1-15. https://doi.org/10.1080/10494820.2022.2091603

International Board of Standards for Training, Performance, and Instruction. (2021). Instructional designer competencies. https://ibstpi.org/competency-sets-services/instructional-designer-competencies/

Joshi, D. R., Adhikari, K. P., Khanal, B., Khadka, J., & Belbase, S. (2022). Behavioral, cognitive, emotional and social engagement in mathematics learning during COVID-19 pandemic. PLoS ONE, 17(11), 1-22. https://doi.org/10.1371/journal.pone.0278052

Jung, H., Kim, Y., Lee, H., & Shin, Y. (2019). Advanced instructional design for successive e-learning: Based on the successive approximation model (SAM). International Journal on E-learning, 18(2), 191-204. https://www.learntechlib.org/primary/p/187327/

Kahn, P., Everington, L., Kelm, K., Reid, I., & Watkins, F. (2017). Understanding student engagement in online learning environments: the role of reflexivity. Educational Technology Research and Development, 65(1), 203-218. https://www.jstor.org/stable/45018536

Kalvin, J. (2021). Project Teamwork Done Right. Talent Development, 75(3), 70-71. https://www.proquest.com/trade-journals/project-teamwork-done-right/docview/2499090837/se-2.

Kearsley, G., & Shneiderman, B. (1998). Engagement theory: A framework for technology-based teaching and learning. Educational Technology, 38(5), 20-23. https://www.jstor.org/stable/44428478

Keeton, M. T., Sheckley, B. G., & Griggs, J. K. (2002). Effectiveness and efficiency in higher education for adults: A guide for fostering learning. Kendall/Hunt Publishing Company.

Klein, J. D. & Kelly, W. Q. (2018). Competencies for instructional designers: A view from employers. Performance Improvement Quarterly, 31(3), 225-247. https://doi.org/10.1002/piq.21257

Knowles, M. S. (1980). The modern practice of adult education: From pedagogy to andragogy (2nd ed.). Cambridge Books.

Kong, S., & Lai, M. (2023). Effects of a teacher development program on teachers' knowledge and collaborative engagement, and students' achievement in computational thinking concepts. British Journal of Education Technology, 54(2), 489-512. https://doi.org/10.1111/bjet.13256

Koohang, A. & du Plessis, J. (2004). Architecting usability properties in the e-learning instructional design process. International Journal on E-Learning, 3(3), 38-44. https://www.learntechlib.org/primary/p/5102/

Kordrostami, M., & Seitz, V. (2022). Faculty online competence and student affective engagement in online learning. Marketing Education Review, 32(3), 240-254. https://doi.org/10.1080/10528008.2021.1965891

Koszalka, T. A., Russ-Eft, D. F. & Reiser, R. (2013). Instructional designer competencies: The standards (4th ed.). Information Age Publishing.

Kucuk-Avci, S., Topal, M., & Istanbullu, A. (2022). The effects of the COVID-19 pandemic on distance education in higher education: A bibliometric analysis study. Croatian Journal of Education, 24(2), 457-488. https://doi.org/10.15516/cje.v24i2.4534

Kuo, Y., & Fitzpatrick, B. J. (2020). Instructional design guidelines for advancing self-sustaining online higher education in the USA. Performance Improvement Quarterly, 34(4), 427-454. https://doi.org/10.1002/piq.21354

Landa, L. V. (1983). Descriptive and prescriptive theories of learning and instruction: An analysis of their relationships and interactions. In C. M. Reigeluth (Ed.), Instructional-design theories and models: An overview of their current status (pp. 55–69). Routledge. https://doi.org/10.4324/9780203824283

Landa, R. (2018). Graphic design solutions. Cengage Learning.

Larson, M. B. (2005). Instructional design career environments: Survey of the alignment of preparation and practice. TechTrends, 49(6), 22-34. https://doi.org/10.1007/BF02763727

Larson, M. B. & Lockee, B. B. (2008). Instructional design practice: Career environments, job roles, and a climate of change. Performance Improvement Quarterly, 17(1), 22-40. https://doi.org/10.1111/j.1937-8327.2004.tb00300.x

Lee, E. & Hannafin, M. J. (2016). A design framework for enhancing engagement in student-centered learning: own it, learn it, and share it. Educational Technology Research and Development, 64(4), 707-734. https://doi.org/10.1007/s11423-015-9422-5

Lewis, E. (2021). Best practices for improving the quality of the online course design and learners experience. Journal of Continuing Higher Education, 69(1), 61-70. https://doi.org/10.1080/07377363.2020.1776558

Li, S., & Lajoie, S. P. (2021). Cognitive engagement in self-regulated learning: An integrative model. European Journal of Psychology of Education, 37, 833-852. https://doi.org/10.1007/s10212-021-00565-x

Li, L., Valiente, C., Eisenberg, N., Spinrad, T. L., Johns, S. K., Berger, R. H., Thompson, M. S., Southworth, J., Pina, A. A., Hernandez, M. M., & Gal-Szabo, D. E. (2022). Longitudinal relations between behavioral engagement and academic achievement: The moderating roles of socio-economic status and early achievement. Journal of School Psychology, 94, 15-27. https://doi.org/10.1016/j.jsp.2022.08.001

Li, J., & Xue, E. (2023). Interaction between student learning behaviour and learning environment: Meta-analysis of student engagement and its influencing factors. Behavioral Sciences, 13(1), 59. https://doi.org/10.3390/bs13010059

Lin, L., Wang, J., & Meng, X. (2022). Influencing factors of learners’ cognitive engagement in an online learning environment. International Journal of Emerging Technologies in Learning (iJET), 17(17), 127-139. https://doi.org/10.3991/ijet.v17i17.33851

Lin, W., Zaman, S. I., Jamil, S., & Khan, S. A. (2023). Students engagement in distant learning: How much influence do the critical factors have for success in academic performance? Psychology in the Schools, 1, 1-22. https://doi.org/10.1002/pits.22858

Liu, Z., Zhang, N., Peng, X., Liu, S., & Yang, Z. (2023). Students’ social-cognitive engagement in online discussions. Educational Technology & Society, 26(1), 1-15. https://www.jstor.org/stable/10.2307/48707963

Martin, F., Bolliger, D. U., & Flowers, C. (2021). Design matters: Development and validation of the Online Course Design Elements (OCDE) instrument. International Review of Research in Open and Distributed Learning, 22(2), 46–71. https://doi.org/10.19173/irrodl.v22i2.5187

Martin, F., Polly, D., Jokiaho, A., & May B. (2017). Global standards for enhancing quality in online learning. Quarterly Review of Distance Education, 18(2), 1-10. https://proxy2.library.illinois.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=tfh&AN=125876169&site=ehost-live

Martinez, L. (2023). Perceptions and perspectives of instructional designers at a financial services institution (Publication No. 30573532) [Doctoral dissertation, Trident University]. ProQuest Dissertations and Theses Global.

McCreary, M. (2022). Beyond backward design, or, by the end of this article, you should be able to imagine some alternatives to learning objectives. To Improve the Academy: A Journal of Educational Development, 41(1), 68-91. https://doi.org/10.3998/tia.454

McDonald, J. K. (2023). The everydayness of instructional design and the pursuit of quality in online courses. Online Learning, 27(2), 137-169. https://doi.org/10.24059/olj.v27i2.3470

Merriam, S. B. (2008). Adult learning theory for the twenty-first century. New Directions for Adult Continuing Education, 2008(119), 93-98. https://doi.org/10.1002/ace.309

Merriam, S. B., & Caffarella, R. S. (1999). Andragogy and other models of adult learning. In, Learning in adulthood: A comprehensive guide (pp. 271-287) (2nd ed.). Jossey-Bass. https://proxy2.library.illinois.edu/login?url=https://search.ebscohost.com/login.aspx?direct=true&db=nlebk&AN=26069&site=ehost-live&scope=site

Mills, J., Wiley., C., & Williams, J. (2019). “This is what learning looks like!”: Backwards design and the framework in first year writing. Libraries and the Academy, 19(1), 155-175. https://doi.org/10.1353/pla.2019.0008

Molenda, M. H. (2022). History and development of instructional design and technology. In O. Zawacki-Richter & I. Jung (Eds.), Handbook of open, distance and digital education (pp. 57-74). Springer. https://doi.org/10.1007/978-981-19-0351-9

Moore, M. G. (1997). Theory of transactional distance. In D. Keegan (Ed.), Theoretical principles of distance education (pp. 22-38). Routledge. http://www.c3l.uni-oldenburg.de/cde/found/moore93.pdf

Ngampornchai, A., Trail-Constant, T., & Swenson, N. (2021). How students navigate in online classrooms: The link between usability and instructional design best practices. International Journal on E-Learning, 20(4), 433-457. https://www.learntechlib.org/p/216947/

Ossiannilsson, E., W, K., Camilleri, A. F., & Brown, M. (2015). Quality models in online and open education around the globe: State of the arts and recommendations. International Council for Open and Distance Education. https://files.eric.ed.gov/fulltext/ED557055.pdf

Pace, C. R. (1980). Measuring the quality of student effort. Current Issues in Higher Education, 2, 10–16. https://files.eric.ed.gov/fulltext/ED255099.pdf

Petherbridge, D., Bartlett, M., White, J., & Chapman, D. (2022). The disruption to the practice of instructional design during COVID-19. The Journal of Applied Instructional Design, 11(2), 23-34. https://doi.org/10.51869/112/dpmbjwdc

Phillips, A. S., Sheffield, A., Moore, M., & Robinson, H. A. (2016). An online social constructivist course: Toward a framework for usability evaluations. The Quarterly Review of Distance Education, 17(1), 1-10. https://www.infoagepub.com/qrde-issue.html?i=p5760190b408a2

Picciano, A. G. (2017). Theories and frameworks for online education: Seeking an integrated model. Online Learning, 21(3), 166-90. http://doi.org/10.24059/olj.v21i3.1225

Pilotti, M., Anderson, S., Hardy, P., Murphy, P., & Vincent, P. (2017). Factors related to cognitive, emotional, and behavioral engagement in the online asynchronous classroom. International Journal of Teaching and Learning in Higher Education, 29(1), 145-153. https://eric.ed.gov/?id=EJ1135992

Pollard, R., & Kumar S. (2022). Instructional designers in higher education: Roles, challenges, and supports. The Journal of Applied Instructional Design, 11(1), 7-24. https://doi.org/10.51869/111/rp

Ralston-Berg, P., & Braatz, H. (2021). Online course design structure and interface. New Directions for Adult & Continuing Education, 2021(169), 15-33. https://doi.org/10.1002/ace.20411

Redmond, P., Heffernan, A., Abawi, L., Brown, A., & Henderson, R. (2018). An online engagement framework for higher education. Online Learning, 22(1), 183-204. http://dx.doi.org/10.24059/olj.v22i1.1175

Richardson, J. C., Ashby, I., Alshammari, A. N., Cheng, Z., Johnson, B. S., Krause, T. S., Lee, D., Randolph, A. RE., & Wang, H. (2018). Faculty and instructional designers on building successful collaborative relationships. Educational Technology Research and Development, 67, 855–880. https://doi.org/10.1007/s11423-018-9636-4

Richey, R. C., Fields, D. C., & Foxon, M. (2001). Instructional design competencies: The standards (3rd ed.). ERIC Clearinghouse. https://eric.ed.gov/?q=richey+fields+foxon

Richmond, J. (1986). The importance of student involvement: A dialogue with Alexander Astin. Journal of Counseling and Development, 65(2), 92-95. https://onlinelibrary.wiley.com/doi/10.1002/j.1556-6676.1986.tb01240.x

Ritzhaupt, A. D., & Kumar, S. (2015). Knowledge and skills needed by instructional designers in higher education. Performance Improvement Quarterly, 28(3), 51-69. https://doi.org/10.1002/piq.21196

Samuel, A., & Conceição, S. C. O. (2022). Using the critical incident questionnaire as a formative evaluation tool to inform online course design: A qualitative study. International Review of Research in Open & Distance Learning, 23(2), 151-168. https://doi.org/10.19173/irrodl.v23i2.5959

Sandoval, Z. V. (2016). The re-design process of an instrument to evaluate usability in online courses. Issues in Information Systems, 17(3), 77-88. https://doi.org/10.48009/3_iis_2016_77-88

Schofield, K. (2019). Theorizing about learning and knowing, In K. Daniels, C. Elliott, S. Finley, & C. Chapman (Eds.), Learning and teaching in higher education: Perspectives from a Business school (pp. 2-12). Edward Elgar Publishing. https://doi.org/0.4337/9781788975087

Şen-Akbulut, M., Umutlu, D., & and Arıkan, S. (2022). Extending the community of inquiry framework: Development and validation of technology sub-dimensions. International Review of Research in Open and Distributed Learning, 23(3), 61-80. https://doi.org/10.19173/irrodl.v23i2.6022

Sharif, A. & Cho, S. (2015). 21st-Century instructional designers: Bridging the perceptual gaps between identity, practice, impact and professional development. Universities and Knowledge Society Journal, 12(3), 72-85. http://dx.doi.org/10.7238/rusc.v12i3.2176

Shuell, T. J. (1986). Cognitive conceptions of learning. Review of Educational Research, 56(4), 411-436. https://doi.org/10.2307/1170340

Siemens, G. (2004). Connectivism: A learning theory for the digital age. International Journal of Instructional Technology and Distance Learning, 2(1). https://www.itdl.org/Journal/Jan_05/article01.htm

Skinner, E. A., & Pitzer, J. R. (2012). Developmental dynamics of student engagement, coping, and everyday resilience. In S. L. Christenson, A. L. Reschly, & C. Wylie (Eds.), Handbook of research on student engagement (pp. 21–44). Springer.

Smith, P. L., & Ragan, T. J. (2005). Instructional Design (3rd ed.). Wiley.

Spiker, A. (2021). Student engagement; Who is in charge? College Teaching, 69(4), 183-190. https://doi.org/10.1080/87567555.2020.1846486

Stephens, M. L., Lowney, J., Ybarra, C. M., & Stephens, S. (2022). Adult learning facilitators in any setting, instructional designers’ roles as the adult learner and educator, and their perceived knowledge construction when preparing graduate faculty for teaching online: An interpretative study. New Horizons in Adult Education & Human Resource Development, 34(1), 3-15. https://doi.org/10.1002/nha3.20319

Souto-Otero, M. (2021). Validation of non-formal and informal learning in formal education: Covert and overt. European Journal of Education, 56(3), 365-379. https://onlinelibrary.wiley.com/doi/10.1111/ejed.12464

Sun, P.-C., Tsai, R. J., Chen, Y.-Y., & Yeh, D. (2008). What drives successful e-Learning: An empirical investigation of the critical factors influencing learner satisfaction. Computers and Education, 50(4), 1183-1202. https://doi.org/10.1016/j.compedu.2006.11.007

Swan, K. (2003). learning effectiveness: What the research tells us. In J. Bourne & J. C. Moore (Eds.), Elements of quality online education, practice, and direction (pp. 13-45). Sloan Center for Online Education.

Tracey, M. W., Baaki, J., Budhrani, K., & Shah, S. (2022). “Behind the curtain”: Exploring how instructional design teams function to complete design and development. International Journal of Technology & Design Education, 32(5), 2853-2871. https://doi.org/10.1007/s10798-021-09715-0

Tracey, M. W., & Boling, E. (2013). Preparing instructional designers and educational technologists. Traditional and emerging perspectives. In M. Spector, D. Merrill, J. Ellen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (4th ed.). (pp. 653-660). Springer. https://doi.org/10.1007/978-1-4614-3185-5_52

Trowler, V., Allan, R. L., Bryk, J., & Din, R. R. (2021). Pathways to student engagement: Beyond triggers and mechanisms at the engagement interface. Higher Education, 84, 761-777. https://doi.org/10.1007/s10734-021-00798-1

Tualaulelei, E., Burke, K., Fanshawe, M., & Cameron, C. (2022). Mapping pedagogical touchpoints: Exploring online student engagement and course design. Active Learning in Higher Education, 23(3), 189-203. https://doi.org/10.1177/1469787421990847

UNESCO, UNICEF, the World Bank, and OECD (2021). What’s next? Lessons on education recovery: Findings from a survey of ministries of education amid the COVID-19 pandemic. Paris, New York, Washington D.C.: UNESCO, UNICEF, World Bank. https://unesdoc.unesco.org/ark:/48223/pf0000379117.locale=en

Wiggins, G., & McTighe, J. (2005). Understanding by Design (2nd ed.). ASCD.

Williams, H. M. A. (2015). Fighting a resurgent hyper-positivism in education is music to my ears. Action, Criticism, and Theory for Music Education, 14(1), 19-43. http://act.maydaygroup.org/articles/Williams14_1.pdf

Williamson, R., & Stevenson, O. (2022). Bringing adult learning principles to university-policy engagement training involving students and policy professionals. Research for All, 6(1), 21. https://doi.org/10.14324/RFA.06.1.21

Wolverton, C., & Hollier, B. G. (2022). Guidelines for incorporating active learning into the design of online management courses utilizing the successive approximation model (SAM). International Journal of Education and Development using Information and Communication Technology, 18(1), 264-274. https://files.eric.ed.gov/fulltext/EJ1345818.pdf

Zaharias, P., & Poylymenakou, A. (2009). Developing a usability evaluation method for e-learning applications: Beyond functional usability. International Journal of Human-Computer Interaction, 25(1), 75-98. https://doi.org/10.1080/10447310802546716

Zhang, S., Gao, Q., Wen, Y., Li, M., & Wang, Q. (2021). Automatically detecting cognitive engagement beyond behavioral indicators. International Forum of Educational Technology & Society, 24(2), 58-72. https://www.jstor.org/stable/10.2307/27004931

Zhoc, K. C. H., Webster, B. J., King, R. B., Li, J. C. H., & Chung, T. S. H. (2019). Higher education student engagement scale (HESES): Development and psychometric evidence. Research in Higher Education, 60(2), 219-244. https://www.jstor.org/stable/45180376


Appendix

  • Jessie Mundo Gonzalez