Research Study Critique #2

•

1 gefällt mir•596 views

A critique of the research study "Impact of media richness and flow on e-learning technology acceptance" by Liu, Liao, and Pratt for EDET 780, Maymester 2009.

Bildung Technologie

Research Study Critique No. 2
colin gray | AEET/EDET 780

May 25, 2009

RESEARCH | study

Liu, S., Liao, H., & J. Pratt (2009). Impact of media richness and
ﬂow on e-learning technology acceptance [Electronic version].
Computers & Education, 52, 599-607.

http://dx.doi.org.pallas2.tcl.sc.edu/10.1016/j.compedu.2008.11.002

STUDY | purpose

integration of rich media in elearning environments

STUDY | purpose

integration of rich media in elearning environments

evaluate user concentration

STUDY | purpose

integration of rich media in elearning environments

evaluate user concentration

evaluate streaming rich media in a CBT context

STUDY | purpose

Perceived
Usefulness

Perceived
Attitude Intentions
Ease-of-Use

Concentration

STUDY | groups

Three groups organized by multimedia intervention

STUDY | groups

Three groups organized by multimedia intervention

Aa

text-audio

STUDY | groups

Three groups organized by multimedia intervention

Aa

text-audio audio-video

STUDY | groups

Three groups organized by multimedia intervention

Aa
Aa

text-audio audio-video text-audio-video

STUDY | subject

students enrolled in a system analysis course

STUDY | subject

students enrolled in a system analysis course

Chung Yuan University in Taipei, Taiwan

STUDY | subject

students enrolled in a system analysis course

Chung Yuan University in Taipei, Taiwan

55% female | 45% male | ages 20-25

STUDY | subject

students enrolled in a system analysis course

Chung Yuan University in Taipei, Taiwan

55% female | 45% male | ages 20-25

88 respondents

STUDY | results

Perceived
Presentation Methodology

Usefulness

Actual Use of elearning
Perceived
Attitude Intentions
Ease-of-Use

Concentration

STUDY | results
First Survey Final Survey

STUDY | results
First Survey Final Survey

6 6

4.5 4.5

3 3

1.5 1.5

Text/Audio Text/Audio
Audio/Video 0 0
Audio/Video
Text/Audio/Video Text/Audio/Video

Perceived Usefulness Concentration

STUDY | output
limited to streaming audio-visual media

STUDY | output
limited to streaming audio-visual media

limited to speciﬁc LMS, based on user experience onboarding

STUDY | output
limited to streaming audio-visual media

limited to speciﬁc LMS, based on user experience onboarding

limited to short-run training (<= four modules)

STUDY | next steps
reuse of rich media objects in additive training scenarios

STUDY | next steps
reuse of rich media objects in additive training scenarios

addition of interactivity to existing rich media base

STUDY | next steps
reuse of rich media objects in additive training scenarios

addition of interactivity to existing rich media base

concentration effect transfer on users with
limited internet connectivity

OVERVIEW | mechanics

high level of subject matter and evaluation data

OVERVIEW | mechanics

high level of subject matter and evaluation data

extensive preview and review of study questions and outcomes in
context with literature review

OVERVIEW | applicability

highly applicable to contemporary ILT development

OVERVIEW | applicability

highly applicable to contemporary ILT development

demonstrates value of media richness

OVERVIEW | applicability

highly applicable to contemporary ILT development

demonstrates value of media richness

multiple research paths to further study
external variables affecting concentration

Weitere ähnliche Inhalte

Andere mochten auch

Embedding Social Media

colin gray

Critique is an important part of a typical design pedagogy, but is generally only discussed within formal curricular structures, which do not address informal interactions between students in the design studio. In this study, I report findings from ethnographic observations of a design studio, including occurrences of informal critique that take place outside of the planned curriculum. Types of critique that are observed are detailed, including similarities or differences to critique in typical classroom practice.

The Hidden Curriculum of the Design Studio: Student Engagement in Informal Cr...

colin gray

While critique is frequently studied in formal higher education contexts, often including investigation of classroom critique and high stakes design juries, relatively little is known about the qualities of informal critique and design talk that occurs organically between students in the design studio environment. A critical analysis of design education has revealed a lack of attention to the role of student experience and the power relations that often dominate critique as an evaluative activity. Previous studies conducted in this framing have revealed what Dutton (1991) terms the "hidden curriculum" of a design studio, including factors that affect the student experience of a design pedagogy. Utilizing Shaffer's (2003) framework to theorize the construction of this "hidden curriculum," an evaluation of features manifests on three levels: surface, pedagogical, and epistemological. This study investigates the occurrence of informal design talk between students in a shared studio workspace in a graduate Human-Computer Interaction design program. Data sources for this ethnographic investigation include: approximately 150 hours of participant observation of the studio space during a four month period, supporting audio recordings and photographs, and intensive interviews. Based on initial analysis of collected data, including field notes, photographs, and audio recordings, a preliminary taxonomy of informal instigating interactions can be arranged. A broad continuum of informal design talk was observed, with little critique or critical talk between students following a structure that corresponds with classroom or professor-led critique. Despite this lack of structural similarity, informal design talk frequently invokes elements of critical discourse, reflecting the growth of a personal design perspective, and the latent assumptions built into the surface, pedagogical, and epistemological structures of the studio environment.

Emergent Critique in Informal Design Talk: Reflections of Surface, Pedagogic...

colin gray

Building Design Knowledge: Creating and Disseminating Design Precedent

colin gray

In recent years, there has been increasing focus on aesthetic learning experiences. We propose expanding this focus to account for the felt learner experience, including a deeper understanding of how learners build learning spaces surrounding the formal curriculum. This study is based on a one-year ethnography of a design studio, documenting how students actively engaged in informal learning in support and reaction to the formal pedagogy. Implications for the design of learning experiences are discussed.

Exploring the Lived Experience of Learners: Broadening our Understanding of A...

colin gray

Understanding authentic ID practice on its own terms instead of through academically reified notions of practice may be required if our conceptual tools (theories, models and guidelines) are to be used in practice (Rowland, 1992; Stolterman et al. 2008). To do this, we discuss definitions of design theory in IDT and contrast them to the larger design community, suggesting future research on ID practice framed by a heightened notion of design theory and method.

Design in the “Real World”: Situating Academic Conceptions of ID Practice

colin gray

In this study, we address existing ID education through the lens of authentic ID practice, noting a lack of rigorous research into practice that should inform how we teach. Researchers observed eight ID practitioners conducting everyday activities in two organizations. Based on analysis of the judgments these designers made and the infrastructure surrounding their activities, implications for ID education are identified, including areas of authentic practice not usually addressed in courses.

Stop Telling Designers What To Do: Reframing Instructional Design Education T...

colin gray

UX and design culture are beginning to dominate corporate priorities, but despite the current hype there is often a disconnect between the organizational efficiencies desired by executives and the knowledge of how UX can or should address these issues. This exploratory study addresses this space by reframing the concept of competence in UX to include the flow of competence between individual designers and the companies in which they work. Our reframing resulted in a preliminary schema based on interviews conducted with six design practitioners, which allows this flow to be traced in a performative way on the part of individuals and groups over time. We then trace this flow of individual and organizational competence through three case studies of UX adoption. Opportunities for use of this preliminary schema as a generative, rhetorical tool for HCI researchers to further interrogate UX adoption are considered, including accounting for factors that affect adoption.

Flow of Competence in UX Design Practice

colin gray

Critical pedagogy has historically been used to document and explicate unequal power relationships in education environments, but this perspective has not been fully developed in the context of design education. The purpose of this study is to begin the process of synthesizing perspectives on critical pedagogy and what we know about representation and materiality in the studio space in order to see the tensions that arise as new methods of representation are explored and implemented in a relatively new studio space within an emergent design discipline. By documenting the tensions surrounding representation in the studio through a critical ethnography, issues of pedagogical oppression, student experience, and representations of design in this particular design field can be more rigorously explored, establishing a space for critical pedagogy in design education, and exploring forms of oppression that may be unique to creative disciplines.

Struggle Over Representation in the Studio: Critical Pedagogy in Design Educa...

colin gray

Storyboard

colin gray

Cross-cultural design practices have begun to rise in prominence, but these practices have infrequently intersected with common user-centered design practices that value the participation and lived experience of users. We identified the ways in which the design team referred to co-creation workshop participants during the design and debrief of the workshop, focusing on how these references invoked or implicated the design team’s understanding of Chinese culture. We identified referents to the participants, using occurrence of third-person plural pronouns to locate projection of and reflection on participant interaction. In parallel, we performed a thematic analysis of design and debrief activities to document the team’s articulation and activation of instrumental judgments relating to culture. The team’s instrumental judgments shifted substantially across the design and debrief session, moving from totalizing cultural references in the design phase to frequent translator-mediated interactions in the debrief phase. Translators “nuanced” the cultural meanings being explored by the design team, while team members attempted to engage with cultural concerns by “making familiar” these concerns within the context of their own culture. Implications for considering culture as a part of standard user research methods and paradigms are considered, along with practical considerations for foregrounding cultural assumptions in design activity.

Designers’ Articulation and Activation of Instrumental Design Judgments in Cr...

colin gray

Critique has long been considered a benchmark of design education and practice, both as a way to elicit feedback about design artifacts in the process of production and as a high-stakes assessment tool in academia. In this study, I investigate a specific form of critique between peers that emerges organically in the design studio apart from coursework or guidance of a professor. Based on intensive interviews and observations, this informal peer critique appears to elicit the design judgment of the individual designer in explicit ways, encouraging peers to follow new paths in their design process, while also verbalizing often-implicit design decisions that have already been made. Implications for future research in academic and professional practice are considered.

Discursive Structures of Informal Critique in an HCI Design Studio

colin gray

Engineering and design students are often required to evaluate their products against user requirements, but frequently, these requirements are abstracted from the user or context of use rather than coming from actual user and context data. Abstraction of user requirements makes it difficult for students to empathize with the eventual user of the product or system they are designing. In previous research, Design Heuristics have been shown to encourage exploration of design solutions spaces at the initial stages of design processes. This study combines use of Design Heuristics in an engineering classroom context with a method designed to connect students with an understanding the context of the user, product use setting, and sociocultural milieu. We adapted an existing method, the cognitive walkthrough, for use in an engineering education context, renaming it the empathic walkthrough. In this study, this method was revised and extended to maximize empathy with the end user and context, using these insights to promote a more situated form of idea development using the Design Heuristics cards. We present several case studies of students using this method to expand their notion of situated use, demonstrating how this method may have utility for importation into engineering contexts. Our early testing has indicated that this method stimulates empathy on the part of the student for the design context within which they are working, resulting in a richer narrative that foregrounds problems that a user might encounter.

Idea Generation Through Empathy: Reimagining the "Cognitive Walkthrough"

colin gray

When engaged in design activity, what does a designer think about? And how does she draw on disciplinary knowledge, precedent, and other strategies in her design process in order to imagine new possible futures? In this paper, we explore Design Heuristics as a form of intermediate-level knowledge that may explain how designers build on existing knowledge of “design moves”—non-deterministic, generative strategies or heuristics—during conceptual design activity. We describe relationships between disciplinary training and the acquisition of such heuristics, and postulate how design students might accelerate their development of expertise.

What is the Content of “Design Thinking”? Design Heuristics as Conceptual Rep...

colin gray

There has been an ongoing conversation about the role and relationship of theory and practice in the HCI community. This paper explores this relationship privileging a practice perspective through a tentative model, which describes a “bubble-up” of ideas from practice to inform research and theory development, and an accompanying “trickle-down” of theory into practice. Interviews were conducted with interaction designers, which included a description of their use of design methods in practice, and their knowledge and use of two common design methods—affinity diagramming and the concept of affordance. Based on these interviews, potential relationships between theory and practice are explored through this model. Disseminating agents already common in HCI practice are addressed as possible mechanisms for the research community to understand practice more completely. Opportunities for future research, based on the use of the tentative model in a generative way, are considered.

Reprioritizing the Relationship Between HCI Research and Practice: Bubble-Up ...

colin gray

The design community has discussed issues of ethics and values for decades, but less attention has been paid to the question of how an ethical sensibility might be developed or taken on by design students. In this analysis, we explore how normative concerns emerge through the process of design reviews—where a developing designer’s normative infrastructure is engaged with the artifact they are designing. We focused on the normative concerns that were foregrounded by two undergraduate and two graduate industrial design students across a series of five design reviews, addressing the possible relationship between the emergence of normative concerns and the inscription of norms in the final designed artifact. We used several critical qualitative techniques, including sequence analysis and meaning reconstruction to locate areas where normative concerns were addressed. Normative concerns only arose in explicit form in the earliest review sessions on the graduate level, if they were going to arise at all, and end-user research appeared to be the primary mechanism for introducing norms into the design process. Neither instructor actively engaged or foregrounded the normative infrastructure of the design students, and all of the normative concerns discussed in the four cases were brought to the conversation by students. Implications for including awareness of normative concerns as part of a student’s developing design character are considered as part of a systemic approach to ethics and values in design education.

Normativity in Design Communication: Inscribing Design Values in Designed Art...

colin gray

Idea generation has frequently been explored in design education as an exercise of students’ “innate” creativity, and few tools or techniques are offered to scaffold ideation ability. As students develop their design skills, we expect them to demonstrate increasing ideation flexibility—a cognitive and social ability to see a problem from multiple perspectives, and to create more varied concepts within the problem space. In this study, we introduced three tools— functional decomposition, Design Heuristics, and affinity diagramming—to aid students’ ideation in a three-hour workshop. Participants included 20 students in a junior industrial design studio arranged in five pre-existing teams. These participants first decomposed the functions within an existing set of concepts they had generated, then selected a specific function and generated additional concepts using the Design Heuristics ideation method. Finally, teams organized these concepts using affinity diagramming to find patterns and additional concepts. Our findings suggest that this process encouraged students to try multiple ways of examining the existing problem space, resulting in a broadened set of final concepts. More striking, the instructional activities served to foreground differences in team members’ understanding of the problem they were addressing, fostering alignment of their problem statement and aiding in its further development.

What Problem Are We Solving? Encouraging Idea Generation and Effective Team C...

colin gray

Critique is considered to be a central feature of design education, serving as both a structural mechanism that provides regular feedback, and a high stakes assessment tool. This study utilizes informal peer critique as a natural extension of this existing form, engaging the practice community in reflection-in-action due to the natural physical co-location of the studio environment. The purpose of this study is to gain greater understanding of the pedagogical role of informal critique in shaping design thinking and judgment, as seen through the framing of Bourdieu’s habitus. The methodology of this study is informed by a critical theory perspective, and uses a combination of interview, observation, and stimulated recall in the process of data collection. Divergent viewpoints on the role of informal v. formal spaces, objectivity v. subjectivity of critique, and differences between professor and peer feedback are addressed. Additionally, beliefs about critique on the individual and group level are analysed as critical elements of an evolving habitus, supported by or developed in response to the culture inscribed by the pedagogy and design studio. This form of critique reveals tacit design thinking and conceptions of design, and outlines the co-construction of habitus by individual students and the design pedagogy.

Informal peer critique and the negotiation of habitus in a design studio (AEC...

colin gray

Numerous studies have shown the value of introducing cognitive supports to encourage the development of creative ability, using both convergent and divergent methods to develop and synthesize ideas. As part of this iterative idea generation process, design students often struggle to explore new ideas after their initial ideas are exhausted. Yet, there is little instructional guidance on how to productively use the exhaustion of ideas as a way to encourage the development of creative ability, particularly in relation to creativity support tools. In this study, an idea generation tool called Design Heuristics was employed in an industrial design course at a large Midwestern university. Students were given a simple design task, and 30 minutes to generate concept ideas on their own; then, after ten minutes of instruction on the Design Heuristics tool, students generated more ideas for an additional 30 minutes using the same problem. Working on their own, students generated an average of 6 concepts, and generated 2.7 additional concepts while using the Design Heuristics tool. Even though the initial ideation session resulted in more concepts, once their ideas were exhausted, the students were able to continue creating more concepts using Design Heuristics. Concepts created in this second session were rated as higher in their novelty, specificity, and relevance. These results suggest the advantages of introducing creativity support tools following a period where students can work using their own ideas; once exhausted, they may be more open to adopting the method or tool introduced, and may produce more creative outcomes.

What Happens when Creativity is Exhausted? Design Tools as an Aid for Ideation

colin gray

Reflective activities have the potential to encourage students to develop critical skills and awareness of mental models. In this study, I address the emerging identity of early design students as they externalize their evolving conceptions of design through visual and textual reflection. Forty-three students in an introductory human-computer interaction (HCI) course completed weekly textual reflections on a course blog, and completed visual reflections at the conclusion of each of three projects. The weekly blog reflections were intended to document their experience as a developing designer, while the visual reflections represented their personal conception of design within HCI—their rendering of the “whole game”. Through this process of reflection, students externalized their transformation as designers, including an awareness of the pedagogical, social, and cultural factors shaping them, and a growing sense of their personal and professional design identity. Through interviews and additional analysis of eight of these students, a disjuncture was found between conceptions of design in visual and textual reflections, with visual reflections forming a professional, generic design identity, and textual reflections more congruent with the student’s personal identity. Issues relating to lack of representational skill and how these forms of reflection externalize a student’s evolving design philosophy are addressed.

Locating the Emerging Design Identity of Students Through Visual and Textual ...

colin gray

Andere mochten auch (20)