While our discussions in the e-Learning Ecologies MOOC often touch on the "what" of multimodality (like digital media and multiliteracies), I want to introduce a concept that focuses on the "how" of cognitive shift: Transmediation.

Because every mode has different affordances—what it can and cannot do—the learner must re-conceptualize the core idea to fit the new medium. This creates a "synesthetic" moment of deep learning where the student discovers new facets of the concept that were invisible in the original mode.

Transmediation in Practice: The "Science-to-Storyboard" Shift

A powerful example of this is found in middle-school science. When students read a dense text about Cellular Mitosis, they often memorize definitions. However, when tasked with transmediating that text into a stop-motion animation:

Linguistic to Visual: They must decide what a "centromere" actually looks like (Shape/Color).
Visual to Spatial/Temporal: They must determine the rhythm and timing of the cell division (Movement).
Synthesis: By the time the video is finished, the student hasn't just "read" about mitosis; they have "authored" it across multiple semiotic planes.

Visualizing the PRocess

Imagine the cognitive leap required to move between these points:

Source: A musical score (Audio/Symbolic).
Target: A mathematical graph representing frequency and amplitude (Visual/Logic).
The Result: The learner understands "harmony" not just as a sound, but as a ratio.

Exploring "Transmediation" in Multimodal Learning