LAB 3B: MULTIMODAL TRANSCRIPT

(GROUP Submission) READ ALL INSTRUCTIONS CAREFULLY BEFORE YOU BEGIN
Submit on CanvasGradescope |

In Lab 3B, you will return to the video you recorded in Lab 3A and begin working with it as data. The goal of this lab is to move from raw video to structured representations and then to a grounded analysis of how action is organized over time. This lab has three closely connected components:

1. a timestamped index of your video recording,
2. a detailed multimodal transcript of a particularly important segment, and
3. a short analysis of the organization of action in that segment, using concepts from class.

Together, these components allow you to slow activity down, make its structure visible, and begin to articulate how cognition emerges through coordinated action involving people, bodies, tools, and environments.

SEE CANVAS FOR AN EXAMPLE INDEX, TRANSCRIPT AND ANALYSIS

LEARNING OBJECTIVES

1. Practice transforming video recordings into structured data for analysis data.
2. Learn to identify analytically significant moments within extended activity.
3. Represent action across multiple modalities (e.g., talk, gesture, gaze, posture, object use).
4. Analyze how actions are organized in time and space to accomplish cognitive work using course concepts , and ground analytic claims explicitly in observable data.

DELIVERABLE

Use the to submit one PDF document that includes all three components:

1. Video Index (minimum 10 minutes of indexed video)
2. Multimodal Transcript ( 30 seconds of activity)
3. Organization of Action Analysis (short analytic text)

INSTRUCTIONS

PART 1: CREATE A TIMESTAMPED VIDEO INDEX

The purpose of the index is to make the overall structure of the activity visible and navigable.

• Review your full video recording multiple times.
• Select at least 10 minutes of the recording to index.
• Create a tabular index that includes timestamps (minutes:seconds) and identifies meaningful events, phases, or shifts in activity and is detailed enough that a reader could understand the flow of the activity without watching the video.

Be thoughtful about the level of granularity! The index should neither be so coarse that important structure disappears, nor so fine-grained that it becomes unreadable. FORMAT: You may wish to create your index in a spreadsheet or table, and copy this into the lab report template.

PART 2: MULTIMODAL TRANSCRIPT

The purpose of the multimodal transcript is to represent a short segment of activity in fine-grained detail, across multiple modalities. You should choose to transcribe a segment of your recorded activity that will serve as a rich example for more detailed analysislike those discussed in the papers weve read in class, and reinforced in lecture.

1. From your indexed section, choose approximately 30 seconds of activity that is interactionally rich, analytically promising, and central to the cognitive work of the activity.
2. Create multimodal transcript that includes
   1. timestamps,
   2. description of relevant activity
   3. some representation of relevant semiotic fields

You have a great degree of flexibility in both what you choose to represent, and how you choose to represent it. You should represent information about at least (3) semiotic fields, one of which being the content of any speech (utterances) made by participants. Use the example transcript examples in the papers weve read (especially those discussed in lecture) to inspire how you choose to represent your transcript on the page. You are welcome to use a combination of diagrams, icons and/or annotated screenshots. You may want to construct your transcript in a spreadsheet, or even graphic layout software like Figmaand then copy/paste the final result into the lab report

1. You are encouraged to use Jeffersonian notation to encode features of the participants speech that are relevant to your analysis such as pacing, intonation, stress or emphasis on particular syllables. (see example on Canvas and also )
2. Be sure to choose semiotic fields strategically. You do not need to encode everything you seefocus on what matters for your analysis of how the activity works. Consider focusing on the flow of information in the activity, and the spatial and temporal organization of semiotic resources.

PART 3: ANALYZE THE ORGANIZATION OF THE ACTIVITY

Using your multimodal transcript as data, write a short analysis (250-500 words) that examines how action is organized in the selected segment. Your analysis should address questions such as:

1. What is the activity? (e.g. consider levels of activity from the Lave 1984)
2. What is the environment? (e.g. consider discussions of setting from the Lave 1984)
3. How are actions sequenced and coordinated over time? (e.g. consider semiotic fields and changes in epistemic stance)
4. How are bodies, talk, tools, and environmental resources organized in relation to one another?
5. What roles do different modalities play in perception, action, and meaning-making?
6. How does this organization contribute to the cognitive work being accomplished?

Use specific evidence from your transcript (e.g. timestamps, rows, images) to support your claims. As in earlier labs, resist the temptation to explain the activity solely in terms of what participants are thinking. Instead, focus on how cognition becomes visible through interaction and coordination in the world.

GRADING RUBRIC

USE OF ARTIFICIAL INTELLIGENCE TECHNOLOGIES

The purpose of this assignment is to tune your ability to notice, observe, reflect, describe and analyze a cognitive activity. We recognize that writing is hard. However, writing is in and of itself an act of thinking. This is a situation in which it is not beneficial for your current learning or future research performance to offload the composition of writing onto an AI-based tool.

• FOR WRITING: You are not permitted to use generative AI systems (such as ChatGPT, Claude, and other synthetic text generating tools) in writing your lab report.

• You are permitted to use built-in grammar-correction based tools that are available in Google Docs.
• FOR TRANSCRIPTION: You are not permitted to use AI-based or any other automated transcription services. In fact, the time and challenge associated with creating the transcript by hand is fundamental to developing and understanding of the activity you are analyzing.

Struggling with your essay and deadlines?

Get this or a similar paper done in as fast as 4 hours, 24/7.

NB: We do not sell prewritten papers. All essays are written from scratch according to specific needs and instructions

✔Secure Service ✔ Plagiarism Free ✔On-time Delivery

WRITE MY PAPER