Human Side – Cognition Framework Human-Computer Interaction

Quote from Terry Winograd HCI is the kind of discipline which is neither the study of humans nor the study of technology, but rather the bridging between the two. So you always have to have one eye open to the questions: –What can the technology do? –How can you build it ? –What are the possibilities? And one eye open to the question –What are people doing and how would this fit in? –What would they do with it ? If you lose sight of either of those you fail to design well.. I think the challenge is to really keep knowledge of both the technology and the people playing off against each other in order to develop new things

Human Side Cognition Cognitive Framework

Going for a Drive Driving a Car with a Keyboard Steering with Arrow keys Brake – Space bar Acceleration – Enter Indicators –Left – F1 –Right – F2 Horn – F3 Headlights – F4 Windscreen Wipe – F5

Going for a Drive Driving along on Highway Suddenly a Cow comes in front What do you do ? What are your chances of survival

Cognitive Psychology Psychology primarily concerned with human behavior and the mental processes that underlie it. It is primarily concerned with information processing

Cognition Process by which we became acquainted with things or in other words gain knowledge –Understanding –Remembering –Reasoning –Attending –Creating a new idea How Humans and Computers interact with one another in terms of knowledge transmitted by them

Cognition Also described in terms of specific process –Attention –Perception –Memory –Learning –Reading, speaking and listening –Problem solving, planning, reasoning, decision making many of these cognitive processes are interdependent: when you try to learn material for an exam, you need to attend the material, perceive, and recognize it, read it, think about it, and try to remember it. Thus cognition typically involves a range of processes. It is rare for one to occur in isolation

What Goes inside the head Perceiving Thinking Remembering Learning Planning a meal Imaging a trip Painting Writing Composing Understanding others Talking to others Manipulation others Making decisions Solving problems daydreaming

Experiential and Reflective Cognition Experiential It is the state of mind in which we perceive, act, and react to events around us effectively and effortlessly. It requires reaching a certain level of expertise and engagement. Examples include driving a car, reading a book, having a conversation, and playing a video game. Reflective involves thinking, comparing and decision making This kind of cognition is what leads to new ideas and creativity. Examples include designing, learning, and writing a book.

Information Processing … Lets look at how humans process information Identify the following:

So what was it ? Was it : – An elephant ? –A Tiger –An Apple –Roses Roses Of course

Information Processing Analysis Trace mental operations, whats going on in mind? Example Retrieving a friends phone number –Identifying friends Name –Retrieving meaning of words –Understanding the meaning of set of words given in the exercise –Retrieve number from memory –Generate plan and formulate the answer –Recite digits or write them down

How come we all Recognized them as Roses Behind the scenes of Information processing in Humans: –Input Channels Sight, hearing, touch, smell, taste –Encoding information from environment in some kind of internal representation –Internal representation is compared with memorized representations (Comparison) –Concerned with deciding on a response to the encoded stimulus (Response Selection) –Organizing response and necessary action (Response Execution)

Human Information Processing Model EncodingComparisonResponse Selection Response Execution

Extended Model How Information is perceived by the perceptual processors How information is attended to How information is processes and stored in Memory

Extension to the Information Processing Model EncodingComparisonResponse Selection Response Execution Attention Memory Memory

Human Processor Model Helps Conceptualize human behavior It models the cognitive processes of a user interacting with a computer. Based on the information-processing model, cognition is conceptualized as a series of processing stages where perceptual, cognitive, motor processors are organized in relation to one another. The model predicts which cognitive processes are involved when a user interacts with a computer, enabling calculations to be made how long a user will take to carry out various tasks.

Human Processor Model The information processing approach is based on modeling mental activities that happen exclusively inside the head. However, most cognitive activities involve people interacting with external kinds of representations, like books, documents, and computersnot to mentions one another. For example, when we go home from wherever we have been we do not need to remember the details of the route because we rely on cues in the environment (e.g., we know to turn left at the National Bank, right when the road comes to a New Naka, and so on )

More Models: GOMS Goals: There are the users goals, describing what the user wants to achieve. Further, in GOMS the goals are taken to represent a memory point for the user, from which he can evaluate what should be done and to which he may return should any errors occur.

More Models: GOMS Operators: These are the lowest level of analysis. They are the basic actions that the user must perform in order to use the system. They may affect the system (e.g., press the X key) or only the users mental state (e.g., read the dialogue box). There is still a degree of flexibility about the granularity of operators; we may take the command level issue the select command or be more primitive; move mouse to menu bar, press center mouse button Methods: there are typically several ways in which a goal can be split into sub goals

More Models: GOMS Selection Rules: choosing between competing methods

More Models Knowledge Representation Models: How knowledge is represented Mental Models: refer to representation people constructs in their minds of themselves, others, objects and the environment to help them know what to do in current and future situations. Write note Conceptual Models : these are the various ways in which systems are understood by different people to help designers develop appropriate interfaces. User Interaction Learning Models: How user learn to interact and become experienced in using computer system. Interface Models: these are GUIs that consists of electronic counterparts to physical objects in the real world to match the knowledge requirements of users

Metaphors Write note –Use of abstract metaphors for describing interface behavior – Use of metaphors to support user understanding

More Frameworks External Cognition Language Action Framework Distributed Cognition

External Cognition Externalizing to reduce memory load Computational offloading Annotating and Cognitive tracing

External Cognition - Externalizing Knowledge is transformed into external representations –Example birthdays –Phone numbers –Addresses –Appointments

External Cognition – Computational Offload Computational Offloading –Try the following –2 X 3 –12 X 15 –12387 X 9875

External Cognition – Annotating and Cognitive Tracing Annotating and Cognitive tracing Modify representation to reflect changes that are taking place –Annotating –Cognitive Tracing

Information Visualization

Beyond Cognitive framework Where do you think the framework lacks? –Lack of consideration for other aspects –How people interact with each other –How people interact with objects other than Computer system. –In Short Context

Distributed Cognitive framework Describing cognition as it is distributed across individuals and settings (functional systems) in which it takes place. To provide explanation to conceptualize cognitive activities Analyze processing from the following aspect –Cognitive –Social –And Organization

Distributed Cognitive framework Consider an example taking a plane to higher altitude –ATC gives clearance to pilot to fly to higher altitude (verbal) –Pilot changes altitude meter (mental and physical) –Captain observes pilot (visual) –Captain flies to higher altitude (mental and physical)

Language Action Framework