Psychology 3214

Learning

Calendar of Topics and Class Materials - Spring 2024

Classical Conditioning: Basics
Jan
17
W
Course Description & Requirements

*
*

What is a reflex?

--------------------------------------------------------------

The Issue of Continuity among Creatures

A cat feeling harassed?

A horse doing math?

A parrot that understands language?

Talk therapy for your pet?

Koko's strange request

--------------------------------------------------------------

Descartes: Inventor of the term Reflex
(1596 - 1650)

Human vs. Nonhuman

Descartes Philosophy

A walk through the gardens

The mixed nature of humankind

Mind and body

Pineal gland in action

--------------------------------------------------------------

Marshall Hall: Definition of Reflex
(1790 - 1857)

Brain vs. Spinal Cord

Voluntary vs. Involuntary Response Distinction

Reflex Definition -- #1 

--------------------------------------------------------------

Another Definition: Predictable Relationship

Ivan Sechenov

Sechenov's Approach

Pavlov's Definition of Reflex - Predictable Relationship

B. F. Skinner (1931) Definition of Reflex - Correlation

Reflex Definition -- #2 

--------------------------------------------------------------

A Current Animal Cognition Controversy and more and Descartes

A Skeptical Analysis of the Nonhuman Acquisition of Language focusing on Koko

--------------------------------------------------------------

Summary of Two Definitions of Reflex

  * *

The Classical Conditioning Effect

Ivan Petrovich Pavlov
(1849 - 1936)

Pavlov in surgery

Pavlov is awarded Nobel Prize

Pavlov's Special Lab

Pavlov in Lab

Dog in apparatus

Kymograph Records

The issue of "Psychic Secretions" vs "Psychic Reflexes" - Sechenov - Reflexes of the Brain   

--------------------------------------------------------------

Label Classical Conditioning Exercise

--------------------------------------------------------------

Human Digestive System

The case of Alexis St. Martin -&- William Beaumont

RadioLab podcast on Beaumont and St. Martin

The Pavlov Institute of Physiology

Pictures of Pavlov's Dogs

[trivia] Pavlov's Steak

[humor] Pavlov's Brother


*
*

Acquisition of the Effect

Eyeblink Conditioning  

--------------------------------------------------------------

Basic Procedures (Variation 1) 

Basic Procedures (Variation 2) 

Delay vs Trace (Variation 1) 

Delay vs Trace (Variation 2) 


--------------------------------------------------------------

Label Acquisition Procedure Exercise

--------------------------------------------------------------

How to identify a specific Classical Conditioning procedure

--------------------------------------------------------------


Bad CC Diagram



*
*

Extinction of the Effect

Spontaneous Recovery Effect (Rescorla, 2004)

Rapid Reacquisition

Latent Inhibition Effect

Renewal Effect

--------------------------------------------------------------

Rat in Classical Conditioning Procedure


*
*

Inhibition - What does it mean?  Effect or Process? 

Table of Contents from Pavlov (1927)

Two types of Conditioning: Excitatory (response production) vs Inhibitory (response suppression)

Differential Conditioning -- Why do responses go away?

Bouton's counter answer

Summary of 4 Extinction Effects


* *

Watson & Rayner (1920)

Questions to focus on while reading Watson & Rayner

--------------------------------------------------------------

John B. Watson -- Why he is famous?

John B. Watson
(1878 - 1958)

Biographical Info On John B. Watson

JBW's House

JBW at Furman

Watson and Rayner

--------------------------------------------------------------

What is the effect of other stimuli?

Generalization Gradient -- How to interpret and why it is important
--------------------------------------------------------------

What happened to Little Albert? Current views
--------------------------------------------------------------

Mary Cover Jones

Jones (1924) - Elimination of Children's Fears

 

*
*
*

Application assignment #1

John B. Watson moves to Advertising -- More Classical Conditioning

Example Ads: Old Style vs. New Style

--------------------------------------------------------------

Adventures with Ludicrous CC Applications: Sexy Women Sell Firearms

 

Feb 5 * Application Assignment #1 released on AsuLearn. Due by Feb 7, Noon.
Feb 7 * Apply Classical Conditioning Analysis to Assignment #1  
Feb
9
*

Question & Answer - Review [ Study Guide ]

Feb
12
*
Test 1
     

Test 1 Results

Test 1 - 12:00

Classical Conditioning: Modern Work & Explanations

*
*

Pavlov's Cortical Explanation

Table of Contents from Pavlov (1927)


Summary Analysis of the classical conditioning effect

---------------------------------------------------------------

Lecture 17 & the Shenger-Krestovnikova Experiment - (What does "Experimental Neurosis" effect tell us?)
--------------------------------------------------------------

J. Hughlings Jackson

Homunculus


*
*

What makes a good CS?

--------------------------------------------------------------

Pavlov

Analysis of the effect
--------------------------------------------------------------

Robert Rescorla

Contiguity vs. Contingency in basic conditioning procedure

Rescorla experimental procedure  

Practice exercise with Contiguity vs Contingency analysis 
--------------------------------------------------------------


*
*

What makes a good UCS?

Pavlov's Answer - Biological Potency

the Blocking Effect & Kamin's Answer

Blocking Effect - Lecture Summary  

Blocking Effect Results - Summary

Kamin's Explanation of Classical Conditioning

--------------------------------------------------------------

Leo Kamin & Harvard in the 1950s  - Kamin's Account 


*
*

Prediction of Conditioning Effects

Current approach of thinking about Classical Conditioning effect

Rescorla - Wagner Model

Rescorla - Wagner Model Acquisition Process (So you want to be a CS, Laddie?)

Rescorla - Wagner Model Summary


*
*
Rescorla - Wagner Model Successes & Failures

Rescorla - Wagner Model - Extinction & Latent Inhibition Summary 




*
*

Prediction of the Conditioned Response

Solomon's Opponent Process Model

Solomon, Kamin, & Wynne apparatus 

Hedonic changes with experience #1  #2  #3 

General Pattern of Response

Dynamics of Pattern - Early

Dynamics of Pattern - Many Encounters

Early vs. Late

Opponent Process Model Summary 

--------------------------------------------------------------

Homeostasis -- The active body attempts to maintain the 'optimal' state

W B Cannon - Wisdom of the Body  

Example -- Body Temperature Regulation

--------------------------------------------------------------

Prediction of Tolerance, Craving, and Withdrawal

Shepard Siegel 

Opponent responses in heroin use

Siegel & Ellsworth (1986)

-- The Siegel, Hinson, Krank & McCully (1982) Experiment  --

Title page of the experiment

Results of the experiment

Tolerance = Craving = Withdrawal is same conditioning effect dependent on CS and UCS presence. 

--------------------------------------------------------------

Reminder -- Analysis of the Classical Conditioning effect according to Pavlov

Karl Zener

Zener Cards

Shuttle Box Apparatus

Mar
1
*

--------------------------------------------------------------

Application assignment #2

--------------------------------------------------------------

Application assignment due by noon on March 4

 


Other "opponent process" cases

Rebound headaches

Nasal Spray addiction

Tachyphylaxis

Rebound Effects

Is this a good way to deal with antidepressant "poop out"?


Mar
6
*

Question & Answer - Review [ Study Guide ]

Mar
8
*

Test 2 




Test 2 Results

Test 2 - 12:00

Mar 11-15 * Spring Break
Operant Conditioning: "Law of Effect" Basics

*
*

Thorndike introduces the Law of Effect

Charles Darwin - Voyage of the Beagle

Continuity Among Species - Darwin's Finches

Comparative Psychology - George Romanes argues by Anecdote

Edward Lee Thorndike tests the mental continuity argument

Example Puzzle Box

More Actual Puzzle Boxes 

Actual Learning Curve 

Thorndike's Law of Effect

--------------------------------------------------------

Summary of Darwin's Theory of Evolution 

Relationship of Theory of Evolution to Law of Effect 

--------------------------------------------------------

Thorndike and Connectionism

Neural Nets, Machine Learning, and the New Connectionism

--------------------------------------------------------

A short, fun, and useful read...

Introduction to Animal Intelligence by E. L. Thorndike

--------------------------------------------------------

Complex behavior does not mean a complex brain

Building a spider web 



*
*

Alternative explanations of the Puzzle Box results

J. B. Watson -- Watson's alternative analysis of Thorndike's  Puzzle Box results

Guthrie and Horton Puzzle Box

Cat B

Cat G

Edwin Guthrie's alternative

Brian Wansink - Mindless Eating

Textbook: 325-326

--------------------------------------------------------

Modern Version of Guthrie (with a smidgen of Skinner)

BJ Fogg "Tiny Habits"

Video Here

  * *

Three approaches to a "Law of Effect"

Hull - Drive reduction  (Need--Drive Hypothesis)

S-R Diagram and Label Terms

Example Postulate

Summary of Hull Need-Drive Theory 


* *

A Problem for Hull - Harry Harlow

Harlow's General Procedures

Harlow's Results
Harlow (1958) Fig. 5

Harlow (1958) Fig. 6

Another Problem for Hull?

--------------------------------------------------------

Meehl - Transituational Law of Effect - Meehl (1950)

Summary of Transituational Law of Effect 

Textbook:

  * *

Skinner - Empirical Law of Effect
(1904 - 1990)

--------------------------------------------------------

Positive Reinforcement Tutorial

Negative Reinforcement University

Skinner (1953) - Empirical Law of Effect

Example circularity problem

Brief biography of Skinner by his daughter

Another biography of Skinner by Howard Rachlin

Skinner In His Own Words

Textbook: 213-232


*
*

Empirical Law of Effect Exercises

Label the effect #1 

Label the effect #2 

Label the effect #3 

Label the effect #4 

Label the effect #5 

Label the effect #6 

Label the effect #7 

Label the effect #8 

Label the effect #9 

Label the effect #10 

--------------------------------------------------------

Summary of Empirical Law of Effect Analysis

--------------------------------------------------------

Nutraloaf: Food as a punisher? Can food be a punisher?

Bart & Lisa use a contingency. But what is the contingency?



*


Apr
5
*

Question & Answer - Review [ Study Guide ]

Apr
8
*

Test 3

     

Test 3 Results

Test 3 - 12:00

Apr 12

Application assignment #3

Due April 17
Operant Conditioning: Modern Work & Theory
*
*
*

Origin of New Responses

Skinner - Shaping by successive approximations

Girl with Violin

Skinner's Minnesota Lab

Pigeons Playing Ping Pong

Operant Conditioning Chamber

--------------------------------------------------------------

Skinner Shaping a Response [Warning: 6 Mb file]

Training Rats as Bomb Detectors (The Video)

Pouched Rat at Work

Charles Mingus Trains a Cat to Use a Toilet

Panhandle Story

Skinner (1951) How to Teach Animals

--------------------------------------------------------------


*

*

Reinforcement schedules

Operant Chamber

Operation of a Cumulative Recorder

Real Cumulative Recorder

Bank of Cumulative Recorders

---------------------------------------------

Development of Skinner's Operant Chamber

Skinner (1956) - Figure 5

Skinner (1956) - Figure 8

Skinner (1956) - Figure 12

---------------------------------------------


---------------------------------------------


  * *

Reinforcement schedules - Summary 

4 Schedule Performances

---------------------------------------------

Fish Hunter Games

Game Table Here

Game Demo Here

Another Game Demo Here

How to Play Here

Article on Fish Hunter Games Here

Article on Hooked Player Here

---------------------------------------------

Nir Eyal - What makes Technonology so Habit-Forming?

Video Here

Verbal Description Here

Summary of "Hooked" Here

---------------------------------------------

KMS at Harrah's

---------------------------------------------

Skinner (1960) Pigeons in a Pelican

Nose Cone Outside

Nose Cone Inside

  * *

Reinforcer "Value" - I

Pigeon in Operant Chamber

Multiple Schedules - Behavioral Contrast

     

Reinforcer "Value" - II

Concurrent schedules

Matching effect vs. Matching Law

Richard Herrnstein (left) and James Q. Wilson

Herrnstein (1961) Results




Reinforcer "Value" - III

Temporal Discounting & Self-Control

Howard Rachlin

Temporal Discounting Function

Self-Control Problem

Self Control Problem 2


*
*

Into the future...

Premack Approach to the Law of Effect

Premack's RunDrink Apparatus

Premack: Reward and Punishment vs Freedom

Premack Summary

Premack Reinforcement Principle 

Textbook: 279-281

  * *

Premack's Analysis of Punishment

Both Premack Principles

  * *

Timberlake & Allison - Response Deprivation Theory

  * *

Response Deprivation Theory

Response Deprivation Example 


*
*
Punishment

Timberlake Disequilibrium Model   


Application assignment #4

  * *

Application assignment due

Discussion of Application Assignment




Classical vs. Operant - Identifying & Interactions

Breland & Breland (1961)

IQ Zoo

The Tic-Tac-Toe Chicken

BFS vs the Chicken

Handshaping vs. Autoshaping

Long Box Autoshaping

Negative Autoshaping

Why is the child crying?

Apr
26
*
Questions & Answers - Review [ Study Guide ]
Apr
29
*

Test 4

     

Test 4 Results

Test 4 - 12:00  

May
1
*

Discuss Optional Final Exam

Final Exam:  Monday - 5/6 - 11:00