Psychology 3214

Learning

Calendar of Topics and Class Materials - Spring 2023

Classical Conditioning: Basics
Jan
18
W
Course Description & Requirements

*
*

What is a reflex?

--------------------------------------------------------------

The Issue of Continuity among Creatures

A cat feeling harassed?

A horse doing math?

A parrot that understands language?

Talk therapy for your pet?

Koko's strange request

--------------------------------------------------------------

Descartes: Inventor of the term Reflex
(1596 - 1650)

Human vs. Nonhuman

Descartes Philosophy

A walk through the gardens

The mixed nature of humankind

Mind and body

Pineal gland in action

--------------------------------------------------------------

Marshall Hall: Definition of Reflex
(1790 - 1857)

Brain vs. Spinal Cord

Voluntary vs. Involuntary Response Distinction

Reflex Definition -- #1 

--------------------------------------------------------------

Another Definition: Predictable Relationship

Ivan Sechenov

Sechenov's Approach

Pavlov's Definition of Reflex - Predictable Relationship

B. F. Skinner (1931) Definition of Reflex - Correlation

Reflex Definition -- #2 

--------------------------------------------------------------

A Current Animal Cognition Controversy and more and Descartes

A Skeptical Analysis of the Nonhuman Acquisition of Language focusing on Koko

--------------------------------------------------------------

Summary of Two Definitions of Reflex

  * *

The Classical Conditioning Effect

Ivan Petrovich Pavlov
(1849 - 1936)

Pavlov in surgery

Pavlov is awarded Nobel Prize

Pavlov's Special Lab

Pavlov in Lab

Dog in apparatus

Kymograph Records

The issue of "Psychic Secretions" vs "Psychic Reflexes"

--------------------------------------------------------------

Label Classical Conditioning Exercise

--------------------------------------------------------------

Human Digestive System

The case of Alexis St. Martin -&- William Beaumont

RadioLab podcast on Beaumont and St. Martin

The Pavlov Institute of Physiology

Pictures of Pavlov's Dogs

[trivia] Pavlov's Steak

[humor] Pavlov's Brother


*
*

Acquisition of the Effect

Eyeblink Conditioning  


--------------------------------------------------------------

Basic Procedures (Variation 1) 

Basic Procedures (Variation 2) 

Delay vs Trace (Variation 1) 

Delay vs Trace (Variation 2) 


--------------------------------------------------------------

Label Acquisition Procedure Exercise

--------------------------------------------------------------

Bad CC Diagram



*
*

Extinction of the Effect

Spontaneous Recovery Effect (Rescorla, 2004)

Rapid Reacquisition

Latent Inhibition Effect

Renewal Effect

--------------------------------------------------------------

Rat in Classical Conditioning Procedure


*
*

Inhibition

Table of Contents from Pavlov (1927)

Differential Conditioning

Summary of 4 Extinction Effects


* *

Watson & Rayner (1920)

Questions to focus on while reading Watson & Rayner

--------------------------------------------------------------

John B. Watson -- Why he is famous?

John B. Watson
(1878 - 1958)

Biographical Info On John B. Watson

JBW's House

JBW at Furman

Watson and Rayner

--------------------------------------------------------------

What is the effect of other stimuli?

Generalization Gradient -- How to interpret and why it is important
--------------------------------------------------------------

What happened to Little Albert? Current views
--------------------------------------------------------------

Mary Cover Jones

Jones (1924) - Elimination of Children's Fears

 

*
*
*

Application assignment #1

John B. Watson moves to Advertising -- More Classical Conditioning

Example Ads: Old Style vs. New Style

--------------------------------------------------------------

Adventures with Ludicrous CC Applications: Sexy Women Sell Firearms

 

Feb 3 F Apply Classical Conditioning Analysis to Example Case  
Feb
6
M

Question & Answer - Review [ Study Guide ]

Feb
8
W
Test 1
     

Test 1 Results

Test 1 - 12:00

Classical Conditioning: Modern Work & Explanations

*
*

Pavlov's Cortical Explanation

Table of Contents from Pavlov (1927)


Summary Analysis of the classical conditioning effect

---------------------------------------------------------------

Lecture 17 & the Shenger-Krestovnikova Experiment - (What does "Experimental Neurosis" effect tell us?)
--------------------------------------------------------------

J. Hughlings Jackson

Homunculus


*
*

What makes a good CS?

--------------------------------------------------------------

Pavlov

Analysis of the effect
--------------------------------------------------------------

Robert Rescorla

Contiguity vs. Contingency in basic conditioning procedure

Rescorla experimental procedure  

Practice exercise with Contiguity vs Contingency analysis 
--------------------------------------------------------------


*
*

What makes a good UCS?

Pavlov's Answer - Biological Potency

the Blocking Effect & Kamin's Answer

Blocking Effect - Lecture Summary  

Blocking Effect Results - Summary

--------------------------------------------------------------

Leo Kamin & Harvard in the 1950s  - Kamin's Account 


*
*

Prediction of Conditioning Effects

Rescorla - Wagner Model

Rescorla - Wagner Model Acquisition Process (So you want to be a CS, Laddie?)

Rescorla - Wagner Model Summary


*
*
Rescorla - Wagner Model Successes & Failures

Rescorla - Wagner Model - Extinction & Latent Inhibition Summary 




*
*

Prediction of the Conditioned Response

Solomon's Opponent Process Model

Solomon, Kamin, & Wynne apparatus 

Hedonic changes with experience #1  #2  #3 

General Pattern of Response

Dynamics of Pattern - Early

Dynamics of Pattern - Many Encounters

Early vs. Late

Opponent Process Model Summary 

--------------------------------------------------------------

Homeostasis -- The active body attempts to maintain the 'optimal' state

W B Cannon - Wisdom of the Body  

Example -- Body Temperature Regulation

--------------------------------------------------------------

Prediction of Tolerance, Craving, and Withdrawal

Shepard Siegel 

Opponent responses in heroin use

Siegel & Ellsworth (1986)

-- The Siegel, Hinson, Krank & McCully (1982) Experiment  --

Title page of the experiment

Results of the experiment

Application assignment #2

--------------------------------------------------------------

Reminder -- Analysis of the Classical Conditioning effect according to Pavlov

Karl Zener

Zener Cards

Shuttle Box Apparatus


*
*

Application assignment due

 


Other "opponent process" cases

Rebound headaches

Nasal Spray addiction

Tachyphylaxis

Rebound Effects

Is this a good way to deal with antidepressant "poop out"?

The story of someone who is Addicted to Coke  (of the Diet Coke variety)

Your analysis problem of the person who is addicted to Coke 

Mar
6
M

Question & Answer - Review [ Study Guide ]

Mar
8
W

Test 2 




Test 2 Results

Test 2 - 12:00

Mar 13-17 M-F Spring Break
Operant Conditioning: "Law of Effect" Basics

*
*

Thorndike introduces the Law of Effect

Charles Darwin - Voyage of the Beagle

Continuity Among Species - Darwin's Finches

Comparative Psychology - George Romanes argues by Anecdote

Edward Lee Thorndike tests the mental continuity argument

Example Puzzle Box

More Actual Puzzle Boxes 

Actual Learning Curve 

Thorndike's Law of Effect

--------------------------------------------------------

Thorndike and Connectionism

Neural Nets, Machine Learning, and the New Connectionism

--------------------------------------------------------

Summary of Darwin's Theory of Evolution 

Relationship of Theory of Evolution to Law of Effect 

--------------------------------------------------------

A short, fun, and useful read...

Introduction to Animal Intelligence by E. L. Thorndike

--------------------------------------------------------

Complex behavior does not mean a complex brain

Building a spider web 

--------------------------------------------------------

Examples of Quick Evolutionary Changes

Italian Wall Lizard

Brown Anole Lizard

Galapagos Finch


*
*

Alternative explanations of the Puzzle Box results

J. B. Watson -- Watson's alternative analysis of Thorndike's  Puzzle Box results

Guthrie and Horton Puzzle Box

Cat B

Cat G

Edwin Guthrie's alternative

Brian Wansink - Mindless Eating

Textbook: 325-326

--------------------------------------------------------

Modern Version of Guthrie (with a smidgen of Skinner)

BJ Fogg "Tiny Habits"

Video Here

  * *

Three approaches to a "Law of Effect"

Hull - Drive reduction  (Need--Drive Hypothesis)

S-R Diagram and Label Terms

Example Postulate

Summary of Hull Need-Drive Theory 


* *

A Problem for Hull - Harry Harlow

Harlow's General Procedures

Harlow's Results
Harlow (1958) Fig. 5

Harlow (1958) Fig. 6

Another Problem for Hull?

Meehl - Transituational Law of Effect - Meehl (1950)

Textbook:

  * *

Skinner - Empirical Law of Effect
(1904 - 1990)

--------------------------------------------------------

Positive Reinforcement Tutorial

Negative Reinforcement University

Skinner (1953) - Empirical Law of Effect

Example circularity problem

Brief biography of Skinner by his daughter

Another biography of Skinner by Howard Rachlin

Skinner In His Own Words

Textbook: 213-232


*
*

Empirical Law of Effect Exercises

Label the effect #1 

Label the effect #2 

Label the effect #3 

Label the effect #4 

Label the effect #5 

Label the effect #6 

Label the effect #7 

Label the effect #8 

Label the effect #9 

Label the effect #10 

--------------------------------------------------------

Summary of Empirical Law of Effect Analysis

--------------------------------------------------------

Nutraloaf: Food as a punisher?

Bart & Lisa use a contingency. But what is the contingency?

Application assignment #3


*
*

Application assignment due

Apr
5
W

Question & Answer - Review [ Study Guide ]

Apr
10
M

Test 3

     

Test 3 Results

Test 3 - 12:00

Operant Conditioning: Modern Work & Theory
*
*
*

Origin of New Responses

Skinner - Shaping by successive approximations

Girl with Violin

Skinner's Minnesota Lab

Pigeons Playing Ping Pong

Operant Conditioning Chamber

--------------------------------------------------------------

Skinner Shaping a Response [Warning: 6 Mb file]

Training Rats as Bomb Detectors (The Video)

Pouched Rat at Work

Charles Mingus Trains a Cat to Use a Toilet

Panhandle Story

Skinner (1951) How to Teach Animals

--------------------------------------------------------------


*

*

Reinforcement schedules

Operant Chamber

Operation of a Cumulative Recorder

Real Cumulative Recorder

Bank of Cumulative Recorders

---------------------------------------------

Development of Skinner's Operant Chamber

Skinner (1956) - Figure 5

Skinner (1956) - Figure 8

Skinner (1956) - Figure 12

---------------------------------------------


---------------------------------------------


  * *

Reinforcement schedules - Summary 

4 Schedule Performances

---------------------------------------------

Fish Hunter Games

Game Table Here

Game Demo Here

Another Game Demo Here

How to Play Here

Article on Fish Hunter Games Here

Article on Hooked Player Here

---------------------------------------------

Nir Eyal - What makes Technonology so Habit-Forming?

Video Here

Verbal Description Here

Summary of "Hooked" Here

---------------------------------------------

KMS at Harrah's

---------------------------------------------

Skinner (1960) Pigeons in a Pelican

Nose Cone Outside

Nose Cone Inside

  * *

Reinforcer "Value" - I

Pigeon in Operant Chamber

Multiple Schedules - Behavioral Contrast

     

Reinforcer "Value" - II

Concurrent schedules

Matching effect vs. Matching Law

Richard Herrnstein (left) and James Q. Wilson

Herrnstein (1961) Results




Reinforcer "Value" - III

Temporal Discounting & Self-Control

Howard Rachlin

Temporal Discounting Function

Self-Control Problem

Self Control Problem 2


*
*

Into the future...

Premack Approach to the Law of Effect

Premack's RunDrink Apparatus

Premack: Reward and Punishment vs Freedom

Premack Summary

Premack Reinforcement Principle 

Textbook: 279-281

  * *

Premack's Analysis of Punishment

Both Premack Principles

  * *

Timberlake & Allison - Response Deprivation Theory

  * *

Response Deprivation Theory

Response Deprivation Example 


*
*
Punishment

Timberlake Disequilibrium Model   


Application assignment #4

  * *

Application assignment due

Discussion of Application Assignment




Classical vs. Operant - Identifying & Interactions

Breland & Breland (1961)

IQ Zoo

The Tic-Tac-Toe Chicken

BFS vs the Chicken

Handshaping vs. Autoshaping

Long Box Autoshaping

Negative Autoshaping

Why is the child crying?

April
28
F
Questions & Answers - Review [ Study Guide ]
May
1
M

Test 4

     

Test 4 Results

Test 4 - 12:00  

May
3
W

Discuss Final Exam

Final Exam:  Monday, 5/8 -- 11:00