Psychology 3214

Learning

Calendar of Topics and Class Materials - Fall 2023

Classical Conditioning: Basics
Aug
21
M
Course Description & Requirements

*
*

What is a reflex?

--------------------------------------------------------------

The Issue of Continuity among Creatures

A cat feeling harassed?

A horse doing math?

A parrot that understands language?

Talk therapy for your pet?

Koko's strange request

--------------------------------------------------------------

Descartes: Inventor of the term Reflex
(1596 - 1650)

Human vs. Nonhuman

Descartes Philosophy

A walk through the gardens

The mixed nature of humankind

Mind and body

Pineal gland in action

--------------------------------------------------------------

Marshall Hall: Definition of Reflex
(1790 - 1857)

Brain vs. Spinal Cord

Voluntary vs. Involuntary Response Distinction

Reflex Definition -- #1 

--------------------------------------------------------------

Another Definition of Reflex: Predictable Relationship

Ivan Sechenov

Sechenov's Approach

Pavlov's Definition of Reflex - Predictable Relationship

B. F. Skinner (1931) Definition of Reflex - Correlation

Reflex Definition -- #2 

--------------------------------------------------------------

Summary of Two Definitions of Reflex

  * *

The Classical Conditioning Effect

Ivan Petrovich Pavlov
(1849 - 1936)

Pavlov in surgery

Pavlov is awarded Nobel Prize

Pavlov's Special Lab

Pavlov in Lab

Dog in apparatus

Kymograph Records

The issue of "Psychic Secretions" vs "Psychic Reflexes"

--------------------------------------------------------------

Label Classical Conditioning Exercise

--------------------------------------------------------------

Human Digestive System

The case of Alexis St. Martin -&- William Beaumont

RadioLab podcast on Beaumont and St. Martin

The Pavlov Institute of Physiology

Pictures of Pavlov's Dogs

[trivia] Pavlov's Steak

[humor] Pavlov's Brother


*
*

Acquisition of the Effect

Eyeblink Conditioning  


--------------------------------------------------------------

Basic Procedures (Variation 1) 

Basic Procedures (Variation 2) 

Delay vs Trace (Variation 1) 

Delay vs Trace (Variation 2) 


--------------------------------------------------------------

Label Acquisition Procedure Exercise

--------------------------------------------------------------

Bad CC Diagram



*
*

Extinction of the Effect

Spontaneous Recovery Effect (Rescorla, 2004)

Rapid Reacquisition

Latent Inhibition Effect

Renewal Effect

--------------------------------------------------------------

Rat in Classical Conditioning Procedure


*
*

Inhibition

Table of Contents from Pavlov (1927)

Differential Conditioning

Summary of 4 Extinction Effects


* *

Watson & Rayner (1920)

Questions to focus on while reading Watson & Rayner

--------------------------------------------------------------

John B. Watson -- Why is he famous?

John B. Watson
(1878 - 1958)

Biographical Info On John B. Watson

JBW's House

JBW at Furman

Watson and Rayner

--------------------------------------------------------------

What is the effect of other stimuli?

Generalization Gradient -- How to interpret and why it is important
--------------------------------------------------------------

What happened to Little Albert? Current views
--------------------------------------------------------------

Mary Cover Jones

Jones (1924) - Elimination of Children's Fears

 

*
*
*

Application assignment #1

John B. Watson moves to Advertising -- More Classical Conditioning

Example Ads: Old Style vs. New Style





Application Assignment #1

Apply Classical Conditioning Analysis to Example Case  
Sep 13 W Discussion of Application Assignment
Sep
15
F

Question & Answer - Review [ Study Guide ]

Sep
18
M
Test 1
     
Classical Conditioning: Modern Work & Explanations

*
*

Pavlov's Cortical Explanation

Table of Contents from Pavlov (1927)


Summary Analysis of the classical conditioning effect

---------------------------------------------------------------

Lecture 17 & the Shenger-Krestovnikova Experiment - (What does "Experimental Neurosis" effect tell us?)
--------------------------------------------------------------

J. Hughlings Jackson

Homunculus


*
*

What makes a good CS?

--------------------------------------------------------------

Pavlov

Analysis of the effect
--------------------------------------------------------------

Robert Rescorla

Contiguity vs. Contingency in basic conditioning procedure

Rescorla experimental procedure  

Practice exercise with Contiguity vs Contingency analysis 
--------------------------------------------------------------


*
*

What makes a good UCS?

Pavlov's Answer - Biological Potency

the Blocking Effect & Kamin's Answer

Blocking Effect - Lecture Summary  

Blocking Effect Results - Summary

--------------------------------------------------------------

Leo Kamin & Harvard in the 1950s  - Kamin's Account 


*
*

Prediction of Conditioning Effects

Rescorla - Wagner Model

Rescorla - Wagner Model Acquisition Process (So you want to be a CS, Laddie?)

Rescorla - Wagner Model Summary


*
*
Rescorla - Wagner Model Successes & Failures

Rescorla - Wagner Model - Extinction & Latent Inhibition Summary 

*
*

Prediction of the Conditioned Response

Solomon's Opponent Process Model

Solomon, Kamin, & Wynne apparatus 

Hedonic changes with experience #1  #2  #3 

General Pattern of Response

Dynamics of Pattern - Early

Dynamics of Pattern - Many Encounters

Early vs. Late

Opponent Process Model Summary 

--------------------------------------------------------------

Homeostasis -- The active body attempts to maintain the 'optimal' state

W B Cannon - Wisdom of the Body  

Example -- Body Temperature Regulation

--------------------------------------------------------------

Prediction of Tolerance, Craving, and Withdrawal

Shepard Siegel 

Opponent responses in heroin use

Siegel & Ellsworth (1986)

-- The Siegel, Hinson, Krank & McCully (1982) Experiment  --

Title page of the experiment

Results of the experiment

Application assignment #2

--------------------------------------------------------------

Reminder -- Analysis of the Classical Conditioning effect according to Pavlov

Karl Zener

Zener Cards

Shuttle Box Apparatus

 


Other "opponent process" cases

Rebound headaches

Nasal Spray addiction

Tachyphylaxis

Rebound Effects

Prozac "poop out"

The story of someone who is Addicted to Coke  (of the Diet Coke variety)

Application Assignment #2

Your analysis problem of the person who is addicted to Coke 

Oct 16 M FALL BREAK
Oct 18 W Discussion  of Assignment #2
Oct
20
F

Question & Answer - Review [ Study Guide ]

Oct
23
M

Test 2 




Operant Conditioning: "Law of Effect" Basics

*
*

Thorndike introduces the Law of Effect

Charles Darwin - Voyage of the Beagle

Continuity Among Species - Darwin's Finches

Comparative Psychology - George Romanes argues by Anecdote

Edward Lee Thorndike tests the mental continuity argument

Example Puzzle Box

More Actual Puzzle Boxes 

Actual Learning Curve 

Thorndike's Law of Effect

--------------------------------------------------------

Summary of Darwin's Theory of Evolution 

Relationship of Theory of Evolution to Law of Effect 

--------------------------------------------------------

A short, fun, and useful read...

Introduction to Animal Intelligence by E. L. Thorndike

--------------------------------------------------------

Complex behavior does not mean a complex brain

Building a spider web 

--------------------------------------------------------

Thorndike and Connectionism

Neural Nets, Machine Learning, and the New Connectionism

--------------------------------------------------------

William James - 1865


*
*

Alternative explanations of the Puzzle Box results

J. B. Watson -- Watson's alternative analysis of Thorndike's  Puzzle Box results

Guthrie and Horton Puzzle Box

Cat B

Cat G

Edwin Guthrie's alternative

Textbook: 325-326

--------------------------------------------------------

Modern Version of Guthrie (with a smidgen of Skinner)

BJ Fogg "Tiny Habits"

Video Here

  * *

Three approaches to a "Law of Effect"

Hull - Drive reduction  (Need--Drive Hypothesis)

S-R Diagram and Label Terms

Example Postulate

Summary of Hull Need-Drive Theory 


* *

A Problem for Hull - Harry Harlow

Harlow's General Procedures

Harlow's Results
Harlow (1958) Fig. 5

Harlow (1958) Fig. 6

Another Problem for Hull?

Meehl - Transituational Law of Effect - Meehl (1950)

Meehl - Summary of Analysis

Meehl - How to use the Law of Effect   

Textbook:

  * *

Skinner - Empirical Law of Effect
(1904 - 1990)

--------------------------------------------------------

Positive Reinforcement Tutorial

Negative Reinforcement University

Skinner (1953) - Empirical Law of Effect

Example circularity problem

Brief biography of Skinner by his daughter

Another biography of Skinner by Howard Rachlin

Skinner In His Own Words

Textbook: 213-232


*
*

Empirical Law of Effect Exercises

Label the effect #1 

Label the effect #2 

Label the effect #3 

Label the effect #4 

Label the effect #5 

Label the effect #6 

Label the effect #7 

Label the effect #8 

Label the effect #9 

Label the effect #10 

--------------------------------------------------------

Summary of Empirical Law of Effect Analysis

--------------------------------------------------------

Nutraloaf: Food as a punisher?

Application assignment #3


*
*

Application assignment due

Nov
8
W

Question & Answer - Review [ Study Guide ]

Nov
10
F

Test 3

     
Operant Conditioning: Modern Work & Theory
*
*
*

Origin of New Responses

Skinner - Shaping by successive approximations

Girl with Violin

Skinner's Minnesota Lab

Pigeons Playing Ping Pong

Operant Conditioning Chamber

--------------------------------------------------------------

Skinner Shaping a Response [Warning: 6 Mb file]

Training Rats as Bomb Detectors (The Video)

Pouched Rat at Work

Charles Mingus Trains a Cat to Use a Toilet

Panhandle Story

Skinner (1951) How to Teach Animals

--------------------------------------------------------------


*

*

Reinforcement schedules

Operant Chamber

Operation of a Cumulative Recorder

Real Cumulative Recorder

Bank of Cumulative Recorders

---------------------------------------------

Development of Skinner's Operant Chamber

Skinner (1956) - Figure 5

Skinner (1956) - Figure 8

Skinner (1956) - Figure 12

---------------------------------------------


---------------------------------------------


  * *

Reinforcement schedules - Summary 

4 Schedule Performances

---------------------------------------------

Fish Hunter Games

Game Table Here

Game Demo Here

Another Game Demo Here

How to Play Here

Article on Fish Hunter Games Here

Article on Hooked Player Here

---------------------------------------------

Nir Eyal - What makes Technonology so Habit-Forming?

Video Here

Verbal Description Here

Summary of "Hooked" Here

---------------------------------------------

KMS at Harrah's

---------------------------------------------


  * *

Reinforcer "Value" - I

Pigeon in Operant Chamber

Multiple Schedules - Behavioral Contrast

     

Reinforcer "Value" - II

Concurrent schedules

Matching effect vs. Matching Law

Richard Herrnstein (left) and James Q. Wilson

Herrnstein (1961) Results




Reinforcer "Value" - III

Temporal Discounting & Self-Control

Howard Rachlin

Temporal Discounting Function

Self-Control Problem

Self Control Problem 2


*
*

Into the future...

Premack Approach to the Law of Effect

Premack's RunDrink Apparatus

Premack: Reward and Punishment vs Freedom

Premack Summary

Premack Reinforcement Principle 

Textbook: 279-281

  * *

Premack's Analysis of Punishment

Both Premack Principles


*
*
Not too hot and not too cold approach

Back to considering what the baseline tells us--

It is all how you set up the contingency--

Timberlake Disequilibrium Model   




Classical vs. Operant - Identifying & Interactions

Breland & Breland (1961)

IQ Zoo

The Tic-Tac-Toe Chicken

BFS vs the Chicken

Handshaping vs. Autoshaping

Long Box Autoshaping

Negative Autoshaping

Why is the child crying?

Nov 22 W Thanksgiving Break
Nov 24 F Thanksgiving Break
Nov 27 M Application # 3 due
Nov 29 W
Dec
1
F
Questions & Answers - Review [ Study Guide ]
Dec
4
M

Test 4

     
Dec
6
W

Discuss Optional Comprehensive Final Exam -- Details -- Q&A

Final Exam:  Friday, 12/8 -- 11:00