Chapter 9: Extinction

Question 1

Extinction

Answer 1

• Omitting the US (classical) or reinforcer (instrumental)
• conditioned response declines
• forgetting ? Not the same; changes bc of a passage of time, not because of experience

Question 2

effects of extinction procedures

Answer 2

1. target response decreases whine no longer = in reinforcement
   - after extinction burst
2. increase in response variability (at first)
3. frustration and aggression
4. depression
5. resurgence (regression)

Question 3

Neuringer et al. (2001)

Answer 3

Rats presented 2 levers and a key in operant chamber

• 3 responses in a row to get food
• during acquisition:
  
  • group 1: had to vary response pattern
  • group 2: no variation necessary
• then extinction (no reinforcement)
  results:
  1. rate of responding
• decrease in overall rate of responding for both groups (during the reinforcement phase the control group with no variation had higher rates of responding)
  2. Response variability
• increase in response variability during extinction for both groups (but the highest response variability was found in the experimental group!)

Question 4

Tomie et al. (1993)

Answer 4

methods:

• rats water deprived
• four phases:
  1. alternative schedule of:
• 3 min: VI-30 sec delivery of water
• 3 min: no water (ext) singled by tone (S-)
  2.
• no tone and tone conditions both = no water
  3.
• same as phase 1.
  4.
• no tone and tone both = water

behavioural measure: target bite bar (target biting is a sign of frustration in rats)

Result:
phase 1.
- no water presented during tone sessions. Lots of target biting during tone sessions
see slide 12

Question 5

extinction and original learning

Answer 5

extinct does not reverse/undo original learning

• how do we know this?
  1. spontanteous recovery
  2. renewal
  3. reinstatement
  4. resurgence

Question 6

extinction is not the _______ of acquisition

Answer 6

reversal

Question 7

spontaneous recovery

Answer 7

when responding recovers after a period of rest, after extinction trials

Question 8

Rescorla (1996) Spontaneous recovery: operant conditioning

Answer 8

• responses (lever press or nose poke) acquired, then extinguished
• R-rest: tested 7 days post-extinction
• R-No rest: tested shortly after extinction
• graph: R-Rest group had higher response rates always, they were really high initially then dropped off; the no rest group always had the lower responses!

Question 9

renewal of original excitatory conditioning

Answer 9

incerased behaviour when the contextual cues that were present during extinction are changed

Question 10

Bouten and King (1983) renewal of fear

Answer 10

fear conditioning in context A
then extinction in context A
test with context A => no fear

fear conditioning in context A
extinction training in context B
test with context A => fear!

• fear measured in conditioned suppression of lever pressing
• important: original acquisition generalizes across contexts more readily than extinction performance does!!!!

Question 11

what does renewal tell us?

Answer 11

extinction is about learning new S- contexts rather than “un-learning”

Question 12

reinstatement of conditioned excitation

Answer 12

rapid recovery of conditioned behaviour produced by exposures to the US

Question 13

Reinstatement of fear in humans: :bar and Phelps (2005)

Answer 13

fear conditioning -> extinction -> US presentations -> tested with CS ( = recovery of fear)or (= no fear)

Question 14

Resurgence of conditioned behaviour

Answer 14

appearance of an extinguished response caused by the extinction of another behaviour

Question 15

techniques for enhancing extinction

Answer 15

• greater # of trials (decrease in spontaneous recovery)
• massing and spacing
• many alternations of extinction and rest sessions
• extinction in many diff contexts qa
• deepen extinction by using compound stimuli

Question 16

Compound stimuli in extinction, Rescorla (2006)

Answer 16

• rats
• three stimuli: light, noise, tone
• acquisition of lever pressing in presence of stimuli, presented independently
• compound extinction phase (light w/ one of the auditory stimuli; other with auditory alone)

results:
- compound stimuli = compound extinction trials deepened the extinction of the stimulus (also reduced reinstatement and slows rate of reaquisition)

Question 17

what is learned in extinction?

Answer 17

• SR and RO associations are not eliminated ( shown by spontaneous recovery, renewal and reinstatement)

Question 18

why does extinction reduce responding is learning persists?

Answer 18

due to an inhibitory S-R association

- non-reinforcement of a response in the presence of a particular stimulus (S) produces an inhibitory association

Question 19

extinguished effects will be highly specific to the _____ in which the response was extinguished

Answer 19

context!

Question 20

Inhibitory S-R associations in instrumental extinction: rescoral 1993)

Answer 20

• Noise and Light discriminative stimuli in extinction create expectancy
• only one response available in extinction (inhibitory S-R)
• the extinction procedure produced an inhabit S-R association that was specific to a particular stimulus and response
• can’t be due to R-O or S-O associations bc changes in these would effect R1 and R2 equally

Question 21

Paradoxical rewards effects

Answer 21

you might expect that more acquisition training = behaviours that are harder to extinguish
- NOT TRUE

Question 22

overtraining extinction effect

Answer 22

• the more acquisition trials, the greater the expectancy of reward, and the greater the frustration when extinction is introduced
• produces more rapid extinction
• odd!

Question 23

Ishida and Papini (1997)

overtraining extinction effect

Answer 23

titles that were trained longer showed more rapid extinction

Question 24

magnitude reinforcement extinction effect

Answer 24

• more rapid extinction if trained w/ larger rather than smaller magnitude reinforcer
• expectancy of greater reward produces greater frustration when it is not forthcoming

Question 25

Hulse (1958) magnitude reinforcement extinction effect

Answer 25

group reinforced 100% of the time w/ a large reward showed rapid extinction

Question 26

partial reinforcement extinction effect (PREE)

Answer 26

- schedule in effect prior to extinction is important - chief characteristic is whether the schedule was CRF or PRF - much less resistance to extinction with PRF - high and low gamblers study

Question 27

Discrimination hypothesis | Jenkins (1962)

Answer 27

easier to notice at the start of extinction if on CRF than on PRF jenkins: - 2 groups of pigeons, 1st on CRF, 2nd on PRF - both put on CRF, then immediately on extinction - 2nd group took longer to extinguish

Question 28

Frustration theory (Amsel)

Answer 28

- intermittent reinforcement (PRF) has rewarded and non-rewarded responses - reward responses motivation, non-rewarded responses are frustrating - sometimes what you expect will be a non-reinforced response produces a reinforcer - hence, frustrated responses lead to future expectation of reward; on CRF can't learn to respond when expecting non-reward

Question 29

Sequential theory (Capaldi)

Answer 29

- based on what subjects learn about the memory or non-reward - eg. you can't remember whether or not a response was reinforced in recent past - based on memory, a non-rewarded trial can become a cue for responding

Question 30

Behavioural momentum

Answer 30

- analogy with Newtonian physics - behaviour that has a lot of momentum will be hard to disrupt through manipulation - studied using multiple schedules of reinforcement - 1. diff reinforcement schedules are in effect for diff stimuli presented in succession - 2. add disruption (e.g. extra food b/w components, extinction, novel salient stimulus, etc) - 3. test how responding is affected for each schedule

Question 31

momentum of human behaviour: Mace et al. (1990)

Answer 31

VI 60, more reinforcement, more momentum

Question 32

lever pressing extinguishes less when...

Answer 32

pressing also leads to info about food elsewhere

Question 33

Fading

Answer 33

slowly extinguishing aspects of discriminative stimuli signalling reinforcement - increases success rates, decreases anxiety, prompts intrinsic reinforcement - taking the training wheels off the bike

Question 34

DRO

Answer 34

- help alleviate frustration | - blurred line b/w extinction and negative punishment

Question 35

extinction

Answer 35

response no longer produces reinforcement

Question 36

negative punishment

Answer 36

response leads to withdrawal of reinforcement