Psychology Notes

Simple Choice and Concurrent Choice

With Skinner boxes and lever-pressing behavior.

There are two response alternatives, each on its own schedule of reinforcement.

Allow for continuous measurement of choice because the organism is free to change between the response alternatives at any time.

Calculate relative rate of responding for alternatvies. Rate of responding for alternative divided by total rate of responding.

BL/(BL+BR)

rL/(rL+rR) - influenced by Relative Rates of Responding

BL/BR = rL/rR - Relative Rates or Responding match Relative Rate of Reinforcement

If Sensitivity and response bias are not taken into account with a generalized formula BL/BR = b(rL/rR)^s

Bias for a response alternative because more effort is required for other alternatives without a significantly stronger reinforcer.

Does not predict that a choice will occur, it predicts the fraction of time in which a certain choice will occur.

Choosing whatever alternative is most likely to be reinforced at the time.

Distributing choices among alternatives to maximize amount of reinforcement in the "long run".

Acting to make something better. Choices are not optimal in the long run.

Choice of a larger, delayed reinforcer over a smaller, less delayed reinforcer.

Chocie of a smaller, more immediate reinforcer over a larger, more delayed reinforcer.

Reinforcer type, quality, amount, and delay

As delay for both reinforcers increase, choice for self-control increases.

Impulsivity varies as a function of delay.

Involves two stages. Choice link - participant chooses between two alternatives by making one of two responses. Terminal link - creates a reinforcement schedule for the choice made in the choice link, but not the alternatives. Precommitment is involved.

Making some prior decision which limits alternative options in decision-making.

The value of a reinforcer is reduced by how long you have to wait to get it. Predicts delay is inversely related to reinforcer value.

• V=M/(1+KD) where V = value of reinforcer, M = reward magnitude, D = reward delay, and K = the discounting rate. K increases, V decreases; K decreases, V increases.
• Differences between Associative Structure and Behavioral Regulatory perspectives?

Associated - Pavlovian, Molecular, Two-Process Theory and S-O Associations. Behavioral - Skinnerian, Molar

Assumes that there are two distinct types of learning: Pavlovian and instrumental conditioning.

Stimulus-Outcome association.

Reinforcers are not just special types of stimuli. Species-typical consummatory responses are themselves critical features of reinforcement. Reinforcers are special responses.

Difference between likelihood of instrumental and reinforcer responses. Less preferred task before preferred task equals reinforcement of less preferred task

Instrumental responses are the initial, less-preferred task; Reinforcer responses are the "reward" or high-preference tasks;

Probability of reinforcer responding is due to restricted access to reinforcer. Low probability responses can be reinforcer if restricted from it before hand.

Reinforcer does not exist independent of instrumental conditioning.

Optimal response distribution. Frequency of responses in an unconstrained situation. Organisms will defend against changes to bliss point; usually cannot be reestablished once changed.

Empty circle represents bliss point between two alternatives; line represents schedule or restrictions to alternatives; black dot represents equilibrium point closest to bliss point.

Homeostasis

Income = # of instrumental responses made; Price of Goods = # of responses needed for reinforcer

Relation between price of a commodity and how much is purchased. Price of item represents reinforcer schedule.

Degree to which price influences consumption. High elasticity means prices have large influence on purchasing behavior while low elasticity means the opposite.

Availability of Substitutes (alternative forms of reinforcement) - Price Range (increases in price have less effect at low rather than high prices) - Income Level (the more you earn the less disrupted purchasing behavior will be; influences substitutes)

Bliss Point - must assume that behaviors performed in absense of constraints are the same as when those contraints are imposed. (expirementer and environmental constraints)

Rats self-administered drug more if in the same context as when conditioned to it. Change of location helps with drug addiction.