-
Baseline
In a single case design, the subject's behavior during a control period before introduction of the experimental manipulation.
-
Cohort
- A group of people born at about the same time and exposed to the same societal events
- Cohort effects are confounded with age in a cross-sectional study.
-
-
Control series design
An extension of the interrupted time series quasi-experimental design in which there is a comparison or control group
-
Cross-sectional method
- A developmental research method in which persons of different ages are studied at only one point in time
- Conceptions ally similarly to an Independent group
-
Efficiency assessment
- Once it is shown that a program does have its intended effect, researchers must determine whether it is worth the resources it consumes
- The cost of the program must be weighed against its benefits.
-
History effects
As a threat to the internal validity of an experiment, refers to any outside event that is not part
-
Instrument decay
As a threat to internal validity, the possibility that a change in the characteristics of the measurement instrument, including human observers, is responsible for the results.
-
Interrupted time series design
- A design in which the effectiveness of a treatment is determined by examining a series of measurements made over an extended time period both before and after the treatment is introduced.
- The treatment is not introduced at a random point in time
-
Longitudinal method
- A developmental research method in which the same persons are observed repeatedly as they grow older
- Conceptually similar to a repeated measures design
-
Maturation effects
As a threat to internal validity, the possiblity that any naturally occurring change within the individual is responsible for the results
-
Multiple baseline design
Observing behavior before and after a maniupalation under multiple circumstances (across different individuals, different behaviors, or different settings.)
-
Needs assessment
Ask whether there are problems that need to be addressed in a target population
-
Nonequivalent control group design
A quasi-experimental design in which nonequivalent groups of subjects participate in the different experimental groups, and there is no pretest.
-
Nonequivalent control group pretest-posttest design
A quasi-experimental design in which nonequivalent groups are used, but a pretest allows assessment of equivalency and pretest-posttest changes.
-
One-group posttest-only design
- A quasi-experimental design that has no control group and no pretest comparison
- A very poor design in terms of internal validity.
-
One-group pretest-posttest design
A quasi-experimental design in which the effect of an independent variable is inferred from the pretest-posttest difference in a single group.
-
Outcome evaluation
- Impact assessment
- Evaluation researcher must devise a way of measuring the outcome and then study the impact of the program on the outcome measure.
-
Process evaluation
- Program monitoring
- Evaluation researcher monitors it to determine whether:
- it is reaching the target population
- it is attracting enough clients
- the staff is providing the planned services
-
Program evaluation
Research designed to assess procedures (e.g., social reforms, innovations) that are designed to produce certain changes or outcomes in a target population
-
Program theory assessment
The collaboration of researchers, service providers, and prospective clients of the program to determine that the proposed program does in fact address the needs of the target population in appropriate ways.
-
Propensity score matching
A method of pairing individuals for assignment to a treatment and control condition based upon a combination of scores on participant variables.
-
Quasi-experimental design
A type of haphazard sample conducted to obtain predetermined types of individuals for the sample.
-
Regression toward the mean (statistical regression)
Principle that extreme scores on a variable tend to be closer to the mean when a second measurement is made.
-
Reversal design
- A single case design in which the treatment is introduced after a baseline period and then withdrawn during a second baseline period
- It may be extended by adding a second introduction of the treatment
- Sometimes called a "withdrawal" design
-
Selection differences
- Differences in the type of subjects who make up each group in an experimental design
- This situation occurs when participants elect which group they are to be assigned to
-
Sequential method
A combination of the cross-sectional and longitudinal design to study developmental research questions.
-
Single-case experimental design
An experiment in which the effect of the independent variable is assessed using data from a single participant.
-
Testing effects
A threat to internal validity in which taking a pretest changes behavior without any effect on the independent variable.
-
Describe single-case experimental designs and discuss reasons to use this design.
- An experiment in which the effect of the independent variable is assessed using data from a single participant.
- Reasons:
- Determine whether an experimental manipulation had an effect on a single research participant
-
Describe the five types of evaluations involved in program evaluation research: needs assessment, program assessment, process evaluation, outcome evaluation, and efficiency assessment.
- Needs assessment
- Ask whether there are problems that need to be addressed in a target population
- Program theory assessment
- The collaboration of researchers, service providers, and prospective clients of the program to determine that the proposed program does in fact address the needs of the target population in appropriate ways.
- Process evaluation
- Program monitoring
- Evaluation researcher monitors it to determine whether:
- it is reaching the target population
- it is attracting enough clients
- the staff is providing the planned services
- Outcome evaluation
- Impact assessment
- Evaluation researcher must devise a way of measuring the outcome and then study the impact of the program on the outcome measure.
- Efficiency assessment
- Once it is shown that a program does have its intended effect, researchers must determine whether it is worth the resources it consumes
- The cost of the program must be weighed against its benefits.
-
Describe the one-group posttest-only design.
- One-group posttest-only design
- A quasi-experimental design that has no control group and no pretest comparison
- A very poor design in terms of internal validity.
-
Describe the one-group pretest-posttest design and the associated threats to internal validity that may occur: history, maturation, testing, instrument decay, and regression toward the mean.
- One-group pretest-posttest design
- A quasi-experimental design in which the effect of an independent variable is inferred from the pretest-posttest difference in a single group.
- History
- As a threat to the internal validity of an experiment, refers to any outside event that is not part
- Maturation
- As a threat to internal validity, the possiblity that any naturally occurring change within the individual is responsible for the results
- Testing
- A threat to internal validity in which taking a pretest changes behavior without any effect on the independent variable.
- Instrument decay
- As a threat to internal validity, the possibility that a change in the characteristics of the measurement instrument, including human observers, is responsible for the results.
- Regression toward the mean
- Principle that extreme scores on a variable tend to be closer to the mean when a second measurement is made.
-
Describe the nonequivalent control group design and nonequivalent control group pretest-posttest design, and discuss the advantages of having a control group.
- Nonequivalent control group design
- A quasi-experimental design in which nonequivalent groups of subjects participate in the different experimental groups, and there is no pretest.
- Nonequivalent control group pretest-posttest design
- A quasi-experimental design in which nonequivalent groups are used, but a pretest allows assessment of equivalency and pretest-posttest changes.
- Advantages of having a control group:
- We can see whether the groups were the same on the pretest
- If not equivalent, we can look at changes in scores from the pretest to the posttest.
-
Distinguish between the interrupted time series design and control series design.
- Interrupted time series design
- A design in which the effectiveness of a treatment is determined by examining a series of measurements made over an extended time period both before and after the treatment is introduced.
- The treatment is not introduced at a random point in time
- Control series design
- An extension of the interrupted time series quasi-experimental design in which there is a comparison or control group
-
Describe cross-sectional, longitudinal, and sequential research designs, including the advantages and disadvantages of each design.
- Cross-sectional method
- A developmental research method in which persons of different ages are studied at only one point in time
- Conceptions ally similarly to an Independent group
- Advantages:
- Disadvantages:
- Longitudinal method
- A developmental research method in which the same persons are observed repeatedly as they grow older
- Conceptually similar to a repeated measures design
- Advantages:
- Disadvantages:
- Sequential method
- A combination of the cross-sectional and longitudinal design to study developmental research questions.
- Advantages:
- Disadvantages:
|
|
