Research methods reliability vs validity flashcards

What is reliability in research methods?

Reliability refers to the consistency of a measure. A reliable instrument yields the same results under consistent conditions.

What is validity in research methods?

Validity indicates how well a test measures what it claims to measure. High validity means accurate results.

True or False: A test can be reliable but not valid.

True. A test can consistently produce the same results (reliable) but may not measure what it's supposed to (not valid).

Fill in the blank: __________ is the extent to which an experiment accurately represents the real world.

Ecological validity.

Compare reliability and validity.

Reliability: Consistency; Validity: Accuracy. A measure can be reliable but not valid.

What is test-retest reliability?

Test-retest reliability assesses the stability of test results over time. Compare scores from the same test taken at different times.

Example of a reliable but invalid measure?

A clock consistently runs 5 minutes fast. It reliably gives the same time, but it does not represent the actual time.

What does internal validity mean?

Internal validity refers to the degree to which an experiment accurately establishes a causal relationship between variables.

What is external validity?

External validity concerns how well the findings of a study generalize to or have relevance for settings, people, or times beyond the study.

True or False: High reliability guarantees high validity.

False. High reliability does not ensure that the measure is valid.

What is inter-rater reliability?

Inter-rater reliability measures the degree to which different raters give consistent estimates of the same phenomenon.

What is content validity?

Content validity evaluates whether a test covers the representative breadth of the topic. It ensures the measure includes all relevant content.

Fill in the blank: __________ validity assesses if a measurement tool correlates with other measures of the same construct.

Criterion-related.

Cause → Effect: Low reliability leads to...

Inconsistent results and unreliable conclusions in research findings.

What is the significance of face validity?

Face validity refers to how appropriate a measure appears to be on the surface, based on subjective judgment.

Example of a valid but unreliable measure?

A scale that fluctuates widely each time you step on it may accurately measure weight but is not reliable.

What is convergent validity?

Convergent validity checks if two measures that should be related are, in fact, found to be related.

What does a reliability coefficient indicate?

A reliability coefficient measures the degree of consistency of a test. Values range from 0 to 1, with higher values indicating better reliability.

True or False: All valid measures are reliable.

True. For a measure to be valid, it must also be reliable as it needs consistent results to be accurate.

What is split-half reliability?

Split-half reliability assesses consistency by comparing results from two halves of the same test, evaluating if both halves produce similar scores.

What is reliability?

Reliability refers to the consistency of a measure. A reliable measure produces stable and consistent results over time.

What is validity?

Validity assesses whether a test measures what it's intended to measure. It's about accuracy.

True or False: Reliability ensures validity.

False. A measure can be reliable but not valid. Consistency does not guarantee accuracy.

Fill in the blank: Reliability is to consistency as validity is to ______.

accuracy.

What is test-retest reliability?

Test-retest reliability measures the consistency of a test over time. It’s assessed by correlating scores from two different administrations.

Examples of reliability types?

- Test-retest - Inter-rater - Internal consistency

Comparison of validity types: construct vs. content.

Construct validity assesses if a test truly measures the theoretical construct. Content validity examines if the test covers the intended material.

What is internal consistency?

Internal consistency evaluates if items on a test measure the same construct. Commonly assessed using Cronbach's alpha.

Cause → Effect: High reliability leads to ______.

Stable results over time.

What is external validity?

External validity is the extent to which research findings can be generalized to real-world settings beyond the study conditions.

True or False: All valid tests are reliable.

True. For a test to be valid, it must be reliable; however, not all reliable tests are valid.

What is face validity?

Face validity refers to how suitable a test appears at face value. It assesses whether a test seems relevant to the intended purpose.

What is a common method to assess construct validity?

Using factor analysis to determine if test items group together logically.

Fill in the blank: Validity is crucial for ______.

accurate interpretations of test scores.

Examples of threats to validity?

- Sample bias - Measurement error - Confounding variables

Effect of low reliability on validity?

Low reliability can weaken validity, as inconsistent results can lead to inaccurate conclusions.

What is ecological validity?

Ecological validity refers to the degree to which research findings can be generalized to real-life settings.

Impact of high validity on research outcomes?

High validity increases confidence that results accurately reflect the phenomenon being studied.

Difference between criterion-related validity and construct validity?

Criterion-related validity measures how well one measure predicts an outcome based on another measure. Construct validity focuses on the theoretical basis of the test.

Fill in the blank: To ensure a measure is valid, it must also be ______.

reliable.