top of page

Primary and secondary data | AQA A-Level Psychology Revision

Updated: 6 days ago

For 7182 specification, first teach in September 2025


AQA A-Level Psychology | Free Revision Notes

Estimated study time: 55 minutes

Psychologists may collect new information for an investigation or analyse information that already exists. This Primary and secondary data A-Level Psychology revision page explains how these two sources of evidence differ, how meta-analysis combines findings from several studies and why the quality of existing evidence must be assessed carefully. You will also evaluate the practical, scientific and ethical advantages and limitations of each approach. Understanding data sources is important when designing investigations, interpreting research reports and deciding whether conclusions are justified.


Learning Objectives 🎯

By the end of this revision page, you should be able to:

  • Define primary and secondary data.

  • Distinguish the source of data from its quantitative or qualitative form.

  • Identify primary and secondary data in unfamiliar investigations.

  • Explain the purpose and basic process of meta-analysis.

  • Evaluate the usefulness of primary data.

  • Evaluate the usefulness of secondary data.

  • Evaluate the strengths and limitations of meta-analysis.


Revision Notes 📚


What is a data source?

A data source identifies where the information used in an investigation came from.

Psychologists may use:

  1. Primary data, collected directly for the current investigation.

  2. Secondary data, which already existed before the current investigation.

This distinction concerns the origin of the information.

It does not tell us whether the information is:

  • Numerical.

  • Written.

  • Descriptive.

  • Experimental.

  • Observational.

  • Collected through a questionnaire or interview.

Those are separate features of the research.


Primary data

Primary data are data collected directly by a researcher for the purpose of the current investigation.

The researcher plans:

  • What information is needed.

  • Which participants or materials will be studied.

  • How the variables will be operationalised.

  • Which method will be used.

  • How the data will be recorded.

  • How the information will be analysed.

Primary data are therefore produced as part of the researcher’s own investigation.


Examples of primary data

Primary data might include:

  • Memory scores collected during an experiment.

  • Behavioural frequencies recorded during an observation.

  • Responses collected through a new questionnaire.

  • Accounts obtained during interviews.

  • Measurements of two co-variables in a correlation.

  • Material coded by the researcher during a content analysis.

  • Information collected directly during a case study.

The research method does not determine whether data are primary. The important question is whether the current researcher collected them directly for the current research purpose.


Example of primary experimental data

A psychologist investigates whether background noise affects concentration.

The researcher:

  1. Recruits participants.

  2. Places them into quiet and background-noise conditions.

  3. Gives them a concentration task.

  4. Records the number of correct responses.

  5. Compares the scores.

The concentration scores are primary data because the researcher collected them specifically for this investigation.


Example of primary observational data

A researcher observes cooperative behaviour during group activities and records:

  • Frequency of sharing.

  • Number of task-related questions.

  • Number of joint actions.

These behavioural frequencies are primary data because the researcher personally organised and carried out the observation for the current study.


Example of primary questionnaire data

A psychologist constructs a questionnaire about revision behaviour and asks students:

  • How many hours they revised.

  • Which resources they used.

  • How confident they feel.

  • Why they selected a particular revision method.

All the responses are primary data because they were collected for that investigation.

Some responses may be quantitative and others qualitative. Their shared feature is that they were collected directly by the researcher.


Control over primary data collection

When collecting primary data, researchers can make decisions about:

  • The research aim.

  • The sample.

  • The sampling method.

  • The questions or tasks.

  • The procedure.

  • The variables.

  • The testing environment.

  • The recording system.

  • The scoring criteria.

  • Ethical safeguards.

This allows the investigation to be designed around the exact research question.

For example, a psychologist investigating concentration can choose:

  • A task suited to the target population.

  • A relevant time limit.

  • A clear scoring system.

  • Appropriate experimental conditions.

  • Suitable controls.

These decisions form part of planning a complete psychological study.


Secondary data

Secondary data are data that already existed before the current investigation and are used by a researcher who did not originally collect them for the present research purpose.

The information may previously have been collected by:

  • Another psychologist.

  • A public organisation.

  • An educational institution.

  • A healthcare service.

  • A business.

  • An individual.

  • A research team conducting an earlier study.

The current researcher analyses or reuses the existing information rather than collecting an entirely new set of data from participants.


Examples of secondary data

Secondary data might include:

  • Results reported in published psychological studies.

  • An existing research database.

  • Previously collected questionnaire responses.

  • Archived interview transcripts.

  • Existing educational or workplace records.

  • Published numerical statistics.

  • Diaries, letters or written records originally produced for another purpose.

  • Audio, video or written material that already exists.

  • Findings from several studies used in a meta-analysis.

Whether these sources can be used ethically and scientifically depends on their content, quality and the conditions under which they were originally collected.


Example of secondary numerical data

A psychologist wants to investigate whether student attendance is related to examination performance.

Instead of collecting new information, the researcher analyses an existing dataset containing:

  • Number of days attended.

  • Examination scores.

These are secondary data because the records existed before the current investigation.

The data are also quantitative because they are numerical.


Example of secondary qualitative data

A researcher investigates how people described working from home during a particular period.

The researcher analyses a collection of existing written accounts produced several years earlier.

The accounts are:

  • Secondary, because they already existed.

  • Qualitative, because they are expressed in words.

This illustrates why data source and data type must be identified separately.


Primary and secondary data compared

Feature

Primary data

Secondary data

Who collects the data?

The current researcher or research team

Another researcher, organisation or individual

Why were they originally collected?

For the current investigation

For an earlier study or a different purpose

Researcher control

Usually greater

Usually more limited

Time needed to obtain data

Often substantial

May be quicker if suitable data already exist

Fit with current aim

Can be designed precisely

May not match the current research question fully

Knowledge of the procedure

Usually detailed

May depend on the available documentation

Example

Conducting a new memory experiment

Reanalysing results from earlier memory studies


Source of data and type of data

Primary and secondary describe where data came from.

Quantitative and qualitative describe the form of the data.

These distinctions can be combined.

Example

Source

Type

New test scores collected by the researcher

Primary

Quantitative

New interview accounts collected by the researcher

Primary

Qualitative

Numerical results from an existing dataset

Secondary

Quantitative

Archived written accounts

Secondary

Qualitative

You can revise the difference between numerical and descriptive information in comparing forms of psychological evidence.


Primary data are not always quantitative

Primary data can be qualitative.

For example, a psychologist may conduct new interviews and collect detailed descriptions of participants’ experiences.

The interviews are primary because they were organised for the current investigation. The responses are qualitative because they are expressed through words.


Secondary data are not always qualitative

Secondary data can be quantitative.

For example, a psychologist may analyse numerical results from previously published investigations.

The scores are secondary because another researcher originally collected them. They remain quantitative because they are numerical.


Research method and data source

The same research method may use primary or secondary data.


Content analysis using primary data

A researcher asks participants to write a short account and then codes their responses.

The accounts are primary because they were produced specifically for the investigation.


Content analysis using secondary data

A researcher codes newspaper articles published during the previous year.

The articles are secondary because they already existed.


Correlation using primary data

A researcher directly measures each participant’s sleep and concentration.


Correlation using secondary data

A researcher calculates a correlation using an existing dataset containing sleep and concentration scores.

The method is determined by how the variables are investigated. The data source is determined by where the evidence originated.


Evaluating primary data


Strength: the data can match the research aim

A major advantage of primary data is that the researcher can collect exactly the information required.

For example, if the aim is to investigate the effect of background noise on concentration, the researcher can define:

  • The background-noise conditions.

  • The concentration task.

  • The sample.

  • The time limit.

  • The scoring system.

  • The controls.

This creates a closer match between the research question and the evidence.

With secondary data, the researcher must work with the measures that already exist.


Strength: variables can be operationalised appropriately

The researcher can decide how abstract psychological concepts will be measured.

For example, concentration could be defined as:

The number of correct responses on a 30-item visual-search task completed within five minutes.

This definition may be designed specifically for the target population and research setting.

The quality of the measure can also be tested during a small-scale trial of the proposed procedure.


Strength: greater control over the procedure

Researchers collecting primary data can attempt to control:

  • Instructions.

  • Materials.

  • Timing.

  • Testing conditions.

  • Participant allocation.

  • Recording.

  • Scoring.

  • Extraneous variables.

This may improve the validity and reliability of the investigation.

However, greater control does not guarantee good research. The procedure must still be designed and followed appropriately.


Strength: the researcher knows how the data were produced

The current researcher has direct knowledge of:

  • How participants were recruited.

  • What instructions were given.

  • Which problems occurred.

  • How responses were recorded.

  • Whether procedures changed.

  • How missing information was handled.

This may make the limitations easier to identify.

With secondary data, some details may be unavailable or unclear.


Strength: current data can be collected

Primary data can be collected from contemporary participants using current materials and settings.

This may be important where:

  • Technology has changed.

  • Social behaviour has changed.

  • Language has changed.

  • Educational or workplace practices have changed.

Collecting new data may therefore improve temporal validity.


Strength: ethical procedures can be designed for the current investigation

The researcher can plan:

  • Consent.

  • Protection from harm.

  • The right to withdraw.

  • Privacy.

  • Confidentiality.

  • Debriefing.

  • Secure data handling.

This gives the researcher an opportunity to ensure that ethical procedures fit the particular study.

However, ethical quality still depends on how those procedures are implemented.


Limitation: collecting primary data may be time-consuming

Researchers may need time to:

  • Recruit participants.

  • Obtain consent.

  • Prepare materials.

  • Pilot the procedure.

  • Collect responses.

  • Conduct interviews.

  • Transcribe recordings.

  • Score tasks.

  • Check the data.

A large investigation may take months or years to complete.


Limitation: primary research may be expensive

Costs may include:

  • Researcher time.

  • Participant expenses.

  • Equipment.

  • Software.

  • Travel.

  • Testing locations.

  • Transcription.

  • Data storage.

  • Specialist training.

A researcher may therefore be unable to collect a very large or diverse primary sample.


Limitation: access to participants may be difficult

Some populations are difficult to recruit.

Researchers may have limited access to:

  • People with rare experiences.

  • Particular workplaces or institutions.

  • Participants spread across a large geographical area.

  • People who took part in events occurring in the past.

  • Groups requiring specialist ethical safeguards.

Secondary data may provide access to information that could not easily be collected again.


Limitation: primary samples may be small

Practical limits may result in a small sample.

A small sample may:

  • Contain unusual characteristics.

  • Be less representative.

  • Produce unstable estimates.

  • Make subgroup comparisons difficult.

  • Limit generalisation.

Collecting new data does not automatically make the sample better than an existing large dataset.


Limitation: the researcher may influence data collection

Primary data collection can be affected by:

  • Demand characteristics.

  • Investigator effects.

  • Inconsistent instructions.

  • Subjective scoring.

  • Poorly designed questions.

  • Unclear behavioural categories.

The researcher’s direct involvement can therefore become both a strength and a weakness.

Control and standardisation should be considered alongside participant and investigator influences.


Limitation: the measure may not be established

A researcher may create a new task or questionnaire that has not been tested thoroughly.

The measure might have:

  • Low reliability.

  • Weak face validity.

  • Poor concurrent validity.

  • Ambiguous questions.

  • Inconsistent scoring.

Using a new measure allows a close fit with the aim, but the researcher must demonstrate that it produces useful evidence.


Evaluating secondary data


Strength: secondary data may save time

The researcher does not need to complete every stage of original data collection.

Suitable existing data may allow the researcher to move more quickly to:

  • Organising information.

  • Coding material.

  • Calculating statistics.

  • Comparing groups.

  • Interpreting findings.

This can be particularly useful when the original data took many years to collect.


Strength: secondary data may reduce costs

Existing datasets, published studies or archived materials may reduce the need for:

  • Participant recruitment.

  • Testing facilities.

  • New equipment.

  • Travel.

  • Lengthy data collection.

Some secondary sources may still require payment, access permission or extensive preparation, so secondary research is not always cost-free.


Strength: access to large datasets

Existing records may contain data from many more participants than one researcher could recruit independently.

A large dataset may allow:

  • More stable estimates.

  • Comparisons between groups.

  • Examination of uncommon outcomes.

  • Investigation of patterns across locations or periods.

However, size alone does not guarantee quality or representativeness.


Strength: access to historical information

Secondary data allow researchers to investigate:

  • Earlier time periods.

  • Changes across generations.

  • Historical patterns.

  • Events that cannot be recreated.

  • Records from participants who are no longer available.

This may support the study of temporal change.


Strength: no new burden on participants

Using existing data may avoid asking participants to repeat:

  • Lengthy tests.

  • Sensitive interviews.

  • Distressing procedures.

  • Time-consuming questionnaires.

This may reduce the practical and ethical burden associated with collecting new information.

However, researchers must still consider whether the existing information can be reused appropriately.


Strength: findings can be checked or reanalysed

Researchers may use secondary data to:

  • Check an earlier analysis.

  • Apply a different calculation.

  • Test a new research question.

  • Compare findings across studies.

  • Examine whether another interpretation is possible.

This supports scientific scrutiny and may help identify conclusions that are not fully supported by the evidence.


Limitation: the data may not fit the current aim

Secondary data were originally collected for another purpose.

The researcher may find that:

  • The variables are defined differently.

  • The required participants are missing.

  • The measure is not suitable.

  • Important questions were not asked.

  • The available categories do not match the current theory.

  • The original sample is too narrow.

The current researcher cannot simply return to the original procedure and add missing information.


Limitation: limited control over data collection

The researcher cannot change how the original data were collected.

Possible problems include:

  • Unstandardised instructions.

  • Weak sampling.

  • Inappropriate measures.

  • Missing control procedures.

  • Ambiguous questions.

  • Investigator effects.

  • Unreliable equipment.

  • Incomplete records.

These weaknesses may limit the conclusions that can be drawn.


Limitation: the quality may be difficult to judge

Researchers need enough information about the original procedure to evaluate the data.

They should consider:

  • Who collected the information.

  • Why it was collected.

  • Which sample was used.

  • How variables were operationalised.

  • Whether the procedure was reliable.

  • Whether the measure was valid.

  • How missing responses were treated.

  • Whether the findings were reported selectively.

If these details are unavailable, the current researcher may not know how much confidence to place in the evidence.


Limitation: definitions may differ

Different organisations or researchers may define the same variable in different ways.

For example, “absence” might mean:

  • Any missed session.

  • A complete missed day.

  • Unauthorised absence only.

  • Absence lasting more than a specified period.

Combining or comparing these records without checking the definitions could produce a misleading conclusion.


Limitation: the data may be incomplete

Existing records may contain:

  • Missing scores.

  • Unanswered questions.

  • Lost files.

  • Incomplete participant information.

  • Measurements collected only at certain times.

  • Inconsistent formats.

The current researcher may not be able to replace the missing information.


Limitation: secondary data may be outdated

Older data may not represent current behaviour or settings.

Changes in:

  • Technology.

  • Social expectations.

  • Education.

  • Work.

  • Communication.

  • Psychological services.

may reduce the temporal validity of the findings.

The researcher should report when the data were collected and consider whether the context has changed.


Limitation: ethical issues remain important

Existing information is not automatically free to use.

Researchers should consider:

  • Whether participants agreed to later use of their data.

  • Whether the information is confidential.

  • Whether individuals can be identified.

  • Whether sensitive information is being used appropriately.

  • Whether access has been authorised.

  • How data will be stored and reported.

The fact that data already exist does not remove ethical responsibilities.


Limitation: published data may be selective

The available information may not represent all of the research that has been conducted.

Studies with clear or statistically significant results may be more likely to be published than studies reporting little or no effect.

If researchers use only the accessible published evidence, they may obtain a distorted picture of the overall findings.

This issue is especially relevant to meta-analysis.


Primary and secondary data compared

Evaluation issue

Primary data

Secondary data

Fit with the aim

Can be designed specifically

May only partly match

Control

Researcher controls the procedure

Procedure has already occurred

Cost

Often higher

Often lower

Time

May require lengthy collection

May be quicker to access

Sample size

May be limited by resources

Large datasets may be available

Historical research

Cannot recreate the past directly

Existing records may provide access

Knowledge of data quality

Researcher knows the procedure

Depends on documentation

Current relevance

Can use contemporary participants

May be outdated

Ethical responsibility

Must be planned during collection

Still applies to access, reuse and reporting

Missing information

Researcher may correct problems during collection

Missing data may be impossible to replace

The most appropriate source depends on the research question and available evidence.


Meta-analysis


What is meta-analysis?

A meta-analysis is a method in which a researcher statistically combines the quantitative findings of several studies investigating the same or a closely related research question.

Rather than collecting a completely new set of participant responses, the researcher analyses the results of existing investigations.

Meta-analysis therefore uses secondary data.

Its purpose is to identify the overall pattern across a body of research.


Why is meta-analysis used?

Individual psychological studies may produce different findings.

For example:

  • One study reports a strong difference.

  • Another reports a small difference.

  • A third reports no clear difference.

  • The studies use samples of different sizes.

  • The studies take place in different settings.

Looking at one investigation alone may give an incomplete picture.

A meta-analysis allows researchers to combine the available results and examine whether there is an overall effect or relationship.


A simplified meta-analysis process

A researcher conducting a meta-analysis may:

  1. Define a clear research question.

  2. Decide which types of studies are relevant.

  3. Search for existing research.

  4. Apply predetermined inclusion and exclusion criteria.

  5. Evaluate whether the studies provide suitable data.

  6. Extract the relevant quantitative results.

  7. Convert the results into a form that can be compared where appropriate.

  8. Statistically combine the findings.

  9. Examine the overall pattern.

  10. Interpret the combined result.

  11. Report limitations and differences between the studies.

The final conclusion depends on which studies are included and how comparable their methods are.


Inclusion and exclusion criteria

Researchers should decide in advance which studies will be included.

Criteria might concern:

  • The research question.

  • The variables studied.

  • The participants.

  • The method.

  • The measures.

  • The type of data reported.

  • The date of the research.

  • The information available for analysis.

Predetermined criteria reduce the risk that researchers select only studies supporting their preferred conclusion.


Example of meta-analysis

Suppose several psychologists investigate whether a particular learning condition affects memory performance.

The studies differ in:

  • Sample size.

  • Participant age.

  • Memory task.

  • Duration of the learning condition.

  • Testing setting.

A researcher gathers the quantitative results from all suitable investigations and combines them statistically.

The meta-analysis may indicate:

  • An overall improvement.

  • An overall reduction.

  • Little overall difference.

  • A pattern that depends on participant or procedural characteristics.

The result represents the combined evidence from the included studies rather than the outcome of one experiment.


Meta-analysis is not a new experiment

In a meta-analysis, the researcher does not normally:

  • Recruit a new sample for the main analysis.

  • Manipulate a new independent variable.

  • Administer a new psychological task.

  • Collect new participant scores.

The researcher works with the numerical findings of studies that have already taken place.

The primary studies produced the original data. Those findings become secondary data for the meta-analyst.


Meta-analysis and literature summaries

A written summary may describe what several studies found.

A meta-analysis goes further by statistically combining suitable quantitative results.

For example, a written account might state:

  • Four studies reported an effect.

  • Two studies did not report an effect.

A meta-analysis considers the numerical findings more systematically rather than treating every study as an identical vote.

However, the quality of the combined result still depends on the quality and comparability of the included studies.


Strength: meta-analysis combines a large amount of evidence

Combining several studies usually produces a much larger total number of participants than one researcher could study alone.

This can provide a broader picture of the available evidence.

A result that appears inconsistent in a small study may become clearer when evidence from many participants is considered.


Strength: it can identify an overall pattern

Individual studies may disagree because of:

  • Small samples.

  • Different participants.

  • Different settings.

  • Variation in procedures.

  • Sampling variation.

A meta-analysis can show whether the combined body of evidence tends towards an overall effect or relationship.


Strength: findings are not based on one study

A single investigation may contain:

  • An unusual sample.

  • A measurement problem.

  • An unexpected event.

  • A result that does not occur again.

A meta-analysis draws on several investigations, reducing dependence on one set of findings.


Strength: it can help resolve apparently conflicting findings

When studies produce different conclusions, meta-analysis may help researchers examine:

  • The overall direction of the findings.

  • Whether the effect is generally small or large.

  • Whether some study characteristics are linked to different outcomes.

  • Whether the evidence remains too inconsistent for a confident conclusion.

This can provide a more balanced interpretation than selecting one preferred study.


Strength: efficient use of existing research

The researcher uses studies that have already been conducted.

This may reduce the need for:

  • New participant recruitment.

  • New experimental procedures.

  • Repetition of demanding tasks.

  • Additional data collection costs.

Meta-analysis can therefore make productive use of existing psychological evidence.


Strength: it may guide future research

A meta-analysis can identify:

  • Areas with consistent findings.

  • Questions where evidence is weak.

  • Groups that have received little attention.

  • Measures that produce conflicting outcomes.

  • Methodological problems repeated across studies.

Researchers can use this information when planning future investigations.


Limitations of meta-analysis


Limitation: the conclusion depends on the quality of the original studies

A meta-analysis cannot repair major weaknesses in the research it combines.

If the original studies contain:

  • Biased samples.

  • Poor operationalisation.

  • Unreliable measures.

  • Weak control procedures.

  • Invalid conclusions.

  • Inappropriate analysis.

the combined result may also be misleading.

A large quantity of weak evidence does not automatically become high-quality evidence.


Limitation: the studies may not be sufficiently comparable

Studies described as investigating the same topic may differ in:

  • Participant characteristics.

  • Research methods.

  • Experimental designs.

  • Operational definitions.

  • Task difficulty.

  • Settings.

  • Time periods.

  • Scoring procedures.

If the differences are substantial, combining the results into one overall value may hide important distinctions.


Example of limited comparability

Suppose studies of concentration use:

  • Number of symbols identified.

  • Number of errors.

  • Time spent on task.

  • Self-reported concentration.

  • Observer ratings of attention.

These measures may not represent exactly the same psychological outcome.

A combined conclusion about “concentration” must therefore be interpreted cautiously.


Limitation: publication bias

Publication bias occurs when research with clear or statistically significant findings is more likely to become publicly available than research showing no significant result.

A meta-analysis based mainly on published evidence may therefore overestimate the consistency or size of an effect.

Studies showing little or no relationship may have been conducted but remain unavailable.

The combined analysis can only include evidence that the researcher is able to locate and use.


Limitation: study selection may be influenced by the researcher

Researchers make decisions about:

  • Search terms.

  • Databases.

  • Dates.

  • Inclusion criteria.

  • Exclusion criteria.

  • Quality requirements.

  • Which outcomes to extract.

These decisions can influence the final conclusion.

Predetermined and clearly reported criteria improve transparency, but judgement cannot be removed completely.


Limitation: important contextual differences may be hidden

An overall result may conceal differences between:

  • Age groups.

  • Settings.

  • Cultures.

  • Task types.

  • Levels of the independent variable.

  • Time periods.

For example, an intervention may be effective for one group but not another. A single combined result may obscure this difference.


Limitation: older research may reduce temporal validity

A meta-analysis may combine studies conducted over a long period.

Changes in society, technology or research practice may mean that older and newer studies are not directly comparable.

The researcher should consider:

  • When the data were collected.

  • Whether the behaviour has changed.

  • Whether measurement tools have changed.

  • Whether the research context remains relevant.


Limitation: duplicated or overlapping data

Different reports may sometimes use the same or overlapping participant data.

If these results are treated as completely separate studies, some participants may influence the combined result more than once.

Researchers must examine reports carefully to identify possible overlap.


Limitation: missing details can prevent evaluation

Published reports may not provide every detail required to judge:

  • Sampling.

  • Reliability.

  • Validity.

  • Participant allocation.

  • Missing data.

  • Scoring.

  • Ethical procedures.

The meta-analyst may therefore need to make decisions based on incomplete information.


Limitation: meta-analysis does not automatically establish causation

If the included studies are correlational, combining them does not convert the evidence into proof of cause and effect.

Similarly, if the original experiments contain important confounding variables, the combined analysis does not remove those problems.

The conclusions must remain appropriate to the methods of the original research.


Strengths and limitations of meta-analysis

Strength

Why it is useful

Combines several studies

Provides an overview of a larger body of evidence

Uses a large combined sample

Reduces reliance on one small sample

Examines overall patterns

May clarify apparently conflicting findings

Uses existing results

Can save time and participant burden

Guides later research

Identifies gaps and recurring methodological issues

Limitation

Why it matters

Depends on original study quality

Poor research may produce a misleading combined conclusion

Studies may differ

One overall result may combine measures that are not equivalent

Publication bias

Available studies may overrepresent clear findings

Researcher selection decisions

Inclusion choices can affect the outcome

Context may be hidden

Different groups or settings may respond differently

Older findings may be included

Temporal validity may be reduced


Meta-analysis and peer review

A meta-analysis should be examined critically like any other research.

Peer reviewers may consider:

  • Whether the research question is clear.

  • Whether the search was sufficiently broad.

  • Whether inclusion criteria were appropriate.

  • Whether studies were comparable.

  • Whether poor-quality evidence was handled appropriately.

  • Whether publication bias was considered.

  • Whether the conclusions match the combined evidence.

This connects meta-analysis with the scientific scrutiny of psychological evidence.

Peer review cannot guarantee that every relevant study was found, but it allows other experts to examine the researcher’s decisions.


Meta-analysis and research reporting

A meta-analysis should report enough information for readers to understand:

  • Which question was investigated.

  • How studies were located.

  • Which studies were included.

  • Why studies were excluded.

  • Which results were extracted.

  • How the results were combined.

  • What the overall finding was.

  • Which limitations affect the conclusion.

Clear reporting allows other researchers to evaluate and potentially repeat the analysis.


Meta-analysis and quantitative data

Meta-analysis combines quantitative results.

The original studies may have used methods such as:

  • Experiments.

  • Correlations.

  • Questionnaires.

  • Observations.

The method used to collect the original data may differ, but the meta-analysis requires numerical findings that can be compared and combined appropriately.

Qualitative findings may be reviewed and interpreted across studies, but this would not be the statistical combination required by the term meta-analysis.


Meta-analysis and descriptive statistics

After collecting results from existing studies, researchers must summarise and interpret numerical evidence.

Understanding:

  • Typical scores.

  • Variation.

  • Relationships.

  • Data presentation.

helps psychologists evaluate both individual studies and combined findings.


Choosing primary or secondary data

The researcher should begin with the research aim.


Primary data may be most appropriate when:

  • Existing information does not answer the research question.

  • A new variable must be measured.

  • A specific population is required.

  • The researcher needs control over the procedure.

  • Current behaviour is being investigated.

  • The existing measures are unsuitable.

  • Detailed knowledge of data collection is essential.


Secondary data may be most appropriate when:

  • Suitable information already exists.

  • A large or historical dataset is required.

  • New data collection would be impractical.

  • Participants are difficult to access.

  • The researcher wants to check an earlier analysis.

  • Several existing studies need to be compared.

  • The cost or time of primary collection would be excessive.

Neither source is always superior. The most suitable choice depends on the aim, evidence available and quality of the procedures.


Combining primary and secondary data

A psychological investigation may use both sources.

For example, a psychologist might:

  1. Examine existing studies of examination anxiety.

  2. Use their findings to design a new questionnaire.

  3. Collect new responses from current students.

  4. Compare the primary findings with the earlier secondary evidence.

In this investigation:

  • Published findings are secondary data.

  • New questionnaire responses are primary data.

Using both sources may strengthen the investigation by combining existing knowledge with evidence collected for the current aim.

However, the researcher must distinguish clearly between:

  • What was found previously.

  • What was collected in the new study.

  • Whether the measures and samples are comparable.


Worked example: choosing a data source

A psychologist wants to investigate whether working from home is related to employee stress.


Primary-data approach

The psychologist could:

  • Recruit current employees.

  • Measure days worked from home.

  • Administer a stress questionnaire.

  • Analyse the relationship between the two co-variables.


Possible strength

The researcher can use current participants and measures designed for the exact research aim.


Possible limitation

Recruiting a large, varied sample may be expensive and time-consuming.


Secondary-data approach

The psychologist could analyse an existing workplace dataset containing:

  • Working-location records.

  • Stress questionnaire scores.


Possible strength

The dataset may include many employees and be available immediately.


Possible limitation

The stress measure or working-location categories may not match the researcher’s preferred definitions.


Meta-analysis approach

The psychologist could identify several existing quantitative studies investigating working location and stress, then combine their findings statistically.


Possible strength

The conclusion would draw on evidence from several samples and settings.


Possible limitation

The studies may define working from home or stress differently, making comparison difficult.


Worked example: evaluating an existing dataset

A researcher obtains existing records from a college.

The records include:

  • Attendance.

  • Examination scores.

  • Course studied.

  • Student age.

The researcher wants to examine the relationship between attendance and examination performance.


Why the records are secondary data

The college collected the information before the current investigation, primarily for administrative and educational purposes.


Possible advantage

The researcher can access information from a large number of students without asking each person to complete a new study.


Possible limitation

The records may not contain relevant extraneous variables, such as:

  • Previous attainment.

  • Amount of revision.

  • Course difficulty.

  • Additional support.

The researcher cannot conclude that attendance caused higher scores simply because the two variables are related.


Ethical consideration

The researcher must consider:

  • Authorised access.

  • Confidentiality.

  • Removal of identifying information.

  • Appropriate use of personal records.


Worked example: evaluating a meta-analysis

A psychologist combines the findings of 20 studies investigating whether background noise affects task performance.

The studies use:

  • Different age groups.

  • Different noise recordings.

  • Different task lengths.

  • Different measures of performance.


Possible strength

The analysis includes evidence from more participants and settings than one study.


Possible limitation

The studies may not be measuring the same form of background noise or performance.

The combined conclusion should acknowledge these procedural differences.


Publication concern

If studies reporting no difference were less likely to be published, the meta-analysis might exaggerate the overall effect.


Appropriate conclusion

The psychologist should report what the combined evidence suggests while remaining cautious about differences between studies and possible missing evidence.


Primary and secondary data A-Level Psychology revision: exam application

Examination questions may ask you to:

  • Identify whether evidence is primary or secondary.

  • Explain the difference between primary and secondary data.

  • Distinguish source from data type.

  • Explain how a meta-analysis is conducted.

  • Apply an advantage or limitation to a scenario.

  • Compare primary research with meta-analysis.

  • Evaluate a claim based on existing data.

  • Suggest an appropriate source for a proposed study.


Identifying primary data

Ask:

Did the current researcher collect this information specifically for the investigation?

If yes, it is primary data.

Example:

A psychologist interviews 15 students about their revision experiences.

The interview responses are primary data.


Identifying secondary data

Ask:

Did the information exist before the current investigation?

If yes, it is secondary data.

Example:

A psychologist analyses interview transcripts produced during an earlier study.

The transcripts are secondary data.


Explaining meta-analysis

Weak answer:

It looks at lots of studies.

Stronger answer:

A researcher identifies several quantitative studies investigating the same or a closely related question and statistically combines their findings to examine the overall pattern.

Applying an evaluation point

Weak answer:

Secondary data are quicker.

Stronger answer:

Using the college’s existing attendance records would save the researcher from collecting attendance information from every student, reducing the time needed for data collection.

Evaluating data quality

Weak answer:

The dataset is large, so it is valid.

This is incorrect because sample size does not establish validity.

Stronger answer:

Although the dataset contains many students, the original records may not include variables such as previous attainment. These missing variables could provide alternative explanations for the relationship between attendance and examination scores.

Evaluating a meta-analysis

A strong response may explain:

  1. Why combining studies is useful.

  2. How it increases the amount of evidence considered.

  3. Whether the studies are comparable.

  4. Whether the original research is high quality.

  5. Whether unpublished findings may be missing.

  6. Whether the conclusion matches the methods of the included studies.


Key Words 🔑

Key word

Student-friendly definition

How it may be used in an exam

Primary data

Information collected directly for the purpose of the current investigation.

Identify new scores, observations or responses collected by the researcher.

Secondary data

Existing information originally collected by someone else or for another purpose.

Identify the use of records, datasets or previous research.

Data source

The origin of the information used in an investigation.

Distinguish primary and secondary evidence.

Quantitative data

Information represented numerically.

Describe the form of scores used in a meta-analysis.

Qualitative data

Information expressed through words or descriptions.

Identify written accounts or interview transcripts within primary or secondary data.

Meta-analysis

The statistical combination of quantitative findings from several studies investigating the same or a closely related question.

Explain how psychologists identify an overall pattern across research.

Existing dataset

A collection of data that was produced before the current investigation.

Identify a source of secondary data.

Inclusion criteria

Predetermined rules explaining which studies will be included in an analysis.

Explain how study selection can be made more systematic.

Exclusion criteria

Predetermined rules explaining which studies will not be included.

Explain why some research may be left out of a meta-analysis.

Publication bias

The possibility that studies with clear findings are more likely to become publicly available than studies with no significant result.

Evaluate whether a meta-analysis includes a balanced body of evidence.

Operationalisation

Defining a variable precisely so it can be measured.

Explain why existing studies may not be directly comparable.

Temporal validity

The extent to which findings remain applicable over time.

Evaluate older secondary data.

Reliability

The consistency of a procedure or measurement.

Assess the quality of the original data used in secondary research.

Validity

The extent to which research measures what it intends to measure and supports appropriate conclusions.

Evaluate whether existing data answer the current research question.

Replication

Repeating an investigation using the same or a comparable procedure.

Explain how existing findings may be checked before being combined.


Common Mistakes ⚠️


Mistake: Defining primary data as quantitative data.

Why this is incorrect:Primary describes who collected the information and why. Primary data may be numerical or qualitative.

How to improve:Identify the source and form of the data separately.


Mistake: Defining secondary data as qualitative data.

Why this is incorrect:Existing information may include numerical scores, written accounts or both.

How to improve:Ask whether the information already existed before the current study.


Mistake: Assuming published data are always high quality.

Why this is incorrect:A published study may still contain sampling, measurement, control or interpretation weaknesses.

How to improve:Evaluate how the original data were collected before using the findings.


Mistake: Saying that primary data are always more valid.

Why this is incorrect:New data may be based on a weak measure, biased sample or poorly controlled procedure.

How to improve:Judge validity using the design and measurement rather than the data source alone.


Mistake: Saying that secondary data have no ethical issues because the data already exist.

Why this is incorrect:The information may be private, confidential or unsuitable for reuse without appropriate safeguards.

How to improve:Consider permission, anonymity, confidentiality and secure handling.


Mistake: Describing meta-analysis as repeating several experiments.

Why this is incorrect:The meta-analyst uses results from studies that have already been conducted.

How to improve:Explain that the existing quantitative findings are statistically combined.


Mistake: Describing meta-analysis as simply reading several studies.

Why this is incorrect:Meta-analysis involves statistical combination rather than only a written summary.

How to improve:Refer to extracting comparable numerical results and analysing the overall pattern.


Mistake: Claiming that a larger combined sample guarantees validity.

Why this is incorrect:A large amount of poorly measured or biased evidence may still produce a weak conclusion.

How to improve:Evaluate the quality and comparability of the original studies.


Mistake: Ignoring publication bias.

Why this is incorrect:The studies available to the researcher may overrepresent clear or statistically significant findings.

How to improve:Consider whether research reporting no effect may be missing.


Mistake: Assuming that all studies on the same topic can be combined.

Why this is incorrect:Studies may use very different participants, measures, procedures or settings.

How to improve:Explain why inclusion criteria and study comparability are important.


Mistake: Treating a combined correlation as evidence of causation.

Why this is incorrect:Combining correlational findings does not establish that one co-variable caused the other.

How to improve:Keep the conclusion appropriate to the methods used in the original studies.


Exam-Style Questions ✍️


Question 1

Define primary data. (1 mark)



Question 2

Define secondary data. (1 mark)



Question 3

A psychologist analyses examination scores and attendance figures that were previously collected by a college.

Identify the source of the data. (1 mark)



Question 4

Explain why primary data can be either quantitative or qualitative. (2 marks)



Question 5

A researcher conducts new interviews with employees and also analyses attendance records collected by their employer.

Identify the primary and secondary data in this investigation. (2 marks)



Question 6

Explain what is meant by meta-analysis. (3 marks)



Question 7

A psychologist uses an existing dataset containing the sleep duration and concentration scores of 5,000 participants.

Explain one strength and one limitation of using these secondary data. (4 marks)



Question 8

A researcher wants to investigate current student attitudes towards online learning. The only available secondary data were collected ten years ago.

Explain one limitation of using these data and suggest an alternative approach. (4 marks)



Question 9

A psychologist conducts a meta-analysis of studies investigating whether background noise affects task performance. The studies use different participant age groups, different forms of noise and different performance measures.

Explain two limitations of combining these studies. (4 marks)



Question 10

A meta-analysis reports an overall effect based on 25 published studies. Most of the original studies used small opportunity samples, and the researcher was unable to locate studies reporting no statistically significant result.

Evaluate the quality of the meta-analysis. (6 marks)



Question 11

Compare primary and secondary data. In your answer, refer to:

  • Researcher control

  • Time and cost

  • Suitability for the research aim

  • Sample size

  • Reliability and validity

  • Ethical considerations

(8 marks)



Question 12

A psychologist wants to investigate whether a revision programme improves examination performance.

Discuss whether the psychologist should:

  • Conduct a new experiment using primary data

  • Analyse an existing educational dataset

  • Conduct a meta-analysis of previous quantitative studies

Justify your answer. (8 marks)

Recent Posts

See All

Comments

Rated 0 out of 5 stars.
No ratings yet

Add a rating
bottom of page