Peer review | AQA A-Level Psychology Revision

For 7182 specification, first teach in September 2025

AQA A-Level Psychology | Free Revision Notes

Estimated study time: 45 minutes

Peer review is an important quality-control process within psychological science. This Peer review A-Level Psychology revision page explains how experts assess research before decisions are made about publication or funding, how their feedback may improve the quality of an investigation and why peer review cannot guarantee that research is accurate. Understanding peer review will help you explain how psychological knowledge is checked, challenged and refined as part of the scientific process required in AQA A-Level Psychology.

Learning Objectives 🎯

By the end of this revision page, you should be able to:

• Define peer review.

• Explain the role of peer review within the scientific process.

• Describe how peer reviewers assess psychological research.

• Explain how peer review may improve the quality of research.

• Apply peer review to unfamiliar research scenarios.

• Evaluate the strengths and limitations of peer review.

Revision Notes 📚

What is peer review?

Peer review is the process through which psychological research is assessed by other experts working in the same or a closely related area.

The researchers who assess the work are known as peer reviewers. They consider whether the investigation has been designed, analysed, interpreted and reported to an acceptable scientific standard.

Peer review usually takes place before decisions are made about:

• Publishing a research report.

• Providing funding for a proposed investigation.

• Requiring the researcher to revise the work.

• Rejecting work that does not meet the required standard.

Peer review is therefore part of the wider scientific process. It provides an opportunity for research to be examined critically before it becomes part of the published body of psychological knowledge.

Understanding peer review builds on the principles that make psychological research scientific.

The role of peer review in the scientific process

The main role of peer review is to provide quality control.

Research findings may influence:

• Future psychological investigations.

• Explanations of behaviour.

• The development of practical applications.

• Decisions made by professionals and organisations.

• The allocation of research funding.

It is therefore important that research is examined carefully before it is accepted or used as evidence.

Peer reviewers may check whether:

• The research aim and hypothesis are clear.

• The method is appropriate for the research question.

• The sample and sampling method are suitable.

• Variables have been operationalised clearly.

• Extraneous variables have been controlled.

• The research procedure is described accurately.

• Ethical issues have been addressed.

• The data have been analysed appropriately.

• The conclusions follow from the findings.

• Limitations have been acknowledged.

• Enough information has been provided for the research to be replicated.

Peer review does not involve simply deciding whether the reviewer agrees with the conclusion. Reviewers should examine the quality of the evidence and the process used to produce it.

A simplified peer-review process

A peer-review process may involve the following stages:

1. The researcher prepares the work.

   
   

   This may be a completed research report or a proposal seeking funding.

2. The work is sent for review.

   
   

   Experts with relevant knowledge are selected to assess it.

3. The reviewers examine the research.

   
   

   They consider the design, procedure, analysis, interpretation and reporting.

4. The reviewers provide feedback.

   
   

   They identify strengths, weaknesses and changes that may be required.

5. A recommendation is made.

   
   

   Reviewers may recommend that the work is accepted, revised or rejected.

6. The researcher responds.

   
   

   The researcher may revise the report, explain decisions or provide further information.

7. A final decision is made.

   
   

   The organisation responsible for publication or funding considers the reviewers’ recommendations.

The exact procedure may vary, but the central principle is that research is examined by relevant experts rather than being accepted solely on the researcher’s own judgement.

Peer review and publication

Before a psychological investigation is published, peer reviewers may assess whether it meets the expected scientific standards.

They may examine:

• Whether the method can answer the research question.

• Whether important controls were used.

• Whether the results are presented clearly.

• Whether the statistical analysis is appropriate.

• Whether conclusions are supported by the data.

• Whether alternative explanations have been considered.

• Whether the report contains enough detail to be understood and replicated.

The reviewers then advise whether the work should be:

• Accepted.

• Revised before further consideration.

• Rejected.

Publication does not prove that a study is correct. It means that the work has passed a particular process of expert assessment.

Peer review and research funding

Peer review may also be used when researchers apply for money to conduct an investigation.

Reviewers may consider:

• Whether the proposed research question is worthwhile.

• Whether the planned method is suitable.

• Whether the researchers can realistically complete the investigation.

• Whether risks and ethical issues have been managed.

• Whether the expected value of the research justifies the resources required.

Funding organisations can then use these assessments when deciding which proposals to support.

Peer review helps prevent limited resources from being allocated solely according to the applicant’s own claims about the value of the research.

The wider consequences of funding and applying psychological evidence connect with how psychological research can affect society and resources.

Peer review and the quality of research design

Peer reviewers may identify flaws that the original researchers have overlooked.

For example, reviewers may notice that:

• Participants were not allocated to conditions appropriately.

• The independent variable was not clearly manipulated.

• The dependent variable was measured inconsistently.

• A repeated measures design was used without controlling order effects.

• The conditions differed in more than one important way.

• The control group was not treated comparably.

• The sample was unlikely to represent the target population.

• The procedure created demand characteristics.

• Investigator effects were not adequately controlled.

The researcher can then revise the procedure, provide a stronger justification or acknowledge the limitation more clearly.

Example: reviewing an experimental design

A psychologist submits a report on the effect of background noise on concentration.

The report states that:

• The quiet condition was completed in the morning.

• The noise condition was completed in the afternoon.

• Different researchers tested each condition.

• Participants were allowed different amounts of time.

A peer reviewer might identify time of day, investigator behaviour and task duration as possible extraneous variables.

The reviewer could request that the researcher:

• Explain how these differences may have affected the findings.

• Avoid claiming that noise was the only cause of any difference.

• Improve the procedure in a future investigation.

• Revise the conclusions so that they match the evidence.

This demonstrates how peer review may challenge an interpretation rather than simply accepting the researcher’s preferred explanation.

Peer review and operationalisation

A study may use terms such as:

• Aggression.

• Memory.

• Stress.

• Concentration.

• Helping behaviour.

These concepts must be defined in measurable terms.

A reviewer may ask whether:

• The independent variable has clearly different conditions.

• The dependent variable measures the intended concept.

• The scoring system is objective.

• Behavioural categories are observable and distinct.

• Another researcher could use the same definition.

For example, measuring concentration as “how focused a participant appears” involves considerable judgement. Measuring it as the number of correct targets identified on a defined attention task is more precise.

This links directly to defining psychological variables clearly.

Peer review and reliability

Reliability concerns the consistency of a procedure or measurement.

Reviewers may examine whether:

• Instructions were standardised.

• Equipment was used consistently.

• Questions were presented in the same way.

• Scoring rules were clear.

• Behavioural categories were interpreted consistently.

• Enough procedural detail was provided for replication.

A reviewer might ask researchers to clarify an incomplete procedure or provide evidence that observers produced consistent records.

Peer review can therefore encourage researchers to report their methods more precisely, supporting the measurement and improvement of consistency.

Peer review and validity

Validity concerns whether an investigation measures what it intends to measure and whether its conclusions are justified.

Reviewers may question:

• Whether an operational definition represents the intended concept.

• Whether extraneous variables provide alternative explanations.

• Whether demand characteristics changed participant behaviour.

• Whether findings from the sample can be applied more widely.

• Whether the setting affected the behaviour being measured.

• Whether the conclusions go beyond the evidence.

For example, a study may claim to measure aggression but record only the volume at which participants speak. A reviewer might question whether this is an adequate measure of aggression.

This can help researchers strengthen or qualify their conclusions before publication. These issues are studied further in assessing different forms of validity.

Peer review and ethical quality

Reviewers may also examine how ethical issues were managed.

They may consider whether:

• Participants received appropriate information.

• Consent was obtained.

• Deception was necessary and managed appropriately.

• Participants were protected from harm.

• The right to withdraw was respected.

• Privacy and confidentiality were protected.

• An adequate debrief was provided.

If the ethical procedure is unclear, reviewers may request further information or recommend that the work is not accepted.

Peer review therefore supports the principles covered in protecting participants during psychological investigations.

Peer review and data analysis

Psychological conclusions should be based on appropriate analysis of the collected data.

Reviewers may check:

• Whether the data were presented clearly.

• Whether the selected descriptive statistics were appropriate.

• Whether graphs and tables represent the findings accurately.

• Whether an appropriate inferential test was used.

• Whether the statistical conclusion has been interpreted correctly.

• Whether the written conclusion matches the results.

A calculation may be mathematically correct but still inappropriate if the wrong analysis has been selected.

Peer review allows an expert to examine both how the data were handled and what the researcher claims the findings show.

Peer review and scientific reporting

A research report should allow readers to understand:

• Why the investigation was conducted.

• How it was carried out.

• What was found.

• What conclusions were reached.

• What limitations remain.

Peer reviewers may request clearer descriptions or additional information where the report is incomplete.

This may improve the structure and transparency of the final report, supporting the sections used to communicate psychological investigations.

Peer review and replication

Replicability means that a study is described in enough detail for another researcher to repeat it.

Reviewers may identify missing information about:

• Participant selection.

• Experimental conditions.

• Standardised instructions.

• Materials.

• Timing.

• Scoring.

• Data analysis.

If the procedure is not described clearly, another psychologist may be unable to reproduce it.

By requesting greater detail, peer reviewers may improve replicability. Replication is important because repeated research can show whether findings are consistent or whether they may have depended on features of the original investigation.

Peer review as quality control

Peer review contributes to research quality in several connected ways.

Area of research	How peer review may contribute
Research question	Checks whether the aim and hypothesis are clear
Method	Examines whether the chosen method can answer the question
Variables	Checks manipulation, measurement and operationalisation
Controls	Identifies possible extraneous variables
Ethics	Examines whether participants were protected
Analysis	Checks whether data were handled appropriately
Conclusions	Challenges claims that are not supported by the findings
Reporting	Requests clearer information and explanation
Replicability	Encourages detailed description of the procedure
Publication or funding	Informs decisions about whether work should proceed

Strengths of peer review

Expert assessment

Research is examined by people with relevant psychological and scientific knowledge.

These reviewers may recognise:

• Methodological flaws.

• Weak operationalisation.

• Inappropriate analyses.

• Unsupported interpretations.

• Missing procedural information.

This provides a level of scrutiny beyond the researcher’s own evaluation of the work.

Researchers receive constructive feedback

Reviewers can recommend specific improvements rather than simply accepting or rejecting the research.

The researcher may be asked to:

• Clarify the method.

• Reanalyse data.

• Reduce an unsupported claim.

• Explain a limitation.

• Improve the discussion.

• Provide additional procedural details.

This can strengthen the final version of the report.

Weak evidence may be challenged

Peer review may prevent research with serious flaws from being accepted without criticism.

Reviewers can challenge conclusions that:

• Ignore alternative explanations.

• Extend beyond the sample studied.

• Are not supported by the data.

• Treat a correlation as evidence of causation.

• Fail to acknowledge limitations.

Scientific standards are encouraged

Knowing that work will be examined by other experts encourages researchers to:

• Use clear procedures.

• Justify decisions.

• Analyse evidence carefully.

• Report findings accurately.

• Address ethical issues.

• Recognise limitations.

Limitations of peer review

Peer review is an important form of quality control, but it is not a guarantee that research is correct.

Reviewers may miss errors

A reviewer examines the information presented in the report or proposal.

Some weaknesses may not be obvious, particularly if:

• The procedure is described incompletely.

• A problem occurred during data collection but was not reported.

• An error is difficult to detect.

• The data appear plausible.

• The reviewers focus on different aspects of the work.

Research may therefore pass peer review and still contain errors or weaknesses.

Reviewers may disagree

Scientific judgement is not always completely objective.

Different reviewers may reach different conclusions about:

• The importance of a study.

• The suitability of a method.

• The seriousness of a limitation.

• Whether further revisions are needed.

• Whether the evidence supports publication.

One reviewer may regard a weakness as minor, while another may consider it serious.

This means that peer-review decisions can depend partly on the judgements of the reviewers selected.

Reviewers may be influenced by expectations

Reviewers are experts, but they are still capable of bias.

They may respond more positively to:

• Familiar methods.

• Explanations that fit existing scientific thinking.

• Research questions they consider important.

They may respond more critically to work that challenges accepted ideas.

This could make it harder for unusual or conflicting findings to be accepted, even where the research has been conducted carefully.

Peer review can delay research

Detailed review takes time.

The process may include:

• Finding suitable reviewers.

• Waiting for reports.

• Revising the work.

• Responding to further questions.

• Completing another round of review.

This can delay the publication of findings or the start of a funded investigation.

The delay may be justified where it improves quality, but it remains a practical limitation.

Peer review depends on the information provided

Reviewers do not usually observe the original investigation taking place.

They rely on the submitted account of:

• The sample.

• The procedure.

• The data.

• The analysis.

• The ethical safeguards.

If important information is missing or inaccurate, the reviewer’s assessment may also be incomplete.

Peer review therefore cannot replace accurate and transparent reporting by the original researcher.

Peer review may not identify deliberate misconduct

A reviewer can inspect whether data and conclusions appear reasonable, but may not be able to determine whether every result was collected and reported honestly.

If invented or altered data appear convincing, ordinary peer review may not detect the problem.

This shows why peer review is one part of the scientific process rather than a complete guarantee of research integrity.

Peer review does not prove a finding is true

A published study may have passed expert assessment, but its findings may later be:

• Challenged by other researchers.

• Explained in a different way.

• Limited to particular participants or settings.

• Found not to occur consistently when the study is repeated.

• Revised in light of further evidence.

Scientific knowledge develops through continued testing, criticism and replication.

Peer review filters and improves research, but it does not create certainty.

Balancing strengths and limitations

An effective evaluation should avoid two extreme conclusions:

• Peer review guarantees that published research is correct.

• Peer review has no value because it is imperfect.

A more balanced judgement is:

Peer review provides valuable expert scrutiny and may improve research before publication or funding. However, reviewers can disagree, errors may be missed and the process depends on the quality of the information submitted. It therefore improves research quality without guaranteeing accuracy.

Applying peer review to a scenario

Consider the following research report:

A psychologist reports that students who use a new revision technique achieve higher test scores. Participants chose whether to use the new technique, the two groups completed different tests and the researcher concludes that the technique causes improved performance.

A peer reviewer may identify several problems.

Participant allocation

Students chose their condition, so the groups may differ in motivation or existing ability.

Measurement

The groups completed different tests, which may not have been equally difficult.

Causal conclusion

The researcher cannot be certain that the revision technique caused the difference because other variables were not controlled.

Appropriate reviewer response

The reviewer might ask the researcher to:

• Reduce the strength of the causal conclusion.

• Discuss participant variables.

• Explain whether the tests were equivalent.

• Recommend random allocation and standardised measurement in future research.

This illustrates how peer review can improve the accuracy and quality of scientific claims.

Peer review A-Level Psychology revision: answering exam questions

Questions may ask you to:

• Explain the role of peer review.

• Apply peer review to a research report.

• Explain how it improves scientific quality.

• Discuss its strengths and limitations.

• Suggest issues a reviewer should examine.

Answering an “explain” question

A complete explanation should show both what reviewers do and why it matters.

Weak answer:

Other psychologists read the study.

Stronger answer:

Experts examine the method, analysis and conclusions before publication. They may identify flaws or request revisions, which helps prevent weak or unsupported research from being accepted without scrutiny.

Answering an “apply” question

Refer directly to the research scenario.

Weak answer:

The reviewers would check the method.

Stronger answer:

The reviewers may question why participants selected their own condition because this could create systematic differences in motivation between the groups.

Answering an “evaluate” question

Include a developed strength and limitation.

For each point:

1. State the issue.

2. Explain how it affects peer review.

3. Link it to research quality.

4. Reach a reasoned judgement where appropriate.

Example strength

Peer review uses experts who can identify weaknesses in research design or analysis. This may lead researchers to revise an unclear procedure or unsupported conclusion before publication, improving the quality of the final report.

Example limitation

Reviewers may disagree because some judgements about the importance of a weakness are subjective. A study might therefore be accepted by one set of reviewers but rejected by another, limiting consistency in the process.

Peer review within a complete investigation

Peer review occurs after researchers have made decisions about:

• Aims and hypotheses.

• Sampling.

• Experimental design.

• Variables.

• Controls.

• Ethics.

• Data analysis.

• Reporting.

Reviewers may scrutinise all of these areas.

Peer review therefore draws together knowledge from across research methods and supports the analysis and reporting of a completed investigation.

Key Words 🔑

Key word	Student-friendly definition	How it may be used in an exam
Peer review	The assessment of psychological research by experts working in the same or a related field.	Define the process or explain its role in scientific research.
Peer reviewer	An expert who evaluates a research report or proposal.	Explain who assesses the quality of research.
Scientific process	The procedures through which scientific ideas are developed, tested, examined and reported.	Explain where peer review fits within psychological science.
Quality control	Procedures used to check whether research meets appropriate standards.	Explain the overall purpose of peer review.
Publication	Making a research report available to the wider scientific community.	Explain how peer review informs decisions about research reports.
Research funding	Money provided to support a proposed investigation.	Explain how reviewers may assess research before it is conducted.
Reliability	The consistency of a procedure or measurement.	Explain why reviewers examine standardisation and scoring.
Validity	The extent to which an investigation measures what it intends to measure and supports its conclusions.	Explain why reviewers check operationalisation and control.
Replicability	The extent to which a study is described clearly enough to be repeated.	Explain why reviewers may request additional procedural detail.
Objectivity	Minimising personal opinion or bias when producing and assessing scientific evidence.	Evaluate whether reviewer judgement is completely objective.
Research report	A structured account of an investigation, its method, findings and conclusions.	Apply peer review to the communication of psychological research.
Revision	A change made to research or its report in response to feedback.	Explain how reviewers may improve work before publication.

Common Mistakes ⚠️

Mistake: Saying that peer review involves participants reviewing the study.

Why this is incorrect:Peer reviewers are researchers or experts with relevant knowledge, not the participants who supplied the data.

How to improve:Refer to assessment by other experts in the same or a related field.

Mistake: Describing peer review as replication.

Why this is incorrect:Peer review examines a report or proposal. Replication involves repeating the investigation.

How to improve:Explain that reviewers may check whether replication is possible, but they do not necessarily repeat the study themselves.

Mistake: Claiming that peer review proves the findings are correct.

Why this is incorrect:Reviewers may miss errors, and later research may challenge the findings.

How to improve:State that peer review improves quality and credibility but does not guarantee accuracy.

Mistake: Explaining only the publication role of peer review.

Why this is incorrect:Peer review can also inform decisions about research funding and revisions.

How to improve:Include the assessment of completed reports and proposed investigations.

Mistake: Giving a vague strength such as “it makes the study better”.

Why this is incorrect:The answer does not identify what the reviewers examine or what improvement may result.

How to improve:Explain that reviewers may identify an uncontrolled variable, inappropriate analysis or unsupported conclusion and request a revision.

Mistake: Giving a limitation without explaining its consequence.

Why this is incorrect:A statement such as “reviewers can be biased” is undeveloped.

How to improve:Explain that expectations may influence which methods or conclusions reviewers accept, making decisions less objective.

Mistake: Assuming that all reviewers will reach the same decision.

Why this is incorrect:Experts may judge the importance of methods, findings and limitations differently.

How to improve:Recognise that peer review includes human judgement and may not produce complete agreement.

Mistake: Evaluating the research study instead of evaluating peer review.

Why this is incorrect:A question about the limitations of peer review requires discussion of the review process itself.

How to improve:Focus on expert judgement, errors being missed, possible bias, delay and dependence on submitted information.

Exam-Style Questions ✍️

Question 1

Define peer review. (2 marks)

Question 2

State one role of peer review in the scientific process. (1 mark)

Question 3

Explain how peer review may contribute to the reliability of psychological research. (3 marks)

Question 4

A researcher submits a report in which the procedure is described only briefly.

Explain why a peer reviewer might ask the researcher to provide more procedural detail. (3 marks)

Question 5

A psychologist concludes that a new teaching method caused higher test scores. However, participants chose which teaching method they received.

Explain one issue that a peer reviewer might identify. (3 marks)

Question 6

A research proposal involves asking participants about distressing personal experiences. The proposal does not explain how participants will be protected or how their information will be stored.

Explain two issues that peer reviewers should consider before recommending funding. (4 marks)

Question 7

Explain two ways in which peer review may improve the quality of a psychological research report. (4 marks)

Question 8

A peer-reviewed study is later found to contain an important error in its analysis.

Explain why this finding does not necessarily mean that peer review has no value. (4 marks)

Question 9

Discuss two limitations of peer review. (6 marks)

Question 10

A psychologist submits the following research report:

• Participants were placed into groups according to their own preferences.

• The instructions differed between the groups.

• The dependent variable was described only as “motivation”.

• The researcher concluded that the independent variable definitely caused the result.

• No details were provided about consent or confidentiality.

Explain how peer review could be used to improve the quality of this research before publication. (8 marks)