Critically evaluating research

Question 1

Nullius in verba

Answer 1

Trust no one’s word other tha own judgement = skepticism

Question 2

Credibility crises in science

Answer 2

Incentives in how science is published which encourages (implicitely) academic malpractise
E.g. intentionally hyping up your own findings

Question 3

Reprodcibility crises in psychology

Answer 3

Failures to replicate famous psych studies and obtain similar results (1/3 of studies give similar results)

Question 4

Good vs transparent research

Answer 4

Good = reliable, valid, informative
Transparent = how open and honest the results/ analysis process is to the public to judge the quality

Question 5

Open science

Answer 5

Transparent research

Question 6

How is transparency shown in articles?

Answer 6

Open access data
Comprehensive methods and materials

Question 7

Good introduction in research

Answer 7

Clear narrative of pre-existing literature which are high quality cited studies
DOES NOT Cherry-pick studies to show one sided narrative
The rationale logically follows from literature: clear on research question/aim

Question 8

Good methods section in research

Answer 8

Is the method congruent in methodology?
If the method is tranparently reported, tells everything, shares research data

Question 9

Data sharing

Answer 9

Being transparent by reporting all results of the study and so we know they did not report it in a sketchy way to prove their point
State why you cannot share data if not possible

Question 10

Critically evaluating results section

Answer 10

Results aren’t too good to be true e.g. show perfect correlation
Qual = themes backed up with quotes
Quan = statistics and analysis are backed up

Question 11

Critically evaluation discussion section

Answer 11

Ensuring judtifications are backed up by results
Exploring contradictions and correspondence with other studies to explain why
How self-critical is it? is this constructive or performative

Question 12

Other areas of research to be critical of?

Answer 12

Statements of conflicts of interest
Declaration of funding
Open research: data availability and supplementary info

Question 13

Where are there conflicts of interest?

Answer 13

If funding is from particular company who supports a specific stance
Pressure to find something to be published and advance career

Question 14

When citing your sources

Answer 14

Explain briefly the info included in your own paper to strengthen your point
Explain contradictions between people’s papers and account for methodological issues
Evaluate relevant strengths and weaknesses of each + link to own study
Only relevant sources

Question 15

Whe writing research supports

Answer 15

Drawing apporpriate interpretations from data and link to wider literature, link to theoretical and practical importance of research
And identify any limitations in research AND INCLUDE IT IN CONCLUSION