characteristics of conclusion in research paper

Get science-backed answers as you write with Paperpal's Research feature

How to Write a Conclusion for Research Papers (with Examples)

The conclusion of a research paper is a crucial section that plays a significant role in the overall impact and effectiveness of your research paper. However, this is also the section that typically receives less attention compared to the introduction and the body of the paper. The conclusion serves to provide a concise summary of the key findings, their significance, their implications, and a sense of closure to the study. Discussing how can the findings be applied in real-world scenarios or inform policy, practice, or decision-making is especially valuable to practitioners and policymakers. The research paper conclusion also provides researchers with clear insights and valuable information for their own work, which they can then build on and contribute to the advancement of knowledge in the field.

The research paper conclusion should explain the significance of your findings within the broader context of your field. It restates how your results contribute to the existing body of knowledge and whether they confirm or challenge existing theories or hypotheses. Also, by identifying unanswered questions or areas requiring further investigation, your awareness of the broader research landscape can be demonstrated.

Remember to tailor the research paper conclusion to the specific needs and interests of your intended audience, which may include researchers, practitioners, policymakers, or a combination of these.

Table of Contents

What is a conclusion in a research paper, summarizing conclusion, editorial conclusion, externalizing conclusion, importance of a good research paper conclusion, how to write a conclusion for your research paper, research paper conclusion examples.

• How to write a research paper conclusion with Paperpal? 

Frequently Asked Questions

A conclusion in a research paper is the final section where you summarize and wrap up your research, presenting the key findings and insights derived from your study. The research paper conclusion is not the place to introduce new information or data that was not discussed in the main body of the paper. When working on how to conclude a research paper, remember to stick to summarizing and interpreting existing content. The research paper conclusion serves the following purposes: 1

• Warn readers of the possible consequences of not attending to the problem.
• Recommend specific course(s) of action.
• Restate key ideas to drive home the ultimate point of your research paper.
• Provide a “take-home” message that you want the readers to remember about your study.

Types of conclusions for research papers

In research papers, the conclusion provides closure to the reader. The type of research paper conclusion you choose depends on the nature of your study, your goals, and your target audience. I provide you with three common types of conclusions:

A summarizing conclusion is the most common type of conclusion in research papers. It involves summarizing the main points, reiterating the research question, and restating the significance of the findings. This common type of research paper conclusion is used across different disciplines.

An editorial conclusion is less common but can be used in research papers that are focused on proposing or advocating for a particular viewpoint or policy. It involves presenting a strong editorial or opinion based on the research findings and offering recommendations or calls to action.

An externalizing conclusion is a type of conclusion that extends the research beyond the scope of the paper by suggesting potential future research directions or discussing the broader implications of the findings. This type of conclusion is often used in more theoretical or exploratory research papers.

Align your conclusion’s tone with the rest of your research paper. Start Writing with Paperpal Now!  

The conclusion in a research paper serves several important purposes:

• Offers Implications and Recommendations : Your research paper conclusion is an excellent place to discuss the broader implications of your research and suggest potential areas for further study. It’s also an opportunity to offer practical recommendations based on your findings.
• Provides Closure : A good research paper conclusion provides a sense of closure to your paper. It should leave the reader with a feeling that they have reached the end of a well-structured and thought-provoking research project.
• Leaves a Lasting Impression : Writing a well-crafted research paper conclusion leaves a lasting impression on your readers. It’s your final opportunity to leave them with a new idea, a call to action, or a memorable quote.

Writing a strong conclusion for your research paper is essential to leave a lasting impression on your readers. Here’s a step-by-step process to help you create and know what to put in the conclusion of a research paper: 2

• Research Statement : Begin your research paper conclusion by restating your research statement. This reminds the reader of the main point you’ve been trying to prove throughout your paper. Keep it concise and clear.
• Key Points : Summarize the main arguments and key points you’ve made in your paper. Avoid introducing new information in the research paper conclusion. Instead, provide a concise overview of what you’ve discussed in the body of your paper.
• Address the Research Questions : If your research paper is based on specific research questions or hypotheses, briefly address whether you’ve answered them or achieved your research goals. Discuss the significance of your findings in this context.
• Significance : Highlight the importance of your research and its relevance in the broader context. Explain why your findings matter and how they contribute to the existing knowledge in your field.
• Implications : Explore the practical or theoretical implications of your research. How might your findings impact future research, policy, or real-world applications? Consider the “so what?” question.
• Future Research : Offer suggestions for future research in your area. What questions or aspects remain unanswered or warrant further investigation? This shows that your work opens the door for future exploration.
• Closing Thought : Conclude your research paper conclusion with a thought-provoking or memorable statement. This can leave a lasting impression on your readers and wrap up your paper effectively. Avoid introducing new information or arguments here.
• Proofread and Revise : Carefully proofread your conclusion for grammar, spelling, and clarity. Ensure that your ideas flow smoothly and that your conclusion is coherent and well-structured.

Write your research paper conclusion 2x faster with Paperpal. Try it now!

Remember that a well-crafted research paper conclusion is a reflection of the strength of your research and your ability to communicate its significance effectively. It should leave a lasting impression on your readers and tie together all the threads of your paper. Now you know how to start the conclusion of a research paper and what elements to include to make it impactful, let’s look at a research paper conclusion sample.

How to write a research paper conclusion with Paperpal?

A research paper conclusion is not just a summary of your study, but a synthesis of the key findings that ties the research together and places it in a broader context. A research paper conclusion should be concise, typically around one paragraph in length. However, some complex topics may require a longer conclusion to ensure the reader is left with a clear understanding of the study’s significance. Paperpal, an AI writing assistant trusted by over 800,000 academics globally, can help you write a well-structured conclusion for your research paper. 

• Sign Up or Log In: Create a new Paperpal account or login with your details.  
• Navigate to Features : Once logged in, head over to the features’ side navigation pane. Click on Templates and you’ll find a suite of generative AI features to help you write better, faster.  
• Generate an outline: Under Templates, select ‘Outlines’. Choose ‘Research article’ as your document type.  
• Select your section: Since you’re focusing on the conclusion, select this section when prompted.  
• Choose your field of study: Identifying your field of study allows Paperpal to provide more targeted suggestions, ensuring the relevance of your conclusion to your specific area of research. 
• Provide a brief description of your study: Enter details about your research topic and findings. This information helps Paperpal generate a tailored outline that aligns with your paper’s content. 
• Generate the conclusion outline: After entering all necessary details, click on ‘generate’. Paperpal will then create a structured outline for your conclusion, to help you start writing and build upon the outline.  
• Write your conclusion: Use the generated outline to build your conclusion. The outline serves as a guide, ensuring you cover all critical aspects of a strong conclusion, from summarizing key findings to highlighting the research’s implications. 
• Refine and enhance: Paperpal’s ‘Make Academic’ feature can be particularly useful in the final stages. Select any paragraph of your conclusion and use this feature to elevate the academic tone, ensuring your writing is aligned to the academic journal standards. 

By following these steps, Paperpal not only simplifies the process of writing a research paper conclusion but also ensures it is impactful, concise, and aligned with academic standards. Sign up with Paperpal today and write your research paper conclusion 2x faster .  

The research paper conclusion is a crucial part of your paper as it provides the final opportunity to leave a strong impression on your readers. In the research paper conclusion, summarize the main points of your research paper by restating your research statement, highlighting the most important findings, addressing the research questions or objectives, explaining the broader context of the study, discussing the significance of your findings, providing recommendations if applicable, and emphasizing the takeaway message. The main purpose of the conclusion is to remind the reader of the main point or argument of your paper and to provide a clear and concise summary of the key findings and their implications. All these elements should feature on your list of what to put in the conclusion of a research paper to create a strong final statement for your work.

A strong conclusion is a critical component of a research paper, as it provides an opportunity to wrap up your arguments, reiterate your main points, and leave a lasting impression on your readers. Here are the key elements of a strong research paper conclusion: 1. Conciseness : A research paper conclusion should be concise and to the point. It should not introduce new information or ideas that were not discussed in the body of the paper. 2. Summarization : The research paper conclusion should be comprehensive enough to give the reader a clear understanding of the research’s main contributions. 3 . Relevance : Ensure that the information included in the research paper conclusion is directly relevant to the research paper’s main topic and objectives; avoid unnecessary details. 4 . Connection to the Introduction : A well-structured research paper conclusion often revisits the key points made in the introduction and shows how the research has addressed the initial questions or objectives. 5. Emphasis : Highlight the significance and implications of your research. Why is your study important? What are the broader implications or applications of your findings? 6 . Call to Action : Include a call to action or a recommendation for future research or action based on your findings.

The length of a research paper conclusion can vary depending on several factors, including the overall length of the paper, the complexity of the research, and the specific journal requirements. While there is no strict rule for the length of a conclusion, but it’s generally advisable to keep it relatively short. A typical research paper conclusion might be around 5-10% of the paper’s total length. For example, if your paper is 10 pages long, the conclusion might be roughly half a page to one page in length.

In general, you do not need to include citations in the research paper conclusion. Citations are typically reserved for the body of the paper to support your arguments and provide evidence for your claims. However, there may be some exceptions to this rule: 1. If you are drawing a direct quote or paraphrasing a specific source in your research paper conclusion, you should include a citation to give proper credit to the original author. 2. If your conclusion refers to or discusses specific research, data, or sources that are crucial to the overall argument, citations can be included to reinforce your conclusion’s validity.

The conclusion of a research paper serves several important purposes: 1. Summarize the Key Points 2. Reinforce the Main Argument 3. Provide Closure 4. Offer Insights or Implications 5. Engage the Reader. 6. Reflect on Limitations

Remember that the primary purpose of the research paper conclusion is to leave a lasting impression on the reader, reinforcing the key points and providing closure to your research. It’s often the last part of the paper that the reader will see, so it should be strong and well-crafted.

• Makar, G., Foltz, C., Lendner, M., & Vaccaro, A. R. (2018). How to write effective discussion and conclusion sections. Clinical spine surgery, 31(8), 345-346.
• Bunton, D. (2005). The structure of PhD conclusion chapters.  Journal of English for academic purposes ,  4 (3), 207-224.

Paperpal is a comprehensive AI writing toolkit that helps students and researchers achieve 2x the writing in half the time. It leverages 21+ years of STM experience and insights from millions of research articles to provide in-depth academic writing, language editing, and submission readiness support to help you write better, faster.  

Get accurate academic translations, rewriting support, grammar checks, vocabulary suggestions, and generative AI assistance that delivers human precision at machine speed. Try for free or upgrade to Paperpal Prime starting at US$19 a month to access premium features, including consistency, plagiarism, and 30+ submission readiness checks to help you succeed.  

Experience the future of academic writing – Sign up to Paperpal and start writing for free!  

Related Reads:

• 5 Reasons for Rejection After Peer Review
• Ethical Research Practices For Research with Human Subjects

7 Ways to Improve Your Academic Writing Process

• Paraphrasing in Academic Writing: Answering Top Author Queries

Preflight For Editorial Desk: The Perfect Hybrid (AI + Human) Assistance Against Compromised Manuscripts

You may also like, how to write a high-quality conference paper, academic editing: how to self-edit academic text with..., measuring academic success: definition & strategies for excellence, phd qualifying exam: tips for success , ai in education: it’s time to change the..., is it ethical to use ai-generated abstracts without..., what are journal guidelines on using generative ai..., quillbot review: features, pricing, and free alternatives, what is an academic paper types and elements , should you use ai tools like chatgpt for....

In a short paper—even a research paper—you don’t need to provide an exhaustive summary as part of your conclusion. But you do need to make some kind of transition between your final body paragraph and your concluding paragraph. This may come in the form of a few sentences of summary. Or it may come in the form of a sentence that brings your readers back to your thesis or main idea and reminds your readers where you began and how far you have traveled.

So, for example, in a paper about the relationship between ADHD and rejection sensitivity, Vanessa Roser begins by introducing readers to the fact that researchers have studied the relationship between the two conditions and then provides her explanation of that relationship. Here’s her thesis: “While socialization may indeed be an important factor in RS, I argue that individuals with ADHD may also possess a neurological predisposition to RS that is exacerbated by the differing executive and emotional regulation characteristic of ADHD.”

In her final paragraph, Roser reminds us of where she started by echoing her thesis: “This literature demonstrates that, as with many other conditions, ADHD and RS share a delicately intertwined pattern of neurological similarities that is rooted in the innate biology of an individual’s mind, a connection that cannot be explained in full by the behavioral mediation hypothesis.”  

Highlight the “so what”  

At the beginning of your paper, you explain to your readers what’s at stake—why they should care about the argument you’re making. In your conclusion, you can bring readers back to those stakes by reminding them why your argument is important in the first place. You can also draft a few sentences that put those stakes into a new or broader context.

In the conclusion to her paper about ADHD and RS, Roser echoes the stakes she established in her introduction—that research into connections between ADHD and RS has led to contradictory results, raising questions about the “behavioral mediation hypothesis.”

She writes, “as with many other conditions, ADHD and RS share a delicately intertwined pattern of neurological similarities that is rooted in the innate biology of an individual’s mind, a connection that cannot be explained in full by the behavioral mediation hypothesis.”  

Leave your readers with the “now what”  

After the “what” and the “so what,” you should leave your reader with some final thoughts. If you have written a strong introduction, your readers will know why you have been arguing what you have been arguing—and why they should care. And if you’ve made a good case for your thesis, then your readers should be in a position to see things in a new way, understand new questions, or be ready for something that they weren’t ready for before they read your paper.

In her conclusion, Roser offers two “now what” statements. First, she explains that it is important to recognize that the flawed behavioral mediation hypothesis “seems to place a degree of fault on the individual. It implies that individuals with ADHD must have elicited such frequent or intense rejection by virtue of their inadequate social skills, erasing the possibility that they may simply possess a natural sensitivity to emotion.” She then highlights the broader implications for treatment of people with ADHD, noting that recognizing the actual connection between rejection sensitivity and ADHD “has profound implications for understanding how individuals with ADHD might best be treated in educational settings, by counselors, family, peers, or even society as a whole.”

To find your own “now what” for your essay’s conclusion, try asking yourself these questions:

• What can my readers now understand, see in a new light, or grapple with that they would not have understood in the same way before reading my paper? Are we a step closer to understanding a larger phenomenon or to understanding why what was at stake is so important?  
• What questions can I now raise that would not have made sense at the beginning of my paper? Questions for further research? Other ways that this topic could be approached?  
• Are there other applications for my research? Could my questions be asked about different data in a different context? Could I use my methods to answer a different question?  
• What action should be taken in light of this argument? What action do I predict will be taken or could lead to a solution?  
• What larger context might my argument be a part of?  

What to avoid in your conclusion  

• a complete restatement of all that you have said in your paper.  
• a substantial counterargument that you do not have space to refute; you should introduce counterarguments before your conclusion.  
• an apology for what you have not said. If you need to explain the scope of your paper, you should do this sooner—but don’t apologize for what you have not discussed in your paper.  
• fake transitions like “in conclusion” that are followed by sentences that aren’t actually conclusions. (“In conclusion, I have now demonstrated that my thesis is correct.”)
• picture_as_pdf Conclusions

• Walden University
• Faculty Portal

Writing a Paper: Conclusions

Writing a conclusion.

A conclusion is an important part of the paper; it provides closure for the reader while reminding the reader of the contents and importance of the paper. It accomplishes this by stepping back from the specifics in order to view the bigger picture of the document. In other words, it is reminding the reader of the main argument. For most course papers, it is usually one paragraph that simply and succinctly restates the main ideas and arguments, pulling everything together to help clarify the thesis of the paper. A conclusion does not introduce new ideas; instead, it should clarify the intent and importance of the paper. It can also suggest possible future research on the topic.

An Easy Checklist for Writing a Conclusion

It is important to remind the reader of the thesis of the paper so he is reminded of the argument and solutions you proposed.

Think of the main points as puzzle pieces, and the conclusion is where they all fit together to create a bigger picture. The reader should walk away with the bigger picture in mind.

Make sure that the paper places its findings in the context of real social change.

Make sure the reader has a distinct sense that the paper has come to an end. It is important to not leave the reader hanging. (You don’t want her to have flip-the-page syndrome, where the reader turns the page, expecting the paper to continue. The paper should naturally come to an end.)

No new ideas should be introduced in the conclusion. It is simply a review of the material that is already present in the paper. The only new idea would be the suggesting of a direction for future research.

Conclusion Example

As addressed in my analysis of recent research, the advantages of a later starting time for high school students significantly outweigh the disadvantages. A later starting time would allow teens more time to sleep--something that is important for their physical and mental health--and ultimately improve their academic performance and behavior. The added transportation costs that result from this change can be absorbed through energy savings. The beneficial effects on the students’ academic performance and behavior validate this decision, but its effect on student motivation is still unknown. I would encourage an in-depth look at the reactions of students to such a change. This sort of study would help determine the actual effects of a later start time on the time management and sleep habits of students.

Related Webinar

Didn't find what you need? Email us at [email protected] .

• Previous Page: Thesis Statements
• Next Page: Writer's Block
• Office of Student Disability Services

Walden Resources

Departments.

• Academic Residencies
• Academic Skills
• Career Planning and Development
• Customer Care Team
• Field Experience
• Military Services
• Student Success Advising
• Writing Skills

Centers and Offices

• Center for Social Change
• Office of Academic Support and Instructional Services
• Office of Degree Acceleration
• Office of Research and Doctoral Services
• Office of Student Affairs

Student Resources

• Doctoral Writing Assessment
• Form & Style Review
• Quick Answers
• ScholarWorks
• SKIL Courses and Workshops
• Walden Bookstore
• Walden Catalog & Student Handbook
• Student Safety/Title IX
• Legal & Consumer Information
• Website Terms and Conditions
• Cookie Policy
• Accessibility
• Accreditation
• State Authorization
• Net Price Calculator
• Contact Walden

Walden University is a member of Adtalem Global Education, Inc. www.adtalem.com Walden University is certified to operate by SCHEV © 2024 Walden University LLC. All rights reserved.

When you choose to publish with PLOS, your research makes an impact. Make your work accessible to all, without restrictions, and accelerate scientific discovery with options like preprints and published peer review that make your work more Open.

• PLOS Biology
• PLOS Climate
• PLOS Complex Systems
• PLOS Computational Biology
• PLOS Digital Health
• PLOS Genetics
• PLOS Global Public Health
• PLOS Medicine
• PLOS Mental Health
• PLOS Neglected Tropical Diseases
• PLOS Pathogens
• PLOS Sustainability and Transformation
• PLOS Collections
• How to Write Discussions and Conclusions

The discussion section contains the results and outcomes of a study. An effective discussion informs readers what can be learned from your experiment and provides context for the results.

What makes an effective discussion?

When you’re ready to write your discussion, you’ve already introduced the purpose of your study and provided an in-depth description of the methodology. The discussion informs readers about the larger implications of your study based on the results. Highlighting these implications while not overstating the findings can be challenging, especially when you’re submitting to a journal that selects articles based on novelty or potential impact. Regardless of what journal you are submitting to, the discussion section always serves the same purpose: concluding what your study results actually mean.

A successful discussion section puts your findings in context. It should include:

• the results of your research,
• a discussion of related research, and
• a comparison between your results and initial hypothesis.

Tip: Not all journals share the same naming conventions.

You can apply the advice in this article to the conclusion, results or discussion sections of your manuscript.

Our Early Career Researcher community tells us that the conclusion is often considered the most difficult aspect of a manuscript to write. To help, this guide provides questions to ask yourself, a basic structure to model your discussion off of and examples from published manuscripts. 

Questions to ask yourself:

• Was my hypothesis correct?
• If my hypothesis is partially correct or entirely different, what can be learned from the results? 
• How do the conclusions reshape or add onto the existing knowledge in the field? What does previous research say about the topic? 
• Why are the results important or relevant to your audience? Do they add further evidence to a scientific consensus or disprove prior studies? 
• How can future research build on these observations? What are the key experiments that must be done? 
• What is the “take-home” message you want your reader to leave with?

How to structure a discussion

Trying to fit a complete discussion into a single paragraph can add unnecessary stress to the writing process. If possible, you’ll want to give yourself two or three paragraphs to give the reader a comprehensive understanding of your study as a whole. Here’s one way to structure an effective discussion:

Writing Tips

While the above sections can help you brainstorm and structure your discussion, there are many common mistakes that writers revert to when having difficulties with their paper. Writing a discussion can be a delicate balance between summarizing your results, providing proper context for your research and avoiding introducing new information. Remember that your paper should be both confident and honest about the results! 

• Read the journal’s guidelines on the discussion and conclusion sections. If possible, learn about the guidelines before writing the discussion to ensure you’re writing to meet their expectations. 
• Begin with a clear statement of the principal findings. This will reinforce the main take-away for the reader and set up the rest of the discussion. 
• Explain why the outcomes of your study are important to the reader. Discuss the implications of your findings realistically based on previous literature, highlighting both the strengths and limitations of the research. 
• State whether the results prove or disprove your hypothesis. If your hypothesis was disproved, what might be the reasons? 
• Introduce new or expanded ways to think about the research question. Indicate what next steps can be taken to further pursue any unresolved questions. 
• If dealing with a contemporary or ongoing problem, such as climate change, discuss possible consequences if the problem is avoided. 
• Be concise. Adding unnecessary detail can distract from the main findings. 

Don’t

• Rewrite your abstract. Statements with “we investigated” or “we studied” generally do not belong in the discussion. 
• Include new arguments or evidence not previously discussed. Necessary information and evidence should be introduced in the main body of the paper. 
• Apologize. Even if your research contains significant limitations, don’t undermine your authority by including statements that doubt your methodology or execution. 
• Shy away from speaking on limitations or negative results. Including limitations and negative results will give readers a complete understanding of the presented research. Potential limitations include sources of potential bias, threats to internal or external validity, barriers to implementing an intervention and other issues inherent to the study design. 
• Overstate the importance of your findings. Making grand statements about how a study will fully resolve large questions can lead readers to doubt the success of the research. 

Snippets of Effective Discussions:

Consumer-based actions to reduce plastic pollution in rivers: A multi-criteria decision analysis approach

Identifying reliable indicators of fitness in polar bears

• How to Write a Great Title
• How to Write an Abstract
• How to Write Your Methods
• How to Report Statistics
• How to Edit Your Work

The contents of the Peer Review Center are also available as a live, interactive training session, complete with slides, talking points, and activities. …

The contents of the Writing Center are also available as a live, interactive training session, complete with slides, talking points, and activities. …

There’s a lot to consider when deciding where to submit your work. Learn how to choose a journal that will help your study reach its audience, while reflecting your values as a researcher…

How to write a strong conclusion for your research paper

Last updated

17 February 2024

Reviewed by

Writing a research paper is a chance to share your knowledge and hypothesis. It's an opportunity to demonstrate your many hours of research and prove your ability to write convincingly.

Ideally, by the end of your research paper, you'll have brought your readers on a journey to reach the conclusions you've pre-determined. However, if you don't stick the landing with a good conclusion, you'll risk losing your reader’s trust.

Writing a strong conclusion for your research paper involves a few important steps, including restating the thesis and summing up everything properly.

Find out what to include and what to avoid, so you can effectively demonstrate your understanding of the topic and prove your expertise.

• Why is a good conclusion important?

A good conclusion can cement your paper in the reader’s mind. Making a strong impression in your introduction can draw your readers in, but it's the conclusion that will inspire them.

• What to include in a research paper conclusion

There are a few specifics you should include in your research paper conclusion. Offer your readers some sense of urgency or consequence by pointing out why they should care about the topic you have covered. Discuss any common problems associated with your topic and provide suggestions as to how these problems can be solved or addressed.

The conclusion should include a restatement of your initial thesis. Thesis statements are strengthened after you’ve presented supporting evidence (as you will have done in the paper), so make a point to reintroduce it at the end.

Finally, recap the main points of your research paper, highlighting the key takeaways you want readers to remember. If you've made multiple points throughout the paper, refer to the ones with the strongest supporting evidence.

• Steps for writing a research paper conclusion

Many writers find the conclusion the most challenging part of any research project . By following these three steps, you'll be prepared to write a conclusion that is effective and concise.

• Step 1: Restate the problem

Always begin by restating the research problem in the conclusion of a research paper. This serves to remind the reader of your hypothesis and refresh them on the main point of the paper. 

When restating the problem, take care to avoid using exactly the same words you employed earlier in the paper.

• Step 2: Sum up the paper

After you've restated the problem, sum up the paper by revealing your overall findings. The method for this differs slightly, depending on whether you're crafting an argumentative paper or an empirical paper.

Argumentative paper: Restate your thesis and arguments

Argumentative papers involve introducing a thesis statement early on. In crafting the conclusion for an argumentative paper, always restate the thesis, outlining the way you've developed it throughout the entire paper.

It might be appropriate to mention any counterarguments in the conclusion, so you can demonstrate how your thesis is correct or how the data best supports your main points.

Empirical paper: Summarize research findings

Empirical papers break down a series of research questions. In your conclusion, discuss the findings your research revealed, including any information that surprised you.

Be clear about the conclusions you reached, and explain whether or not you expected to arrive at these particular ones.

• Step 3: Discuss the implications of your research

Argumentative papers and empirical papers also differ in this part of a research paper conclusion. Here are some tips on crafting conclusions for argumentative and empirical papers.

Argumentative paper: Powerful closing statement

In an argumentative paper, you'll have spent a great deal of time expressing the opinions you formed after doing a significant amount of research. Make a strong closing statement in your argumentative paper's conclusion to share the significance of your work.

You can outline the next steps through a bold call to action, or restate how powerful your ideas turned out to be.

Empirical paper: Directions for future research

Empirical papers are broader in scope. They usually cover a variety of aspects and can include several points of view.

To write a good conclusion for an empirical paper, suggest the type of research that could be done in the future, including methods for further investigation or outlining ways other researchers might proceed.

If you feel your research had any limitations, even if they were outside your control, you could mention these in your conclusion.

After you finish outlining your conclusion, ask someone to read it and offer feedback. In any research project you're especially close to, it can be hard to identify problem areas. Having a close friend or someone whose opinion you value read the research paper and provide honest feedback can be invaluable. Take note of any suggested edits and consider incorporating them into your paper if they make sense.

• Things to avoid in a research paper conclusion

Keep these aspects to avoid in mind as you're writing your conclusion and refer to them after you've created an outline.

Dry summary

Writing a memorable, succinct conclusion is arguably more important than a strong introduction. Take care to avoid just rephrasing your main points, and don't fall into the trap of repeating dry facts or citations.

You can provide a new perspective for your readers to think about or contextualize your research. Either way, make the conclusion vibrant and interesting, rather than a rote recitation of your research paper’s highlights.

Clichéd or generic phrasing

Your research paper conclusion should feel fresh and inspiring. Avoid generic phrases like "to sum up" or "in conclusion." These phrases tend to be overused, especially in an academic context and might turn your readers off.

The conclusion also isn't the time to introduce colloquial phrases or informal language. Retain a professional, confident tone consistent throughout your paper’s conclusion so it feels exciting and bold.

New data or evidence

While you should present strong data throughout your paper, the conclusion isn't the place to introduce new evidence. This is because readers are engaged in actively learning as they read through the body of your paper.

By the time they reach the conclusion, they will have formed an opinion one way or the other (hopefully in your favor!). Introducing new evidence in the conclusion will only serve to surprise or frustrate your reader.

Ignoring contradictory evidence

If your research reveals contradictory evidence, don't ignore it in the conclusion. This will damage your credibility as an expert and might even serve to highlight the contradictions.

Be as transparent as possible and admit to any shortcomings in your research, but don't dwell on them for too long.

Ambiguous or unclear resolutions

The point of a research paper conclusion is to provide closure and bring all your ideas together. You should wrap up any arguments you introduced in the paper and tie up any loose ends, while demonstrating why your research and data are strong.

Use direct language in your conclusion and avoid ambiguity. Even if some of the data and sources you cite are inconclusive or contradictory, note this in your conclusion to come across as confident and trustworthy.

• Examples of research paper conclusions

Your research paper should provide a compelling close to the paper as a whole, highlighting your research and hard work. While the conclusion should represent your unique style, these examples offer a starting point:

Ultimately, the data we examined all point to the same conclusion: Encouraging a good work-life balance improves employee productivity and benefits the company overall. The research suggests that when employees feel their personal lives are valued and respected by their employers, they are more likely to be productive when at work. In addition, company turnover tends to be reduced when employees have a balance between their personal and professional lives. While additional research is required to establish ways companies can support employees in creating a stronger work-life balance, it's clear the need is there.

Social media is a primary method of communication among young people. As we've seen in the data presented, most young people in high school use a variety of social media applications at least every hour, including Instagram and Facebook. While social media is an avenue for connection with peers, research increasingly suggests that social media use correlates with body image issues. Young girls with lower self-esteem tend to use social media more often than those who don't log onto social media apps every day. As new applications continue to gain popularity, and as more high school students are given smartphones, more research will be required to measure the effects of prolonged social media use.

What are the different kinds of research paper conclusions?

There are no formal types of research paper conclusions. Ultimately, the conclusion depends on the outline of your paper and the type of research you’re presenting. While some experts note that research papers can end with a new perspective or commentary, most papers should conclude with a combination of both. The most important aspect of a good research paper conclusion is that it accurately represents the body of the paper.

Can I present new arguments in my research paper conclusion?

Research paper conclusions are not the place to introduce new data or arguments. The body of your paper is where you should share research and insights, where the reader is actively absorbing the content. By the time a reader reaches the conclusion of the research paper, they should have formed their opinion. Introducing new arguments in the conclusion can take a reader by surprise, and not in a positive way. It might also serve to frustrate readers.

How long should a research paper conclusion be?

There's no set length for a research paper conclusion. However, it's a good idea not to run on too long, since conclusions are supposed to be succinct. A good rule of thumb is to keep your conclusion around 5 to 10 percent of the paper's total length. If your paper is 10 pages, try to keep your conclusion under one page.

What should I include in a research paper conclusion?

A good research paper conclusion should always include a sense of urgency, so the reader can see how and why the topic should matter to them. You can also note some recommended actions to help fix the problem and some obstacles they might encounter. A conclusion should also remind the reader of the thesis statement, along with the main points you covered in the paper. At the end of the conclusion, add a powerful closing statement that helps cement the paper in the mind of the reader.

Should you be using a customer insights hub?

Do you want to discover previous research faster?

Do you share your research findings with others?

Do you analyze research data?

Start for free today, add your research, and get to key insights faster

Editor’s picks

Last updated: 11 January 2024

Last updated: 15 January 2024

Last updated: 17 January 2024

Last updated: 12 May 2023

Last updated: 30 April 2024

Last updated: 18 May 2023

Last updated: 25 November 2023

Last updated: 13 May 2024

Latest articles

Related topics, .css-je19u9{-webkit-align-items:flex-end;-webkit-box-align:flex-end;-ms-flex-align:flex-end;align-items:flex-end;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-flex-direction:row;-ms-flex-direction:row;flex-direction:row;-webkit-box-flex-wrap:wrap;-webkit-flex-wrap:wrap;-ms-flex-wrap:wrap;flex-wrap:wrap;-webkit-box-pack:center;-ms-flex-pack:center;-webkit-justify-content:center;justify-content:center;row-gap:0;text-align:center;max-width:671px;}@media (max-width: 1079px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}}@media (max-width: 799px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}} decide what to .css-1kiodld{max-height:56px;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}@media (max-width: 1079px){.css-1kiodld{display:none;}} build next, decide what to build next.

Users report unexpectedly high data usage, especially during streaming sessions.

Users find it hard to navigate from the home page to relevant playlists in the app.

It would be great to have a sleep timer feature, especially for bedtime listening.

I need better filters to find the songs or artists I’m looking for.

Log in or sign up

Get started for free

Conclusions

What this handout is about.

This handout will explain the functions of conclusions, offer strategies for writing effective ones, help you evaluate conclusions you’ve drafted, and suggest approaches to avoid.

About conclusions

Introductions and conclusions can be difficult to write, but they’re worth investing time in. They can have a significant influence on a reader’s experience of your paper.

Just as your introduction acts as a bridge that transports your readers from their own lives into the “place” of your analysis, your conclusion can provide a bridge to help your readers make the transition back to their daily lives. Such a conclusion will help them see why all your analysis and information should matter to them after they put the paper down.

Your conclusion is your chance to have the last word on the subject. The conclusion allows you to have the final say on the issues you have raised in your paper, to synthesize your thoughts, to demonstrate the importance of your ideas, and to propel your reader to a new view of the subject. It is also your opportunity to make a good final impression and to end on a positive note.

Your conclusion can go beyond the confines of the assignment. The conclusion pushes beyond the boundaries of the prompt and allows you to consider broader issues, make new connections, and elaborate on the significance of your findings.

Your conclusion should make your readers glad they read your paper. Your conclusion gives your reader something to take away that will help them see things differently or appreciate your topic in personally relevant ways. It can suggest broader implications that will not only interest your reader, but also enrich your reader’s life in some way. It is your gift to the reader.

Strategies for writing an effective conclusion

One or more of the following strategies may help you write an effective conclusion:

• Play the “So What” Game. If you’re stuck and feel like your conclusion isn’t saying anything new or interesting, ask a friend to read it with you. Whenever you make a statement from your conclusion, ask the friend to say, “So what?” or “Why should anybody care?” Then ponder that question and answer it. Here’s how it might go: You: Basically, I’m just saying that education was important to Douglass. Friend: So what? You: Well, it was important because it was a key to him feeling like a free and equal citizen. Friend: Why should anybody care? You: That’s important because plantation owners tried to keep slaves from being educated so that they could maintain control. When Douglass obtained an education, he undermined that control personally. You can also use this strategy on your own, asking yourself “So What?” as you develop your ideas or your draft.
• Return to the theme or themes in the introduction. This strategy brings the reader full circle. For example, if you begin by describing a scenario, you can end with the same scenario as proof that your essay is helpful in creating a new understanding. You may also refer to the introductory paragraph by using key words or parallel concepts and images that you also used in the introduction.
• Synthesize, don’t summarize. Include a brief summary of the paper’s main points, but don’t simply repeat things that were in your paper. Instead, show your reader how the points you made and the support and examples you used fit together. Pull it all together.
• Include a provocative insight or quotation from the research or reading you did for your paper.
• Propose a course of action, a solution to an issue, or questions for further study. This can redirect your reader’s thought process and help them to apply your info and ideas to their own life or to see the broader implications.
• Point to broader implications. For example, if your paper examines the Greensboro sit-ins or another event in the Civil Rights Movement, you could point out its impact on the Civil Rights Movement as a whole. A paper about the style of writer Virginia Woolf could point to her influence on other writers or on later feminists.

Strategies to avoid

• Beginning with an unnecessary, overused phrase such as “in conclusion,” “in summary,” or “in closing.” Although these phrases can work in speeches, they come across as wooden and trite in writing.
• Stating the thesis for the very first time in the conclusion.
• Introducing a new idea or subtopic in your conclusion.
• Ending with a rephrased thesis statement without any substantive changes.
• Making sentimental, emotional appeals that are out of character with the rest of an analytical paper.
• Including evidence (quotations, statistics, etc.) that should be in the body of the paper.

Four kinds of ineffective conclusions

• The “That’s My Story and I’m Sticking to It” Conclusion. This conclusion just restates the thesis and is usually painfully short. It does not push the ideas forward. People write this kind of conclusion when they can’t think of anything else to say. Example: In conclusion, Frederick Douglass was, as we have seen, a pioneer in American education, proving that education was a major force for social change with regard to slavery.
• The “Sherlock Holmes” Conclusion. Sometimes writers will state the thesis for the very first time in the conclusion. You might be tempted to use this strategy if you don’t want to give everything away too early in your paper. You may think it would be more dramatic to keep the reader in the dark until the end and then “wow” them with your main idea, as in a Sherlock Holmes mystery. The reader, however, does not expect a mystery, but an analytical discussion of your topic in an academic style, with the main argument (thesis) stated up front. Example: (After a paper that lists numerous incidents from the book but never says what these incidents reveal about Douglass and his views on education): So, as the evidence above demonstrates, Douglass saw education as a way to undermine the slaveholders’ power and also an important step toward freedom.
• The “America the Beautiful”/”I Am Woman”/”We Shall Overcome” Conclusion. This kind of conclusion usually draws on emotion to make its appeal, but while this emotion and even sentimentality may be very heartfelt, it is usually out of character with the rest of an analytical paper. A more sophisticated commentary, rather than emotional praise, would be a more fitting tribute to the topic. Example: Because of the efforts of fine Americans like Frederick Douglass, countless others have seen the shining beacon of light that is education. His example was a torch that lit the way for others. Frederick Douglass was truly an American hero.
• The “Grab Bag” Conclusion. This kind of conclusion includes extra information that the writer found or thought of but couldn’t integrate into the main paper. You may find it hard to leave out details that you discovered after hours of research and thought, but adding random facts and bits of evidence at the end of an otherwise-well-organized essay can just create confusion. Example: In addition to being an educational pioneer, Frederick Douglass provides an interesting case study for masculinity in the American South. He also offers historians an interesting glimpse into slave resistance when he confronts Covey, the overseer. His relationships with female relatives reveal the importance of family in the slave community.

Works consulted

We consulted these works while writing this handout. This is not a comprehensive list of resources on the handout’s topic, and we encourage you to do your own research to find additional publications. Please do not use this list as a model for the format of your own reference list, as it may not match the citation style you are using. For guidance on formatting citations, please see the UNC Libraries citation tutorial . We revise these tips periodically and welcome feedback.

Douglass, Frederick. 1995. Narrative of the Life of Frederick Douglass, an American Slave, Written by Himself. New York: Dover.

Hamilton College. n.d. “Conclusions.” Writing Center. Accessed June 14, 2019. https://www.hamilton.edu//academics/centers/writing/writing-resources/conclusions .

Holewa, Randa. 2004. “Strategies for Writing a Conclusion.” LEO: Literacy Education Online. Last updated February 19, 2004. https://leo.stcloudstate.edu/acadwrite/conclude.html.

You may reproduce it for non-commercial use if you use the entire handout and attribute the source: The Writing Center, University of North Carolina at Chapel Hill

Make a Gift

• Affiliate Program

• UNITED STATES
• 台灣 (TAIWAN)
• TÜRKIYE (TURKEY)
• Academic Editing Services
• - Research Paper
• - Journal Manuscript
• - Dissertation
• - College & University Assignments
• Admissions Editing Services
• - Application Essay
• - Personal Statement
• - Recommendation Letter
• - Cover Letter
• - CV/Resume
• Business Editing Services
• - Business Documents
• - Report & Brochure
• - Website & Blog
• Writer Editing Services
• - Script & Screenplay
• Our Editors
• Client Reviews
• Editing & Proofreading Prices
• Wordvice Points
• Partner Discount
• Plagiarism Checker
• APA Citation Generator
• MLA Citation Generator
• Chicago Citation Generator
• Vancouver Citation Generator
• - APA Style
• - MLA Style
• - Chicago Style
• - Vancouver Style
• Writing & Editing Guide
• Academic Resources
• Admissions Resources

How to Write a Research Paper Conclusion Section

What is a conclusion in a research paper?

The conclusion in a research paper is the final paragraph or two in a research paper. In scientific papers, the conclusion usually follows the Discussion section , summarizing the importance of the findings and reminding the reader why the work presented in the paper is relevant.

However, it can be a bit confusing to distinguish the conclusion section/paragraph from a summary or a repetition of your findings, your own opinion, or the statement of the implications of your work. In fact, the conclusion should contain a bit of all of these other parts but go beyond it—but not too far beyond! 

The structure and content of the conclusion section can also vary depending on whether you are writing a research manuscript or an essay. This article will explain how to write a good conclusion section, what exactly it should (and should not) contain, how it should be structured, and what you should avoid when writing it.  

Table of Contents:

What does a good conclusion section do, what to include in a research paper conclusion.

• Conclusion in an Essay
• Research Paper Conclusion 
• Conclusion Paragraph Outline and Example
• What Not to Do When Writing a Conclusion

The conclusion of a research paper has several key objectives. It should:

• Restate your research problem addressed in the introduction section
• Summarize your main arguments, important findings, and broader implications
• Synthesize key takeaways from your study

The specific content in the conclusion depends on whether your paper presents the results of original scientific research or constructs an argument through engagement with previously published sources.

You presented your general field of study to the reader in the introduction section, by moving from general information (the background of your work, often combined with a literature review ) to the rationale of your study and then to the specific problem or topic you addressed, formulated in the form of the statement of the problem in research or the thesis statement in an essay.

In the conclusion section, in contrast, your task is to move from your specific findings or arguments back to a more general depiction of how your research contributes to the readers’ understanding of a certain concept or helps solve a practical problem, or fills an important gap in the literature. The content of your conclusion section depends on the type of research you are doing and what type of paper you are writing. But whatever the outcome of your work is, the conclusion is where you briefly summarize it and place it within a larger context. It could be called the “take-home message” of the entire paper.

What to summarize in the conclusion

Your conclusion section needs to contain a very brief summary of your work , a very brief summary of the main findings of your work, and a mention of anything else that seems relevant when you now look at your work from a bigger perspective, even if it was not initially listed as one of your main research questions. This could be a limitation, for example, a problem with the design of your experiment that either needs to be considered when drawing any conclusions or that led you to ask a different question and therefore draw different conclusions at the end of your study (compared to when you started out).

Once you have reminded the reader of what you did and what you found, you need to go beyond that and also provide either your own opinion on why your work is relevant (and for whom, and how) or theoretical or practical implications of the study , or make a specific call for action if there is one to be made.   

How to Write an Essay Conclusion

Academic essays follow quite different structures than their counterparts in STEM and the natural sciences. Humanities papers often have conclusion sections that are much longer and contain more detail than scientific papers. There are three main types of academic essay conclusions.

Summarizing conclusion

The most typical conclusion at the end of an analytical/explanatory/argumentative essay is a summarizing conclusion . This is, as the name suggests, a clear summary of the main points of your topic and thesis. Since you might have gone through a number of different arguments or subtopics in the main part of your essay, you need to remind the reader again what those were, how they fit into each other, and how they helped you develop or corroborate your hypothesis.

For an essay that analyzes how recruiters can hire the best candidates in the shortest time or on “how starving yourself will increase your lifespan, according to science”, a summary of all the points you discussed might be all you need. Note that you should not exactly repeat what you said earlier, but rather highlight the essential details and present those to your reader in a different way. 

Externalizing conclusion

If you think that just reminding the reader of your main points is not enough, you can opt for an externalizing conclusion instead, that presents new points that were not presented in the paper so far. These new points can be additional facts and information or they can be ideas that are relevant to the topic and have not been mentioned before.

Such a conclusion can stimulate your readers to think about your topic or the implications of your analysis in a whole new way. For example, at the end of a historical analysis of a specific event or development, you could direct your reader’s attention to some current events that were not the topic of your essay but that provide a different context for your findings.

Editorial conclusion

In an editorial conclusion , another common type of conclusion that you will find at the end of papers and essays, you do not add new information but instead present your own experiences or opinions on the topic to round everything up. What makes this type of conclusion interesting is that you can choose to agree or disagree with the information you presented in your paper so far. For example, if you have collected and analyzed information on how a specific diet helps people lose weight, you can nevertheless have your doubts on the sustainability of that diet or its practicability in real life—if such arguments were not included in your original thesis and have therefore not been covered in the main part of your paper, the conclusion section is the place where you can get your opinion across.    

How to Conclude an Empirical Research Paper

An empirical research paper is usually more concise and succinct than an essay, because, if it is written well, it focuses on one specific question, describes the method that was used to answer that one question, describes and explains the results, and guides the reader in a logical way from the introduction to the discussion without going on tangents or digging into not absolutely relevant topics.

Summarize the findings

In a scientific paper, you should include a summary of the findings. Don’t go into great detail here (you will have presented your in-depth  results  and  discussion  already), but do clearly express the answers to the  research questions  you investigated.

Describe your main findings, even if they weren’t necessarily the ones anticipated, and explain the conclusion they led you to. Explain these findings in as few words as possible.

Instead of beginning with “ In conclusion, in this study, we investigated the effect of stress on the brain using fMRI …”, you should try to find a way to incorporate the repetition of the essential (and only the essential) details into the summary of the key points. “ The findings of this fMRI study on the effect of stress on the brain suggest that …” or “ While it has been known for a long time that stress has an effect on the brain, the findings of this fMRI study show that, surprisingly… ” would be better ways to start a conclusion. 

You should also not bring up new ideas or present new facts in the conclusion of a research paper, but stick to the background information you have presented earlier, to the findings you have already discussed, and the limitations and implications you have already described. The one thing you can add here is a practical recommendation that you haven’t clearly stated before—but even that one needs to follow logically from everything you have already discussed in the discussion section.

Discuss the implications

After summing up your key arguments or findings, conclude the paper by stating the broader implications of the research , whether in methods , approach, or findings. Express practical or theoretical takeaways from your paper. This often looks like a “call to action” or a final “sales pitch” that puts an exclamation point on your paper.

If your research topic is more theoretical in nature, your closing statement should express the significance of your argument—for example, in proposing a new understanding of a topic or laying the groundwork for future research.

Future research example

Future research into education standards should focus on establishing a more detailed picture of how novel pedagogical approaches impact young people’s ability to absorb new and difficult concepts. Moreover, observational studies are needed to gain more insight into how specific teaching models affect the retention of relationships and facts—for instance, how inquiry-based learning and its emphasis on lateral thinking can be used as a jumping-off point for more holistic classroom approaches.

Research Conclusion Example and Outline

Let’s revisit the study on the effect of stress on the brain we mentioned before and see what the common structure for a conclusion paragraph looks like, in three steps. Following these simple steps will make it easy for you to wrap everything up in one short paragraph that contains all the essential information: 

One: Short summary of what you did, but integrated into the summary of your findings:

While it has been known for a long time that stress has an effect on the brain, the findings of this fMRI study in 25 university students going through mid-term exams show that, surprisingly, one’s attitude to the experienced stress significantly modulates the brain’s response to it. 

Note that you don’t need to repeat any methodological or technical details here—the reader has been presented with all of these before, they have read your results section and the discussion of your results, and even (hopefully!) a discussion of the limitations and strengths of your paper. The only thing you need to remind them of here is the essential outcome of your work. 

Two: Add implications, and don’t forget to specify who this might be relevant for: 

Students could be considered a specific subsample of the general population, but earlier research shows that the effect that exam stress has on their physical and mental health is comparable to the effects of other types of stress on individuals of other ages and occupations. Further research into practical ways of modulating not only one’s mental stress response but potentially also one’s brain activity (e.g., via neurofeedback training) are warranted.

This is a “research implication”, and it is nicely combined with a mention of a potential limitation of the study (the student sample) that turns out not to be a limitation after all (because earlier research suggests we can generalize to other populations). If there already is a lot of research on neurofeedback for stress control, by the way, then this should have been discussed in your discussion section earlier and you wouldn’t say such studies are “warranted” here but rather specify how your findings could inspire specific future experiments or how they should be implemented in existing applications. 

Three: The most important thing is that your conclusion paragraph accurately reflects the content of your paper. Compare it to your research paper title , your research paper abstract , and to your journal submission cover letter , in case you already have one—if these do not all tell the same story, then you need to go back to your paper, start again from the introduction section, and find out where you lost the logical thread. As always, consistency is key.    

Problems to Avoid When Writing a Conclusion 

• Do not suddenly introduce new information that has never been mentioned before (unless you are writing an essay and opting for an externalizing conclusion, see above). The conclusion section is not where you want to surprise your readers, but the take-home message of what you have already presented.
• Do not simply copy your abstract, the conclusion section of your abstract, or the first sentence of your introduction, and put it at the end of the discussion section. Even if these parts of your paper cover the same points, they should not be identical.
• Do not start the conclusion with “In conclusion”. If it has its own section heading, that is redundant, and if it is the last paragraph of the discussion section, it is inelegant and also not really necessary. The reader expects you to wrap your work up in the last paragraph, so you don’t have to announce that. Just look at the above example to see how to start a conclusion in a natural way.
• Do not forget what your research objectives were and how you initially formulated the statement of the problem in your introduction section. If your story/approach/conclusions changed because of methodological issues or information you were not aware of when you started, then make sure you go back to the beginning and adapt your entire story (not just the ending). 

Consider Receiving Academic Editing Services

When you have arrived at the conclusion of your paper, you might want to head over to Wordvice AI’s AI Writing Assistant to receive a free grammar check for any academic content. 

After drafting, you can also receive English editing and proofreading services , including paper editing services for your journal manuscript. If you need advice on how to write the other parts of your research paper , or on how to make a research paper outline if you are struggling with putting everything you did together, then head over to the Wordvice academic resources pages , where we have a lot more articles and videos for you.

Organizing Academic Research Papers: 9. The Conclusion

• Purpose of Guide
• Design Flaws to Avoid
• Glossary of Research Terms
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Choosing a Title
• Making an Outline
• Paragraph Development
• Executive Summary
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tertiary Sources
• What Is Scholarly vs. Popular?
• Qualitative Methods
• Quantitative Methods
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Annotated Bibliography
• Dealing with Nervousness
• Using Visual Aids
• Grading Someone Else's Paper
• How to Manage Group Projects
• Multiple Book Review Essay
• Reviewing Collected Essays
• About Informed Consent
• Writing Field Notes
• Writing a Policy Memo
• Writing a Research Proposal
• Acknowledgements

The conclusion is intended to help the reader understand why your research should matter to them after they have finished reading the paper. A conclusion is not merely a summary of your points or a re-statement of your research problem but a synthesis of key points. For most essays, one well-developed paragraph is sufficient for a conclusion, although in some cases, a two-or-three paragraph conclusion may be required.

Importance of a Good Conclusion

A well-written conclusion provides you with several important opportunities to demonstrate your overall understanding of the research problem to the reader. These include:

• Presenting the last word on the issues you raised in your paper . Just as the introduction gives a first impression to your reader, the conclusion offers a chance to leave a lasting impression. Do this, for example, by highlighting key points in your analysis or findings.
• Summarizing your thoughts and conveying the larger implications of your study . The conclusion is an opportunity to succinctly answer the "so what?" question by placing the study within the context of past research about the topic you've investigated.
• Demonstrating the importance of your ideas . Don't be shy. The conclusion offers you a chance to elaborate on the significance of your findings.
• Introducing possible new or expanded ways of thinking about the research problem . This does not refer to introducing new information [which should be avoided], but to offer new insight and creative approaches for framing/contextualizing the research problem based on the results of your study.

Conclusions . The Writing Center. University of North Carolina; Kretchmer, Paul. Twelve Steps to Writing an Effective Conclusion . San Francisco Edit, 2003-2008.

Structure and Writing Style

https://writing.wisc.edu/wp-content/uploads/sites/535/2018/07/conclusions_uwmadison_writingcenter_aug2012.pdf I.  General Rules

When writing the conclusion to your paper, follow these general rules:

• State your conclusions in clear, simple language.
• Do not simply reiterate your results or the discussion.
• Indicate opportunities for future research, as long as you haven't already done so in the discussion section of your paper.

The function of your paper's conclusion is to restate the main argument . It reminds the reader of the strengths of your main argument(s) and reiterates the most important evidence supporting those argument(s). Make sure, however, that your conclusion is not simply a repetitive summary of the findings because this reduces the impact of the argument(s) you have developed in your essay.

Consider the following points to help ensure your conclusion is appropriate:

• If the argument or point of your paper is complex, you may need to summarize the argument for your reader.
• If, prior to your conclusion, you have not yet explained the significance of your findings or if you are proceeding inductively, use the end of your paper to describe your main points and explain their significance.
• Move from a detailed to a general level of consideration that returns the topic to the context provided by the introduction or within a new context that emerges from the data.

The conclusion also provides a place for you to persuasively and succinctly restate your research problem, given that the reader has now been presented with all the information about the topic . Depending on the discipline you are writing in, the concluding paragraph may contain your reflections on the evidence presented, or on the essay's central research problem. However, the nature of being introspective about the research you have done will depend on the topic and whether your professor wants you to express your observations in this way.

NOTE : Don't delve into idle speculation. Being introspective means looking within yourself as an author to try and understand an issue more deeply not to guess at possible outcomes.

II.  Developing a Compelling Conclusion

Strategies to help you move beyond merely summarizing the key points of your research paper may include any of the following.

• If your essay deals with a contemporary problem, warn readers of the possible consequences of not attending to the problem.
• Recommend a specific course or courses of action.
• Cite a relevant quotation or expert opinion to lend authority to the conclusion you have reached [a good place to look is research from your literature review].
• Restate a key statistic, fact, or visual image to drive home the ultimate point of your paper.
• If your discipline encourages personal reflection, illustrate your concluding point with a relevant narrative drawn from your own life experiences.
• Return to an anecdote, an example, or a quotation that you introduced in your introduction, but add further insight that is derived from the findings of your study; use your interpretation of results to reframe it in new ways.
• Provide a "take-home" message in the form of a strong, succient statement that you want the reader to remember about your study.

III. Problems to Avoid Failure to be concise The conclusion section should be concise and to the point. Conclusions that are too long often have unnecessary detail. The conclusion section is not the place for details about your methodology or results. Although you should give a summary of what was learned from your research, this summary should be relatively brief, since the emphasis in the conclusion is on the implications, evaluations, insights, etc. that you make. Failure to comment on larger, more significant issues In the introduction, your task was to move from general [the field of study] to specific [your research problem]. However, in the conclusion, your task is to move from specific [your research problem] back to general [your field, i.e., how your research contributes new understanding or fills an important gap in the literature]. In other words, the conclusion is where you place your research within a larger context. Failure to reveal problems and negative results Negative aspects of the research process should never be ignored. Problems, drawbacks, and challenges encountered during your study should be included as a way of qualifying your overall conclusions. If you encountered negative results [findings that are validated outside the research context in which they were generated], you must report them in the results section of your paper. In the conclusion, use the negative results as an opportunity to explain how they provide information on which future research can be based. Failure to provide a clear summary of what was learned In order to be able to discuss how your research fits back into your field of study [and possibly the world at large], you need to summarize it briefly and directly. Often this element of your conclusion is only a few sentences long. Failure to match the objectives of your research Often research objectives change while the research is being carried out. This is not a problem unless you forget to go back and refine your original objectives in your introduction, as these changes emerge they must be documented so that they accurately reflect what you were trying to accomplish in your research [not what you thought you might accomplish when you began].

Resist the urge to apologize If you've immersed yourself in studying the research problem, you now know a good deal about it, perhaps even more than your professor! Nevertheless, by the time you have finished writing, you may be having some doubts about what you have produced. Repress those doubts!  Don't undermine your authority by saying something like, "This is just one approach to examining this problem; there may be other, much better approaches...."

Concluding Paragraphs. College Writing Center at Meramec. St. Louis Community College; Conclusions . The Writing Center. University of North Carolina; Conclusions . The Writing Lab and The OWL. Purdue University; Freedman, Leora  and Jerry Plotnick. Introductions and Conclusions . The Lab Report. University College Writing Centre. University of Toronto; Leibensperger, Summer. Draft Your Conclusion. Academic Center, the University of Houston-Victoria, 2003; Make Your Last Words Count . The Writer’s Handbook. Writing Center. University of Wisconsin, Madison; Tips for Writing a Good Conclusion . Writing@CSU. Colorado State University; Kretchmer, Paul. Twelve Steps to Writing an Effective Conclusion . San Francisco Edit, 2003-2008; Writing Conclusions . Writing Tutorial Services, Center for Innovative Teaching and Learning. Indiana University; Writing: Considering Structure and Organization . Institute for Writing Rhetoric. Dartmouth College.

Writing Tip

Don't Belabor the Obvious!

Avoid phrases like "in conclusion...," "in summary...," or "in closing...." These phrases can be useful, even welcome, in oral presentations. But readers can see by the tell-tale section heading and number of pages remaining to read, when an essay is about to end. You'll irritate your readers if you belabor the obvious.

Another Writing Tip

New Insight, Not New Information!

Don't surprise the reader with new information in your Conclusion that was never referenced anywhere else in the paper. If you have new information to present, add it to the Discussion or other appropriate section of the paper.  Note that, although no actual new information is introduced, the conclusion is where you offer your most "original" contributions in the paper; it's where you describe the value of your research, demonstrate your understanding of the material that you’ve presented, and locate your findings within the larger context of scholarship on the topic.

• << Previous: Limitations of the Study
• Next: Appendices >>
• Last Updated: Jul 18, 2023 11:58 AM
• URL: https://library.sacredheart.edu/c.php?g=29803
• QuickSearch
• Library Catalog
• Databases A-Z
• Publication Finder
• Course Reserves
• Citation Linker
• Digital Commons
• Our Website

Research Support

• Ask a Librarian
• Appointments
• Interlibrary Loan (ILL)
• Research Guides
• Databases by Subject
• Citation Help

Using the Library

• Reserve a Group Study Room
• Renew Books
• Honors Study Rooms
• Off-Campus Access
• Library Policies
• Library Technology

User Information

• Grad Students
• Online Students
• COVID-19 Updates
• Staff Directory
• News & Announcements
• Library Newsletter

My Accounts

• Interlibrary Loan
• Staff Site Login

FIND US ON  

How to Write a Conclusion for a Research Paper

When you're wrapping up a research paper, the conclusion is like the grand finale of a fireworks show – it's your chance to leave a lasting impression. In this article, we'll break down the steps to help you write a winning research paper conclusion that not only recaps your main points but also ties everything together. Consider it the "So what?" moment – why should people care about your research? Our professional essay writers will guide you through making your conclusion strong, clear, and something that sticks with your readers long after they've put down your paper. So, let's dive in and ensure your research ends on a high note!

What Is a Conclusion in a Research Paper

In a research paper, the conclusion serves as the final segment, where you summarize the main points and findings of your study. It's not just a repetition of what you've already said but rather a chance to tie everything together and highlight the significance of your research. As you learn how to start a research paper , a good conclusion also often discusses the implications of your findings, suggests potential areas for further research, and leaves the reader with a lasting impression of the importance and relevance of your work in the broader context of the field. Essentially, it's your last opportunity to make a strong impact and leave your readers with a clear understanding of the significance of your research. Here’s a research paper conclusion example:

In conclusion, this research paper has navigated the intricacies of sustainable urban development, shedding light on the pivotal role of community engagement and innovative planning strategies. Through applying qualitative and quantitative research methods, we've uncovered valuable insights into the challenges and opportunities inherent in fostering environmentally friendly urban spaces. The implications of these findings extend beyond the confines of this study, emphasizing the imperative for continued exploration in the realms of urban planning and environmental sustainability. By emphasizing both the practical applications and theoretical contributions, this research underscores the significance of community involvement and forward-thinking strategies in shaping the future of urban landscapes. As cities evolve, incorporating these insights into planning and development practices will create resilient and harmonious urban environments.

Conclusion Outline for Research Paper

This outline for a research paper conclusion provides a structured framework to ensure that your ending effectively summarizes the key elements of your research paper and leaves a lasting impression on your readers. Adjust the content based on the specific requirements and focus of your research.

Restate the Thesis Statement

• Briefly restate the main thesis or research question.
• Emphasize the core objective or purpose of the study.

Summarize Key Findings

• Recap the main points and key findings from each section of the paper.
• Provide a concise overview of the research journey.

Discuss Implications

• Explore the broader implications of the research findings.
• Discuss how the results contribute to the existing body of knowledge in the field.

Address Limitations

• Acknowledge any limitations or constraints encountered during the research process.
• Explain how these limitations may impact the interpretation of the findings.

Suggest Areas for Future Research

• Propose potential directions for future studies related to the topic.
• Identify gaps in the current research that warrant further exploration.

Reaffirm Significance

• Reaffirm the importance and relevance of the research in the broader context.
• Highlight the practical applications or real-world implications of the study.

Concluding Statement

• Craft a strong, memorable closing statement that leaves a lasting impression.
• Sum up the overall impact of the research and its potential contribution to the field.

Study the full guide on how to make a research paper outline here, which will also specify the conclusion writing specifics to improve your general prowess.

Tips on How to Make a Conclusion in Research

Here are key considerations regarding a conclusion for research paper to not only recap the primary ideas in your work but also delve deeper to earn a higher grade:

• Provide a concise recap of your main research outcomes.
• Remind readers of your research goals and their accomplishments.
• Stick to summarizing existing content; refrain from adding new details.
• Emphasize why your research matters and its broader implications.
• Clearly explain the practical or theoretical impact of your findings.
• Prompt readers to reflect on how your research influences their perspective.
• Briefly discuss the robustness of your research methods.
• End with a suggestion for future research or a practical application.
• Transparently address any constraints or biases in your study.
• End on a powerful note, leaving a memorable impression on your readers.

For your inspiration, we’ve also prepared this research proposal example APA , which dwells on another important aspect of research writing.

How to Write a Research Paper Conclusion

As you finish your research paper, the conclusion takes center stage. In this section, we've got five practical tips for writing a conclusion for a research paper. We'll guide you through summarizing your key findings, revisiting your research goals, discussing the bigger picture, addressing any limitations, and ending on a powerful note. Think of it as your roadmap to creating a conclusion that not only wraps up your research but also leaves a lasting impact on your readers. Let's dive in and make sure your conclusion stands out for all the right reasons!

Synthesize Core Discoveries. Initiate your conclusion by synthesizing the essential discoveries of your research. Offer a succinct recapitulation of the primary points and outcomes you have elucidated in your paper. This aids in reinforcing the gravity of your work and reiterates the pivotal information you have presented.

Revisit Research Objectives. Revisit the research objectives or questions you outlined at the beginning of your paper. Assess whether you have successfully addressed these objectives and if your findings align with the initial goals of your research. This reflection helps tie your conclusion back to the purpose of your study.

Discuss Implications and Contributions. Discuss the broader implications of your research and its potential contributions to the field. Consider how your findings might impact future research, applications, or understanding of the subject matter. This demonstrates the significance of your work and places it within a larger context.

Address Limitations and Future Research. Acknowledge any limitations in your study, such as constraints in data collection or potential biases. Briefly discuss how these limitations might have affected your results. Additionally, suggest areas for future research that could build upon your work, addressing any unanswered questions or unexplored aspects. This demonstrates a thoughtful approach to your research.

End with a Strong Conclusion Statement. Conclude your research paper with a strong and memorable statement that reinforces the key message you want readers to take away. This could be a call to action, a proposal for further investigation, or a reflection on the broader significance of your findings. Leave your readers with a lasting impression that emphasizes the importance of your research. Remember that you can buy a research paper anytime if you lack time or get stuck in writer’s block.

Want to Enjoy the Benefits of Academic Freedom?

With our top-notch writers and 24/7 support, you can relax and focus on what really matters

Stylistic Devices to Use in a Conclusion

Discover distinctive stylistic insights that you can apply when writing a conclusion for a research paper:

• Rhetorical Questions. When using rhetorical questions, strategically place them to engage readers' minds. For instance, you might pose a question that prompts reflection on the broader implications of your findings, leaving your audience with something to ponder.
• Powerful Language. Incorporate strong language to convey a sense of conviction and importance. Choose words that resonate with the overall tone of your research and amplify the significance of your conclusions. This adds weight to your key messages.
• Repetitions. Repetitions can be employed to reinforce essential ideas. Reiterate key phrases or concepts in a way that emphasizes their importance without sounding redundant. This technique serves to drive home your main points.
• Anecdotes. Integrating anecdotes into your conclusion can provide a human touch. Share a brief and relevant story that connects with your research, making the information more relatable and memorable for your audience.
• Vivid Imagery. Lastly, use vivid imagery to paint a picture in the minds of your readers. Appeal to their senses by describing scenarios or outcomes related to your research. This creates a more immersive and lasting impression.

If you have a larger paper to write, for example a thesis, use our custom dissertation writing can help you in no time.

How to Make a Conclusion Logically Appealing

Knowing how to write a conclusion for a research paper that is logically appealing is important for leaving a lasting impression on your readers. Here are some tips to achieve this:

Logical Sequencing

• Present your conclusion in a structured manner, following the natural flow of your paper. Readers should effortlessly follow your thought process, making your conclusion more accessible and persuasive.

Reinforce Main Arguments

• Emphasize the core arguments and findings from your research. By reinforcing key points, you solidify your stance and provide a logical culmination to your paper.

Address Counterarguments

• Acknowledge and address potential counterarguments or limitations in your research. Demonstrate intellectual honesty and strengthen your conclusion by preemptively addressing potential doubts.

Connect with Introduction

• Revisit themes or concepts introduced in your introduction to create a cohesive narrative, allowing readers to trace the logical progression of your research from start to finish.

Propose Actionable Insights

• Suggest practical applications or recommendations based on your findings. This will add a forward-looking dimension, making your conclusion more relevant and compelling.

Highlight Significance

• Clearly articulate the broader implications of your research to convey the importance of your work and its potential impact on the field, making your conclusion logically compelling.

Are you ready to produce an A-grade assignment? If not, opt for a custom research paper from our skilled writers across various disciplines.

Avoid These Things When Writing a Research Paper Conclusion

As you write your conclusion of research paper, there’s a list of things professional writers don’t recommend doing. Consider these issues carefully:

• Repetition of Exact Phrases
• Repetitively using the same phrases or sentences from the main body. Repetition can make your conclusion seem redundant and less engaging.
• Overly Lengthy Summaries
• Providing excessively detailed summaries of each section of your paper. Readers may lose interest if the conclusion becomes too long and detailed.
• Unclear Connection to the Introduction
• Failing to connect the conclusion back to the introduction. A lack of continuity may make the paper feel disjointed.
• Adding New Arguments or Ideas
• Introducing new arguments or ideas that were not addressed in the body. This can confuse the reader and disrupt the coherence of your paper.
• Overuse of Complex Jargon
• Using excessively complex or technical language without clarification. Clear communication is essential in the conclusion, ensuring broad understanding.
• Apologizing or Undermining Confidence
• Apologizing for limitations or expressing doubt about your work. Maintain a confident tone; if limitations exist, present them objectively without undermining your research.
• Sweeping Generalizations
• Making overly broad or unsupported generalizations. Such statements can weaken the credibility of your conclusion.
• Neglecting the Significance
• Failing to emphasize the broader significance of your research. Readers need to understand why your findings matter in a larger context.
• Abrupt Endings
• Concluding abruptly without a strong closing statement. A powerful ending leaves a lasting impression; avoid a sudden or weak conclusion.

Research Paper Conclusion Example

That covers the essential aspects of summarizing a research paper. The only remaining step is to review the conclusion examples for research paper provided by our team.

Like our examples? Order our research proposal writing service to write paper according to your instructions to avoid plagiarizing and to keep your academic integrity strong.

Final Thoughts

In conclusion, the knowledge of how to write the conclusion of a research paper is pivotal for presenting your findings and leaving a lasting impression on your readers. By summarizing the key points, reiterating the significance of your research, and offering avenues for future exploration, you can create a conclusion that not only reinforces the value of your study but also encourages further academic discourse. Remember to balance brevity and completeness, ensuring your conclusion is concise yet comprehensive. Emphasizing the practical implications of your research and connecting it to the broader academic landscape will help solidify the impact of your work. Pay someone to write a research paper if you are having a hard time finishing your coursework on time.

Tired of Stressing Over Endless Essays and Deadlines? 

Let us take the load off your shoulders! Order your custom research paper today and experience the relief of knowing that your assignment is in expert hands

How To Write A Conclusion For A Research Paper?

What should the conclusion of a research paper contain, how to start a conclusion paragraph for a research paper.

Daniel Parker

is a seasoned educational writer focusing on scholarship guidance, research papers, and various forms of academic essays including reflective and narrative essays. His expertise also extends to detailed case studies. A scholar with a background in English Literature and Education, Daniel’s work on EssayPro blog aims to support students in achieving academic excellence and securing scholarships. His hobbies include reading classic literature and participating in academic forums.

is an expert in nursing and healthcare, with a strong background in history, law, and literature. Holding advanced degrees in nursing and public health, his analytical approach and comprehensive knowledge help students navigate complex topics. On EssayPro blog, Adam provides insightful articles on everything from historical analysis to the intricacies of healthcare policies. In his downtime, he enjoys historical documentaries and volunteering at local clinics.

Related Articles

• Privacy Policy

Home » Research Paper – Structure, Examples and Writing Guide

Research Paper – Structure, Examples and Writing Guide

Table of Contents

Research Paper

Definition:

Research Paper is a written document that presents the author’s original research, analysis, and interpretation of a specific topic or issue.

It is typically based on Empirical Evidence, and may involve qualitative or quantitative research methods, or a combination of both. The purpose of a research paper is to contribute new knowledge or insights to a particular field of study, and to demonstrate the author’s understanding of the existing literature and theories related to the topic.

Structure of Research Paper

The structure of a research paper typically follows a standard format, consisting of several sections that convey specific information about the research study. The following is a detailed explanation of the structure of a research paper:

The title page contains the title of the paper, the name(s) of the author(s), and the affiliation(s) of the author(s). It also includes the date of submission and possibly, the name of the journal or conference where the paper is to be published.

The abstract is a brief summary of the research paper, typically ranging from 100 to 250 words. It should include the research question, the methods used, the key findings, and the implications of the results. The abstract should be written in a concise and clear manner to allow readers to quickly grasp the essence of the research.

Introduction

The introduction section of a research paper provides background information about the research problem, the research question, and the research objectives. It also outlines the significance of the research, the research gap that it aims to fill, and the approach taken to address the research question. Finally, the introduction section ends with a clear statement of the research hypothesis or research question.

Literature Review

The literature review section of a research paper provides an overview of the existing literature on the topic of study. It includes a critical analysis and synthesis of the literature, highlighting the key concepts, themes, and debates. The literature review should also demonstrate the research gap and how the current study seeks to address it.

The methods section of a research paper describes the research design, the sample selection, the data collection and analysis procedures, and the statistical methods used to analyze the data. This section should provide sufficient detail for other researchers to replicate the study.

The results section presents the findings of the research, using tables, graphs, and figures to illustrate the data. The findings should be presented in a clear and concise manner, with reference to the research question and hypothesis.

The discussion section of a research paper interprets the findings and discusses their implications for the research question, the literature review, and the field of study. It should also address the limitations of the study and suggest future research directions.

The conclusion section summarizes the main findings of the study, restates the research question and hypothesis, and provides a final reflection on the significance of the research.

The references section provides a list of all the sources cited in the paper, following a specific citation style such as APA, MLA or Chicago.

How to Write Research Paper

You can write Research Paper by the following guide:

• Choose a Topic: The first step is to select a topic that interests you and is relevant to your field of study. Brainstorm ideas and narrow down to a research question that is specific and researchable.
• Conduct a Literature Review: The literature review helps you identify the gap in the existing research and provides a basis for your research question. It also helps you to develop a theoretical framework and research hypothesis.
• Develop a Thesis Statement : The thesis statement is the main argument of your research paper. It should be clear, concise and specific to your research question.
• Plan your Research: Develop a research plan that outlines the methods, data sources, and data analysis procedures. This will help you to collect and analyze data effectively.
• Collect and Analyze Data: Collect data using various methods such as surveys, interviews, observations, or experiments. Analyze data using statistical tools or other qualitative methods.
• Organize your Paper : Organize your paper into sections such as Introduction, Literature Review, Methods, Results, Discussion, and Conclusion. Ensure that each section is coherent and follows a logical flow.
• Write your Paper : Start by writing the introduction, followed by the literature review, methods, results, discussion, and conclusion. Ensure that your writing is clear, concise, and follows the required formatting and citation styles.
• Edit and Proofread your Paper: Review your paper for grammar and spelling errors, and ensure that it is well-structured and easy to read. Ask someone else to review your paper to get feedback and suggestions for improvement.
• Cite your Sources: Ensure that you properly cite all sources used in your research paper. This is essential for giving credit to the original authors and avoiding plagiarism.

Research Paper Example

Note : The below example research paper is for illustrative purposes only and is not an actual research paper. Actual research papers may have different structures, contents, and formats depending on the field of study, research question, data collection and analysis methods, and other factors. Students should always consult with their professors or supervisors for specific guidelines and expectations for their research papers.

Research Paper Example sample for Students:

Title: The Impact of Social Media on Mental Health among Young Adults

Abstract: This study aims to investigate the impact of social media use on the mental health of young adults. A literature review was conducted to examine the existing research on the topic. A survey was then administered to 200 university students to collect data on their social media use, mental health status, and perceived impact of social media on their mental health. The results showed that social media use is positively associated with depression, anxiety, and stress. The study also found that social comparison, cyberbullying, and FOMO (Fear of Missing Out) are significant predictors of mental health problems among young adults.

Introduction: Social media has become an integral part of modern life, particularly among young adults. While social media has many benefits, including increased communication and social connectivity, it has also been associated with negative outcomes, such as addiction, cyberbullying, and mental health problems. This study aims to investigate the impact of social media use on the mental health of young adults.

Literature Review: The literature review highlights the existing research on the impact of social media use on mental health. The review shows that social media use is associated with depression, anxiety, stress, and other mental health problems. The review also identifies the factors that contribute to the negative impact of social media, including social comparison, cyberbullying, and FOMO.

Methods : A survey was administered to 200 university students to collect data on their social media use, mental health status, and perceived impact of social media on their mental health. The survey included questions on social media use, mental health status (measured using the DASS-21), and perceived impact of social media on their mental health. Data were analyzed using descriptive statistics and regression analysis.

Results : The results showed that social media use is positively associated with depression, anxiety, and stress. The study also found that social comparison, cyberbullying, and FOMO are significant predictors of mental health problems among young adults.

Discussion : The study’s findings suggest that social media use has a negative impact on the mental health of young adults. The study highlights the need for interventions that address the factors contributing to the negative impact of social media, such as social comparison, cyberbullying, and FOMO.

Conclusion : In conclusion, social media use has a significant impact on the mental health of young adults. The study’s findings underscore the need for interventions that promote healthy social media use and address the negative outcomes associated with social media use. Future research can explore the effectiveness of interventions aimed at reducing the negative impact of social media on mental health. Additionally, longitudinal studies can investigate the long-term effects of social media use on mental health.

Limitations : The study has some limitations, including the use of self-report measures and a cross-sectional design. The use of self-report measures may result in biased responses, and a cross-sectional design limits the ability to establish causality.

Implications: The study’s findings have implications for mental health professionals, educators, and policymakers. Mental health professionals can use the findings to develop interventions that address the negative impact of social media use on mental health. Educators can incorporate social media literacy into their curriculum to promote healthy social media use among young adults. Policymakers can use the findings to develop policies that protect young adults from the negative outcomes associated with social media use.

References :

• Twenge, J. M., & Campbell, W. K. (2019). Associations between screen time and lower psychological well-being among children and adolescents: Evidence from a population-based study. Preventive medicine reports, 15, 100918.
• Primack, B. A., Shensa, A., Escobar-Viera, C. G., Barrett, E. L., Sidani, J. E., Colditz, J. B., … & James, A. E. (2017). Use of multiple social media platforms and symptoms of depression and anxiety: A nationally-representative study among US young adults. Computers in Human Behavior, 69, 1-9.
• Van der Meer, T. G., & Verhoeven, J. W. (2017). Social media and its impact on academic performance of students. Journal of Information Technology Education: Research, 16, 383-398.

Appendix : The survey used in this study is provided below.

Social Media and Mental Health Survey

• How often do you use social media per day?
• Less than 30 minutes
• 30 minutes to 1 hour
• 1 to 2 hours
• 2 to 4 hours
• More than 4 hours
• Which social media platforms do you use?
• Others (Please specify)
• How often do you experience the following on social media?
• Social comparison (comparing yourself to others)
• Cyberbullying
• Fear of Missing Out (FOMO)
• Have you ever experienced any of the following mental health problems in the past month?
• Do you think social media use has a positive or negative impact on your mental health?
• Very positive
• Somewhat positive
• Somewhat negative
• Very negative
• In your opinion, which factors contribute to the negative impact of social media on mental health?
• Social comparison
• In your opinion, what interventions could be effective in reducing the negative impact of social media on mental health?
• Education on healthy social media use
• Counseling for mental health problems caused by social media
• Social media detox programs
• Regulation of social media use

Thank you for your participation!

Applications of Research Paper

Research papers have several applications in various fields, including:

• Advancing knowledge: Research papers contribute to the advancement of knowledge by generating new insights, theories, and findings that can inform future research and practice. They help to answer important questions, clarify existing knowledge, and identify areas that require further investigation.
• Informing policy: Research papers can inform policy decisions by providing evidence-based recommendations for policymakers. They can help to identify gaps in current policies, evaluate the effectiveness of interventions, and inform the development of new policies and regulations.
• Improving practice: Research papers can improve practice by providing evidence-based guidance for professionals in various fields, including medicine, education, business, and psychology. They can inform the development of best practices, guidelines, and standards of care that can improve outcomes for individuals and organizations.
• Educating students : Research papers are often used as teaching tools in universities and colleges to educate students about research methods, data analysis, and academic writing. They help students to develop critical thinking skills, research skills, and communication skills that are essential for success in many careers.
• Fostering collaboration: Research papers can foster collaboration among researchers, practitioners, and policymakers by providing a platform for sharing knowledge and ideas. They can facilitate interdisciplinary collaborations and partnerships that can lead to innovative solutions to complex problems.

When to Write Research Paper

Research papers are typically written when a person has completed a research project or when they have conducted a study and have obtained data or findings that they want to share with the academic or professional community. Research papers are usually written in academic settings, such as universities, but they can also be written in professional settings, such as research organizations, government agencies, or private companies.

Here are some common situations where a person might need to write a research paper:

• For academic purposes: Students in universities and colleges are often required to write research papers as part of their coursework, particularly in the social sciences, natural sciences, and humanities. Writing research papers helps students to develop research skills, critical thinking skills, and academic writing skills.
• For publication: Researchers often write research papers to publish their findings in academic journals or to present their work at academic conferences. Publishing research papers is an important way to disseminate research findings to the academic community and to establish oneself as an expert in a particular field.
• To inform policy or practice : Researchers may write research papers to inform policy decisions or to improve practice in various fields. Research findings can be used to inform the development of policies, guidelines, and best practices that can improve outcomes for individuals and organizations.
• To share new insights or ideas: Researchers may write research papers to share new insights or ideas with the academic or professional community. They may present new theories, propose new research methods, or challenge existing paradigms in their field.

Purpose of Research Paper

The purpose of a research paper is to present the results of a study or investigation in a clear, concise, and structured manner. Research papers are written to communicate new knowledge, ideas, or findings to a specific audience, such as researchers, scholars, practitioners, or policymakers. The primary purposes of a research paper are:

• To contribute to the body of knowledge : Research papers aim to add new knowledge or insights to a particular field or discipline. They do this by reporting the results of empirical studies, reviewing and synthesizing existing literature, proposing new theories, or providing new perspectives on a topic.
• To inform or persuade: Research papers are written to inform or persuade the reader about a particular issue, topic, or phenomenon. They present evidence and arguments to support their claims and seek to persuade the reader of the validity of their findings or recommendations.
• To advance the field: Research papers seek to advance the field or discipline by identifying gaps in knowledge, proposing new research questions or approaches, or challenging existing assumptions or paradigms. They aim to contribute to ongoing debates and discussions within a field and to stimulate further research and inquiry.
• To demonstrate research skills: Research papers demonstrate the author’s research skills, including their ability to design and conduct a study, collect and analyze data, and interpret and communicate findings. They also demonstrate the author’s ability to critically evaluate existing literature, synthesize information from multiple sources, and write in a clear and structured manner.

Characteristics of Research Paper

Research papers have several characteristics that distinguish them from other forms of academic or professional writing. Here are some common characteristics of research papers:

• Evidence-based: Research papers are based on empirical evidence, which is collected through rigorous research methods such as experiments, surveys, observations, or interviews. They rely on objective data and facts to support their claims and conclusions.
• Structured and organized: Research papers have a clear and logical structure, with sections such as introduction, literature review, methods, results, discussion, and conclusion. They are organized in a way that helps the reader to follow the argument and understand the findings.
• Formal and objective: Research papers are written in a formal and objective tone, with an emphasis on clarity, precision, and accuracy. They avoid subjective language or personal opinions and instead rely on objective data and analysis to support their arguments.
• Citations and references: Research papers include citations and references to acknowledge the sources of information and ideas used in the paper. They use a specific citation style, such as APA, MLA, or Chicago, to ensure consistency and accuracy.
• Peer-reviewed: Research papers are often peer-reviewed, which means they are evaluated by other experts in the field before they are published. Peer-review ensures that the research is of high quality, meets ethical standards, and contributes to the advancement of knowledge in the field.
• Objective and unbiased: Research papers strive to be objective and unbiased in their presentation of the findings. They avoid personal biases or preconceptions and instead rely on the data and analysis to draw conclusions.

Advantages of Research Paper

Research papers have many advantages, both for the individual researcher and for the broader academic and professional community. Here are some advantages of research papers:

• Contribution to knowledge: Research papers contribute to the body of knowledge in a particular field or discipline. They add new information, insights, and perspectives to existing literature and help advance the understanding of a particular phenomenon or issue.
• Opportunity for intellectual growth: Research papers provide an opportunity for intellectual growth for the researcher. They require critical thinking, problem-solving, and creativity, which can help develop the researcher’s skills and knowledge.
• Career advancement: Research papers can help advance the researcher’s career by demonstrating their expertise and contributions to the field. They can also lead to new research opportunities, collaborations, and funding.
• Academic recognition: Research papers can lead to academic recognition in the form of awards, grants, or invitations to speak at conferences or events. They can also contribute to the researcher’s reputation and standing in the field.
• Impact on policy and practice: Research papers can have a significant impact on policy and practice. They can inform policy decisions, guide practice, and lead to changes in laws, regulations, or procedures.
• Advancement of society: Research papers can contribute to the advancement of society by addressing important issues, identifying solutions to problems, and promoting social justice and equality.

Limitations of Research Paper

Research papers also have some limitations that should be considered when interpreting their findings or implications. Here are some common limitations of research papers:

• Limited generalizability: Research findings may not be generalizable to other populations, settings, or contexts. Studies often use specific samples or conditions that may not reflect the broader population or real-world situations.
• Potential for bias : Research papers may be biased due to factors such as sample selection, measurement errors, or researcher biases. It is important to evaluate the quality of the research design and methods used to ensure that the findings are valid and reliable.
• Ethical concerns: Research papers may raise ethical concerns, such as the use of vulnerable populations or invasive procedures. Researchers must adhere to ethical guidelines and obtain informed consent from participants to ensure that the research is conducted in a responsible and respectful manner.
• Limitations of methodology: Research papers may be limited by the methodology used to collect and analyze data. For example, certain research methods may not capture the complexity or nuance of a particular phenomenon, or may not be appropriate for certain research questions.
• Publication bias: Research papers may be subject to publication bias, where positive or significant findings are more likely to be published than negative or non-significant findings. This can skew the overall findings of a particular area of research.
• Time and resource constraints: Research papers may be limited by time and resource constraints, which can affect the quality and scope of the research. Researchers may not have access to certain data or resources, or may be unable to conduct long-term studies due to practical limitations.

About the author

Muhammad Hassan

Researcher, Academic Writer, Web developer

You may also like

How to Cite Research Paper – All Formats and...

Data Collection – Methods Types and Examples

Delimitations in Research – Types, Examples and...

Research Paper Format – Types, Examples and...

Research Process – Steps, Examples and Tips

Research Design – Types, Methods and Examples

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Korean Med Sci
• v.37(16); 2022 Apr 25

A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

Edward barroga.

1 Department of General Education, Graduate School of Nursing Science, St. Luke’s International University, Tokyo, Japan.

Glafera Janet Matanguihan

2 Department of Biological Sciences, Messiah University, Mechanicsburg, PA, USA.

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarify the main purpose and specific objectives of the study, which in turn dictate the design of the study, its direction, and outcome. Studies developed from good research questions and hypotheses will have trustworthy outcomes with wide-ranging social and health implications.

INTRODUCTION

Scientific research is usually initiated by posing evidenced-based research questions which are then explicitly restated as hypotheses. 1 , 2 The hypotheses provide directions to guide the study, solutions, explanations, and expected results. 3 , 4 Both research questions and hypotheses are essentially formulated based on conventional theories and real-world processes, which allow the inception of novel studies and the ethical testing of ideas. 5 , 6

It is crucial to have knowledge of both quantitative and qualitative research 2 as both types of research involve writing research questions and hypotheses. 7 However, these crucial elements of research are sometimes overlooked; if not overlooked, then framed without the forethought and meticulous attention it needs. Planning and careful consideration are needed when developing quantitative or qualitative research, particularly when conceptualizing research questions and hypotheses. 4

There is a continuing need to support researchers in the creation of innovative research questions and hypotheses, as well as for journal articles that carefully review these elements. 1 When research questions and hypotheses are not carefully thought of, unethical studies and poor outcomes usually ensue. Carefully formulated research questions and hypotheses define well-founded objectives, which in turn determine the appropriate design, course, and outcome of the study. This article then aims to discuss in detail the various aspects of crafting research questions and hypotheses, with the goal of guiding researchers as they develop their own. Examples from the authors and peer-reviewed scientific articles in the healthcare field are provided to illustrate key points.

DEFINITIONS AND RELATIONSHIP OF RESEARCH QUESTIONS AND HYPOTHESES

A research question is what a study aims to answer after data analysis and interpretation. The answer is written in length in the discussion section of the paper. Thus, the research question gives a preview of the different parts and variables of the study meant to address the problem posed in the research question. 1 An excellent research question clarifies the research writing while facilitating understanding of the research topic, objective, scope, and limitations of the study. 5

On the other hand, a research hypothesis is an educated statement of an expected outcome. This statement is based on background research and current knowledge. 8 , 9 The research hypothesis makes a specific prediction about a new phenomenon 10 or a formal statement on the expected relationship between an independent variable and a dependent variable. 3 , 11 It provides a tentative answer to the research question to be tested or explored. 4

Hypotheses employ reasoning to predict a theory-based outcome. 10 These can also be developed from theories by focusing on components of theories that have not yet been observed. 10 The validity of hypotheses is often based on the testability of the prediction made in a reproducible experiment. 8

Conversely, hypotheses can also be rephrased as research questions. Several hypotheses based on existing theories and knowledge may be needed to answer a research question. Developing ethical research questions and hypotheses creates a research design that has logical relationships among variables. These relationships serve as a solid foundation for the conduct of the study. 4 , 11 Haphazardly constructed research questions can result in poorly formulated hypotheses and improper study designs, leading to unreliable results. Thus, the formulations of relevant research questions and verifiable hypotheses are crucial when beginning research. 12

CHARACTERISTICS OF GOOD RESEARCH QUESTIONS AND HYPOTHESES

Excellent research questions are specific and focused. These integrate collective data and observations to confirm or refute the subsequent hypotheses. Well-constructed hypotheses are based on previous reports and verify the research context. These are realistic, in-depth, sufficiently complex, and reproducible. More importantly, these hypotheses can be addressed and tested. 13

There are several characteristics of well-developed hypotheses. Good hypotheses are 1) empirically testable 7 , 10 , 11 , 13 ; 2) backed by preliminary evidence 9 ; 3) testable by ethical research 7 , 9 ; 4) based on original ideas 9 ; 5) have evidenced-based logical reasoning 10 ; and 6) can be predicted. 11 Good hypotheses can infer ethical and positive implications, indicating the presence of a relationship or effect relevant to the research theme. 7 , 11 These are initially developed from a general theory and branch into specific hypotheses by deductive reasoning. In the absence of a theory to base the hypotheses, inductive reasoning based on specific observations or findings form more general hypotheses. 10

TYPES OF RESEARCH QUESTIONS AND HYPOTHESES

Research questions and hypotheses are developed according to the type of research, which can be broadly classified into quantitative and qualitative research. We provide a summary of the types of research questions and hypotheses under quantitative and qualitative research categories in Table 1 .

Research questions in quantitative research

In quantitative research, research questions inquire about the relationships among variables being investigated and are usually framed at the start of the study. These are precise and typically linked to the subject population, dependent and independent variables, and research design. 1 Research questions may also attempt to describe the behavior of a population in relation to one or more variables, or describe the characteristics of variables to be measured ( descriptive research questions ). 1 , 5 , 14 These questions may also aim to discover differences between groups within the context of an outcome variable ( comparative research questions ), 1 , 5 , 14 or elucidate trends and interactions among variables ( relationship research questions ). 1 , 5 We provide examples of descriptive, comparative, and relationship research questions in quantitative research in Table 2 .

Hypotheses in quantitative research

In quantitative research, hypotheses predict the expected relationships among variables. 15 Relationships among variables that can be predicted include 1) between a single dependent variable and a single independent variable ( simple hypothesis ) or 2) between two or more independent and dependent variables ( complex hypothesis ). 4 , 11 Hypotheses may also specify the expected direction to be followed and imply an intellectual commitment to a particular outcome ( directional hypothesis ) 4 . On the other hand, hypotheses may not predict the exact direction and are used in the absence of a theory, or when findings contradict previous studies ( non-directional hypothesis ). 4 In addition, hypotheses can 1) define interdependency between variables ( associative hypothesis ), 4 2) propose an effect on the dependent variable from manipulation of the independent variable ( causal hypothesis ), 4 3) state a negative relationship between two variables ( null hypothesis ), 4 , 11 , 15 4) replace the working hypothesis if rejected ( alternative hypothesis ), 15 explain the relationship of phenomena to possibly generate a theory ( working hypothesis ), 11 5) involve quantifiable variables that can be tested statistically ( statistical hypothesis ), 11 6) or express a relationship whose interlinks can be verified logically ( logical hypothesis ). 11 We provide examples of simple, complex, directional, non-directional, associative, causal, null, alternative, working, statistical, and logical hypotheses in quantitative research, as well as the definition of quantitative hypothesis-testing research in Table 3 .

Research questions in qualitative research

Unlike research questions in quantitative research, research questions in qualitative research are usually continuously reviewed and reformulated. The central question and associated subquestions are stated more than the hypotheses. 15 The central question broadly explores a complex set of factors surrounding the central phenomenon, aiming to present the varied perspectives of participants. 15

There are varied goals for which qualitative research questions are developed. These questions can function in several ways, such as to 1) identify and describe existing conditions ( contextual research question s); 2) describe a phenomenon ( descriptive research questions ); 3) assess the effectiveness of existing methods, protocols, theories, or procedures ( evaluation research questions ); 4) examine a phenomenon or analyze the reasons or relationships between subjects or phenomena ( explanatory research questions ); or 5) focus on unknown aspects of a particular topic ( exploratory research questions ). 5 In addition, some qualitative research questions provide new ideas for the development of theories and actions ( generative research questions ) or advance specific ideologies of a position ( ideological research questions ). 1 Other qualitative research questions may build on a body of existing literature and become working guidelines ( ethnographic research questions ). Research questions may also be broadly stated without specific reference to the existing literature or a typology of questions ( phenomenological research questions ), may be directed towards generating a theory of some process ( grounded theory questions ), or may address a description of the case and the emerging themes ( qualitative case study questions ). 15 We provide examples of contextual, descriptive, evaluation, explanatory, exploratory, generative, ideological, ethnographic, phenomenological, grounded theory, and qualitative case study research questions in qualitative research in Table 4 , and the definition of qualitative hypothesis-generating research in Table 5 .

Qualitative studies usually pose at least one central research question and several subquestions starting with How or What . These research questions use exploratory verbs such as explore or describe . These also focus on one central phenomenon of interest, and may mention the participants and research site. 15

Hypotheses in qualitative research

Hypotheses in qualitative research are stated in the form of a clear statement concerning the problem to be investigated. Unlike in quantitative research where hypotheses are usually developed to be tested, qualitative research can lead to both hypothesis-testing and hypothesis-generating outcomes. 2 When studies require both quantitative and qualitative research questions, this suggests an integrative process between both research methods wherein a single mixed-methods research question can be developed. 1

FRAMEWORKS FOR DEVELOPING RESEARCH QUESTIONS AND HYPOTHESES

Research questions followed by hypotheses should be developed before the start of the study. 1 , 12 , 14 It is crucial to develop feasible research questions on a topic that is interesting to both the researcher and the scientific community. This can be achieved by a meticulous review of previous and current studies to establish a novel topic. Specific areas are subsequently focused on to generate ethical research questions. The relevance of the research questions is evaluated in terms of clarity of the resulting data, specificity of the methodology, objectivity of the outcome, depth of the research, and impact of the study. 1 , 5 These aspects constitute the FINER criteria (i.e., Feasible, Interesting, Novel, Ethical, and Relevant). 1 Clarity and effectiveness are achieved if research questions meet the FINER criteria. In addition to the FINER criteria, Ratan et al. described focus, complexity, novelty, feasibility, and measurability for evaluating the effectiveness of research questions. 14

The PICOT and PEO frameworks are also used when developing research questions. 1 The following elements are addressed in these frameworks, PICOT: P-population/patients/problem, I-intervention or indicator being studied, C-comparison group, O-outcome of interest, and T-timeframe of the study; PEO: P-population being studied, E-exposure to preexisting conditions, and O-outcome of interest. 1 Research questions are also considered good if these meet the “FINERMAPS” framework: Feasible, Interesting, Novel, Ethical, Relevant, Manageable, Appropriate, Potential value/publishable, and Systematic. 14

As we indicated earlier, research questions and hypotheses that are not carefully formulated result in unethical studies or poor outcomes. To illustrate this, we provide some examples of ambiguous research question and hypotheses that result in unclear and weak research objectives in quantitative research ( Table 6 ) 16 and qualitative research ( Table 7 ) 17 , and how to transform these ambiguous research question(s) and hypothesis(es) into clear and good statements.

a These statements were composed for comparison and illustrative purposes only.

b These statements are direct quotes from Higashihara and Horiuchi. 16

a This statement is a direct quote from Shimoda et al. 17

The other statements were composed for comparison and illustrative purposes only.

CONSTRUCTING RESEARCH QUESTIONS AND HYPOTHESES

To construct effective research questions and hypotheses, it is very important to 1) clarify the background and 2) identify the research problem at the outset of the research, within a specific timeframe. 9 Then, 3) review or conduct preliminary research to collect all available knowledge about the possible research questions by studying theories and previous studies. 18 Afterwards, 4) construct research questions to investigate the research problem. Identify variables to be accessed from the research questions 4 and make operational definitions of constructs from the research problem and questions. Thereafter, 5) construct specific deductive or inductive predictions in the form of hypotheses. 4 Finally, 6) state the study aims . This general flow for constructing effective research questions and hypotheses prior to conducting research is shown in Fig. 1 .

Research questions are used more frequently in qualitative research than objectives or hypotheses. 3 These questions seek to discover, understand, explore or describe experiences by asking “What” or “How.” The questions are open-ended to elicit a description rather than to relate variables or compare groups. The questions are continually reviewed, reformulated, and changed during the qualitative study. 3 Research questions are also used more frequently in survey projects than hypotheses in experiments in quantitative research to compare variables and their relationships.

Hypotheses are constructed based on the variables identified and as an if-then statement, following the template, ‘If a specific action is taken, then a certain outcome is expected.’ At this stage, some ideas regarding expectations from the research to be conducted must be drawn. 18 Then, the variables to be manipulated (independent) and influenced (dependent) are defined. 4 Thereafter, the hypothesis is stated and refined, and reproducible data tailored to the hypothesis are identified, collected, and analyzed. 4 The hypotheses must be testable and specific, 18 and should describe the variables and their relationships, the specific group being studied, and the predicted research outcome. 18 Hypotheses construction involves a testable proposition to be deduced from theory, and independent and dependent variables to be separated and measured separately. 3 Therefore, good hypotheses must be based on good research questions constructed at the start of a study or trial. 12

In summary, research questions are constructed after establishing the background of the study. Hypotheses are then developed based on the research questions. Thus, it is crucial to have excellent research questions to generate superior hypotheses. In turn, these would determine the research objectives and the design of the study, and ultimately, the outcome of the research. 12 Algorithms for building research questions and hypotheses are shown in Fig. 2 for quantitative research and in Fig. 3 for qualitative research.

EXAMPLES OF RESEARCH QUESTIONS FROM PUBLISHED ARTICLES

• EXAMPLE 1. Descriptive research question (quantitative research)
• - Presents research variables to be assessed (distinct phenotypes and subphenotypes)
• “BACKGROUND: Since COVID-19 was identified, its clinical and biological heterogeneity has been recognized. Identifying COVID-19 phenotypes might help guide basic, clinical, and translational research efforts.
• RESEARCH QUESTION: Does the clinical spectrum of patients with COVID-19 contain distinct phenotypes and subphenotypes? ” 19
• EXAMPLE 2. Relationship research question (quantitative research)
• - Shows interactions between dependent variable (static postural control) and independent variable (peripheral visual field loss)
• “Background: Integration of visual, vestibular, and proprioceptive sensations contributes to postural control. People with peripheral visual field loss have serious postural instability. However, the directional specificity of postural stability and sensory reweighting caused by gradual peripheral visual field loss remain unclear.
• Research question: What are the effects of peripheral visual field loss on static postural control ?” 20
• EXAMPLE 3. Comparative research question (quantitative research)
• - Clarifies the difference among groups with an outcome variable (patients enrolled in COMPERA with moderate PH or severe PH in COPD) and another group without the outcome variable (patients with idiopathic pulmonary arterial hypertension (IPAH))
• “BACKGROUND: Pulmonary hypertension (PH) in COPD is a poorly investigated clinical condition.
• RESEARCH QUESTION: Which factors determine the outcome of PH in COPD?
• STUDY DESIGN AND METHODS: We analyzed the characteristics and outcome of patients enrolled in the Comparative, Prospective Registry of Newly Initiated Therapies for Pulmonary Hypertension (COMPERA) with moderate or severe PH in COPD as defined during the 6th PH World Symposium who received medical therapy for PH and compared them with patients with idiopathic pulmonary arterial hypertension (IPAH) .” 21
• EXAMPLE 4. Exploratory research question (qualitative research)
• - Explores areas that have not been fully investigated (perspectives of families and children who receive care in clinic-based child obesity treatment) to have a deeper understanding of the research problem
• “Problem: Interventions for children with obesity lead to only modest improvements in BMI and long-term outcomes, and data are limited on the perspectives of families of children with obesity in clinic-based treatment. This scoping review seeks to answer the question: What is known about the perspectives of families and children who receive care in clinic-based child obesity treatment? This review aims to explore the scope of perspectives reported by families of children with obesity who have received individualized outpatient clinic-based obesity treatment.” 22
• EXAMPLE 5. Relationship research question (quantitative research)
• - Defines interactions between dependent variable (use of ankle strategies) and independent variable (changes in muscle tone)
• “Background: To maintain an upright standing posture against external disturbances, the human body mainly employs two types of postural control strategies: “ankle strategy” and “hip strategy.” While it has been reported that the magnitude of the disturbance alters the use of postural control strategies, it has not been elucidated how the level of muscle tone, one of the crucial parameters of bodily function, determines the use of each strategy. We have previously confirmed using forward dynamics simulations of human musculoskeletal models that an increased muscle tone promotes the use of ankle strategies. The objective of the present study was to experimentally evaluate a hypothesis: an increased muscle tone promotes the use of ankle strategies. Research question: Do changes in the muscle tone affect the use of ankle strategies ?” 23

EXAMPLES OF HYPOTHESES IN PUBLISHED ARTICLES

• EXAMPLE 1. Working hypothesis (quantitative research)
• - A hypothesis that is initially accepted for further research to produce a feasible theory
• “As fever may have benefit in shortening the duration of viral illness, it is plausible to hypothesize that the antipyretic efficacy of ibuprofen may be hindering the benefits of a fever response when taken during the early stages of COVID-19 illness .” 24
• “In conclusion, it is plausible to hypothesize that the antipyretic efficacy of ibuprofen may be hindering the benefits of a fever response . The difference in perceived safety of these agents in COVID-19 illness could be related to the more potent efficacy to reduce fever with ibuprofen compared to acetaminophen. Compelling data on the benefit of fever warrant further research and review to determine when to treat or withhold ibuprofen for early stage fever for COVID-19 and other related viral illnesses .” 24
• EXAMPLE 2. Exploratory hypothesis (qualitative research)
• - Explores particular areas deeper to clarify subjective experience and develop a formal hypothesis potentially testable in a future quantitative approach
• “We hypothesized that when thinking about a past experience of help-seeking, a self distancing prompt would cause increased help-seeking intentions and more favorable help-seeking outcome expectations .” 25
• “Conclusion
• Although a priori hypotheses were not supported, further research is warranted as results indicate the potential for using self-distancing approaches to increasing help-seeking among some people with depressive symptomatology.” 25
• EXAMPLE 3. Hypothesis-generating research to establish a framework for hypothesis testing (qualitative research)
• “We hypothesize that compassionate care is beneficial for patients (better outcomes), healthcare systems and payers (lower costs), and healthcare providers (lower burnout). ” 26
• Compassionomics is the branch of knowledge and scientific study of the effects of compassionate healthcare. Our main hypotheses are that compassionate healthcare is beneficial for (1) patients, by improving clinical outcomes, (2) healthcare systems and payers, by supporting financial sustainability, and (3) HCPs, by lowering burnout and promoting resilience and well-being. The purpose of this paper is to establish a scientific framework for testing the hypotheses above . If these hypotheses are confirmed through rigorous research, compassionomics will belong in the science of evidence-based medicine, with major implications for all healthcare domains.” 26
• EXAMPLE 4. Statistical hypothesis (quantitative research)
• - An assumption is made about the relationship among several population characteristics ( gender differences in sociodemographic and clinical characteristics of adults with ADHD ). Validity is tested by statistical experiment or analysis ( chi-square test, Students t-test, and logistic regression analysis)
• “Our research investigated gender differences in sociodemographic and clinical characteristics of adults with ADHD in a Japanese clinical sample. Due to unique Japanese cultural ideals and expectations of women's behavior that are in opposition to ADHD symptoms, we hypothesized that women with ADHD experience more difficulties and present more dysfunctions than men . We tested the following hypotheses: first, women with ADHD have more comorbidities than men with ADHD; second, women with ADHD experience more social hardships than men, such as having less full-time employment and being more likely to be divorced.” 27
• “Statistical Analysis
• ( text omitted ) Between-gender comparisons were made using the chi-squared test for categorical variables and Students t-test for continuous variables…( text omitted ). A logistic regression analysis was performed for employment status, marital status, and comorbidity to evaluate the independent effects of gender on these dependent variables.” 27

EXAMPLES OF HYPOTHESIS AS WRITTEN IN PUBLISHED ARTICLES IN RELATION TO OTHER PARTS

• EXAMPLE 1. Background, hypotheses, and aims are provided
• “Pregnant women need skilled care during pregnancy and childbirth, but that skilled care is often delayed in some countries …( text omitted ). The focused antenatal care (FANC) model of WHO recommends that nurses provide information or counseling to all pregnant women …( text omitted ). Job aids are visual support materials that provide the right kind of information using graphics and words in a simple and yet effective manner. When nurses are not highly trained or have many work details to attend to, these job aids can serve as a content reminder for the nurses and can be used for educating their patients (Jennings, Yebadokpo, Affo, & Agbogbe, 2010) ( text omitted ). Importantly, additional evidence is needed to confirm how job aids can further improve the quality of ANC counseling by health workers in maternal care …( text omitted )” 28
• “ This has led us to hypothesize that the quality of ANC counseling would be better if supported by job aids. Consequently, a better quality of ANC counseling is expected to produce higher levels of awareness concerning the danger signs of pregnancy and a more favorable impression of the caring behavior of nurses .” 28
• “This study aimed to examine the differences in the responses of pregnant women to a job aid-supported intervention during ANC visit in terms of 1) their understanding of the danger signs of pregnancy and 2) their impression of the caring behaviors of nurses to pregnant women in rural Tanzania.” 28
• EXAMPLE 2. Background, hypotheses, and aims are provided
• “We conducted a two-arm randomized controlled trial (RCT) to evaluate and compare changes in salivary cortisol and oxytocin levels of first-time pregnant women between experimental and control groups. The women in the experimental group touched and held an infant for 30 min (experimental intervention protocol), whereas those in the control group watched a DVD movie of an infant (control intervention protocol). The primary outcome was salivary cortisol level and the secondary outcome was salivary oxytocin level.” 29
• “ We hypothesize that at 30 min after touching and holding an infant, the salivary cortisol level will significantly decrease and the salivary oxytocin level will increase in the experimental group compared with the control group .” 29
• EXAMPLE 3. Background, aim, and hypothesis are provided
• “In countries where the maternal mortality ratio remains high, antenatal education to increase Birth Preparedness and Complication Readiness (BPCR) is considered one of the top priorities [1]. BPCR includes birth plans during the antenatal period, such as the birthplace, birth attendant, transportation, health facility for complications, expenses, and birth materials, as well as family coordination to achieve such birth plans. In Tanzania, although increasing, only about half of all pregnant women attend an antenatal clinic more than four times [4]. Moreover, the information provided during antenatal care (ANC) is insufficient. In the resource-poor settings, antenatal group education is a potential approach because of the limited time for individual counseling at antenatal clinics.” 30
• “This study aimed to evaluate an antenatal group education program among pregnant women and their families with respect to birth-preparedness and maternal and infant outcomes in rural villages of Tanzania.” 30
• “ The study hypothesis was if Tanzanian pregnant women and their families received a family-oriented antenatal group education, they would (1) have a higher level of BPCR, (2) attend antenatal clinic four or more times, (3) give birth in a health facility, (4) have less complications of women at birth, and (5) have less complications and deaths of infants than those who did not receive the education .” 30

Research questions and hypotheses are crucial components to any type of research, whether quantitative or qualitative. These questions should be developed at the very beginning of the study. Excellent research questions lead to superior hypotheses, which, like a compass, set the direction of research, and can often determine the successful conduct of the study. Many research studies have floundered because the development of research questions and subsequent hypotheses was not given the thought and meticulous attention needed. The development of research questions and hypotheses is an iterative process based on extensive knowledge of the literature and insightful grasp of the knowledge gap. Focused, concise, and specific research questions provide a strong foundation for constructing hypotheses which serve as formal predictions about the research outcomes. Research questions and hypotheses are crucial elements of research that should not be overlooked. They should be carefully thought of and constructed when planning research. This avoids unethical studies and poor outcomes by defining well-founded objectives that determine the design, course, and outcome of the study.

Disclosure: The authors have no potential conflicts of interest to disclose.

Author Contributions:

• Conceptualization: Barroga E, Matanguihan GJ.
• Methodology: Barroga E, Matanguihan GJ.
• Writing - original draft: Barroga E, Matanguihan GJ.
• Writing - review & editing: Barroga E, Matanguihan GJ.

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• 8. The Discussion
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

The purpose of the discussion section is to interpret and describe the significance of your findings in relation to what was already known about the research problem being investigated and to explain any new understanding or insights that emerged as a result of your research. The discussion will always connect to the introduction by way of the research questions or hypotheses you posed and the literature you reviewed, but the discussion does not simply repeat or rearrange the first parts of your paper; the discussion clearly explains how your study advanced the reader's understanding of the research problem from where you left them at the end of your review of prior research.

Annesley, Thomas M. “The Discussion Section: Your Closing Argument.” Clinical Chemistry 56 (November 2010): 1671-1674; Peacock, Matthew. “Communicative Moves in the Discussion Section of Research Articles.” System 30 (December 2002): 479-497.

Importance of a Good Discussion

The discussion section is often considered the most important part of your research paper because it:

• Most effectively demonstrates your ability as a researcher to think critically about an issue, to develop creative solutions to problems based upon a logical synthesis of the findings, and to formulate a deeper, more profound understanding of the research problem under investigation;
• Presents the underlying meaning of your research, notes possible implications in other areas of study, and explores possible improvements that can be made in order to further develop the concerns of your research;
• Highlights the importance of your study and how it can contribute to understanding the research problem within the field of study;
• Presents how the findings from your study revealed and helped fill gaps in the literature that had not been previously exposed or adequately described; and,
• Engages the reader in thinking critically about issues based on an evidence-based interpretation of findings; it is not governed strictly by objective reporting of information.

Annesley Thomas M. “The Discussion Section: Your Closing Argument.” Clinical Chemistry 56 (November 2010): 1671-1674; Bitchener, John and Helen Basturkmen. “Perceptions of the Difficulties of Postgraduate L2 Thesis Students Writing the Discussion Section.” Journal of English for Academic Purposes 5 (January 2006): 4-18; Kretchmer, Paul. Fourteen Steps to Writing an Effective Discussion Section. San Francisco Edit, 2003-2008.

Structure and Writing Style

I.  General Rules

These are the general rules you should adopt when composing your discussion of the results :

• Do not be verbose or repetitive; be concise and make your points clearly
• Avoid the use of jargon or undefined technical language
• Follow a logical stream of thought; in general, interpret and discuss the significance of your findings in the same sequence you described them in your results section [a notable exception is to begin by highlighting an unexpected result or a finding that can grab the reader's attention]
• Use the present verb tense, especially for established facts; however, refer to specific works or prior studies in the past tense
• If needed, use subheadings to help organize your discussion or to categorize your interpretations into themes

II.  The Content

The content of the discussion section of your paper most often includes :

• Explanation of results : Comment on whether or not the results were expected for each set of findings; go into greater depth to explain findings that were unexpected or especially profound. If appropriate, note any unusual or unanticipated patterns or trends that emerged from your results and explain their meaning in relation to the research problem.
• References to previous research : Either compare your results with the findings from other studies or use the studies to support a claim. This can include re-visiting key sources already cited in your literature review section, or, save them to cite later in the discussion section if they are more important to compare with your results instead of being a part of the general literature review of prior research used to provide context and background information. Note that you can make this decision to highlight specific studies after you have begun writing the discussion section.
• Deduction : A claim for how the results can be applied more generally. For example, describing lessons learned, proposing recommendations that can help improve a situation, or highlighting best practices.
• Hypothesis : A more general claim or possible conclusion arising from the results [which may be proved or disproved in subsequent research]. This can be framed as new research questions that emerged as a consequence of your analysis.

III.  Organization and Structure

Keep the following sequential points in mind as you organize and write the discussion section of your paper:

• Think of your discussion as an inverted pyramid. Organize the discussion from the general to the specific, linking your findings to the literature, then to theory, then to practice [if appropriate].
• Use the same key terms, narrative style, and verb tense [present] that you used when describing the research problem in your introduction.
• Begin by briefly re-stating the research problem you were investigating and answer all of the research questions underpinning the problem that you posed in the introduction.
• Describe the patterns, principles, and relationships shown by each major findings and place them in proper perspective. The sequence of this information is important; first state the answer, then the relevant results, then cite the work of others. If appropriate, refer the reader to a figure or table to help enhance the interpretation of the data [either within the text or as an appendix].
• Regardless of where it's mentioned, a good discussion section includes analysis of any unexpected findings. This part of the discussion should begin with a description of the unanticipated finding, followed by a brief interpretation as to why you believe it appeared and, if necessary, its possible significance in relation to the overall study. If more than one unexpected finding emerged during the study, describe each of them in the order they appeared as you gathered or analyzed the data. As noted, the exception to discussing findings in the same order you described them in the results section would be to begin by highlighting the implications of a particularly unexpected or significant finding that emerged from the study, followed by a discussion of the remaining findings.
• Before concluding the discussion, identify potential limitations and weaknesses if you do not plan to do so in the conclusion of the paper. Comment on their relative importance in relation to your overall interpretation of the results and, if necessary, note how they may affect the validity of your findings. Avoid using an apologetic tone; however, be honest and self-critical [e.g., in retrospect, had you included a particular question in a survey instrument, additional data could have been revealed].
• The discussion section should end with a concise summary of the principal implications of the findings regardless of their significance. Give a brief explanation about why you believe the findings and conclusions of your study are important and how they support broader knowledge or understanding of the research problem. This can be followed by any recommendations for further research. However, do not offer recommendations which could have been easily addressed within the study. This would demonstrate to the reader that you have inadequately examined and interpreted the data.

IV.  Overall Objectives

The objectives of your discussion section should include the following: I.  Reiterate the Research Problem/State the Major Findings

Briefly reiterate the research problem or problems you are investigating and the methods you used to investigate them, then move quickly to describe the major findings of the study. You should write a direct, declarative, and succinct proclamation of the study results, usually in one paragraph.

II.  Explain the Meaning of the Findings and Why They are Important

No one has thought as long and hard about your study as you have. Systematically explain the underlying meaning of your findings and state why you believe they are significant. After reading the discussion section, you want the reader to think critically about the results and why they are important. You don’t want to force the reader to go through the paper multiple times to figure out what it all means. If applicable, begin this part of the section by repeating what you consider to be your most significant or unanticipated finding first, then systematically review each finding. Otherwise, follow the general order you reported the findings presented in the results section.

III.  Relate the Findings to Similar Studies

No study in the social sciences is so novel or possesses such a restricted focus that it has absolutely no relation to previously published research. The discussion section should relate your results to those found in other studies, particularly if questions raised from prior studies served as the motivation for your research. This is important because comparing and contrasting the findings of other studies helps to support the overall importance of your results and it highlights how and in what ways your study differs from other research about the topic. Note that any significant or unanticipated finding is often because there was no prior research to indicate the finding could occur. If there is prior research to indicate this, you need to explain why it was significant or unanticipated. IV.  Consider Alternative Explanations of the Findings

It is important to remember that the purpose of research in the social sciences is to discover and not to prove . When writing the discussion section, you should carefully consider all possible explanations for the study results, rather than just those that fit your hypothesis or prior assumptions and biases. This is especially important when describing the discovery of significant or unanticipated findings.

V.  Acknowledge the Study’s Limitations

It is far better for you to identify and acknowledge your study’s limitations than to have them pointed out by your professor! Note any unanswered questions or issues your study could not address and describe the generalizability of your results to other situations. If a limitation is applicable to the method chosen to gather information, then describe in detail the problems you encountered and why. VI.  Make Suggestions for Further Research

You may choose to conclude the discussion section by making suggestions for further research [as opposed to offering suggestions in the conclusion of your paper]. Although your study can offer important insights about the research problem, this is where you can address other questions related to the problem that remain unanswered or highlight hidden issues that were revealed as a result of conducting your research. You should frame your suggestions by linking the need for further research to the limitations of your study [e.g., in future studies, the survey instrument should include more questions that ask..."] or linking to critical issues revealed from the data that were not considered initially in your research.

NOTE: Besides the literature review section, the preponderance of references to sources is usually found in the discussion section . A few historical references may be helpful for perspective, but most of the references should be relatively recent and included to aid in the interpretation of your results, to support the significance of a finding, and/or to place a finding within a particular context. If a study that you cited does not support your findings, don't ignore it--clearly explain why your research findings differ from theirs.

V.  Problems to Avoid

• Do not waste time restating your results . Should you need to remind the reader of a finding to be discussed, use "bridge sentences" that relate the result to the interpretation. An example would be: “In the case of determining available housing to single women with children in rural areas of Texas, the findings suggest that access to good schools is important...," then move on to further explaining this finding and its implications.
• As noted, recommendations for further research can be included in either the discussion or conclusion of your paper, but do not repeat your recommendations in the both sections. Think about the overall narrative flow of your paper to determine where best to locate this information. However, if your findings raise a lot of new questions or issues, consider including suggestions for further research in the discussion section.
• Do not introduce new results in the discussion section. Be wary of mistaking the reiteration of a specific finding for an interpretation because it may confuse the reader. The description of findings [results section] and the interpretation of their significance [discussion section] should be distinct parts of your paper. If you choose to combine the results section and the discussion section into a single narrative, you must be clear in how you report the information discovered and your own interpretation of each finding. This approach is not recommended if you lack experience writing college-level research papers.
• Use of the first person pronoun is generally acceptable. Using first person singular pronouns can help emphasize a point or illustrate a contrasting finding. However, keep in mind that too much use of the first person can actually distract the reader from the main points [i.e., I know you're telling me this--just tell me!].

Analyzing vs. Summarizing. Department of English Writing Guide. George Mason University; Discussion. The Structure, Format, Content, and Style of a Journal-Style Scientific Paper. Department of Biology. Bates College; Hess, Dean R. "How to Write an Effective Discussion." Respiratory Care 49 (October 2004); Kretchmer, Paul. Fourteen Steps to Writing to Writing an Effective Discussion Section. San Francisco Edit, 2003-2008; The Lab Report. University College Writing Centre. University of Toronto; Sauaia, A. et al. "The Anatomy of an Article: The Discussion Section: "How Does the Article I Read Today Change What I Will Recommend to my Patients Tomorrow?” The Journal of Trauma and Acute Care Surgery 74 (June 2013): 1599-1602; Research Limitations & Future Research . Lund Research Ltd., 2012; Summary: Using it Wisely. The Writing Center. University of North Carolina; Schafer, Mickey S. Writing the Discussion. Writing in Psychology course syllabus. University of Florida; Yellin, Linda L. A Sociology Writer's Guide . Boston, MA: Allyn and Bacon, 2009.

Writing Tip

Don’t Over-Interpret the Results!

Interpretation is a subjective exercise. As such, you should always approach the selection and interpretation of your findings introspectively and to think critically about the possibility of judgmental biases unintentionally entering into discussions about the significance of your work. With this in mind, be careful that you do not read more into the findings than can be supported by the evidence you have gathered. Remember that the data are the data: nothing more, nothing less.

MacCoun, Robert J. "Biases in the Interpretation and Use of Research Results." Annual Review of Psychology 49 (February 1998): 259-287; Ward, Paulet al, editors. The Oxford Handbook of Expertise . Oxford, UK: Oxford University Press, 2018.

Another Writing Tip

Don't Write Two Results Sections!

One of the most common mistakes that you can make when discussing the results of your study is to present a superficial interpretation of the findings that more or less re-states the results section of your paper. Obviously, you must refer to your results when discussing them, but focus on the interpretation of those results and their significance in relation to the research problem, not the data itself.

Azar, Beth. "Discussing Your Findings."  American Psychological Association gradPSYCH Magazine (January 2006).

Yet Another Writing Tip

Avoid Unwarranted Speculation!

The discussion section should remain focused on the findings of your study. For example, if the purpose of your research was to measure the impact of foreign aid on increasing access to education among disadvantaged children in Bangladesh, it would not be appropriate to speculate about how your findings might apply to populations in other countries without drawing from existing studies to support your claim or if analysis of other countries was not a part of your original research design. If you feel compelled to speculate, do so in the form of describing possible implications or explaining possible impacts. Be certain that you clearly identify your comments as speculation or as a suggestion for where further research is needed. Sometimes your professor will encourage you to expand your discussion of the results in this way, while others don’t care what your opinion is beyond your effort to interpret the data in relation to the research problem.

• << Previous: Using Non-Textual Elements
• Next: Limitations of the Study >>
• Last Updated: May 15, 2024 9:53 AM
• URL: https://libguides.usc.edu/writingguide

• Open access
• Published: 13 May 2024

Sexual and reproductive health implementation research in humanitarian contexts: a scoping review

• Alexandra Norton 1 &
• Hannah Tappis 2  

Reproductive Health volume  21 , Article number:  64 ( 2024 ) Cite this article

85 Accesses

Metrics details

Meeting the health needs of crisis-affected populations is a growing challenge, with 339 million people globally in need of humanitarian assistance in 2023. Given one in four people living in humanitarian contexts are women and girls of reproductive age, sexual and reproductive health care is considered as essential health service and minimum standard for humanitarian response. Despite growing calls for increased investment in implementation research in humanitarian settings, guidance on appropriate methods and analytical frameworks is limited.

A scoping review was conducted to examine the extent to which implementation research frameworks have been used to evaluate sexual and reproductive health interventions in humanitarian settings. Peer-reviewed papers published from 2013 to 2022 were identified through relevant systematic reviews and a literature search of Pubmed, Embase, PsycInfo, CINAHL and Global Health databases. Papers that presented primary quantitative or qualitative data pertaining to a sexual and reproductive health intervention in a humanitarian setting were included.

Seven thousand thirty-six unique records were screened for inclusion, and 69 papers met inclusion criteria. Of these, six papers explicitly described the use of an implementation research framework, three citing use of the Consolidated Framework for Implementation Research. Three additional papers referenced other types of frameworks used in their evaluation. Factors cited across all included studies as helping the intervention in their presence or hindering in their absence were synthesized into the following Consolidated Framework for Implementation Research domains: Characteristics of Systems, Outer Setting, Inner Setting, Characteristics of Individuals, Intervention Characteristics, and Process.

This review found a wide range of methodologies and only six of 69 studies using an implementation research framework, highlighting an opportunity for standardization to better inform the evidence for and delivery of sexual and reproductive health interventions in humanitarian settings. Increased use of implementation research frameworks such as a modified Consolidated Framework for Implementation Research could work toward both expanding the evidence base and increasing standardization.

Plain English summary

Three hundred thirty-nine million people globally were in need of humanitarian assistance in 2023, and meeting the health needs of crisis-affected populations is a growing challenge. One in four people living in humanitarian contexts are women and girls of reproductive age, and provision of sexual and reproductive health care is considered to be essential within a humanitarian response. Implementation research can help to better understand how real-world contexts affect health improvement efforts. Despite growing calls for increased investment in implementation research in humanitarian settings, guidance on how best to do so is limited. This scoping review was conducted to examine the extent to which implementation research frameworks have been used to evaluate sexual and reproductive health interventions in humanitarian settings. Of 69 papers that met inclusion criteria for the review, six of them explicitly described the use of an implementation research framework. Three used the Consolidated Framework for Implementation Research, a theory-based framework that can guide implementation research. Three additional papers referenced other types of frameworks used in their evaluation. This review summarizes how factors relevant to different aspects of implementation within the included papers could have been organized using the Consolidated Framework for Implementation Research. The findings from this review highlight an opportunity for standardization to better inform the evidence for and delivery of sexual and reproductive health interventions in humanitarian settings. Increased use of implementation research frameworks such as a modified Consolidated Framework for Implementation Research could work toward both expanding the evidence base and increasing standardization.

Peer Review reports

Over the past few decades, the field of public health implementation research (IR) has grown as a means by which the real-world conditions affecting health improvement efforts can be better understood. Peters et al. put forward the following broad definition of IR for health: “IR is the scientific inquiry into questions concerning implementation – the act of carrying an intention into effect, which in health research can be policies, programmes, or individual practices (collectively called interventions)” [ 1 ].

As IR emphasizes real-world circumstances, the context within which a health intervention is delivered is a core consideration. However, much IR implemented to date has focused on higher-resource settings, with many proposed frameworks developed with particular utility for a higher-income setting [ 2 ]. In recognition of IR’s potential to increase evidence across a range of settings, there have been numerous reviews of the use of IR in lower-resource settings as well as calls for broader use [ 3 , 4 ]. There have also been more focused efforts to modify various approaches and frameworks to strengthen the relevance of IR to low- and middle-income country settings (LMICs), such as the work by Means et al. to adapt a specific IR framework for increased utility in LMICs [ 2 ].

Within LMIC settings, the centrality of context to a health intervention’s impact is of particular relevance in humanitarian settings, which present a set of distinct implementation challenges [ 5 ]. Humanitarian responses to crisis situations operate with limited resources, under potential security concerns, and often under pressure to relieve acute suffering and need [ 6 ]. Given these factors, successful implementation of a particular health intervention may require different qualities than those that optimize intervention impact under more stable circumstances [ 7 ]. Despite increasing recognition of the need for expanded evidence of health interventions in humanitarian settings, the evidence base remains limited [ 8 ]. Furthermore, despite its potential utility, there is not standardized guidance on IR in humanitarian settings, nor are there widely endorsed recommendations for the frameworks best suited to analyze implementation in these settings.

Sexual and reproductive health (SRH) is a core aspect of the health sector response in humanitarian settings [ 9 ]. Yet, progress in addressing SRH needs has lagged far behind other services because of challenges related to culture and ideology, financing constraints, lack of data and competing priorities [ 10 ]. The Minimum Initial Service Package (MISP) for SRH in Crisis Situations is the international standard for the minimum set of SRH services that should be implemented in all crisis situations [ 11 ]. However, as in other areas of health, there is need for expanded evidence for planning and implementation of SRH interventions in humanitarian settings. Recent systematic reviews of SRH in humanitarian settings have focused on the effectiveness of interventions and service delivery strategies, as well as factors affecting utilization, but have not detailed whether IR frameworks were used [ 12 , 13 , 14 , 15 ]. There have also been recent reviews examining IR frameworks used in various settings and research areas, but none have explicitly focused on humanitarian settings [ 2 , 16 ].

Given the need for an expanded evidence base for SRH interventions in humanitarian settings and the potential for IR to be used to expand the available evidence, a scoping review was undertaken. This scoping review sought to identify IR approaches that have been used in the last ten years to evaluate SRH interventions in humanitarian settings.

This review also sought to shed light on whether there is a need for a common framework to guide research design, analysis, and reporting for SRH interventions in humanitarian settings and if so, if there are any established frameworks already in use that would be fit-for-purpose or could be tailored to meet this need.

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) extension for scoping reviews was utilized to guide the elements of this review [ 17 ]. The review protocol was retrospectively registered with the Open Science Framework ( https://osf.io/b5qtz ).

Search strategy

A two-fold search strategy was undertaken for this review, which covered the last 10 years (2013–2022). First, recent systematic reviews pertaining to research or evaluation of SRH interventions in humanitarian settings were identified through keyword searches on PubMed and Google Scholar. Four relevant systematic reviews were identified [ 12 , 13 , 14 , 15 ] Table 1 .

Second, a literature search mirroring these reviews was conducted to identify relevant papers published since the completion of searches for the most recent review (April 2017). Additional file 1 includes the search terms that were used in the literature search [see Additional file 1 ].

The literature search was conducted for papers published from April 2017 to December 2022 in the databases that were searched in one or more of the systematic reviews: PubMed, Embase, PsycInfo, CINAHL and Global Health. Searches were completed in January 2023 Table 2 .

Two reviewers screened each identified study for alignment with inclusion criteria. Studies in the four systematic reviews identified were considered potentially eligible if published during the last 10 years. These papers then underwent full-text review to confirm satisfaction of all inclusion criteria, as inclusion criteria were similar but not fully aligned across the four reviews.

Literature search results were exported into a citation manager (Covidence), duplicates were removed, and a step-wise screening process for inclusion was applied. First, all papers underwent title and abstract screening. The remaining papers after abstract screening then underwent full-text review to confirm satisfaction of all inclusion criteria. Title and abstract screening as well as full-text review was conducted independently by both authors; disagreements after full-text review were resolved by consensus.

Data extraction and synthesis

The following content areas were summarized in Microsoft Excel for each paper that met inclusion criteria: publication details including author, year, country, setting [rural, urban, camp, settlement], population [refugees, internally displaced persons, general crisis-affected], crisis type [armed conflict, natural disaster], crisis stage [acute, chronic], study design, research methods, SRH intervention, and intervention target population [specific beneficiaries of the intervention within the broader population]; the use of an IR framework; details regarding the IR framework, how it was used, and any rationale given for the framework used; factors cited as impacting SRH interventions, either positively or negatively; and other key findings deemed relevant to this review.

As the focus of this review was on the approach taken for SRH intervention research and evaluation, the quality of the studies themselves was not assessed.

Twenty papers underwent full-text review due to their inclusion in one or more of the four systematic reviews and meeting publication date inclusion criteria. The literature search identified 7,016 unique papers. After full-text screening, 69 met all inclusion criteria and were included in the review. Figure  1 illustrates the search strategy and screening process.

Flow chart of paper identification

Papers published in each of the 10 years of the review timeframe (2013–2022) were included. 29% of the papers originated from the first five years of the time frame considered for this review, with the remaining 71% papers coming from the second half. Characteristics of included publications, including geographic location, type of humanitarian crisis, and type of SRH intervention, are presented in Table  3 .

A wide range of study designs and methods were used across the papers, with both qualitative and quantitative studies well represented. Twenty-six papers were quantitative evaluations [ 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 , 33 , 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 ], 17 were qualitative [ 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 ], and 26 used mixed methods [ 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 73 , 74 , 75 , 76 , 77 , 78 , 79 , 80 , 81 , 82 , 83 , 84 , 85 , 86 ]. Within the quantitative evaluations, 15 were observational, while five were quasi-experimental, five were randomized controlled trials, and one was an economic evaluation. Study designs as classified by the authors of this review are summarized in Table  4 .

Six papers (9%) explicitly cited use of an IR framework. Three of these papers utilized the Consolidated Framework for Implementation Research (CFIR) [ 51 , 65 , 70 ]. The CFIR is a commonly used determinant framework that—in its originally proposed form in 2009—is comprised of five domains, each of which has constructs to further categorize factors that impact implementation. The CFIR domains were identified as core content areas influencing the effectiveness of implementation, and the constructs within each domain are intended to provide a range of options for researchers to select from to “guide diagnostic assessments of implementation context, evaluate implementation progress, and help explain findings.” [ 87 ] To allow for consistent terminology throughout this review, the original 2009 CFIR domains and constructs are used.

Guan et al. conducted a mixed methods study to assess the feasibility and effectiveness of a neonatal hepatitis B immunization program in a conflict-affected rural region of Myanmar. Guan et al. report mapping data onto the CFIR as a secondary analysis step. They describe that “CFIR was used as a comprehensive meta-theoretical framework to examine the implementation of the Hepatitis B Virus vaccination program,” and implementation themes from multiple study data sources (interviews, observations, examination of monitoring materials) were mapped onto CFIR constructs. They report their results in two phases – Pre-implementation training and community education, and Implementation – with both anchored in themes that they had mapped onto CFIR domains and constructs. All but six constructs were included in their analysis, with a majority summarized in a table and key themes explored further in the narrative text. They specify that most concerns were identified within the Outer Setting and Process domains, while elements identified within the Inner Setting domain provided strength to the intervention and helped mitigate against barriers [ 70 ].

Sarker et al. conducted a qualitative study to assess provision of maternal, newborn and child health services to Rohingya refugees residing in camps in Cox’s Bazar, Bangladesh. They cite using CFIR as a guide for thematic analysis, applying it after a process of inductive and deductive coding to index these codes into the CFIR domains. They utilized three of the five CFIR domains (Outer Setting, Inner Setting, and Process), stating that the remaining two domains (Intervention Characteristics and Characteristics of Individuals) were not relevant to their analysis. They then proposed two additional CFIR domains, Context and Security, for use in humanitarian contexts. In contrast to Guan et al., CFIR constructs are not used nor mentioned by Sarker et al., with content under each domain instead synthesized as challenges and potential solutions. Regarding the CFIR, Sarker et al. write, “The CFIR guided us for interpretative coding and creating the challenges and possible solutions into groups for further clarification of the issues related to program delivery in a humanitarian crisis setting.” [ 51 ]

Sami et al. conducted a mixed methods case study to assess the implementation of a package of neonatal interventions at health facilities within refugee and internally displaced persons camps in South Sudan. They reference use of the CFIR earlier in the study than Sarker et al., basing their guides for semi-structured focus group discussions on the CFIR framework. They similarly reference a general use of the CFIR framework as they conducted thematic analysis. Constructs are referenced once, but they do not specify whether their application of the CFIR framework included use of domains, constructs, or both. This may be in part because they then applied an additional framework, the World Health Organization (WHO) Health System Framework, to present their findings. They describe a nested approach to their use of these frameworks: “Exploring these [CFIR] constructs within the WHO Health Systems Framework can identify specific entry points to improve the implementation of newborn interventions at critical health system building blocks.” [ 65 ]

Three papers cite use of different IR frameworks. Bolan et al. utilized the Theoretical Domains Framework in their mixed methods feasibility study and pilot cluster randomized trial evaluating pilot use of the Safe Delivery App by maternal and newborn health workers providing basic emergency obstetric and newborn care in facilities in the conflict-affected Maniema province of the Democratic Republic of the Congo (DRC). They used the Theroetical Domains Framework in designing interview questions, and further used it as the coding framework for their analysis. Similar to the CFIR, the Theoretical Domains Framework is a determinant framework that consists of domains, each of which then includes constructs. Bolan et al. utilized the Theoretical Domains Framework at the construct level in interview question development and at the domain level in their analysis, mapping interview responses to eight of the 14 domains [ 83 ]. Berg et al. report using an “exploratory design guided by the principles of an evaluation framework” developed by the Medical Research Council to analyze the implementation process, mechanisms of impact, and outcomes of a three-pillar training intervention to improve maternal and neonatal healthcare in the conflict-affected South Kivu province of the DRC [ 67 , 88 ]. Select components of this evaluation framework were used to guide deductive analysis of focus group discussions and in-depth interviews [ 67 ]. In their study of health workers’ knowledge and attitudes toward newborn health interventions in South Sudan, before and after training and supply provision, Sami et al. report use of the Conceptual Framework of the Role of Attitudes in Evidence-Based Practice Implementation in their analysis process. The framework was used to group codes following initial inductive coding analysis of in-depth interviews [ 72 ].

Three other papers cite use of specific frameworks in their intervention evaluation [ 19 , 44 , 76 ]. As a characteristic of IR is the use of an explicit framework to guide the research, the use of the frameworks in these three papers meets the intention of IR and serves the purpose that an IR framework would have in strengthening the analytical rigor. Castle et al. cite use of their program’s theory of change as a framework for a mixed methods evaluation of the provision of family planning services and more specifically uptake of long-acting reversible contraception use in the DRC. They describe use of the theory of change to “enhance effectiveness of [long-acting reversible contraception] access and uptake.” [ 76 ] Thommesen et al. cite use of the AAAQ (Availability, Accessibility, Acceptability and Quality) framework in their qualitative study assessing midwifery services provided to pregnant women in Afghanistan. This framework is focused on the “underlying elements needed for attainment of optimum standard of health care,” but the authors used it in this paper to evaluate facilitators and barriers to women accessing midwifery services [ 44 ]. Jarrett et al. cite use of the Centers for Disease Control and Prevention’s (CDC) Guidelines for Evaluating Public Health Surveillance Systems to explore the characteristics of a population mobility, mortality and birth surveillance system in South Kivu, DRC. Use of these CDC guidelines is cited as one of four study objectives, and commentary is included in the Results section pertaining to each criteria within these guidelines, although more detail regarding use of these guidelines or the authors’ experience with their use in the study is not provided [ 19 ].

Overall, 22 of the 69 papers either explicitly or implicitly identified IR as relevant to their work. Nineteen papers include a focus on feasibility (seven of which did not otherwise identify the importance of exploring questions concerning implementation), touching on a common outcome of interest in implementation research [ 89 ].

While a majority of papers did not explicitly or implicitly use an IR framework to evaluate their SRH intervention of focus, most identified factors that facilitated implementation when they were present or served as a barrier when absent. Sixty cite factors that served as facilitators and 49 cite factors that served as barriers, with just three not citing either. Fifty-nine distinct factors were identified across the papers.

Three of the six studies that explicitly used an IR framework used the CFIR, and the CFIR is the only IR framework that was used by multiple studies. As previously mentioned, Means et al. put forth an adaptation of the CFIR to increase its relevance in LMIC settings, proposing a sixth domain (Characteristics of Systems) and 11 additional constructs [ 2 ]. Using the expanded domains and constructs as proposed by Means et al., the 59 factors cited by papers in this review were thematically grouped into the six domains: Characteristics of Systems, Outer Setting, Inner Setting, Characteristics of Individuals, Intervention Characteristics, and Process. Within each domain, alignment with CFIR constructs was assessed for, and alignment was found with 29 constructs: eight of Means et al.’s 11 constructs, and 21 of the 39 standard CFIR constructs. Three factors did not align with any construct (all fitting within the Outer Setting domain), and 14 aligned with a construct label but not the associated definition. Table 5 synthesizes the mapping of factors affecting SRH intervention implementation to CFIR domains and constructs, with the construct appearing in italics if it is considered to align with that factor by label but not by definition.

Table 6 lists the CFIR constructs that were not found to have alignment with any factor cited by the papers in this review.

This scoping review sought to assess how IR frameworks have been used to bolster the evidence base for SRH interventions in humanitarian settings, and it revealed that IR frameworks, or an explicit IR approach, are rarely used. All four of the systematic reviews identified with a focus on SRH in humanitarian settings articulate the need for more research examining the effectiveness of SRH interventions in humanitarian settings, with two specifically citing a need for implementation research/science [ 12 , 13 ]. The distribution of papers across the timeframe included in this review does suggest that more research on SRH interventions for crisis-affected populations is taking place, as a majority of relevant papers were published in the second half of the review period. The papers included a wide range of methodologies, which reflect the differing research questions and contexts being evaluated. However, it also invites the question of whether there should be more standardization of outcomes measured or frameworks used to guide analysis and to facilitate increased comparison, synthesis and application across settings.

Three of the six papers that used an IR framework utilized the CFIR. Guan et al. used the CFIR at both a domain and construct level, Sarker et al. used the CFIR at the domain level, and Sami et al. did not specify which CFIR elements were used in informing the focus group discussion guide [ 51 , 65 , 70 ]. It is challenging to draw strong conclusions about the applicability of CFIR in humanitarian settings based on the minimal use of CFIR and IR frameworks within the papers reviewed, although Guan et al. provides a helpful model for how analysis can be structured around CFIR domains and constructs. It is worth considering that the minimal use of IR frameworks, and more specifically CFIR constructs, could be in part because that level of prescriptive categorization does not allow for enough fluidity in humanitarian settings. It also raises questions about the appropriate degree of standardization to pursue for research done in these settings.

The mapping of factors affecting SRH intervention implementation provides an example of how a modified CFIR framework could be used for IR in humanitarian contexts. This mapping exercise found factors that mapped to all five of the original CFIR domains as well as the sixth domain proposed by Means et al. All factors fit well within the definition for the selected domain, indicating an appropriate degree of fit between these existing domains and the factors identified as impacting SRH interventions in humanitarian settings. On a construct level, however, the findings were more variable, with one-quarter of factors not fully aligning with any construct. Furthermore, over 40% of the CFIR constructs (including the additional constructs from Means et al.) were not found to align with any factors cited by the papers in this review, also demonstrating some disconnect between the parameters posed by the CFIR constructs and the factors cited as relevant in a humanitarian context.

It is worth noting that while the CFIR as proposed in 2009 was used in this assessment, as well as in the included papers which used the CFIR, an update was published in 2022. Following a review of CFIR use since its publication, the authors provide updates to construct names and definitions to “make the framework more applicable across a range of innovations and settings.” New constructs and subconstructs were also added, for a total of 48 constructs and 19 subconstructs across the five domains [ 90 ]. A CFIR Outcomes Addendum was also published in 2022, based on recommendations for the CFIR to add outcomes and intended to be used as a complement to the CFIR determinants framework [ 91 ]. These expansions to the CFIR framework may improve applicability of the CFIR in humanitarian settings. Several constructs added to the Outer Setting domain could be of particular utility – critical incidents, local attitudes, and local conditions, each of which could help account for unique challenges faced in contexts of crisis. Sub-constructs added within the Inner Setting domain that seek to clarify structural characteristics and available resources would also be of high utility based on mapping of the factors identified in this review to the original CFIR constructs. As outcomes were not formally included in the CFIR until the 2022 addendum, a separate assessment of implementation outcomes was not undertaken in this review. However, analysis of the factors cited by papers in this review as affecting implementation was derived from the full text of the papers and thus captures content relevant to implementation determinants that is contained within the outcomes.

Given the demonstrated need for additional flexibility within an IR framework for humanitarian contexts, while not a focus of this review, it is worth considering whether a different framework could provide a better fit than the CFIR. Other frameworks have differing points of emphasis that would create different opportunities for flexibility but that do not seem to resolve the challenges experienced in applying the CFIR to a humanitarian context. As one example, the EPIS (Exploration, Preparation, Implementation, Sustainment) Framework considers the impact of inner and outer context on each of four implementation phases; while the constructs within this framework are broader than the CFIR, an emphasis on the intervention characteristics is missing, a domain where stronger alignment within the CFIR is also needed [ 92 ]. Alternatively, the PRISM (Practical, Robust Implementation and Sustainability Model) framework is a determinant and evaluation framework that adds consideration of context factors to the RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) outcomes framework. It has a stronger emphasis on intervention aspects, with sub-domains to account for both organization and patient perspectives within the intervention. While PRISM does include aspects of context, external environment considerations are less robust and intentionally less comprehensive in scope, which would not provide the degree of alignment possible between the Characteristics of Systems and Outer Setting CFIR domains for the considerations unique to humanitarian environments [ 93 ].

Reflecting on their experience with the CFIR, Sarker et al. indicate that it can be a “great asset” in both evaluating current work and developing future interventions. They also encourage future research of humanitarian health interventions to utilize the CFIR [ 51 ]. The other papers that used the CFIR do not specifically reflect on their experience utilizing it, referring more generally to having felt that it was a useful tool [ 65 , 70 ]. On their use of an evaluation framework, Berg et al. reflected that it lent useful structure and helped to identify aspects affecting implementation that otherwise would have gone un-noticed [ 67 ]. The remaining studies that utilized an IR framework did not specifically comment on their experience with its use [ 72 , 83 ]. While a formal IR framework was not engaged by other studies, a number cite a desire for IR to contribute further detail to their findings [ 21 , 37 ].

In their recommendations for strengthening the evidence base for humanitarian health interventions, Ager et al. speak to the need for “methodologic innovation” to develop methodologies with particular applicability in humanitarian settings [ 7 ]. As IR is not yet routinized for SRH interventions, this could be opportune timing for the use of a standardized IR framework to gauge its utility. Using an IR framework to assess factors influencing implementation of the MISP in initial stages of a humanitarian response, and interventions to support more comprehensive SRH service delivery in protracted crises, could lend further rigor and standardization to SRH evaluations, as well as inform strategies to improve MISP implementation over time. Based on categorizing factors identified by these papers as relevant for intervention evaluation, there does seem to be utility to a modified CFIR approach. Given the paucity of formal IR framework use within SRH literature, it would be worth conducting similar scoping exercises to assess for explicit use of IR frameworks within the evidence base for other health service delivery areas in humanitarian settings. In the interim, the recommended approach from this review for future IR on humanitarian health interventions would be a modified CFIR approach with domain-level standardization and flexibility for constructs that may standardize over time with more use. This would enable use of a common analytical framework and vocabulary at the domain level for stakeholders to describe interventions and the factors influencing the effectiveness of implementation, with constructs available to use and customize as most appropriate for specific contexts and interventions.

This review had a number of limitations. As this was a scoping review and a two-part search strategy was used, the papers summarized here may not be comprehensive of those written pertaining to SRH interventions over the past 10 years. Papers from 2013 to 2017 that would have met this scoping review’s inclusion criteria may have been omitted due to being excluded from the systematic reviews. The review was limited to papers available in English. Furthermore, this review did not assess the quality of the papers included or seek to assess the methodology used beyond examination of the use of an IR framework. It does, however, serve as a first step in assessing the extent to which calls for implementation research have been addressed, and identify entry points for strengthening the science and practice of SRH research in humanitarian settings.

With one in 23 people worldwide in need of humanitarian assistance, and financing required for response plans at an all-time high, the need for evidence to guide resource allocation and programming for SRH in humanitarian settings is as important as ever [ 94 ]. Recent research agenda setting initiatives and strategies to advance health in humanitarian settings call for increased investment in implementation research—with priorities ranging from research on effective strategies for expanding access to a full range of contraceptive options to integrating mental health and psychosocial support into SRH programming to capturing accurate and actionable data on maternal and perinatal mortality in a wide range of acute and protracted emergency contexts [ 95 , 96 ]. To truly advance guidance in these areas, implementation research will need to be conducted across diverse humanitarian settings, with clear and consistent documentation of both intervention characteristics and outcomes, as well as contextual and programmatic factors affecting implementation.

Conclusions

Implementation research has potential to increase impact of health interventions particularly in crisis-affected settings where flexibility, adaptability and context-responsive approaches are highlighted as cornerstones of effective programming. There remains significant opportunity for standardization of research in the humanitarian space, with one such opportunity occurring through increased utilization of IR frameworks such as a modified CFIR approach. Investing in more robust sexual and reproductive health research in humanitarian contexts can enrich insights available to guide programming and increase transferability of learning across settings.

Availability of data and materials

The datasets analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

Availability, Accessibility, Acceptability and Quality

Centers for Disease Control and Prevention

Consolidated Framework for Implementation Research

Democratic Republic of the Congo

Exploration, Preparation, Implementation, Sustainment

• Implementation research

Low and middle income country

Minimum Initial Service Package

Practical, Robust Implementation and Sustainability Model

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

Reach, Effectiveness, Adoption, Implementation, Maintenance

• Sexual and reproductive health

World Health Organization

Peters DH, et al. Implementation research: what it is and how to do it. RESEARCH METHODS. 2013;347:7.

Means AR, et al. Evaluating and optimizing the consolidated framework for implementation research (CFIR) for use in low- and middle-income countries: a systematic review. Implement Sci. 2020;15(1):17.

Article   PubMed   PubMed Central   Google Scholar  

Alonge O, et al. How is implementation research applied to advance health in low-income and middle-income countries? BMJ Glob Health. 2019;4(2):e001257.

Ridde V, Pérez D, Robert E. Using implementation science theories and frameworks in global health. BMJ Glob Health. 2020;5(4):e002269.

Gaffey MF, et al. Delivering health and nutrition interventions for women and children in different conflict contexts: a framework for decision making on what, when, and how. Lancet (London, England). 2021;397(10273):543–54.

Article   PubMed   Google Scholar  

Singh NS, et al. Delivering health interventions to women, children, and adolescents in conflict settings: what have we learned from ten country case studies? The Lancet. 2021;397(10273):533–42.

Article   Google Scholar  

Ager A, et al. Strengthening the evidence base for health programming in humanitarian crises. Science. 2014;345(6202):1290–2.

Article   CAS   PubMed   Google Scholar  

Blanchet K, et al. Evidence on public health interventions in humanitarian crises. The Lancet. 2017;390(10109):2287–96.

Sphere A. The Sphere Handbook | Standards for quality humanitarian response. 2018.

Google Scholar  

Barot S. In a State of Crisis: Meeting the Sexual and Reproductive Health Needs of Women in Humanitarian Situations. Guttmacher Policy Rev. 2017;20:7.

Crisis, I.-A.W.G.f.R.H.i., Minimum Initial Service Package. 2020: https://www.unfpa.org/resources/minimum-initial-service-package-misp-srh-crisis-situations .

Casey SE. Evaluations of reproductive health programs in humanitarian settings: a systematic review. Confl Heal. 2015;9(1):S1.

Singh NS, et al. A long way to go: a systematic review to assess the utilisation of sexual and reproductive health services during humanitarian crises. BMJ Glob Health. 2018;3(2):e000682.

Singh NS, et al. Evaluating the effectiveness of sexual and reproductive health services during humanitarian crises: A systematic review. PLoS ONE. 2018;13(7):e0199300.

Warren E, et al. Systematic review of the evidence on the effectiveness of sexual and reproductive health interventions in humanitarian crises. BMJ Open. 2015;5(12):e008226.

Dadich A, Piper A, Coates D. Implementation science in maternity care: a scoping review. Implement Sci. 2021;16(1):16.

Tricco AC, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467–73.

Devine A, et al. Strategies for the prevention of perinatal hepatitis B transmission in a marginalized population on the Thailand-Myanmar border: a cost-effectiveness analysis. BMC Infect Dis. 2017;17(1):552.

Jarrett P, et al. Evaluation of a population mobility, mortality, and birth surveillance system in South Kivu. Democratic Republic of the Congo Disasters. 2020;44(2):390–407.

PubMed   Google Scholar  

Logie CH, et al. A Psycho-Educational HIV/STI Prevention Intervention for Internally Displaced Women in Leogane, Haiti: Results from a Non-Randomized Cohort Pilot Study. PLoS ONE. 2014;9(2):e89836.

O’Laughlin KN, et al. A cohort study to assess a communication intervention to improve linkage to HIV care in Nakivale Refugee Settlement. Uganda Glob Public Health. 2021;16(12):1848–55.

Adam I. The influence of maternal health education on the place of delivery in conflict settings of Darfur. Sudan Conflict and Health. 2015;9:31.

Adam IF, et al. Relationship between implementing interpersonal communication and mass education campaigns in emergency settings and use of reproductive healthcare services: evidence from Darfur, Sudan. BMJ Open. 2015;5(9):e008285.

Edmond K, et al. Mobile outreach health services for mothers and children in conflict-affected and remote areas: a population-based study from Afghanistan. Arch Dis Child. 2020;105(1):18–25.

Nasir S, et al. Dissemination and implementation of the e-MCHHandbook, UNRWA’s newly released maternal and child health mobile application: a cross-sectional study. BMJ Open. 2020;10(3):e034885.

O’Laughlin KN, et al. Feasibility and acceptability of home-based HIV testing among refugees: a pilot study in Nakivale refugee settlement in southwestern Uganda. BMC Infect Dis. 2018;18(1):332.

Adam I. Evidence from cluster surveys on the association between home-based counseling and use of family planning in conflict-affected Darfur. Int J Gynecol Obstet. 2016;133(2):221–5.

Casey S, et al. Availability of long-acting and permanent family-planning methods leads to increase in use in conflict-affected northern Uganda: Evidence from cross-sectional baseline and endline cluster surveys. Glob Public Health. 2013;8(3):284–97.

Corna F, et al. Supporting maternal mental health of Rohingya refugee women during the perinatal period to promote child health and wellbeing: a field study in Cox’s Bazar. Intervention, the Journal of Mental Health & Psychosocial Support in Conflict Affected Areas. 2019;17(2):160–8.

Glass N, et al. Effectiveness of the Communities Care programme on change in social norms associated with gender-based violence (GBV) with residents in intervention compared with control districts in Mogadishu, Somalia. BMJ Open. 2019;9(3):e023819.

James LE, et al. Development and Testing of a Community-Based Intervention to Address Intimate Partner Violence among Rohingya and Syrian Refugees: A Social Norms-Based Mental Health-Integrated Approach. Int J Environ Res Public Health. 2021;18(21):11674.

Le Roux E, et al. Engaging with faith groups to prevent VAWG in conflict-affected communities: results from two community surveys in the DRC. BMC Int Health Hum Rights. 2020;20(1):27.

Morris CN, et al. When political solutions for acute conflict in Yemen seem distant, demand for reproductive health services is immediate: a programme model for resilient family planning and post-abortion care services. Sex Reprod Health Matters. 2019;27(2):1610279.

Anibueze AU, et al. Impact of counseling visual multimedia on use of family planning methods among displaced Nigerian families. Health Promot Int. 2022;37(3):daac060.

Doocy S, et al. Cash-based assistance and the nutrition status of pregnant and lactating women in the Somalia food crisis: A comparison of two transfer modalities. PLoS ONE. 2020;15(4):e0230989.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Draiko CV, et al. The effect of umbilical cord cleansing with chlorhexidine gel on neonatal mortality among the community births in South Sudan: a quasi-experimental study. Pan Afr Med J. 2021;38:78.

Edmond KM, et al. Can community health worker home visiting improve care-seeking and maternal and newborn care practices in fragile states such as Afghanistan? A population-based intervention study. BMC Med. 2018;16(1):106.

Edmond KM, et al. Conditional cash transfers to improve use of health facilities by mothers and newborns in conflict affected countries, a prospective population based intervention study from Afghanistan. BMC Pregnancy Childbirth. 2019;19(1):193.

Bakesiima R, et al. Effect of peer counselling on acceptance of modern contraceptives among female refugee adolescents in northern Uganda: A randomised controlled trial. PLoS ONE. 2021;16(9):e0256479.

Greene MC, et al. Evaluation of an integrated intervention to reduce psychological distress and intimate partner violence in refugees: Results from the Nguvu cluster randomized feasibility trial. PLoS ONE. 2021;16(6):e0252982.

Gupta J, et al. Gender norms and economic empowerment intervention to reduce intimate partner violence against women in rural Côte d’Ivoire: a randomized controlled pilot study. BMC Int Health Hum Rights. 2013;13(1):46.

Hossain M, et al. Working with men to prevent intimate partner violence in a conflict-affected setting: a pilot cluster randomized controlled trial in rural Côte d’Ivoire. BMC Public Health. 2014;14(1):339.

Vaillant J, et al. Engaging men to transform inequitable gender attitudes and prevent intimate partner violence: a cluster randomised controlled trial in North and South Kivu, Democratic Republic of Congo. BMJ Glob Health. 2020;5(5):e002223.

Thommesen T, et al. “The midwife helped me … otherwise I could have died”: women’s experience of professional midwifery services in rural Afghanistan - a qualitative study in the provinces Kunar and Laghman. BMC Pregnancy Childbirth. 2020;20(1):140.

Awasom-Fru A, et al. Doctors’ experiences providing sexual and reproductive health care at Catholic Hospitals in the conflict-affected North-West region of Cameroon: a qualitative study. Reprod Health. 2022;19(1):126.

Kabakian-Khasholian T, Makhoul J, Ghusayni A. “A person who does not have money does not enter”: a qualitative study on refugee women’s experiences of respectful maternity care. BMC Pregnancy and Childbirth. 2022;22(1):748.

Lilleston P, et al. Evaluation of a mobile approach to gender-based violence service delivery among Syrian refugees in Lebanon. Health Policy Plan. 2018;33(7):767–76.

Mugo NS, et al. Barriers Faced by the Health Workers to Deliver Maternal Care Services and Their Perceptions of the Factors Preventing Their Clients from Receiving the Services: A Qualitative Study in South Sudan. Matern Child Health J. 2018;22(11):1598–606.

Persson M, et al. A qualitative study on health care providers’ experiences of providing comprehensive abortion care in Cox’s Bazar, Bangladesh. Conflict and Health. 2021;15(1):6.

Phanwichatkul T, et al. The perceptions and practices of Thai health professionals providing maternity care for migrant Burmese women: An ethnographic study. Women Birth. 2022;35(4):e356–68.

Sarker M, et al. Effective maternal, newborn and child health programming among Rohingya refugees in Cox’s Bazar, Bangladesh: Implementation challenges and potential solutions. PLoS ONE. 2020;15(3):e0230732.

Tousaw E, et al. “Without this program, women can lose their lives”: migrant women’s experiences with the Safe Abortion Referral Programme in Chiang Mai. Thailand Reprod Health Matters. 2017;25(51):58–68.

Tousaw E, et al. “It is just like having a period with back pain”: exploring women’s experiences with community-based distribution of misoprostol for early abortion on the Thailand-Burma border. Contraception. 2018;97(2):122–9.

West L, et al. Factors in use of family planning services by Syrian women in a refugee camp in Jordan. Journal of Family Planning and Reproductive Health Care. 2017;43(2):96–102.

O’Connell KA, et al. Meeting the Sexual and Reproductive Health Needs of Internally Displaced Persons in Ethiopia’s Somali Region: A Qualitative Process Evaluation. Glob Health Sci Pract. 2022;10(5):e2100818.

Orya E, et al. Strengthening close to community provision of maternal health services in fragile settings: an exploration of the changing roles of TBAs in Sierra Leone and Somaliland. BMC Health Serv Res. 2017;17(1):460.

Perera SM, et al. Barriers to seeking post-abortion care in Paktika Province, Afghanistan: a qualitative study of clients and community members. BMC Womens Health. 2021;21(1):390.

Tanabe M, et al. Piloting community-based medical care for survivors of sexual assault in conflict-affected Karen State of eastern Burma. Confl Heal. 2013;7(1):12.

Tran NT, et al. Clinical outreach refresher trainings in crisis settings (S-CORT): clinical management of sexual violence survivors and manual vacuum aspiration in Burkina Faso, Nepal, and South Sudan. Reprod Health Matters. 2017;25(51):103–13.

Yankah E, et al. Feasibility and acceptability of mobile phone platforms to deliver interventions to address gender-based violence among Syrian adolescent girls and young women in Izmir. Turkey Vulnerable Children and Youth Studies. 2020;15(2):133–43.

Muuo S, et al. Barriers and facilitators to care-seeking among survivors of gender-based violence in the Dadaab refugee complex. Sex Reprod Health Matters. 2020;28(1):1722404.

Amsalu R, et al. Essential newborn care practice at four primary health facilities in conflict affected areas of Bossaso, Somalia: a cross-sectional study. Conflict and Health. 2019;13(13):27.

Myers A, et al. Facilitators and barriers in implementing the Minimum Initial Services Package (MISP) for reproductive health in Nepal post-earthquake. Conflict and Health. 2018;12:35.

Santo L.C.d, et al. Feasibility and acceptability of a video library tool to support community health worker counseling in rural Afghan districts: a cross-sectional assessment. Conflict and Health. 2020;14:56.

Sami S, et al. Understanding health systems to improve community and facility level newborn care among displaced populations in South Sudan: a mixed methods case study. BMC Pregnancy Childbirth. 2018;18(1):325.

Amsalu R, et al. Effectiveness of clinical training on improving essential newborn care practices in Bossaso, Somalia: a pre and postintervention study. BMC Pediatr. 2020;20(1):215.

Berg M, Mwambali SN, Bogren M. Implementation of a three-pillar training intervention to improve maternal and neonatal healthcare in the Democratic Republic Of Congo: a process evaluation study in an urban health zone. Glob Health Action. 2022;15(1):2019391.

Castillo M, et al. Turning Disaster into an Opportunity for Quality Improvement in Essential Intrapartum and Newborn Care Services in the Philippines: Pre- to Posttraining Assessments. Biomed Res Int. 2016;2016:1–9.

Foster AM, Arnott G, Hobstetter M. Community-based distribution of misoprostol for early abortion: evaluation of a program along the Thailand-Burma border. Contraception. 2017;96(4):242–7.

Guan TH, et al. Implementation of a neonatal hepatitis B immunization program in rural Karenni State, Myanmar: A mixed-methods study. PLoS ONE. 2021;16(12):e0261470.

Logie, C.H., et al., Mixed-methods findings from the Ngutulu Kagwero (agents of change) participatory comic pilot study on post-rape clinical care and sexual violence prevention with refugee youth in a humanitarian setting in Uganda. Global Public Health, 2022((Logie C.H., [email protected]) Factor-Inwentash Faculty of Social Work, University of Toronto, Toronto, Canada(Logie C.H., [email protected]) Women’s College Research Institute, Women’s College Hospital, Toronto, Canada(Logie C.H., carmen.l).

Sami S, et al. “You have to take action”: changing knowledge and attitudes towards newborn care practices during crisis in South Sudan. Reprod Health Matters. 2017;25(51):124–39.

Smith JR, et al. Clinical care for sexual assault survivors multimedia training: a mixed-methods study of effect on healthcare providers’ attitudes, knowledge, confidence, and practice in humanitarian settings. Confl Heal. 2013;7(1):14.

Stevens A, et al. Folate supplementation to prevent birth abnormalities: evaluating a community-based participatory action plan for refugees and migrant workers on the Thailand-Myanmar border. Public Health. 2018;161:83–9.

Nguyen Toan T, et al. Strengthening healthcare providers’ capacity for safe abortion and postabortion care services in humanitarian settings: lessons learned from the clinical outreach refresher training model (S-CORT) in Uganda, Nigeria, and the Democratic Republic of Congo. Conflict and Health. 2021;15(1):20.

Castle S, et al. Successful programmatic approaches to facilitating IUD uptake: CARE’s experience in DRC. BMC Womens Health. 2019;19(1):104.

Deitch J, et al. “They Love Their Patients”: Client Perceptions of Quality of Postabortion Care in North and South Kivu, the Democratic Republic of the Congo. Global health, science and practice. 2019;7(Suppl 2):S285–98.

Ferreyra C, et al. Evaluation of a community-based HIV test and start program in a conflict affected rural area of Yambio County, South Sudan. PLoS ONE. 2021;16(7):e0254331.

Ho LS, Wheeler E. Using Program Data to Improve Access to Family Planning and Enhance the Method Mix in Conflict-Affected Areas of the Democratic Republic of the Congo. Glob Health Sci Pract. 2018;6(1):161–77.

Klabbers RE, et al. Health Worker Perspectives on Barriers and Facilitators of Assisted Partner Notification for HIV for Refugees and Ugandan Nationals: A Mixed Methods Study in West Nile Uganda. AIDS Behav. 2021;25(10):3206–22.

Turner C, et al. Neonatal Intensive Care in a Karen Refugee Camp: A 4 Year Descriptive Study. PLoS ONE. 2013;8(8):e72721.

Vries Id, et al. Key lessons from a mixed-method evaluation of a postnatal home visit programme in the humanitarian setting of Gaza. Eastern Mediterr Health J. 2021;27(6):546–52.

Bolan NE, et al. mLearning in the Democratic Republic of the Congo: A Mixed-Methods Feasibility and Pilot Cluster Randomized Trial Using the Safe Delivery App. Global health, science and practice. 2018;6(4):693–710.

Khan MN, et al. Evaluating feasibility and acceptability of a local psycho-educational intervention for pregnant women with common mental problems affected by armed conflict in Swat, Pakistan: A parallel randomized controlled feasibility trial. Int J Soc Psychiatry. 2017;63(8):724–35.

Hynes M, et al. Using a quality improvement approach to improve maternal and neonatal care in North Kivu, Democratic Republic of Congo. Reprod Health Matters. 2017;25(51):140–50.

Gibbs A, et al. The impacts of combined social and economic empowerment training on intimate partner violence, depression, gender norms and livelihoods among women: an individually randomised controlled trial and qualitative study in Afghanistan. BMJ Glob Health. 2020;5(3):e001946.

Damschroder L, et al. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation science: IS; 2009.

Moore GF, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.

Proctor E, et al. Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda. Adm Policy Ment Health. 2011;38(2):65–76.

Damschroder LJ, et al. The updated Consolidated Framework for Implementation Research based on user feedback. Implement Sci. 2022;17(1):75.

Damschroder LJ, et al. Conceptualizing outcomes for use with the Consolidated Framework for Implementation Research (CFIR): the CFIR Outcomes Addendum. Implement Sci. 2022;17(1):7.

Aarons GA, Hurlburt M, Horwitz SM. Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors. Administration and Policy in Mental Health and Mental Health Services Research. 2011;38(1):4–23.

Feldstein AC, Glasgow RE. A Practical, Robust Implementation and Sustainability Model (PRISM) for Integrating Research Findings into Practice. The Joint Commission Journal on Quality and Patient Safety. 2008;34(4):228–43.

OCHA. Global Humanitarian Overview 2023. 2022 [cited 2023 8/3/2023]; Available from: https://humanitarianaction.info/node/13073/article/glance-0 . Accessed 8 Mar 2023.

Kobeissi L, et al. Setting research priorities for sexual, reproductive, maternal, newborn, child and adolescent health in humanitarian settings. Confl Heal. 2021;15(1):16.

Save the, C., et al. Roadmap to Accelerate Progress for Every Newborn in Humanitarian Settings 2020 – 2024. 2020. p. 52.

Inter-Agency Working Group on Reproductive Health in, C. Inter-Agency Field Manual on Reproductive Health in Humanitarian Settings. 2018.

Download references

Acknowledgements

Not applicable.

The authors received no funding for this study.

Author information

Authors and affiliations.

Duke University School of Medicine, 40 Duke Medicine Circle, Durham, NC, 27710, USA

Alexandra Norton

Johns Hopkins Bloomberg School of Public Health, 615 N. Wolfe St, Baltimore, MD, 21205, USA

Hannah Tappis

You can also search for this author in PubMed   Google Scholar

Contributions

AN and HT designed the scoping review. AN conducted the literature search. AN and HT screened records for inclusion. AN extracted data from included studies. Both authors contributed to synthesis of results. AN drafted the manuscript and both authors contributed to editorial changes.

Corresponding author

Correspondence to Alexandra Norton .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

. Literature search terms: Exact search terms used in literature search, with additional detail on the methodology to determine search terms and definitions used for each component of the search

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Norton, A., Tappis, H. Sexual and reproductive health implementation research in humanitarian contexts: a scoping review. Reprod Health 21 , 64 (2024). https://doi.org/10.1186/s12978-024-01793-2

Download citation

Received : 06 November 2023

Accepted : 12 April 2024

Published : 13 May 2024

DOI : https://doi.org/10.1186/s12978-024-01793-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Humanitarian settings

Reproductive Health

ISSN: 1742-4755

• General enquiries: [email protected]

ORIGINAL RESEARCH article

This article is part of the research topic.

Building the Future of Education Together: Innovation, Complexity, Sustainability, Interdisciplinary Research and Open Science

Developing the Skills for Complex Thinking Research: A Case Study Using Social Robotics to Produce Scientific Papers Provisionally Accepted

• 1 Institute for the Future of Education, Monterrey Institute of Technology and Higher Education (ITESM), Mexico
• 2 University of Cienfuegos, Cuba

The final, formatted version of the article will be published soon.

The development of university students' skills to successfully produce scientific documents has been a recurring topic of study in academia. This paper analyzes the implementation of a training experience using a digital environment mediated by video content materials starring humanoid robots. The research aimed to scale complex thinking and its subcompetencies as a hinge to strengthen basic academic research skills. Students from Colombia, Ecuador, and Mexico committed to preparing a scientific document as part of their professional training participated. A pretest to know their initial level of perception, a posttest to evaluate if there was a change, and a scientific document the students delivered at the end of the training experience comprised the methodology to demonstrate the improvement of their skills. The results indicated students' perceived improvement in the sub-competencies of systemic, creative, scientific, and innovative thinking; however, their perceptions did not align with that of the tutor who reviewed the delivered scientific product. The conclusion was that although the training experience helped strengthen the students' skills, variables that are determinants for a student to develop the knowledge necessary to prepare scientific documents and their derived products remain to be analyzed.

Keywords: higher education, research skills, Educational innovation, complex thinking, scientific thinking, Critical Thinking, Innovative thinking, social robotics

Received: 16 Oct 2023; Accepted: 17 May 2024.

Copyright: © 2024 Lopez-Caudana, George-Reyes and Avello-Martínez. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

* Correspondence: Dr. Edgar O. Lopez-Caudana, Institute for the Future of Education, Monterrey Institute of Technology and Higher Education (ITESM), Monterrey, Mexico

People also looked at

This paper is in the following e-collection/theme issue:

Published on 17.5.2024 in Vol 26 (2024)

Reporting of Ethical Considerations in Qualitative Research Utilizing Social Media Data on Public Health Care: Scoping Review

Authors of this article:

• Yujie Zhang 1, 2 * , MD   ; 
• Jiaqi Fu 1, 2 * , MD   ; 
• Jie Lai 1, 2 * , MD   ; 
• Shisi Deng 1, 2 , MD   ; 
• Zihan Guo 1, 2 , MD   ; 
• Chuhan Zhong 1, 2 , MD   ; 
• Jianyao Tang 1, 2 , MD   ; 
• Wenqiong Cao 1 , BSc   ; 
• Yanni Wu 1 , PhD  

1 Nanfang Hospital, Southern Medical University, Guangzhou, China

2 School of Nursing, Southern Medical University, Guangzhou, China

*these authors contributed equally

Corresponding Author:

Yanni Wu, PhD

Nanfang Hospital

Southern Medical University

No 1838 Guangzhou Avenue North

Baiyun District, Guangdong Province

Guangzhou, 510515

Phone: 86 02061641192

Email: [email protected]

Background: The internet community has become a significant source for researchers to conduct qualitative studies analyzing users’ views, attitudes, and experiences about public health. However, few studies have assessed the ethical issues in qualitative research using social media data.

Objective: This study aims to review the reportage of ethical considerations in qualitative research utilizing social media data on public health care.

Methods: We performed a scoping review of studies mining text from internet communities and published in peer-reviewed journals from 2010 to May 31, 2023. These studies, limited to the English language, were retrieved to evaluate the rates of reporting ethical approval, informed consent, and privacy issues. We searched 5 databases, that is, PubMed, Web of Science, CINAHL, Cochrane, and Embase. Gray literature was supplemented from Google Scholar and OpenGrey websites. Studies using qualitative methods mining text from the internet community focusing on health care topics were deemed eligible. Data extraction was performed using a standardized data extraction spreadsheet. Findings were reported using PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines.

Results: After 4674 titles, abstracts, and full texts were screened, 108 studies on mining text from the internet community were included. Nearly half of the studies were published in the United States, with more studies from 2019 to 2022. Only 59.3% (64/108) of the studies sought ethical approval, 45.3% (49/108) mentioned informed consent, and only 12.9% (14/108) of the studies explicitly obtained informed consent. Approximately 86% (12/14) of the studies that reported informed consent obtained digital informed consent from participants/administrators, while 14% (2/14) did not describe the method used to obtain informed consent. Notably, 70.3% (76/108) of the studies contained users’ written content or posts: 68% (52/76) contained verbatim quotes, while 32% (24/76) paraphrased the quotes to prevent traceability. However, 16% (4/24) of the studies that paraphrased the quotes did not report the paraphrasing methods. Moreover, 18.5% (20/108) of the studies used aggregated data analysis to protect users’ privacy. Furthermore, the rates of reporting ethical approval were different between different countries ( P =.02) and between papers that contained users’ written content (both direct and paraphrased quotes) and papers that did not contain users’ written content ( P <.001).

Conclusions: Our scoping review demonstrates that the reporting of ethical considerations is widely neglected in qualitative research studies using social media data; such studies should be more cautious in citing user quotes to maintain user privacy. Further, our review reveals the need for detailed information on the precautions of obtaining informed consent and paraphrasing to reduce the potential bias. A national consensus of ethical considerations such as ethical approval, informed consent, and privacy issues is needed for qualitative research of health care using social media data of internet communities.

Introduction

Social media are web-based computer-mediated tools to collaborate, share, or exchange information, ideas, pictures, or videos in virtual communities and networks such as message boards, communities, chat rooms, forums, Twitter, and Facebook [ 1 ]. Moreover, patients and researchers can use internet communities to provide health care and disseminate health information [ 2 , 3 ]. Health care refers to the efforts made to improve or maintain physical, mental, or emotional well-being, including prevention, diagnosis, treatment, recovery, and other physical and mental impairments [ 4 ]. Currently, with 57% of the global population’s access to social media, more than 40% of the patients and caregivers worldwide utilize the internet community for health care information needs [ 5 ]. With diverse populations accessing internet communities and sharing information about health care topics, researchers have the opportunity to collect and analyze text about health care from a diverse range of participants in the internet community, which was unavailable previously [ 6 ]. Usually, quantitative data are derived from information extraction, which can be analyzed statistically, and the summary results presented cannot be directly linked to individual participants. In contrast, qualitative research within internet community analysis posts and comments qualitatively or thematically involves a more detailed and in-depth analysis and understanding of the full written content [ 7 ]. However, a controversial ethical problem has been raised about conducting qualitative research containing internet users’ verbatim quotes that could lead to traceability of the original post, thereby causing a threat to an individual’s privacy [ 8 ]. Additionally, a previous study investigated public and patients’ views regarding ethics in research using social media data and reported that internet users were aggrieved if they found any of their quotes cited in a medical research paper without obtaining their informed consent [ 9 ]. Further, besides the privacy breach caused by posts being traced, there is greater harm for special groups or vulnerable groups if we do not highlight the importance of the technical standards for text mining and privacy protection in health care. For instance, some unusual postings, abnormal pictures, and interactions that were expressed by individuals with mental disorders in social media can be detected by researchers by using text mining tools without obtaining their consent [ 10 ]. The publication of research on mental disorders, including quotes in posts, can result in a high risk of information harm, which can lead to personal information being revealed and further stigmatization of the condition or disease [ 11 ]. Since 2001, ethical concerns have been debated for decades about ethical approval, informed consent, and how to ensure anonymity and preserve data privacy and confidentiality in qualitative research in the internet community [ 12 - 14 ].

With the rapid development of social media and internet research, some ethical guidelines or standards have been published to ensure that research based on internet communities is conducted ethically. The Association of Internet Researchers (internet research ethical guidelines 2.0 and 3.0) showed that researchers working without the direct approval of ethics review boards would have additional challenges to face, and obtaining informed consent is obviously impracticable in several big data projects. However, with the ethical issues about privacy breaches and harms of risk of discrimination, the Association of Internet Researchers recommended reserving the acquisition of informed consent to the dissemination stage by asking for informed consent from specific participants before publication of their quotes [ 15 , 16 ]. Furthermore, researchers should take responsibility for information confidentiality and anonymity according to the internet research ethics criteria prepared by the National Committee for Research Ethics in the Social Sciences and the Humanities guidelines, which recommend a basic research ethic norm for the analyses, reports, and evaluations that apply to all research [ 17 ]. Moreover, the National Committee for Research Ethics in the Social Sciences and the Humanities guidelines contain more details about the demand for legal consent and privacy standards imposed by the European Union’s General Data Protection Regulation. The General Data Protection Regulation is a European Union–wide regulation targeting the project of personal data processing. The General Data Protection Regulation defines personal data as any information relating to an identifiable person (data subject), including name, online identification number, location data, and other factors related to personal, physical, physiological, mental, or social identity [ 18 ]. The General Data Protection Regulation recommends using anonymous data and deleting identifiable information to ensure the confidentiality of the data. Consent should be obtained from the individual for use in scientific research [ 18 , 19 ]. The British Psychological Society guideline does not explicitly refer to the internet community but suggests that researchers may consider paraphrasing the verbatim quotes to reduce the risk of being traced or identified in qualitative research [ 20 ]. When paraphrasing, steps must be put into place to ensure that the original meaning of the message is maintained. Currently, there is no widespread consensus on ethical considerations by social media researchers.

Some researchers have tried to explore the reporting of existing ethical considerations in research papers using social media data. For instance, Sinnenberg et al [ 6 ] reported that only 32% and 12% of the papers mentioned acquiring ethical approval and informed consent, respectively, by utilizing multiple analysis methods, including surveillance, intervention, recruitment, engagement, content analysis, and network analysis with Twitter data before 2015. Thereafter, Takats et al [ 21 ] conducted an updated examination based on Sinnenberg et al’s [ 6 ] study. They found that of 367 studies using different methodological approaches, including sentiment mining, surveillance, and thematic exploration of public health research using Twitter data between 2010 to 2019, 17% of the studies included verbatim tweets and identifiable information about the internet users [ 21 ]. Similarly, Lathan et al [ 22 ] reviewed papers, including both qualitative and quantitative methods, by using Facebook data to explore public health issues and reported that only 48% and 10% of the papers obtained ethical approval and informed consent, respectively. Furthermore, in a study on research using YouTube data or comments, Tanner et al [ 23 ] found that only 26.1% of these studies sought ethical approval, only 1 paper (0.08%) sought informed consent, and 27.7% contained identifiable information. These findings indicate widespread neglect of ethical issues such as ethical approval, informed consent, and privacy issues in research papers using social media data.

Our study focuses on the ethical challenges of qualitative studies utilizing social media data. First, social media can be considered as sources for qualitative data collection because of the low cost, vast amount of available sources about health information, and users’ health behaviors, experiences, and attitudes. Second, qualitative research is context-dependent and mainly contains quotations and written content to support the viewpoint. It is acknowledged that quote materials from social media would potentially be traced back to the original posts and threaten the users’ privacy [ 24 ]. This is supported by findings reported by Ayers et al [ 25 ] who found that online searches of verbatim Twitter quotes in journal papers described as “content analyses” or “coded Twitter postings” can be traced back to individual internet users 84% of the time. Furthermore, Lathan et al [ 22 ] identified that 46% of the studies with verbatim or paraphrased quotes could be traced to the original posts in 10 minutes. Therefore, it is essential to investigate the extent to which ethical oversight is reported in qualitative studies using social media data. Moreover, qualitative research often involves personally sensitive data about health conditions and diseases; hence, anonymity and proper deidentification would be more important for researchers [ 26 , 27 ].

Previous studies have reviewed the ethical challenges and methodological use of social media platforms such as Twitter [ 6 , 21 ], Facebook [ 22 ], and YouTube [ 23 ] for health care research in both qualitative and quantitative studies. Although there is plenty of qualitative data pouring into social media such as blogs, Twitter, Facebook, and Weibo, evidence is lacking on the investigation of ethical considerations targeting qualitative data in different software and web-based discussion forums to provide a more comprehensive understanding of the ethical issues. To address the ethical considerations in qualitative research of different internet communities and draw the attention of researchers and publishers to ethical issues, we conducted this study to evaluate the ethical practices and ethical considerations of qualitative studies on health care by using data of internet communities. This review aims to (1) assess the rates of reporting institutional review board (IRB) approval and informed consent in studies focused on mining text in the internet community and social media, (2) compare these rates according to the year of publication, country conducting the research, website included in the study’s analysis, and journal’s guidelines about ethical approval for the type of study, and (3) describe whether the studies used anonymized/deidentified data.

Research Design

We conducted a scoping review to investigate how qualitative research mining social media data handles ethical approval, informed consent, and confidential issues. We performed this study according to the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) guidelines. The completed PRISMA-ScR checklist is provided in Multimedia Appendix 1 .

Search Strategy

All published qualitative studies from 2010 to March 31, 2023, focusing on mining text from online community and social media sources about health care in the following databases were included in this study: PubMed, Web of Science, CINAHL, Cochrane, and Embase. A standardized search string containing Medical Subject Headings (MeSH) and non-MeSH entry terms was used in the search strategy. In addition, the reference lists of the retrieved papers and citation tracking were manually searched as a supplement to database searches to improve comprehensiveness. Gray literature was also identified through internet searches in Google Scholar and OpenGrey websites. The search strategies are represented in Multimedia Appendix 2 .

Inclusion and Exclusion Criteria

We divided the criteria into 2 parts. First, we limited the inclusion and exclusion criteria used at the title and abstract screening stage eligible for (1) studies mining existing text and posts from the internet community and social media data focusing on health care topics, (2) studies using qualitative methods or available qualitative parts in mixed methods studies to analyze data, and (3) studies only written in English. Ineligible studies were those related to investigating the use and dissemination of social media in health care, using social media or internet community as an intervention tool, and using social media to conduct web-based interviews, surveys, or focus groups. We also excluded studies published as reviews, case studies, conference abstracts, commentaries, policies, guidelines, and recommendations. Second, at the full screening stage, the specific eligible inclusion criteria were studies focused on mining text about health care topics with full-text papers. Studies that did not have the full text after contacting the authors and that were not originally in the English language were excluded.

Study Selection

All results of the searches were entered into the EndNote library, and duplicates were removed. Two researchers reviewed the titles and abstracts based on the inclusion and exclusion criteria independently. Those studies that were irrelevant to the study topic were discarded, and then the full text was screened to select eligible papers. Any disagreements were discussed and resolved by consensus or a third person.

Data Extraction

Data were extracted between April 2023 and May 2023. Two researchers independently read the full text carefully, and the results were extracted using a standardized data extraction spreadsheet, including research type, first author, study objective, sample size, publication time, country where the research was conducted or country of the first author, website or internet community the studies focus on, type of data collected from social media, language of collected posts or data, privacy level of data (public or privacy posts), study design, research results, published journal, and information about the ethical considerations. Disagreements were resolved by consensus of a third person. The information about ethical considerations was analyzed to investigate the rates of reporting ethical approval, informed consent, and privacy issues: whether IRB review was reported (IRB approval, IRB exemption, unnecessary, not mentioned) and the reason for not requiring IRB approval; whether informed consent was obtained from participants or the websites’ administrators, consent types (digitally informed consent or written informed consent, informed consent is not required, consent was waived by IRB), and the methods used to obtain consent in each study; and whether quoting a post in papers could lead to the identification of internet users in each study. The description of users’ posts (verbatim quote, paraphrase) was recorded. We also analyzed if posts were paraphrased to maintain the original meaning, if actions were taken to deidentify the internet users, and if the posts contained other identifying information (ie, usernames, photos, links, hashtags) attached to the post. As every journal would provide publication ethical considerations and requirements, we also searched the submission guidelines and editorial policies of each journal submission website to check whether the journal contained any ethical guidance targeting studies using data from internet community and social media platforms. Additional information was included about the details of ethical approval, informed consent, and privacy, for example, whether individuals can withdraw their quotes if they want to be excluded from the study at any time without any reprisal and whether the quotations were tested for deidentification via search engines. There was excellent agreement on the primary outcome between the 2 researchers (k>.95 for all).

Data Analysis

Data were analyzed using SPSS software (IBM Corp). The chi-square test or Fisher exact tests (when cell size was less than 5) were used to test for differences between the rates of informed consent and ethical approval according to publication year, website, and different countries. All P values were 2-sided, and P values <.05 indicated significance.

Study Selection for the Review

We reviewed 4674 papers after removing the duplicates. After screening the titles, abstracts, and full-texts, we reviewed 108 eligible papers ( Figure 1 ). The full list of the included papers and all the extracted information are incorporated in Multimedia Appendix 3 [ 28 - 135 ]. Of the 108 studies reviewed, 73 (67.6%) were qualitative studies and 35 (32.4%) were mixed methods studies. All papers had text mined from internet communities or social media for qualitative analysis. The sample size ranged from 32 to 392,962. Approximately 82.4% (89/108) of the studies were published after 2018, and there was a sharp increase in the number of studies from 2019 to 2022. Moreover, nearly half of the studies (55/108, 50.9%) were published in the United States. Regarding the websites for mining text, the most widely used social media platform was Twitter (42/108, 38.9%), followed by Facebook (17/108, 15.7%).

Ethics Approval in These Studies

Our results indicated that of the 108 studies, 78 (72.2%) reported ethics approval. Of the 78 studies, 31 (40%) explicitly stated that ethics approval was obtained before the study was undertaken, 33 (42%) reported that the ethics approval was granted through exemptions by the local IRB, and 14 (18%) explicitly demonstrated that approval by the ethics committee was not required because publicly available data were collected from internet communities and social media platforms. However, 30 (27.8%) of the 108 studies did not mention about obtaining IRB approval ( Table 1 ).

Based on our exploration of the ethical guidelines of each journal to determine whether there were ethical requirements for studies mining social media data, only 36.1% (39/108) of the studies were published in journals that required ethical considerations for studies gathering data from social media platforms by using internet and digital technologies. Of the 39 studies published in 19 journals, 27 (69%) were published in the Journal of Medical Internet Research and its sister journals. The submission guidelines of the Journal of Medical Internet Research state that authors of manuscripts describing studies of internet, digital tools, and technologies are required to verify that they have adhered to local, national, regional, and international laws and regulations, and are required to verify that they complied with informed consent guidelines. Moreover, 2 journals also provided a specific requirement, that is, when researchers interact with individuals or obtain privacy information gathered from social media platforms, they should obtain ethics approval prior to conducting the study and informed consent from anyone who could potentially be identified. Surprisingly, there were no significant differences in the ethics approval reportage between journals with ethics approval guidelines and those that did not have ethics guidelines for researchers gathering data from social media platforms ( P =.08). Notably, the rates of reporting ethics approval were different between different countries ( P =.02). However, there were no statistically significant differences between the rates of reporting ethical approval and different websites or publication years (all P >.05) ( Table 2 ).

Informed Consent

Of the 108 studies, 59 (54.7%) showed that they did not include any information about informed consent and 49 (45.3%) mentioned informed consent. Of the 49 studies that mentioned informed consent, 14 (13%) demonstrated that informed consent was waived by local institutional boards, and 21 (19%) reported that informed consent was not required because this information is publicly available in websites or did not involve human participants. We interpreted this as not seeking informed consent. Only 14 (12.9%) of the 108 studies explicitly indicated that informed consent was obtained ( Table 1 ). Among the 14 studies, 2 (14%) only provided a generic statement that informed consent was obtained but did not report the process of how the informed consent was obtained, while 12 (86%) received digital informed consent. Of the 12 studies that reported receiving digital informed consent, 6 reported that they sought permission from the communities’ or groups’ administrators and by posting a statement of the research objective on the group’s wall, while 5 studies contacted the participants privately via email, commenting below the posts and software to gain consent, and 1 study reported that it had sent a digital version of the informed consent book. Furthermore, among the studies that had obtained informed consent, 7 studies included the statement that the individuals’ posts would be removed if they wanted to be excluded from the study, and they could withdraw from the study whenever they wanted. In addition, the rates of reporting informed consent showed no statistical significance between publication years, different countries, and different websites (all P >.05) ( Table 2 ).

Confidentiality of the Information

All data sources were obtained from anonymous websites or communities, and the majority (104/108, 96.3%) of the data sources did not contain usernames. Notably, only 3.7% (4/108) of the studies contained the participants’ usernames or pseudonyms. One study reported that pseudonyms like Sasha had been used instead of the real name. The other 3 studies contained the expression for usernames but did not state whether pseudonyms were used. Except for 9 studies that used nonnative language quotes and 3 studies that were transcribed into text via video, among the 108 included studies, 76 (70.3%) quoted at least one native language post in their reports. Additionally, 20 studies presenting aggregated analysis or composite accounts did not include any quotation or written content. Of the 76 studies containing internet users’ written content, 52 (68%) contained just verbatim-quoted participants’ posts and 24 (32%) contained paraphrased posts ( Table 1 ). Among the 52 studies containing direct and verbatim quotations, which are likely to be traced to the original posts from users, only 17 (33%) studies took measures to deidentify the users. The 17 studies mentioned that all names or usernames were removed and personal identifying information was removed to maintain privacy, while 42% (22/52) of the studies did not mention any measures that were taken to deidentify the users and maintain confidentiality. Approximately 32% (24/76) of the studies described that they paraphrased posts and removed any explicitly identified personal information to maintain confidentiality to reduce the likelihood of users being identified via search engines. Of the 24 studies, 20 (83%) reported that the quotations were slightly modified or summarized for readability, the symbol information was removed using “…”, and key identifiable information was removed to protect privacy while maintaining the meaning of posts. Four of the 24 (17%) studies did not report the methods and details of paraphrasing. Notably, only 3% (2/76) of the studies containing users’ written content showed that researchers intentionally entered each quote into search engines to ensure that every quote did not lead to the original posts. Moreover, of the 76 studies containing written content, 62 (82%) did not contain other types of identity information attached to the posts, while 14 (18%) included other identifying data (hashtags, emojis, geolocation, photos, links, screenshots) attached to the original posts for analysis ( Table 1 ). Of the 14 studies including other identifying information, 4 (29%) contained photos and screenshots associated with the website pages. Of the 52 studies that disclosed verbatim quotes and other identifiable information, 26 (46%) studies reported informed consent consideration, and only 8 (15%) obtained explicitly informed consent. Additionally, of the 77% (40/52) of the studies that mentioned IRB or ethical review, 38% (15/40) received IRB approval, and 63% (25/40) of the studies were granted exemption. The proportion of reporting ethical approval in studies containing users’ written content was modestly higher than that in studies not containing users’ written content (60/76, 79% vs 14/32, 44%; P <.001) ( Table 2 ).

Principal Findings and Comparison to Prior Work

In this scoping review, we included 108 studies ( Multimedia Appendix 3 ; [ 28 - 135 ]) that focused on mining text from internet community and social media data for health care research, and we reviewed the ethical consideration reportage and outcome reports in these studies. We found that the rates of reporting IRB approval and informed consent in qualitative research on health care utilizing social media data were 59.3% (64/108) and 12.9% (14/108), respectively. Our findings demonstrate that the key ethical considerations for qualitative research in online communities are insufficiently discussed and described. However, the reporting rates of ethical considerations in the papers in our scoping review were much higher than those reported in systematic reviews including multiple analysis methodologies on only 1 social media platform. For example, ethics approval and informed consent were reported in 48% and 10% of research studies using only Facebook data [ 22 ], 32% and 0% from 2006 to 2019 [ 21 ], 40% and 0.9% (only 1 paper) from 2015 to 2016 in public health research using only Twitter data [ 25 ], and 26.1% and 0.8% (only 1 paper) in researches incorporating only YouTube data [ 23 ], respectively. In fact, previous studies were limited to only a few selected websites such as Twitter, Facebook, and YouTube. There is a lack of research that incorporates a variety of different social media data for comparisons. Differences in the reporting of ethical considerations may be attributed to the different methodologies adopted by studies. For example, Lathan et al [ 22 ] analyzed the ethical considerations in studies including predictive or model development, while our research focuses on the ethical considerations in qualitative studies.

Importantly, our findings indicate that there is a need to develop a standardized and apparent approach for the reporting of ethical considerations in qualitative research of data from social media and online communities. Our research demonstrates that the rates of reporting ethics approval are different in different countries ( P =.02). Specifically, a wide variety of national research ethics governing bodies and over 1000 laws, regulations, and standards provide oversight for human subjects research in 130 countries. Obviously, a guideline is needed for best ethical practices for qualitative research involving posts from social media platforms. Surprisingly, there were no significant differences between the rates of reporting ethical approval and those of journals specifying ethical requirements for studies involving text mining ( P =.08). This inconsistent result of publication guidelines and reports of ethical approval consent is similar to previous findings on the ethical standards in COVID-19 human studies [ 136 ]. Although there are journal publication guidelines for studies mining social media data, the reports of ethical approval and consent in the papers published in such journals do not exactly follow the guidelines. Consequently, this finding indicates that more ethical awareness is needed among researchers, editors, and reviewers for qualitative studies on data mining.

Besides the different legal and regulations in different countries, the inconsistency in the ethics approval in published papers may be because social media research is a highly interdisciplinary science, and computer science researchers may be less experienced or may pay less attention to the key ethical issues of protecting human subjects [ 137 ]. Medical and health science researchers may have considered some ethical concerns about gathering social media data but they may not be familiar with the relevant guidelines. For example, the Association of Internet Researchers has a detailed ethical guideline targeting social scientists conducting digital research, while it may be less popular and less well-known among medical and health care researchers. At the institute level, Ferretti et al [ 138 ] noticed that institutionalized review committees, especially the individual IRB institutes for universities and health care systems lack knowledge about the methodology, text mining technical standards, data security, and ethical harms for studies using big data and social media as sources. Because of this lack of knowledge, institutional ethics committees may have inconsistent ethical criteria and perspectives about web-based projects using social media data [ 139 ]. Therefore, some ethics review committees exclude research on internet communities from ethical oversights because their ethics standards are confined only to medical fields. Above all, it is additionally challenging for ethical approval institutions because of the continuous development and dynamic change of studies using social media data. Furthermore, it is necessary for ethics committee members to be trained about the ethical issues in studies mining text from social media. Inviting interdisciplinary researchers to join in the approval process would be an appropriate method to increase the awareness of ethical considerations [ 140 , 141 ].

Interestingly, the reporting rate of obtaining informed consent for mining social media data in qualitative studies was unexpected. The most influential ethical reports such as the Nuremberg Code [ 142 ], Declaration of Helsinki [ 143 ], and the Belmont Report [ 144 ] have demonstrated the principle of informed consent in research involving humans. Our review shows that only 12.9% (14/108) of the studies explicitly obtained informed consent and 32.4% (35/108) of the studies reported that informed consent was exempted by IRB or was not required, as the information was available publicly in websites or did not involve human participants. Our results are similar to those of Wongkoblap et al [ 145 ] who reported that only 16.7% of the studies received informed consent from participants prior to data analysis on data mining of social network data on mental health disorders.

There are multiple reasons for the challenges in obtaining informed consent in an internet setting. First, it is impractical for researchers to gain individual informed consent from a large number of users in an internet community [ 146 ]. Second, members of ethics review boards lack consensus about the need for informed consent from an internet community for qualitative research under the current legal definition [ 147 ]. Moreover, there has been a debate on the criteria of human subject research in using social media data. The federal regulation recommends that if data in the studies are obtained from public social media websites, where data are identifiable and do not require interaction with individuals, such studies do not constitute human subject research, while studies involving the identification of private information or interaction with the individual can be considered as human subject research [ 148 ]. In contrast, some researchers believe that social media and big data research are not ethically exceptional and should be treated in the same manner and with the same rules as those for traditional forms of research [ 149 ]. There is ambiguity as to what is appropriate or should be standard practice for obtaining informed consent.

Currently, it is challenging to maintain privacy and protect the traceability of individuals posting content in the internet community. Our findings indicated that 70.3% (76/108) of the studies contained internet users’ written content, of which 68% (52/76) included verbatim quotations of users’ posts that could lead to identification, and 18% (14/76) of the studies included other identifiable information such as links, screenshots, and emojis linked to original posts, which are similar to the findings of Ayers et al [ 25 ] and Lathan et al [ 22 ]. Usha Lawrance et al [ 150 ] and Wilkinson and Thelwall [ 151 ] argued that using direct quotes to support findings would lead to the identification of users and breach users’ confidentiality in internet community data. Moreover, quoting social media posts or disclosing usernames violate the International Committee of Medical Journal Editors’ ethics standards, which state that identifying information such as written descriptions and photos should not be published unless the information is essential for scientific purposes and the participants give written informed consent for publication [ 152 ]. Furthermore, our study demonstrates that the proportion of studies containing users’ written content (both direct and paraphrased quotations) is higher than that of studies that do not include any quotation or written content (60/76, 79% vs 14/32, 44%; P <.001)——a tentative explanation is that some researchers realized that ethical reportage should be stricter for qualitative papers with quotations from social media posts due to privacy and security issues. This is supported by Boyd and Crawford [ 153 ] who stated that rigorous thinking about the process of mining and anonymizing big data is required for ethics boards to ensure that people are protected. Our findings show that 32% (24/76) of the studies intentionally paraphrased the quotes to ensure that users could not locate them, and 20 studies used aggregated data interconnected with anonymity. Moreover, it is recommended by Wilkinson and Thelwall [ 151 ], Bond et al [ 154 ], and Markham et al [ 155 ] that researchers should not directly quote and work with aggregate data sets and separate texts from their original context, which is more acceptable to participants. In addition, the British Psychological Society guidelines recommend that researchers consider paraphrasing any verbatim quotes to reduce the risk of these being traced to the source [ 20 ]. Notably, 13 of the 25 papers in this study showed that they did not report the precautions taken for paraphrasing. This may be due to the lack of detailed methodology and consensus about paraphrasing quotes to reduce bias and maintaining the original meaning.

Limitations and Strengths

Our scoping review has several limitations. First, our research was limited to qualitative studies and the qualitative parts in mixed methods studies on text mining from social media, and it is unclear whether ethical considerations are critical in quantitative studies among internet communities. Second, we were restricted to studies published in English language and those with the full text available, and therefore, we could be underestimating the number of relevant papers published in other languages. Third, the rates of reporting ethical approval, informed consent, and privacy of this research relied on self-reported data. Thus, it is possible that although certain studies did not report the process of ethical considerations, such considerations may have been followed during the research. Conversely, some studies may have mentioned about the ethical considerations but may not have conducted them in practice. Hence, there is a bias because of the lack of accurate documentation that must be considered.

Social media text mining can be a useful tool for researchers to understand patient experiences of health conditions and health care. However, as illustrated by the absence of ethical discourse in publications, our analysis indicates significant gaps in the ethical considerations and governance of qualitative research of internet posts. Therefore, a complete and consistent consensus guideline of ethical considerations in qualitative research of internet posts is needed to protect users’ data. With the continued advancing development of text-mining techniques, qualitative studies mining text from social media should be more cautious while using user quotations to maintain user privacy and protect the traceability of the internet users posting content. We suggest that authors should report their results by using aggregated findings or deidentified ways like paraphrasing instead of verbatim quotations, which can prevent internet users from being identified through search engines. In addition, authors should provide more detailed information about the precautions taken for obtaining informed consent and paraphrasing to reduce the potential bias. Furthermore, journals and editors should pay more attention to the reporting standards of ethical consideration and privacy issues in qualitative research involving social media data.

Acknowledgments

This project was funded by the National Natural Science Foundation of China (72304131) and the Outstanding Youths Development Scheme of Nanfang Hospital, Southern Medical University (2023J005). The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of this manuscript. We sincerely thank the funders of this study.

Data Availability

All data extracted and analyzed during this study are presented in this paper and in the multimedia appendices.

Authors' Contributions

YW was responsible for the protocol of the research and redrafted the paper critically. YZ and JF performed literature searches. YZ, JL, and WC performed study identification and screening. ZG, SD, CZ, and JT extracted and analyzed the data from the included journals. YZ and JL wrote the first draft of the paper. All authors read and approved the final manuscript.

Conflicts of Interest

None declared.

PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) checklist.

Search strategy for each database.

Summary of included literature.

• Obar JA, Wildman S. Social media definition and the governance challenge: An introduction to the special issue. Telecommunications Policy. Oct 2015;39(9):745-750. [ CrossRef ]
• Kaplan AM, Haenlein M. Users of the world, unite! The challenges and opportunities of social media. Business Horizons. Jan 2010;53(1):59-68. [ CrossRef ]
• VanDam C, Kanthawala S, Pratt W, Chai J, Huh J. Detecting clinically related content in online patient posts. J Biomed Inform. Nov 2017;75:96-106. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Health care. Wikipedia. URL: https://en.wikipedia.org/wiki/Health_care [accessed 2023-06-01]
• Moorhead SA, Hazlett DE, Harrison L, Carroll JK, Irwin A, Hoving C. A new dimension of health care: systematic review of the uses, benefits, and limitations of social media for health communication. J Med Internet Res. Apr 23, 2013;15(4):e85. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Sinnenberg L, Buttenheim AM, Padrez K, Mancheno C, Ungar L, Merchant RM. Twitter as a tool for health research: A systematic review. Am J Public Health. Jan 2017;107(1):e1-e8. [ CrossRef ] [ Medline ]
• Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. Jan 2006;3(2):77-101. [ CrossRef ]
• Hswen Y, Naslund JA, Brownstein JS, Hawkins JB. Monitoring online discussions about suicide among Twitter users with schizophrenia: exploratory study. JMIR Ment Health. Dec 13, 2018;5(4):e11483. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Golder S, Ahmed S, Norman G, Booth A. Attitudes toward the ethics of research using social media: a systematic review. J Med Internet Res. Jun 06, 2017;19(6):e195. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Athanasopoulou C, Sakellari E. Facebook and health information: content analysis of groups related to schizophrenia. Stud Health Technol Inform. 2015;213:255-258. [ Medline ]
• Conway M, O'Connor D. Social media, big data, and mental health: current advances and ethical implications. Curr Opin Psychol. Jun 2016;9:77-82. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Eysenbach G, Till JE. Ethical issues in qualitative research on internet communities. BMJ. Nov 10, 2001;323(7321):1103-1105. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Heilferty CM. Ethical considerations in the study of online illness narratives: a qualitative review. J Adv Nurs. May 2011;67(5):945-953. [ CrossRef ] [ Medline ]
• Roberts LD. Ethical issues in conducting qualitative research in online communities. Qualitative Research in Psychology. Apr 20, 2015;12(3):314-325. [ CrossRef ]
• Franzke A, Bechmann A, Zimmer M, Ess C, the Association of Internet Researchers. Internet research: ethical guidelines 3.0. Association of Internet Researchers. 2020. URL: https://aoir.org/reports/ethics3.pdf [accessed 2023-05-30]
• Markham A, Buchanan E. Ethical decision-making and internet research: recommendations from the AoIR ethics working committee (version 2.0). AoIR. 2012. URL: https://aoir.org/reports/ethics2.pdf [accessed 2023-06-05]
• The NCFREITSSH(. Ethical guidelines for internet research. 2022. URL: https:/​/www.​forskningsetikk.no/​en/​guidelines/​social-sciences-humanities-law-and-theology/​a-guide-to-internet-research-ethics [accessed 2023-06-13]
• Chapter 3: Rights of the data subject. General Data Protection Regulation (GDPR). European Commission. Official Journal of the European Union; 2018. URL: https://gdpr-info.eu/chapter-3/ [accessed 2023-11-29]
• Hand DJ. Aspects of data ethics in a changing world: where are we now? Big Data. Sep 01, 2018;6(3):176-190. [ FREE Full text ] [ CrossRef ] [ Medline ]
• British Psychological Society. Ethics guidelines for internet-mediated research. 2021. URL: https:/​/explore.​bps.org.uk/​binary/​bpsworks/​64374754e0c1dd30/​5a757d7c2d39a9837f0eedec1b9ba28fa5e9e38f0bffa9950b678ab727803959/​rep155_2021.​pdf [accessed 2023-05-30]
• Takats C, Kwan A, Wormer R, Goldman D, Jones HE, Romero D. Ethical and methodological considerations of Twitter data for public health research: systematic review. J Med Internet Res. Nov 29, 2022;24(11):e40380. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Lathan HS, Kwan A, Takats C, Tanner JP, Wormer R, Romero D, et al. Ethical considerations and methodological uses of Facebook data in public health research: A systematic review. Soc Sci Med. Apr 2023;322:115807. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Tanner J, Takats C, Lathan H, Kwan A, Wormer R, Romero D, et al. Approaches to research ethics in health research on YouTube: systematic review. J Med Internet Res. Oct 04, 2023;25:e43060. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Stockdale J, Cassell J, Ford E. "Giving something back": A systematic review and ethical enquiry into public views on the use of patient data for research in the United Kingdom and the Republic of Ireland. Wellcome Open Res. 2018;3:6. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Ayers JW, Caputi TL, Nebeker C, Dredze M. Don't quote me: reverse identification of research participants in social media studies. NPJ Digit Med. 2018;1:30. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Aitken M, de St Jorre J, Pagliari C, Jepson R, Cunningham-Burley S. Public responses to the sharing and linkage of health data for research purposes: a systematic review and thematic synthesis of qualitative studies. BMC Med Ethics. Nov 10, 2016;17(1):73. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Hunter RF, Gough A, O’Kane N, McKeown G, Fitzpatrick A, Walker T, et al. Ethical issues in social media research for public health. Am J Public Health. Mar 2018;108(3):343-348. [ CrossRef ]
• Ahmed OH, Sullivan SJ, Schneiders AG, McCrory P. iSupport: do social networking sites have a role to play in concussion awareness? Disabil Rehabil. 2010;32(22):1877-1883. [ CrossRef ] [ Medline ]
• Bender JL, Jimenez-Marroquin M, Jadad AR. Seeking support on Facebook: a content analysis of breast cancer groups. J Med Internet Res. Feb 04, 2011;13(1):e16. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Gajaria A, Yeung E, Goodale T, Charach A. Beliefs about attention-deficit/hyperactivity disorder and response to stereotypes: youth postings in Facebook groups. J Adolesc Health. Jul 2011;49(1):15-20. [ CrossRef ] [ Medline ]
• Degroot JM. Maintaining relational continuity with the deceased on Facebook. Omega (Westport). Nov 01, 2012;65(3):195-212. [ CrossRef ]
• Donelle L, Booth RG. Health tweets: an exploration of health promotion on twitter. Online J Issues Nurs. Sep 30, 2012;17(3):4. [ FREE Full text ] [ Medline ]
• Rui JR, Chen Y, Damiano A. Health organizations providing and seeking social support: a Twitter-based content analysis. Cyberpsychol Behav Soc Netw. Sep 2013;16(9):669-673. [ CrossRef ] [ Medline ]
• Lyles CR, López A, Pasick R, Sarkar U. "5 mins of uncomfyness is better than dealing with cancer 4 a lifetime": an exploratory qualitative analysis of cervical and breast cancer screening dialogue on Twitter. J Cancer Educ. Mar 2013;28(1):127-133. [ CrossRef ] [ Medline ]
• Lee JL, DeCamp M, Dredze M, Chisolm MS, Berger ZD. What are health-related users tweeting? A qualitative content analysis of health-related users and their messages on twitter. J Med Internet Res. Oct 15, 2014;16(10):e237. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Ahlwardt K, Heaivilin N, Gibbs J, Page J, Gerbert B, Tsoh JY. Tweeting about pain: comparing self-reported toothache experiences with those of backaches, earaches and headaches. J Am Dent Assoc. Jul 2014;145(7):737-743. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Struik LL, Baskerville NB. The role of Facebook in Crush the Crave, a mobile- and social media-based smoking cessation intervention: qualitative framework analysis of posts. J Med Internet Res. Jul 11, 2014;16(7):e170. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Abdel-Razig S, Anglade P, Ibrahim H. Impact of the COVID-19 pandemic on a physician group's WhatsApp chat: qualitative content analysis. JMIR Form Res. Dec 07, 2021;5(12):e31791. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Reddy A. Skincare in social media: analyzing prominent themes in online dermatologic discussions. Cureus. May 7, 2021:e14890. [ CrossRef ] [ Medline ]
• van der Pijl MSG, Hollander MH, van der Linden T, Verweij R, Holten L, Kingma E, et al. Left powerless: A qualitative social media content analysis of the Dutch #breakthesilence campaign on negative and traumatic experiences of labour and birth. PLoS One. 2020;15(5):e0233114. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Rath L, Vijiaratnam N, Skibina O. Alemtuzumab in multiple sclerosis: lessons from social media in enhancing patient care. Int J MS Care. 2017;19(6):323-328. [ CrossRef ] [ Medline ]
• Bloom R, Beck S, Chou W, Reblin M, Ellington L. In their own words: experiences of caregivers of adults with cancer as expressed on social media. ONF. Sep 1, 2019;46(5):617-630. [ CrossRef ]
• Grumme V, Gordon S. Social media use by transplant recipients for support and healing. Comput Inform Nurs. Dec 2016;34(12):570-577. [ CrossRef ] [ Medline ]
• Haug NA, Bielenberg J, Linder SH, Lembke A. Assessment of provider attitudes toward #naloxone on Twitter. Subst Abus. 2016;37(1):35-41. [ CrossRef ] [ Medline ]
• Oren E, Martinez L, Hensley RE, Jain P, Ahmed T, Purnajo I, et al. Twitter communication during an outbreak of hepatitis A in San Diego, 2016–2018. Am J Public Health. Oct 2020;110(S3):S348-S355. [ CrossRef ]
• Parker C, Zomer E, Liew D, Ayton D. Characterising experiences with acute myeloid leukaemia using an Instagram content analysis. PLoS One. 2021;16(5):e0250641. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Kurko T, Linden K, Kolstela M, Pietilä K, Airaksinen M. Is nicotine replacement therapy overvalued in smoking cessation? Analysis of smokers' and quitters' communication in social media. Health Expect. Dec 2015;18(6):2962-2977. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Reuter K, Lee D. Perspectives toward seeking treatment among patients with psoriasis: protocol for a Twitter content analysis. JMIR Res Protoc. Feb 18, 2021;10(2):e13731. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Mollema L, Harmsen IA, Broekhuizen E, Clijnk R, De Melker H, Paulussen T, et al. Disease detection or public opinion reflection? Content analysis of tweets, other social media, and online newspapers during the measles outbreak in The Netherlands in 2013. J Med Internet Res. May 26, 2015;17(5):e128. [ FREE Full text ] [ CrossRef ] [ Medline ]
• O'Hagan ET, Traeger AC, Bunzli S, Leake HB, Schabrun SM, Wand BM, et al. What do people post on social media relative to low back pain? A content analysis of Australian data. Musculoskelet Sci Pract. Aug 2021;54:102402. [ CrossRef ] [ Medline ]
• Zhou F, Zhang W, Cai H, Cao Y. Portrayals of 2v, 4v and 9vHPV vaccines on Chinese social media: a content analysis of hot posts on Sina Weibo. Hum Vaccin Immunother. Nov 02, 2021;17(11):4433-4441. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Golder S, Bach M, O'Connor K, Gross R, Hennessy S, Gonzalez Hernandez G. Public perspectives on anti-diabetic drugs: exploratory analysis of Twitter posts. JMIR Diabetes. Jan 26, 2021;6(1):e24681. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Mercier R, Senter K, Webster R, Henderson RA. Instagram users? experiences of miscarriage. Obstet Gynecol 2020 Jan;? Jan 2020;135(1):166-173. [ CrossRef ]
• Alghamdi A, Abumelha K, Allarakia J, Al-Shehri A. Conversations and misconceptions about chemotherapy in Arabic tweets: content analysis. J Med Internet Res. Jul 29, 2020;22(7):e13979. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Golder S, O'Connor K, Hennessy S, Gross R, Gonzalez-Hernandez G. Assessment of beliefs and attitudes about statins posted on Twitter: a qualitative study. JAMA Netw Open. Jun 01, 2020;3(6):e208953. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Stekelenburg N, Horsham C, O'Hara M, Janda M. Using social media to determine the affective and cognitive components of tweets about sunburn. Dermatology. Feb 27, 2020;236(2):75-80. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Meeking K. Patients' experiences of radiotherapy: Insights from Twitter. Radiography (Lond). Aug 2020;26(3):e146-e151. [ CrossRef ] [ Medline ]
• Shah S, Bradbury-Jones C, Taylor J. Using Facebook to tell stories of premature ageing and sexual and reproductive healthcare across the life course for women with cerebral palsy in the UK and USA. BMJ Open. Feb 17, 2020;10(2):e032172. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Pretorius K, Choi E, Kang S, Mackert M. Sudden infant death syndrome on Facebook: qualitative descriptive content analysis to guide prevention efforts. J Med Internet Res. Jul 30, 2020;22(7):e18474. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Karmegam D, Mapillairaju B. What people share about the COVID-19 outbreak on Twitter? An exploratory analysis. BMJ Health Care Inform. Nov 2020;27(3):e100133. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Hairston TK, Links AR, Harris V, Tunkel DE, Walsh J, Beach MC, et al. Evaluation of parental perspectives and concerns about pediatric tonsillectomy in social media. JAMA Otolaryngol Head Neck Surg. Jan 01, 2019;145(1):45-52. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Årsand E, Bradway M, Gabarron E. What are diabetes patients versus health care personnel discussing on social media? J Diabetes Sci Technol. Mar 2019;13(2):198-205. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Jiang X, Jiang W, Cai J, Su Q, Zhou Z, He L, et al. Characterizing media content and effects of organ donation on a social media platform: content analysis. J Med Internet Res. Mar 12, 2019;21(3):e13058. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Oser TK, Minnehan KA, Wong G, Parascando J, McGinley E, Radico J, et al. Using social media to broaden understanding of the barriers and facilitators to exercise in adults with type 1 diabetes. J Diabetes Sci Technol. May 2019;13(3):457-465. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Sutton J, Vos SC, Olson MK, Woods C, Cohen E, Gibson CB, et al. Lung cancer messages on Twitter: content analysis and evaluation. J Am Coll Radiol. Jan 2018;15(1 Pt B):210-217. [ CrossRef ] [ Medline ]
• Thomas J, Prabhu AV, Heron DE, Beriwal S. Twitter and brachytherapy: An analysis of "tweets" over six years by patients and health care professionals. Brachytherapy. 2018;17(6):1004-1010. [ CrossRef ] [ Medline ]
• Kelly-Hedrick M, Grunberg PH, Brochu F, Zelkowitz P. "It's totally okay to be sad, but never lose hope": content analysis of infertility-related videos on YouTube in relation to viewer preferences. J Med Internet Res. May 23, 2018;20(5):e10199. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Gage-Bouchard EA, LaValley S, Mollica M, Beaupin LK. Cancer communication on social media: examining how cancer caregivers use Facebook for cancer-related communication. Cancer Nurs. 2017;40(4):332-338. [ CrossRef ] [ Medline ]
• Rael CT, Pierre D, Frye V, Kessler D, Duffy L, Malos N, et al. Evaluating blood donor experiences and barriers/facilitators to blood donation in the United States using YouTube video content. Transfusion. Sep 2021;61(9):2650-2657. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Fisher S, Jehassi A, Ziv M. Hidradenitis suppurativa on Facebook: thematic and content analyses of patient support group. Arch Dermatol Res. Aug 2020;312(6):421-426. [ CrossRef ] [ Medline ]
• Abdoli S, Hessler D, Vora A, Smither B, Stuckey H. Descriptions of diabetes burnout from individuals with Type 1 diabetes: an analysis of YouTube videos. Diabet Med. Aug 2020;37(8):1344-1351. [ CrossRef ] [ Medline ]
• Myneni S, Lewis B, Singh T, Paiva K, Kim SM, Cebula AV, et al. Diabetes self-management in the age of social media: large-scale analysis of peer interactions using semiautomated methods. JMIR Med Inform. Jun 30, 2020;8(6):e18441. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Charlie AM, Gao Y, Heller SL. What do patients want to know? questions and concerns regarding mammography expressed through social media. J Am Coll Radiol. Oct 2018;15(10):1478-1486. [ CrossRef ] [ Medline ]
• Watts G, Christou P, Antonarakis G. Experiences of individuals concerning combined orthodontic and orthognathic surgical treatment: a qualitative Twitter analysis. Med Princ Pract. 2018;27(3):227-235. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Pai RR, Alathur S. Assessing mobile health applications with Twitter analytics. Int J Med Inform. May 2018;113:72-84. [ CrossRef ] [ Medline ]
• Cheng TY, Liu L, Woo BK. Analyzing Twitter as a platform for Alzheimer-related dementia awareness: thematic analyses of tweets. JMIR Aging. Dec 10, 2018;1(2):e11542. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Bridges N, Howell G, Schmied V. Exploring breastfeeding support on social media. Int Breastfeed J. 2018;13:22. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Anderson JG, Hundt E, Dean M, Keim-Malpass J, Lopez RP. "The Church of Online Support": examining the use of blogs among family caregivers of persons with dementia. J Fam Nurs. Feb 2017;23(1):34-54. [ CrossRef ] [ Medline ]
• Kearney MD, Selvan P, Hauer MK, Leader AE, Massey PM. Characterizing HPV vaccine sentiments and content on Instagram. Health Educ Behav. Dec 2019;46(2_suppl):37-48. [ CrossRef ] [ Medline ]
• Davies SH, Langer MD, Klein A, Gonzalez-Hernandez G, Dowshen N. Adolescent perceptions of menstruation on Twitter: opportunities for advocacy and education. J Adolesc Health. Jul 2022;71(1):94-104. [ CrossRef ] [ Medline ]
• Van Diepen C, Rosales Valdes D. A content analysis on the perceptions of LGBTQ+ (centred) health care on Twitter. Health Expect. Dec 2022;25(6):3238-3245. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Pleasure ZH, Frohwirth LF, Li N, Polis CB. A content analysis of Reddit users' posts about challenges to contraceptive care-seeking during COVID-19-related restrictions in the United States. J Health Commun. Oct 03, 2022;27(10):746-754. [ CrossRef ] [ Medline ]
• Du Y, Dennis B, Ramirez V, Li C, Wang J, Meireles CL. Experiences and disease self-management in individuals living with chronic kidney disease: qualitative analysis of the National Kidney Foundation's online community. BMC Nephrol. Mar 04, 2022;23(1):88. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Sadek Attalla S, Ow NL, McNarry M, De Simoni A. Experiences of exercise in patients with asthma: a qualitative analysis of discussions in a UK asthma online community. BJGP Open. Apr 29, 2022;6(3):BJGPO.2021.0162. [ CrossRef ]
• Bartmess M, Talbot C, O'Dwyer ST, Lopez RP, Rose KM, Anderson JG. Using Twitter to understand perspectives and experiences of dementia and caregiving at the beginning of the COVID-19 pandemic. Dementia (London). Jul 2022;21(5):1734-1752. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Brewer G, Centifanti L, Caicedo JC, Huxley G, Peddie C, Stratton K, et al. Experiences of mental distress during COVID-19: thematic analysis of discussion forum posts for anxiety, depression, and obsessive-compulsive disorder. Illn Crises Loss. Oct 2022;30(4):795-811. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Castillo LIR, Hadjistavropoulos T, Beahm J. Social media discussions about long-term care and the COVID-19 pandemic. J Aging Stud. Dec 2022;63:101076. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Colaceci S, Anderson G, Ricciuto V, Montinaro D, Alazraki G, Mena-Tudela D. Experiences of birth during COVID-19 pandemic in Italy and Spain: A thematic analysis. Int J Environ Res Public Health. Jun 18, 2022;19(12):7488. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Tripathi SD, Parker PD, Prabhu AV, Thomas K, Rodriguez A. An examination of patients and caregivers on Reddit Navigating Brain Cancer: content analysis of the brain tumor Subreddit. JMIR Cancer. Jun 22, 2022;8(2):e35324. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Jina-Pettersen N. Fear, neglect, coercion, and dehumanization: is inpatient psychiatric trauma contributing to a public health crisis? J Patient Exp. 2022;9:23743735221079138. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Rossi NA, Devarajan K, Chokshi SN, Ochoa VJ, Benavidez M, Malaya LT, et al. Social media depictions of cochlear implants: An Instagram and TikTok analysis. Otol Neurotol. 2023;44(1):e13-e21. [ CrossRef ]
• Singh GK, Rego J, Chambers S, Fox J. Health professionals' perspectives of the role of palliative care during COVID-19: content analysis of articles and blogs posted on Twitter. Am J Hosp Palliat Care. Apr 2022;39(4):487-493. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Koly KN, Tasnim Z, Ahmed S, Saba J, Mahmood R, Farin FT, et al. Mental healthcare-seeking behavior of women in Bangladesh: content analysis of a social media platform. BMC Psychiatry. Dec 19, 2022;22(1):797. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Belcher R, Sim D, Meykler M, Owens-Walton J, Hassan N, Rubin R, et al. A qualitative analysis of female Reddit users' experiences with low libido: how do women perceive their changes in sexual desire? J Sex Med. Feb 27, 2023;20(3):287-297. [ CrossRef ] [ Medline ]
• Culp F, Wu Y, Wu D, Ren Y, Raynor P, Hung P, et al. Understanding alcohol use discourse and stigma patterns in perinatal care on Twitter. Healthcare (Basel). Nov 26, 2022;10(12):2375. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Ferrey A, Ashworth G, Cabling M, Rundblad G, Ismail K. A thematic analysis of YouTube comments on a television documentary titled 'Diabulimia: The world's most dangerous eating disorder'. Diabet Med. May 2023;40(5):e15025. [ CrossRef ] [ Medline ]
• Watt S, Salway T, Gómez-Ramírez O, Ablona A, Barton L, Chang H, et al. Rumination, risk, and response: a qualitative analysis of sexual health anxiety among online sexual health chat service users. Sex. Health. May 23, 2022;19(3):182-191. [ CrossRef ]
• Naganathan G, Bilgen I, Cleland J, Reel E, Cil T. #COVID19 and #Breastcancer: a qualitative analysis of tweets. Curr Oncol. Nov 08, 2022;29(11):8483-8500. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Potgieter I, Hoare DJ, Fackrell K. Hyperacusis in children: a thematic analysis of discussions in online forums. Am J Audiol. Mar 03, 2022;31(1):166-174. [ CrossRef ]
• Manning Hutson M, Hosking SM, Mantalvanos S, Berk M, Pasco J, Dunning T. What injured workers with complex claims look for in online communities: netnographic analysis. J Med Internet Res. Apr 07, 2022;24(4):e17180. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Lawless MT, Hunter SC, Pinero de Plaza MA, Archibald MM, Kitson AL. "You Are By No Means Alone": a netnographic study of self-care support in an online community for older adults. Qual Health Res. Nov 2022;32(13):1935-1951. [ CrossRef ] [ Medline ]
• Keim-Malpass J, Mitchell EM, Sun E, Kennedy C. Using Twitter to understand public perceptions regarding the #HPV vaccine: opportunities for public health nurses to engage in social marketing. Public Health Nurs. Jul 2017;34(4):316-323. [ CrossRef ] [ Medline ]
• Yamada R, Rasmussen KM, Felice JP. "What is 'enough,' and how do I make it?": a qualitative examination of questions mothers ask on social media about pumping and providing an adequate amount of milk for their infants. Breastfeed Med. 2019;14(1):17-21. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Osadchiy V, Mills JN, Eleswarapu SV. Understanding patient anxieties in the social media era: qualitative analysis and natural language processing of an online male infertility community. J Med Internet Res. Mar 10, 2020;22(3):e16728. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Thomas TH, Nauth-Shelley K, Thompson MA, Attai DJ, Katz MS, Graham D, et al. The needs of women treated for ovarian cancer: results from a #gyncsm Twitter chat. J Patient Cent Res Rev. 2018;5(2):149-157. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Mehta N, Zhu L, Lam K, Stall NM, Savage R, Read SH, et al. Health forums and Twitter for dementia research: opportunities and considerations. J Am Geriatr Soc. Dec 2020;68(12):2881-2889. [ CrossRef ] [ Medline ]
• Gupta R, Ariefdjohan M. Mental illness on Instagram: a mixed method study to characterize public content, sentiments, and trends of antidepressant use. J Ment Health. Aug 2021;30(4):518-525. [ CrossRef ] [ Medline ]
• He L, He C, Reynolds T, Bai Q, Huang Y, Li C, et al. Why do people oppose mask wearing? A comprehensive analysis of U.S. tweets during the COVID-19 pandemic. J Am Med Inform Assoc. Jul 14, 2021;28(7):1564-1573. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Loeb S, Mihalcea R, Perez-Rosas V, Xu A, Taylor J, Byrne N, et al. Leveraging social media as a thermometer to gauge patient and caregiver concerns: COVID-19 and prostate cancer. Eur Urol Open Sci. Mar 2021;25:1-4. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Graf I, Gerwing H, Hoefer K, Ehlebracht D, Christ H, Braumann B. Social media and orthodontics: A mixed-methods analysis of orthodontic-related posts on Twitter and Instagram. Am J Orthod Dentofacial Orthop. Aug 2020;158(2):221-228. [ CrossRef ] [ Medline ]
• Boon-Itt S, Skunkan Y. Public perception of the COVID-19 pandemic on Twitter: sentiment analysis and topic modeling study. JMIR Public Health Surveill. Nov 11, 2020;6(4):e21978. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Wang J, Zhou Y, Zhang W, Evans R, Zhu C. Concerns expressed by Chinese social media users during the COVID-19 pandemic: content analysis of Sina Weibo microblogging data. J Med Internet Res. Nov 26, 2020;22(11):e22152. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Wahbeh A, Nasralah T, Al-Ramahi M, El-Gayar O. Mining physicians' opinions on social media to obtain insights into COVID-19: mixed methods analysis. JMIR Public Health Surveill. Jun 18, 2020;6(2):e19276. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Çınar S, Boztepe H, Prof. The use of social media among parents of infants with cleft lip and/or palate. J Pediatr Nurs. 2020;54:e91-e96. [ CrossRef ] [ Medline ]
• Jiang T, Osadchiy V, Mills JN, Eleswarapu SV. Is It all in my head? self-reported psychogenic erectile dysfunction and depression are common among young men seeking advice on social media. Urology. Aug 2020;142:133-140. [ CrossRef ] [ Medline ]
• Dzubur E, Khalil C, Almario CV, Noah B, Minhas D, Ishimori M, et al. Patient concerns and perceptions regarding biologic therapies in ankylosing spondylitis: insights from a large-scale survey of social media platforms. Arthritis Care Res (Hoboken). Feb 2019;71(2):323-330. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Gonzalez G, Vaculik K, Khalil C, Zektser Y, Arnold C, Almario CV, et al. Women's experience with stress urinary incontinence: insights from social media analytics. Journal of Urology. May 2020;203(5):962-968. [ CrossRef ]
• Jha SR, McDonagh J, Prichard R, Newton PJ, Hickman LD, Fung E, et al. #Frailty: A snapshot Twitter report on frailty knowledge translation. Australas J Ageing. Dec 2018;37(4):309-312. [ CrossRef ] [ Medline ]
• Litchman ML, Snider C, Edelman LS, Wawrzynski SE, Gee PM. Diabetes online community user perceptions of successful aging with diabetes: analysis of a #DSMA Tweet chat. JMIR Aging. Jun 22, 2018;1(1):e10176. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Jones J, Pradhan M, Hosseini M, Kulanthaivel A, Hosseini M. Novel approach to cluster patient-generated data into actionable topics: case study of a web-based breast cancer forum. JMIR Med Inform. Nov 29, 2018;6(4):e45. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Gonzalez G, Vaculik K, Khalil C, Zektser Y, Arnold C, Almario CV, et al. Using large-scale social media analytics to understand patient perspectives about urinary tract infections: thematic analysis. J Med Internet Res. Jan 25, 2022;24(1):e26781. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Sormunen T, Westerbotn M, Aanesen A, Fossum B, Karlgren K. Social media in the infertile community-using a text analysis tool to identify the topics of discussion on the multitude of infertility blogs. Womens Health (Lond). 2021;17:17455065211063280. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Berkovic D, Ackerman IN, Briggs AM, Ayton D. Tweets by people with arthritis during the COVID-19 pandemic: content and sentiment analysis. J Med Internet Res. Dec 03, 2020;22(12):e24550. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Della Rosa S, Sen F. Health topics on Facebook Groups: content analysis of posts in multiple sclerosis communities. Interact J Med Res. Feb 11, 2019;8(1):e10146. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Awofeso N, Imam SA, Ahmed A. Content analysis of media coverage of childhood obesity topics in UAE newspapers and popular social media platforms, 2014-2017. Int J Health Policy Manag. Feb 01, 2019;8(2):81-89. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Smith DJ, Mac VV, Hertzberg VS. Using Twitter for nursing research: a tweet analysis on heat illness and health. J Nurs Scholarsh. May 2021;53(3):343-350. [ CrossRef ] [ Medline ]
• Green BM, Van Horn KT, Gupte K, Evans M, Hayes S, Bhowmick A. Assessment of adaptive engagement and support model for people with chronic health conditions in online health communities: combined content analysis. J Med Internet Res. Jul 07, 2020;22(7):e17338. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Osakwe ZT, Cortés YI. Impact of COVID-19: a text mining analysis of Twitter data in Spanish language. Hisp Health Care Int. Dec 2021;19(4):239-245. [ CrossRef ] [ Medline ]
• Sümeyye Yorulmaz D, Karadeniz H. Vaccination refusal debate on social media in Turkey: a content analysis of the comments on Instagram blogs. Iran J Public Health. Mar 2022;51(3):615-623. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Choi E, Becker H, Kim S. A blog text analysis to explore psychosocial support in adolescents and young adults with cancer. Cancer Nurs. Dec 11, 2022;46(2):143-151. [ CrossRef ]
• Jun J, Wickersham K, Zain A, Ford R, Zhang N, Ciccarelli C, et al. Cancer and COVID-19 vaccines on Twitter: the voice and vaccine attitude of cancer community. J Health Commun. Jan 02, 2023;28(1):1-14. [ CrossRef ] [ Medline ]
• Yashpal S, Raghunath A, Gencerliler N, Burns LE. Exploring public perceptions of dental care affordability in the United States: mixed method analysis via Twitter. JMIR Form Res. Jul 01, 2022;6(7):e36315. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Damier P, Henderson EJ, Romero-Imbroda J, Galimam L, Kronfeld N, Warnecke T. Impact of off-time on quality of life in Parkinson's patients and their caregivers: insights from social media. Parkinsons Dis. 2022;2022:1800567. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Miller WR, Malloy C, Mravec M, Sposato MF, Groves D. Nursing in the spotlight: Talk about nurses and the nursing profession on Twitter during the early COVID-19 pandemic. Nurs Outlook. 2022;70(4):580-589. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Hriberšek M, Eibensteiner F, Kapral L, Teufel A, Nawaz FA, Cenanovic M, et al. "Loved ones are not 'visitors' in a patient's life"-The importance of including loved ones in the patient's hospital stay: An international Twitter study of #HospitalsTalkToLovedOnes in times of COVID-19. Front Public Health. 2023;11:1100280. [ FREE Full text ] [ CrossRef ] [ Medline ]
• O'Sullivan L, Killeen RP, Doran P, Crowley RK. Adherence with reporting of ethical standards in COVID-19 human studies: a rapid review. BMC Med Ethics. Jun 28, 2021;22(1):80. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Denecke K, Bamidis P, Bond C, Gabarron E, Househ M, Lau AYS, et al. Ethical issues of social media usage in healthcare. Yearb Med Inform. Aug 13, 2015;10(1):137-147. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Ferretti A, Ienca M, Sheehan M, Blasimme A, Dove ES, Farsides B, et al. Ethics review of big data research: What should stay and what should be reformed? BMC Med Ethics. Apr 30, 2021;22(1):51. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Kohn T, Shore C. The Ethics of University Ethics Committees: risk management and the research imagination. Death Public Univ Uncertain Futur High Educ Knowl Econ. May 2017:229-249. [ CrossRef ]
• Friesen P, Redman B, Caplan A. Of straws, camels, research regulation, and IRBs. Ther Innov Regul Sci. Jul 2019;53(4):526-534. [ CrossRef ] [ Medline ]
• Sellers C, Samuel G, Derrick G. Reasoning "uncharted territory": notions of expertise within ethics review panels assessing research use of social media. J Empir Res Hum Res Ethics. 2020;15(1-2):28-39. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Kious B. The Nuremberg Code: its history and implications. Princet J Bioeth. 2001;4:7-19. [ Medline ]
• World Medical Association. World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. Nov 27, 2013;310(20):2191-2194. [ CrossRef ] [ Medline ]
• Department of Health‚ Education‚Welfare, National Commission for the Protection of Human Subjects of BiomedicalBehavioral Research. The Belmont Report. Ethical principles and guidelines for the protection of human subjects of research. J Am Coll Dent. 2014;81(3):4-13. [ Medline ]
• Wongkoblap A, Vadillo MA, Curcin V. Researching mental health disorders in the era of social media: systematic review. J Med Internet Res. Jun 29, 2017;19(6):e228. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Alim S. An initial exploration of ethical research practices regarding automated data extraction from online social media user profiles. First Monday. Jul 2014;19(7):105-127. [ CrossRef ] [ Medline ]
• Vitak J, Proferes N, Shilton K, Ashktorab Z. Ethics regulation in social computing research: examining the role of institutional review boards. J Empir Res Hum Res Ethics. Dec 2017;12(5):372-382. [ CrossRef ] [ Medline ]
• Moreno MA, Goniu N, Moreno PS, Diekema D. Ethics of social media research: common concerns and practical considerations. Cyberpsychol Behav Soc Netw. Sep 2013;16(9):708-713. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Metcalf J, Crawford K. Where are human subjects in Big Data research? The emerging ethics divide. Big Data & Society. Jun 01, 2016;3(1):205395171665021. [ CrossRef ]
• Usha Lawrance J, Nayahi Jesudhasan JV. Privacy preserving parallel clustering based anonymization for big data using MapReduce framework. Applied Artificial Intelligence. Oct 17, 2021;35(15):1587-1620. [ CrossRef ]
• Wilkinson D, Thelwall M. Researching personal information on the public web. Social Science Computer Review. Aug 17, 2010;29(4):387-401. [ CrossRef ]
• International Committee of Medical Journal Editors. Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication. Croat Med J. Dec 2003;44(6):770-783. [ FREE Full text ] [ Medline ]
• Boyd D, Crawford K. Critical questions for big data. Information, Communication & Society. Jun 2012;15(5):662-679. [ CrossRef ]
• Bond CS, Ahmed OH, Hind M, Thomas B, Hewitt-Taylor J. The conceptual and practical ethical dilemmas of using health discussion board posts as research data. J Med Internet Res. Jun 07, 2013;15(6):e112. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Markham A, Tiidenberg K, Herman A. Ethics as methods: doing ethics in the era of big data research—introduction. Social Media + Society. Jul 19, 2018;4(3):205630511878450-205630511878416. [ CrossRef ]

Abbreviations

Edited by T Leung, T de Azevedo Cardoso; submitted 02.08.23; peer-reviewed by E Zibrowski, J Scheibner; comments to author 06.10.23; revised version received 29.11.23; accepted 16.04.24; published 17.05.24.

©Yujie Zhang, Jiaqi Fu, Jie Lai, Shisi Deng, Zihan Guo, Chuhan Zhong, Jianyao Tang, Wenqiong Cao, Yanni Wu. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 17.05.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.

Are Markups Driving the Ups and Downs of Inflation?

Download PDF (158 KB)

FRBSF Economic Letter 2024-12 | May 13, 2024

How much impact have price markups for goods and services had on the recent surge and the subsequent decline of inflation? Since 2021, markups have risen substantially in a few industries such as motor vehicles and petroleum. However, aggregate markups—which are more relevant for overall inflation—have generally remained flat, in line with previous economic recoveries over the past three decades. These patterns suggest that markup fluctuations have not been a main driver of the ups and downs of inflation during the post-pandemic recovery.

In the recovery from the pandemic, U.S. inflation surged to a peak of over 7% in June 2022 and has since declined to 2.7% in March 2024, as measured by the 12-month change in the personal consumption expenditures (PCE) price index. What factors have been driving the ups and downs of inflation? Production costs are traditionally considered a main contributor, particularly costs stemming from fluctuations in demand for and supply of goods and services. As demand for their products rises, companies need to hire more workers and buy more intermediate goods, pushing up production costs. Supply chain disruptions can also push up the cost of production. Firms may pass on all or part of the cost increases to consumers by raising prices. Thus, an important theoretical linkage runs from cost increases to inflation. Likewise, decreases in costs should lead to disinflation.

Labor costs are an important factor of production costs and are often useful for gauging inflationary pressures. However, during the post-pandemic surge in inflation, nominal wages rose more slowly than prices, such that real labor costs were falling until early 2023. By contrast, disruptions to global supply chains pushed up intermediate goods costs, contributing to the surge in inflation (see, for example, Liu and Nguyen 2023). However, supply chains have more direct impacts on goods inflation than on services inflation, which also rose substantially.

In this Economic Letter , we consider another factor that might drive inflation fluctuations: changes in firms’ pricing power and markups. An increase in pricing power would be reflected in price-cost markups, leading to higher inflation; likewise, a decline in pricing power and markups could alleviate inflation pressures. We use industry-level measures of markups to trace their evolving impact on inflation during the current expansion. We find that markups rose substantially in some sectors, such as the motor vehicles industry. However, the aggregate markup across all sectors of the economy, which is more relevant for inflation, has stayed essentially flat during the post-pandemic recovery. This is broadly in line with patterns during previous business cycle recoveries. Overall, our analysis suggests that fluctuations in markups were not a main driver of the post-pandemic surge in inflation, nor of the recent disinflation that started in mid-2022.

Potential drivers of inflation: Production costs and markups

To support households and businesses during the pandemic, the Federal Reserve lowered the federal funds rate target to essentially zero, and the federal government provided large fiscal transfers and increased unemployment benefits. These policies boosted demand for goods and services, especially as the economy recovered from the depth of the pandemic.

The increase in overall demand, combined with supply shortages, boosted the costs of production, contributing to the surge in inflation during the post-pandemic recovery. Although labor costs account for a large part of firms’ total production costs, real labor costs were falling between early 2021 and mid-2022 such that the increases in prices outpaced those in nominal wages. This makes it unlikely that labor costs were driving the surge in inflation.

Instead, we focus on another potential alternative driver of inflation that resulted from firms’ ability to adjust prices, known as pricing power. As demand for goods surged early in the post-pandemic recovery, companies may have had a greater ability to raise their prices above their production costs, a gap known as markups. Following a sharp drop in spending at the height of the pandemic, people may have become eager to resume normal spending patterns and hence more tolerant to price increases than in the past. In fact, growth of nonfinancial corporate profits accelerated in the early part of the recovery (see Figure 1), suggesting that companies had increased pricing power. Some studies have pointed to the strong growth in nonfinancial corporate profits in 2021 as evidence that increased markups have contributed to inflation (see, for example, Weber and Wasmer 2023). However, the figure also shows that growth in corporate profits is typically volatile. Corporate profits tend to rise in the early stages of economic recoveries. Data for the current recovery show that the increase in corporate profits is not particularly pronounced compared with previous recoveries.

Figure 1 Profit growth for nonfinancial businesses

More importantly, corporate profits are an imperfect measure of a firm’s pricing power because several other factors can drive changes in profitability. For instance, much of the recent rise in corporate profits can be attributed to lower business taxes and higher subsidies from pandemic-related government support, as well as lower net interest payments due to monetary policy accommodation (Pallazzo 2023).

Instead of relying on profits as a measure of pricing power, we construct direct measures of markups based on standard economic models. Theory suggests that companies set prices as a markup over variable production costs, and that markup can be inferred from the share of a firm’s revenue spent on a given variable production factor, such as labor or intermediate goods. Over the period of data we use, we assume that the specific proportion of a company’s production costs going toward inputs does not change. If the share of a firm’s revenue used for inputs falls, it would imply a rise in the firm’s price-cost margin or markup. In our main analysis, we use industry-level data from the Bureau of Economic Analysis (BEA) to compute markups based on the share of revenue spent on intermediate inputs. Our results are similar if we instead use the share of revenue going toward labor costs.

We compare the evolution of markups to that of prices, as measured by the PCE price index, since the recovery from the pandemic. In constructing this price index, the BEA takes into account changes in product characteristics (for instance, size) that could otherwise bias the inflation measure by comparing the prices of inherently different products over time. Similarly, based upon standard economic theory, our markup measure implicitly captures changes in those characteristics (see, for example, Aghion et al. 2023).

The post-pandemic evolution of markups

We examine the evolution of markups in each industry since the third quarter of 2020, the start of the post-pandemic recovery. Figure 2 shows that some sectors, such as the motor vehicles and petroleum industries, experienced large cumulative increases in markups during the recovery. Markups also rose substantially in general merchandise, such as department stores, and for other services, such as repair and maintenance, personal care, and laundry services. Since the start of the expansion, markups in those industries rose by over 10%—comparable in size to the cumulative increases over the same period in the core PCE price index, which excludes volatile food and energy components. However, the surge in inflation through June 2022 was broad based, with prices also rising substantially outside of these sectors. Thus, understanding the importance of markups for driving inflation requires a macroeconomic perspective that examines the evolution of aggregate markups across all sectors of the economy.

Figure 2 Cumulative changes in markups for salient industries

The role of aggregate markups in the economy

To assess how much markup changes contribute to movements in inflation more broadly, we use our industry-level measurements to calculate an aggregate markup at the macroeconomic level. We aggregate the cumulative changes in industry markups, applying two different weighting methods, as displayed in Figure 3. In the first method (green line), we match our industry categories to the spending categories in the core PCE price index for ease of comparison; we then use the PCE weights for each category to compute the aggregate markup. Alternatively, we use each industry’s cost weights to compute the aggregate markup (blue line). Regardless of the weighting method, Figure 3 shows that aggregate markups have stayed essentially flat since the start of the recovery, while the core PCE price index (gray line) rose by more than 10%. Thus, changes in markups are not likely to be the main driver of inflation during the recovery, which aligns with results from Glover, Mustre-del-Río, and von Ende-Becker (2023) and Hornstein (2023) using different methodologies or data. Markups also have not played much of a role in the slowing of inflation since the summer of 2022.

Figure 3 Cumulative changes in aggregate markups and prices

Moreover, the path of aggregate markups over the past three years is not unusual compared with previous recoveries. Figure 4 shows the cumulative changes in aggregate markups since the start of the current recovery (dark blue line), alongside aggregate markups following the 1991 (green line), 2001 (yellow line), and 2008 (light blue line) recessions. Aggregate markups have stayed roughly constant throughout all four recoveries.

Figure 4 Cumulative changes of aggregate markups in recoveries

Firms’ pricing power may change over time, resulting in markup fluctuations. In this Letter , we examine whether increases in markups played an important role during the inflation surge between early 2021 and mid-2022 and if declines in markups have contributed to disinflation since then. Using industry-level data, we show that markups did rise substantially in a few important sectors, such as motor vehicles and petroleum products. However, aggregate markups—the more relevant measure for overall inflation—have stayed essentially flat since the start of the recovery. As such, rising markups have not been a main driver of the recent surge and subsequent decline in inflation during the current recovery.

Aghion, Philippe, Antonin Bergeaud, Timo Boppart, Peter J. Klenow, and Huiyu Li. 2023. “A Theory of Falling Growth and Rising Rents.”  Review of Economic Studies  90(6), pp.2,675-2,702.

Glover, Andrew, José Mustre-del-Río, and Alice von Ende-Becker. 2023. “ How Much Have Record Corporate Profits Contributed to Recent Inflation? ” FRB Kansas City Economic Review 108(1).

Hornstein, Andreas. 2023. “ Profits and Inflation in the Time of Covid .” FRB Richmond Economic Brief 23-38 (November).

Liu, Zheng, and Thuy Lan Nguyen. 2023. “ Global Supply Chain Pressures and U.S. Inflation .” FRBSF Economic Letter 2023-14 (June 20).

Palazzo, Berardino. 2023. “ Corporate Profits in the Aftermath of COVID-19 .” FEDS Notes , Federal Reserve Board of Governors, September 8.

Weber, Isabella M. and Evan Wasner. 2023. “Sellers’ Inflation, Profits and Conflict: Why Can Large Firms Hike Prices in an Emergency?” Review of Keynesian Economics 11(2), pp. 183-213.

Opinions expressed in FRBSF Economic Letter do not necessarily reflect the views of the management of the Federal Reserve Bank of San Francisco or of the Board of Governors of the Federal Reserve System. This publication is edited by Anita Todd and Karen Barnes. Permission to reprint portions of articles or whole articles must be obtained in writing. Please send editorial comments and requests for reprint permission to [email protected]