Journal of Practical Studies in Education
ISSN: 2634-4629
www.jpse.gta.org.uk
25
Mixed-Methods Research: A Discussion on its Types, Challenges, and
Criticisms
Saraswati Dawadi (Corresponding author)
Institute of Educational Technology, The Open University, UK
Email: Saras[email protected]k
Sagun Shrestha
School of Applied Language and Intercultural Studies (SALIS), Dublin City University (DCU), Ireland
Ram A. Giri
Monash University English Language Centre, Monash College, Australia
Received: 29/11/2020
Accepted: 04/02/2021
Published: 01/03/2021
Volume: 2 Issue: 2
How to cite this paper: Dawadi, S., Shrestha, S., & Giri, R. A. (2021). Mixed-Methods
Research: A Discussion on its Types, Challenges, and Criticisms. Journal of Practical Studies
in Education, 2(2), 25-36
DOI: https://doi.org/10.46809/jpse.v2i2.20
Copyright © 2020 by author(s) and Global Talent Academy Press Ltd. This work is licensed
under Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International
License. http://creativecommons.org/licenses/by/4.0/
Abstract
The article positions mixed-method research (MMR) as a principled complementary research method to the traditional
quantitative and qualitative research approaches. By situating MMR in an analysis of some of the common research
paradigms, the article presents it as a natural choice in order to complement and cater to the increasingly complex needs of
contemporary researchers. It proffers MMR as a flexible and adaptive conceptual framework for designing and conducting
mixed methods research in a simplified manner. By explaining fundamental principles and major theoretical tenets of a
mixed-methods approach, which involves both quantitative and qualitative data collection in response to research questions, it
elucidates several benefits of adopting MMR since it integrates post-positivism as well as interpretivism frameworks. There is
abundant literature around this research design aiming to provide researchers an understanding of the approach. Yet there is
limited literature that provides illustrative guidance to research novices in comprehending mixed methods, understanding
reasons for choosing it, and selecting an appropriate mixed methods design. Based on an analysis of some notable works in
the field, this article provides an overview of mixed methods designs, discusses its main types, and explains challenges one
can potentially encounter when in using them with a view to assisting early career researchers in particular and other
researchers in general.
Keywords: Mixed Methods Research, Research Paradigm, Challenges, Criticism
1. Introduction
A research study is conventionally guided by a research paradigm(s) which refers to researchers' underlying philosophical
views concerning the truth and reality in general and the research issue in particular. A research paradigm, therefore, is a
philosophical position about the world or the nature of reality and how we approach it to understand it (Maxwell, 2005). It
includes researchersassumptions about ontology and epistemology that guide the research process. Ontology is concerned
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
26
with the nature of truth, i.e., what is the nature of reality? whereas epistemology refers to the nature and forms of human
knowledge, i.e., how do we know what reality is (Cohen et al., 2007). A researcher, based on their purpose, may adapt
different approaches to uncover the truth and/or knowledge. Mixed-methods research (MMR) is a research methodology that
incorporates multiple methods to address research questions in an appropriate and principled manner (Bryman, 2012;
Creswell, 2015; Creswell & Plano Clark, 2011), which involves collecting, analysing, interpreting and reporting both
qualitative and quantitative data.
An in-depth understanding of the research paradigms is essential for a researcher. When novice researchers encounter a
social problem, they must know how best to approach it. For instance, they must understand the paradigms that guide their
methodological decisions in collecting information (data), analysing and interpreting them, and reporting findings. In other
words, new researchers must understand what research designs are there that can best address their research problems and
guide them throughout the research process. With novice researchers in view, this article introduces the most prevalent
research paradigms and the resultant research methods. It particularly focuses on the mixed-methods research (MMR) - its
characteristics, reasons for using it, and its major types. The language and organisation of the article are deliberately simple
to assist researchers to understand what different types of MMR approaches there are, how to decide which type of MMR is
appropriate for their research study, and what the key considerations are when choosing a mixed-method design.
Additionally, the chapter provides an understanding of practical considerations and the potential challenges a researcher is
likely to experience when adopting a particular MMR design. What follows, then, is a brief discussion of major research
paradigms followed by an introduction to mixed-methods research, its types, key considerations, and challenges.
2. Major Research Paradigms
There are a number of research paradigms, while some of them are complementary to each other, others are opposed. One
of the most prevalent research paradigms is positivism which considers that only the knowledge confirmed by the senses is
affirmed as knowledge (Bryman, 2012). It follows the objective route in research and advocates that the knowledge is gained
through a gathering of objectively verifiable facts using quantitative means. Positivists differentiate between scientific and
normative statements and they believe that normative statements cannot be confirmed by the senses; therefore, only the
scientific statements are the true domain of the scientist (Bryman, 2012). Quantitative researchers are, by and large, guided
by positivism and they use quantitative tools to get objective findings in their study. Historically, the main research method
was guided by quantitative research design or the positivistic approach. Post-positivism, on the other hand, “is a milder form
of positivism that follows the same principles but allows more interaction between the researcher and his/her research
participants” (Taylor & Medina, 2011, p. 3). While positivism focuses on the objectivity of the research process, post-
positivism has room for subjectivity as well. Therefore, it uses both quantitative (such as a survey) and qualitative methods
(such as interviews and participant-observation).
Another paradigm, interpretivism, with a contrasting epistemology to positivism, believes in multiple realities. Therefore,
the followers of this paradigm are critical of the application of the scientific (or positivist) model to the study (Bryman,
2012). The social scientists who are guided by this paradigm respect the subjective meaning of social action (Taylor &
Medina, 2011). Interpretivists, as a consequence of that, understand social phenomena and interpret them further. Since the
qualitative researchers use the tools such as interviews, focus groups, and participant observation to understand the situation
and explain the indicative findings, they follow interpretivism as a research paradigm. The constructivism paradigm is
different from positivism and interpretivism, and is based on the premise that reality is a product of human interaction with
the real world. It is guided by the belief that active construction of knowledge takes place when there is human interaction
with the real world. This means, knowledge is built up socially. It opposes the idea that there is a single methodology to
generate knowledge and that knowledge must be approached through multiple perspectives. In a similar vein, the paradigm of
criticalism approaches knowledge from a critical perspective and with a major focus on power imbalance in society.
Therefore, it posits that scientific investigation should be conducted with a noble goal of social change. The primary purpose
of research is to identify and support resolve 'gross power imbalances' in society (Taylor & Medina, 2011). Thus, in this
paradigm, “the researcher’s role is one of advocate, a change agent, who argues for and leads the way towards a more
equitable, fair and sustainable society” (Taylor & Medina, 2011, p. 6). To sum up, the two main paradigms, which are
conventionally considered to be fundamentally opposed to each other, are positivism/post-positivism and
constructivism/interpretivism, the former relates to quantitative methodology whereas the latter drives qualitative research.
The qualitative research emerged as the quantitative research alone could not address all the research questions.
The final paradigm discussed in this article is the paradigm of pragmatism which is not committed to any sort of
philosophical stance (Creswell, 2007) but argues that the forced choices between positivism and interpretivism should be
abandoned as it views reality as both singular and multiple. Pragmatism “is pluralistic and oriented towards ‘what works’ and
practice” (Creswell & Plano Clark, 2011, p. 41). In other words, pragmatism uses multiple methods but the use of the
methods should always be guided by research problems. It values both objective and subjective knowledge to meet research
objectives. Researchers adopting a pragmatist position have the liberty to choose those research methods or strategies that
can best answer their research questions (Creswell, 2007). According to Feilzer (2010, p.14), pragmatism brushes aside the
quantitative/qualitative divide and ends the paradigm war by suggesting that the most important question is whether the
research has helped to find out what the researcher wants to know. Tashakkori and Teddlie (1998) suggest that pragmatists
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
27
study what interests them and are of value to them. They study research problems in different ways that they deem
appropriate. Therefore, the main reason for adopting a pragmatist position in a study is to allow a researcher to have a
pluralistic stance of gathering all sorts of data in order to best answer the research questions. In essence, a pragmatist
employs a mixed-methods design to follow one or multiple combinations of some of the prevalent research paradigms
mentioned above. In a mixed-methods research design, qualitative research approaches help understand the situation through
indicative results by exploring through the tools like participant observation and interviews whereas quantitative approaches
help derive objective findings by using the tools like a survey. A description of mixed methods as a research design is
presented below.
3. Mixed Methods as a Research Methodology
A mixed-methods approach is a research methodology in its own right. As stated by Creswell and Plano Clark (2011), a
mixed-methods research design is a research design that has its own philosophical assumptions and methods of inquiry. As a
methodology, it includes philosophical assumptions to provide directions for the collection and analysis of data from multiple
sources in a single study.
A mixed-methods design offers a number of benefits to approaching complex research issues as it integrates
philosophical frameworks of both post-positivism and interpretivism (Fetters, 2016) interweaving qualitative and quantitative
data in such a way that research issues are meaningfully explained. It also offers a logical ground, methodological flexibility
and an in-depth understanding of smaller cases (Maxwell, 2016). In other words, the use of mixed-methods enables
researchers to answer research questions with sufficient depth and breadth (Enosh, Tzafrir, & Stolovy, 2014) and helps
generalise findings and implications of the researched issues to the whole population. For example, the quantitative approach
helps a researcher to collect the data from a large number of participants; thus, increasing the possibility to generalise the
findings to a wider population. The qualitative approach, on the other hand, provides a deeper understanding of the issue
being investigated, honouring the voices of its participants. In other words, whereas quantitative data bring breadth to the
study and qualitative data provides depth to it. Moreover, quantitative results can be triangulated with qualitative findings and
vice versa. Triangulation, as a qualitative research strategy, is the use of multiple methods or data sources to develop a
comprehensive understanding of a research problem or to test validity through the convergence of information from different
sources (Carter et al., 2014). A mixed-methods design, therefore, offers the best chance of answering research questions by
combining two sets of strengths while compensating at the same time for the weaknesses of each method (Johnson &
Onwuegbuzie, 2004). Consequently, "mixed-method research designs are becoming increasingly relevant to addressing
impact research questions” (Saville, 2012, p.7).
There is a plethora of literature (Bryman, 2012; Creswell & Plano Clark, 2018; Johnson & Onwuegbuzie, 2004; Maxwell,
2016; Morgan, 2014; Tashakkori & Teddlie, 1998) around the theory of mixed-methods, and on the breadth and depth of this
design. However, it seems that there is very limited literature on a mixed-methods research design that can effectively guide
early career researchers through selecting a proper design for their study thereby enabling them to understand its rationale.
Despite its merits and popularity among researchers, some scholars might consider it as a design that can potentially cause a
lot of troubles to a researcher when they plan to organize both qualitative and quantitative methods in a study as a researcher
may not be equally capable of handling both methods. In the following sections, then, reasons for selecting mixed-methods
for a study and their potential weaknesses are explained.
4. Why Mixed Methods?
Mixing two methods might be superior to a single method as it is likely to provide rich insights into the research
phenomena that cannot be fully understood by using only qualitative or quantitative methods. A mixed-methods design can
integrate and synergize multiple data sources which can assist to study complex problems (Poth & Munce, 2020). The
application of MMR, as mentioned in the previous section, means purposeful data consolidation which allows researchers to
seek a wide view of their study by enabling them to view a phenomenon from different perspectives and research lenses
(Shorten & Smith, 2017).
There are six major justifications for combining quantitative and qualitative data in a research study. The first rationale of
employing an MMR approach is the expansion of study. This means an MMR approach allows researchers widen their
inquiry with sufficient depth and breadth. For instance, when a researcher wants to generalize the findings to a population
and develop a detailed view of the meaning of a phenomenon or concept for individuals, the advantages of collecting both
closed-ended quantitative data and open-ended qualitative data support understanding a research problem (Creswell, 2003).
Furthermore, qualitative data (such as interviews and focus groups) can provide depth in the research inquiry as the
researcher can gain a deeper insight into the phenomenon from narratives. Then, a quantitative approach of data collection
can bring breadth to the study by supporting the researcher with accumulating data about on different aspects of a
phenomenon from different participants.
Another driving motive for combining the two methods is the belief that both kinds of research have values and that in
some respects they are complementary, and therefore, there will be an added value in combining them. The researchers use
both data sets to answer the same research question which can produce greater certainty and wider implication in the
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
28
conclusion (Maxwell, 2016; Morgan, 2014). In other words, mixing two methods helps to produce a more complete picture
and provides an opportunity for a greater assortment of divergent or complementary views; which are valuable as they not
only lead to extra reflection and enrich our understanding of a phenomenon, but also open new avenues for future inquiries
(Teddlie & Tashakkori, 2009). Additionally, findings from mixed-methods research offer a holistic view of a phenomenon
and provide additional insights into different components of a phenomenon which might help for generating substantive
theories (Ventakesh et al., 2013).
Third, an MMR approach helps “to overcome the epistemological differences between quantitative and qualitative
paradigms and to provide a royal road to true knowledge” (Bergman, 2008, p. 4). Indeed, a principled combination of the two
methods supports researchers in developing an in-depth and comprehensive understanding of a research phenomenon (Lund,
2012). For example, while using a quantitative method, concepts can be operationalised in terms of well-defined indicators,
tracing trends and relationships, making comparisons, and using large and perhaps representative samples, a qualitative
method has the strengths of sensitivity to multiple meanings, logical ground, great methodological flexibility and in-depth
study of smaller samples which helps to study the process and change.
Fourth, an MMR approach helps to obtain more rigorous conclusions by employing two methods in such a way that the
strengths of the qualitative methods offset the weaknesses of the quantitative methods and vice versa (Plano Clark &
Ivankova, 2016). This implies that a quantitative method can be strong in those areas where a qualitative method is weak and
vice versa. Putting it in another way, one method is more suitable to answer one type of question and another method is more
suitable for another type of question. Mixing the two methods, therefore, offers the possibility of combining two sets of
strengths while compensating at the same time for the weaknesses of each method. Thus, the combination of quantitative and
qualitative methods is often proposed on the grounds that a researcher can utilize the respective strengths, escape the
respective weaknesses of the two approaches and produce a more accurate conclusion.
Another value of an MMR approach is its triangulation component. Data triangulation in a mixed-methods study is
generally accepted as a strategy for validating results obtained with the individual method (Bergman, 2008). A researcher, for
instance, aims to obtain a more valid picture about a research issue by directly comparing the findings drawn from one
method (qualitative or quantitative) to those obtained from another (quantitative or qualitative) for convergence and/or
divergence (Plano Clark & Ivankova, 2016). In other words, collecting diverse types of data offers greater insights on a
phenomenon that the methods individually cannot offer, and therefore, provides more valid and stronger inferences than a
single method does (Teddle & Tashakori, 2009). Thus, data triangulation leads to a well-validated conclusion and also
promotes the credibility of inferences obtained from one approach (Ventakesh et al., 2013).
Finally, the sixth rationale for mixing the two methods is “to develop more effective and refined conclusions by using the
results from one method (qualitative or quantitative) to inform or shape the use of another method (qualitative or
quantitative)” (Plano Clark & Ivankova, 2016, p. 86). For instance, researchers who want to understand possible factors that
cause obesity in children might argue for the need to quantitatively assess significant predictors and then they use the
quantitative results to develop qualitative follow-up exploration (potentially through interviews, observation, and focus
groups) to explore why certain factors were significant. This means the development of a new method based on the previous
method is possible only in a (mixed-methods) sequential design. The following section elucidates fundamental considerations
when developing a sequential (MMR) design.
5. Key Considerations
In a mixed-methods study, the selection of a proper design is not an easy task for most researchers. Careful consideration
should be given to three major aspects while selecting an MMR design. The first decision is about the relative priority of the
approaches. Priority refers to the relative importance of the qualitative and quantitative data for answering research questions
(Plano Clark & Ivankova, 2016). The priority usually depends on the research questions or the goals of the research and its
participants. A study can have three priority options: quantitative priority (i.e., more emphasis on the quantitative data
collection and analysis), qualitative priority (i.e., more emphasis on the qualitative data collection and analysis), or equal
priority (i.e., considering both data sets to be equally important to answer the research questions) (Plano Clark & Ivankova,
2016). A researcher, then, must weigh carefully the purpose of their research and the data they need to address it before
prioritising research approaches.
The second decision accentuates the level of interaction between the data sets. It refers to the extent to which qualitative
and quantitative approaches “are kept independent or interact with each other” (Creswell & Plano Clark, 2011, p. 64). When
they are independent, the researcher mixes the two approaches only at the final stage, i.e., after the analysis of the data. As
one of the purposes of using mixed methods methodology in a study is to obtain different but complementary data on the
same issue to best understand the research problems, the data can be collected separately, and the findings can be mixed
before interpreting the results. Creswell and Plano Clark (2011) discuss four possible stages for mixing two data sets: at the
level of design, during data collection, during data analysis, and during data interpretation.
The third decision concerns the timing of the qualitative and quantitative approaches. Timing refers to “the entire
quantitative and qualitative strands, not just data collection” (Creswell & Plano Clark, 2011, p. 65). The two methods can be
combined either sequentially (i.e., findings from one approach inform the other) or concurrently (i.e., independent of each
other). Ventakesh et al. (2013) state:
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
29
In a concurrent design, qualitative and quantitative data are collected and analyzed in parallel and then merged
for a complete understanding of a phenomenon or to compare individual results. In contrast, in a sequential
mixed methods design, quantitative and qualitative data collection and analyses are implemented in different
phases and each is integrated in a separate phase. (p. 17)
Regarding sequential combination, Achterberg (1988) suggests that a qualitative method should precede quantitative
methods so that detailed information can be collected and more directed, specific quantitative procedures can be developed.
However, the type of combination should be driven by research goals and context. In general, if the research goal is to
understand the phenomenon as it happens, it seems that a concurrent approach will be better, but if the researcher expects that
findings from a method (either qualitative or quantitative) will support the later (quantitative or qualitative) study, then a
sequential approach should be used (Creswell, 2003).
In addition to the above key considerations, the sample size in a mixed methods research design can be different for
qualitative and quantitative strands. The sample participating in a qualitative strand can be a subset of the participants who
participate in the quantitative study. The researcher should also be aware of the issue that it will bring complexity in the
merging process while analysing and interpreting the data. And since one of the purposes is also to synthesize different
results into a complementary picture of the issue being explored (Creswell & Plano Clark, 2018), the size differential should
not be a big issue. Creswell and Plano Clark (2018) state that having a small size in qualitative component and larger size in
quantitative component supports researchers to get in-depth qualitative exploration and rigorous quantitative examination of
the issue.
If a researcher evaluates some or all of these criteria, they can decide if mixed-methods fits as a research design for their
study. Once a researcher decides to use mixed-methods as a design, they need to delve deeper into deciding which mixed
methods design is appropriate. The following section introduces core mixed-methods designs and lists the challenges of each
design that can potentially help a researcher to select the most appropriate design for their study.
6. Which Mixed-Methods Design?
Timans et al. (2019) claim that "mixed-methods research (MMR) scholars seem to be committed to designing a
standardized methodological framework for combining methods." (p. 212). They argue that although MMR must be
separated from their native epistemology to work, it is necessary to be within a qualitative and quantitative research approach
which will also be indicated by the data they use. While acknowledging merits in the Timans et al.'s views, this article is
based on the premise that the research-novices need to treat the mixing of methods as one research approach as keeping them
epistemologically separate within MMR may create complications at the data integration and interpretation stage. This
section, therefore, presents core common mixed-methods research types which are prevalent in the field of research. Several
scholars (Plano Clark & Ivankova 2016; Terrell, 2012; Wilkinson & Staley, 2019) have listed various types of mixed-
methods research design. Creswell and Plano Clark (2018) consider these core designs as parsimonious and practical since
they have the potential to make researchers understand the best possible options of mixed methods research designs. In this
section some common types of mixed methods are presented. Attempts have been made to illustrate the MMR types with
suitable examples.
6.1. Convergent Parallel Mixed-Methods Design
A convergent design that follows pragmatism as a theoretical assumption, is an efficient and popular approach to mixing-
methods research (Creswell & Plano Clark, 2018). Two different approaches namely qualitative and quantitative methods are
mixed to obtain the triangulated results in this design. At first, two types of data sets are collected concurrently, and secondly,
they are analysed independently using quantitative and qualitative analytical approaches (Schoonenboom & Johnson, 2017;
Shorten & Smith, 2017; Creswell and Plano Clark, 2018; Wisdom & Creswell, 2013). In a convergent design, the integration
of both data will help a researcher gain a complete understanding of the one provided by the quantitative or qualitative results
alone. It is an approach in which two data sets are combined to get a complete picture of the issue being explored and to
validate one set of findings with the other (Creswell and Plano Clark, 2018). For instance, if a researcher is examining
experiences of using digital technologies in education, s/he administers a survey and also conducts interviews with teachers
and students to understand the issue. S/he collects quantitative data from a survey and qualitative data from interviews and
examines if the findings obtained from these two different data sets converge or diverge. In case the results diverge, the
researcher explains the finding by re-examining the results and collecting more data, or explaining the quality of the dataset.
"The intent of integration in a convergent design is to develop results and interpretations that expand understanding, are
comprehensive and are validated and confirmed" (Creswell & Plano Clark, 2018, p. 221). Fàbregues et al. (2020) argue that
convergent studies are apt designs for integration as both data results are available when interpretation is planned.
In the analysis phase, a researcher can always look for the common concepts across both sets of findings. Integration in
convergent design can be done in two ways: a) by presenting findings of the qualitative study followed by the quantitative
study or vice versa or b) by transforming the qualitative data into counts and integrating the transformed qualitative dataset
into quantitative data (Creswell & Plano Clark, 2018). In the latter case, a researcher can count the identified codes or
themes.
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
30
Creswell and Plano Clark (2018) maintain that this design can be useful in certain conditions, such as, it can be adopted
when a researcher has limited time; when s/he needs both qualitative and quantitative information from the participants and
when s/he (or a team of researchers) has required skills to handle both quantitative and qualitative methods. They also list
issues of different sample sizes, the need to merge a text and numeric database and the need to explain divergence when
comparing results as the challenges of convergent design. Firstly, in this design, a researcher needs to think of the possibility
and outcomes of having different sample sizes when quantitative and qualitative data are collected for generalization and
deeper understanding. Secondly, s/he might find it difficult to merge data based on texts with the data based on numbers to
examine the same issue. Thirdly, if the findings have divergent results, it might add an additional layer of complexity for
them, and they might find it difficult to address these differences. They might require to collect qualitative data or
quantitative data or both again. The following is an example of a study that explains convergent parallel mixed-methods
design.
Example: Dawadi (2019) conducted a convergent parallel mixed-methods study to explore the impact of the Secondary
Education Examination English Test on students (aged 15-16 years old) and their parents in Nepal. In the study, the data was
collected through a longitudinal survey (n=247) with students, oral diaries recorded by six students intermittently for three
months (n=72) and interviews with those six students and their parents (n=24). The study used concurrent timing meaning
both quantitative and qualitative data were collected at the same time, but independent of each other. The author argues that
this timing was used to ensure that there was no chance that one approach influenced another approach as in a sequential
design. Therefore, both qualitative and quantitative data in the study were collected concurrently but analysed separately, and
the findings were mixed before interpreting the results. This means that the two data sets were combined during the data
interpretation phase only. Dawadi argues, "If the quantitative data had been analysed first, the qualitative findings might
have been affected by the quantitative results, but the reverse was not possible" (p. 66). It is also worth pointing out that
equal priority was given to both data sets considering the equal importance of both types of data in answering the research
questions of the study. The two data sets complemented each other and also supported the author to triangulate her findings
drawn from the qualitative methods with the results from quantitative methods, and vice versa.
6.2. Explanatory Sequential Design
Explanatory Sequential design occurs in two distinct interactive phases, the beginning with the collection and analysis of
the quantitative data to expand the first phase quantitative results followed by the designing of the second, qualitative phase
on the basis of the quantitative findings (Creswell & Plano Clark, 2018; Schoonenboom & Johnson, 2017; Shorten & Smith,
2017; Wisdom & Creswell, 2013). In this design, a researcher follows up on a specific quantitative finding and explains it
with the qualitative data (Wisdom & Creswell, 2013). For example, once the significant predictors are identified through
statistical measures, such as it is found that pandemic is one of the reasons that has made teachers and learners use digital
technologies profusely, an interview is designed to delve deeper and explain this predictor. In this design, the qualitative
design helps explain certain quantitative results that include unexpected findings in more detail (Terrell, 2012). Creswell and
Plano Clark (2018) suggest that a researcher should shift from postpositivist to constructivist theoretical assumption when
this design is adopted in a study. The researcher follows the postpositivist assumption to select instruments and moves to
constructivist assumption as they value multiple perspectives and in-depth exploration (Creswell & Plano Clark, 2018).
In this design, firstly, a quantitative strand is designed and implemented, and later the specific quantitative findings which
will be explained is decided. Secondly, a qualitative strand is designed and developed to explain the quantitative findings.
And finally, the quantitative results are summarized and interpreted. Creswell and Plano Clark (2018) argue that integration
in this design takes place in two ways: a) by connecting the quantitative findings to the qualitative data collection and b) by
drawing integrated findings after combining two sets of results after the qualitative phase is completed.
This design is useful when a researcher and research issue is more quantitatively oriented; when s/he has already
identified a variable to measure; when s/he has an ability to access the participants to collect the qualitative data; when s/he
has time to collect data in two phases; and when s/he is the sole investigator, collecting and analysing the data one at a time.
Wilkinson and Staley (2019) in their study found that sampling was one of the problems associated with this design. They
pointed out that the reviewers of the research papers, which they analysed, were concerned with "how well the sample for the
qualitative component represented the phenomenon identified in data from a larger sample of participants and analysed in the
quantitative portion of the study" (p. 70). Creswell and Plano Clark (2018) enumerate the extended time needed for
completion, the complexity in specifying the qualitative phase in advance, the compulsion for the identification of
quantitative results to be followed up, and the need to specify the participants who can provide the explanation as challenges
of this design. In this design, a researcher needs to spend too much time to implement two phases and a researcher might face
difficulty to get approval from the institutional board since it will be challenging for a researcher to specify the qualitative
phase beforehand. A researcher also needs to decide the quantitative results to be followed on, and they also need to decide
who to study and what will be the criteria for sampling (Creswell & Plano Clark, 2018). The following is an example of the
study that explains explanatory sequential design.
Example: McKim (2017) employed an explanatory sequential design to examine the perceived value of mixed methods
research for graduate students. The study consisted of two phases “where the quantitative phase was dominant, meaning more
weight was placed on the quantitative phase” (p. 204). In the first phase, a survey was conducted with 113 graduate students
and the data was analysed using SPSS. Then, in the second phase, focus group discussions were conducted with a small
subsample of students (n=11) to explain quantitative results (i.e., for the purpose of complementarity). This means the focus
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
31
group discussion questions/prompts were guided by the survey results. It is worth pointing out that the connection between
the two data sets happened in two places:
The first connection of the quantitative and qualitative phase was the use of the quantitative results to create the
focus group questions. The second connection was the mixing that happened after the qualitative data were
collected and analyzed. The results were connected to gain a better understanding of the findings from both
phases. (pp. 204-205)
The above discussions indicate that the quantitative phase informed the qualitative phase and the qualitative phase
provided further explanations to the quantitative results. Thus, the two data sets helped the authors to reflect on the research
issues with sufficient breadth and depth.
6.3. Exploratory Sequential Design
Exploratory sequential design is a three-phase study in which a researcher works from the constructivist principle. During
the first phase, a researcher explores an issue in-depth, and as they reach the second phase, they shift to the post-positivist
principle to identify and measure the variable and statistical trend (Creswell & Plano Clark, 2018). In this design, at first, the
qualitative data are gathered and analysed, and later quantitative data are collected and tested (Schoonenboom & Johnson,
2017; Shorten & Smith, 2017). This design begins with the collection and analysis of qualitative data. Building from the
qualitative findings, quantitative measures or instruments are developed (Terrell, 2012; Wisdom & Creswell, 2013), and
finally, a researcher quantitatively tests the variable that they have identified and interprets in what ways the quantitative data
generalizes and extends the qualitative findings (Creswell & Plano Clark, 2018). For example, once a researcher identifies
variables that have a role in promoting the use of digital technologies in education, they design the research instruments to
check if those variables are prevalent in a large mass as well. As far as the integration of this design is concerned, it begins
when a quantitative measure is developed based on the qualitative results. Integration is also seen when a researcher
integrates two sets of data after the quantitative phase is complete, and draws integrated conclusions that help to extend
qualitative findings.
The exploratory sequential design is useful when a researcher and a research issue are more qualitatively oriented; when
s/he has a required amount of time to conduct a three-phase study; when s/he is interested in the transferability or
generalizability of the product; and when s/he finds an issue based on a small sample and wants to test it with a large sample
(Creswell & Plano Clark, 2018). They further claim that it is straightforward to implement and describe and it makes the
qualitative result acceptable to quantitative-biased audiences since it combines the quantitative component. They argue that
in this design, a researcher can develop a new instrument during the research process. They also list challenges as a
compulsion to plan for an extended time to complete, a necessity to tentatively specify the quantitative phase in advance, a
prospective requirement of the identification of two different samples, the necessity to determine the qualitative results to
use, and the requirement of the skillful researcher. This research design requires a lot of time for a researcher to complete a
study and as in the explanatory sequential design, as s/he needs to decide tentatively quantitative phase for the institutional
board review which is challenging. A researcher should use a small, purposeful sample in the first phase and a large sample
in the second phase to have the extended finding which is difficult too. Next, s/he needs to decide the qualitative result which
will be used to build the quantitative measure, and s/he must be skilled and proficient in qualitative, quantitative, mixed
methods research and developing instruments. The following is an example of a study that employs the exploratory
sequential design.
Example: Munce et al. (2021) utilised an exploratory sequential design to demonstrate how this design can be used for
complex intervention development in a self-management program for individuals with spinal cord injury. The study consisted
of four phases. Phase I was a qualitative descriptive approach. Telephone interviews (n=26) of individuals were conducted to
inform the development of a subsequent survey and intervention. In Phase II, the themes that emerged from Phase I were
used to designing a survey, and the survey was administered. Phase III collected quantitative data via a survey with 99
participants, and both the quantitative and qualitative findings were merged (especially integrated) in the final phase. The
authors argue that the design “provided the opportunity to identify complementarity, convergence, and/or divergence” (p.
45). Figure 1 summarises different phases of the study.
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
32
Figure 1: Conceptual steps of the methodology followed to develop a complex intervention. (Munce et al., 2021, p. 48)
7. Challenges in Using a Mixed-Methods Design
Mixed-methods research may not always achieve its goal as mixing quantitative and qualitative methods can produce
several threats. Researchers, such as David et al. (2018); Dawadi (2019); and Fauser (2018), have pointed out some practical
difficulties associated with mixing qualitative and quantitative components which have been summarised here as five major
challenges. First, data collection and analysis might be a very lengthy process. Therefore, it might be more expensive in
terms of cost and time. Researchers usually struggle in designing their research within their estimated time and budgets
(Fauser, 2018; Hauken et al., 2019). Some researchers indicate that the timeline of recruitment is demanding and the labor in
data collection is intensive (David et al., 2018; Linnander et al., 2019).
Second, integrating qualitative and quantitative data is often difficult for many researchers (Wisdom & Creswell, 2013).
For instance, Dawadi (2019) pointed out that she was not confident about her approach in bringing together quantitative
(survey) and qualitative data (interviews and oral diaries). Casey et al. (2016) had a similar experience as they were unsure
about a strategy to integrate their data sets. They also indicate that existing literature provides sparse guidance on how to
merge data from different sources. Youngs and Piggot-Irvine (2012) raised a similar question in data analysis: ‘‘When do you
stop analyzing, comparing, and contrasting the data?’’ (p. 195).
Third, quantitative and qualitative methods are guided by different epistemological and philosophical frameworks.
Therefore, the concerns in integrating them "include whether the assumptions in each paradigm get the same value or
attention in the study and whether the data derived from the two methodologies are viewed as incommensurable" (Salehi &
Golafshani, 2010, p.189). Similarly, Yu (2012) points out, ''the difficulty associated with this design is the quantitative
measures must be compatible with the qualitative findings, which requires distinct and accurate themes to be found in the
qualitative data’’ (p. 375). Although researchers give equal priority/value and weight to both methods by considering that
they complement each other, a big challenge may arise when the findings drawn from one method contradict the those from
the other method, questioning the reliability and validity of one method (Salehi & Golafshani, 2010). As pointed out by Plano
Clark and Creswell (2018), most mixed-methods researchers obtain conflicting results from the qualitative and quantitative
strands. There might also be frequent problems in relating two different kinds of information and drawing a conclusion from
them (Hammersley, 2014). A researcher, therefore, needs to ensure that different methods are suitably combined so that there
is no compromise on the robustness and reliability of the research. Therefore, a mixed-methods researcher needs to have a
wider set of skills to conduct research rigorously. To reiterate, mixing methods is not a solution in itself, it might also create
some problems.
The fourth challenge associated with the mixed-methods approach is that of choosing a proper design and maintaining
quality in data integration. Sometimes, there might be a case that one method may influence data collection and interpretation
of another method. For instance, in a sequential design, the findings drawn from the first method (e.g., survey data) may
influence the second method (e.g., interview). A concurrent design might have similar issues. Leal et al. (2018) express their
concern that ‘‘the concurrent collection of both quantitative and qualitative in a single written survey from the sample
participants could result in each data method unintentionally influencing the other’’ (p. 51).
Fifth and the most important challenge for a mixed-method researcher is deciding which MMR design is appropriate for a
particular study. Suitability of a design will largely depend upon the purpose of the study and perceived priority given to the
qualitative and quantitative strand (i.e., whether the equal priority is given to both data sets or one is dominated by another).
As a consequence, early-career researchers may not have confidence to choose one from many designs especially when each
one has its own drawbacks and potential challenges.
To sum up, mixing data from different sources can sometimes lead a researcher nowhere. Creswell (2003) argues that
triangulated research may run the risk of taking on too many unfocused questions all at once. Novice researchers, therefore,
need to develop adequate skills both on qualitative and quantitative methods to cope with the demands of utilising a mixed-
methods approach (Creswell & Plano Clark, 2011). Therefore, they need to undertake the challenging task of training and
developing such skills before they employ an MMR research design.
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
33
8. Criticism of Mixed Methods Research
Researchers hold different views with regard to the use of both quantitative and qualitative methods within a single study.
Hammersley (1996), for example, states that qualitative and quantitative research paradigms are “founded on
incommensurable philosophical and/or political presuppositions'' (p. 2). Indeed, a quantitative approach, which is guided by
positivism, envisions the world mostly as static but for a qualitative approach, which is guided by interpretivism, the reality is
multiple and dynamic. Therefore, incompatibilists argue that the two approaches are incompatible as they have different
conceptions of reality, truth, the relationship between the researcher and object of investigation, and so forth. Guba (1987)
claims, "The one [paradigm] precludes the other just as surely as belief in a round world precludes belief in a flat one" (p.
31). Smith (1983) further argues:
One approach takes a subject-object position on the relationship to subject matter; the other takes a subject-
subject position. One separates facts and values, while the other sees them inextricably mixed. One searches for
laws, and the other seeks understanding. These positions do not seem to be compatible. (p. 12)
Having discussed the pitfalls of their mixed-methods research, Wilkinson and Staley (2019) argue that "in many cases,
the data collected and the analyses conducted were not sufficient to warrant conclusions about the research questions" (pp.
76-77). They further contend that the lack of focus could be another pitfall of the approach as mixed methods researchers try
to achieve a lot more in one manuscript handling both qualitative and quantitative methods, and also methodological hand-
wringing as these researchers try to present a persuasive argument for their knowledge claims and lengthy justification for
using mixed methods design in their study.
Despite the challenges, there has been a movement in favor of promoting 'mixed-methods' that combines qualitative and
quantitative approaches (Hammersley, 2014). Bryman (2012) argues that research should avoid epistemological division
between quantitative and qualitative methods as, for practical reasons, one type of method will usually be primary, but all
research is enriched by the addition of other methods. Additionally, Lincoln and Guba (2003) note:
various paradigms are beginning to ‘interbreed’ such that two theories previously thought to be in irreconcilable
conflict may now appear, under a different theoretical rubric [eclecticism in this case], to be informing one
another's arguments. (p. 254)
Thus, the driving motive for combining the two approaches is the belief that both kinds of research have value, that in
some respects they are complementary to each other, and that there are benefits of combining them together. As such, there
are several rationales for using a mixed-methods approach.
9. Conclusion
This article aimed at introducing a mixed-method research design for research students and novice researchers who have
a minimum of prior knowledge in the field. It follows a simple organisation and is written in simple language to help research
novices understand the MMR process and integrate different research methods at any stage of their research i.e., formulating
their research purpose, collecting, analysing, interpreting and reporting both qualitative and quantitative data. The article has
illustrated different types of MMR with suitable examples and practical advice in designing and implementing them with an
overview of constraints and challenges. The article suggests that incorporating methods from the two research traditions
quantitative and qualitative, and mixing them to create a new research design has been a scholarly practice in almost all
disciplines.
Providing an overview of the existing research methods, the article pointed out that historically, the main research method
was quantitative research design or the positivistic approach, which primarily addressed numerical data-related issues. The
researchers, later, knew that this conventional research method did not address all their research questions and there were
serious limitations. They then turned to the qualitative (constructivist) approaches for alternatives. However, qualitative
research designs have their own limitations and did not cater to the increasingly complex research aims of researchers.
Therefore, the search for a new research method led them to choose from a full repertoire of the available methodological
options and mixing them at any stage of their inquiry process research aim, overall research design, sampling, data
recording, analysis, and interpretation. A mixed-research design thus incorporates multiple approaches from all available
research paradigms at any stage of research.
Discussing the tension between the two established traditions of research, i.e., between positivists and constructivists
traditions, the article pointed out the attitudinal issues associated with each of them, particularly the qualitative tradition, by
stating that the researcher of the positivist tradition promotes the use of numbers, counts and statistics to produce empirical
evidence of truth and realities, while the scholars of the constructivists or hermeneutics tradition, advocate building of social
construction of meanings from the live experiences of their participants.
In answering the question of ‘why mixed-method research design?’, the article provided a number of justifications. First
and foremost, the article pointed out that the need for a mixed-method research design is to address the need of researching
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
34
complex social phenomena with a view to understanding their complexities. Secondly, a mixed-method research design,
especially in collaborative and applied research, assists a researcher to address confirmatory and explanatory questions
simultaneously. In other words, on the basis of the analysis and interpretation from a mixed-research method, a researcher
can construct, confirm and theorise at the same time. Thirdly, a mixed-method research design enables researchers to explain
seemingly contradictory outcomes emerging from the use of different methods. In addition, using data coming from a number
of methods, or converging data from multiple sources produce more credible findings which could strengthen research
conclusions and implications. In other words, results from one method can inform or develop the findings from another.
Furthermore, a mixed-method research design contributes to the complementarity of research which is understanding a
research issue through the use of separate yet dialectically related approaches. Finally, a mixed-method research design helps
extend the breadth and range of an inquiry.
A mixed-method research design is not free from limitations or challenges. The article has pointed to a number of its
challenges (challenges of using a mixed-method approach). The first of these limitations is deciding which mixed method
(discussed in the section of ‘which mixed-method study design?’) is appropriate for a particular research project. The
decision is often difficult for novice researchers because it may be difficult for them to realise how the mixing of methods
can inform the data analysis and interpretation of results. Secondly, maintaining a balance between the two research
traditions may be a challenge because it is easy for any researcher to focus more on one tradition they are more comfortable
with. Thirdly, integrating data from two methods to complement and extend data analysis and interpretation, and specially
triangulating them may be a challenge. Finally, using a mixed-method is a lengthy process as each of the research methods
consumes time. Therefore, a research project may require more time than it is available.
This article is especially useful and relevant for research students and early career researchers who typically take generic
research courses and have no practical ideas about how and where to begin when developing a research project. We have
tried to keep language simple to allow readers to follow the content of the article with ease. Additionally, we have not
focused on any particular discipline, therefore, research enthusiasts from any disciplines can benefit from it.
References
Achterberg, C. (1988). Qualitative methods in nutrition education evaluation research. Journal of Nutrition Education, 20(5),
244-250.
Bergman, M. M. (Ed.) (2008). Advances in Mixed Methods Research. Continuum.
Bryman, A. (2012). Social research methods (4
th
ed.). Oxford university press.
Carter, N, Bryant-Lukosius, D, DiCenso, A, Blythe, J, & Neville, A. J. (2014). The use of triangulation in qualitative
research. Oncol Nurs Forum. 41(5), pp. 545-7. http://dx.doi.org.libezproxy.open.ac.uk/10.1188/14.ONF.545-547
Casey, D., O’Hara, M. C., Meehan, B., Byrne, M., Dinneen, S. F., & Murphy, K. (2016). A mixed methods study exploring
the factors and behaviors that affect glycemic control following a structured education program: The Irish DAFNE
Study. Journal of Mixed Methods Research, 10(2), 182-203. https://doi.org/10.1177/1558689814547579
Caruth, G. D. (2013). Demystifying mixed methods research design: a review of the literature. Mevlana International
Journal of Education 3(2), pp. 112-122. http://dx.doi.org/10.13054/mije.13.35.3.2
Cohen, L., Manion, L., & Morrison, K. (2007). Research Methods in Education. Routledge.
Creswell, J.W. (2003). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches. Sage Publications.
Creswell, J. W. (2007). Qualitative Inquiry and Research Design: Choosing Among Five Approaches. Sage Publications.
Creswell, J. W. (2015). A concise Introduction to Mixed Methods Research. Sage Publications Ltd.
Creswell, J. W., & Plano Clark, V. L. (2011). Designing and Conducting Mixed Methods Research. Sage Publications.
Creswell, J. W., & Plano Clark, V. L. (2018). Designing and Conducting Mixed Methods Research (3rd ed.). Sage
Publications.
David, S. L., Hitchcock, J. H., Ragan, B., Brooks, G., & Starkey, C. (2018). Mixing interviews and Rasch modeling:
Demonstrating a procedure used to develop an instrument that measures trust. Journal of Mixed Methods Research,
12(1), 75-94. https://doi.org/10.1177/1558689815624586
Dawadi, S. (2019). Impact of the Secondary Education Examination (English) on Students and Parents in Nepal. An
unpublished PhD thesis. The Open University, UK.
Enosh, G., Tzafrir, S. S., & Stolovy, T. (2014). The development of client violence questionnaire (CVQ). Journal of Mixed
Methods Research, 9(3), 273–290. https://doi.org/10.1177/1558689814525263
Fàbregues, S., Hong, Q. N., Escalante-Barrios, E. L., Guetterman, T. C., Meneses, J., & Fetters, M. D. (2020). A
Methodological Review of Mixed Methods Research in Palliative and End-of-Life Care (2014–2019). International
Journal of Environmental Research and Public Health, 17(11), 3853. https://doi.org/10.3390/ijerph17113853
Fauser, M. (2018). Mixed methods and multisited migration research: Innovations from a transnational perspective. Journal
of Mixed Methods Research, 12(4), 394-412. https://doi.org/10.1177/1558689817702752
Feilzer, M. Y. (2010). Doing mixed methods research pragmatically: Implications for the rediscovery of pragmatism as a
research paradigm. Journal of Mixed Methods Research, 4(1), 6–16. https://doi.org/10.1177/1558689809349691
Fetters, M. D. (2016). Haven’t we always been doing mixed methods research? Lessons learned from the development of the
horseless carriage. Journal of Mixed Methods Research, 10(1), 3–11. https://doi.org/10.1177/1558689815620883
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
35
Guba, E. G. (1987). What have we learned about naturalistic evaluation? Evaluation Practice, 8(1), 23-43.
Hammersley, M. (1996). The relationship between qualitative and quantitative research: Paradigm loyalty versus
methodological eclecticism. In J. Richardson (Ed.) Handbook of qualitative research methods for psychology and the
social sciences. British Psychological Society Books.
Hammersley, M. (2014). Mres Programme: Module a Core Reading: An Introduction to Social Research. The Open
University, UK.
Hauken, M. A., Larsen, T. M. B., & Holsen, I. (2019). ‘‘Back on track’’: A longitudinal mixed methods study on the
rehabilitation of young adult cancer survivors. Journal of Mixed Methods Research, 13(3), 339-360.
https://doi.org/10.1177/1558689817698553
Johnson, R. B.B. & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come.
Educational Researcher, 33(7), 14–26. https://doi.org/10.3102/0013189X033007014
Leal, I., Engebretson, J., Cohen, L., Fernandez-Esquer, M. E., Lopez, G., Wangyal, T., & Chaoul, A. (2018). An exploration
of the effects of Tibetan yoga on patients’ psychological well-being and experience of lymphoma: An experimental
embedded mixed methods study. Journal of Mixed Methods Research, 12(1), 31-54.
https://doi.org/10.1177/1558689816645005
Lincoln, Y. S., Lynham, S. A., & Guba, E. G. (2011). Paradigmatic controversies, contradictions, and emerging confluences,
revisited. The Sage handbook of qualitative research, 4, 97-128.
Linnander, E., LaMonaca, K., Brault, M., Vyavahare, M., & Curry, L. (2019). A mixed methods evaluation of a multi-
country, cross-sectoral knowledge transfer partnership to improve health systems across Africa. International Journal
of Multiple Research Approaches, 11(1), 136-148. https://doi.org/10.29034/ijmra.v10n1a9
Lund, T. (2012). Combining qualitative and quantitative approaches: Some arguments for mixed methods research.
Scandinavian Journal of Educational Research, 56(2), 155-165.
McKim, C. A. (2017). The value of mixed methods research: A mixed methods study. Journal of Mixed Methods Research.
11(2) 202–222. https://doi.org/10.1177/1558689815607096
Maxwell, J. A. (2005). Qualitative research design: An interpretive approach. Sage Publications.
Maxwell, J. A. (2016). Expanding the history and range of mixed methods research. Journal of Mixed Methods Research,
10(1), 12–27. https://doi.org/10.1177/1558689815571132
Morgan, D. L. (2014). Integrating qualitative and quantitative methods: A pragmatic approach. Sage Publications.
Munce, S. E. P., Guetterman, T. C. & Jaglal, S. B. (2021). Using the exploratory sequential design for complex intervention
development: Example of the development of a self-management program for spinal cord injury. Journal of Mixed
Methods Research. 15(1) 37–60. https://doi.org/10.1177/1558689820901936
Plano Clark, V. L. & Ivankova, N. V. (2016). Mixed methods research. A guide to the field. Sage Publications.
Poth, C., & Munce, S. E. P. (2020). Commentary—Preparing today’s researchers for a yet unknown tomorrow: Promising
practices for a synergistic and sustainable mentoring approach to mixed methods research learning. International
Journal of Multiple Research Approaches, 12(1), 56-64. doi:10.29034/ijmra.v12n1commentary
Salehi, K. & Golafshani, N. (2010). Using mixed methods in research studies: An opportunity with its challenges.
International Journal of Multiple Research Approaches, 4(3), 186-191. https://doi.org/10.5172/mra.2010.4.3.186
Saville, N. (2012). Applying a Model for Investigating the Impact of Language Assessment within Educational Contexts:
The Cambridge ESOL Approach. Cambridge ESOL: Research Notes 50.
Schoonenboom, J., & Johnson, R. B. (2017). How to construct a mixed methods research design. KZfSS Kölner Zeitschrift
für Soziologie und Sozialpsychologie, 69(2), 107-131. https://doi.org/10.1007/s11577-017-0454-1
Shorten A., & Smith J. (2017). Mixed methods research: Expanding the evidence base. Evid Based Nurs, 20, 74–5.
http://dx.doi.org/10.1136/eb-2017-102699
Smith, J. K. (1983). Quantitative versus qualitative research: An attempt to clarify the issue. Educational Researcher, 12(3),
6-13.
Tashakkori, A., & Teddlie, C. (1998). Mixed Methodology: Combining Qualitative and Quantitative Approaches. Sage
Publications.
Taylor, P. C., & Medina, M. (2011). Educational research paradigms: from positivism to pluralism. College Research
Journal, 1(1), 1-16.
Teddlie, C., & Tashakkori, A. (Eds.) (2009). Foundations of Mixed Methods Research: Integrating Quantitative and
Qualitative Approaches In the Social and Behavioral Sciences. Sage Publications.
Terrell, S. (2012). Mixed-methods research methodologies. The Qualitative Report, 17(1), 254-280.
http://www.nova.edu/ssss/QR/QR17-1/terrell.pdf
Timans, R., Wouters, P., & Heilbron, J. (2019). Mixed methods research: what it is and what it could be. Theory Soc, 48,
193–216. https://doi.org/10.1007/s11186-019-09345-5
Venkatesh, V., Brown, S. A., & Bala, H. (2013). Bridging the qualitative-quantitative divide: Guidelines for conducting
mixed methods research in information systems. MIS Quarterly, 37(1), 21-54.
Wisdom, J., Creswell, J. W. (2013, March). Mixed Methods: Integrating Quantitative and Qualitative Data Collection and
Analysis While Studying Patient-Centered Medical Home Models. AHRQ and PCHM.
JPSE 2 (2): 25-36
Dawadi, S., Shrestha, S., & Giri, R. A.
36
https://pcmh.ahrq.gov/page/mixed-methods-integrating-quantitative-and-qualitative-data-collection-and-analysis-
while
Wilkinson, I. A. G., & Staley, B. (2019). On the pitfalls and promises of using mixed methods in literacy research:
Perceptions of reviewers. Research Papers in Education, 34(1), 61-83.
https://doi.org/10.1080/02671522.2017.1402081
Youngs, H., & Piggot-Irvine, E. (2012). The application of a multiphase triangulation approach to mixed methods: The
research of an aspiring school principal development program. Journal of Mixed Methods Research, 6(3), 184-
198. https://doi.org/10.1177/1558689811420696
Yu, S. (2012). College students’ justification for digital piracy: A mixed methods study. Journal of Mixed Methods Research,
6(4), 364-378. https://doi.org/10.1177/1558689812451790