Mobile research – specifically, research by way of smartphone technology – has become a widely used and accepted design option for conducting qualitative and survey research.  The advantages of the mobile mode are many, not the least of which are: the high incidence of smartphone ownership in the U.S. (more than 60% in 2015), the ubiquitous influence smartphones have on our lives, the dependence people have on their smartphones as their go-to channel for communicating and socializing, and the features of the smartphone that offer a variety of response formats (e.g., text, video, image) and location-specific (e.g., geo-targeting, geo-fencing) capabilities.

From a research design perspective, there are also several limitations to the mobile mode, including: the small screen of the smartphone (making the design of standard scale and matrix questionnaire items – as well as the user experience overall – problematic), the relatively short attention span of the respondent or participant precipitated by frequent interruptions, the potential for errors due to the touch screen technology, and connectivity issues.

Another important yet often overlooked concern with mobile research is the potential for bias associated with the smartphone response format and location features mentioned earlier.  Researchers have been quick to embrace the ability to capture video and photographs as well as location information yet they have not universally exercised caution when integrating these features into their research designs.  For example, a recent webinar in which a qualitative researcher presented the virtues of mobile qualitative research – esp., for documenting in-the-moment experiences – espoused the advantages of utilizing systems that allow the researcher to identify a participant’s location.  Among these advantages, according to the presenter, is the ability to gain the exact location of someone’s home address during an in-home use test (IHUT) which then, with the help of Google Earth, enables the researcher to actually see the property and surrounding neighborhood.  The presenter went on to state that these location images can and should be used with the intent of evaluating some aspect of this person’s life such as their socio-economic status.

The blatant bias this introduces into the research should be obvious.  Where someone chooses to livemay say something about their household income, educational achievement, and even their “social circles”; however, it is certainly not true in all cases and, indeed, such appearances can be grossly deceiving.  And, even if the researcher could ascertain some idea of the individual’s demographic or social group, what would be the point or use of this information?  Only to deepen the bias by creating a story of someone’s lived experience based on unsubstantiated claims built on preconceived stereotypical assumptions?

A similar bias creeps into mobile qualitative research when participants are asked to submit their responses in the form of videos and/or photographs without also being asked for accompanying commentary or follow-up questions by the researcher.  By simply submitting these images without explanation, the researcher comes to his/her own conclusions which then lead to bias and error in the data which ultimately downgrades the value of the final outcomes.  If the researcher conducting an IHUT study on eating habits, for example, learns from the participant that she and her family eat a “healthy” diet but sees from a submitted photograph a refrigerator containing fruits and vegetables but also donuts, Coke, and processed cheese – what is the researcher to make of that?  Are the participant’s eating habits really not that “healthy”?  Are there additional healthier foods hidden from view in the refrigerator’s compartments or drawers?  Does the participant’s definition of “healthy eating” include donuts, Coke, and processed cheese?   Without examining the whys and whereforeswith the participant, the researcher is left to form a subjective understanding of the fridge contents and may create a false yet seemingly plausible story about the participant from the image.

Mobile research gives the researcher new and convenient ways to learn about the lives of the people who matter most in our research designs.  And yet, researchers are cautioned to tread carefully or risk infecting their data with an insidious and potentially destructive bias that comes from conjecturing stories of people’s lives by relying on what researchers see rather than from what they know to be true.

There are some who argue that idea generation among consumers is a frustrating task.  After all, who knows a particular product category more than the manufacturer, its advertising agency, and other groups committed to the survival of the product (and the product line)?  And it doesn’t help that facilitators of all kinds are guilty of asking consumers to be experts where they are not and to assume greater role playing in marketing decisions than is justified.  Asking consumers to step outside of their worlds – to pretend to be someone (something) else – may seem foolhardy.

Consumer ideation, however, can be a useful approach, particularly when it is constructed with two key ingredients: 1) people who are product-involved; and 2) individuals who can provide fresh, new insights.  Finding consumers who are product-involved is not difficult, but not all consumers are “creative” thinkers who can produce new perspectives or have the ability to look at something inside out and make sense of it, or take the familiar and make it strange.  This takes a very special recruiting effort, which is one of the many differences between idea generation and focus group research.

Idea generation sessions or workshops are not focus group research discussions.  Here are a few key ways in which consumer ideation – defined as a balance between loosely-structured brainstorming and the more structured, solution-oriented Synectic method – is differentiated from traditional focus group research:

• Research objectives.  Focus groups are attempting to understand underlying beliefs and motivations for consumer behavior, compared to consumer ideation where the goal is to make the familiar strange and generate as many ideas or solutions as possible without asking consumers to justify or defend.

• Preliminary groundwork.  Focus groups are often conducted to explore product-related questions that are being asked for the first time without necessarily the support of prior knowledge.  In contrast, ideation sessions are more productive if they are conducted only after preliminary research has indicated real opportunities.
• Sampling & Recruitment.  Focus group research design should strive to include an honest representation of the target audience.  This means a fair distribution of demographics, geography, product-usage level, and other considerations.  The primary interest in idea generation recruitment is often (but not always) to find consumers who have shown (via their attitudes and behavior) a particularly high level of involvement in the product and/or category, and proven their ability to think “creatively” by way of responses to carefully-crafted screening questions.
• Session length.  Focus group discussions are, typically, 90-120 minutes in length, compared to ideation sessions which can run half a day or longer.
• Facilitation.  A focus group moderator is generally intent on controlling the content of the discussion in order to successfully cover all topics on a predetermined discussion outline.  The role of the facilitator in an ideation session, however, is to control the process – by keeping participants fresh, keeping a productive flow of ideas – not the content.  In idea generation, the content can not be predetermined, the content belongs to the participants.
• Psychological environment.  All facilitators attempt to create a “safe” environment for their participants.  The leader of an idea generation session places a particularly heavy emphasis on this aspect by loosing the structure, the usual social or cultural norms, and by having participants build on others’ comments while making participants feel safe from “attack.”