Tips from my online survey research in 2018

I have a special affinity for quantitative research. Specifically: I LOVE online survey work! It’s a very efficient method to gather lots of data at scale that is almost automatically formatted for easy analysis and visualization.

Even though I have past experience with designing, collecting and analyzing survey data around current events, politics and marketing, my academically-focused work this year really sharpened my survey skills. I used Qualtrics almost exclusively as the online platform for creating and administering surveys, and I recruited larger samples than I ever have before using Amazon Mechanical Turk (MTurk), Qualtrics‘ own panel aggregation and a study pool run by Carnegie Mellon University’s Center for Behavioral and Decision Research (CBDR). My collaborators and I also recruited participants through US-based Survey Monkey; Prolific Academic, a UK-based company that also recruits US-based workers; and QQ and SoJump survey platforms based in China.

The increased stakes and many unknowns I encountered as my research evolved led me to reach out on social media, at workshops and in my own labs for help and for new ideas. I also reached out to MTurk workers for advice on fine-tuning my surveys, and I signed up myself as an MTurk worker to see how it looks from the other side. Below, I share some of what I learned during this year’s academic work that may also benefit your own survey research.

Continue reading Tips from my online survey research in 2018

Age effects: Correlation, causation, and socialization

Recently, when working with undergraduates to design a new experiment, they told me that they preferred to recruit participants under 40 in order to control for age effects in attitudes toward using technology.

Actually, that’s not quite what they said. “Older people are slower to change to new technologies,” is the quote I remember.

I acknowledged that I had seen “age effects” in my recent research — which I had just asked them to read through, though that summary didn’t include in which direction the age effects were seen. For the pilot study, I conceded that it might be wise to narrow the sampling to an age range that is more easily recruited around a college campus.

But privately, I started wondering – Do I believe, as they apparently do, that older people are usually slower to “get” technology? After all, **I** am older than 40. I could argue that, given my life circumstances as an adult returning student, I am learning new technologies at a **faster** pace than those younger than me simply because I am playing catch-up. But, in my more honest moments, I know I am more set in my ways than when I was 20 or 25. … Except, I might only be set in ways that I’ve learned the hard way from bad experiences, including from technologies that promise more than they deliver, while I stay open to new possibilities. … Except, I’ve known plenty of tech curmudgeons older than me, so I very well might be the exception. Except,  …

Continue reading Age effects: Correlation, causation, and socialization

July 2018 note: Back to blogging?

It’s been a while since I posted here. Plenty has happened to me! I:

  • Switched my master’s degree field from media arts and science to human-computer interaction.
  • Earned a master’s of science degree in human-computer interaction from Indiana University School of Informatics and Computing at IUPUI.
  • Sold my condo in Downtown Indianapolis, Ind.
  • Spent a summer renting a friend’s lake house in Carmel, Ind.
  • Moved to an apartment in the Shadyside neighborhood of Pittsburgh, Penn.
  • Began work as a doctoral student researcher at the Human-Computer Interaction Institute at Carnegie Mellon University’s School of Computer Science.

Thanks to some timely help from an undergraduate student here, I have this blog up and running again. Given I am already working 40+ hours again, I don’t know if I will be able to keep it up, but I hope to keep posting from time to time – maybe when I’m drinking my morning coffee.

Coffee and newspaper for reading roundup post
Coffee and a newspaper. Photo credit: cafemama via photopin cc