Site icon Dynamics of Writing

Ask a generic question, get a generic answer: The perils and promise of letting ChatGPT build your interview questions

Believe it or not, we actually used to sell beer like this. Try not to let AI make your interview questions as generic as this marketing approach.

As I noted in previous posts, I wasn’t significantly worried about ChatGPT or other AI programs taking over journalism at this point. The writing wasn’t clean, the material we cover is too specific and the nuances of the language tended to create more problems than solutions.

That changed a bit when a former student told me people in her orbit were using ChatGPT to create interview questions for everything from press releases to profiles. My concerns ranged from students becoming lazy to ChatGPT asking some pretty offensive questions that ill-prepared or inexperienced writers would use to their own detriment.

To see what would happen, I relied on a situation a friend found herself in last week while teaching at Missouri Boys and Girls State. One of the guest speakers was Barbara P. Bush, daughter of former President George W. Bush and granddaughter of former President George H. W. Bush. She has also been a significant figure as an author and global health care activist.

My friend noted that one of her students had an exceptionally good interview moment with Barbara P. Bush, which we’ll get to in a moment. Before that happens, I decided to let ChatGPT take the wheel and build me a set of interview questions for the former First Daughter:

Here are five thoughtful and engaging questions an interviewer could ask Barbara Pierce Bush, daughter of former President George W. Bush:

  1. Your work with Global Health Corps has been widely recognized—what inspired you to focus on global health, and how has that mission evolved over the years?
    (This connects her personal passion to her professional work.)

  2. Growing up in one of America’s most prominent political families, how did you navigate forming your own identity outside of politics?
    (This explores the personal challenge of living in the public eye.)

  3. You and your twin sister Jenna have often shared stories of your childhood—how has your bond influenced your adult life and careers?
    (This taps into her well-known relationship with her sister and could elicit warm, relatable stories.)

  4. What lessons did you learn from your mother, Laura Bush, that have shaped how you approach leadership and service?
    (This allows reflection on legacy and values from a female role model.)

  5. In today’s divisive political climate, how do you think members of prominent political families can help encourage civility and understanding?
    (This invites her to speak thoughtfully about public discourse without diving into partisanship.)

It’s a solid list, but here are a couple key problems I noticed:

  1. Bush has been asked and has answered most of these questions at length before. This means she probably has a pretty standard answer for them, so you’re not getting anything new.
  2. Not one of them directly attaches itself to the idea of your dad being the “most powerful man in the world.” (I always believed my dad to be the “most powerful man in the world” back when I was a kid, as I’m sure a lot of kids my age did back in the day. That said, my dad didn’t have Seal Team 6 or the 82nd Airborne to deploy when my room got too messy for him to tolerate.)

The question my friend’s student asked perfectly dealt with those two problems:

“How did your dad change after Sept. 11?”

Bush teared up immediately, not expecting a question like that, nor one phrased exactly that way. She gave a great answer about how he changed but he would always be her dad. She also thanked the student for asking that question and really tapping into something different.

Even in that scenario, it’s hard to pick on ChatGPT’s effort. These are good questions, and the bot does a good job of rationalizing what each question should provide the interviewer. I could clearly imagine being flustered if I were to interview someone famous like a former First Daughter, who has carved out an impressive career of her own. ChatGPT’s questions would put me on some better ground than, “So what’s it like to be a twin?” or “Was it weird having your high school dates pick you up at the governor’s mansion?”

That said, ChatGPT struggles a bit more when it comes to people who aren’t internationally famous. I picked a Facebook friend at random and tried the same thing, ending up with one of my favorite high school teachers, Greg Frederick, as the guinea pig for this situation (Sorry in advance, Mr. Frederick…):

Here are five thoughtful and respectful questions an interviewer could ask Greg Frederick, former teacher at Pius XI High School in Milwaukee, Wisconsin:

  1. What initially inspired you to pursue a career in education, and what led you to Pius XI High School specifically?

  2. How did your teaching philosophy evolve during your time at Pius XI, and what impact did that have on your students?

  3. Can you share a memorable moment or experience from your teaching career that still resonates with you today?

  4. How did you approach balancing academic rigor with the values and mission of a Catholic high school like Pius XI?

  5. What advice would you give to new educators entering the profession, especially those teaching in faith-based schools?

A couple of these are solid “opener” questions that could get the ball rolling for a decent interview. Why you wanted to be a teacher and why you ended up teaching at Pius for as long as you did could establish report. The third question is always a good one, in allowing the person to open up about something important and not forcing the interview subject to feel pigeonholed.

A couple of these feel problematic: The second question is a bit iffy in that we assume he changed over time (not always a guarantee) and that it impacted his students (again, not a guarantee). The fourth question could be taken poorly, as someone might read it as the values and mission of the faith are at odds with educational rigor.

The bigger thing, again, is that they’re generic. These could be asked of any biped who spent an appreciable length of time teaching any subject at any religious-based high school. In short, there’s less out there on Mr. Frederick because he’s not a president, a pope or a Kardashian.

I don’t know him as well as a lot of other people, I’m sure, in that I was a student at the school for four years during a specific time period, and I haven’t kept up with his life like a stalker in a made-for-TV movie. That said, I do know certain things that might have led to different questions:

(SIDE NOTE: Chris and I participated in a number of musicals together, which speaks more to the desperation the directors felt in getting males into the productions than it did to our musical acumen. In preparing for one such musical, the choral director actually told both of us to just “mouth the words” during the songs as we were not only godawful at singing, but we were screwing up everyone else who could carry a tune. Good memories…)

Again, this is just based on some basic stuff that I know that ChatGPT doesn’t. If I were to end up doing a profile on Mr. Frederick, I’d take my normal “build the donut around the hole” approach and interview his family, some people I know who taught with him, some of his students who have gone on to work in specific fields and so forth. The goal would be to figure out what kinds of questions to ask that are more on point about him specifically as opposed to Generic Catholic High School Teacher X.

This is why it’s important to use ChatGPT as a tool in your toolbox and not view it as a panacea for completing your work. If you don’t go beyond the basics that ChatGPT can offer, you will never create anything better than a basic piece.

Exit mobile version