A recently published study established a new way to monitor the mental health of a university's student population and it all boiled down to the website Reddit. Researchers from Georgia Tech University presented the findings at an Association for Computing Machinery conference. The team used publicly available social media posts to gauge student mental health at 109 universities. What they found overturned expectations based on other studies.
The researchers found a positive correlation between students at prestigious, expensive colleges and better mental health versus those at publicly funded universities. Because financial stress often contributes to mental anxiety, the scientists had been expecting the opposite. So, what accounted for that reversal?
Before we answer that, let's look at how the survey was conducted. Reddit might seem an unusual choice. But the researchers say the social network's organization makes it ideal for this study. Reddit includes forums called subreddits and many universities have their own dedicated subreddits. This made it easier to concentrate on specific schools for the purposes of analysis.
Another reason to rely upon Reddit is that most of those subreddits are viewable by the public. Facebook allows for private groups, which wouldn't be visible to the algorithm. Reddit also allows users to be semi-anonymous, using handles instead of real names. The researchers felt this would remove one of the social barriers that might prevent students from expressing themselves otherwise. (Although colleges have conducted mental health surveys these take a lot of time and money and only capture students' feelings at a particular moment in time, the researchers say.)
The team relied on earlier research that established a link between the content of social media posts and mental health. They also created an algorithm that could trawl through hundreds of posts and search for words and phrases that indicate stress or other problems. For example, a sentence like, "This semester is really taking a toll on me" could register as a hit.
To train the algorithm, the team first took a selection of posts from mental health subreddits as well as a control group of posts from subreddits unrelated to mental health. They used a method called inductive transfer learning to train the algorithm. This is a type of machine learning that involves storing knowledge gained by solving one type of problem and then applying that knowledge to a different but related problem.
Using their algorithm, the team developed a metric they called the Mental Well-being Index or MWI. A high MWI meant the student body posted about mental health issues less frequently on their university's subreddit, while a school with a low MWI indicated a higher concentration of such posts.
According to the researchers, their algorithm was more than 90 percent accurate in identifying posts on subreddits that contained language indicating a student was suffering from some sort of mental health issue. The team wasn't interested in identifying individuals — in fact, they expressly cautioned universities against taking that sort of approach. But then why run the study?
The scientists wanted to see the relationship between mental health and specific variables such as a university's size, demographic distribution and prestige. They found that the bigger public universities, particularly those with a large undergraduate population, had a lower MWI than smaller, private institutions. They also discovered that students at prestigious schools, and at those with higher tuitions, had a higher MWI than others. They likewise found that schools with a higher concentrate of female students had a lower MWI. Other demographics, such as ethnic diversity, didn't reveal statistically significant results and so the team didn't make any conclusions regarding those variables.
What the Researchers Found
Does that mean students in public universities have more mental health issues than those in ivy league schools? Or that women are struggling more than men? Not necessarily -- the researchers pointed out that those attending the prestigious schools may internalize stress and other mental health challenges more than their public university counterparts. In other words, they might be dealing with similar struggles but they aren't as likely to express them online.
The researchers also speculated that students at more expensive colleges might have more financial and emotional support from families and that students at prestigious colleges might be self-selected to already know how to deal with academic stress. Finally, other studies had shown that female students are more likely to seek mental health help than male students and may therefore be more likely to express their mental health challenges.
Don't expect the team to publish a guide telling you which schools have the highest MWI. The team would rather use the tool as a way for universities to see how various policies and activities impact student mental health. That way, a university has a tool that can alert administrators if a recent change in policy is having an adverse effect on student mental health.
This approach, they argue, allows university administrators to monitor trends in student body mental health continuously. That could help schools shape their policies and practices to minimize a negative impact on students -- as long as people keep posting to Reddit, that is.