More stories

  • in

    Studying learner engagement during the Covid-19 pandemic

    While massive open online classes (MOOCs) have been a significant trend in higher education for many years now, they have gained a new level of attention during the Covid-19 pandemic. Open online courses became a critical resource for a wide audience of new learners during the first stages of the pandemic — including students whose academic programs had shifted online, teachers seeking online resources, and individuals suddenly facing lockdown or unemployment and looking to build new skills.

    Mary Ellen Wiltrout, director of online and blended learning initiatives and lecturer in digital learning in the Department of Biology, and Virginia “Katie” Blackwell, currently an MIT PhD student in biology, published a paper this summer in the European MOOC Stakeholder Summit (EMOOCs 2021) conference proceedings evaluating data for the online course 7.00x (Introduction to Biology). Their research objective was to better understand whether the shift to online learning that occurred during the pandemic led to increased learner engagement in the course.Blackwell participated in this research as part of the Bernard S. and Sophie G. Gould MIT Summer Research Program (MSRP) in Biology, during the uniquely remote MSRPx-Biology 2020 student cohort. She collaborated on the project while working toward her bachelor’s degree in biochemistry and molecular biology from the University of Texas at Dallas, and collaborated on the research while in Texas. She has since applied and been accepted into MIT’s PhD program in biology.

    “MSRP Biology was a transformative experience for me. I learned a lot about the nature of research and the MIT community in a very short period of time and loved every second of the program. Without MSRP, I would never have even considered applying to MIT for my PhD. After MSRP and working with Mary Ellen, MIT biology became my first-choice program and I felt like I had a shot at getting in,” says Blackwell.

    Play video

    Many MOOC platforms experienced increased website traffic in 2020, with 30 new MOOC-based degrees and more than 60 million new learners.

    “We find that the tremendous, lifelong learning opportunities that MOOCs provide are even more important and sought-after when traditional education is disrupted. During the pandemic, people had to be at home more often, and some faced unemployment requiring a career transition,” says Wiltrout.

    Wiltrout and Blackwell wanted to build a deeper understanding of learner profiles rather than looking exclusively at enrollments. They looked at all available data, including: enrollment demographics (i.e., country and “.edu” participants); proportion of learners engaged with videos, problems, and forums; number of individual engagement events with videos, problems, and forums; verification and performance; and the course “track” level — including auditing (for free) and verified (paying and receiving access to additional course content, including access to a comprehensive competency exam). They analyzed data in these areas from five runs of 7.00x in this study, including three pre-pandemic runs of April, July, and November 2019 and two pandemic runs of March and July 2020. 

    The March 2020 run had the same count of verified-track participants as all three pre-pandemic runs combined. The July 2020 run enrolled nearly as many verified-track participants as the March 2020 run. Wiltrout says that introductory biology content may have attracted great attention during the early days and months of the Covid-19 pandemic, as people may have had a new (or renewed) interest in learning about (or reviewing) viruses, RNA, the inner workings of cells, and more.

    Wiltrout and Blackwell found that the enrollment count for the March 2020 run of the course increased at almost triple the rate of the three pre-pandemic runs. During the early days of March 2020, the enrollment metrics appeared similar to enrollment metrics for the April 2019 run — both in rate and count — but the enrollment rate increased sharply around March 15, 2020. The July 2020 run began with more than twice as many learners already enrolled by the first day of the course, but continued with half the enrollment rate of the March 2020 course. In terms of learner demographics, during the pandemic, there was a higher proportion of learners with .edu addresses, indicating that MOOCs were often used by students enrolled in other schools. 

    Viewings of course videos increased at the beginning of the pandemic. During the March 2020 run, both verified-track and certified participants viewed far more unique videos during March 2020 than in the pre-pandemic runs of the course; even auditor-track learners — not aiming for certification — still viewed all videos offered. During the July 2020 run, however, both verified-track and certified participants viewed far fewer unique videos than during all prior runs. The proportion of participants who viewed at least one video decreased in the July 2020 run to 53 percent, from a mean of 64 percent in prior runs. Blackwell and Wiltrout say that this decrease — as well as the overall dip in participation in July 2020 — might be attributed to shifting circumstances for learners that allowed for less time to watch videos and participate in the course, as well as some fatigue from the extra screen time.

    The study found that 4.4 percent of March 2020 participants and 4.5 percent of July 2020 participants engaged through forum posting — which was 1.4 to 3.3 times higher than pre-pandemic proportions of forum posting. The increase in forum engagement may point to a desire for community engagement during a time when many were isolated and sheltering in place.

    “Through the day-to-day work of my research team and also through the engagement of the learners in 7.00x, we can see that there is great potential for meaningful connections in remote experiences,” says Wiltrout. “An increase in participation for an online course may not always remain at the same high level, in the long term, but overall, we’re continuing to see an increase in the number of MOOCs and other online programs offered by all universities and institutions, as well as an increase in online learners.” More

  • in

    “To make even the smallest contribution to improving my country would be my dream”

    Thailand has become an economic leader in Southeast Asia in recent decades, but while the country has rapidly industrialized, many Thai citizens have been left behind. As a child growing up in Bangkok, Pavarin Bhandtivej would watch the news and wonder why families in the nearby countryside had next to nothing. He aspired to become a policy researcher and create beneficial change.

    But Bhandtivej knew his goal wouldn’t be easy. He was born with a visual impairment, making it challenging for him to see, read, and navigate. This meant he had to work twice as hard in school to succeed. It took achieving the highest grades for Bhandtivej to break through stigmas and have his talents recognized. Still, he persevered, with a determination to uplift others. “I would return to that initial motivation I had as a kid. For me, to make even the smallest contribution to improving my country would be my dream,” he says.

    “When I would face these obstacles, I would tell myself that struggling people are waiting for someone to design policies for them to have better lives. And that person could be me. I cannot fall here in front of these obstacles. I must stay motivated and move on.”

    Bhandtivej completed his undergraduate degree in economics at Thailand’s top college, Chulalongkorn University. His classes introduced him to many debates about development policy, such as universal basic income. During one debate, after both sides made compelling arguments about how to alleviate poverty, Bhandtivej realized there was no clear winner. “A question came to my mind: Who’s right?” he says. “In terms of theory, both sides were correct. But how could we know what approach would work in the real world?”

    A new approach to higher education

    The search for those answers would lead Bhandtivej to become interested in data analysis. He began investigating online courses, eventually finding the MIT MicroMasters Program in Data, Economics, and Development Policy (DEDP), which was created by MIT’s Department of Economics and the Abdul Latif Jameel Poverty Action Lab (J-PAL). The program requires learners to complete five online courses that teach quantitative methods for evaluating social programs, leading to a MicroMasters credential. Students that pass the courses’ proctored exams are then also eligible to apply for a full-time, accelerated, on-campus master’s program at MIT, led by professors Esther Duflo, Abhijit Banerjee, and Benjamin Olken.

    The program’s mission to make higher education more accessible worked well for Bhandtivej. He studied tirelessly, listening and relistening to online lectures and pausing to scrutinize equations. By the end, his efforts paid off — Bhandtivej was the MicroMasters program’s top scorer. He was soon admitted into the second cohort of the highly selective DEDP master’s program.

    “You can imagine how time-consuming it was to use text-to-speech to get through a 30-page reading with numerous equations, tables, and graphs,” he explains. “Luckily, Disability and Access Services provided accommodations to timed exams and I was able to push through.”   

    In the gap year before the master’s program began, Bhandtivej returned to Chulalongkorn University as a research assistant with Professor Thanyaporn Chankrajang. He began applying his newfound quantitative skills to study the impacts of climate change in Thailand. His contributions helped uncover how rising temperatures and irregular rainfall are leading to reduced rice crop yields. “Thailand is the world’s second largest exporter of rice, and the vast majority of Thais rely heavily on rice for its nutritional and commercial value. We need more data to encourage leaders to act now,” says Bhandtivej. “As a Buddhist, it was meaningful to be part of generating this evidence, as I am always concerned about my impact on other humans and sentient beings.”

    Staying true to his mission

    Now pursuing his master’s on campus, Bhandtivej is taking courses like 14.320 (Econometric Data Science) and studying how to design, conduct, and analyze empirical studies. “The professors I’ve had have opened a whole new world for me,” says Bhandtivej. “They’ve inspired me to see how we can take rigorous scientific practices and apply them to make informed policy decisions. We can do more than rely on theories.”

    The final portion of the program requires a summer capstone experience, which Bhandtivej is using to work at Innovations for Poverty Action. He has recently begun to analyze how remote learning interventions in Bangladesh have performed since Covid-19. Many teachers are concerned, since disruptions in childhood education can lead to intergenerational poverty. “We have tried interventions that connect students with teachers, provide discounted data packages, and send information on where to access adaptive learning technologies and other remote learning resources,” he says. “It will be interesting to see the results. This is a truly urgent topic, as I don’t believe Covid-19 will be the last pandemic of our lifetime.”

    Enhancing education has always been one of Bhandtivej’s priority interests. He sees education as the gateway that brings a person’s innate talent to light. “There is a misconception in many developing countries that disabled people cannot learn, which is untrue,” says Bhandtivej. “Education provides a critical signal to future employers and overall society that we can work and perform just as well, as long as we have appropriate accommodations.”

    In the future, Bhandtivej plans on returning to Thailand to continue his journey as a policy researcher. While he has many issues he would like to tackle, his true purpose still lies in doing work that makes a positive impact on people’s lives. “My hope is that my story encourages people to think of not only what they are capable of achieving themselves, but also what they can do for others.”

    “You may think you are just a small creature on a large planet. That you have just a tiny role to play. But I think — even if we are just a small part — whatever we can do to make life better for our communities, for our country, for our planet … it’s worth it.” More