Middle East

Subterms

    Latest story

    100 Shares119 Views

    Architectural heritage like you haven’t seen it before

    by

    The shrine of Khwaja Abu Nasr Parsa is a spectacular mosque in Balkh, Afghanistan. Also known as the “Green Mosque” due to the brilliant color of its tiled and painted dome, the intricately decorated building dates to the 16th century.

    If it were more accessible, the Green Mosque would attract many visitors. But Balkh is located in northern Afghanistan, roughly 50 miles from the border with Uzbekistan, and few outsiders will ever reach it. Still, anyone can now get a vivid sense of the mosque thanks to MIT’s new “Ways of Seeing” project, an innovative form of historic preservation.

    Play video

    PHD student Nikolaos Vlavianos created the following Extended Reality sequences for the “Ways of Seeing” project.

    “Ways of Seeing” uses multiple modes of imagery to produce a rich visual record of four historic building sites in Afghanistan — including colorful 3D still images, virtual reality imagery that takes viewers around and in some cases inside the structures, and exquisite hand-drawn architectural renderings of the buildings. The project’s imagery will be made available for viewing through the MIT Libraries by the end of June, with open access for the public. A subset of curated project materials will also be available through Archnet, an open access resource on the built environment of Muslim societies, which is a collaboration between the Aga Khan Documentation Center of the MIT Libraries and the Aga Khan Trust for Culture.

    “After the U.S. withdrawal from Afghanistan in August 2021, Associate Provost Richard Lester convened a set of MIT faculty in a working group to think of what we as a community of scholars could be doing that would be meaningful to people in Afghanistan at this point in time,” says Fotini Christia, an MIT political science professor who led the project. “‘Ways of Seeing’ is a project that I conceived after discussions with that group of colleagues and which is truly in the MIT tradition: It combines field data, technology, and art to protect heritage and serve the world.”

    Christia, the Ford International Professor of the Social Sciences and director of the Sociotechnical Systems Research Center at the MIT Schwarzman College of Computing, has worked extensively in Afghanistan conducting field research about civil society. She viewed this project as a unique opportunity to construct a detailed, accessible record of remarkable heritage sites — through sophisticated digital elements as well as finely wrought ink drawings.

    “The idea is these drawings would inspire interest and pride in this heritage, a kind of amazement and motivation to preserve this for as long as humanly possible,” says Jelena Pejkovic MArch ’06, a practicing architect who made the large-scale renderings by hand over a period of months.

    Pejkovic adds: “These drawings are extremely time-consuming, and for me this is part of the motivation. They ask you to slow down and pay attention. What can you take in from all this material that we have collected? How do you take time to look, to interpret, to understand what is in front of you?”

    The project’s “digital transformation strategy” was led by Nikolaos Vlavianos, a PhD candidate in the Department of Architecture’s Design and Computation group. The group uses cutting-edge technologies and drones to make three-dimensional digital reconstructions of large-scale architectural sites and create immersive experiences in extended reality (XR). Vlavianos also conducts studies of the psychological and physiological responses of humans experiencing such spaces in XR and in person. 

    “I regard this project as an effort toward a broader architectural metaverse consisting of immersive experiences in XR of physical spaces around the world that are difficult or impossible to access due to political, social, and even cultural constraints,” says Vlavianos. “These spaces in the metaverse are information hubs promoting an embodied experiential approach of living, sensing, seeing, hearing, and touching.”

    Nasser Rabbat, the Aga Khan Professor and director of the Aga Khan Program for Islamic Architecture at MIT, also offered advice and guidance on the early stages of the project.

    The project — formally titled “Ways of Seeing: Documenting Endangered Built Heritage in Afghanistan” — encompasses imaging of four quite varied historical sites in Afghanistan.

    These are the Green Mosque in Balkh; the Parwan Stupa, a Buddhist dome south of Kabul; the tomb of Gawhar Saad, in Herat, in honor of the queen of the emperor of the Timurid, who was herself a highly influential figure in the 14th and 15th centuries; and the Minaret of Jam, a remarkable 200-foot tall tower dating to the 12th century, next to the Hari River in a distant spot in western Afghanistan.

    The sites thus encompass multiple religions and a diversity of building types. Many are in remote locations within Afghanistan that cannot readily be accessed by visitors — including scholars.

    “Ways of Seeing” is supported by a Mellon Faculty Grant from the MIT Center for Art, Science, and Technology (CAST), and by faculty funding from the MIT School of Humanities, Arts, and Social Sciences (SHASS). It is co-presented with the Institute for Data, Systems, and Society (IDSS), the Sociotechnical Systems Research Center (SSRC) at the MIT Schwarzman College of Computing, the MIT Department of Political Science, and SHASS.

    Two students from Wellesley College participating in MIT’s Undergraduate Research Opportunities Program (UROP), juniors Meng Lu and Muzi Fang, also worked on the project under the guidance of Vlavianos to create a video game for children involving the Gawhar Saad heritage site. 

    To generate the imagery, the MIT team worked with an Afghan digital production team that was on the ground in the country; they went to the four sites and took thousands of pictures, having been trained remotely by Vlavianos to perform a 3D scanning aerial operation. They were led by Shafic Gawhari, the managing director for Afghanistan at the Moby Group, an international media enterprise; others involved were Mohammad Jan Kamal, Nazifullah Benaam, Warekzai Ghayoor, Rahm Ali Mohebzada, Mohammad Harif Ghobar, and Abdul Musawer Anwari.

    The journalists documented the sites by collecting 15,000 to 30,000 images, while Vlavianos computationally generated point clouds and mesh geometry with detailed texture mapping. The outcome of those models consisted of still images,  immersive experiences in XR, and data for Pejkovic.  

    “‘Ways of Seeing’ proposes a hybrid model of remote data collection,” says Vlavianos, who in his time at MIT has also led similar projects at Machu Picchu in Peru, and the Simonos Petra monastery at Mount Athos, Greece. To produce similar imagery even more easily, he says, “The next step — which I am working on — is to utilize autonomous drones deployed simultaneously in various locations on the world for rapid production and advanced neural network algorithms to generate models from lower number of images.”  

    In the future, Vlavianos envisions documenting and reconstructing other sites around the world using crowdsourcing data, historical images, satellite imagery, or even by having local communities learn XR techniques. 

    Pejkovic produced her drawings based on the digital models assembled by Vlavianos, carefully using a traditional rendering technique in which she would first outline the measurements of each structure, at scale, and then gradually ink in the drawings to give the buildings texture. The inking technique she used is based on VERNADOC, a method of documenting vernacular architecture developed by the Finnish architect Markku Mattila.

    “I wanted to rediscover the most traditional possible kind of documentation — measuring directly by hand, and drawing by hand,” says Pejkovic. She has been active in conservation of cultural heritage for over 10 years.

    The first time Pejkovic ever saw this type of hand-drawn renderings in person, she recalls thinking, “This is not possible, a human being cannot make drawings like this.” However, she wryly adds, “You know the motto at MIT is ‘mens et manus,’ mind and hand.” And so she embarked on hand drawing these renderings herself, at a large scale — her image of the Minaret of Jam has been printed in a crisp 8-foot version by the MIT team.

    “The ultimate intent of this project has been to make all these outputs, which are co-owned with the Afghans who carried out the data collection on the ground, available to Afghan refugees displaced around the world but also accessible to anyone keen to witness them,” Christia says. “The digital twins [representations] of these sites are also meant to work as repositories of information for any future preservation efforts. This model can be replicated and scaled for other heritage sites at risk from wars, environmental disaster, or cultural appropriation.” More

    More stories

    • 88 Shares189 Views

      in Data Management & Statistics

      Mining social media data for social good

      by

      For Erin Walk, who has loved school since she was a little girl, pursuing a graduate degree always seemed like a given. As a mechanical engineering major at Harvard University with a minor in government, she figured that going to graduate school in engineering would be the next logical step. However, during her senior year, a class on the “Technology of War” changed her trajectory, sparking her interest in technology and policy.

      “[Warfare] seems like a very dark reason for this interest to blossom … but I was so interested in how these technological developments including cyberwar had such a large impact on the entire course of world history,” Walk says. The class took a starkly different perspective from her engineering classes, which often focused on how a revolutionary technology was built. Instead, Walk was challenged to think about “the implications of what this [technology] could do.” 

      Now, Walk is studying the intersection between data science, policy, and technology as a graduate student in the Social and Engineering Systems program (SES), part of the Institute for Data, Systems, and Society (IDSS). Her research has demonstrated the value and bias inherent in social media data, with a focus on how to mine social media data to better understand the conflict in Syria. 

      Using data for social good

      With a newfound interest in policy developing just as college was drawing to a close, Walk says, “I realized I did not know what I wanted to do research on for five whole years, and the idea of getting a PhD started to feel very daunting.” Instead, she decided to work for a web security company in Washington, as a member of the policy team. “Being in school can be this fast process where you feel like you are being pushed through a tube and all of a sudden you come out the other end. Work gave me a lot more mental time to think about what I enjoyed and what was important to me,” she says.

      Walk served as a liaison between thinktanks and nonprofits in Washington that worked to provide services and encourage policies that enable equitable technology distribution. The role helped her identify what held her interest: corporate social responsibility projects that addressed access to technology, in this case, by donating free web security services to nonprofit organizations and to election websites. She became curious about how access to data and to the Internet can be beneficial for education, and how such access can be leveraged to establish connections to populations that are otherwise hard-to-reach, such as refugees, marginalized groups, or activist communities that rely on anonymity for safety.

      Walk knew she wanted to pursue this kind of tech activism work, but she also recognized that staying with a company driven by profits would not be the best avenue to fulfill her personal career aspirations. Graduate school seemed like the best option to both learn the data science skills she needed, and pursue full-time research focusing on technology and policy.

      Finding new ways to tap social media data

      With these goals in mind, Walk joined the SES graduate program in IDSS. “This program for me had the most balance,” she says. “I have a lot of leeway to explore whatever kind of research I want, provided it has an impact component and a data component.”

      During her first year, she intended to explore a variety of research advisors to find the right fit. Instead, during her first few months on MIT’s campus, she sat down for an introductory meeting with her now-research advisor, Fotini Christia, the Ford International Professor in the Social Sciences, and walked out with a project. Her new task: analyzing “how different social media sources are used differently by groups within the conflict, and how those different narratives present themselves online. So much social science research tends to use just Twitter, or just Facebook, to draw conclusions. It is important to understand how your data set might be skewed,” she says.

      Walk’s current research focuses on another novel way to tap social media. Scholars traditionally use geographic data to understand population movements, but her research has demonstrated that social media can also be a ripe data source. She is analyzing how social media discussions differ in places with and without refugees, with a particular focus on places where refugees have returned to their homelands, including Syria.

      “Now that the [Syrian] civil war has been going on for so long, there is a lot of discussion on how to bring refugees back in [to their homelands],” Walk says. Her research adds to this discussion by using social media sources to understand and predict the factors that encourage refugees to return, such as economic opportunities and decreases in local violence. Her goal is to harness some of the social media data to provide policymakers and nonprofits with information on how to address repatriation and related issues.

      Walk attributes much of her growth as a graduate student to the influence of collaborators, especially Professor Kiran Garimella at Rutgers’ Department of Library and Information Science. “So much of being a graduate student is feeling like you have a stupid question and figuring out who you can be vulnerable with in asking that stupid question,” she says. “I am very lucky to have a lot of those people in my life.”

      Encouraging the next generation

      Now, as a third-year student, Walk is the one whom others go to with their “stupid questions.” This desire to mentor and share her knowledge extends beyond the laboratory. “Something I discovered is that I really like talking to and advising people who are in a similar position to where I was. It is fulfilling to work with smart people close to my age who are just trying to figure out the answers to these meaty life issues that I have also struggled with,” she says.

      This realization led Walk to a position as a resident advisor at Harvard University’s Mather House, an undergraduate dormitory and community center. Walk became a faculty dean aide during her first year at MIT, and since then has served as a full-time Mather House resident tutor. “Every year I advise a new class of students, and I just become invested in their process. I get to talk to people about their lives, about their classes, about what is making them excited and about what is making them sad,” she says.

      After she graduates, Walk plans to explore issues that have a positive, tangible impact on policy outcomes and people, perhaps in an academic lab or in a nonprofit organization. Two such issues that particularly intrigue her are internet access and privacy for underserved populations. Regardless of the issues, she will continue to draw from both political science and data science. “One of my favorite things about being a part of interdisciplinary research is that [experts in] political science and computer science approach these issues so differently, and it is very grounding to have both of those perspectives. Political science thinks so carefully about measurement, population selection, and research design … [while] computer science has so many interesting methods that should be used in other disciplines,” she says.

      No matter what the future holds, Walk already has a sense of contentment. She admits that “my path was much less linear than I expected. I don’t think I even realized that a field like this existed.” Nevertheless, she says with a laugh, “I think that little-girl me would be very proud of present-day me.” More