At Tsinghua University in Beijing, China, all eyes are on Professor Yuanchun Shi. But it’s not the computer scientist’s lecture that’s so riveting-it’s how she’s giving it. One wall of her “smart classroom” displays photos of students at other universities across China who have logged in. Shi poses a question and calls on a remote student by shining a laser pointer on his photo. “Go ahead,” the teacher says. The student’s picture switches to live video and audio as he answers. Shi writes on a digital whiteboard that transmits her handwriting to the students’ computers, complementing audio and visual feeds from cameras and microphones.
Shi’s smart classroom is one of the most advanced in the world. Wide-scale testing is under way, and commercialization is planned, initially within China.
Until now, most smart classrooms for distance learning have required teachers to use desktop computers to run their classes. But this version allows Shi to lecture and interact with remote students more naturally, using speech, gestures, and handwriting. “They are certainly doing some interesting things that other people have done before in isolation but not together in an all-in-one package,” says Jason Brotherton, an expert in computer-enhanced education at University College London who is developing his own distance-learning classroom.
Shi’s classroom relies on some technological wizardry. In the back of the room, behind a curtain, is a rack of seven computers. Computer-vision algorithms coordinate eight video cameras that track the teacher’s movements, switching views as she points to a page in a textbook or writes on the whiteboard. The computers recognize the positions of her arms and zoom in on particular gestures. The system also tracks the trajectory of the laser pointer and responds to simple spoken commands. Remote students’ desktop computers are equipped with video cameras, microphones, and communication software to allow them to send and receive multimedia data.
Last summer, 180 students took part in a computer science course at Tsinghua, one of the country’s top technical schools, from their dorm rooms. And since last winter, hundreds of students in a half-dozen cities in China have joined the class. Now, working with Beijing MoVision Technologies, a multimedia telecom firm, Shi plans to commercialize the system’s software within a year. Her first customer: Tsinghua’s Continuing Education School, which could grant remote access to as many as 20,000 students.
LEADERS IN COMPUTER-ENHANCED EDUCATION
|Gregory Abowd, Georgia Institute of Technology |
|Multimedia technologies for recording and enhancing classroom lectures|
|Ron Baecker, University of Toronto |
|Web-based interactive audio and videoconferencing for universities|
|Jason Brotherton, University College London |
|Experimental classroom for enhanced distance learning|
|Yuanchun Shi, Tsinghua University |
|Smart classroom for interactive distance learning|
Capitalizing on machine learning with collaborative, structured enterprise tooling teams
Machine learning advances require an evolution of processes, tooling, and operations.
The Download: how to fight pandemics, and a top scientist turned-advisor
Plus: Humane's Ai Pin has been unveiled
The race to destroy PFAS, the forever chemicals
Scientists are showing these damaging compounds can be beat.
How scientists are being squeezed to take sides in the conflict between Israel and Palestine
Tensions over the war are flaring on social media—with real-life ramifications.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.