Generative adversarial networks, the algorithms responsible for deepfakes, have developed a bit of a bad rap of late. But their ability to synthesize highly realistic images could also have important benefits for medical diagnosis.
Deep-learning algorithms are excellent at pattern-matching in images; they can be trained to detect different types of cancer in a CT scan, differentiate diseases in MRIs, and identify abnormalities in an x-ray. But because of privacy concerns, researchers often don’t have enough training data. This is where GANs come in: they can synthesize more medical images that are indistinguishable from the real ones, effectively multiplying a data set to the necessary quantity.
There is another challenge, though. Deep-learning algorithms need to train on high-resolution images to produce the best predictions, yet synthesizing such high-res images, especially in 3D, takes a lot of computational power. That means it requires special and expensive hardware, making its large-scale use impractical in hospitals.
So researchers from the Institute of Medical Informatics at the University of Lübeck proposed a new approach to make the process much less intensive. They broke it up into stages: the GAN first generates the whole image in low-res, then generates the details at the right resolution one small section at a time. Through experiments, the researchers showed not only that their method generated realistic high-res 2D and 3D images with low computational resources, but that the expenditure also stayed constant regardless of image size.
To have more stories like this delivered directly to your inbox, sign up for our Webby-nominated AI newsletter The Algorithm. It's free.
Geoffrey Hinton tells us why he’s now scared of the tech he helped build
“I have suddenly switched my views on whether these things are going to be more intelligent than us.”
ChatGPT is going to change education, not destroy it
The narrative around cheating students doesn’t tell the whole story. Meet the teachers who think generative AI could actually make learning better.
Deep learning pioneer Geoffrey Hinton has quit Google
Hinton will be speaking at EmTech Digital on Wednesday.
We are hurtling toward a glitchy, spammy, scammy, AI-powered internet
Large language models are full of security vulnerabilities, yet they’re being embedded into tech products on a vast scale.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.