Researchers use neural networks to turn face sketches into photos

Researchers use neural networks to turn face sketches into photos

Researchers use neural networks to turn face sketches into photos

We all have a soft spot for Prisma, the app that turns smartphone photos into stylized artwork. But the reverse process — transforming artwork into pictures — is no less fascinating. And it’s not far from becoming real, researchers in the Netherlands said.

A team of four neuroscientists at Radboud University is working on a model for inverting face sketches to synthesize photorealistic face images by using deep neural networks. The results of the study (Convolutional Sketch Inversion) were first made available in the online archive arXiv and have recently been accepted at the European Conference on Computer Vision in Amsterdam.

Scientists said applications of their model could include fine arts, for turning self-portraits into something more akin to a photo, but also in forensics, for turning sketches based on eyewitness accounts into something a photo-recognition tool could use, for example.

“We were inspired by the recent work on neural style transfer, an algorithm to reimagine photos in the style of artworks,” Yağmur Güçlütürk, 29 and Umut Güçlü, 30, the two PhD students in cognitive neuroscience who developed the study together with Marcel van Gerven and Rob van Lier, wrote in an email to TechCrunch.

Read Also:
Governed Insight: The Power of MDM and Analytics

The article Yağmur and Umut referred to described a technique to reimagine a photo of the city of Tübingen, Germany, in the style of The Starry Night, the oil on canvas painting by Vincent van Gogh. “This example got us thinking about its inverse problem. That is, what the artworks of Vincent van Gogh would look like as photos,” Güçlütürk and Güçlü wrote.

Here is how Güçlütürk and Güçlü describe how their software, which uses an artificial neural network, works:

“Let’s say that I, scientist, want to teach you, artificial neural network, how to convert sketches (inputs) to photos (outputs).

 



Chief Analytics Officer Europe

25
Apr
2017
Chief Analytics Officer Europe

15% off with code 7WDCAO17

Read Also:
IoT success depends on data governance, security and privacy

Chief Analytics Officer Spring 2017

2
May
2017
Chief Analytics Officer Spring 2017

15% off with code MP15

Read Also:
Venture investors should embrace data over instinct

Big Data and Analytics for Healthcare Philadelphia

17
May
2017
Big Data and Analytics for Healthcare Philadelphia

$200 off with code DATA200

Read Also:
6 Keys to Big Data Victory
Read Also:
Like a gym membership, data has no value unless you use it

SMX London

23
May
2017
SMX London

10% off with code 7WDATASMX

Read Also:
Google Buys Machine Learning Startup Moodstocks

Data Science Congress 2017

5
Jun
2017
Data Science Congress 2017

20% off with code 7wdata_DSC2017

Read Also:
Increased Awareness of the Value of Data Science

Leave a Reply

Your email address will not be published. Required fields are marked *