Researchers use neural networks to turn face sketches into photos

Researchers use neural networks to turn face sketches into photos

Researchers use neural networks to turn face sketches into photos

We all have a soft spot for Prisma, the app that turns smartphone photos into stylized artwork. But the reverse process — transforming artwork into pictures — is no less fascinating. And it’s not far from becoming real, researchers in the Netherlands said.

A team of four neuroscientists at Radboud University is working on a model for inverting face sketches to synthesize photorealistic face images by using deep neural networks. The results of the study (Convolutional Sketch Inversion) were first made available in the online archive arXiv and have recently been accepted at the European Conference on Computer Vision in Amsterdam.

Scientists said applications of their model could include fine arts, for turning self-portraits into something more akin to a photo, but also in forensics, for turning sketches based on eyewitness accounts into something a photo-recognition tool could use, for example.

“We were inspired by the recent work on neural style transfer, an algorithm to reimagine photos in the style of artworks,” Yağmur Güçlütürk, 29 and Umut Güçlü, 30, the two PhD students in cognitive neuroscience who developed the study together with Marcel van Gerven and Rob van Lier, wrote in an email to TechCrunch.

Read Also:
Fresh New Features for Teradata in the Cloud

The article Yağmur and Umut referred to described a technique to reimagine a photo of the city of Tübingen, Germany, in the style of The Starry Night, the oil on canvas painting by Vincent van Gogh. “This example got us thinking about its inverse problem. That is, what the artworks of Vincent van Gogh would look like as photos,” Güçlütürk and Güçlü wrote.

Here is how Güçlütürk and Güçlü describe how their software, which uses an artificial neural network, works:

“Let’s say that I, scientist, want to teach you, artificial neural network, how to convert sketches (inputs) to photos (outputs).

 



Sentiment Analysis Symposium

27
Jun
2017
Sentiment Analysis Symposium

15% off with code 7WDATA

Read Also:
What CIOs need to know about containers

Data Analytics and Behavioural Science Applied to Retail and Consumer Markets

28
Jun
2017
Data Analytics and Behavioural Science Applied to Retail and Consumer Markets

15% off with code 7WDATA

Read Also:
Elon Musk and Google Want You to Make Their Artificial Intelligence Smarter
Read Also:
Beyond Acronyms: Humanizing Big Data and Information Governance through Mindful Storytelling

AI, Machine Learning and Sentiment Analysis Applied to Finance

28
Jun
2017
AI, Machine Learning and Sentiment Analysis Applied to Finance

15% off with code 7WDATA

Read Also:
Data Lakes are Growing Up

Real Business Intelligence

11
Jul
2017
Real Business Intelligence

25% off with code RBIYM01

Read Also:
Don't use the cloud like a data warehouse

Advanced Analytics Forum

20
Sep
2017
Advanced Analytics Forum

15% off with code Discount15

Read Also:
Fresh New Features for Teradata in the Cloud

Leave a Reply

Your email address will not be published. Required fields are marked *