CNN that generate a new image from input image

There are several options but basically the same way that you have one input for every pixel you must have one output from every pixel in the output image.

  • In MLPs you must have the same neurons in the input layer than in the output layer.

  • In CNNs you can also have at the beginning convolutional layers and after that deconvolutional layers.

  • Take a look at this paper (it is awesome) to create very realistic images from other images (for example satellite and map views in google maps). It is a neural network that is trying to solve the problem and also trying to create images that other neural network is not capable to distinguish from real images (it also have the source code available):

https://phillipi.github.io/pix2pix/