Some thoughts on entropy in AI image generation

There has been an intense debate about image generation within the last weeks, after the technology has been made publicly available. After several proprietary programs have offered limited free tiers for some time, with stable diffusion an open-source model was published this August. One popular discussion has been the question, if the created images really can be compared to images created by human creativity. I don’t want to get into this discussion here. Rather my question is, what would happen in a next step: At the moment we talk about AI produced images as the output of the programs and deep learning models. But what happens if they become part of the very image databases the models are trained on? What if the AI generated images are fed back into the models for image generation? My hypothesis is, that this will produce entropy in the image generation process which, in the long run, will tend towards ever more noise.

Continue reading “Some thoughts on entropy in AI image generation”