Incremental Notes on GANs

draft

So there are a variety of things I have learned about GANs in the last few weeks.  

1. I am limited by my GPU memory.  The more memory you have, the more you can fit into the GPU, the larger the batch size.  A batch size of 6 may have very different results from a batch size of 2, or a batch size of 50.

2. It is only the GPU (in my case a 1080 with 8 GB memory) that makes this at all practical or possible.  I have 8/16 pretty good processors here and they can run for 10 minutes and not do a single batch, whereas the GPU can do a batch in 60 seconds or less.

3. 256 resolution is much more practical than 512 resolution.

4. It is not at all clear whether GANs can do any of the simplistic projects I wanted to do with galaxies, nebulae or march posters.

5. With the simplistic test patterns, at least 150,000 samples are required.