Skip to content

willdalh/generative-modeling-projects

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

32 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Generative modeling projects

Repository for presenting results from projects in generative modeling.

3D Minecraft Steve

For this project, I utilized my gan-kit. I experimented with a self-made dataset consisting of different perspectives of Steve because I was curious to see how interpolations between two arbitrary latent vectors would create an animation. For models trained on faces, interpolations between two latent vectors will generate a smooth transition as seen here.

Dataset

I created the dataset by importing a 3D-model of Steve into Unity and creating a script that would revolve around the model and capture images from different angles. A subset of the dataset is visualized below, with rescaling applied and colors removed.

Generating perspectives of Steve

With a trained model, I generate different perspectives using arbitrary latent vectors.

The generator quickly learnt that it is not necessary to create images showing Steve's face, as it is more detailed than the back of his head, and that the discriminator would still accept these. Therefore, most inputs will result in images showing the back of Steve.

Generating animations

The three GIFs below shows how interpolating between latent vectors simulates a rotation animation.

An interesting effect occured where a certain point between two vectors would switch the direction the model faces. This can be seen in the two GIFs below.

Switch front to back Switch back to front

Pokémon Sprites

This was my first attempt at Generative Adversarial Networks. All models would fail after some training due to mode collapse.

About

Small projects in generative modeling

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages