Automatic Classification of an online Fashion Catalogue: The Simple WayMiguel MéndezBlockedUnblockFollowFollowingFeb 15I have been working with Tensorflow during last months and I realized that, although there is a large number of Github repositories with many different and complex models, is hard to find a simple example that shows you how to obtain your own dataset from the web and apply some Deep Learning on it.
In this post I pretended to provide an example of this task but being keeping it as simple as possible.
I will show you how to obtain online unlabeled data, how to create a simple convolutional network, train it with some supervised data and use it later to classify the data we have gathered from the web.
All code can be found on my Github account:mmeendez8/garment-classifierA tensorflow network to classify garments.
github.
com1.
Data ScrapingIf you are close to Data Science world you probably have heard about the Fashion MNIST dataset.
It’s a super simple collection of 28×28 images consisting of a training set of 60,000 examples and a test set of 10,000 examples.
The data is associated with a label from 10 classes as Trouser, Pullover, Dress, Coat…Fashion MNISTSo the idea is simple, we train our network with the MNIST data and we use then to classify the data obtained from the actual Zalando’s catalogue.
Data scraping is a very important task if you are a Data Scientist.
Most of the time you will not have available the data you are looking for, so you will need to obtain it from the web.
The procedure is pretty simple if you know a little bit of HTML and CSS.
2.
Neural NetworkWe are going to classify small grey scaled images so we will not need a super complex architecture.
I basically stacked two convolutional layers with their correspondent pooling layer (check what Hinton thinks about Pool Layers).
After this a dense layer followed by a dropout operation and a final dense layer with a softmax function.
Classic and simple stuff!If you have problems understanding what that decorator is doing you can check my previous post: Generating fake FIFA 19 football players with Variational Autoencoders and Tensorflow or this amazing post from Danijar Hafner.
3.
Training the networkFor the training task I have used Adam Optimizer and let algorithm run for just 100 epochs.
You can apply longer and better training to improve the accuracy as much as you want and I would also recommend you to change the network structure adding some extra layers.
The training file allows you to observe how you accuracy and loss evolve with the number of epochs.
These were my results:Remember that when we train our model we must validate our data with a different dataset to avoid overfitting issues (between others).
In this case we can use Fashion MNIST test set!3.
Evaluate resultsOnce the network has been trained and saved, we can proceed to evaluate its performance with the scraped dataset.
Look at this code snippet:It’s pretty simple.
What I do in here is recovering the network and loading the unlabeled data.
I recover two important tensors which are the ones that I use to feed new data and to output the predictions of the network.
Finally I pass 5 different images to the network and this is what I get:Note that I did not show the whole process here, since the images we obtained from the web must be converted to 28×28 gray scale images before being inserted to the network, once more I encourage you to check the whole code on Github.
Well, that’s all we need to classify the unlabeled images we obtain from Zalando’s website.
You could use this to create a labeled dataset of images to train another different model or anything that you can think on!mmeendez8/garment-classifierA tensorflow network to classify garments.
github.
comAny ideas for future posts or is there something you would like to comment?.Please feel free to reach out on Github , Linkedin or my personal web.
.