Click here to Skip to main content
15,867,686 members
Articles / Artificial Intelligence / Keras
Article

Deep Learning in C#: Coin Recognition in Keras.NET, Part II

Rate me:
Please Sign up or sign in to vote.
5.00/5 (3 votes)
6 Nov 2020CPOL3 min read 11K   257   5   2
In this article we will examine the CNN we implemented for coin recognition using Keras.NET.
Here we introduce the code of the architecture presented in the previous article, and we will examine another architecture that would require more than an ordinary CPU to be trained accurately.

To start, let’s download the Keras.NET package from the Nuget package manager. We can find the Nuget package manager in Tools > Nuget package manager. Keras.NET relies on the packages Numpy.NET and pythonnet_netstandard. In case they are not installed, let’s go ahead and install them.

Image 1

It is important to point out here that Keras.NET requires a version of Python 2.7-3.7 to be installed in your operating system. It also requires the Python libraries Numpy and TensorFlow to be installed. In this example, we have used Python 3.7 64-bit.

If you encounter any issues while executing the code in this article, try running the following code once at the beginning of the execution of the main method in your ConsoleApplication. This code will set up the environment variables you need so that all DLLs are found:

C#
private static void SetupPyEnv()
        {
            string envPythonHome = @"C:\Users\arnal\AppData\Local\Programs\Python\Python37\";
            string envPythonLib = envPythonHome + "Lib\\;" + envPythonHome + @"Lib\site-packages\";
            Environment.SetEnvironmentVariable("PYTHONHOME", envPythonHome, EnvironmentVariableTarget.Process);
            Environment.SetEnvironmentVariable("PATH", envPythonHome + ";" + envPythonLib + ";" + Environment.GetEnvironmentVariable("PATH", EnvironmentVariableTarget.Machine), EnvironmentVariableTarget.Process);
            Environment.SetEnvironmentVariable("PYTHONPATH", envPythonLib, EnvironmentVariableTarget.User);
           
            PythonEngine.PythonHome = envPythonHome;
            PythonEngine.PythonPath = Environment.GetEnvironmentVariable("PYTHONPATH");
        }

We will see now how easy and transparent it is to create our CNN for coin recognition using Keras.NET. The following class shows our Cnn class containing all the logic of the model.

C#
public class Cnn
    {
        private DataSet _dataset;
        private Sequential _model;

        public Cnn(DataSet dataset)
        {
            _dataset = dataset;
            _model = new Sequential();
        }

        public void Train()
        {
            // Build CNN model
            _model.Add(new Conv2D(32, kernel_size: (3, 3).ToTuple(),
                                 padding: Settings.PaddingMode,
                                 input_shape: new Shape(Settings.ImgWidth, Settings.ImgHeight, Settings.Channels)));
            _model.Add(new Activation(Settings.ActivationFunction));
            _model.Add(new Conv2D(32, (3, 3).ToTuple()));
            _model.Add(new Activation(Settings.ActivationFunction));
            _model.Add(new MaxPooling2D(pool_size: (2, 2).ToTuple()));
            _model.Add(new Dropout(0.25));

            _model.Add(new Conv2D(64, kernel_size: (3, 3).ToTuple(),
                                padding: Settings.PaddingMode));
            _model.Add(new Activation(Settings.ActivationFunction));
            _model.Add(new Conv2D(64, (3, 3).ToTuple()));
            _model.Add(new Activation(Settings.ActivationFunction));
            _model.Add(new MaxPooling2D(pool_size: (2, 2).ToTuple()));
            _model.Add(new Dropout(0.25));

            _model.Add(new Flatten());
            _model.Add(new Dense(Settings.FullyConnectedNodes));
            _model.Add(new Activation(Settings.ActivationFunction));
            _model.Add(new Dropout(0.5));
            _model.Add(new Dense(_dataset.NumberClasses));
            _model.Add(new Softmax());
            
            _model.Compile(loss: Settings.LossFunction,
              optimizer: Settings.Optimizer, 
              metrics: new string[] { Settings.Accuracy });
            
            _model.Fit(_dataset.TrainX, _dataset.TrainY,
                          batch_size: Settings.BatchSize,
                          epochs: Settings.Epochs,
                          validation_data: new NDarray[] { _dataset.ValidationX, _dataset.ValidationY });

            var score = _model.Evaluate(_dataset.ValidationX, _dataset.ValidationY, verbose: 0);
            Console.WriteLine("Test loss:" + score[0]);
            Console.WriteLine("Test accuracy:" + score[1]);
        }

        public NDarray Predict(string imgPath)
        {
            NDarray x = Utils.Normalize(imgPath);
            x = x.reshape(1, x.shape[0], x.shape[1], x.shape[2]);
            return _model.Predict(x);
        }
    }

As we can see, we first have a constructor where we receive the dataset (imported and processed during the second article of this series) and create a new instance of the Sequential class stored in the private variable _model. What is Sequential? It is an empty model that gives us the possibility of stacking layers, which is precisely what we need.

Then, in the Train method, we first create our stack of layers as described in the architecture presented in the previous article, and then compile the model and call the fit method to begin training. The loss function used is categorical_crossentropy. What is a loss function? It is the function we use to optimize our learning process, that is, we either minimize it or maximize it. The one in charge of minimizing the loss function is the optimizer — an algorithm that changes the weights and learning rate of our network to minimize the loss.

At the end, the model is evaluated using the validation dataset. Another method is Predict, which as the name suggests predicts the label of new incoming data. This method should be called once training has been finalized. Starting the training phrase is as simple as running the following:

C#
var cnn = new Cnn(dataSet);
cnn.Train();

Let’s see the results obtained during training in the coin recognition problem that we are going through in this series:

Image 2

We can see that we were able to reach 100% accuracy during training.

In the case of the prediction method, its output will be an NDarray containing the probability of the object or image belonging to one of the classes used to train the CNN.

So, what would be an architecture that would require a GPU instead of a CPU? AlexNet architecture, for example, includes five convolutional layers and three fully connected layers, along with pooling and activation layers. This type of deep CNN performs better on a GPU due to its complexity. The general rule is that the more layers you add, the more complicated calculations on the weights will be.

After seeing how to code your own CNN, we will move to the area of pre-trained models. More on this in the next article!

This article is part of the series 'Deep Learning in C# View All

License

This article, along with any associated source code and files, is licensed under The Code Project Open License (CPOL)


Written By
Software Developer
Serbia Serbia
Computer Scientist and book author living in Belgrade and working for a German IT company. Author of Practical Artificial Intelligence: Machine Learning, Bots, and Agent Solutions Using C# (Apress, 2018) and PrestaShop Recipes (Apress, 2017). Lover of Jazz and cinema Smile | :)

Comments and Discussions

 
QuestionPleased to report success! Pin
asiwel13-Jan-21 18:13
professionalasiwel13-Jan-21 18:13 
Hi, Arnaldo. Initially I had no difficulty running the first article in this series showing the coin pictures. However, until just recently, I could not (figure out how to) run the Keras.Net ML code. This turned out not to be a problem with your articles, but rather a wicked little bug apparently in Windows itself. Here is the link to the extensive Visual Studio Developer Forum discussion of that issue.

sanity checks and Numpy and Keras problems[^]

In any event, apparently that has now been fixed in a Windows or Numpy update (not sure which). Your code runs nicely now and is an excellent demonstration. So I am pleased to give you and this whole series of articles a +5 star rating and a Thank You.
QuestionThanks for help Pin
Member 149888169-Nov-20 22:05
Member 149888169-Nov-20 22:05 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.