If you haven’t read the round 1 and round 2 articles yet, I recommend you check it out before you start reading this article. If you already read round one and two, let’s get started.

Introduction

This week I was researching a lot the implementation of a reinforcement learning algorithm to train the agent for the game. So after reading some articles, forums and documentation, I confirmed that what I need to implement is Deep Q learning algorithm.

Deep Q learning pseudocode

Based on this article called Playing Atari with Deep Reinforcement Learning, the algorithm looks like the following:

If you haven’t read the round 1article yet, I recommend you check it out before you start reading this article. If you already read round one, let’s get started.

Introduction

After discussing my ideas for this project a bit on Reddit, some fellows told me that Google Colab supports JavaScript code in the environment by using ijavascript kernel. So it’s not necessary to migrate the game environment code to Python. The only drawback with this approach is that the use of GPUs and TPUs is not optimized so well for JavaScript.

This is a starting point of a series about an adventure I want to share. This article explores an idea that came to my mind the last week and that I’m researching about. The idea is to create an expert AI player of Mortal Kombat based on reinforcement learning techniques.

Note: On this series of articles I will carry out some research about something that, in my own view, it could work. So if you came here searching for answers, this is the wrong place, here we will find questions, many of them.

Introduction

I came out with this idea after…

The power of deep learning architectures and the handy Tensorflow.js library allows us to create interesting applications that change the way we interact with computers. In this case, we use a pose estimation neural network to create a virtual steering wheel based on the position of the wrists.

Introduction

In this project I will show an example of integration between web applications and deep learning models to transfer the application controls from the mouse and keyboard to the human body.

In this case, I created a virtual steering wheel to drive a vehicle on a highway.

The growth of processing power in devices and Machine learning allows us to create new solutions that a few years ago couldn’t have been achieved. In this case, I want to show an interesting way to perform authentication using Flutter and Tensorflow Lite with face recognition.

Introduction

I will explain step by step, how is the process of building a fairly simple facial recognition app that contains 3 functionalities: Sign Up, Sign In and Clear DB.

Process summary

Sign up

1. The user takes a photo.
2. The ML models process it and create an output (array of numbers) to be stored in a database.
3. A name…

In recent years, the interaction in Twitter has become increasingly toxic with the rise of hate speech, harassment and offensive content. In this article, I want to explain how to build a simple toxic tweet detector, using twitter API and tensorflow.js.

Introduction

In this post I want to show step by step how to build a web application that shows the last toxic tweets and retweets from the given user.

The application will receive 2 parameters: tweets to search and username.

• Tweets to search: the number of tweets that we want to bring from the twitter API to be analyzed (10…

Edge devices, such as smartphones, have become more powerful with the passing of time and enabled an increasing number of on-device machine learning use cases.

What is Tensorflow?

TensorFlow is a platform for building and training neural networks, which allow detecting and deciphering patterns and correlations, analogous to the learning and reasoning used by humans.
TensorFlow’s flexible architecture enables developers to deploy computation to one or more CPUs or GPUs on desktops, servers, or mobile devices with a single API. …

Cascading Style Sheets, better known by its acronym CSS, is a language used to display the design elements of a web page, which generally must be defined separately.

Why is CSS loading performance important?

HTML and XML documents contain information only about the content or semantics of some of the components of a website, while design resources are found separately in so-called CSS files. If Stylesheets are used, the server has to access them (where multimedia content such as photos, videos, etc. is stored) each time the web is visited, which clearly has an impact on load times. The larger and more complex the CSS files…