Overview: Generally speaking, Variational Inference(VI) is a specific Statistical inference method that attempts to find the best tractable distribution to replace the intractable distribution when the unknown density function is intractable. In this way, a typical inference problem can be converted to a typical optimization problem. The best tractable distribution we look for is theContinue reading “The simplest way to understand Variational Inference”

# Category Archives: Analytics & Statistics

## My new paper: Anomaly Detection based on LDA, Autoencoder and GMM

Recently my team has finished a paper about Anomaly Detection. We proposed a novel unsupervised Anomaly Detection model (LAG) based on LDA, Autoencoder, and GMM. Our model can be used on both structured and unstructured data and provides a comprehensive solution for various Anomaly Detection tasks in different industries. Particularly, we provide a way toContinue reading “My new paper: Anomaly Detection based on LDA, Autoencoder and GMM”

## Shape Data for RNN by a single function

When we attempt to construct an RNN model in the Tensorflow. We will always come across a task that is reshaping the data to meet the input format of the RNN model. This step is essential but a little confusing. To simplify the work of reshaping data for RNN, I develop an RNN sample generatorContinue reading “Shape Data for RNN by a single function”

## The simplest way to understand SVM

Recently, many friends asked me how to understand SVM intuitively. They were confused by the complicated mathematical formulas. Today I will thoroughly explain what is SVM through eight questions. For those who need to know the mathematical proofs, please refer to the appendix below. Q1: How to understand SVM most intuitively？ Ans1: Firstly, take aContinue reading “The simplest way to understand SVM”

## Suspicious customer detection with LDA + Auto-Encoder part1

Suspicious customer detection is one of the applications of Fraud Detection or Anomaly Detection. There are many data-driven approaches in this area. This blog will introduce a very novel approach as a good alternative solution for suspicious customer detection: LDA + Auto-Encoder. Different business units or business lines have different perspectives to detect anomaly customers.Continue reading “Suspicious customer detection with LDA + Auto-Encoder part1”