Skip to content

Supervised learning

train using qusetion-answer pairs.

Generalized linear model https://www.bilibili.com/video/BV13X4y1R7im

Regression

Linear regression y=wx+bJ=(yy)2n

Logistic regression z=wx+by=11+ez Log Loss

Classification

A example usually contains features and a label. Feature indicates question, label indicates answer.

Parameters control predicting, hyperparameters control training.

  • Learning rate
  • Batch size: the number of examples used to update parameters once.
  • Epochs: an epoch means that every example have been used once.
Metric
AccuracyTP+TNALL
TPR, RecallTPTP+FN
FPRFPFP+TN
PrecisionTPTP+FP

Unsupervised learning

train using questions only.

clustering


Numerical data

  • Clear
  • Normalization

Categorical data