Search

Home > Machine Learning Guide > 27. Hyperparameters 1
Podcast: Machine Learning Guide
Episode:

27. Hyperparameters 1
Category: Technology
Duration: 00:46:09
Publish Date: 2018-01-27 21:28:12
Description:

## Episode

- Hypers future & meta-learning ** We're always removing hypers. DL removed feature-engineering ` - Model selection ** Unsupervised? K-means Clustering => DL ** Linear? Linear regression, logistic regression ** Simple? Naive Bayes, Decision Tree (Random Forest, Gradient Boosting) ** Little data? Boosting ** Lots of data, complex situation? Deep learning - Network ** Layer arch ** Vision? CNN ** Time? LSTM ** Other? MLP ** Trading LSTM => CNN decision ** Layer size design (funnel, etc) ** Face pics ** From BTC episode ** Don't know? Layers=1, Neurons=mean(inputs, output) https://stats.stackexchange.com/a/1097/107199 - Activations / nonlinearity https://towardsdatascience.com/activation-functions-neural-networks-1cbd9f8d91d6 ** Output ** Sigmoid = predict probability of output, usually at output ** Softmax = multi-class ** Nothing = regression ** Relu family (Leaky Relu, Elu, Selu, ...) = vanishing gradient (gradient is constant), performance, usually better ** Tanh = classification between two classes, mean 0 important
Total Play: 6

Users also like

200+ Episodes
Data Science .. 300+     20+
300+ Episodes
Revolutions 2K+     50+
2 Episodes
Anxiety & De .. 20+    
100+ Episodes
Fisicast 800+     60+