hahadsg's note

Follow me on GitHub

GBM对比

参考:https://www.kaggle.com/nschneider/gbm-vs-xgboost-vs-lightgbm

Tree Traverse

level-wise

逐层的生长(类似BFS),每次选取最优分割

leaf-wise(best-first)

选择对减少loss贡献最大的节点生长(类似DFS)

Decision Tree

gini and entropy: https://www.garysieling.com/blog/sklearn-gini-vs-entropy-criteria