what make lightGBM run faster than XGBoost?

Data Science Asked on January 4, 2022

I am curious on what differences in implementation allow speed up of lightGBM over XGBoost, some times up to magnitude of orders.

One Answer

First of all both the GBM methods are great and superiority of each algorithm is dependent on the data.

Major Differences between the two is that LightGBM uses a novel technique of Gradient-based One-Side Sampling (GOSS) to filter out the data instances for finding a split value while XGBoost uses pre-sorted algorithm & Histogram-based algorithm for computing the best split.

GOSS assumes that data points with small gradients tend to be more well trained. This means that it is more efficient to concentrate on data points with larger gradients.To attenuate the problem of biased sample it also randomly samples from data with small gradients.

To read more you can refer:

Answered by prashant0598 on January 4, 2022

Add your own answers!

Related Questions

Padding instead of deconvolution in FCN

0  Asked on March 9, 2021 by mykhailo-bichurin


build biased image dataset for emotion analysis

1  Asked on March 9, 2021 by josselin-tobelem


SAP DI: Ml Scenario Manager – Git

1  Asked on March 8, 2021 by jkortner


Linear Regression Model Validation with Transformed Data

0  Asked on March 8, 2021 by taku-charles-noel-endo


model tuning by using loss curves

0  Asked on March 7, 2021


Ask a Question

Get help from others!

© 2023 All rights reserved. Sites we Love: PCI Database, MenuIva, UKBizDB, Menu Kuliner, Sharing RPP, SolveDir