Questions tagged [lightgbm]
6 questions
3
votes
1 answer
Any reasons to prefer neural networks over boosting methods in tabular data?
Based on Kaggle winners data, it seems that ensemble boosting methods like XGBOOST, LIGHTGBM, CATBOOST are the top choices when dealing with structured or tabular data for maximizing the prediction accuracy. However, in industry as far as I know,…
mhsnk
- 118
- 7
2
votes
1 answer
Why can EFB(Exclusive Feature Bundling) works in lightGBM?
As I know, EFB can help you to decrease features which are sparse. They put two features together and add offset every feature in feature bundles. They combine features into same histogram.
After creating histogram, how can it works when finding the…
ChrisChu
- 21
- 2
1
vote
0 answers
How to tune LightGBM parameters to overcome underfitting?
I'm using LightGBM for a regression task. My training data's shape is (2000000, 1600), which means the number of training data is 2 million +, and each sample has 1600 features. The figure below is the scatter plot of my trained model's predictions…
Yuhua Wei
- 11
- 1
0
votes
0 answers
What's the difference between combined pos_bagging_fraction and neg_bagging_fraction vs is_unbalance vs scale_pos_weight in LightGBM?
Let's suppose a binary classification task and an unbalanced dataset (10% of positive records). I am using LightGBM and would like to better understand the difference between the combined pos_bagging_fraction and neg_bagging_fraction vs is_unbalance…
guiotan
- 33
- 5
0
votes
0 answers
Predictor With Lower Mean Absolute Error Ends Up Worse
I have been recently working on a problem to estimate the ETAs of vehicles using ensemble techniques such as LightGBM. As expected, the distance taken by the vehicle's route to its destination is a powerful predictor, however this can only be…
James Balajan
- 51
- 1
0
votes
0 answers
Why is the Hessian of RegressionL1Loss set to 1 in LightGBM
I'm reading this code snippet related to RegressionL1loss implementation in LightGBM
void GetGradients(const double* score, score_t* gradients,
score_t* hessians) const override {
if (weights_ == nullptr) {
#pragma…
zyxue
- 847
- 6
- 21