Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

2
Removing correlated features
Post Body

Hi everyone, I dont' know if this is the correct subreddit for this question, but in case let me know where i should post.

I am facing a regression task where I have to predict the price of some diamonds using a tabular dataset. I know that highly correlated features need to be removed and I noticed that 4 features, namely "carat", "x", "y" and "z", have correlation above 0.9. The problem is the performance of the model. If I keep all variables, I get a mean squared error of 702188 , If I keep only one of the three, I get 3107246 . I am using a PoissonRegressor(alpha=0.001, max_iter=5000) because the target variable has mean equal to the standard deviation. I really don't understand why my model has this behaviour, do you have any idea? Thanks for any help

Author
Account Strength
60%
Account Age
3 years
Verified Email
Yes
Verified Flair
No
Total Karma
155
Link Karma
126
Comment Karma
29
Profile updated: 3 days ago
Posts updated: 7 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
7 months ago