Hello, whether there is a leak or not you are still not allowed to use the field id as a feature. It will not be useful to the client nor is it good data science skills.
Yes, this is still an interesting insight (For learning purposes though). I noticed that fields (both train and test) that are present in the same chip have sequential ids (1, 2, 3, ...4). So the model might have learned to cluster field ids from the label in the train set.
'%3e%3ccircle r='20' fill='%23008'/%3e%3ccircle r='17.5' fill='%23fff'/%3e%3ccircle r='3.5' fill='%23008'/%3e%3cg id='d'%3e%3cg id='c'%3e%3cg id='b'%3e%3cg id='a' fill='%23008'%3e%3ccircle r='.875' transform='rotate(7.5 -8.75 133.5)'/%3e%3cpath d='M0 17.5.6 7 0 2l-.6 5L0 17.5z'/%3e%3c/g%3e%3cuse xlink:href='%23a' transform='rotate(15)'/%3e%3c/g%3e%3cuse xlink:href='%23b' transform='rotate(30)'/%3e%3c/g%3e%3cuse xlink:href='%23c' transform='rotate(60)'/%3e%3c/g%3e%3cuse xlink:href='%23d' transform='rotate(120)'/%3e%3cuse xlink:href='%23d' transform='rotate(-120)'/%3e%3c/g%3e%3c/svg%3e)
What do you mean (data leak)?
Hello, whether there is a leak or not you are still not allowed to use the field id as a feature. It will not be useful to the client nor is it good data science skills.
Thank u.
this is exactly what I meant,in real world it means nothing but i found out that using it improves the score.
Yes, this is still an interesting insight (For learning purposes though). I noticed that fields (both train and test) that are present in the same chip have sequential ids (1, 2, 3, ...4). So the model might have learned to cluster field ids from the label in the train set.
hmm smart