[D] How to compute Ablation Study Neural Networks p-value?
Let me just first say that my knowledge of statistics is shit.
I want to conduct an ablation study of a deep neural network, whose task is on regression.
I want to compare the performance (MSE) of the neural network vs the neural network without a few layers. I see in literature that people often report if results achieved are less than a p-value, say 0.05 or something.
How would I measure this p-value? Would I be able to measure the p-value simply given the 2 MSEs of the 2 models?