I think the larger issue is eventually the models might 'think' by passing massive matrices of floating point numbers around and there's basically no hope of decoding those.