[R][BAIR] “we show that a generative text model trained on sensitive data can actually memorize its training data” – Nicholas Carlini
Evaluating and Testing Unintended Memorization in Neural Networks
Link: https://bair.berkeley.edu/blog/2019/08/13/memorization/
For example, we show that given access to a language model trained on the Penn Treebank with one credit card number inserted, it is possible to completely extract this credit card number from the model.
submitted by /u/downtownslim
[link] [comments]