In a pioneering study, a team from the University of North Carolina, Chapel Hill, has shed light on the pressing issue of data retention in large language models (LLMs) such as OpenAI’s ChatGPT and Google’s Bard.
Despite deletion attempts, the intricacies of these AI models continue to regurgitate sensitive data, stirring a severe conversation on information security and AI ethics.
The ‘Undeletable’ Data Conundrum
The researchers embarked on a quest to investigate the eradication of sensitive information from LLMs. However, they stumbled upon a revelation. Deleting such data is arduous, but verifying the deletion poses an equal challenge. Once trained on expansive datasets, these AI behemoths harbor the data within their complex maze of parameters and weights.
This predicament turns ominous when the AI models inadvertently spill out sensitive data, such as personal identifiers or financial records, potentially laying the groundwork for nefarious uses.
Researchers find LLMs like ChatGPT output sensitive data even after it’s been ‘deleted’ – https://t.co/P5QG8eGxwE
— ⚡️John The Collector⚡️ (@JohnTheCollectr) October 2, 2023
Moreover, the issue’s core resides in the design blueprint of these models. The preliminary phase involves training on vast databases and fine-tuning to ensure coherent outputs. The terminology “Generative Pretrained Transformer,” encapsulated in GPT, offers a glimpse into this mechanism.
The UNC scholars elucidated a hypothetical scenario where an LLM, having feasted on a trove of sensitive banking data, becomes a potential threat. The contemporary guardrails employed by AI developers fall short of assuaging this concern.
These protective measures, like hard-coded prompts or a paradigm known as Reinforcement Learning from Human Feedback (RLHF), play a vital role in curbing undesirable outputs. However, they still leave the data lurking within the abyss of the model, ready to be summoned with a mere rephrasing of a prompt.
Bridging The Security Gap
Despite deploying state-of-the-art model editing methods such as Rank-One Model Editing, the UNC team discovered that substantial factual information remained accessible. Their findings revealed that facts could be resurrected around 38% and 29% of the time through whitebox and blackbox attacks, respectively.
In their quest, the researchers utilized a model known as GPT-J. With its 6 billion parameters, it’s a dwarf compared to the colossal GPT-3.5, a base model for ChatGPT with 170 billion parameters. This stark contrast hints at the monumental challenge of sanitizing larger models like GPT-3.5 from unwarranted data.
Furthermore, the UNC scholars crafted new defense methods to shield LLMs from specific “extraction attacks.” These nefarious schemes exploit the model’s guardrails to fish out sensitive data. Nonetheless, the paper ominously hinted at a perpetual game of cat and mouse, where defensive strategies would forever chase the evolving offensive tactics.
Microsoft Delegates a Nuclear Team to Bolster AI
On a related note, the burgeoning realm of AI has propelled tech behemoths like Microsoft to venture into uncharted territories. Microsoft’s recent formation of a nuclear power team to bolster AI initiatives underscores the escalating demands and the intertwined future of AI and energy resources. As AI models evolve, their appetite for energy burgeons, paving the way for innovative solutions to satiate this growing demand.
Microsoft to form nuclear power team to support AI: Reporthttps://t.co/OvAGclfMnt#News #crypto #Bitcoin #machinelearning #Microsoft #news #Technology https://t.co/OvAGclfMnt
— Crypto Breaking News: Latest Crypto & Bitcoin News (@CryptoBreakNews) October 1, 2023
The discourse around data retention and deletion in LLMs transcends academic corridors. It beckons a thorough examination and an industry-wide dialogue to foster a robust framework that ensures data security while nurturing the growth and potential of AI.
This venture by the UNC researchers is a significant stride towards understanding and eventually solving the ‘undeletable’ data problem, a step closer to making AI a safer tool in the digital age.
and then