Identifying and Mitigating the Security Risks of Generative AI

Identifying and Mitigating the Security Risks of Generative AI” by Clark Barrett, Brad Boyd, Elie Bursztein, Nicholas Carlini, Brad Chen, Jihye Choi, Amrita Roy Chowdhury, Mihai Christodorescu, Anupam Datta, Soheil Feizi, Kathleen Fisher, Tatsunori Hashimoto, Dan Hendrycks, Somesh Jha, Daniel Kang, Florian Kerschbaum, Eric Mitchell, John Mitchell, Zulfikar Ramzan, Khawaja Shams, Dawn Song, Ankur Taly, and Diyi Yang. Foundations and Trends in Privacy and Security, vol. 6, no. 1, 2023, pp. 1-52, now publishers inc..


Every major technical invention resurfaces the dual-use dilemma — the new technology has the potential to be used for good as well as for harm. Generative AI (GenAI) techniques, such as large language models (LLMs) and diffusion models, have shown remarkable capabilities (e.g., in-context learning, code-completion, and text-to-image generation and editing). However, GenAI can be used just as well by attackers to generate new attacks and increase the velocity and efficacy of existing attacks. This monograph reports the findings of a workshop held at Google (co-organized by Stanford University and the University of Wisconsin-Madison) on the dual-use dilemma posed by GenAI. This work is not meant to be comprehensive, but is rather an attempt to synthesize some of the interesting findings from the workshop. We discuss short-term and long-term goals for the community on this topic. We hope this work provides both a launching point for a discussion on this important topic as well as interesting problems that the research community can work to address.

BibTeX entry:

   author = {Clark Barrett and Brad Boyd and Elie Bursztein and Nicholas
	Carlini and Brad Chen and Jihye Choi and Amrita Roy Chowdhury and
	Mihai Christodorescu and Anupam Datta and Soheil Feizi and
	Kathleen Fisher and Tatsunori Hashimoto and Dan Hendrycks and
	Somesh Jha and Daniel Kang and Florian Kerschbaum and Eric
	Mitchell and John Mitchell and Zulfikar Ramzan and Khawaja Shams
	and Dawn Song and Ankur Taly and Diyi Yang},
   title = {Identifying and Mitigating the Security Risks of Generative AI},
   journal = {Foundations and Trends in Privacy and Security},
   volume = {6},
   number = {1},
   pages = {1--52},
   publisher = {now publishers inc.},
   year = {2023},
   issn = {2474-1558},
   doi = {10.1561/3300000041},
   url = {}

(This webpage was created with bibtex2web.)