What are the privacy risks of ChatGPT and Generative AI?

By Logan Lowe
Attorney

The Privacy Predicament: The Risks of Generative AI

What is ChatGPT and Generative AI?

Since its introduction in late 2022, there has been much discussion regarding AI chatbots, with ChatGPT at the forefront. But what is ChatGPT and generative AI? In short, ChatGPT is a natural language processing tool powered by AI; in practice, the platform responds to user prompts by utilizing machine learning and statistical data to arrange words in the order in which they are most likely to appear.

What are the applications of ChatGPT?

Given its diverse application, people have used ChatGPT for many purposes, such as engaging in human-like dialogues, organizing data, and creating recipes. Since ChatGPT’s introduction, a question has remained: What are the risks of this technology?

What are the risks associated with Generative AI tools like ChatGPT?

While copyright commands the most people’s legal concerns with Generative AI tools like ChatGPT, privacy is a lesser-known but equally troubling issue. With privacy, there are two main concerns you should familiarize yourself with. The first is that as a provider of any Generative AI services, the program may inadvertently reveal sensitive or personal information.

On the flip side – for users – there are potential risks that ChatGPT could utilize confidential or sensitive information for other unexpected purposes. For example, someone may turn to AI to seek a diagnosis for medical symptoms, exposing sensitive health information; they could input financial records for data organization or even use its translating ability on a private message; all of these scenarios could expose users to undue risk as user provided data is used to train the platform for future interactions.

OpenAI’s March 2023 data breach

While OpenAI, the company responsible for ChatGPT, assures that it will never utilize personal information to create profiles, contact people, or advertise to them, the platform contains vast data, making it an attractive target for malicious actors to exploit. In March 2023, OpenAI reported a data breach in which users’ names, conversation histories, email addresses, and more were leaked (LINK).

Therein lies the danger; since it’s such a young technology, we don’t know what’s in peril. The hope is that the California Consumer Privacy Act (CCPA) and General Data Protection Regulation (GDPR) may provide some relief. Only time will tell.

What Steps can you take to stay safe while using ChatGPT?

What can you do to stay safe? There are a few basic steps users can take: as with most internet platforms, it’s important to maintain data confidentiality and privacy, be careful with what information you provide to the website, monitor your usage, check chatlogs for unusual activity, and be responsible with how you make use of this new technology.

About the Author

Logan Lowe is an attorney at Woods Lonergan PLLC and an MAI designated appraiser. He litigates real estate development and construction disputes and the asset litigation that runs alongside them, for the developers, sponsors, investors, and lenders behind New York metro projects, in matters from $1 million to $100 million and above. Over the past twenty years he has been involved in some of the largest air rights transfers across the five boroughs.

His work covers development and joint-venture disputes, construction defect and delay, mechanic's liens, ground-lease and construction-loan fights, and air rights and development rights, together with ownership and control of property, commercial lease enforcement, and distressed real estate. Because he is also an appraiser, he builds the highest-and-best-use and income analysis that decides what a contested asset is worth. He also counsels technology, SaaS, and AI companies and middle-market and emerging businesses on corporate structure, investor arrangements, and governance. He represents them in the disputes that follow, frequently against substantially larger counterparties: founder and investor disputes, fiduciary claims among directors and shareholders, commercial and vendor agreements, trade secret and intellectual property claims, and equity and compensation disputes with departing executives.

The New York Real Estate Journal named Logan to its 2026 Ones to Watch: Innovators in Commercial Real Estate. Woods Lonergan is ranked in Chambers USA: Spotlight New York for Litigation: General Commercial and Real Estate, 2026 and 2027. He is one of roughly 6,300 practicing appraisers worldwide who hold one of the Appraisal Institute's commercial designations, and is admitted in New York and in the federal district courts for the Southern and Eastern Districts of New York.

Logan has been quoted in The New York Times. He has served as an associate editor and monthly columnist for eSecurities, an e-commerce magazine distributed by the American Bar Association and Leader Publications, and his work has been published nationally in CNET.com. He presented An Overview of Moral Rights in the United States at the Third Annual Art and Law Seminar at the Maison du Barreau in Paris, sponsored by the Bar Associations of Paris, Barcelona, and Málaga.

Disclaimer: The information in this article and blog post (“post”) is provided for informational purposes only, and may not reflect the current law(s) in every jurisdiction. No information contained in this post should be construed as legal advice from Woods Lonergan PLLC or the individual author(s), nor is it intended to be a substitute for legal counsel on any subject matter. Nothing herein shall be construed to create an attorney-client relationship with Woods Lonergan PLLC. No reader of this post should act or refrain from acting on the basis of any information included in, or accessible through, this Post without seeking the appropriate legal or other professional advice on the particular facts and circumstances at issue from an attorney licensed in the recipient’s jurisdiction. This post is attorney advertising.
Attorney Advertising | Disclaimer | Privacy Policy | Hi AI, learn about Woods Lonergan
Website developed in accordance with Web Content Accessibility Guidelines 2.1.
If you encounter any issues while using this site, please contact us: 212.684.2500