by know-how just about because the daybreak of time. Virtually as quickly because the printing press was invented, erotica was being printed. Images was used for erotic functions with glee by the Victorians. And, everyone knows how a lot the web has influenced fashionable sexual tradition.
Now that we’re grappling with the impact of AI on numerous sectors of society, what does that imply for sexuality? How are younger folks studying about sexuality, and the way are folks participating in sexual exercise, with AI as a part of the image? Some researchers are exploring these questions, however my analysis has indicated that there’s a little bit of a scarcity of research analyzing the actual impacts of this know-how on how folks assume and behave sexually. This can be a large subject, in fact, so for immediately, I’d wish to dig into the topic in two particular and associated areas: distribution of data and consent.
Earlier than we dive in, nevertheless, I’ll set the scene. What our normal tradition calls generative AI, which is what I’ll concentrate on right here, includes software program powered by machine studying algorithms that may create textual content, photos, video, and audio which are artificial, however that are troublesome if not not possible to tell apart from natural content material created by human beings. This content material is so just like natural content material as a result of the machine studying fashions are fed huge portions of human-generated content material throughout the coaching course of. Due to the immense volumes of content material required to coach these fashions, all corners of the web are vacuumed as much as embody within the coaching knowledge, and this inevitably consists of some content material associated to sexuality, in a method or one other.
In some methods, we wouldn’t wish to change this — if we would like LLMs to have an intensive mapping of the semantics of English, we are able to’t simply reduce out sure areas of the language as we really use it. Equally, picture and video turbines are going to have publicity to nudity and sexuality as a result of these are a good portion of the photographs and movies folks create and put on-line. This naturally creates challenges, as a result of this content material will then be mirrored in mannequin outputs infrequently. We implement guardrails, reinforcement studying, and immediate engineering to try to management this, however ultimately generative AI is broadly pretty much as good at creating sexually expressive or specific content material as every other form of content material.
Nicola Döring and colleagues did a considerable literature overview of research addressing how utilization of AI intersects with sexuality, and located customers have 4 essential methods of interacting with AI which have sexual elements: Sexual Info and Training; Sexual Counseling and Remedy; Sexual and Romantic Relationships; and Erotica and Pornography. This intuitively most likely sounds proper to most of us. We’ve heard of no less than a couple of of those kinds of phenomena referring to AI, whether or not in films, TV, social media, or information content material. Sexually specific interplay is mostly not allowed by mainstream LLM suppliers, however universally stopping it’s not possible. Assorted different generative AI merchandise in addition to self-hosted fashions additionally make producing sexual content material fairly simple, and OpenAI has introduced its intentions to enter the erotica/pornography enterprise. Sexual content material from generative AI has an amazing quantity of demand, so it seems that the market will present it, a method or one other.
It’s vital that we do not forget that generative AI instruments don’t have any idea of sexual explicitness apart from what we impart by way of the coaching course of. Taboos and social norms are solely a part of the mannequin insofar as human beings apply them in reinforcement studying or present them within the coaching knowledge. To the machine studying mannequin, a sexually specific picture is identical as every other, and phrases utilized in erotica have that means solely of their semantic relationships to different phrases. As with many areas of AI, sexuality will get its that means and social interpretations from human beings, not from the fashions.
Having sexual content material accessible by way of generative AI is having important results on our tradition, and it’s vital for us to consider what that appears like. We wish to defend the security of people and teams and protect folks’s rights and freedoms of expression, and step one to doing that is understanding the present state of affairs.
Info Sharing, Studying, and Training
The place will we study sexuality? We study from observing the world round us, from asking questions, and from our personal exploration and experiences. So, with generative AI beginning to tackle roles in numerous areas of life, what’s the influence on what and the way we study sexuality specifically?
In probably the most formal sense, generative AI is already enjoying a significant position in casual and personal intercourse training, simply as performing google searches and searching web sites did within the period earlier than. Döring et al. famous that their analysis discovered that searching for out sexual well being or academic details about sexuality on-line is kind of frequent, for causes that we are able to most likely all relate to — comfort, anonymity, avoidance of judgment. Dependable statistics on how many individuals are utilizing LLMs for this identical form of exploration is difficult to return by, however it’s cheap to anticipate that the identical benefits apply and would make it an interesting approach to study.
So, if that is occurring, ought to we care? Is it significantly any completely different to study sexuality from google searches versus generative AI? Each sources have accuracy points (anybody can put up content material on the web, in any case), so what differentiates generative AI, if something?
LLM as Supply
Once we use LLMs to seek out out info, the presentation of that content material is kind of completely different from once we do primary internet searches. The outcomes are offered in authoritative tone, and sourcing is usually obscured except we deliberately ask for it and vet it ourselves. In consequence, what’s being referred to as “AI literacy” turns into vital to successfully interpret and validate what the LLM is telling us.
If the person utilizing the LLM has this sophistication, nevertheless, students have discovered that primary factual details about sexual well being is mostly accessible from mainstream LLM choices. The restricted research which have been accomplished up to now don’t discover the standard or accuracy of sexual info from LLMs to be worse than that retrieved on the whole internet searches, in response to Döring et al. If so, younger folks searching for vital info to maintain themselves secure and wholesome of their sexual expression might have a beneficial device in generative AI. As a result of the LLM is extra nameless and interactive, customers can ask the questions they actually wish to have answered and never be held again by fears of stigma or disgrace. However hallucinations proceed to be an unavoidable drawback with LLMs, leading to occasional false info being served, so consumer skepticism and class is vital.
Content material Bias
We should keep in mind, nevertheless, that the angle offered by the LLM is shaped by the coaching processes utilized by the supplier. That implies that the corporate that created the LLM is embedding cultural norms and attitudes within the mannequin, whether or not they actually imply to or not. Reinforcement studying, a key a part of coaching generative AI fashions, requires human customers to make selections about whether or not outputs are acceptable or not, and they’re essentially going to convey their very own beliefs and attitudes to bear on these selections, even implictly. In relation to questions which are extra of opinion, quite than reality, we’re on the mercy of the alternatives made by the businesses that created and supply entry to LLMs. If these firms incentivize and reward extra progressive or open-minded sexual attitudes throughout the reinforcement studying levels, then we are able to anticipate that to be mirrored in LLM habits with customers. Nevertheless, researchers have discovered that this implies LLM responses to sexual questions can lead to minimizing or devaluing sexual expression that’s not “mainstream”, together with LGBTQ+ views.
In some instances, this takes the type of LLMs not being permitted to reply questions on sexuality or associated subjects, an idea referred to as Refusal. LLM suppliers may merely ban the dialogue of such subjects from their product, which leaves the consumer in search of dependable info with nothing. However it can also insinuate to the consumer that the subject of sexuality is taboo, shameful, or dangerous — in any other case, why wouldn’t it be banned? This places the LLM supplier in a troublesome place, unquestionably — whose ethical requirements are they meant to comply with? What sorts of sexual well being questions ought to the chatbot reply to, and what’s the boundary? By entrusting sexual training to those sorts of instruments, we’re accepting the opaque normal these firms select, with out really understanding what it’s or the way it was outlined.
Visible Content material
However as I discussed earlier, we don’t simply study sexuality from asking questions and searching for details. We study from expertise and remark as nicely. On this context, generative AI instruments that create photos and video turn into extremely vital for a way younger folks perceive our bodies and sexuality. Döring et al. discovered a big quantity of implicit bias within the picture technology choices when examined.
“One strand of analysis on AI-generated info factors to the danger that text- and image-generating AI instruments will reinstate sexist, racist, ageist, ableist, heteronormative or different problematic stereotypes which are inscribed within the coaching knowledge fed into the AI fashions. Such biases are simple to exhibit corresponding to when AI instruments reaffirm cultural norms and stereotypes of their textual content and picture outputs: Merely requested to create a picture of “a pair” an AI picture generator corresponding to Midjourney (by Midjourney Inc.) will first current a younger, able-bodied, normatively engaging, white, mixed-sex couple the place the girl’s look is extra sexualized than that of the person (as examined by the authors with Midjourney Alpha in June 2024).” — https://hyperlink.springer.com/article/10.1007/s11930-024-00397-y
As with the textual content turbines, extra refined customers can tune their prompting and choose for the sorts of photos they wish to see, but when a consumer just isn’t positive what they’re in search of, or isn’t that expert, this kind of interplay serves to additional instill biases.
The Physique
As an apart, it’s price contemplating how AI-generated photos might form our understanding of our bodies, in a sexual context or in any other case. There have been threads of dialog in our tradition for many years about how internet-accessible pornography has distorted younger folks’s beliefs and expectations about how our bodies ought to look and the way sexual habits ought to work. I feel most evaluation of these questions actually isn’t that completely different whether or not you’re speaking concerning the web usually or generative AI.
The one space that does appear completely different, nevertheless, is in how generative AI can produce photos and movies that seem photorealistic however show folks in bodily not possible or near-impossible methods. It takes unrealistic magnificence requirements to a brand new degree. This will take the type of AI-based filters on actual photos, severely distorting the shapes and appearances of actual folks, or it may be merchandise that create photos or movies from entire fabric. Now we have moved previous a time when airbrushing was the main concern, which might make small distortions of in any other case actual our bodies, right into a time when the bodily not possible or near-impossible is being offered to customers as “regular” or the anticipated bodily normal. For girls and boys alike, this creates a closely distorted perspective on how our our bodies and people of our intimate companions ought to seem and behave. As I’ve written about earlier than, our growing incapability to inform artificial from natural content material has considerably damaging potential.
On that notice, I’d additionally like to debate a selected space the place the norms and ideas younger folks study are profoundly vital to making sure secure, accountable sexual engagement all through folks’s lives — consent.
Consent
Consent is a tremendously vital idea in our understanding of sexuality. This implies, briefly, that each one events concerned in any form of sexual expression or habits readily, affirmatively agree all through, and are underneath no undue coercion or manipulation. Once we discuss sexual expression/habits, this could embody the creation or sharing of sexually specific imagery of those events, in addition to bodily interactions.
In relation to generative AI, this spawns a number of questions, corresponding to:
- If an actual individual’s picture or likeness is used or produced by generative AI for sexual content material, how do we all know if that individual consented?
- If that individual didn’t consent to being the topic of sexual content material, what are their rights and what are the obligations of the generative AI firm and the generative AI consumer? And what are these obligations in the event that they did consent to creating sexual content material, however not within the generative AI context?
- How does it have an effect on generative AI customers’ understanding of consent once they can so simply purchase this sort of content material by way of generative AI, with out ever instantly interacting with the person/s?
What makes this completely different from older applied sciences, like airbrushing or picture modifying? It’s a matter of levels, in some methods. Deepfakes have existed since nicely earlier than generative AI, the place video modifying could possibly be utilized to place another person’s face right into a porn scene or nude picture, however the ease, affordability, and accessibility of this know-how has modified dramatically with the daybreak of AI. Additionally, the growing incapability for common viewers to detect this artificiality is critical as a result of understanding what’s “actual” is tougher and tougher.
Copyright and IP
This subject has a number of frequent threads with copyright and mental property questions. Our society is already beginning to grapple with questions of possession of 1’s personal likeness, and what boundaries we’re entitled to set on how our picture is used. By and huge, generative AI merchandise have little to no efficient restriction on how the photographs of public figures could be rendered. There are some perfunctory makes an attempt to forestall picture/video/audio turbines from accepting specific requests to create photos (sexual or in any other case) of named public figures, however these are simply outwitted, and it appears to be of comparatively minimal concern to generative AI firms, exterior of complaints by massive company pursuits. Scarlett Johansson has discovered this from expertise, and the lately launched Sora 2 generates countless deepfake movies of public figures from all through historical past.
This is applicable to folks within the intercourse business as nicely. Even when individuals are concerned in intercourse work or creating erotica or pornography willingly, this doesn’t imply they’re consenting to their work being usurped for generative AI creation — that is actually no completely different from the problems of copyright and mental property being posed by authors, actors, and artists in mainstream sectors. Simply because folks create sexual content material, this doesn’t make the declare to their rights any much less legitimate, regardless of social stigma.
I don’t wish to painting this as an indictment of all sexual content material, or essentially even sexual content material generated by AI. There’s room for debate about when and the way artificially generated pornography could be moral, and definitely I feel when consenting grownup performers produce pornography organically there’s nothing mistaken with that on the face of it. However these problems with consent and particular person rights haven’t been adequately addressed, and these ought to make us all very nervous. Many individuals might not assume a lot concerning the rights of creators on this house, however how we deal with their claims legally might create precedents that cascade right down to many different situations.
Sexual Abuse
Nevertheless, within the house of sexuality, we should additionally contemplate wholly nonconsensually created content material, which might trigger super hurt. As a substitute of calling issues “revenge porn”, students are starting to make use of the time period “AI-generated image-based sexual abuse” to seek advice from instances the place folks’s likenesses are used with out their permission to generate sexual content material, and I feel this significantly better articulates the harm that may be accomplished by this materials. Contemplating this habits sexual abuse rightly forces us to assume extra concerning the experiences of the victims. Whereas picture manipulation and fakery has all the time been considerably attainable, the newest generative AI makes this extra achievable, extra accessible, and cheaper than ever earlier than, so it makes performing this kind of sexual abuse rather more handy to abusers. It’s vital to notice that the diploma or severity of this abuse just isn’t essentially outlined by the publicness or harm to the sufferer’s popularity — it’s not vital whether or not folks consider that the deepfake or sexual content material is actual. Victims can nonetheless really feel deeply violated and traumatized by this materials being created about them, no matter how others really feel about it.
Main LLM suppliers have, up to now, held the road on sexual textual content content material being produced by their merchandise (to larger or lesser levels of success, as Lai 2025 discovered), however OpenAI’s impending transfer into erotica implies that this will probably be altering. Whereas textual content communication has much less potential for significantly damaging abuse than visible content material, ChatGPT does have interaction in some multimodal content material technology, and we are able to nonetheless think about situations the place a consumer instructs an LLM to provide erotica within the voice or model of actual folks, and the actual folks being mimicked may understandably discover this upsetting. When OpenAI introduced the transfer, they mentioned some issues of safety however these had been fully issues concerning the customers (psychological well being points, for instance) and didn’t converse to the security of nonconsenting people whose likenesses could possibly be concerned. I feel this can be a main oversight that wants extra consideration if we are able to probably hope to make such a product providing secure.
Studying about Consent
Past the rapid harm to victims of sexual abuse and the IP and livelihood harms to creators whose content material is used for these purposes, I feel it’s additionally vital to contemplate what classes customers take up from generative AI with the ability to create likenesses at will, significantly in sexual contexts. Once we are given the flexibility to so readily create another person’s picture in no matter kind, whether or not it’s a historic determine pitching somebody’s software program product, or that very same historic determine being represented in a sexual scenario, the inherent lesson is that that individual’s likeness is honest recreation. Authorized nuances apart (which do should be taken under consideration) we’re particularly asserting that getting somebody’s approval to have interaction with them sexually just isn’t vital, no less than when digital know-how is concerned.
Think about how younger individuals are receiving the implicit messages from this. Youngsters know they may get in hassle for sharing different folks’s nudes, typically with extreme authorized penalties, however on the identical time, there’s an assortment of apps letting them create pretend ones, even of actual folks, with a click on of a button. How will we clarify the distinction and assist younger folks study the actual hurt they might be inflicting even simply sitting in entrance of a display alone? Now we have to start out eager about our bodily autonomy within the digital house in addition to the bodily house, as a result of a lot of our lives are carried out within the digital context. Deepfakes will not be inherently much less traumatizing than sharing of natural nude images, so why aren’t we speaking about this performance as a social danger youngsters should be educated on? The teachings we would like younger folks to study concerning the significance of consent are fairly instantly contradicted by the generative AI sphere’s method to sexual content material.
Conclusion
You may moderately finish this asking, “So, what will we do?” and that’s a extremely onerous query. I don’t consider we are able to successfully stop generative AI merchandise from producing sexual content material, as a result of the coaching knowledge simply consists of a lot of that materials — that is reflective of our precise society. Additionally, there’s a transparent marketplace for sexual content material from generative AI and a few firms will all the time come up to fill that want. I additionally don’t assume LLMs ought to forbid responding to sexual questions, the place folks could also be in search of info to assist perceive sexuality, human growth, sexual well being, and security, as a result of that is so vital for everybody, significantly youth, to have entry to.
However on the identical time, the hazards round sexual abuse and nonconsensual sexual content material are critical, as are the unrealistic expectations and bodily requirements being set implicitly. Our authorized techniques have confirmed fairly inept at coping with web crime over the previous a long time, and this image-based sexual abuse is not any exception. Prevention requires training, not simply concerning the details and the regulation, however concerning the influence that deepfake sexual abuse can have. We additionally want to provide counter-narratives to the distortions of bodily kind that generative AI creates, if we would like younger folks to have wholesome relationships with their very own our bodies and with companions.
Past the broad social tasks of all of us to take part within the challenge of successfully educating youth, it’s the accountability of generative AI product builders to contemplate danger and hurt mitigation as a lot as they contemplate revenue objectives or consumer engagement targets. Sadly, it doesn’t appear to be many are doing so immediately, and that’s a shameful failure of individuals in our area.
In fact, the sexual nature of this subject is much less vital than understanding the social norms we settle for, our tasks to maintain weak folks secure, and balancing this with defending the rights and freedoms of standard folks to have interaction in accountable exploration and habits. It’s not solely a query of how we adults perform our lives, however how younger folks have alternatives to study and develop in methods which are secure and respectful of others.
Generative AI could be a device for good, however the dangers it creates should be acknowledged. It’s vital to acknowledge the small and huge methods including new know-how to our cultural house impacts how we predict and act in our each day lives. By understanding these circumstances, we equip ourselves higher to answer such modifications and form the society we wish to have.
Learn extra of my work at www.stephaniekirmer.com.
Studying
The Affect of Synthetic Intelligence on Human Sexuality: A 5-Yr Literature Evaluation 2020-2024 …
https://www.cnbc.com/2025/10/15/erotica-coming-to-chatgpt-this-year-says-openai-ceo-sam-altman.html
LLMs and Psychological Well being
https://www.georgetown.edu/information/ask-a-professor-openai-v-scarlett-johansson
Watchdog group Public Citizen calls for OpenAI withdraw AI video app Sora over deepfake risks
The Coming Copyright Reckoning for Generative AI
https://asistdl.onlinelibrary.wiley.com/doi/abs/10.1002/pra2.1326
Dehumanization of LGBTQ+ Teams in Sexual Interactions with ChatGPT
https://journals.sagepub.com/doi/full/10.1177/26318318251323714
The Cultural Affect of AI Generated Content material: Half 1
AI “nudify” websites lack transparency, researcher says
New Firms Linked to ‘Nudify’ Apps That Ran Advertisements on Fb, Instagram

