Regulating Deepfakes - Legal Challenges And The Future Of AI-Driven Synthetic Media In India
Author: LawSphereX
Category: General Law
Published:
Updated:
REGULATING DEEPFAKES: LEGAL
CHALLENGES
AND THE FUTURE OF AI-DRIVEN SYNTHETIC MEDIA IN INDIA Rushitha Sravani Putlur, Amity Law School, Noida Dr Kritika Nagpal, Amity Law School, Noida
INTRODUCTION
Today, technology has mixed reality and fiction more than ever before. One of the most striking examples of this is the growth of deepfakes, artificial media created by AI that can mimic faces, voices, and actions of actual people. 1 Initially created as a technological wonder in the domains of artificial intelligence and machine learning, deepfakes have over time evolved to become a versatile, and occasionally hazardous, weapon with profound ramifications. As such artificial productions are becoming more indistinguishable from genuine audio-visual material, societies worldwide are struggling with how they can mislead, manipulate, and take advantage of people. In India, where digital literacy and online access have grown at a blistering pace, deepfakes have found fertile ground.
2 The use of social media services like WhatsApp, Instagram, and X (formerly Twitter) has made it easier for these hacked media types to spread rapidly, unsuspectingly falling into the laps of users. From edited political speeches to pornographic content involving celebrities or unwitting individuals, the range of abuses is extensive—and the damage can be catastrophic. At the center of the deepfake problem is a conflict between innovation and regulation. On the one hand, synthetic media, when utilized responsibly, has vast potential in all industries—entertainment, education, advertising, and even journalism. On the other hand, the abuse of deepfake technology has severe consequences for privacy, personal dignity, political stability, and public trust.
For example, deepfakes have already been used for disinformation campaigns, character assassinations, and cybercrime, causing serious concerns about the degradation of truth in online communication. In a democracy such as India, where public opinion can be easily swayed by visual information, the stakes are even greater. The intricacy of the legal environment around deepfakes creates another layer of concern. Currently, India does not have an overarching legal framework that specifically deals with synthetic media. 3 Although some laws such as the Information Technology Act, 2000 and parts of the Indian Penal Code provide some protection against manipulated content using digital means, they are usually inadequate when applied to the advanced and dynamic context of deepfakes.
Additionally, the lack of definitions and categorizations in Indian law results in uncertainty, which hinders victims from claiming redress or authorities from ensuring accountability. Such a legal loophole becomes even more problematic given the fast-paced evolution of AI and machine learning. Deepfake generating tools are increasingly becoming available and easy to use, reducing the threshold for even non-technical users to produce realistic fake material. 4 With deepfake generators now easily available on the internet as open-source software, nearly anyone can create digital content that appears hauntingly realistic. This made available to the masses has dramatically multiplied both the quantity and diversity of threats—ranging from online harassment and non-consensual pornography to targeted political disinformation.
The worldwide reaction to deepfakes has been diverse, with nations such as the United States, China, and members of the European Union testing different ways of regulating. 5 Some have suggested that deepfakes should be criminalized when used maliciously, while others emphasize enhancing detection mechanisms or encouraging transparency in online content. International developments have useful lessons to be learned by India, particularly how to adopt a judicious balance between protecting the rights of the individual without discouraging innovation. Bringing foreign legal models into use, though, demands cautious scrutiny of India's sui generis socio-political context, internet infrastructure, and constitutional ethos. Another challenge in regulating deepfakes is the ethical aspect.
In addition to legal issues, the phenomenon raises deeply philosophical questions regarding authenticity, consent, and autonomy. When someone's image can be made to say or do something they never did, their agency over their own identity is undermined. This has severe consequences not only for public figures or celebrities, but also for regular citizens who might become unwilling actors in digitally created stories. The psychological and emotional impact of such experiences is tremendous, especially in instances of sexualized content or defamation. 6 On the other hand, one cannot ignore the potential of synthetic media to be utilized positively. In the field of cinema, deepfakes can recreate historical figures or de-age actors. 7 In education, they can bring historical events or science concepts to life in engaging ways.
In accessibility, synthetic voice technology can enable more inclusive experiences for people with disabilities. These positive applications underscore the importance of not vilifying the technology itself, but rather focusing on responsible use and adequate safeguards. This makes the task of regulation more nuanced—how does one encourage innovation while preventing harm? The growing prevalence of deepfakes also calls for greater public awareness. Many users remain unaware of how synthetic media works or how to identify it. Without critical digital literacy, people are more susceptible to being manipulated or misled. Education campaigns and awareness programs, especially in local languages, are imperative to empower the public with the means to steer through a digitally over-saturated information environment.
8 In this sense, the involvement of civil society, media, and academic circles becomes essential. Considering the multidimensional nature of the deepfake phenomenon, the response in India needs to be multidimensional. Legal reforms are indeed a central piece of the puzzle—but they need to be supported by technological interventions, ethical guidelines, and public awareness. Developing AI-driven detection mechanisms, reinforcing data protection legislation, and providing rapid legal recourse to victims are all in the right direction. 9 Further, there needs to be coordination between technology companies, governments, and legal professionals to develop policies that are effective and dynamic. This dissertation attempts to examine these intricate dynamics from a legal perspective, with a focus on the Indian context.
It will attempt to review the current legal frameworks that can be applied to deepfakes, evaluate their sufficiency, and determine gaps that must be filled. In addition, it will review international best practices and ethical implications and provide a blueprint for a regulatory framework that balances innovation and accountability. The broad aim is to add to the emerging discussion on synthetic media regulation and to offer practical suggestions based on India's constitutional and social realities. In summary, as deepfake technology advances, so must our comprehension of its implications. We are at a juncture where choices today will determine the character of truth, identity, and trust in the digital world for decades to come.
India's legal reaction to deepfakes will not just impact the security and dignity of its citizens but also determine the precedent for how democracies react to the moral challenges presented by AI. We must act with care and purpose to ensure that technology is a force for good, not an instrument of deceit.
STATEMENT OF PROBLEM
Over the last few years, artificial intelligence (AI) has transformed the way we produce, consume, and engage with digital content. Perhaps among the most potent – and possibly unsettling – technologies to emerge from this AI revolution is the production of deepfakes. They are ultra-realistic audio, video, or image-based deceptions produced via machine learning algorithms, especially with tools such as Generative Adversarial Networks (GANs). 10 While deepfakes originally were created to entertain or aid research, today they have stepped into a grey area—where the distinction between innocent creativity and possible harm diminishes. Deepfakes also present a particular challenge to the legal frameworks in the world, and India is not different.
With the second most populous internet users in the world and a very fast-growing digital economy, India is especially open to the disrupting power of synthetic media. 11 From political disinformation, non-consensual porn, impostor fraud, to defamation and identity theft, deepfakes are starting to push the limits of India's legal and regulatory structures. However, our current laws, which were not crafted with AI-based content manipulation in mind, are finding it difficult to keep pace with the fast-changing nature of this technology. The key issue is the lack of a clear, comprehensive legal framework that deals specifically with deepfakes and their consequences. India's main law to deal with cyber crimes—the Information Technology Act, 2000—was enacted when such advanced synthetic media did not exist.
12 Though the Act touches on problems such as hacking and stealing someone else's identity, as well as pornography, it neither appreciably recognizes nor controls deepfake technology. Therefore, law enforcement bodies tend to use a patchwork of provisions under the Indian Penal Code (IPC), IT Act, and other sector-specific laws to deal with deepfake-related offenses, resulting in uncertainty, inconsistency, and under-enforcement. One of the most disturbing issues is the non-consensual application of deepfake technology for sexual harassment and exploitation, which disproportionately affects women. Cases of doctored videos being shared without consent—albeit digitally created—have catastrophic personal, social, and psychological impacts. In most such instances, victims are unable to obtain justice because of procedural barriers and a lack of legal certainty.
While Section 66E of the IT Act and some IPC provisions concerning obscenity or sexual harassment are applicable, the fact that there is no specific legal provision concerning content generated by deepfakes means the justice system ends up playing catch-up. 13 Apart from personal damage, deepfakes also threatened democratic integrity and national security. 14 There have already been cases in other nations where deepfake videos have been applied to generate fake political stories, tarnish public personalities, and manipulate the voters' perception. In a dynamic democracy such as India with more than 900 million voters, the danger of political deepfakes causing trouble in elections or triggering communal unrest is not hypothetical. The virality of social media, with minimal digital literacy among parts of the population, makes misinformation extremely dangerous and hard to control.
Additionally, the Indian criminal justice system and judiciary are still not geared to comprehend or decide cases related to intricate AI-generated content. Investigators might not have access to the necessary forensic equipment or training to detect and establish the utilization of deepfake technology. Courts can grapple with evidentiary admissibility of such material, particularly when the distinction between the real and synthetic becomes impossibly thin. This technical obscurity leaves a void of accountability in which offenders take advantage of legal and technical loopholes, frequently going unpunished. The second fundamental concern is the insufficient awareness among citizens of deepfakes. The majority of citizens remain unaware of the technology, its impact, or how to recognize synthetic media.
This digital illiteracy drives the dissemination of manipulated content, particularly on WhatsApp, Instagram, YouTube, and other pervasive platforms. In the absence of adequate awareness programs or organizational backing, citizens are not adequately equipped to handle this new digital reality, much less shield themselves from its dangers. At the policy level, although some steps have been initiated—such as the recent Digital Personal Data Protection Act, 2023, and the draft Digital India Act—there is no specific regulation or statutory mechanism to regulate synthetic media or AI-generated content. Even across the world, though nations such as the US, UK, and China have started testing ground with deepfakespecific laws, India is still to put forward a legal framework that reconciles innovation and accountability, privacy and protection, and free expression and ethical checks.
Constitutionally, deepfakes pose a threat to the Right to Privacy, which is a constitutional right under Article 21 after the Puttaswamy judgment. 15 Deepfakes makers, usually without permission or knowledge of their portrayed subjects, invade body and informational autonomy. That complicates hard questions of law: May consent be implied when information is out there for public consumption? Who is liable when material is automatically created? What relief should be offered to the victims? Our laws today have no reliable answers to these problems. Additionally, the hosting platforms of such content—Meta (Facebook, Instagram), Twitter, YouTube, etc. —tend to duck responsibility by invoking intermediary protections. Although the new IT Rules of 2021 added due diligence requirements to platforms, enforcement has been half-hearted.
16 Such amplification algorithms are still running amok, and content moderation practices are still opaque, uneven, and reactive. 17 Without strong platform responsibility and an overseeing regulator, it is almost impossible to stop the spread of destructive deepfakes once they have gone viral. Without established criminal liability, regulatory checks, redressal for victims, or technology protection measures, India is at a turning point. The state now needs to address the dilemma of crafting a future-proof legal framework that is capable of mitigating the ethical, social, and legal fallouts of deepfake technology without curtailing innovation and free speech. This study is born out of the imperative to bridge this legal gap.
It aims to explore how India's current legal framework addresses deepfake-related harms, map the legislative gaps, and explore if the emerging global regulatory patterns hold the key. It also aims to investigate how ethical AI development, platform regulation, and digital literacy can be brought into a comprehensive regulatory approach.
SCOPE
OF STUDY The exponential growth of artificial intelligence (AI) and machine learning technologies has produced deepfakes—hyper-realistic, AI-created synthetic media that alter video, audio, and images in a way that is frequently indistinguishable from real content. As deepfakes take hold on digital platforms, they challenge legal systems, public discourse, and human rights in profound ways. Although they provide creative potential in entertainment, education, and accessibility, they also usher in the possibility of misinformation, political disinformation, nonconsensual porn, identity theft, and reputational damage. Against this backdrop, this dissertation attempts to explore the width and depth of legal and regulatory issues surrounding deepfakes within an Indian context, while locating India in the global debate on synthetic media regulation.
At the center of this research is an attempt to grasp the nature of deepfake technology itself— how it is created, how it gets distributed, and why it is such a profound regulatory challenge. Toward that end, the study will examine the technological framework supporting the generation of deepfakes, including Generative Adversarial Networks (GANs), autoencoders, and sophisticated algorithms for mimicking facial expressions, lip syncs, and voice modulations. 18 These technologies are becoming more widely available, enabling not just professionals but also ordinary people to produce realistic counterfeit content cheaply and with little technical expertise. It is important to understand these technological dynamics because regulation cannot be in a vacuum—it must respond to the changing nature of the tools it is trying to regulate.
Thus, the purview of this research consists of a thorough technological examination that forms the groundwork for its legal inquiry. Legal analysis is the primary concern of this dissertation, and it transpires against the context of India's current laws and judicial understandings. India does not currently have any specific statute dealing with deepfakes or synthetic media, which is a regulatory vacuum. 19 In this absence, the law of the land has to draw upon a patchwork of current provisions borrowed from the Information Technology Act, 2000, the Indian Penal Code (IPC), the Constitution, and other sectoral legislations. The following dissertation shall analyze the effectiveness of these provisions in addressing deepfakes.
For example, the IT Act might offer relief for cases of impersonation or obscene material, while the IPC would be applicable in cases of defamation, forgery, or cyberstalking. 20 But the vagueness as to how such laws would extend to AI-based content is important in raising concerns regarding adequacy, specificity, and enforceability. The other critical legal aspect the research touches upon is constitutional jurisprudence, particularly in relation to the right to privacy, freedom of speech and expression, and informational autonomy. The 2017 landmark Puttaswamy judgment brought the right to privacy into the fold of fundamental rights under Article 21 of the Constitution by basing it on the principles of dignity, autonomy, and liberty of the individual. 21 Deepfakes, particularly those that are non-consensual, tend to go against this very ethos.
They can manipulate a person's identity and disseminate false information without their awareness or permission. This research aims to determine whether current constitutional protections are enough to provide a safeguard against such technologically facilitated invasions. Simultaneously, it will also look at the extent to which regulation has to reconcile privacy rights with freedom of expression, especially if synthetic media is utilized for satire, political commentary, or artistic work. Whereas statutory interpretation and constitutional rights are at the core of the scope of this research, they cannot be divorced from the pragmatic aspects of regulatory implementation. For this reason, this dissertation broadens its scope to encompass an examination of India's present regulatory apparatus and institutional preparedness.
It discusses the agency's role of ministries like the Ministry of Electronics and Information Technology (MeitY), CERT-In, law enforcement agencies, and the judiciary to counter the threat posed by deepfakes. It also examines the legal responsibilities of intermediary platforms such as social media firms under the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules,
2021.22 These platforms are usually the main vectors via which deepfakes are circulated, and
therefore they are primary stakeholders in the regulatory environment. However, questions remain regarding their accountability, response times to requests for takedown, and their ability to detect and prevent objectionable content ahead of time. This research also acknowledges that the issue of regulating deepfakes is not an Indian-specific problem. Various nations have started passing laws or regulations to deal with this trend, but with different methods. The General Data Protection Regulation (GDPR) of the European Union, for example, has a strong framework for data protection and informed consent, which can be expanded to regulate the use of deepfakes. 23 In the US, state-level legislation has appeared that specifically targets deepfake pornography and political misinformation, but there is still a shortage of federal-level regulation.
China has been more top-down in its regulation, requiring all deepfake content to be obviously labeled. By examining these global practices, this dissertation aims to discern best practices and possible pitfalls, providing insight into a regulatory strategy in India that is both context-sensitive and globally informed. Notably, this dissertation does not regard deepfakes as an exclusively legal problem—it recognizes their wider ethical and societal implications. Synthetic media undermine public confidence in visual and auditory proof, and it becomes more difficult for people to know the difference between true and false, fact and fiction. Such has been referred to as the "liar's dividend"—where real evidence is discredited as false, and lies can pass for truth.
24 This poses a special ethical challenge to society, especially in a nation like India where disinformation can have quick and violent repercussions, such as communal tension, electoral interference, and reputational damage. The research will examine how public institutions, civil society, and the media can assist in developing resilience against such threats through media literacy, ethical standards, and civic consciousness. The scope of this research also includes a focus on the gendered and marginalized experiences of deepfake harm. Numerous reports have shown that women are disproportionately affected by non-consensual deepfake pornography, often with little recourse for justice. The trauma, stigma, and reputational harm that follows such incidents are profound, and often the legal system lacks the empathy or efficiency to respond meaningfully.
This dissertation will thus explore the convergence of gender, technology, and law, questioning whether legal instruments currently available are responsive and inclusive enough to address the needs of vulnerable populations. It will also research the accessibility of remedies in law and socio-cultural hurdles encountered by victims when reporting and seeking redress. In the future, the study also looks into the regulation of AI in India. As deepfake technology keeps improving and synthetic media becomes increasingly pervasive, reflexive regulatory approaches might not be enough. The times call for anticipatory governance—policy measures that anticipate technological upsets and gear up in advance. 25 This may involve the likelihood of India adopting a holistic AI law or including provisions on deepfakes in the upcoming Digital India Act.
The dissertation will also analyze whether a decision to introduce this move would be legally tenable, technologically viable, and socially preferable. It will further examine the possibilities of using self-regulation in the form of ethical rules designed by AI scientists, news outlets, and IT firms for blocking misuse and allowing transparency. Ultimately, the ambit of this research extends to the interdisciplinarity that exists. Regulation by lawyers and parliamentarians cannot drive legal control over deepfakes—it must have input from technologists, ethicists, social scientists, and communication specialists as well. As such, this dissertation will therefore take a multi-disciplinary, cross-disciplinary approach that references literature in the fields of computer science, digital ethics, media studies, and jurisprudence.
The above approach ensures the proposals given as law are doctrinally coherent yet also realistically enforceable and morally grounded. HYPOTHESIS IN A STATEMENT This study proceeds on the hypothesis that India’s current legal and regulatory framework is insufficient, fragmented, and reactive in addressing the unique challenges posed by deepfakes, and that without a robust, technology-sensitive, rights-based, and future-ready legal regime, the misuse of AI-generated synthetic media will continue to outpace the law, leading to serious consequences for privacy, free speech, democratic integrity, and social trust. 26 At the heart of this hypothesis lies the understanding that deepfakes are not just another form of digital content—they represent a profound disruption in the way we perceive and interact with media.
Enabled by sophisticated artificial intelligence tools such as Generative Adversarial Networks (GANs), deepfakes can convincingly simulate real people saying or doing things they never did. 27 The potential for misuse is staggering, from creating non-consensual pornography and faked political statements to financial scams and reputational sabotage. 28 In a digital ecosystem like India’s, which is both massive in scale and volatile in its reactions to misinformation, such capabilities can easily spiral into real-world harm. The law, therefore, needs to evolve quickly, but the hypothesis contends that it currently lags behind, caught in the web of outdated statutes and inconsistent enforcement.
The assumption driving this hypothesis is that India's existing legal instruments—namely the Information Technology Act, 2000, the Indian Penal Code, 1860, and other sectoral laws—were not designed with synthetic media in mind and therefore fail to directly address the complex nature of deepfakes. These laws may offer piecemeal remedies, such as provisions for defamation, identity theft, obscenity, or cyberstalking, but none provide a targeted or holistic solution. For instance, prosecuting a deepfake creator for defamation or obscenity requires proof of intent, harm, and causation—all of which are exceedingly difficult to establish when the content is generated anonymously and spreads rapidly through decentralized digital channels. The hypothesis, therefore, anticipates that relying solely on existing legal provisions will remain inadequate in tackling deepfakes effectively.
This insufficiency is further compounded by the ambiguity around enforcement. The hypothesis posits that enforcement agencies and judicial actors in India are ill-equipped to detect, evaluate, and act upon deepfake-related cases due to the lack of technical expertise and clear legal standards. With cybercrime units stretched thin and often undertrained, identifying perpetrators who use anonymizing tools and foreign servers becomes a daunting task. Courts, meanwhile, struggle with both the evidentiary value of synthetic media and the philosophical implications of regulating speech that might not be “real,” but still has real-world impact. 29 Thus, the study hypothesizes that a gap exists not just in law, but in institutional capacity and interpretive clarity—widening the chasm between legal doctrine and technological reality.
Additionally, the hypothesis contends that the lack of a dedicated legal framework for deepfakes exposes fundamental rights to significant risk, particularly the right to privacy. Following the landmark judgment in Justice K. S. Puttaswamy v. Union of India, the right to privacy was constitutionally recognized as intrinsic to life and personal liberty under Article 21 of the Constitution. 30 Deepfakes, especially non-consensual ones, directly violate this right by manipulating and publishing an individual’s likeness or voice without their knowledge or consent. The hypothesis suggests that without specific legislative safeguards, such as informed consent requirements and a framework for redressal, the right to privacy becomes a hollow promise in the digital age. Closely tied to the privacy argument is the hypothesis that deepfakes also threaten the right to free speech and expression.
While this may seem paradoxical—since synthetic content itself may be seen as a form of speech—the danger lies in the chilling effect and distortion of the public sphere. The hypothesis argues that if deepfakes are left unchecked, they will contribute to a culture of disbelief, where real content can be dismissed as fake and fake content passed off as real. This “liar’s dividend” undermines the epistemic foundations of democracy, where informed decision-making depends on trustworthy media. Consequently, freedom of expression and the right to information are both endangered, not by censorship, but by erosion of credibility. Moreover, the hypothesis suggests that the harms caused by deepfakes are not evenly distributed.
Women, minorities, political figures, journalists, and other public-facing individuals are more vulnerable to synthetic defamation, non-consensual pornography, or targeted misinformation. 31 In a society already grappling with patriarchal structures, religious sensitivities, and political polarization, deepfakes can easily be weaponized against vulnerable groups. The hypothesis asserts that the current law fails to recognize or respond adequately to this asymmetry, and that any meaningful regulation must be intersectional and victim-sensitive, embedding gender justice and social equity into its framework. From a regulatory standpoint, the hypothesis holds that India’s platform liability model under the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, is insufficient to deal with the proliferation of deepfakes.
32 While these rules do impose some obligations on social media intermediaries to identify and take down harmful content, they do not establish a clear standard for proactive detection, nor do they mandate the use of watermarking, authenticity indicators, or AI tools to label synthetic content. As such, the hypothesis proposes that without regulatory innovation and technological collaboration between government and private platforms, enforcement will remain reactive and superficial. Further, the hypothesis foresees that legal regulation in India will have to move from a deterrentfocused approach to a preventive and ethical one. Traditional criminal sanctions may be too slow or too blunt to handle the evolving threats of synthetic media.
What is needed, the hypothesis argues, is a layered regulatory framework that includes clear definitions, consentbased rules, swift grievance redressal mechanisms, platform accountability, digital literacy programs, and ethical AI design. It should also involve anticipatory governance that is adaptable to technological shifts, learning from models like the European Union’s AI Act or China’s content labelling mandates. Without this kind of proactive stance, the hypothesis believes, India risks being in a constant state of legal catch-up—forever reacting, never preparing. Lastly, the hypothesis rests on the belief that a balance can and must be struck between innovation and protection. The aim of regulation should not be to stifle the creative, educational, or accessibility-enhancing possibilities of synthetic media.
Deepfakes, in their benign forms, can be used for satire, dubbing, digital resurrection in films, or even aiding persons with disabilities. However, for these benefits to be realized safely, the hypothesis posits that a transparent, rights-based, and participatory regulatory framework is essential. Such a framework would not only respond to harm but foster a culture of ethical AI development in India—anchored in constitutional values and public trust. In conclusion, this hypothesis proposes that the unregulated growth of deepfake technology poses a multidimensional challenge—legal, ethical, technological, and societal. It argues that India’s current legal system, in its present form, is not equipped to handle these challenges comprehensively.
Therefore, unless the law evolves in tandem with technology—grounded in constitutional safeguards and bolstered by institutional reform—the dangers of deepfakes will only deepen, threatening individual dignity, democratic discourse, and the very credibility of reality in the digital age. 33
LITERATURE REVIEW
The emergence of deepfakes has led to a growing body of academic, legal, and technological literature attempting to make sense of their implications, especially in relation to regulation, ethics, and societal impact. As AI-generated synthetic media continues to evolve, scholars and researchers across the globe have begun to examine the multidimensional consequences of deepfakes—from their technological underpinnings to the urgent legal gaps they expose. This review synthesizes key scholarly contributions, legal commentaries, and policy perspectives relevant to the Indian context, while also drawing upon comparative global frameworks to situate the discussion in a broader regulatory discourse.
Deepfakes, in their essence, are an outcome of advanced machine learning technologies, particularly Generative Adversarial Networks (GANs), which are capable of synthesizing hyper-realistic videos, audio, and images. 34 Ian Goodfellow and his team, who pioneered GANs in 2014, did not foresee the darker applications their invention would fuel. Much of the early literature focused on the technical brilliance of such innovations, applauding their potential for creative expression, digital accessibility, and entertainment. However, as the misuse of deepfakes gained traction, academic focus gradually shifted to the dangers posed by this form of synthetic media— particularly in the realms of misinformation, defamation, non-consensual pornography, and political sabotage.
One of the earliest warning voices came from Danielle Citron and Robert Chesney, whose influential work, “Deep Fakes: A Looming Challenge for Privacy, Democracy, and National Security,” emphasized how deepfakes could erode public trust in visual evidence and manipulate democratic processes. 35 Their analysis illuminated the inadequacies of existing U. S. laws in addressing such technologically generated falsehoods and argued for a new legal architecture based on harm reduction and platform responsibility. Their work has since shaped global conversations about synthetic media regulation, including those in India, where similar concerns about the integrity of elections and the spread of communal misinformation are particularly pressing. In the Indian context, legal literature has only recently begun engaging seriously with the regulatory challenges posed by deepfakes. Scholars such as Dr.
Pavan Duggal, a leading cyber law expert in India, have repeatedly emphasized that India’s Information Technology Act, 2000, was drafted in a pre-AI era and therefore lacks the specificity required to deal with novel digital harms like deepfakes. 36 Duggal’s writings point to the urgent need for targeted legislation that can define and criminalize deepfake-related offences, create liability regimes for intermediaries, and empower individuals to seek redress. While his analysis focuses predominantly on legal remedies, it underscores the broader gap in India’s cyber jurisprudence when it comes to AI-driven harms. A related body of scholarship explores the intersection of deepfakes with privacy and consent— particularly in the context of non-consensual pornography, where women are disproportionately targeted.
Scholars such as Vrinda Bhandari and Ananth Padmanabhan have emphasized how deepfakes undermine the constitutional right to privacy recognized in the landmark Puttaswamy judgment. Their work situates deepfakes within the broader debates on informational autonomy, bodily integrity, and digital dignity. They argue that India’s existing laws on obscenity, harassment, and voyeurism under the IPC are woefully inadequate to respond to the trauma caused by synthetic sexual content, especially when victims face stigma, anonymity barriers, and slow adjudication processes. Another critical strand of literature focuses on platform responsibility. In recent years, debates have intensified around the liability of social media intermediaries and content-hosting platforms in allowing the proliferation of deepfake videos.
Commentators such as Apar Gupta of the Internet Freedom Foundation have criticized the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, for being more focused on censorship and surveillance than on proactive harm mitigation. 37 Gupta and others argue that platforms must be mandated to deploy technological tools to detect and label synthetic media, establish grievance redressal mechanisms, and collaborate with independent fact-checkers.
These ideas draw inspiration from international models, such as the EU’s Digital Services Act and the U. S. Deepfake Accountability Act, both of which propose structural checks on platform conduct. Several academic contributions have also engaged with the philosophical and ethical questions that deepfakes provoke. Scholars such as Siva Vaidhyanathan have warned of the “liar’s dividend”—a phenomenon where the existence of deepfakes leads to a generalized skepticism of all visual media, making it easier for powerful actors to discredit genuine evidence. This, in turn, undermines accountability, journalism, and the very notion of truth in the public sphere. Such concerns are echoed in Indian commentary on the weakening of public discourse through viral misinformation and synthetic political content, particularly during elections or social unrest.
On the policy front, think tanks such as the Observer Research Foundation (ORF) and the Centre for Internet and Society (CIS) have begun producing important reports on AI regulation in India. 38 Their publications stress that India cannot afford to delay crafting a policy ecosystem that balances innovation with accountability. A report by ORF notes that deepfakes are particularly dangerous in societies where digital literacy is uneven and fact-checking infrastructure is weak. It calls for a multi-stakeholder approach that includes legal reform, public awareness campaigns, and investment in AI-powered detection technologies. Similarly, CIS advocates for a rights-based regulatory approach that ensures transparency, consent, and ethical data use in AI training models.
METHODOLOGY
In order to thoroughly study the legal challenges of deepfakes and the future of synthetic media driven by AI in India, this research follows a qualitative, doctrinal, and comparative approach. The subject matter calls for an interdisciplinary approach that synthesizes legal theory, new technologies, public policy, and ethical concerns. 39 As deepfakes are at the nexus of law, technology, and society, this methodology is structured to record the subtleties of each field while keeping it firmly rooted in legal analysis. The doctrinal core of this research involves the interpretation, criticism, and analysis of legal writings, statutory law provisions, and judicial judgments.
This entails a detailed study of Indian laws, including the Information Technology Act, 2000, the Indian Penal Code, and other pertinent legal frameworks to determine how they do or do not apply to deepfake-related harms. The study also includes secondary legislation like the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, which place content moderation obligations on digital platforms and have relevance to regulating synthetic media. Judicial rulings, particularly those involving interpretations of the right to privacy, freedom of speech, and cybercrimes, are likewise critically examined in order to frame the changing legal environment in India. 40 This doctrinal research is complemented with a comparative evaluation of legal models from other countries, such as the European Union, the United States, and China.
Analyzing the manner in which these jurisdictions have dealt with regulating deepfakes—be it through specialized legislation, disclosure requirements, or ethical AI standards—this study aims to glean useful insights and assess their suitability for the Indian context. This comparative aspect is essential because it gives a worldwide outlook with an awareness of the necessity for cultureand constitution-dependent solutions in India. Additionally, the methodology involves a literature review of academic studies, policy reports, think tank reports, and international law instruments. Legal academia, cyber law specialists, and technology ethicists' writing are important sources influencing the theoretical background of this dissertation.
Reports by organizations such as the Observer Research Foundation, the Internet Freedom Foundation, and international bodies such as the OECD and UNESCO are integrated to enhance the knowledge of the societal and ethical aspects of synthetic media. 41 Although this research is not empirical, it does take cognizance of actual case studies and media reports to show the material effect of deepfakes in Indian society. These instances fill the gap between law theory and social reality, depicting how a lack of strong regulation can have significant implications ranging from political misinformation to damage to reputation and cyberbullying. Together, the framework is framed as holistic and multi-layered such that legal implications of deepfakes are probed not by themselves but through the entire regime of technology, society, and governance.
Equipped with a mix of doctrinal inquiry paired with comparative, interdisciplinary, as well as hard facts insights, this research tries to create an allround as well as policy-relevant analysis of regulating India's AI-generative media.
CONCLUSION
The rise of deepfakes represents one of the most pressing and complex challenges in the intersection of law, technology, and society. As this research has explored, synthetic media powered by artificial intelligence is not merely a novelty or a byproduct of innovation—it has swiftly become a tool that, while creative and potentially beneficial in certain contexts, poses serious risks to individual rights, democratic integrity, and public trust. In India, the lack of a dedicated legal framework to tackle deepfakes has created a worrying vacuum—one where harmful content often circulates unchecked, and victims find limited recourse under existing laws. Throughout this study, it has become clear that deepfakes are not just a legal issue but a social and ethical one too.
42 From impersonating public figures to defaming private individuals, the misuse of deepfake technology has already caused real harm in India. Women, political actors, and vulnerable groups have disproportionately borne the brunt of synthetic media abuse, often with devastating consequences. And yet, the Indian legal system continues to rely on outdated laws and fragmented cyber regulations that were never designed to handle the intricacies of AIgenerated content. The Information Technology Act, 2000, and the Indian Penal Code offer some protection, but they fall short when it comes to proactive deterrence, clear definitions, and rapid response mechanisms. 43 The comparison with global frameworks reinforces this gap.
Countries like the United States and members of the European Union have already begun developing policy models, including disclosure requirements, watermarking standards, and AI ethics guidelines. 44 While these models are not perfect, they do offer India valuable insights into how regulation can evolve alongside technology. At the same time, India’s approach must remain sensitive to its own constitutional values, particularly the balance between freedom of expression and the right to privacy. The Puttaswamy judgment and subsequent jurisprudence around informational autonomy provide a strong constitutional foundation on which a forwardlooking regulatory regime can be built. Importantly, the future of regulating deepfakes in India cannot rely solely on legal provisions.
A multi-pronged strategy is needed—one that combines robust legal reform with technological interventions, public awareness campaigns, and the active involvement of digital platforms. Platforms must be held accountable for hosting synthetic media, but regulation must also ensure that innovation and creativity are not stifled. Striking this balance will be India’s biggest challenge in the coming years. Ultimately, this dissertation argues that regulation is not only necessary but urgent. The unchecked growth of deepfake technology threatens to erode trust in digital communication, compromise national security, and violate the rights of countless individuals. India, as one of the world's largest digital societies, cannot afford to delay.
It must take a bold, informed, and nuanced approach—drawing from global best practices while staying rooted in constitutional principles—to shape a future where synthetic media is governed responsibly, transparently, and ethically.