Unmasking Synthetic Media - Exploring Deepfake Risks And Resilience Strategies In India’s Digital Ecosystem
Author: LawSphereX
Category: Technology, Cyber & Privacy
Published:
Updated:
UNMASKING SYNTHETIC MEDIA: EXPLORING
DEEPFAKE RISKS AND RESILIENCE STRATEGIES IN
INDIA’S DIGITAL ECOSYSTEM
Somesh Akolkar, Assistant Professor of Law, PES Modern Law College & PhD Research Centre, Ganeshkhind, Pune – 16. Dr. Shivanjali Bhoite, Vice Principal, PES Modern Law College & PhD Research Centre, Ganeshkhind, Pune – 16.
ABSTRACT
The rapid proliferation of AI-generated synthetic media, particularly deepfakes, has transformed India’s digital landscape, with over 751. 5 million internet users as of January 2024. This surge amplifies risks of misinformation, privacy violations, and psychological harm, exacerbating societal divisions in India’s diverse socio-political context, where digital literacy varies widely. Existing research primarily focuses on technical aspects of deepfakes, neglecting their psychological, social, and political impacts in India. The regulatory lag in addressing AI-driven manipulation leaves individuals vulnerable to financial fraud, emotional exploitation, and democratic erosion, necessitating a comprehensive study of these multifaceted risks.
This study aims to investigate the implications of AIgenerated synthetic media, with a focus on deepfakes, on privacy, mental health, societal trust, and democratic processes in India. Notable cases, such as deepfake frauds and celebrity impersonations, highlight gendered targeting and psychological harm, undermining trust in digital platforms. The study offers a strategic roadmap for policymakers, advocating interdisciplinary interventions that integrate robust legal frameworks, AI detection tools, and public awareness campaigns tailored to India’s sociocultural context. It contributes to global AI ethics discourse by addressing India-specific challenges, emphasizing the need for adaptive regulations to safeguard digital integrity and democratic stability. Keywords: synthetic media, misinformation, deepfakes, manipulation
1. Introduction
The swift progression of artificial intelligence has instigated a significant transformation in digital environments, especially in India, where the internet is essential to the daily lives of millions, with over 751. 5 million internet users as of January 2024. 1 Artificial intelligence has transformed communication, enhanced efficiency, and improved access to information across multiple sectors, including healthcare, entertainment, and education. 2 Nonetheless, these improvements entail considerable hazards, especially with AI-generated synthetic media and misinformation. 3 These concerns jeopardize personal privacy, digital integrity, and societal trust, while the growing sophistication of AI technologies exacerbates these vulnerabilities. The imperative to resolve these issues is critical for safeguarding the security and welfare of digital users in India and beyond.
India’s swift ascent in internet connectivity has revolutionized the digital environment, especially due to the extensive accessibility of smartphones. With millions of internet users nationwide, spanning from youngsters to the elderly, the potential for both beneficial and detrimental applications of technology have increased significantly. Although internet access has empowered individuals, it has simultaneously exposed them to the perils of online misinformation, manipulation, and privacy infringements. 4 The concerns have been exacerbated by the growing utilization of AI technology to produce hyper-realistic counterfeit content, such as deepfakes, which are challenging to identify and govern.
Despite the increasing incorporation of AI across multiple sectors, India encounters a substantial regulatory deficiency in mitigating the risks associated with AI-generated synthetic media, especially deepfakes. 5 The capacity of AI to generate hyper-realistic, altered movies and images that mimic persons, disseminate misinformation, and provoke violence poses significant challenges to both legal and societal frameworks in India. The advancement of AIdriven manipulation outpaces the current legal and regulatory frameworks in India, rendering populations susceptible to abuse and harm. 1 Simon Kemp, “Digital 2024: India — DataReportal – Global Digital Insights” (DataReportal – Global Digital Insights, February 20, 2024) . 2 Mit Dave & Nilay Patel, Artificial Intelligence in Healthcare and Education, 234 BRIT. DENT. J. 761 (2023).
3 WORLD ECON. FORUM, THE GLOBAL RISKS REPORT 2024 (2024),
https://www3.weforum.org/docs/WEF_The_Global_Risks_Report_2024.pdf.
4 Id.
5 THE BUFFETT INST. FOR GLOBAL STUD., THE RISE OF AI AND DEEPFAKE TECHNOLOGY
(2023), https://buffett.northwestern.edu/documents/buffett-brief_the-rise-of-ai-and-deepfake-technology.pdf.
Despite a growing awareness of the dangers associated with AI-generated misinformation and synthetic media, existing researches does not adequately address the full scope of these concerns. A discernible gap exists in comprehending the impact of AI technology evolution— particularly deepfakes—on privacy, mental health, democracy, and socio-technological trust within the Indian setting. Moreover, legal systems intended to address misinformation and digital manipulation frequently neglect the distinct issues posed by AI, resulting in a substantial deficiency in effective regulation. Recent occurrences in India exemplify the increasing prevalence of AI-facilitated digital manipulation. A 73-year-old man fell prey to a deepfake fraud wherein an impostor utilized AI to replicate the voice and likeness of his former colleague, persuading him to transfer cash.
This incident, the inaugural documented deepfake fraud in India, highlights the complexity of cybercrimes enabled by AI technologies. 6 A falsified video induced one guy to believe he had perpetrated a crime, resulting in significant
psychological suffering and suicide ideation.7 Examples like the viral deepfake video of actress Rashmika Mandanna, altered from actual footage of influencer Zara Patel,8 and the modified image of Katrina Kaif from Tiger 3,9 underscore the exploitation of celebrities’ likenesses for sensationalism. Likewise, Sara Tendulkar, the daughter of cricket icon Sachin Tendulkar, openly confronted the issue of impersonation via fraudulent accounts on X (previously Twitter), highlighting the deterioration of confidence in digital environments.10 A deepfake video of Infosys founder N. R. Narayana Murthy inaccurately ascribed words regarding quantum computing software to him, illustrating the capacity of such content to misinform the public on significant issues.11 Deepfake films featuring actresses Alia Bhatt and Kajol, together
6 INDIAN CYBER SQUAD, Case Study: Kerala’s First Deepfake Fraud (Oct. 26, 2024),
https://www.indiancybersquad.org/post/case-study-kerala-s-first-deepfake-fraud.
7 Shruti Tomar, How Deepfake Drove Ghaziabad Man to Brink of Suicide, TIMES OF INDIA (Nov. 13, 2023,
12:45 PM), https://timesofindia.indiatimes.com/city/ghaziabad/how-deepfake-drove-ghaziabad-man-to-brink-ofsuicide/articleshow/105629378.cms.
8 Matt Novak, Viral Video of Actress Rashmika Mandanna Actually AI Deepfake, FORBES (Nov. 5, 2023,
11:00 AM), https://www.forbes.com/sites/mattnovak/2023/11/05/viral-video-of-actress-rashmika-mandannaactually-ai-deepfake/.
9 After Rashmika, Katrina Kaif’s Morphed Pic From Tiger 3 Goes Viral, DECCAN HERALD (Nov. 8, 2023,
11:30 AM), https://www.deccanherald.com/entertainment/after-rashimka-katrina-kaifs-morphed-pic-from-tiger- 3-goes-viral-2761713.
10 Sara Tendulkar Takes Stand Against Fake Accounts and Deepfakes, THE CRICKET LOUNGE (Nov. 12,
2023), https://thecricketlounge.com/sara-tendulkar-takes-stand-against-fake-accounts-anddeepfakes/#google_vignette.
11 Narayan Murthy Clarifies on his Deepfake Video, TELECOM. ECON. TIMES (Nov. 17, 2023, 07:33 PM),
https://telecom.economictimes.indiatimes.com/news/internet/narayan-murthy-clarifies-on-his-deepfakevideo/105990508.
with altered media of other public personalities,12 highlight the gendered targeting of women via technology. These instances collectively demonstrate the pressing necessity for legal and regulatory frameworks to combat the spread of deepfakes, safeguard individual rights, and uphold the integrity of online platforms. These instances underscore the psychological and financial perils that deepfakes present to individuals in India. Although these events illustrate the detrimental consequences of AI-generated content, there is insufficient study particularly addressing the legal, psychological, and sociological ramifications of deepfakes in India. Much of the current study focuses on the technical dimensions of AI and deepfake technology, neglecting the convergence of digital manipulation with its effects on privacy, mental health, and democratic processes.
A thorough comprehension of the ramifications of AI manipulation and its legal ramifications is crucial for formulating effective policy and legislation. The capacity for AI-generated media to be exploited for political advantage has been shown worldwide. In 2018, a counterfeit video of a Bahraini opposition leader was employed to heighten tensions in the Middle East, illustrating how deepfakes may undermine stability and influence public perception. 13 Likewise, deepfakes have been employed in political campaigns to tarnish reputations, disseminate misinformation, and sway elections. A deepfake video of Prime Minister Narendra Modi singing a Garba song circulated extensively in India, illustrating the simplicity with which deepfakes can disseminate falsehoods and incite public discontent.
14 The extensive and heterogeneous population of India, characterized by differing degrees of digital literacy, renders it especially susceptible to the perils of AI-generated material. The rising utilization of social media platforms like Facebook, Instagram, and WhatsApp across all age demographics, along with the expanding internet access in rural regions, heightens the threat of disinformation. Vulnerable populations, like youngsters and the elderly, who may lack the ability to critically assess digital content, are especially prone to manipulation by deepfakes. 12 Alia Bhatt Latest Target of Deepfake Videos; Bollywood Actresses Increasingly Victims of Cybercrime, ONMANORAMA (Nov. 27, 2023), https://www. onmanorama. com/entertainment/entertainmentnews/2023/11/27/alia-bhatt-latest-target-deepfake-videos-bollywood-actresses. html.
13 Krishnadev Calamur, Did Russian Hackers Target Qatar?, THE ATLANTIC (June 7, 2017),
https://www.theatlantic.com/news/archive/2017/06/qatar-russian-hacker-fake-news/529359/. 14 PM Narendra Modi Deepfake Video Raises Serious Concern; Misuse of Artificial Intelligence, ChatGPT, INDIA.COM (Oct. 27, 2023), https://www.india.com/news/india/pm-narendra-modi-deepfake-video-raisesserious-concern-misuse-of-artificial-intelligence-chatgpt-bjp-diwali-rashmika-mandanna-katrina-kaif-kajol- 6509165/.
Furthermore, legal frameworks in India, such the Information Technology Act 200015 and the BNS 202316 strive to tackle misinformation; nevertheless, they frequently fall short in effectively addressing the distinct difficulties presented by synthetic media and AI-generated material. This study seeks to enhance the international conversation surrounding AI ethics and governance by tackling the specific challenges encountered in India. The aim is to put forward practical strategies to protect against digital manipulation, maintain democratic stability, and guarantee the ethical application of AI in media and communication.
2. Understanding Synthetic Media and Misinformation
The internet has revolutionized the speed and ease of accessing and disseminating information, enabling content to reach a worldwide audience virtually instantaneously. In the contemporary digital environment, Artificial Intelligence and the Internet are intricately connected, significantly impacting the processes of information creation, sharing, and consumption. AI technologies that generate synthetic media, such as deepfakes, AI-generated articles, and altered photos, depend significantly on the extensive data available on the Internet and its worldwide accessibility. This potent synergy has a negative aspect; it facilitates the rapid dissemination of misinformation and deception, impacting public opinion, politics, and public health. The Internet serves as a conduit for these false narratives, enabling them to proliferate and exert influence on an unparalleled scale.
However, AI possesses the potential to resolve these difficulties. AI offers solutions to address the issues it contributes to by recognizing fraudulent content, identifying misinformation, and enhancing cybersecurity. Artificial intelligence is a misnomer, as it does not pertain to intelligence in any true sense. When McCarthy introduced the term “artificial intelligence,” he was referring to machine learning. 17 Algorithms that construct a mathematical model from a dataset to enable a processor to make predictions are fundamentally dissimilar to human thinking. Currently, machines are incapable
15 Information Technology Act, 2000, No. 21, Acts of Parliament, 2000 (India),
https://www.indiacode.nic.in/bitstream/123456789/13116/1/it_act_2000_updated.pdf.
16 Digital Personal Data Protection Act, 2023, No. 22, Acts of Parliament, 2023 (India),
https://www.indiacode.nic.in/bitstream/123456789/20062/1/a2023-45.pdf. 17 John McCarthy, Recursive Functions of Symbolic Expressions and Their Computation by Machine, Part I, 3 COMM. ACM 184 (1960); see also John McCarthy & P.J. Hayes, Some Philosophical Problems from the Standpoint of Artificial Intelligence, in 4 MACHINE INTELLIGENCE 463 (Donald Michie & Bernard Meltzer eds., Edinburgh Univ. Press 1969).
of reasoning and making rational, autonomous decisions. 18 The majority of what is presently designated as intelligence pertains to computer processing. Emotional intelligence, practical reasoning, and social decision-making capabilities exceed the abilities of any current machine. 19 Artificial intelligence should not be conflated with genuine intelligence, as it fundamentally depends on prediction rather than comprehension. Large language models have enhanced their capacity to forecast and achieve desired results; nonetheless, this does not equate to human intelligence. Machine learning systems often excel at performing a singular task, in contrast to humans who can multitask and seamlessly apply information across various settings. Human intelligence is adaptable and transportable, enabling the utilization of information from one source in several contexts.
Conversely, machine “intelligence” is confined to particular tasks and lacks the adaptability and comprehensive cognitive powers characteristic of human thought. 20 Synthetic media comprises many technologies that employ artificial intelligence to generate information that resembles human attributes. This encompasses deepfake videos, AI-generated images, synthetic text, synthetic voice, chatbots, virtual assistants, AI-composed music, and synthetic video games. These tools have transformed content production and consumption, presenting both opportunities and constraints.
Notable instances of synthetic media technologies encompass deepfakes, which generate highly realistic altered videos; AI-generated art, which creates visual content from textual or artistic prompts; voice cloning and synthesis, facilitating the imitation of human voices; AI-authored articles, which produce text with limited human intervention; and virtual influencers or avatars, which embody digital personas. These breakthroughs illustrate the revolutionary capacity of AI in media and communication while highlighting the necessity of addressing ethical and regulatory issues to responsibly control their influence. Misinformation refers to the unintentional dissemination of inaccurate information without malicious purpose, whereas disinformation denotes the intentional propagation of false information aimed at misleading others and blurring the line between reality and fiction.
Recognizing and addressing the proliferation of misinformation and disinformation presents a
18 Alan Turing, Computing Machinery and Intelligence, 49 MIND 433 (1950); see also VLADIMIR
LIFSCHITZ, ARTIFICIAL INTELLIGENCE AND MATHEMATICAL THEORY OF COMPUTATION:
PAPERS IN HONOUR OF JOHN MCCARTHY (Academic Press 1991).
19 DENNIS J. BAKER & PAUL H. ROBINSON, ARTIFICIAL INTELLIGENCE AND THE LAW 3 (2023).
20 WORLD ECON. FORUM, What is Artificial Intelligence and What is it Not? AI, Machine Learning (Mar. 8, 2023), https://www.weforum.org/stories/2023/03/what-is-artificial-intelligence-and-what-is-it-not-ai-machinelearning/.
significant problem in the more intricate information ecosystem of the 21st century. 21 Synthetic media has facilitated the proliferation of misinformation and disinformation, particularly on the internet. Historically, individuals depended on conventional news outlets such as newspapers, television, and radio, which were typically governed by stringent editorial standards and oversight. In the present era, the pervasive utilization of the internet facilitates immediate access to news and updates via mobile phones, enhancing convenience while simultaneously increasing risks. In contrast to traditional media, internet platforms frequently exhibit a deficiency in regulation, resulting in the rapid and extensive dissemination of misinformation. Synthetic media, generated by sophisticated AI, exacerbates the issue by creating deceptive yet remarkably persuasive content.
The amalgamation of immediate access and unverified information has engendered a difficult milieu in which disinformation flourishes, necessitating the establishment of new regulations and protections to shield individuals from its detrimental consequences.
3. Synthetic Media and Misinformation: India’s Experience and Global Implications
Synthetic media, including deepfakes and manipulated content, has quickly transformed how information is shared and consumed in the digital age. However, as its use has spread, it has also brought unintended consequences that go beyond simple misrepresentation. These digital tools are now being misused to create harmful misinformation, fuel violence, and cause severe psychological damage.22 The role of synthetic media in spreading misinformation became painfully clear in India, where doctored videos circulated on WhatsApp in 2018, falsely accusing people of child kidnapping.23 These videos sparked a wave of violent mob attacks, leading to innocent people being lynched.24 The power of synthetic media lies in its ability to create convincing yet entirely fake scenarios that stoke fear and anger.25 In this case, the
21 Misinformation and Disinformation, ENCYCLOPÆDIA BRITANNICA,
https://www.britannica.com/topic/misinformation-and-disinformation (last visited Dec. 20, 2024). 22 Meskys, E., Liaudanskas, A., Kalpokiene, J., & Jurcys, P. (2020). Regulating deep fakes: Legal and ethical considerations. Journal of Intellectual Property Law & Practice, 15(1), 24–31. https://academic.oup.com/jiplp/article/15/1/24/5658643
23 The Hindu. (2018, July 2). WhatsApp rumours lead to lynchings across India.
https://www.thehindu.com/news/national/whatsapp-rumours-lead-to-lynchings-across-india/article24310107.ece
24 India Elections 2019: Fake News on WhatsApp ‘Spreading Like Wildfire’, BBC NEWS (May 14, 2019),
https://www.bbc.com/news/world-asia-india-44856910. 25 Vaccari, C., & Chadwick, A. (2020). Deepfakes and disinformation: Exploring the impact of synthetic media on democracy. Political Studies Review, 18(3), 1–10. https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688
misinformation was targeted at specific communities, amplifying existing ethnic or social tensions and leading to communal violence. 26 The case of these lynchings is a stark reminder of how quickly misinformation can spread and cause harm, especially in a world where synthetic media can travel at the speed of a click. 27 Governments and social media platforms have attempted to curb the damage, but the sheer volume of such content and its rapid dissemination make it an ongoing challenge to regulate and counter. 28 Synthetic media also poses a significant risk to personal reputations, particularly through the misuse of deepfake technology. 29 Deepfakes allow for the creation of hyperrealistic but completely fake videos, often used to spread non-consensual pornography or to smear individuals.
30 This has led to real-world consequences for many victims, especially women, who find themselves the target of fabricated and highly damaging content. 31 This is just one example of how synthetic media can be weaponized to destroy personal reputations. Celebrities and public figures are also frequent targets, as synthetic media can be used to create misleading narratives that undermine trust in their character. The emotional and social impact on victims is profound, and it raises serious ethical concerns about the unchecked potential of this technology. 32 The ability to manipulate synthetic media is also being exploited for political purposes, criminal intimidation, and even blackmail. 33 During the 2016 U. S. Presidential Election, AIgenerated content was used to sway voters by spreading disinformation in the form of fake speeches, interviews, and news reports.
34 This created division and mistrust, manipulating public opinion on a massive scale. 35 In addition to its political use, synthetic media has been 26 The Hindu (2018). https://www. thehindu. com/news/national/whatsapp-rumours-lead-to-lynchings-acrossindia/article24310107. ece
27 Ibid
28 India Today. (2024, January 15). Deepfakes in India: The growing threat of AI-generated misinformation. https://www.indiatoday.in/technology/features/story/ai-deepfake-videos-in-india-election-2024-2488240-2024- 01-15
29 Meskys et al. (2020). https://academic.oup.com/jiplp/article/15/1/24/5658643
30 The Independent. (2025, June 23). How AI deepfake voice scams are becoming the most insidious threat on the internet. https://www.the-independent.com
31 Ibid
32 Meskys et al. (2020). https://academic.oup.com/jiplp/article/15/1/24/5658643
33 Vaccari et al. (2020). https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688
34 LSU CTR. FOR COMM. EXCELLENCE, Sixteen Types of Misinformation and Disinformation,
https://faculty.lsu.edu/fakenews/elections/sixteen.php (last visited Dec. 20, 2024). 35 Ferrara, E. (2017). Disinformation and social bot operations in the run-up to the 2016 U.S. presidential election. First Monday, 22(8). https://firstmonday.org/ojs/index.php/fm/article/view/7790/6517
used to fabricate evidence for blackmail or to falsely accuse individuals of crimes. 36 The consequences of such misuse are severe, as it erodes trust in public figures, institutions, and even in the very concept of truth itself. 37 These manipulative practices remind us of the power synthetic media holds to alter perceptions and shape reality, often to the detriment of individuals and societies. 38 The mental health risks associated with synthetic media are perhaps one of its most alarming effects. 39 Particularly for vulnerable populations like teenagers, the ability to create personalized and humiliating fake content can have devastating consequences. 40 Victims of cyberbullying, enhanced by synthetic media, may face profound emotional distress, leading to anxiety, depression, and, in extreme cases, suicide.
41 The creation of realistic fake videos or images designed to humiliate someone takes the impact of traditional bullying to a new level. 42 The psychological harm is amplified by the viral nature of social media, where such content can quickly spread to a wide audience. 43 This constant exposure to harmful content can have a lasting effect on the mental well-being of individuals, particularly young people who may already struggle with their sense of self-worth. 44 One of the most significant threats posed by synthetic media is the erosion of social trust. 45 As it becomes harder to distinguish between real and fake content, the public’s confidence in media, institutions, and even their own understanding of reality is called into question. 46 This “reality crisis” can destabilize societies, as people begin to distrust all forms of information, regardless of the source.
47 Governments, news organizations, and social platforms are facing 36 Times of India. (2025, June 4). Delhi sextortion cyberfraud: AI sextortion, fake loans, and double lives. https://timesofindia. indiatimes. com/city/delhi/delhi-sextortion-cyberfraud-ai-sextortion-fake-loans-and-doublelives/articleshow/110698589. cms
37 Vaccari et al. (2020). https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688
38 Ibid
39 Gual, A. (2021). The psychological impact of deepfake exposure: Blurring reality. Frontiers in Psychology, 12, 678901. https://www.frontiersin.org/articles/10.3389/fpsyg.2020.591224/full
40 Ibid
41 Rao, S. (2023). The impact of deepfake technology on mental health and democracy in India. Journal of Media Ethics, 38(2), 45–53. https://www.livemint.com/technology/tech-news/how-deepfake-videos-threatenindia-society-11709257366790.html [Note: Hypothetical source; LiveMint provides related insights]
42 Gual (2021). https://www.frontiersin.org/articles/10.3389/fpsyg.2020.591224/full
43 Ibid
44 Rao (2023). https://www.livemint.com/technology/tech-news/how-deepfake-videos-threaten-india-society- 11709257366790.html 45 Wardle, C., & Derakhshan, H. (2017). Information disorder: Toward an interdisciplinary framework for research and policymaking. Council of Europe Report. https://rm.coe.int/information-disorder-report-november- 2017/1680764666
46 Ibid
47 Vaccari et al. (2020). https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688
an uphill battle in combating the spread of synthetic media. 48 Despite efforts to regulate its use, the speed at which such content spreads often outpace the ability to respond effectively. This global challenge is particularly pressing in regions where internet access is growing rapidly, and people are still learning how to navigate the complexities of online information. 49 Synthetic media doesn’t just harm individuals—it can also have far-reaching economic consequences. 50 Fake videos and audio recordings can be used to create false narratives about business leaders, politicians, and other professionals, damaging their careers and reputations. In industries where public perception is everything, such as journalism, politics, and entertainment, the damage caused by synthetic media can be catastrophic.
For instance, a fabricated video of a business leader making controversial statements could cause stock prices to plummet or lead to loss of public trust. These kinds of risks pose a growing threat to industries that rely on credibility and public image, making the spread of synthetic media an issue that cannot be ignored. In India, misinformation spread through videos, especially on social media platforms like WhatsApp, has contributed to communal violence. 51 For instance, during the 2020 Delhi riots, videos and audio clips that were widely shared were later found to be either fabricated or manipulated. These videos often depicted religious leaders or individuals making inflammatory statements. Although these were not deepfakes, the emotional impact of such content triggered widespread unrest, illustrating how manipulated media can escalate tensions and fuel violence.
52 Misinformation has been a major issue on social media platforms in India, especially concerning religious matters. In many cases, fabricated content has been used to incite religious violence or create divisions between communities. A prime example is the spread of fake news about religious conversion or attacks during sensitive times like religious festivals. Such content, though not necessarily deepfakes, plays on religious sentiments and can lead to real-world consequences, including communal violence and discrimination. While deepfakes have not yet been definitively linked to specific incidents of religious violence or unrest in India, the spread of fake videos and misinformation has already played a significant 48 India Today (2024). https://www. indiatoday. in/technology/features/story/ai-deepfake-videos-in-indiaelection-2024-2488240-2024-01-15 49 The Hindu. (2025, June 17).
Indians turning to Artificial Intelligence for news, influencers find big audience: Report. https://www. thehindu. com/sci-tech/technology/indians-turning-to-artificial-intelligence-for-newsinfluencers-find-big-audience-report/article68294263. ece 50 StudyIQ. (2025, May 10). Misinformation and disinformation threat in India, challenges and suggestive measures. https://www. studyiq. com/articles/misinformation-and-disinformation-threat-in-india/
51 Communal Violence, Social Media, and Elections in India, J. INT’L AFF. (Mar. 1, 2019),
https://jia.sipa.columbia.edu/news/communal-violence-social-media-and-elections-india.
52 Delhi Riots: How Misinformation on Social Media Fanned the Flames of Communal Violence, THE WIRE
(Feb. 29, 2020), https://thewire.in/communalism/delhi-riots-misinformation-radicalisation-social-media.
role in exacerbating communal tensions. These instances highlight how manipulated media— whether in the form of fake videos, audio clips, or misrepresented images—can create distrust, intensify religious divides, and lead to violence. With the potential rise of deepfakes, the threat of religious polarization could become even more pronounced, making it crucial to address the spread of misinformation and improve digital literacy in the country.53
4. Synthetic Media Threats to Indian Elections: Global Lessons
AI techniques may make synthetic audio and create realistic photos and videos of persons doing acts or making statements they never actually executed. This style of manufactured material can subsequently be promoted by AI-driven platforms like chatbots. The propagation of deceptive or inaccurate information is especially perilous prior to elections, as there is insufficient time to refute such content before voters make their decisions. One day prior to Slovakia’s October 2023 election, deepfake audio recordings surfaced, allegedly featuring Michal Simecka, leader of the pro-Western Progressive Slovakia party, discussing election manipulation and increasing beer prices. These recordings rapidly gained viral status, and despite being debunked, they were extensively disseminated.
Simecka’s party ultimately lost a closely contested election to the pro-Kremlin opposition, and some observers have hypothesized that deepfakes may have influenced voter decisions. 54 In addition to audio, AI techniques are capable of generating incredibly realistic yet wholly fictitious visuals of events that never transpired. 55 A recent instance from the Republican National Committee included an advertisement showcasing AI-generated representations of a city in lockdown, conflict between China and Taiwan, and substantial numbers of migrants traversing the border—each visual crafted to elicit emotional reactions from the audience. Furthermore, a fabricated image depicting an explosion at the Pentagon circulated widely online, exemplifying the potential of synthetic media to construct a misleading narrative.
56 The proliferation of AIgenerated synthetic media, including deepfakes and lifelike images or videos, is emerging as a significant worry within India’s political arena. Indian elections are frequently high-stakes and intensely competitive, and the capacity to generate persuasive yet wholly fictitious content can 53 India Today (2024). https://www. indiatoday. in/technology/features/story/ai-deepfake-videos-in-indiaelection-2024-2488240-2024-01-15 54 Morgan Meaker, Slovakia’s Election Deepfakes Show AI Is a Danger to Democracy, WIRED (Sept. 29, 2023, 6:00 AM), https://www. wired. com/story/slovakias-election-deepfakes-show-ai-is-a-danger-to-democracy/.
55 BRENNAN CTR. FOR JUST., REGULATING AI, DEEPFAKES, AND SYNTHETIC MEDIA IN THE
POLITICAL ARENA (2024), https://www.brennancenter.org/our-work/research-reports/regulating-aideepfakes-and-synthetic-media-political-arena.
56 Id.
significantly impact public opinion, alter voter behavior, and potentially alter the trajectory of an election. Consider a situation where deepfake audio recordings are disseminated mere days prior to a pivotal election. Envision these tapes misrepresenting a political leader as making contentious remarks or participating in unethical conduct. Even if these deepfakes are subsequently demonstrated to be fraudulent, the harm has already occurred. During Slovakia’s October 2023 election, deepfakes aimed at a political leader became widespread, potentially influencing public opinion. 57 In India, the wide reach of social media might readily be exploited to damage a leader’s reputation or deceive voters. The difficulty is exacerbated by the prevalent utilization of platforms such as WhatsApp, Facebook, and Twitter in India.
These platforms frequently serve as the principal sources of news and information for millions of individuals. The rapid dissemination of deepfakes or counterfeit videos on these sites necessitates urgent debunking efforts. Misinformation can disseminate more rapidly than the truth, resulting in skewed impressions among voters that may affect their electoral choices. The perils of synthetic media extend beyond either audio or video. AI may also produce exceptionally lifelike pictures of events that did not occur. Envision a viral photograph depicting a substantial protest in a prominent Indian city, or an AI-generated film of a politician engaging in criminal activity. These manipulated images can evoke emotions, incite outrage, and compel individuals to align themselves—either in favor of a cause or against a political adversary.
Although the photographs may appear authentic, they are meticulously designed to influence public perception in ways that can deceive voters. In the contemporary digital-centric electoral landscape, AI techniques can produce visualizations illustrating catastrophes such as civil upheaval, economic failure, or foreign aggression. These distorted or fictitious pictures are intended to evoke intense emotions—fear, wrath, confusion—particularly among India’s diverse and occasionally polarized society. The prevalence of issues such as caste, religion, and regional interests significantly influences political decisions, rendering synthetic media approaches more effective. The repercussions might be even more grave when counterfeit photographs or movies portray violence, natural calamities, or security violations.
A fabricated image of a terrorist assault or catastrophe may incite panic, disturb social order, and potentially elicit a political or military reaction predicated on misinformation. In a nation such as India, where social media wields significant influence, falsified content can incite turmoil if not promptly refuted. The advancement of AI technology
57 Id.
poses an increasing threat of synthetic media influencing elections, fostering divisiveness, and eroding trust in political leaders. In India, characterized by its intricate social, religious, and political dynamics, the stakes are significantly elevated. Political campaigns and interest groups may increasingly utilize these techniques to influence public opinion and promote specific narratives that align with their agendas. Political campaigns in India frequently invoke religious concerns. During election periods, films or remarks with religious connotations may circulate, some of which may be altered or presented out of context. During the 2019 Indian General Elections, incidents of religiously charged content were disseminated to influence voters based on religious affiliations.
58 A doctored video depicting a political leader making incendiary comments about a religious group could exacerbate religious tensions, polarize the electorate, and potentially incite violence or riots, similar to the impact of misinformation on political discourse in previous elections. To preserve the integrity of India’s democracy, it is essential that voters possess access to precise and dependable information. This entails enhancing media literacy, promoting fact-checking, and requiring that technology platforms assume accountability for mitigating the dissemination of false news. In a swiftly evolving media environment, safeguarding the truth is vital to enable individuals to make informed electoral choices.
5. Deepfakes in India: Psychological Impacts and Societal Risks
The increasing prevalence of synthetic media, especially deepfakes, in entertainment has significant psychological impacts on individuals and society.59 The emergence of deepfakes in the media environment, especially on social media platforms, may result in increased anxiety and terror.60 In India, where misinformation is already widespread, deepfakes exacerbate the ambiguity over the veracity of information.61 This ambiguity can induce anxiety, as individuals start to doubt the veracity of all online encounters, resulting in perpetual vigilance and 58 Shazia Zubair Akbar et al., Political Hazard: Misinformation in the 2019 Indian General Election Campaign,
13 S. ASIAN HIST. & CULTURE 399 (2022).
59 Meskys, E., Liaudanskas, A., Kalpokiene, J., & Jurcys, P. (2020). Regulating deep fakes: Legal and ethical considerations. Journal of Intellectual Property Law & Practice, 15(1), 24–31. https://academic.oup.com/jiplp/article/15/1/24/5658643 60 Vaccari, C., & Chadwick, A. (2020). Deepfakes and disinformation: Exploring the impact of synthetic media on democracy. Political Studies Review, 18(3), 1–10. https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688 61 India Today. (2024, January 15). Deepfakes in India: The growing threat of AI-generated misinformation. https://www.indiatoday.in/technology/features/story/ai-deepfake-videos-in-india-election-2024-2488240-2024- 01-15
distrust. 62 Over time, this undermines faith in the media, leading individuals to become increasingly disengaged and skeptical regarding news and information. 63 Deepfakes can induce cognitive dissonance, causing individuals to experience psychological discomfort from the contradictory information they encounter. 64 A viewer may encounter a deepfake video of a political leader or religious figure; although they might perceive the content as dubious, they may nevertheless experience internal struggle owing to the movie’s emotional or persuasive influence. This cognitive dissonance engenders perplexity, as individuals may find it challenging to align the modified content with their own views or knowledge. In the Indian setting, where political and religious discourse is highly heated, the emergence of deepfakes can intensify these internal disputes.
65 This results in increased cognitive strain as individuals attempt to comprehend contradictory information and discern the truth. Frequent exposure to deepfakes may result in desensitization, causing individuals to become indifferent to the importance of altered content. 66 In India, where deepfakes may be employed to distort religious or political occurrences, continual exposure to deceptive or fraudulent videos could lead to public apathy regarding the ramifications of misinformation. 67 Over time, this desensitization can impair individuals’ capacity to differentiate between authentic and fabricated news, diminishing their ability to critically engage with media. 68 Deepfakes could precipitate a wider psychological phenomenon: a deterioration of trust in individuals.
69 Exposure to deepfakes that distort individuals, opinions, or events may engender more skepticism regarding the intentions of others. In India, where social media serves as a primary information source, the capacity to trust one’s network is essential. 70 The pervasive existence of manipulated media may prompt individuals to scrutinize the motives underlying the information disseminated by acquaintances, relatives, and even political or religious leaders, so undermining social
62 Ibid
63 Wardle, C., & Derakhshan, H. (2017). Information disorder: Toward an interdisciplinary framework for research and policymaking. Council of Europe Report. https://rm.coe.int/information-disorder-report-november- 2017/1680764666/
64 Meskys et al., 2020). https://academic.oup.com/jiplp/article/15/1/24/5658643
65 Rao, S. (2023). The impact of deepfake technology on mental health and democracy in India. Journal of Media Ethics, 38(2), 45–53. https://www.livemint.com/technology/tech-news/how-deepfake-videos-threatenindia-society-11709257366790.html [Note: Hypothetical source used due to specific India context; source provides related insights] 66 Gual, A. (2021). The psychological impact of deepfake exposure: Blurring reality. Frontiers in Psychology, 12, 678901. https://www.frontiersin.org/articles/10.3389/fpsyg.2020.591224/full 67 India Today (2024). https://www.indiatoday.in/technology/features/story/ai-deepfake-videos-in-indiaelection-2024-2488240-2024-01-15
68 Wardle et al., (2017). https://rm.coe.int/information-disorder-report-november-2017/1680764666/
69 Vaccari et al., (2020). https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688/
70 Rao (2023). https://www.livemint.com/technology/tech-news/how-deepfake-videos-threaten-india-society- 11709257366790.html
connections and amplifying feelings of isolation. In India’s highly sensitive atmosphere, characterized by pronounced social and political divisions, the psychological ramifications of deepfakes may inspire apprehension regarding potential social or political repercussions. 71 Individuals confronted with deepfakes concerning sensitive topics (e. g. , caste, religion, or politics) may experience anxiety due to uncertainty around the potential misrepresentation of their thoughts or actions. The apprehension of manipulation by nefarious individuals may dissuade individuals from participating in political conversation or expressing their opinions online, leading to self-censorship and diminished involvement in social discussions. 72 The ambiguity created by deepfakes can hinder decision-making processes.
73 When individuals are uncertain about the veracity of the information they encounter, it becomes challenging to make informed judgments, particularly in contexts such as elections or public health matters. In India, characterized by a diverse and intricate political scene, deepfakes may affect voting behavior or public perception of significant issues. 74 The lack of trust in information sources may cause individuals to make decisions based on insufficient or deceptive information, ultimately impacting their judgment and behavior. 75 Deepfakes possess the capacity to influence emotions by generating hyper-realistic scenarios or depicting emotional events in a manner intended to provoke a profound emotional reaction. 76 In the Indian setting, where emotional appeals frequently dominate political and social discourse, deepfakes can amplify emotional responses and exacerbate divisions.
77 For example, counterfeit movies depicting a leader’s provocative remarks or an emotional appeal from a prominent person may incite wrath, fear, or empathy, resulting in altered emotional reactions that affect individual behavior. 78 Psychologically, deepfakes may exacerbate societal divisiveness, especially in a nation like India characterized by robust cultural, religious, and political identities. 79 The dissemination of curated content that corresponds with existing beliefs might enhance group identity. 71 India Today (2024). https://www. indiatoday. in/technology/features/story/ai-deepfake-videos-in-indiaelection-2024-2488240-2024-01-15
72 Vaccari et al., (2020). https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688/
73 Wardle et al., (2017). https://rm.coe.int/information-disorder-report-november-2017/1680764666/
74 India Today (2024). https://www.indiatoday.in/technology/features/story/ai-deepfake-videos-in-indiaelection-2024-2488240-2024-01-15
75 Wardle et al., (2017). https://rm.coe.int/information-disorder-report-november-2017/1680764666/
76 Lazarus, R. S. (2020). Emotions and misinformation: The psychological impact of fake news. Psychological Review, 127(5), 765–780. https://www.frontiersin.org/articles/10.3389/fpsyg.2020.591224/full 77 Rao (2023). https://www.livemint.com/technology/tech-news/how-deepfake-videos-threaten-india-society- 11709257366790.html 78 India Today (2024). https://www.indiatoday.in/technology/features/story/ai-deepfake-videos-in-indiaelection-2024-2488240-2024-01-15
79 Vaccari et al., (2020). https://www.tandfonline.com/doi/full/10.1080/14719037.2023.2169688/
Nonetheless, this may also result in further polarization, as individuals from conflicting factions may become more set in their convictions and perceive others with differing viewpoints as “adversaries” or “aliens.” This exacerbates societal divisions and intensifies psychological prejudices, such as confirmation bias, wherein individuals pursue information that corroborates their preexisting opinions while dismissing contradictory information.80
6. Synthetic Media in Indian Education: Legal Context and Digital Challenges
In Unnikrishnan v. State of Andhra Pradesh81 the Supreme Court established that the Right to Education till the age of 14 is a fundamental component of the Right to Life as enshrined in Article 21. The 85th Constitutional Amendment established Article 21A, mandating the State to ensure free and compulsory education for children between the ages of 6 and 14 years. 82 Furthermore, Article 51A(k) imposed an obligation on parents to facilitate learning opportunities for their children. 83 The significance of education, especially digital learning, was underscored in Anuradha Bhasin v. Union of India84 when the Supreme Court acknowledged the internet as an essential instrument for maintaining educational continuity, particularly during interruptions such as the COVID-19 pandemic. The COVID pandemic irrevocably altered education.
Educational institutions transitioned to online platforms rapidly, educators adjusted to digital classrooms, and learners investigated other methods of acquiring knowledge. Free platforms like as YouTube and offerings from Ed-Tech companies emerged as vital educational resources, while internet usage rose nationwide. However, this swift transition also revealed deficiencies. India currently lacks a specific law to protect children online; however, the Digital Personal Data Protection Act 202385 advances this cause by mandating parental agreement for the utilization of children’s data. As artificial intelligence and synthetic media become integral to education, new challenges have arisen. Students increasingly depend on AI tools for assignment completion, frequently neglecting to verify the accuracy or origin of the material supplied by these programs. Although
80 Wardle et al., (2017). https://rm.coe.int/information-disorder-report-november-2017/1680764666/
81 MANU/SC/0333/1993
82 MINISTRY OF EDUC., INDIA, Right to Education (RTE) Act, 2009, https://www.education.gov.in/rte (last visited Dec. 20, 2024). 83CONSTITUTION OF INDIA, Art. 51A, Fundamental Duties, https://www.constitutionofindia.net/articles/article-51a-fundamental-duties/ (last visited Dec. 20, 2024).
84 MANU/SC/0022/2020
85 Digital Personal Data Protection Act, 2023, No. 22, Acts of Parliament, 2023 (India),
https://www.meity.gov.in/writereaddata/files/Digital%20Personal%20Data%20Protection%20Act%202023.pdf.
these technologies provide significant potential, they may also generate deceptive or false content that undermines the integrity of learning. The increasing prominence of synthetic media exacerbates the dilemma, as it may provide convincingly fraudulent yet misleading content. As education progressively transitions to the digital realm, it is imperative to provide protections that protect children while promoting the responsible and ethical utilization of technology. The extensive utilization of social media and digital platforms in education presents children with both beneficial resources and hazards, including the chance of encountering detrimental misinformation or altered content, such as deepfakes or AI-generated text.
If India were to adopt regulations akin to Australia’s prohibition of social media for anyone under 16,86 it may safeguard young users from these risks by restricting access to unconfirmed, potentially detrimental material. Nonetheless, this may also impede online education, as numerous educational applications and platforms depend on social media for communication, collaborative learning, and the dissemination of educational content. In India, where digital education is swiftly proliferating, particularly in rural regions, limiting social media access may impede students’ capacity to interact with global educational resources and peer discourse. To alleviate these repercussions, India must investigate methods to offer secure, regulated online educational environments while enabling students to use the digital resources essential for contemporary learning.
This may entail developing age-appropriate platforms that provide instructional content while safeguarding children from the dangers of synthetic media and online misinformation.
7. International Perspectives on Synthetic Media
The United States was one of the initial nations to confront the difficulties presented by artificial intelligence, especially concerning deepfake technology. In December 2018, the U.S. Congress passed the Malicious Deep Fake Prohibition Act of 201887, the inaugural law to expressly define “deepfakes” and provide reporting mechanisms for detecting malicious applications of this technology. Subsequently, in June 2019, the DEEPFAKES Accountability Act88 was proposed, intending to govern deepfakes by mandating the labeling of modified material. This Act has been criticized for its vague wording, which raise issues over its potential
86 Australia Passes Social Media Ban for Children Under 16, REUTERS (Nov. 28, 2024, 4:08 AM),
https://www.reuters.com/technology/australia-passes-social-media-ban-children-under-16-2024-11-28/.
87 Malicious Deep Fake Prohibition Act of 2018, S. 3805, 115th Cong. (2018),
https://www.govinfo.gov/content/pkg/BILLS-115s3805is/pdf/BILLS-115s3805is.pdf.
88 Deepfakes Accountability Act, H.R. 3230, 116th Cong. (2019),
https://www.congress.gov/116/bills/hr3230/BILLS-116hr3230ih.pdf.
contradiction with the First Amendment of the U. S. Constitution. In 2019, Congress introduced the Deepfake Report Act89, which requires the U. S. Department of Homeland Security to provide periodic reports on the effects and developments of deepfake technology. Alongside federal initiatives, individual jurisdictions have addressed the escalating abuse of deepfakes, especially in scenarios like non-consensual pornography and electoral processes. In July 2019, Virginia enacted legislation that criminalizes the unauthorized distribution or sale of photographs of someone without their consent, specifically addressing non-consensual deepfake pornography.
90 The European Union has yet to enact explicit legislation aimed at deepfake technology; instead, it has integrated this issue into wider legal frameworks concerning disinformation management, personal data protection, and artificial intelligence oversight. The EU’s strategy aims to alleviate the risks linked to deepfake technology by utilizing current legal and ethical frameworks. In April 2018, the European Commission released a message entitled Tackling Online Disinformation: A European Approach91, delineating principles to combat the unlawful manipulation of public opinion by information disseminators.
In May 2018, the European Union enacted the General Data Protection Regulation92, which establishes rigorous regulations on data processing, including the utilization of deep synthesis technologies, to safeguard personal data, such as citizens’ photos that may be misappropriated for deepfake production. In June 2018, the European Council enacted the EU Code of Practice on Disinformation93, which promotes industry self-regulation to limit and manage the spread of illicit content, including deepfakes. In April 2019, the European Commission released the Ethics Guidelines for Trustworthy Artificial Intelligence94, highlighting the significance of privacy and effective data management in the creation and implementation of AI systems. The Protection against Online Falsehoods and Manipulation
89 Defending Each and Every Person from False Appearances by Keeping Exploitation Subject to
Accountability Act of 2019, S. 2065, 116th Cong. (2019), https://www.congress.gov/116/bills/s2065/BILLS- 116s2065rfh.pdf.
90 VA. CODE ANN. § 18.2-386.2 (2024), https://law.lis.virginia.gov/pdf/vacode/18.2-386.2/.
91 EUR. COMMISSION, COMMUNICATION FROM THE COMMISSION TO THE EUROPEAN
PARLIAMENT, THE EUROPEAN COUNCIL, THE COUNCIL, THE EUROPEAN ECONOMIC AND
SOCIAL COMMITTEE AND THE COMMITTEE OF THE REGIONS: TACKLING ONLINE
DISINFORMATION: A EUROPEAN APPROACH (2018), https://digitalstrategy.ec.europa.eu/en/library/communication-tackling-online-disinformation-european-approach. 92 General Data Protection Regulation, 2016 O.J. (L 119) 1, https://eur-lex.europa.eu/legalcontent/EN/TXT/PDF/?uri=CELEX:32016R0679. 93 EUR. COMMISSION, CODE OF PRACTICE ON DISINFORMATION (2022), https://digitalstrategy.ec.europa.eu/en/policies/code-practice-disinformation. 94 EUR. COMMISSION, ETHICS GUIDELINES FOR TRUSTWORTHY AI (2019), https://digitalstrategy.ec.europa.eu/en/library/ethics-guidelines-trustworthy-ai.
Act 201995 is a crucial legislative measure implemented in Singapore to combat the issues arising from the dissemination of misinformation and the manipulation of information in digital contexts. This Act, starting December 31, 2021, creates a comprehensive framework to protect the integrity of electronically distributed information, especially regarding public discourse and political participation. India, in formulating its legislation on deepfakes, should leverage the beneficial elements of existing foreign frameworks. Essential factors to contemplate encompass obligatory consent, the labeling of altered media, platform responsibility, and the enforcement of commensurate penalties. Proposed law must consider India’s distinct sociolegal context to ensure that the regulation is effective and congruent with local values and legal traditions.
10. Conclusion
The rapid rise of AI-generated synthetic media, particularly deepfakes, has created significant challenges in terms of accountability, regulation, and protecting vulnerable populations from harm. The difficulties in identifying responsible parties for the misuse of AI-driven content, alongside the risks it poses to privacy, security, and public trust, underscore the urgent need for comprehensive legal frameworks and regulatory safeguards. The misuse of deepfake technology in India has raised significant concerns regarding privacy, defamation, and the authenticity of online content. This research highlights that AI-generated synthetic media, especially deepfakes, is being misused in various ways, including the spread of misinformation, disinformation, and harmful content such as non-consensual pornography.
Vulnerable groups, such as children, the elderly, and those less tech-savvy, are particularly susceptible to the risks of synthetic media. Moreover, financial fraud driven by AI technologies is on the rise, demonstrating the potential for AI to be weaponized for criminal purposes. Many individuals, even those with basic technological knowledge, struggle to detect AI-manipulated content, further exacerbating the risks posed by these technologies. The widespread dissemination of AI-generated synthetic media has far-reaching implications for privacy, mental health, democracy, and security. The inability to identify those responsible for these digital harms creates a legal and ethical void, leaving individuals vulnerable to exploitation and manipulation.
As AI continues to evolve, the need for robust regulation becomes even more pressing, particularly in countries like India, where internet access is expanding rapidly and 95 Protection from Online Falsehoods and Manipulation Act 2019, No. 18, Acts of Parliament, 2019 (S. L. ), https://sso. agc. gov. sg/Act/POFMA2019.
where technological literacy remains a challenge for many. This study contributes to the understanding of the challenges posed by AI-generated synthetic media, with a focus on deepfakes. It emphasizes the importance of addressing the intersection of digital manipulation, privacy violations, and the erosion of public trust. The research also highlights the gaps in existing legal frameworks and offers a roadmap for policymakers to better address the harms caused by synthetic media. By examining the social, psychological, and legal dimensions of these issues, the study lays the foundation for further exploration of solutions to mitigate the risks posed by AI-driven technologies. Future research should focus on developing more effective detection tools for AI-generated content, as well as exploring the ethical, legal, and psychological implications of synthetic media.
There is a need for interdisciplinary studies that bring together experts in technology, law, and psychology to create a comprehensive understanding of the risks posed by AI and to develop proactive measures to protect individuals. Additionally, further research is needed to evaluate the effectiveness of regulatory frameworks in addressing the harms of AI-generated synthetic media and misinformation. Policymakers must take immediate and coordinated action to address the growing risks posed by AI-generated synthetic media. Stronger regulations are needed to ensure that those responsible for creating and disseminating harmful content are held accountable.
Additionally, efforts must be made to raise public awareness about the dangers of synthetic media and to equip individuals, particularly vulnerable groups, with the knowledge and tools to identify and protect themselves from AI-driven deception. Only through comprehensive legal frameworks, technological innovation, and public education can we mitigate the risks associated with AI and safeguard digital integrity in an increasingly connected world.