AI, Privacy, And Justice - The Constitutional Challenges Of Regulating AI In India

Author: LawSphereX

Category: Constitutional & Human Rights

Published: 2026-08-23T17:45:48.759705+00:00

Updated: 2026-08-26T17:12:22.136+00:00

AI, PRIVACY, AND JUSTICE: THE CONSTITUTIONAL

CHALLENGES OF REGULATING AI IN INDIA

Mr. Aayush Bhardwaj, PGDIPR, National Law School of India University, Bangalore Ms. Heena Parveen, Assistant Professor, GD Goenka University, Gurugram (Haryana)

ABSTRACT

The rapid integration of artificial intelligence (AI) technologies in India has led to transformative advancements across sectors such as law enforcement, governance, and public administration. While AI holds the promise of enhanced efficiency and improved public services, its application raises profound constitutional concerns, particularly regarding the protection of individual rights enshrined in the Indian Constitution. The Supreme Court’s landmark ruling in Justice K. S. Puttaswamy v. Union of India1 firmly established the right to privacy as a fundamental right under Article 21, emphasizing the need to safeguard personal freedoms in an era of heightened state surveillance and extensive data collection associated with AI applications.

There remains an absence of comprehensive legislation specifically tailored to AI, particularly in relation to privacy and data protection in highly sensitive areas, such as policing and crime prediction. While the Digital Personal Data Protection (DPDP) Act of 2023 represents a significant legislative step towards regulating data handling practices and bolstering privacy protections, it falls short of encompassing the nuanced risks inherent in AI’s deployment. The DPDP Act addresses data usage but does not sufficiently account for the ethical and privacy implications of predictive policing and automated decision-making that may affect procedural fairness and individual rights. This academic trajectory critically examines the intersection of AI, privacy, and justice within the Indian context, underscoring the urgent need for a comprehensive regulatory framework.

Keywords: Artificial Intelligence in India, Fundamental Rights, Privacy Law, AI Regulation, Judiciary

1 Justice K.S. Puttaswamy (Retd.) v. Union of India (2017). 10 SCC 1.

Introduction India has embraced Artificial Intelligence (AI) as a powerful tool for transforming sectors like governance, law enforcement, and public administration. From Aadhaar-based facial recognition to predictive policing, AI is increasingly shaping public service delivery and policy enforcement. This rapid adoption reflects a desire to enhance efficiency and address complex societal challenges; however, it also introduces significant concerns about individual rights under the Indian Constitution, particularly regarding privacy, autonomy, and due process2. Given AI’s ability to collect, process, and analyze massive amounts of data, its unchecked implementation can lead to infringements on citizens’ fundamental rights. One of the most widely discussed AI applications in India is Aadhaar-linked facial recognition, used to authenticate identities across various services.

While this system facilitates service delivery, it also creates risks of data misuse and surveillance, potentially violating the right to privacy as recognized by the Supreme Court in Justice K. S. Puttaswamy v. Union of India3. This landmark case affirmed privacy as a fundamental right under Article 21 of the Constitution, emphasizing the need for safeguards against arbitrary state actions. Without specific legal protections, however, technologies like facial recognition can be deployed in ways that erode individual freedoms4. Predictive policing, another AI-driven tool, aims to enhance law enforcement by using algorithms to identify crime-prone areas and anticipate criminal activities. While this has the potential to improve public safety, it also raises questions about due process and equality before the law5.

Predictive policing systems may lead to biased profiling or discriminatory practices against marginalized communities if the algorithms rely on historically biased data. Automated decision-making, too, is increasingly used to streamline processes like welfare distribution and loan approvals but lacks transparency, making it difficult for individuals to challenge unfair or erroneous outcomes. 2 Arora, S. , & Sharma, P. (2021). Artificial Intelligence and Law: A Cross-Jurisdictional Perspective. Journal of Law and Ethics, 45(2), 231–256.

3 (2017). 10 SCC 1.

4 Binns, R. (2018). Fairness in Machine Learning: Lessons from Political Philosophy. Proceedings of the Conference on Fairness, Accountability, and Transparency, 149–159 5 Chander, A. (2020). India’s Personal Data Protection Bill 2019: A Critical Analysis. Indian Journal of Constitutional Law, 11(1), 73–91.

Reports like the Justice B. N. Srikrishna Committee Report on Data Protection6 and NITI Aayog’s Discussion Paper on National Strategy for AI (2018)7 highlight these concerns. The Srikrishna Committee Report, for instance, emphasizes the need for comprehensive data protection to secure citizens' rights against invasive technologies. Similarly, NITI Aayog’s report discusses the ethical implications of AI, stressing transparency, accountability, and the importance of aligning AI with democratic values. In the absence of a dedicated AI regulatory framework, these reports underscore the urgent need for India to enact laws that balance technological innovation with the constitutional mandate to protect citizens' rights. This paper explores these challenges and advocates for regulatory measures that ensure AI serves India’s democratic and ethical principles.

Emerging Legal Concerns in AI-Driven Technologies in India Privacy Risks and Surveillance As AI-driven surveillance becomes more widespread in India, its implications for individual privacy have garnered substantial attention. Biometric data, especially through the Aadhaar system, has enabled public and administrative agencies to adopt facial recognition for various applications such as verifying identity for welfare distribution, enhancing security in public spaces, and monitoring movements in urban areas. While these advancements enhance efficiency and accessibility, they also pose significant risks to privacy due to the extensive collection, storage, and potential misuse of sensitive personal data. Impact on Privacy Rights: The landmark ruling in Justice K. S. Puttaswamy v.

Union of India (2017)8 established privacy as a fundamental right protected under Article 21 of the Indian Constitution. The judgment emphasized that personal data collection must be subject to strict safeguards to prevent unauthorized surveillance. However, AI-enabled surveillance tools, especially those that are Aadhaar-linked, have yet to receive adequate regulatory frameworks to address potential abuses effectively9. The right to privacy, as defined in the Puttaswamy case, includes the right to control one’s personal data and limit the government’s surveillance

6 Justice B.N. Srikrishna Committee. (2018). Report on Data Protection Framework for India.

7 NITI Aayog. (2018). Discussion Paper on National Strategy for Artificial Intelligence.

8 (2017). 10 SCC 1.

9 Datta, S., & Sengupta, P. (2019). Aadhaar, Privacy, and Surveillance: The Indian Scenario. Surveillance & Society, 17(3), 403–417.

capabilities. Without comprehensive data protection laws tailored to AI, this right risks erosion as AI surveillance continues to expand. Reports and Insights: The Justice B. N. Srikrishna Committee Report (2018)10 highlighted the urgent need for data protection laws to safeguard personal information in India’s digital ecosystem. The report argued that without a strong legal framework, citizens’ privacy rights could be at risk, particularly as AI technologies continue to evolve in scope and sophistication. The committee recommended implementing robust oversight mechanisms, data minimization practices, and consent-based data processing, which would help mitigate potential misuse in AI systems. The Internet Freedom Foundation’s (IFF) Report on AI Surveillance in India (2020)11 underscored the unchecked growth of AI surveillance in India.

The report noted that without stringent regulatory oversight, surveillance could turn into a form of state control over citizens’ behavior, thereby limiting personal freedoms. The report also warned that AI-based surveillance could lead to a “chilling effect,” where individuals feel compelled to alter their behavior out of fear of being constantly monitored. This, in turn, infringes upon citizens' rights to free expression and association, which are cornerstones of democratic societies. These reports suggest a pressing need for India to develop a comprehensive data protection and privacy framework that specifically addresses the challenges posed by AI. This would involve creating a legal architecture that enforces transparency, restricts data misuse, and respects the boundaries of individuals' private lives.

Autonomy and Consent in Automated Decision-Making AI-driven automated decision-making systems are playing an increasing role in public administration in India, influencing areas such as welfare distribution, educational admissions, and even healthcare allocations. Although these systems offer the advantage of efficient decision-making, they also raise profound concerns about autonomy and consent12. Automated

10 Justice B.N. Srikrishna Committee. (2018). Report on Data Protection Framework for India.

11 Internet Freedom Foundation. (2020). AI Surveillance in India: A Report

12 Hajian, S., Bonchi, F., & Castillo, C. (2016). Algorithmic Bias: From Discrimination Discovery to Fairness- Aware Data Mining. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2125–2134.

decisions can often occur without individuals’ active knowledge or participation, limiting their ability to make informed choices regarding their own data and the outcomes that affect them. Autonomy and Informed Consent: In a democratic setup, individual autonomy is paramount, especially in decisions that significantly impact personal lives. Automated decision-making by AI systems has the potential to undermine this autonomy if decisions are made without obtaining informed consent or providing mechanisms for recourse13. For instance, AI-based systems in governance could inadvertently perpetuate errors or biases that disadvantage certain individuals, with limited transparency or accountability for those affected. In Anuradha Bhasin v.

Union of India (2020)14, the Supreme Court emphasized the need to uphold autonomy and digital rights, stressing the importance of procedural safeguards and accountability mechanisms in digital governance. This ruling underscores the need for transparency and accountability in AI systems, particularly those involved in automated decision-making in the public sector. Reports and Guidelines: NITI Aayog’s Discussion Paper on AI (2018)15 highlighted the ethical considerations in deploying AI for public services, stressing that citizens must have control over decisions affecting them. The report advocated for AI systems to incorporate transparent consent mechanisms and allow individuals to challenge or appeal decisions that significantly impact them.

Furthermore, it recommended “explainable AI” to ensure that AI-driven decisions are understandable to those affected, reinforcing democratic values and autonomy. The National Digital Health Blueprint (2019)16 proposed by the Ministry of Health and Family Welfare serves as another example, acknowledging that AI in healthcare decision-making must incorporate patient consent and data privacy protocols. This aligns with the principle of autonomy by emphasizing individuals' rights over their personal health data and choices in AIdriven medical interventions. 13 Dastin, J. (2018). Amazon Scraps Secret AI Recruiting Tool That Showed Bias Against Women. Reuters.

14 (2020). 3 SCC 637.

15 NITI Aayog. (2018). Discussion Paper on National Strategy for Artificial Intelligence

16 Ministry of Health and Family Welfare, Government of India. (2019). National Digital Health Blueprint. New Delhi, India: Government of India

The implementation of these recommendations in India would strengthen citizens' control over their personal data and decisions that impact their lives, aligning AI applications with the values of transparency and informed consent enshrined in the Indian Constitution. Due Process and Fairness in Predictive Policing Predictive policing represents a significant development in AI-driven law enforcement, enabling authorities to anticipate and respond to potential criminal activities based on historical data analysis17. While predictive policing can enhance the allocation of police resources, it also raises substantial concerns regarding procedural fairness, discrimination, and the potential for bias.

Procedural Fairness and Risks of Discrimination: Predictive policing tools rely on data that may contain inherent societal biases, often resulting in profiling or the disproportionate targeting of specific communities. In India, predictive policing without procedural safeguards can risk infringing on the rights to equality and non-discrimination under Articles 1418 and 2119 of the Constitution. This approach not only raises ethical concerns but also undermines trust in law enforcement practices by fostering a perception of unfairness. Selvi v. State of Karnataka (2010)20 serves as a relevant case here, as the ruling examined procedural fairness in criminal investigations, even though it specifically dealt with narcoanalysis.

The decision stressed that investigative methods must not compromise individuals' dignity or procedural rights, a principle applicable to predictive policing as well, which could otherwise reinforce prejudicial treatment against vulnerable groups. Reports and Studies: NASSCOM’s Report on AI in Policing21 discussed the ethical implications of AI’s role in predictive policing, emphasizing the potential for biased data to unfairly target individuals based on race, location, or socioeconomic background. It urged Indian law enforcement 17 Floridi, L. , & Cowls, J. (2019). A Unified Framework of Five Principles for AI in Society. Harvard Data Science Review, 1(1).

18 Constitution of India. (1950). Article 14

19 Constitution of India. (1950). Article 21

20 (2010). 7 SCC 263.

21 NASSCOM. (2020). Artificial Intelligence in Policing in India.

agencies to apply rigorous checks on AI algorithms to prevent unjust profiling and to maintain procedural fairness. Furthermore, the United Nations High Commissioner for Human Rights Report on AI and Human Rights (2021)22 identified predictive policing as a significant area where AI could infringe on human rights if not appropriately regulated. Although not specific to India, the report’s findings are relevant to India’s growing AI applications in law enforcement. It recommended strong accountability and oversight mechanisms to ensure that predictive policing respects human rights and due process. These insights indicate a need for India to approach predictive policing with caution, establishing regulatory safeguards to protect citizens' rights.

Fairness, transparency, and nondiscrimination should be prioritized to prevent AI from undermining the principles of justice and equality in law enforcement. Future Implications of AI in Indian Law Enforcement and Judicial Processes As artificial intelligence (AI) continues to transform various sectors, its integration into law enforcement and judicial processes in India presents both opportunities and challenges23. While AI has the potential to enhance efficiency and effectiveness, there are significant concerns regarding bias, data misuse, and the integrity of judicial processes. This exploration addresses the future implications of AI in these domains, emphasizing the necessity of establishing frameworks that safeguard individual rights and uphold democratic values.

Bias and Discrimination The incorporation of AI into law enforcement and judicial processes raises critical concerns about bias and discrimination24. AI systems often rely on historical data for training algorithms, which can embed existing societal biases into their functioning. These biases may manifest in ways that disproportionately affect marginalized communities, contradicting constitutional 22 United Nations High Commissioner for Human Rights. (2021). The right to privacy in the digital age: Report of the United Nations High Commissioner for Human Rights (A/HRC/47/24). United Nations. https://www. ohchr. org/en/documents/thematic-reports/ahrc4724 23 Murthy, M. , & Bhat, R. (2021). AI, Ethics, and the Law in India: Challenges and Perspectives. Indian Journal of Law and Technology, 16(2), 89–106 24 Ranjan, M. (2020).

Artificial Intelligence and Indian Constitutional Law: An Intersectional Approach. Indian Law Review, 4(3), 58

protections against discrimination and undermining the fairness and impartiality of the justice system. Potential for Systemic Bias: AI algorithms are only as unbiased as the data they are trained on. If the datasets lack diversity or reflect existing prejudices, AI systems can perpetuate and amplify these biases25. For example, algorithms used in predictive policing or risk assessment can lead to biased outcomes, such as over-policing in minority neighborhoods or harsh sentencing recommendations for specific demographics. This not only jeopardizes the principle of equality before the law enshrined in Article 14 of the Indian Constitution but also risks eroding public trust in law enforcement and the judicial system. Case Example: The Supreme Court’s ruling in State of Maharashtra v. Praful B.

Desai (2003)26 recognized the importance of fairness and justice in digital applications, allowing for video conferencing during trials. The court underscored that digital tools should not compromise the principles of fairness in legal proceedings. This principle serves as a reminder that AI systems in law enforcement and the judiciary must be rigorously evaluated for bias, ensuring that they uphold the fundamental tenets of justice. Policy Recommendations: The NITI Aayog’s National Strategy for Artificial Intelligence (2018)27 acknowledges the potential for bias within AI systems and proposes a comprehensive regulatory framework to mitigate discrimination risks. The strategy emphasizes the importance of utilizing unbiased datasets, designing inclusive AI models, and implementing continuous monitoring to ensure AI decisions align with constitutional values of equality and fairness.

Additional frameworks, such as the establishment of independent oversight bodies, could further enhance accountability in AI applications, enabling regular audits of AI algorithms to assess their fairness and effectiveness28. 25 Tisne, M. (2020). The Data Delusion: Protecting Individual Rights Against Big Data Exploitation. Journal of Data Ethics, 6(1), 12–34

26 (2003). 4 SCC 601

27 NITI Aayog. (2018). Discussion Paper on National Strategy for Artificial Intelligence.

28 Balkin, J. M. (2020). Artificial Intelligence and the First Amendment. Georgetown Law Journal, 108(4), 1129– 1185.

These guidelines align with democratic principles and are critical to creating a balanced AI environment that respects the rights of all citizens, ensuring that technology serves as a tool for justice rather than a vehicle for discrimination. Data Misuse and Surveillance State Risks The integration of AI technologies with large databases, such as Aadhaar, raises significant concerns about centralized data misuse and the potential establishment of a surveillance state. The combination of AI systems with centralized data sources poses heightened risks of unwarranted surveillance, data collection, and misuse without individuals' consent29. Privacy and Oversight Concerns: The use of AI in conjunction with centralized databases can lead to an erosion of privacy, creating a "surveillance state" effect30.

In this environment, citizens may experience heightened state interference in their daily lives, as AI systems monitor behaviors and collect data without adequate transparency or consent. This not only infringes on the rights to privacy and personal freedom but also raises ethical questions about the extent of state surveillance in a democratic society. Case Example: The Puttaswamy (Aadhaar) case31 underscored the necessity of protecting individual privacy from excessive government surveillance. The Supreme Court ruled that the right to privacy is fundamental and that any infringement must meet strict scrutiny standards. This case highlighted the risks associated with centralized data systems and the potential for misuse when such systems are linked to AI applications.

Reports and Analyses: The Internet Freedom Foundation’s (IFF) Report on AI Surveillance in India (2020)32 addresses the risks associated with the growing use of AI in surveillance. The report advocates for the establishment of checks and balances to prevent the gradual transformation of India into a surveillance state. Legislative reforms and oversight mechanisms are essential for 29 Mohan, S. (2022). AI Bias and its Implications in the Indian Criminal Justice System. Indian Journal of Criminal Law, 33(2), 27–45. 30 Grover, A. (2022). Privacy Concerns in the Age of Artificial Intelligence in India. Technology and Privacy Journal, 18(2), 245–267.

31 Justice K.S. Puttaswamy (Retd.) v. Union of India (2017). 10 SCC 1.

32 Internet Freedom Foundation. (2020). AI Surveillance in India: A Report

maintaining citizens' privacy while utilizing AI technologies in law enforcement and governance. Recommendations from the IFF report align with the principles established in the Puttaswamy case, advocating for stringent regulatory measures to ensure that AI applications respect individuals' rights to privacy and freedom from unwarranted state surveillance. Implementing these checks is crucial for safeguarding privacy rights in an increasingly digital society. It is essential to establish a legal framework that governs AI use in surveillance, emphasizing accountability and individual rights. Judicial Integrity and Accountability The integration of AI into judicial processes presents opportunities for improving efficiency, such as automating case reviews and assessing sentencing recommendations33.

However, these advancements also raise significant concerns about transparency, accountability, and the potential for arbitrary decision-making. Transparency and Accountability: Judicial decisions hinge on the principles of impartiality, fairness, and the ability to appeal. However, the opaque nature of many AI systems poses risks to these foundational principles34. If AI algorithms are used to determine outcomes without sufficient transparency or understanding of their decision-making processes, it may lead to arbitrary or unchallengeable decisions that undermine the integrity of the judicial system. Case Example: In Shreya Singhal v. Union of India (2015)35, the Supreme Court emphasized the importance of clarity and accountability in digital regulations, particularly concerning freedom of expression.

This precedent highlights the necessity for AI applications in the judiciary to maintain accountability to prevent unjust outcomes and to ensure that individuals have the right to contest decisions made by AI systems. 33 Mittal, R. , & Sharma, J. (2021). The Role of Artificial Intelligence in Indian Courts: Opportunities and Challenges. Journal of Law and Social Justice, 19(1), 112–130 34 Kaur, H. (2022). Predictive Policing in India: Ethical and Legal Dilemmas. Indian Journal of Law and Technology, 8(3), 76–94.

35 Shreya Singhal v. Union of India (2015). 5 SCC 1

Reports and Ethical Frameworks: The NITI Aayog’s Ethics Guidelines for Responsible AI36 emphasize the need for judicial oversight mechanisms to uphold accountability in AI-driven judicial processes. The guidelines stress that AI tools should be transparent and explainable, enabling scrutiny of their applications in the judicial context. These guidelines advocate for adherence to the principles of justice and accountability, ensuring that the integration of AI into the judiciary respects individuals' rights to fair and equitable legal recourse37. Furthermore, they propose establishing independent bodies to oversee AI applications in the judicial system, providing a mechanism for addressing grievances arising from AI decisions. Ensuring transparency in AI-driven judicial processes is essential for maintaining public trust and upholding the rule of law.

By implementing robust oversight mechanisms, the judiciary can leverage AI technologies while safeguarding the principles of justice and fairness38. The Need for a Comprehensive AI Regulatory Framework in India As artificial intelligence (AI) technologies continue to evolve and permeate various sectors in India, the urgency for a comprehensive regulatory framework becomes paramount. The integration of AI in public administration, law enforcement, and other critical areas raises significant concerns regarding privacy, accountability, bias, and the protection of fundamental rights. This discussion explores the need for constitutional safeguards, transparency in AI decision-making, comparative regulatory approaches, and actionable recommendations to align AI with fundamental rights in India.

Constitutional Safeguards for AI Technologies The Indian Constitution provides a robust framework for the protection of individual rights, which must be reflected in the regulation of AI technologies. The Supreme Court’s landmark

NITI

Aayog. (2020). Ethics guidelines for responsible AI.

NITI

Aayog. https://niti.gov.in/sites/default/files/2020-10/Responsible_AI_Guidelines.pdf 37 Calo, R. (2017). Artificial Intelligence Policy: A Primer and Roadmap. UC Davis Law Review, 51(2), 399– 435. 38Crawford, K. (2021). Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence. Yale University Press.

ruling in Puttaswamy v. Union of India (2017)39 established the right to privacy as a fundamental right, thereby mandating the need for statutory safeguards to protect personal data in digital spaces. he Puttaswamy judgment underscored the necessity of privacy in the digital age, affirming that any state interference with individual privacy must satisfy the three-fold test of legality, necessity, and proportionality. This ruling forms the constitutional backbone for advocating comprehensive statutory protections for AI technologies, which often process vast amounts of personal data. The implications of this ruling are significant, as it emphasizes the need for regulatory provisions that ensure personal data collected through AI systems is safeguarded against unauthorized access, misuse, and surveillance.

The Personal Data Protection Bill, 201940, although still pending, proposes regulatory frameworks that are highly relevant to AI applications. The Bill seeks to create a Data Protection Authority to oversee compliance and enforce regulations that align with constitutional rights. Key provisions of the Bill include the need for explicit consent for data processing, rights to data access, and the establishment of grievance redressal mechanisms. These provisions are crucial in the context of AI, as they would ensure that technologies are deployed in a manner that respects individual privacy and autonomy. AI Transparency and Accountability in Decision-Making The increasing reliance on AI systems in critical decision-making processes necessitates a focus on transparency and accountability.

As AI technologies become integral to governance, law enforcement, and other domains, ensuring that these systems operate without bias and with sufficient oversight is essential. The Supreme Court’s decision in Kharak Singh v. State of Uttar Pradesh (1964)41 cautioned against state overreach in surveillance, emphasizing the need for accountability in state actions that affect individual liberties. The case highlighted the risks of unchecked surveillance and the potential for abuse of power, laying the groundwork for demanding transparency in AI

39 Justice K.S. Puttaswamy (Retd.) v. Union of India (2017). 10 SCC 1.

40 Government of India. (2019). Personal Data Protection Bill, 2019 (Bill No. 373 of 2019). Ministry of Electronics and Information Technology. https://www.meity.gov.in/sites/default/files/consultationpapers/Personal%20Data%20Protection%20Bill%202019.pdf

41 Kharak Singh v. State of Uttar Pradesh (1964). 1 SCR 332

algorithms that could similarly infringe upon rights. Ensuring that AI systems are transparent and that their decision-making processes are explainable is vital for maintaining public trust and accountability in governance. Report Reference: The Ministry of Electronics and Information Technology (MeitY)’s Draft National Strategy on Blockchain42 and AI advocates for transparency and accountability in AIdriven decisions. The report emphasizes the necessity of establishing a “right to explanation,” which would grant individuals the ability to understand and challenge decisions made by AI systems that impact their rights. This recommendation is particularly pertinent in a democracy, where citizens must be empowered to question and contest governmental actions influenced by automated decision-making.

Digital Personal Data Protection Act 2023 The Digital Personal Data Protection (DPDP) Act of 202343 is a critical step in India's journey toward establishing robust data governance and privacy frameworks amidst rapidly advancing artificial intelligence (AI) technologies44. This legislation seeks to give individuals meaningful control over their data, reinforcing principles such as autonomy, transparency, and accountability. By setting standards for data processing, it aims to protect individuals' rights and regulate data use by organizations, particularly in the AI-driven landscape. Key Provisions include: • Consent-Based Processing: The DPDP Act mandates explicit consent for personal data collection and processing, ensuring individuals' informed participation. However, with AI’s complexity, ensuring comprehensive understanding of consent mechanisms poses significant challenges.

• Data Minimization: Organizations are required to limit data collection to specific purposes, a principle aimed at reducing risks of excessive data aggregation and potential misuse in surveillance and predictive analysis. 42 Ministry of Electronics and Information Technology (MeitY). (2020). National Strategy on Blockchain and AI. 43 Government of India. (2023). The Digital Personal Data Protection Act, 2023. Ministry of Law and Justice. Retrieved from: https://www. meity. gov. in/writereaddata/files/Digital%20Personal%20Data%20Protection%20Act%202023. pdf 44 Singh, A. , & Anusha. (2024). The Digital Personal Data Protection Act, 2023: An ambitious government step towards ensuring its wide reach. Indian Journal of Public Administration, 70(3), 502–515. https://doi. org/10. 1177/00195561241271533

Individual Rights: The DPDP Act grants individuals the rights to access, rectify, and delete their data, echoing global data protection standards. This includes empowering individuals to control the dissemination and use of their data, critical in an era where AI-driven decisions are increasingly opaque. • Accountability Mechanisms: Penalties for non-compliance, along with requirements for appointing Data Protection Officers (DPOs), aim to establish stronger accountability, especially crucial as AI’s reach expands. Analysis of DPDP Act 2023 in Relation to AI and Constitutional Rights Privacy Risks and Surveillance The rapid expansion of AI in surveillance technologies, especially in sectors such as law enforcement, has heightened concerns about privacy rights45.

The DPDP Act’s provisions for consent-based processing and data minimization represent steps toward safeguarding privacy but are insufficient for addressing AI’s unique risks: • Biometric Data Collection: Technologies relying on biometric identifiers, like Aadhaar, facilitate large-scale surveillance with significant privacy implications. Although the DPDP Act seeks to regulate such practices, the absence of AI-specific restrictions may still expose citizens to potential misuse of personal information. • Privacy and Constitutional Mandates: The DPDP Act’s alignment with the right to privacy, as affirmed in Justice K. S. Puttaswamy (Retd. ) v. Union of India (2017), calls for robust implementation. Protection against unauthorized surveillance and profiling is fundamental to uphold individual freedoms under Articles 14 and 21 of the Constitution.

Autonomy and Consent in Automated Decision-Making Automated decision-making processes, driven by AI algorithms, increasingly shape public administration and impact citizens’ lives significantly, including decisions in welfare distribution, healthcare, and judicial processes. Key concerns include: 45 Korff, D. (2023). The Indian Digital Personal Data Protection Act, 2023, viewed from a European perspective. SSRN. https://doi. org/10. 2139/ssrn. 4614984

Transparency Deficits: AI systems, often described as "black boxes," obscure decision-making pathways, limiting individuals’ understanding of how decisions are derived. While the DPDP Act emphasizes transparency, guidelines specific to AI decision-making are needed to support individuals’ rights to challenge decisions. • Consent Complexity: Although the DPDP Act prioritizes informed consent, ensuring that individuals understand AI’s implications on their autonomy is challenging. Communication strategies that demystify AI processes will be essential to safeguard autonomy in automated governance.

Due Process and Fairness in Predictive Policing AI-driven predictive policing introduces substantial shifts in law enforcement methodologies but also presents risks to procedural fairness and equality: • Discrimination Risks: AI-driven predictive policing systems often depend on historical data, which may embed biases that disproportionately affect marginalized communities. While the DPDP Act establishes data rights, it lacks specific mandates to prevent discriminatory practices in AI applications, necessitating targeted regulations to ensure equal treatment under the law. • Procedural Safeguards: To uphold due process rights as mandated by the Constitution, particularly under Articles 14 and 21, predictive policing should be subjected to stringent oversight and procedural safeguards.

This will prevent biases from leading to unjust profiling, aligning AI use in law enforcement with principles of fairness and justice. Future Implications As India continues integrating AI within its governance frameworks, especially in public administration and law enforcement, adapting regulatory frameworks to meet AI-specific challenges is paramount. To ensure AI development respects constitutional rights and justice, the following measures are essential: • Development of Comprehensive AI Regulations: Supplementing the DPDP Act with AI-specific regulations would provide clear guidelines for ethical AI use, especially in sensitive areas like predictive policing, public health, and judicial processes.

Public Awareness Campaigns: Fostering public understanding of data rights under the DPDP Act is vital to empower citizens to exercise their privacy rights effectively. AI's complexities necessitate a well-informed populace that understands the implications of data processing and AI’s role in public decision-making. • Collaborative Stakeholder Engagement: Interdisciplinary collaboration involving legal experts, technologists, policymakers, and civil society organizations is crucial for creating balanced regulatory approaches. This collaborative framework can drive the creation of ethical AI standards that foster innovation while ensuring protections for privacy, fairness, and justice. The DPDP Act of 2023 lays a foundation for addressing the challenges posed by AI technologies; however, its success depends on developing additional regulatory mechanisms tailored to AI’s complexities.

Ensuring that AI practices align with constitutional principles of privacy, autonomy, and due process is essential for India’s democratic integrity. With comprehensive and adaptive frameworks, India has the potential to lead in ethical AI governance, setting standards that prioritize fundamental rights and justice in a rapidly digitalizing world. Comparative Regulatory Approaches and Proposals for India

A comprehensive regulatory framework for AI in India can draw valuable lessons from

international approaches46. By examining existing frameworks, India can develop a tailored strategy that addresses its unique challenges while ensuring the protection of fundamental rights. Reports Analysis:

1) European Union’s AI Act47: The proposed EU AI Act establishes a risk-based

classification system for AI technologies, categorizing them into minimal, limited, high, and unacceptable risk levels. This framework mandates that high-risk AI systems, particularly those affecting fundamental rights, undergo rigorous assessments, including bias testing and compliance with transparency standards. 46 Brundage, M. (2021). Governing Artificial Intelligence: Ethical and Legal Challenges. Oxford University Press. 47 European Union. (2021). Proposal for a Regulation on a European Approach for Artificial Intelligence (AI Act).

2) Chinese AI Governance Principles48: China’s approach focuses on promoting AI

development while ensuring national security and social stability. The principles emphasize ethical AI practices and the necessity for state oversight.

3) U.S. NIST’s AI Risk Management Framework49: The National Institute of Standards

and Technology (NIST) in the U. S. advocates for a risk-based management approach that emphasizes fairness, accountability, and transparency in AI systems. This framework is designed to help organizations identify and mitigate risks associated with AI technologies. By adopting a similar risk-based approach, India can create a regulatory environment that balances innovation with accountability and safeguards individual rights. This can include developing a classification system for AI applications based on their potential impact on fundamental rights, ensuring that high-risk applications undergo thorough assessments before deployment.

Recommendations for Aligning AI with Fundamental Rights in India To ensure that AI technologies in India align with fundamental rights and do not compromise individual freedoms, the following recommendations are proposed: Establish Mandatory Bias Testing: Inspired by the EU’s AI Act Draft, it is crucial to implement mandatory bias testing for AI algorithms used in public administration and law enforcement. An illustrative case is the Mumbai Police’s experiment with predictive policing, which raised concerns about the risks associated with untested systems. Rigorous bias testing can help identify and mitigate potential discriminatory impacts before deployment.

Propose Independent Oversight Bodies: The establishment of independent oversight bodies, such as a Data Protection Authority as suggested in the Personal Data Protection Bill, is essential for ensuring that AI applications comply with privacy rights and ethical standards. These bodies should have the authority to

48 China’s Ministry of Science and Technology. (2019). AI Governance Principles.

49 U.S. National Institute of Standards and Technology. (2020). AI Risk Management Framework.

oversee AI deployments, conduct audits, and enforce compliance with regulatory frameworks, thereby ensuring accountability in AI usage. Public Awareness Programs: Enhancing public awareness about AI and fundamental rights is vital for improving digital literacy among Indian citizens. Following UNESCO’s Guidelines on AI and Ethics50, comprehensive public education campaigns can empower individuals to understand their rights in the context of AI technologies, fostering a culture of informed consent and active participation in discussions surrounding AI regulation. Encourage Explainability Clauses: Implementing “explainability” clauses similar to the General Data Protection Regulation (GDPR)’s “right to explanation” is crucial to ensure that individuals can understand and challenge AI-based decisions.

Such clauses would require organizations to provide clear explanations for automated decisions affecting individuals, thereby promoting transparency and accountability in AI systems51. Conclusion As artificial intelligence (AI) becomes increasingly integral to India’s public administration, law enforcement, and judicial processes, the need for a dedicated regulatory framework becomes crucial. The potential of AI to transform governance and enhance efficiency is undeniable; however, unchecked AI deployment risks infringing on privacy, autonomy, and due process, key principles embedded in India’s constitutional framework. To ensure AI’s ethical use aligns with fundamental rights, legislative reforms must establish clear regulations addressing these concerns. Firstly, the protection of privacy is paramount in an AI-driven landscape where vast amounts of personal data are processed.

The Supreme Court’s decision in Puttaswamy v. Union of India (2017) recognized privacy as a fundamental right, setting a high standard for safeguarding personal information. AI technologies that collect and process biometric or personal data, such

50 UNESCO. (2021). Ethics and Governance of AI: Guidelines and Best Practices.

51 Andrews, L. (2019). I Know Who You Are and I Saw What You Did: Social Networks and the Right to Privacy. Free Press

as facial recognition and predictive policing, risk enabling intrusive surveillance and data misuse. A regulatory framework grounded in privacy protection would mandate transparency, consent, and accountability in AI applications, ensuring that citizens’ rights are preserved. Moreover, legislative reforms should address the potential impact of AI on individual autonomy. Automated decision-making systems, particularly in public sectors, can make determinations that directly affect citizens’ lives, often without their knowledge or consent. For instance, AI-driven welfare distribution systems or predictive policing models could lead to decisions without adequate transparency or an opportunity for redress.

To safeguard autonomy, India must institute regulations that ensure AI systems are explainable and subject to oversight, providing citizens the ability to understand and challenge AI-based decisions that impact them. Ensuring due process is also critical, especially as AI becomes part of judicial and law enforcement processes. Predictive algorithms trained on historical data carry the risk of perpetuating bias, often to the detriment of marginalized communities. Without stringent oversight, such biases may undermine fairness, equality, and the constitutional guarantee of equal treatment before the law. An AI regulatory framework emphasizing due process would enforce bias-testing requirements and provide accountability mechanisms, reinforcing justice and fairness in AI applications. On the global stage, India has a unique opportunity to set standards for ethical AI governance.

International frameworks such as the European Union’s AI Act, China’s AI Governance Principles, and the U. S. NIST’s AI Risk Management Framework offer valuable insights, but India’s approach can stand out by deeply integrating fundamental rights protection. By developing a framework that balances innovation with accountability, India can position itself as a leader in ethical AI, promoting standards that other democracies may follow. In summary, a dedicated AI regulatory framework rooted in privacy, autonomy, and due process is essential for India. Legislative reforms should focus on creating robust oversight, transparency, and accountability in AI deployment, aligning AI’s advancement with India’s democratic and constitutional values. With the right regulatory approach, India can not only protect its citizens but also play a pivotal role in shaping global ethical standards for AI.