Dual Impact Of AI In Health Care - Balancing Innovation With Ethical And Legal Considerations
Author: LawSphereX
Category: Technology, Cyber & Privacy
Published:
Updated:
DUAL IMPACT OF AI IN HEALTH CARE: BALANCING
INNOVATION WITH ETHICAL AND LEGAL CONSIDERATIONS Ishwarya. S, B.B.A. LL.B.(Hons.), Sastra Deemed To Be University, Thanjavur N.L. Geetha Devi, B.B.A. LL.B. (Hons.), Sastra Deemed To Be University, Thanjavur
ABSTRACT
Artificial Intelligence (AI) is the most distinguishing and useful innovation resulting in the 21st century. The concept of artificial intelligence is not novel to the world; however, its utilization has accelerated significantly in the wake of the COVID-19 pandemic, which has significantly impacted the global health industry, raising concerns about technology usage, innovative diagnosis, treatment, and disease prevention. The incorporation of Artificial intelligence into healthcare, including machine learning algorithms, natural language processing, and robotics offers significant potential benefits in transforming medical practice by providing unprecedented prospects for enhanced diagnoses, personalized therapy, and efficient patient care.
However, this technological breakthrough creates enormous issues for health laws, which must adapt to address the ethical, legal, and regulatory consequences of artificial intelligence in medicine. This paper explores the dual facets of Artificial Intelligence in healthcare, analyzing both its advantages, such as improved diagnostic accuracy and operational efficiency, and its drawbacks, including risks to patient data privacy and potential legal ramifications in cases of AI-induced harm. The research paper investigates the current landscape of AI applications in healthcare, using existing literature to evaluate the effectiveness of AI-driven interventions. The findings highlight that there is a need for robust regulatory frameworks to protect patient data, ensure fairness in AI applications, and clarify legal responsibilities in case of AI-related harm.
It emphasizes the need for careful management of AI adoption in healthcare and the need for balancing innovation with caution and addressing risks in healthcare settings. This contributes to ongoing discussions on AI's potential in healthcare. Keywords: Artificial Intelligence, Health care, Data privacy, Ethical considerations, Legal liability.
CHAPTER
1 INTRODUCTION
Artificial Intelligence (AI) refers to a computer program's ability to perform tasks similar to human intelligence, including reasoning and learning. AI has the potential to change healthcare by producing the vast amount of digital data that provides new and essential insights developed during healthcare delivery. Artificial Intelligence is usually applied as a hardware-software system. From a software perspective, AI is primarily concerned with algorithms. An artificial neural network is a conceptual framework for designing AI algorithms. It's a human brain model composed of an interconnected network of neurons linked by weighted communication channels. AI employs a variety of algorithms to detect complex non-linear correlations in large datasets. Through training the correction of small algorithmic error machines gain confidence and increase prediction model accuracy.
AI integration in healthcare transforms patient care by implementing data-driven insights and machine learning algorithms to discover earlier hidden sequences and solutions. AI's impact on healthcare providers is profound, from predicting patient risks to tailoring treatment plans, allowing them to make more informed decisions and provide effective and personalized care. However, integrating AI into healthcare has its challenges. The most significant is the need to protect patient privacy in an environment where data is both a valuable resource and a potential vulnerability. Handling sensitive health information by AI systems raises serious concerns about privacy, data security, and the possibility of data breaches. Furthermore, the growing reliance on artificial intelligence for healthcare decision-making raises concerns about preserving human autonomy in medical decisions.
The primary aim of this investigation is to deliver an in-depth analysis of AI's role in healthcare, emphasizing the need to balance its innovative potential with the ethical and legal issues it presents. This study will examine both the advantages and risks associated with AI-driven healthcare solutions and assess the effectiveness of current regulatory frameworks. The ultimate objective is to offer recommendations for creating robust regulatory strategies that protect patient interests while supporting technological progress. We use significant results from articles like those that explore the privacy risks associated with private entities controlling AI and the moral difficulties associated with doing so.
Through means of this comprehensive investigation, our review seeks to create fair guidelines and strategies that optimize AI's advantages, while preserving the trust and rights of patients. The main idea of the discussion is to encourage a sophisticated comprehension of AI's impact on healthcare, especially in terms of data security and privacy and ethical integration, to direct the development of strategies and efficient policy in this field.
CHAPTER II
LITERATURE REVIEW
“Artificial Intelligence Applications in Healthcare Sector: Ethical and Legal Challenges” : Emna Chikhaoui , Alanoud Alajmi and Souad Larabi-Marie-Sainte (2022). This paper deals with the applications of AI in healthcare and also emphasizes the need for comprehensive regulatory frameworks to address these issues, ensuring that AI technologies enhance patient care while safeguarding ethical standards and legal compliance in the healthcare sector. “Ethical Guidelines for Application of Artificial Intelligence in Biomedical Research and Healthcare”:ICMR(2023). This paper presents a thorough framework that tackles the ethical implications of AI in healthcare. It addresses concerns such as data privacy, accountability, and liability associated with AI technologies.
Furthermore, the guidelines emphasize the importance of accountability in AI applications, ensuring that all stakeholders are held responsible for the results produced by AI systems. “Ethics and governance of artificial intelligence for health: WHO guidance. Geneva: World Health Organization (2021). This paper provides guidance on the ethical and governance issues surrounding artificial intelligence (AI) in healthcare, offering crucial recommendations. It underscores the importance of maintaining human rights, promoting equity, and ensuring accountability in AI applications. “Role of AI in Healthcare and Its Licensing Framework in India: Ditipriya Dutta Chowdhury (2024). This study examines the profound effects of artificial intelligence (AI) on Indian healthcare, emphasizing its uses in personalized care and diagnosis.
This study examines the profound effects of artificial intelligence (AI) on Indian healthcare, emphasizing its uses in personalized care and diagnosis.
"Artificial Intelligence and Liability in Medicine: Balancing Safety and Innovation,": Maliha, Gerke, Cohen, and Parikh (2021). This paper examines the intricate relationship between AI technologies and legal liability within the medical domain. The authors highlight the potential of AI to enhance healthcare delivery while also raising significant concerns regarding accountability when AI systems make errors.
2.1 STATEMENT OF RESEARCH PROBLEM
The integration of AI into healthcare poses notable ethical and legal challenges. How legislators and medical professionals effectively handle the moral and legal challenges that artificial intelligence (AI) has brought to healthcare in order to protect patients' interests and foster innovation.
2.2 RESEARCH
OBJECTIVE:
❖ To evaluate existing legal frameworks governing AI technologies in healthcare to identify gaps and limitations in addressing AI-induced harms. ❖ To develop guidelines and recommendations to balance innovation with ethical and legal compliances. ❖ To examine the ethical challenges associated with the use of AI in healthcare, including issues of bias, accountability, and informed consent. ❖ To suggest guidelines and recommendations for the use of AI technologies. ❖ To collect perspectives on the application of AI from technologists, patients, and healthcare providers.
2.3 RESEARCH QUESTIONS
1. What are the primary ethical issues raised by the application of Artificial Intelligence
in healthcare?
2. How effective are current regulatory frameworks in India at addressing the legal
challenges
posed by AI in healthcare, and what improvements are necessary?
3. What are the guidelines that can be developed to balance AI innovation technology with
ethical and legal compliances?
2.4 SCOPE
AND LIMITATION: The scope of this research paper encompasses a comprehensive examination of the role of artificial intelligence in healthcare, emphasizing its applications alongside the ethical and legal challenges it presents. It aims to analyze the implications of AI integration, including the issues of liability and accountability, while gathering insights from various stakeholders. Key areas of focus include data privacy concerns, algorithmic bias, and the implications of liability when AI systems make errors. This study exposes several limitations. There might be limitations on access to accurate and thorough data, especially in areas where AI is still developing. The quick speed at which AI is developing can cause research results to become dated very quickly.
2.5
RESEARCH
METHODOLOGY
The research methodology is based on the doctrinal research. The most precise secondary data had been collected from authentic sources. The data used here has been collected from different books, articles, journals and legislations.
3.0 OVERVIEW OF AI TECHNOLOGIES IN HEALTH CARE
Artificial intelligence (AI) is transforming healthcare, thereby ushering in a new era of precision medicine, operational efficiency, and patient care. While the application of AI technologies in the healthcare industry presents complex challenges, it also holds great promise for advancements. In-depth analysis of AI's history in healthcare, its present uses, and the implications of recent advancement particularly in the wake of the COVID-19 pandemic are provided in this overview.
3.1 AI's current applications in healthcare
AI applications in healthcare1 extend to numerous domains, each contributing to advancements in the field of medicine. 1 Cell, D.I.A.I., Ethical Guidelines for Application of Artificial Intelligence in Biomedical Research and Healthcare (2023).
Diagnostics AI has made significant advancements in diagnostics, particularly medical imaging. In order to detect anomalies like cancers, fractures, and other ailments, AI algorithms are trained to examine X-rays, MRIs, and CT scans. For instance, AI systems frequently match or even exceed the performance of seasoned radiologists in identifying early indicators of diseases like lung or breast cancer with high sensitivity and specificity. These tools can help with early diagnosis, enhancing patient survival rates and treatment results. Personalized Medicine AI acts an integral part in the advancement of personalized medicine, which tries to customize medical care for specific patients according to their genetic, environmental, and lifestyle characteristics.
AI systems examine patient data to find developments and anticipate how patients will react to different therapies, allowing medical professionals to create personalized treatment regimens. This method is especially useful in oncology, where AI assists in choosing the best chemotherapy regimens according to each patient's specific genetic profile. Predictive Analytics AI-driven predictive analytics is used to predict health outcomes and direct preventative actions. AI models can forecast the chance of developing chronic illnesses like diabetes, heart disease, or stroke through analyzing past patient data. With the help of these forecasts, medical professionals can reduce risks by implementing prompt measures and lifestyle changes.
AIdriven technologies, for instance, are able to recognize patients who are at a high risk of returning to hospitals and offer tailored interventions to lower that risk. Drug Development and Discovery AI is speeding up the drug discovery and development process by analyzing large datasets to identify potential drug candidates and optimize clinical trial design. Artificial intelligence algorithms have the capability to forecast the interactions between various compounds and biological targets, thereby mitigating the time and expense involved in drug development. AI also assists in the design of more successful clinical trials by predicting outcomes based on past data and identifying appropriate patient populations.
Remote Monitoring and Telemedicine AI has grown increasingly vital for telemedicine and remote monitoring, which are growing prevalent as a consequence of the COVID-19 pandemic. Artificial intelligence (AI)-powered remote monitoring systems gather and examine patient data from connected devices to offer in-the-moment health status and critical sign information. AI-enhanced telemedicine platforms make it possible for patients to receive care without ever leaving their homes by facilitating virtual consultations and follow-ups. These innovations have shown to be extremely helpful in managing long-term illnesses, delivering prompt interventions, and decreasing the strain on medical facilities.
3.2 BENEFITS OF AI IN HEALTHCARE
Artificial Intelligence (AI) is revolutionizing healthcare by offering transformative benefits that enhance various aspects of healthcare and patient care. These developments are tackling important healthcare issues in India and enhancing results everywhere. The potential of AI to improve diagnostic precision is one of its main advantages in the medical field. AI algorithms, particularly those based on machine learning and deep learning, are capable of accurately analyzing complex medical data. AI-based diagnostic tools are having a significant impact in India. For instance, the AI platform from Qure. ai2 has been effectively used to evaluate chest X-rays and identify diseases like COVID-19 and tuberculosis. This technology facilitates faster and more accurate image interpretation by radiologists, which helps with disease management and early detection.
AI also plays a crucial role in improving patient management through real-time monitoring and remote care solutions. Nirmai3, an Indian startup, uses AI-powered thermal imaging to screen for breast cancer. This non-invasive method, combined with AI algorithms, facilitates early detection of cancer, especially in rural and underserved regions where access to traditional screening methods is limited. The ability to conduct remote screenings reduces the need for invasive procedures and makes cancer detection more accessible to a broader population. Moreover, AI enhances patient engagement and education through virtual health assistants and
2 Qure.ai, Home, https://www.qure.ai (2024).
3 Niramai, Home, https://www.niramai.com (2024).
chatbots. Platforms like Medlife4 use AI-powered chatbots to provide patients with health information, schedule appointments, and send medication reminders. These tools improve patient access to healthcare services, facilitate better management of health conditions, and enhance overall patient satisfaction. These advancements are not only addressing critical healthcare challenges but also paving the way for more efficient and effective medical care. As AI technologies continue to evolve, their integration into healthcare systems promises to drive further innovations and improvements in patient outcomes across the country.
4.0 ETHICAL
CHALLENGES
Artificial intelligence (AI) in healthcare has the capability to make patient care, increase operational effectiveness, and improve diagnostic accuracy. It also brings up important ethical issues5, though, which need serious consideration. This paper will examine a number of significant ethical dilemmas related to the application of AI in healthcare, such as concerns about responsibility, bias and equity and the effects on the patient-provider relationship. Bias and Fairness: The risk of bias in algorithms is one of the biggest ethical challenges in the application of AI to healthcare. AI systems are trained on historical data, they may be biased against current medical practices. For instance, an AI model may not function well for other populations if it was primarily trained on data from specific age groups, which could result in unequal treatment outcomes.
This is especially dangerous in domains such as diagnostics, where decisions made by algorithms may mean the difference between life and death. Biased artificial intelligence has serious ethical implications. Health disparities may worsen and the idea of justice in healthcare may be compromised if AI recommendations consistently disadvantage some groups of people. Developers need to prioritize representative and diverse datasets, conduct thorough testing to ensure fairness, and monitor their work continuously to spot biases and address them as they arrive. The Patient-Provider Relationship: The patient-provider relationship may change as artificial intelligence is incorporated into
4 Medlife.ai, Home, https://www.medlife.ai (2024).
5 Chikhaoui, E. , Alajmi, A. , & Larabi-Marie-Sainte, S. , Artificial Intelligence Applications in the Healthcare Sector: Ethical and Legal Challenges, 6 Emerging Sci. J. 717 (2022). healthcare. AI can expedite administrative work and improve clinical decisions, but it also has the potential to depersonalize care. If patients believe AI is making important decisions about their care without human intervention, they could become uncertain or suspicious. Further, the use of AI tools could change how medical professionals communicate with patients. It's possible for providers to rely too much on AI recommendations, which could compromise their ability to make clinical decisions and the therapeutic alliance they build with patients. Balancing the advantages of AI with the requirement to continue providing compassionate, patient-centered care presents an ethical challenge in this case.
Informed Consent and Autonomy: Informed consent is a key concern when using AI in clinical decision-making. It's possible that patients are unaware of how AI algorithms work or how decisions made with their help will affect their course of treatment. This ignorance could threaten patient autonomy and affect their capacity to make wise healthcare decisions. Healthcare providers must make sure patients are informed about AI's role in their care in an understandable and accessible manner in order to uphold the ethical principle of informed consent. This includes details on the operation of AI algorithms, the possible advantages and disadvantages of using them, and the degree of human involvement in the decision-making process. Improving patient education regarding AI can encourage people to take a more active role in choosing their medical care.
5.0 LEGAL
CHALLENGES
Despite the enormous potential benefits of artificial intelligence, which is now being applied to a wide range of domains, the legal and ethical implications of AI applications must not be overlooked. The integration of AI in healthcare presents significant ethical and legal challenges. As AI technologies reshape patient care, concerns emerge around data privacy, algorithmic bias, and liability. Tackling these challenges is essential for ensuring responsible implementation that protects patient rights and preserves trust in healthcare systems and also preventatively develop future countermeasures. Privacy & Data protection AI in healthcare frequently necessitates access to large datasets that may include sensitive patient information. Personal health data must be under the control of the individuals according to the ethical principle of patient autonomy.
Cyberattacks may target AI systems, giving unauthorized access to private data. This raises moral concerns about the obligation of AI developers and healthcare providers to safeguard patient data and maintain data usage transparency. Every citizen of India has the right to privacy as a fundamental right which is guaranteed under article 21 of the Indian constitution. Therefore, it expressly imposes a duty on the state to protect the privacy of every citizen. A fundamental component of medical ethics since the Hippocratic Oath is privacy. The oath is predicated solely on the physician's obligation to protect patient privacy; nevertheless, it is important to highlight that the oath makes no mention of the patient's autonomy or the shared decision-making paradigm of doctor-patient collaboration and there was a strong paternalistic relationship between the doctor and the patient.
In 2020 the Indian Council of Medical Research (ICMR) experienced a major data breach that compromised sensitive health information of millions during the COVID-19 pandemic. Unauthorized access exposed personal data, including names, phone numbers, and health records, raising significant concerns about potential identity theft and privacy violations. Following the incident, the ICMR undertook investigations and implemented enhanced cybersecurity measures to safeguard data. This breach underscored the critical need for comprehensive data protection frameworks in India, especially as healthcare increasingly relies on digital technologies, highlighting the importance of securing sensitive health information in a rapidly evolving landscape.
Subsequently, a recent event breakdown at the All-India Institute of Medical Science (AIIMS) highlights the risk of data breaches and rights violations due to digitization in the absence of a comprehensive data protection framework. On November 23, 2022, a cyberattack resulted in the hacking and corruption of servers hosting the e-hospital database and laboratory data, causing problems for multiple departments at AIIMS when attempting to access patient records through the e-hospital server. The need for digital systems has grown as a result of the pandemic. As hackers have become more aware of hospitals' substantial reliance on digital healthcare systems to manage medical operations and store and handle patient data, they have launched more cyberattacks against hospitals and other medical facilities.
5.1 LEGAL RAMIFICATIONS ARISING FROM AI INDUCED HARM, IT’S
LIABILITY AND ACCOUNTABILITY: The term accountability can be described as the duty of an individual or organization to justify its actions, take responsibility for its decisions, and transparently share the outcomes. AI technologies designed for use in the healthcare sector must be prepared for scrutiny by relevant authorities at any given time. In India, determining liability for AI-induced harm in healthcare involves several parties and the legal framework is still evolving. Here are the key parties that may be held liable, along with relevant laws and considerations: Healthcare Providers: When a provider employs an AI system in their practice, questions arise regarding their accountability for the outcomes. Can a doctor be charged with malpractice if they rely on an AI-generated diagnosis that turns out to be inaccurate?
Courts have the option to take into account whether the provider evaluated the AI's recommendations with due diligence. AI Developers: AI system developers may also be held accountable if it turns out that their algorithms have errors or if they neglected to conduct sufficient testing. This seeks the question of whether developers need to be held to the same level of care as medical professionals. Healthcare Institutions: Hospitals and clinics that adopt AI systems may be held accountable for any harm resulting from those systems. Legal principles like vicarious liability could come into play, making institutions responsible for the actions of their staff, including how they utilize AI tools. Data Providers: The data providers may also be held accountable if the AI system uses biased or erroneous information.
Liability may arise if it is demonstrated that they did not take appropriate measures to ensure data quality. As AI technologies become more prevalent in Indian healthcare, it is critical to establish clear lines of liability and accountability. In order to ensure patient safety, data providers, healthcare organizations, AI developers, and healthcare providers are all essential. To effectively address the intricacies of harm caused by artificial intelligence and safeguard patient rights, a clearly defined legal framework is required.
6.0 EVALUATION OF CURRENT REGULATORY FRAMEWORKS
In India, the regulatory landscape for AI in healthcare is fragmented and primarily governed by existing laws and guidelines, rather than a dedicated AI framework.
6.1 Information Technology Act, 2000 (IT Act) serves as a cornerstone for regulating digital
transactions and data protection in India, significantly impacting the deployment of AI in healthcare. Compensation for Failure to Protect Data: The section 43A of IT Act6, mandates organizations handling sensitive personal data, including health information, must implement "reasonable security practices. " If a data breach occurs due to negligence in protecting this data, individuals may seek compensation. This provision is crucial for AI in healthcare, as it encourages healthcare providers and AI developers to prioritize robust data privacy measures to safeguard patient information. Violation of Privacy: The section 66E of IT Act7, penalizes privacy violations, particularly those involving acquiring and use of personal information without consent. Ensuring that patient data is used ethically and with consent is crucial in the context of artificial intelligence.
This section emphasizes the value of consent and transparency while assisting in the establishment of legal limits on how AI technologies may interact with patient data. If any person violates the privacy of any person, he shall be punished with an imprisonment of 3 years and fine amounting to not exceeding 2,00,000 rupees or both. Penalty and Compensation for Damage: The section 43 of IT Act8, provides that, Penalties for data damage and unauthorized access to
6 Information Technology Act, § 43A 2000 (India).
7 Information Technology Act, § 66E, 2000 (India).
8 Information Technology Act, § 43, 2000 (India).
computer systems are described in this section. In the context of AI in healthcare, healthcare providers and developers may be held accountable under this section if an AI system causes harm as a result of data breaches or errors in data handling. This gives AI technology management a reason to be careful in order to avoid these kinds of risks. Protected Systems: The sec 70(3) of IT Act9, provides that, any computer resource that involves the Critical Information Infrastructure directly or indirectly may be designated as a protected system by the relevant government through notice published in the Official Gazette. Any individual who gains access to, or attempts to gain access to, a protected system in violation of this section's provisions faces up to ten years' imprisonment in either type of facility in addition to a fine.
6.2 EUROPEAN AI ACT
The European Artificial Intelligence (AI) Act is the first comprehensive legal framework on AI in the world. It aims to guarantee that AI systems uphold moral standards, safety precautions, and fundamental rights. The AI Act establishes AI applications into three risk categories and creates a standard framework for the EU: • Unacceptable risk: Prohibited AI systems include government-run social scoring • High-risk: AI programs that must adhere to certain legal regulations, like tools for CV screening. • Minimal risk: AI products like spam filters and AI-enabled video games that are exempt from the AI Act's requirements. Article 6: Classification rules for high-risk AI systems Article 610 serves as a foundational component of the European AI Act, ensuring that AI systems used in sensitive sectors like healthcare are adequately regulated to protect users and uphold public safety.
By categorizing AI applications based on risk, the article aims to foster
9 Information Technology Act, § 70(3), 2000 (India).
10 Regulation (EU) 2021/1689, art. 6, 2021 (EU).
trust and accountability in the deployment of AI technologies. The Article 6(2) of European AI Act, provides that AI systems referred to Annex III shall be considered to be high-risk. However, Annex III outlines AI systems designed for use by or on behalf of public authorities to assess a natural person's eligibility for essential public assistance benefits and services, including healthcare services as well as to offer, restrict, terminate, or recover such benefits and services. Therefore, the AI technology used in health care is classified as the high risk. Article 9: Risk management system High-risk AI systems11 require the establishment, application, documentation, and administration of a risk management system.
It shall comprise the identification and analysis of the known and the reasonably foreseeable risks that the high-risk AI system can pose to health, safety or fundamental rights when the high-risk AI system is applied as intended. Article 10: Data Governance Requires that AI systems be trained12 on high-quality datasets to reduce bias and ensure accurate results, addressing concerns about data integrity and patient trust. Article 13: Transparency and provision of information to deployers Ensures that users and patients have a clear understanding of how AI systems work, which is critical for maintaining transparency13 and trust. Article 14: Human oversight Article 14 of the European AI Act emphasizes the critical need for human oversight14 in the deployment of high-risk AI systems.
According to the article, operators must have the authority to make final decisions, particularly in situations where AI outputs may have a significant impact on safety, health, or fundamental rights. Furthermore, these operators must be
11 Regulation (EU) 2021/1689, art. 9, 2021 (EU).
12 Regulation (EU) 2021/1689, art. 10, 2021 (EU).
13 Regulation (EU) 2021/1689, art. 13, 2021 (EU).
14 Regulation (EU) 2021/1689, art. 14, 2021 (EU).
sufficiently trained and competent to effectively monitor and assess the AI's performance and reliability. Enhancing transparency and accountability necessitates maintaining documentation of the oversight procedures, including the standards for human intervention.
6.3 Digital Personal Data Protection Act, 2023 (DPDP Act)
In August 2023, India enacted the Digital Personal Data Protection (DPDP) Act, which is expected to come into effect in 2024. This new legislation regulates the handling of personal information and aims to establish a framework for data accountability and governance while safeguarding individual privacy. The Indian healthcare sector, currently in the early stages of digital transformation, will be significantly affected by the DPDP Act. This legislation specifically addresses digital personal data and does not cover non-personal data. Once the DPDP Act provisions are implemented, it will supersede the Information Technology (Sensitive Personal Data or Information) Rules of 2011 and Section 43A of the IT Act, which deal with the legal and ethical challenges of digital health. Section 4: Grounds for processing personal data.
This section emphasizes purpose limitation, mandating that personal data be collected only for specific, legitimate purposes, which is essential for AI systems to justify their data collection. There are two lawful bases for processing personal data15: ● The data principal has given their consent ● The processing is for certain legitimate uses Section 5: Notice Before requesting consent from a Data Principal, the Data Fiduciary must provide a notice16. Notice content The notice must include the following information:
15 Digital Personal Data Protection Act, § 4, 2023, (India).
16 Digital Personal Data Protection Act, § 5, 2023, (India).
● The personal data being requested ● The purpose for processing the data ● How can the Data Principal exercise their rights ● How the Data Principal can file a complaint Data Principal withdrawal If a Data Principal withdraws their consent, the Data Fiduciary must stop processing the Data Principal's personal data within a reasonable time. Section 6: Consent The Data Principal's consent17 needs to be unambiguous, free, explicit, informed, and unconditional. It must also be limited to the personal data required for the specified purpose. Section 11: Right to access information about personal data. This section enables the Data Principal the right to access information about their personal data18: ● The Data Principal can request a summary of the personal data being processed by the Data Fiduciary.
● The Data Principal can request a list of other Data Fiduciaries and Data Processors that the personal data has been shared with. ● The Data Principal can request any other information related to their personal data and its processing. The Data Principal can submit a written request to the Data Fiduciary to exercise these rights. The Data Fiduciary is then required to provide the requested information in a timely manner.
17 Digital Personal Data Protection Act, § 6, 2023, (India).
18 Digital Personal Data Protection Act, § 11, 2023, (India).
Section 12: Right to correction and erasure of personal data This section provides Data Principals the right to request the correction, completion, updating, and erasure of their personal data19. To exercise these rights, Data Principals can submit a written request to the Data Fiduciary. The Data Fiduciary must then review the request and make the necessary changes in a timely manner. Section 13: Right of grievance redressal. This section gives data principals the right to grievance redressal20. This means that if a data principal has concerns about how their personal data is being processed, they can raise a grievance with the Data Fiduciary or Consent Manager. The Data Fiduciary or Consent Manager must respond to the grievance within a prescribed timeframe. Section 14: Right to nominate.
A Data Principal can nominate21 another person to exercise their rights if they are unable to do so themselves due to death or incapacity. Incapacity is defined as an inability to exercise rights due to unsoundness of mind or physical infirmity.
6.4 JUDICIAL INTERPRETATION
India, as a developing nation, has recently embraced technological advancements in healthcare. However, these innovations are not yet well-regulated, as evidenced in the case of Kumar Mohammed Rafique v. Municipal Corporation of Greater Bombay22, where the malfunction of an artificial device tragically claimed the life of an eleven-year-old boy. The victim, Mohamed Rafiq Haji Umar, fell from a bus and was taken to the hospital in a semi-conscious state. Diagnosed with a hematoma, he underwent surgery at Bombay Hospital, where a Ventriculoarterial Shunt was inserted to drain cerebrospinal fluid from the brain to the heart. This shunt, which had been repaired twice before, was still used by the hospital despite its known issues. Its failure led to hydrocephalus, causing increased intracranial pressure and ultimately the loss of the child's life.
This incident highlights a violation of Article 21 of the
19 Digital Personal Data Protection Act, § 12, 2023, (India).
20 Digital Personal Data Protection Act, § 13, 2023, (India).
21 Digital Personal Data Protection Act, § 14, 2023, (India).
22 Kumar Mohammed Rafique v. Municipal Corporation of Greater Bombay 2(1986)ACC42
Indian Constitution, which guarantees the right to life, as the government was negligent in regulating a device with a known risk of malfunction. The absence of stringent evaluations for medical robotic devices used in surgeries can result in further innocent lives being lost. Therefore, the government must introduce strict laws to ensure the regular assessment and maintenance of such artificial robotic devices in hospitals, helping to prevent such tragedies in the future. In the case of Sanjay Shyamsundar Sharma vs. State of Gujarat23, the applicant raised concerns over irregularities in the procurement of the "Robotic Assistant Surgery Instrument" at Civil Hospital, Ahmedabad. Sanjay petitioned the court to initiate steps for replacing the instrument to ensure that the general public could benefit from modernized equipment for knee and hip replacement surgeries. Advocate Mr.
Majmudar, referencing various case-related documents, revealed that public funds amounting to eleven crore rupees were spent on procuring the instrument. Despite such a significant investment, only three surgeries were performed over a span of six to seven years. The instrument was later presented to the Additional Director of Medical Education and Research for evaluation, but it was discontinued due to the absence of a recognized brand. This case sheds light on one of the few instances where such issues are formally addressed, though many people may attribute the loss of loved ones to the severity of their conditions, unaware of the potential flaws in the equipment used. To enhance patient safety, the government should require hospitals to not only disclose the surgical procedures but also ensure transparency regarding the authenticity and reliability of the devices used in surgeries.
In the case of Prem Kishore vs. Union of India and Ors24, Urmila Devi underwent a "Robotic Ureterolysis" procedure at Shri Ganga Ram Hospital to remove a fibroid from her ureter. The petitioner claimed that during the surgery, the doctor mistakenly cut the external iliac artery. Rather than addressing the issue immediately, the medical team applied hemoclips and sutures to the artery and continued with the robotic surgery for an additional three hours. As a result, the patient experienced significant blood loss, leading to acute kidney failure. Although the patient suffered two cardiac arrests, she was revived both times. However, she later suffered a third cardiac arrest after thirty minutes and was declared dead. The excessive reliance on robotic surgery contributed to an error in judgment, as the surgeon only switched to open
23 Sanjay Shyamsundar Sharma vs. State of Gujarat
24 Prem Kishore vs. Union of India and Ors
surgery later in the operation, leading to further complications and ultimately, cardiac arrest. This case of medical negligence could have been avoided with stricter regulations, requiring mandatory training and licensing for doctors performing surgeries with robotic devices.
CHAPTER III
CONCLUSION
Artificial intelligence (AI) has significant potential to transform patient care in the health sector by improving diagnostic accuracy and enhancing operational efficiency. This paper underscores the importance of balancing innovation with ethical and legal considerations, particularly regarding data privacy, informed consent, and accountability, which necessitate clear regulatory frameworks. For the responsible integration of AI into healthcare, developing comprehensive guidelines that protect patient rights, foster transparency, and ensure compliance with ethical and legal standards is essential. As AI technologies evolve, collaboration among healthcare providers, policymakers, and technologists becomes crucial to maximize the benefits while addressing inherent risks.
While AI can streamline processes and offer personalized treatments, it also raises issues related to bias, patient autonomy, and data security. Furthermore, legal challenges concerning liability for AI-related harm highlight the need for well-defined regulatory structures to effectively guide implementation. Striking a balance between progress and caution is vital for maintaining trust in healthcare systems and ensuring that AI enhances, rather than undermines, patient care. Looking ahead, while AI may not fully replace clinical decision-making, it can significantly improve clinicians' decision-making processes. In resource-constrained environments, AI could be instrumental in conducting screenings and evaluations where medical expertise is limited.
However, the progression of AI beyond specific tasks relies on various factors, including the trust that healthcare providers, patients, and professionals have in AI technologies. This paper will delve into the ethical concerns and risks tied to the expanding use of AI in healthcare, emphasizing the responsibilities associated with deploying and developing these technologies. The discussion will address technological, legal, security, and ethical challenges, aiming not to discourage AI utilization in health but to ensure it fulfills its considerable potential and promise.
CHAPTER IV
RECOMMENDATIONS
Here are some recommendations on the use of AI in healthcare: ● To address issues peculiar to AI, the Information Technology Act of 2000 should be updated and made compatible with the Digital Personal Data Protection Act of 2023. ● Establish a unified legal framework, equivalent to the European AI Act, that addresses AI applications in healthcare specifically. This framework should require stringent oversight for high-risk applications and categorize AI systems according to risk levels. ● Evidently state who is responsible for harm caused by AI. Assign responsibility to institutions, developers, and healthcare providers according to their roles in developing and managing AI systems. ● Strengthen data protection norms to ensure compliance with Section 43A of the IT Act and the DPDP Act's provisions on purpose limitation, consent, and rights to correction and erasure of personal data.
● Mandate human oversight in decision-making processes involving AI, particularly in high-risk applications such as diagnostics and treatment recommendations, as emphasized in Article 14 of the European AI Act. ● In Japan, the AI Utilization Promotion Council engages with the public to ensure transparency and foster trust in AI technologies. We recommend that India should also establish such a council to address these concerns. ● The WHO has released the Ethics and Governance of Artificial Intelligence for Health guidelines, recommending equitable AI use globally. India should adopt AI healthcare policies with WHO guidelines to promote global interoperability and equity in AIdriven healthcare solutions.
CHAPTER V
REFERENCES
1. Roy, A. and Kant, A., 2018. National strategy for artificial intelligence# AIFORALL.
India: NITI AYOG.
2 Ethics and governance of artificial intelligence for health
WHO guidance. Geneva: World Health Organization; 2021. License: CC BY-NC-SA 3.0 IGO.
3. Cell, D.I.A.I., 2023. Ethical guidelines for application of Artificial Intelligence in
Biomedical Research and Healthcare.
4. Ditipriya Dutta Chowdhury, Role of AI in Healthcare and Its Licensing Framework in
India, 9 NUJS J. REGUL. STUD. 25 (January-March 2024)
5. Chikhaoui, E., Alajmi, A. and Larabi-Marie-Sainte, S., 2022. Artificial intelligence
applications in the healthcare sector: ethical and legal challenges. Emerging Science Journal, 6(4), pp.717-738.
6 Das, S.K., Dasgupta, R.K., Roy, S.D. and Shil, D., 2024. AI in Indian healthcare
From roadmap to reality. Intelligent Pharmacy.
7 Williamson, S.M.; Prybutok, V. Balancing Privacy and Progress
A Review of Privacy Challenges, Systemic Oversight, and Patient Perceptions in AI-Driven Healthcare. Appl. Sci. 2024, 14, 675. https:// doi.org/10.3390/app14020675
8. Nair, R., 2022. Criminal Liability of Artificial Intelligence in Healthcare and Medical
Services. Issue 5 Indian JL & Legal Rsch., 4, p.1.
9. Naik, N., Hameed, B.Z., Shetty, D.K., Swain, D., Shah, M., Paul, R., Aggarwal, K.,
Ibrahim, S., Patil, V., Smriti, K. and Shetty, S., 2022. Legal and ethical consideration in artificial intelligence in healthcare: who takes responsibility? Frontiers in surgery, 9, p.862322.
10 Jain, D., 2023, March. Regulation of digital healthcare in India
ethical and legal
challenges
In Healthcare (Vol. 11, No. 6, p. 911). MDPI.
11 Parry, C.M. and Aneja, U., 2020. Artificial Intelligence for Healthcare
Insights from India.
12. Al Kuwaiti, A., Nazer, K., Al-Reedy, A., Al-Shehri, S., Al-Muhanna, A., Subbarayalu,
A.V., Al Muhanna, D. and Al-Muhanna, F.A., 2023. A review of the role of artificial intelligence in healthcare. Journal of personalized medicine, 13(6), p.951.