NewKerala.com

Key Points

India has launched five new AI safety projects through the IndiaAI Mission to address critical digital threats. These initiatives focus on detecting deepfakes, mitigating bias in AI systems, and conducting security testing. Leading institutions including IIT Jodhpur, IIT Madras, and IIT Mandi are developing cutting-edge solutions. The projects aim to make AI safer and more transparent for all users across the country.

Key Points: IndiaAI Scales Up Safe AI with Deepfake Detection and Bias Mitigation

  • IIT Jodhpur and Madras develop Saakshya framework for advanced deepfake detection
  • IIT Mandi creates AI Vishleshak for detecting audio-visual deepfakes
  • Digital Futures Lab evaluates gender bias in agriculture language models
  • Globals ITES builds Anvil for penetration testing of large language models
3 min read

IndiaAI scales up safe AI efforts with cutting-edge solutions for Deepfake Detection, Bias Mitigation and AI Penetration Testing

IndiaAI Mission selects 5 pioneering projects for deepfake detection, bias mitigation, and AI security testing to ensure safe and ethical AI use nationwide.

"India has taken another major step toward ensuring the safe and ethical use of Artificial Intelligence - Ministry of Electronics and IT"

New Delhi, October 7

India has taken another major step toward ensuring the safe and ethical use of Artificial Intelligence (AI) through the IndiaAI Mission's new set of projects aimed at strengthening deepfake detection, bias mitigation, and AI security testing. The Ministry of Electronics and Information Technology (MeitY) announced the selection of five pioneering projects under the "Safe & Trusted AI" pillar of the IndiaAI initiative, as per a press release by the Ministry.

New Delhi [India], October 7 (ANI): India has taken another major step toward ensuring the safe and ethical use of Artificial Intelligence (AI) through the IndiaAI Mission's new set of projects aimed at strengthening deepfake detection, bias mitigation, and AI security testing. The Ministry of Electronics and Information Technology (MeitY) announced the selection of five pioneering projects under the "Safe & Trusted AI" pillar of the IndiaAI initiative, as per a press release by the Ministry.

The announcement marks the conclusion of the second round of Expression of Interest (EoI), which was launched on December 10, 2024. The initiative received more than 400 proposals from across the country, including submissions from academic institutions, research bodies, start-ups, and civil society groups. A multi-stakeholder committee with technical experts evaluated these proposals, finally choosing five that promise to make AI safer and more transparent.

Among the selected projects, IIT Jodhpur and IIT Madras will jointly develop 'Saakshya', a multi-agent, RAG-enhanced framework for deepfake detection and governance. This project focuses on tackling one of the most urgent threats in the digital space, AI-generated misinformation and manipulated media.

IIT Mandi, in collaboration with the Directorate of Forensic Services, Himachal Pradesh, will lead 'AI Vishleshak', which aims to improve the detection of audio-visual deepfakes and forged signatures through explainable and robust AI models.

IIT Kharagpur will work on a 'Real-Time Voice Deepfake Detection System', enhancing India's capacity to counter emerging voice-cloning technologies.

Under the theme of bias mitigation, Digital Futures Lab and Karya will evaluate gender bias in agriculture language models, creating digital public goods for fair data benchmarking. Meanwhile, Globals ITES Pvt Ltd and IIIT Dharwad will jointly build Anvil, a penetration testing and evaluation tool designed to assess the safety of large language models (LLMs) and generative AI systems.

The IndiaAI Mission implemented by IndiaAI, an Independent Business Division under MeitY, continues to focus on democratizing AI access and ensuring its responsible use. It strives to democratize the benefits of AI across all strata of society, bolster India's leadership in AI, foster technological self-reliance, and ensure the ethical and responsible use of AI.

- ANI

Share this article:

Reader Comments

R
Rohit P
Finally addressing AI bias! The gender bias study in agriculture models is much needed. Our rural women farmers deserve fair representation in technology. Hope this leads to real impact on the ground.
A
Arjun K
Great to see IITs leading this initiative. The voice deepfake detection system from IIT Kharagpur is particularly important given how many scams happen through phone calls. Jai Hind! 🙏
S
Sarah B
While this is a positive step, I hope the implementation is transparent and accessible to smaller startups too. Sometimes these government initiatives remain limited to big institutions. The proof will be in how these tools reach common citizens.
V
Vikram M
𝗔𝗰𝗵𝗵𝗲 𝗱𝗶𝗻 𝗵𝗮𝗶𝗻! India taking proactive steps in AI safety while the world is still debating regulations. The collaboration between academic institutions and industry shows we're serious about building Atmanirbhar AI ecosystem.
M
Michael C
Impressive to see India moving so decisively on AI safety. The penetration testing tool 'Anvil' could become a global standard if executed well. Looking forward to seeing the outcomes!

We welcome thoughtful discussions from our readers. Please keep comments respectful and on-topic.

Leave a Comment

Minimum 50 characters 0/50