IndiaAI scales up efforts to tackle Deepfake detection, bias mitigation and AI penetration testing

New Delhi, (UNI) IndiaAI Mission has selected five projects focusing on Deepfake Detection,Bias Mitigation and Penetration Testing & Evaluation to foster its ‘Safe & Trusted’ AI efforts, an official statement said today.

Under the theme of ‘Deepfake Detection Tool’, IIT Jodhpur (CI) and IIT Madras will jointly develop ‘Saakshya,’ which is a multi-agent, Retrieval-Augmented Generation (RAG)- enhanced framework for deepfake detection and governance.

Moreover, IIT Mandi & Directorate of Forensic Services, Himachal Pradesh will collaborate on ‘AI Vishleshak’, which aims to improve audio-visual deepfake detection and handwritten signature forgery detection with adversarial robustness, explainability and domain generalization.

IIT Kharagpur will assist in the development of a real-time voice deepfake detection system.

Under the theme of ‘Bias Mitigation,’ the Digital Futures Lab & Karya will evaluate gender bias in agriculture Large Language Models (LLMs), creating Digital Public Goods (DPG) for benchmarking and fair data work.

Under the theme of ‘Penetration Testing & Evaluation’, Globals ITES Pvt Ltd & IIIT Dharwad will collaborate on Anvil which is an penetration Testing & Evaluation tool for LLM and Generative AI.

The five selected projects under the second Expression of Interest (EoI) demonstrate IndiaAI’s commitment to translating the vision of Safe & Trusted AI into concrete solutions.

Moreover, these initiatives will advance real-time deepfake detection, strengthen forensic analysis, address bias in AI models and build robust evaluation tools for generative AI.

This will ensure that AI systems deployed in India are reliable, secure and inclusive.

By bringing together leading academic institutions, industry partners and civil society, the IndiaAI mission will continue to foster innovation, ethical practices and a resilient AI ecosystem that serves the diverse needs of the nation.

More than 400 proposals were received from reputed academic institutions, start-ups, research organisations and civil society, and a multi-stakeholder group was created to provide technical expertise for the evaluation of proposals.

It resulted in the selection of five projects across various themes. Collectively, these projects translate ‘Safe & Trusted AI’ into practice, combining resilience testing, bias audits to support the responsible development and deployment of AI.

IndiaAI, an Independent Business Division under MeitY, is an implementation agency for the IndiaAI mission. It strives to democratize the benefits of AI across all strata of society and further bolsters India’s leadership in AI.

 

 

Leave a Reply